ML051240377
| ML051240377 | |
| Person / Time | |
|---|---|
| Site: | LaSalle  |
| Issue date: | 03/07/2005 |
| From: | Palagi B NRC/RGN-III/DRS/OLB |
| To: | |
| Shared Package | |
| ML050900103 | List: |
| References | |
| 50-373/05-301, 50-374/05-301 50-373/05-301, 50-374/05-301 | |
| Download: ML051240377 (13) | |
Text
NRC COMMENTS ON THE PROPOSED OPERATING TEST AND THE PROPOSED WRITTEN EXAM ON ES-401-9 FOR THE LASALLE INITIAL EXAMINATION - MARCH 2005
COMMENTS ON LASALLE 2005 PROPOSED OPERATING TEST Examination Section Scenario 1 Scenario 2
~-~
~
Scenario 3 ADMIN JPM 1 ADMIN JPM 2 ADMIN JPM 3 ADMIN JPM 4 ADMIN JPM 5 SIM JPM 1 SIM JPM 4 SIM JPM 6 Comment In Event 4, switch actions to be taken by RO and BOP.
In Event 5, add steps for RO to check for core stability.
~~~~
~
In scenario outline, reword event 6 description.
In Event 1, add steps to stop A pump and reopen discharge valve.
In Event 5, add insertion of cram rods to Critical task.
In Event 2, change trigger so rod will move at about 475 psig.
~~
~
In Initial Cue, state computerized log out of service.
Make location of Status tag not critical.
Add cue for action required for removal.
Make recording location of tag placement critical.
Aline APRM reading and GAFS on CORE PERFORMANCE LOG.
~~
Have ER-AA-321 and Tech Spec available but do not provide with JPM.
~~
~
~
Add review of area rad map to cue.
Changed Initial Cue to be less leading.
Minor cue changes.
Changed Initial Cue to provide pressure band.
Deleted stem 5 and 6.
Made last two steps of step E.33 critical.
Made steps of E.34 critical Added steps to place generator voltage control in automatic to end of JPM.
In step D.4 changed voltage set point to match procedure.
ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
Explanation E
NEW Question: What are the sources of two temperature signals? If bottom head drain temp is used reword question. May need to change to "What is the purpose of..." Also can " B be a correct answer? High differential temperature could be indicative of inadequate RT bottom head drain flow.
Resolution: Question reworded to correct problems noted.
S NEW S
NEW Instructions
[Refer to Section D of ES-401 and Appendix 6 for additional information regarding each of the following concepts.]
- 1.
- 2.
- 3.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
Check the appropriate box if a psychometric flaw is identified:
e.
e.
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated truelfalse statements.
The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4.
Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (Le., the question has a valid WA but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
- 5.
- 6.
- 7.
Check auestions that are sampled for conformance with the approved WA and those that are designated SRO-only (WA and license level mismatches are unacceptable).
Based on the reviewer's judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric ahributes are not being met).
- 30 question sample
2 Form ES-401-9 ES-401, Rev. 9
- 6.
- 7.
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws Q#
LOK LOD lack-Focus Nard (F/H)
(1-5) Stem 4
H 2
5 F
3 6#
H 3
7#
F 3
X 8#
F 3
9#
F 3
10 H
3 J/VS I
- 5. Other Q= SRO WA Only Explanation E
NEW Editorial: This question appears to be higher order not F as submitted.
Question: What will be the effect of the stuck open stop valve? Will this lead to a scram? If so could one argue to a different correct answer?
S U -
E S
S E
Resolution: Question changed to higher order. It was verified that a scram would not occur.
NEW NEW Comment: If A was correct B would also be correct knowing there is only one correct answer candidates will never pick A. Consider changing A to one rod at 48 one rod at 02.
i Resolution: Stem reworded to eliminate the concern.
NEW Comment: We are testing if the candidate knows which valves are interlocked with Shutdown Cooling Suction not which are not interlockel How about asking, Which of the following valves have an interlock requiring it to be closed before 1 E l 2-F006B, Shutdown Cooling Suctior can be opened. Then list the 4 valves in groups of three.
Resolution: Question reworded as suggested.
BANK BANK NEW Editorial: This question appears to be higher order not F as submitted.
Resolution: Question changed to higher order.
- 4. Job Content Flaws
- 5. Other
- 7.
artial -
dinutia Explanation WODIFIED
>omment: Review with site that they agree " A is clearly wrong, althougt
- he low pool level is causing the low suction pressure. Consider
- hanging "...trip on low Spent Fuel Pool level..." to "...trip on low Spent Fuel Pool level signal...".
Resolution: Distractor " A reworded as suggested.
BANK U
S NEW Comment: KA is Rx pressure, question is Containment pressure.
Resolution: Question replaced.
NEW S
MODIFIED S
E -
S NEW NEW Comment: I don't think distracters " A and "B" are credible. Would Accept:
A. One SBLC pump and Continuity lights lit.
B. Two SBLC pump and Continuity lights lit.
C. One SBLC pump and Continuity lights out.
D. Two SBLC pump and Continuity lights out.
Resolution: Site felt distracters " A and "B" were credible, however mad6 change suggested above.
NEW S
NEW S
S S
BANK NEW NEW S
NEW
Q#
24
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
LOK LOD (FIH)
(1-5) Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-Q= SRO U/WS Explanation Focus Dist.
Link units ward WA Only H
4 S
NEW
ES-401. Rev. 9 3
Form ES-401-9
- 6.
UlUS
>red.
p& -
Explanation
- 4. Job Content Flaws
- 5. Other -
330
- MODIFIED Comment: I am concerned about the stem change. The question was modified from a stem that said one CW pump trips, to a stem that leads to only one CW pump left running. Will this lead to a scram making answer "0" correct? Also what is "condensate depression" the term
, used in answer "D".
- 7.
E
~~
~~
NEW Comment: Consider changing distracter "C" to "1C VR Exahaust Fan wil trip OFF on High differential pressure." As it is I can't see anyone picking an answer which predicts pressure.
Resolution: Suggested change was made.
reactor building differential S
E S
Resolution: Stem changed from full power to 70% power to eliminate thc possibility of a scram. Candidates are familiar with the term "condensate depression".
NEW MODIFIED Editorial: This question appears to be higher order not F as submitted.
Resolution: Question changed to higher order.
BANK E
S NEW Comment: Consider changing The correct answer to "however RClC suction will re-align to SP and the minimum flow valve will open" Resolution: Suggested change was made.
NEW s INEW
u E
n B
zl u) u)
Q I 0
C 0
c (D
c c
5 U
C zl LI a,
0 Q
a, II m
C 0
u) 0-n e
n c
c
?
C 8 c
0 m
c D
9 a,
m C
0 U
a, v) c m
n C
E
!?
9 3
0 c
u) 2 0
U 0,
!?
n
!?
c P
c 0
!?
B a,
C 0
c 0
m Q
3
!?
5 a,
f m
a, 0
n c
-8 E
3
!?
tj 2 %
a m 0
s C
0 e
0 3
- E 0
0 c
5 u) 0 0
a D
a, a,
c (D
5 z r"
K 0
m c
m e
n I2 W
W W
I x X
N N
N L
I L
I I
ro m
rn m
ES-401, Rev. 9 4
Form ES-401-9 NEW NEW It
- 7.
Explanation 3ANK VEW YEW VEW YEW BANK NEW NEW II NEW BANK Comment: Consider changing wording of third sentence of stem to, During this operation the control rod drive collet finger fail in the disengaged position. This would better match the procedure reference.
Resolution: Suggested change was made.
NEW NEW NEW NEW NEW NEW II
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other Q#
LOK LOD (F/H) (1-5)
Stem Cues T/F Cred. Partial Job-Minutia
- I Back-Q= SRO Focus Dist.
Link units ward WA Only 63#
F 2
64 H
3
- 6.
- 7.
U/WS Explanation S
NEW S
NEW
ES-401, Rev. 9 5
Form ES-401-9
- 6.
UIWS Explanation S
S S
NEW MODIFIED NEW 56 37 58 59 70 71 72 73 74 75 76 77 78 H
H H#
H F
H F
H#
F F
H#
H#
F#
S Resolution: Site decided to replace the question because further validation lead to the question being viewed as an SRO level question.
NEW S
S S
NEW Comment: 10CFR20 will allow doses up to 25 rem, check that the site will support 10 rem as the only correct answer.
Resolution: Stem changed to eliminate an question that 25 rem was an incorrect answer.
BANK BANK S
S S
NEW NEW NEW
- 2.
-OD
'1 -5) -
2
- 7.
- 4. Job Content Flaws
- 5. Other
- 3. Psychometric Flaws
- ues TIF I 2
3 -
2 s
3 3 -
2 S
E -
BANK NEW Comment: Check the answer I think " D may be the right answer for in reactor fuel moves. If so CHANGE " while performing component movements within the Unit-2 reactor or spent fuel storage pool." to %her fuel is being moved within the Unit-2 reactor."
3 2
2 -
3 s NEW 3
3 -
3 -
I
- 4. Job Content Flaws
- 5. Other lob-Minutia
- /
Back-Q= SRO
-ink units ward WA Only T/F
- 6.
- 7.
U/WS Explanation E
NEW Comment: Distracter "D" not credible, no one would see maintaining water level as increasing time to boil, how about something like "direct maintaining RPV level between 30 and 40 inches providing time to boil is calculated to be more than two hours." provided that would be wrong.
Resolution: Distracter "D" changed.
S NEW S
MODIFIED S
NEW S
NEW Comment: Can we expect operators to know there are 200 GAUINCH ir the reactor?
'artia S
Resolution: Confirmed with validation staff that this is a site expectation.
BANK
ES-401, Rev. 9 6
Form ES-401-9 J/US 6' 1
- 7.
Explanation I
S NEW il s
!NEW s INEW s INEW S
NEW S
NEW s INEW s INEW I1 s INEW s
(MODIFIED II s
!NEW U
NEW Comment: KA 2.4.49 is Ability to perform without ref to procedure... immediate operation (2.4 Emergency ProcedureslPlan).
Question is Immediate Tech Spec in a non emergency condition (KA 2.1.1 1.)
Resolution: Question was replaced.