ML051240377
| ML051240377 | |
| Person / Time | |
|---|---|
| Site: | LaSalle  |
| Issue date: | 03/07/2005 |
| From: | Palagi B NRC/RGN-III/DRS/OLB |
| To: | |
| Shared Package | |
| ML050900103 | List: |
| References | |
| 50-373/05-301, 50-374/05-301 50-373/05-301, 50-374/05-301 | |
| Download: ML051240377 (13) | |
Text
NRC COMMENTS ON THE PROPOSED OPERATING TEST AND THE PROPOSED WRITTEN EXAM ON ES-401-9 FOR THE LASALLE INITIAL EXAMINATION MARCH 2005
COMMENTS ON LASALLE 2005 PROPOSED OPERATING TEST Examination Section Comment Scenario 1 In Event 4, switch actions to be taken by RO and BOP.
In Event 5, add steps for RO to check for core stability.
~~~~ ~
Scenario 2 In scenario outline, reword event 6 description.
In Event 1, add steps to stop Apump and reopen discharge valve.
In Event 5, add insertion of cram rods to Critical task.
~-~ ~
Scenario 3 In Event 2, change trigger so rod will move at about 475 psig.
~~ ~
ADMIN JPM 1 In Initial Cue, state computerized log out of service.
Make location of Status tag not critical.
Add cue for action required for removal.
Make recording location of tag placement critical.
ADMIN JPM 2 Aline APRM reading and GAFS on CORE PERFORMANCE LOG.
~~
ADMIN JPM 3 Have ER-AA-321 and Tech Spec available but do not provide with JPM.
~~ ~ ~
ADMIN JPM 4 Add review of area rad map to cue.
ADMIN JPM 5 Changed Initial Cue to be less leading.
SIM JPM 1 Minor cue changes.
Changed Initial Cue to provide pressure band.
Deleted stem 5 and 6.
SIM JPM 4 Made last two steps of step E.33 critical.
Made steps of E.34 critical Added steps to place generator voltage control in automatic to end of JPM.
SIM JPM 6 In step D.4 changed voltage set point to match procedure.
ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Explanation E NEW Question: What are the sources of two temperature signals? If bottom head drain temp is used reword question. May need to change to "What is the purpose of ..." Also can " B be a correct answer? High differential temperature could be indicative of inadequate RT bottom head drain flow.
Resolution: Question reworded to correct problems noted.
S NEW S NEW Instructions
[Refer to Section D of ES-401 and Appendix 6 for additional information regarding each of the following concepts.]
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamentalor (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
- 3. Check the appropriate box if a psychometric flaw is identified:
e The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc).
e The answer choices are a collection of unrelated truelfalse statements.
The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
.. The question is not linked to the job requirements (Le., the question has a valid WA but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
- 5. Check auestions that are sampled for conformance with the approved WA and those that are designated SRO-only (WA and license level mismatches are unacceptable).
- 6. Based on the reviewer's judgment, is the question as written (U)nsatisfactory(requiring repair or replacement), in need of (E)ditorialenhancement, or (S)atisfactory?
- 7. At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric ahributes are not being met).
- 30 question sample
ES-401, Rev. 9 2 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q# LOK (F/H)
LOD (1-5) Stem Focus lack- Q= SRO Nard WA Only J/VS I Explanation 4 H 2 E NEW Editorial: This question appears to be higher order not F as submitted.
Question: What will be the effect of the stuck open stop valve? Will this lead to a scram? If so could one argue to a different correct answer?
Resolution: Question changed to higher order. It was verified that a scram would not occur.
5 F 3 - S NEW 6# H 3 U NEW Comment: If A was correct B would also be correct knowing there is only one correct answer candidates will never pick A . Consider changing A to one rod at 48 one rod at 02.
i Resolution: Stem reworded to eliminate the concern.
7# F 3 X E NEW Comment: We are testing if the candidate knows which valves are interlocked with Shutdown Cooling Suction not which are not interlockel How about asking, Which of the following valves have an interlock requiring it to be closed before 1E l 2-F006B, Shutdown Cooling Suctior can be opened. Then list the 4 valves in groups of three.
Resolution: Question reworded as suggested.
8# F 3 S BANK 9# F 3 S BANK 10 H 3 E NEW Editorial: This question appears to be higher order not F as submitted.
Resolution: Question changed to higher order.
- 4. Job Content Flaws 5. Other 7.
artial dinutia Explanation WODIFIED
>omment: Review with site that they agree " A is clearly wrong, althougt
- he low pool level is causing the low suction pressure. Consider
- hanging "...trip on low Spent Fuel Pool level..." to "...trip on low Spent Fuel Pool level signal..." .
Resolution: Distractor " A reworded as suggested.
BANK U NEW Comment: KA is Rx pressure, question is Containment pressure.
- Resolution: Question replaced.
S NEW S MODIFIED S NEW E NEW Comment: I don't think distracters " A and "B" are credible. Would Accept:
A. One SBLC pump and Continuity lights lit.
B. Two SBLC pump and Continuity lights lit.
C. One SBLC pump and Continuity lights out.
D. Two SBLC pump and Continuity lights out.
Resolution: Site felt distracters " A and "B" were credible, however mad6
- change suggested above.
S NEW S NEW S BANK S NEW S NEW S NEW
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q# LOK LOD (FIH) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/WS Explanation Focus Dist. Link units ward WA Only 24 H 4 S NEW
ES-401. Rev. 9 3 Form ES-401-9
- 4. Job Content Flaws
- 5. Other 6. 7.
>red.
p 330 U l U S Explanation MODIFIED Comment: I am concerned about the stem change. The question was modified from a stem that said one CW pump trips, to a stem that leads to only one CW pump left running. Will this lead to a scram making answer "0"correct? Also what is "condensate depression" the term
, used in answer "D".
Resolution: Stem changed from full power to 70% power to eliminate thc possibility of a scram. Candidates are familiar with the term "condensate depression".
~~ ~~
E NEW Comment: Consider changing distracter "C"to "1C VR Exahaust Fan wil trip OFF on High differential pressure." As it is I can't see anyone picking an answer which predicts reactor building differential pressure.
Resolution: Suggested change was made.
S NEW E MODIFIED Editorial: This question appears to be higher order not F as submitted.
Resolution: Question changed to higher order.
S BANK s INEW E NEW Comment: Consider changing The correct answer to "however RClC suction will re-align to SP and the minimum flow valve will open" Resolution: Suggested change was made.
S NEW
C u 8 B
E c c n 0 0 zl u) !? c m
u)
Q B a,
D 9
I C a, c
0 0 .-
c
-C - c m
C c
0 0 0 c m U (D Q a, K U 5 0 3
!? n v) m
.-e 0
C a, .-C zl 5
m c
LI a,
c 0
f E
- m n
n 0
5 u) m
!?
I2 c
-0 n a, 9 3
e 0 a
0 Q
a, - c 0 cu)
D I
n m
I a, a, -8 !?
c E c 2
C (D 0 ._
0
.-0 5 3 n z
c u) !? U
?
0-r" tj s P 0,
!?
C
.-e 0
2 %
0 3
- E am W W W Ix X
N N N I I L I L ro
- rn m m
ES-401, Rev. 9 4 Form ES-401-9 It 7.
Explanation 3ANK VEW YEW VEW YEW BANK NEW NEW II NEW BANK Comment: Consider changing wording of third sentence of stem to, During this operation the control rod drive collet finger fail in the disengaged position. This would better match the procedure reference.
Resolution: Suggested change was made.
NEW NEW NEW NEW NEW NEW II NEW NEW
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #I Back- Q= SRO U/WS Explanation Focus Dist. Link units ward WA Only 63# F 2 S NEW 64 H 3 S NEW
ES-401, Rev. 9 5 Form ES-401-9
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
-OD
'1-5) 2 I
- ues TIF UIWS S NEW Explanation S
56 H
- 2 MODIFIED 37 H 3 S NEW 58 H# 2 s 59 H
- 3
- S BANK 70 F 3 E NEW Comment: Check the answer I think " D may be the right answer for in reactor fuel moves. If so CHANGE " while performing component movements within the Unit-2 reactor or spent fuel storage pool." to %her fuel is being moved within the Unit-2 reactor."
Resolution: Site decided to replace the question because further
- validation lead to the question being viewed as an SRO level question.
71 H 2 S NEW 72 F 3 S NEW Comment: 10CFR20 will allow doses up to 25 rem, check that the site will support 10 rem as the only correct answer.
Resolution: Stem changed to eliminate an question that 25 rem was an incorrect answer.
73 H# 2 S BANK 74 F 2 S BANK 75 F 3 s NEW 76 H#
- 3 S NEW 77 H# 3 S NEW 78 F# NEW
- 3 S
- 4. Job Content Flaws 5. Other 6. 7.
T/F 'artia lob- Minutia #/ Back- Q= SRO U/WS Explanation
-ink units ward WA Only E NEW Comment: Distracter "D" not credible, no one would see maintaining water level as increasing time to boil, how about something like "direct maintaining RPV level between 30 and 40 inches providing time to boil is calculated to be more than two hours." provided that would be wrong.
Resolution: Distracter "D"changed.
S NEW S MODIFIED S NEW S NEW Comment: Can we expect operators to know there are 200 GAUINCH ir the reactor?
Resolution: Confirmed with validation staff that this is a site expectation.
I S BANK
ES-401, Rev. 9 6 Form ES-401-9 6'
J/US S
1 I
NEW 7.
Explanation il s !NEW s N IEW s INEW S NEW S NEW s INEW s INEW 1I s INEW s (MODIFIED II s !NEW U NEW Comment: KA 2.4.49 is Ability to perform without ref to procedure...immediate operation (2.4 Emergency ProcedureslPlan).
Question is Immediate Tech Spec in a non emergency condition (KA 2.1.1 1.)
Resolution: Question was replaced.