ML032680797
| ML032680797 | |
| Person / Time | |
|---|---|
| Site: | Palisades  |
| Issue date: | 07/21/2003 |
| From: | Lanksbury R NRC/RGN-III/DRS/OLB |
| To: | Nuclear Management Co |
| References | |
| 50-255/03-301 | |
| Download: ML032680797 (17) | |
Text
NRC COMMENTS TO INITIAL EXAM SUBMITTAL INCLUDING ES-401-9 AND OPERATING COMMENTS FOR THE PALISADES INITIAL EXAMINATION - JULYIAUG 2003
ES-401 Written Examination Form ES-401-9 Review Worksheet The first 25 questions are only on the RO Exam, the next 75 questions on both exams, and questions 101-125 are SRO ONLY questions. Q I-10,30-40, 101-1 11 for initial review.
30% of questions reviewed for clarity, KA conformance, & independent verification of references indicated
- 7.
Explanation No correct answer. Correct answer is to start available SW pumps.
Answer is correct for this station as wriffen.
EOP is required to answer the question, WA requires use of ARM.
Modified Question to ensure ARM reference.
Add to stem, 'initial power was stable at 100% for the last 30 days.
added Add to stem: The plant was at 89% power for 7 davs when...
Change stem to: Two (21 control rods will...
Reword question in stem to: What effect, if any, will the loss of the Wide Range Nls have on the Reactor Operator's ability to check the status of the Reactivity Control safety function? Seven is correct. Two makes distractor b. correct Deleted 2nd reference to loss of wide range.
Instructions 3efer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2.
Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
- 3.
Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated trudfalse statements.
More than one distractor is not credible.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (Le., the question has a valid WA but, as written, is not operational in content).
The question requires the recall of knowled e that IS too specific for the closed reference test mode (is., it IS not required to be known from memory).
The question contains data with an unreadic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
- 4.
- 5.
- 6.
- 7.
Check questions that are sampled for conformance with the approved WA and those that are desianated SRO-only (WA and license level mismatches are unacceptable).
Based on the reviewer's judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).
ES-401 2
Form ES-401-9 Flaws
- 4. Job Content Flaws I 5. Other
- 6.
E E
S U
S US S
US E
S S
S
- 7.
Explanation Change distractor d. to PRV-1042A. Left as-is. PRV-lO42A is a throw away distractor.
Lo level alarm ma not come in until 23% per ARP-5. Chan e stem to state that oil level {as lowered to 22% instead of 28%. Madge change.
Change 1 condition in stem to state: Plant is in MODE 3 at EOL. Made change.
Distractor c. could is argueably correct. Changed distractor c.
LOD = 1. Need more credible distractors. No better distractor available.
- 1) LOD = 1. 2) Change stem to assume MODE 3 conditions. Change distractor b. to be the correct answer with the following change: FIC-0737A has been selected to MANUAL. Question is not Level 1 difficulty, not taught this way in classroom. Suggested change was not necessary.
1 Change the RO importance from 2.5 to 2.7 per WA Catalog.
2{ Changelst sentence of stem to: Which of the following describes the process of sam ling for a Waste Gas Decay Tank?
- 3) Change the f part of the distractors to: a) & b Samplin is performed at different pressures durin the fill and when GD\\ IS isolafed. c) & d)
Sampling is only performeJwhen GDT is isolated. Fixed KLA importance factor, no changes made to question, satisfactory as wntten.
ES-401 3
Form ES-401-9
~
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
Q#
LOK LOD Explanation (F/H)
(1-5) Stem Cues T/F Cred. Partial Job-Minutia
- I Back-Q= SRO Focus Dist.
Link units ward WA Only 22N H
3.0 S
E 23M F
2.0 E
248 H
2.0 25N H
2.0 S
26N H
2.0 S
27N H
2.0 E
Change the stem to past tense. Stem revised to past tense.
28N H
2.0 S
298 H
2.5 S
30N H
2.0 S
318 H
2.5 S
328 F
2.0 S
338 H
2.5 348 H
2.0 S
358 H
2.0 S
36N H
2.5 S
37N H
2.0 38N H
3.5 S
39N H
2.5 S
40N H
2.5 S
A noun description of HS-05228 should be provided. Noun descnpfion added.
Change the RO Importance Factor from 4.1 to 3.5 per WA Catalog. WA importance factor corrected.
May be memory. How is this taught in the classroom? Not taught this way in classroom. Upper skill.
Is "a." correct? (Not complete, but still correct?) a. is not correct for the given conditions.
.- s B
e K
f w
ES-401 5
Form ES-401-9 This appears to be simple memory. Not taught fhis way in fhe classroom.
Operator needs to assess to arrive at correct answer.
This appears to be simple memory. Not taught fhis way in the classroom.
Operator needs to assess to arrive at correct answer. I This appears to take some analysis (plant conditions) to answer. Agreed
- 7.
Explanation il This should be a memory question taught this way in class. Agreed.
This requires some diagnosis and prediction, making it higher order. May also have two correct answers depending on assumptions made b aoolicant (FW has resoonded -vs-FW hasn't resoonded). Aareedy il This appears to be a series of TIF statements. Agreed. Re-written to require use of fhe stem to answer the question.
No reference for applicant, recall of interlocks and power supply vs right or left DBA sequencer operator (fundamental, memory) Determined to be hiaher skill - not tauaht fhis wav in class. reference bema orovided.
ES-401 6
Form ES-401-9
- 7.
Explanation Distractors are not consistent, c. and d. identify the reference, while a.
and b. give setpoint and reason. Agreed. distractors modified to be consistent.
Recall of precaution (fundamental) Not taught this way in class. Operato has to assess conditions. Higher skill.
Stem does not require a plicant to address KA part a for predictin the possible choices. Agreed. Modkcation made to correct question.
impact. Need to move tt!e info for h drogen burn an d pressure spiie into Reference page from GOP-2 is to be sup lied to the applicant and there i!
no direction to refer or go to SOPr7, so &at makes distractors a, b, and c believable? Cl matches K/A and IS accentahln as IS.
Why is c. incorrect? Distractor does not sa the ap licant will not record the new sition. What would be wrong witx recoring the current valve position E information purposes? Operators are taught to never record incorrect positions. Resolve, fix, then record the valve position.
LOD=I, LOK=F. Recall of specific interlock, synch scope interlock is alwavs reauired to close this breaker reaardless of Dlant conditions.
Distkctor b. is implausible, because it ig never true. Agree. Replacing the question, re-selecting WA.
ES-401 7
Form ES-401-9
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
LOD (1-5) Stem Cues T/F Cpd. Partial Job-Minutia
- /
Back-Q= SRO Explanation Focus Dist.
Link units ward WA Only 2.0 S
2.0 S
2.0 S
Distractor c. is implausible because it is never true. Licensee administrative limits for anfihing are always more conservative than CFR limits. As a result, CFR limits could not be exceeded unless the admin limits were already exceeded. Agreed. Distractor was modified.
Answer d. is implausible. Wh would a plicant believe 'consumables fontrol pro ram' was part of {LARA?
i t a minimum, delete the term program' !om
- d. Agreed. Distractor was modified.
Answer a. would not necessarily prevent initiating a release and could be considered an incorrect answer for the question asked. Reference does not support the answer. Agreed. Changed correct answer.
Applicant handout EOP-8.0, pa e 8 of 40, was not supplied with question.
Is this SRO only knowledge? (80 use of EOPs?) Modified question to ensure RO knowledge.
ttE 2.0 2.0 UE 2.0 U
2.0 E
2.0 S
2.0 S
2.5 This is a memory question. This is not an SRO ONLY question. Agree its memory. Basis document reference, making it SRO ONLY.
Distractor 'a' should read: 'circuitry is...' to be consistent w/ b. & d.
Change made.
E 3.0 3.0 x
s 3.0 x
s 2.0 2.5 x
s Appea[s to be a memory question. May not be an SRO ONLY question.
Agree its memory. Sequence makes it SRO ONLY.
ES-401 8
Form ES-401-9
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
LOD (1-5) Stem Cues T/F Cred. Partial Job-Minutia
- /
Back-Q= SRO u/E/s Explanation Focus Dust.
Link units ward WA Only 2.0 x
s 2.5 2.5 x
s 2.5 x
s 3.0 x
s 2.5 E
2.0 x
s 3.0 x
s 2.0 x
U be higher, Immediate Actions are memorized. Station does not use ROs -
Doesnt match the WA. Doesnt match purpose or function. Has to know purpose or function to arrive at the correct answer.
x Distractor d. should be changed to read Less than 940 psia... Agreed.
Ma not be SRO ONLY, but they dont use ROs on refuel floor. May not on the refuel floor, SRO ONLY. Agree not higher.
TS ent.ry conditions are not SRO ONLY. Change to 2 hr tech spec, providing tech specs to make it SRO ONLY.
EOP/AOP entry conditions are not SRO ONLY. Deleting WA, reselecting to get WA that can be used for SRO ONLY question. Replacing question.
3.0 2.5 2.5 x
s tis May not be SRO ONLY. ROs would know this information. SRO ONLY at this station.
2.0 2.0 x
s 2.0 May not be SRO ONLY. ROs would know this information. ROs may know information, but this is an admin function done by SROs.
May not be SRO ONLY. ROs should know this information. Agree.
Modiiifing the question to be SRO ONLY.
2.0 I
L _
I..
ES-401 9
Form ES-401-9
Palisades Operating Test Comments No.
- 1.
Source Scenario 1 Comment
- 1)
Outline gives credit for Instrument failure to RO for Event 3, "Hot Leg #1 RTD fails low." However, the scenario has no actions for the RO to take.
On shift turnover, Add: "D/G is in Day 2 of 7 Day LCO."
Event 1 : After "acknowledges associated breaker trip alarm, add: "(1 F and 1 G only)."
Event 3: Add (ARP-21) after first SRO action.
Event 3: After "Bypass the Variable High Power Trip," add "(Trip #l); after "TWLP Trip," add "(Trip
- 9)" in the first block of BOP actions.
Event 4: First set of SRO actions, "Start Standby Service Water Pump," add "per SOP 15."
Event 6 p2: Second RO instruction box, after "PZR swav valve" add: "CV-1057)"
- 2)
- 3)
- 4)
- 5)
- 6)
- 7)
Resolution
- 1)
RO credit removed.
- 2)
Comment incorporated.
- 3)
Comment incorporated.
- 4)
ARPadded.
- 5)
Trip descriptions added.
- 6)
Per SOP-15 added.
- 7)
Description added.
Palisades Operating Test Comments
- 2.
Scenario 2 Is the B S/G required to be isolated because of a ruptured tube? If so, why isn't the isolation of the B S/G (ruptured tube) a critical task?
If the A S/G is isolated due to the open code safety and the B S/G is isolated due to ruptured tube, how is the plant to be cooled down?
Delete Event 5 - too many events when combined with Scenario 1.
Combine Events 7 & 10 as Event 7. They are naturally grouped together.
Event 4: Position ALL: add the following note to the bottom of the block "Note: Refers to ONP-6.1, Control Rod Drop Event 4: 1st BOP reference: add trip channels to the description.
Event 6: Second BOP reference: remove D/G 1-2 did NOT auto start.
Event 8: 2nd RO reference: replace "Otherwise, acceptance criteria are MET," with "Acceptance criteria are NOT met."
Event 9, Page 2, 1st SRO reference: replace "CA-1 I' with "CA-2."
Critical task added Decision by the SRO to un-isolate the A S/G.
Event deleted.
Events combined.
Added Note.
Trip channels added.
Removed statement.
Replaced statement.
Replacement made.
Palisades Operating Test Comments
- 3.
Scenario 3 Events 1 and 2 should only count as one event.
Event 6: 1 st action: diagnose failure of feed flow transmitter LT-0703. LT-0703 is a level transmitter.
Delete Events 4, 5 & 6. Too many events when combined with Scenarios 1 & 2.
Modify description of Event 8 to include failure of manual trip.
Add the following to the shift turnover: 'IT-53B was placed on long recirc by the previous shift per SOP-2A, 7.4.2.a.2, and boric acid sample results match the placard.
Event 3: Add a small air lead to cause operator response to the event.
Event 3: First block: add the expected annunciators.
Event 7: Page 3: 5th RO response: at the end of the block add, "and/or containment temperature
> 125°F.
Event 7: Page 4: 2nd RO response: insert NOT between the words "are MET."
Events are separate items performed by different operators. Left events as-is Feed was changed to Level Events deleted.
Event 8 description modified.
Initial condition modified.
Small air leak added.
Annunciators added.
Comment added.
NOT added.
RO Admin 1.1
- 4.
- 5.
- 6.
- 7.
- 8.
- 9.
- 10.
- 11.
- 12.
- 13.
No Comment.
NIA RO Admin 1.2 RO Admin 2 RO Admin 3 RO Admin 4
~~
No Comment.
- 1)
Task elements 19, 20 are not critical tasks as
- 1)
Critical task requirements written.
deleted.
- 1)
No comment.
change the initiating cue to determine the "maximum" radiation dose expected.
SRO Admin 1.1
~~
- 1)
- 1)
- 1)
No Comment.
- 1)
- 1)
- 2)
- 3)
At the end of the cue add, "to determine if there are any additional errors."
Change the cue to add, "in minutes."
Change the initiating cue to determine the "maximum" radiation dose expected.
Add to the initiating cue: "This JPM is time critical."
Change initial condition 8 to "in progress."
Move initial comment from position 12 to position 9, re-sequence the remainder of the initial conditions.
SRO Admin 2
~~
- 1)
Additional cue material added.
- 1)
Change made NIA
- 1)
Change made
- 1)
Change made.
- 2)
Change made.
- 3)
Change made.
- 14.
- 15.
- 16.
Palisades Operating Test Comments JPM B.1.a
- 1)
- 2)
Have a working copy of RO-22 for examiner to provide to the applicant.
Task Element 9: Annunciators sound at this point.
Add annunciators to the JPM so they are expected by the examiners.
Task Element 19: change the expected withdraw tolerance to 2.0" to 4.0"
- 3)
JPM B.1.b
~~
~
- 1)
Task Element 6. Is it acceptable to have all three charging pumps running at one time due to maximum flow considerations?
Step 1 : Task refers to MO-2087, Standard refers
- 2) to MO-2160.
JPM B.1.c I NO Comments.
- 1)
Facility will have the
- 2)
Annunciators added to the
- 3)
Tolerance changed.
worksheets available.
narrative.
- 1)
This is done to make it easier to control PZR level.
It is acceptable to run all three charging pumps at the same time.
- 2)
Typo. 2087 should be 2160. Change made.
N/A
Palisades Operating Test Comments
- 17.
- 18.
- 19.
JPM 6.l.d JPM B.1.e JPM B.1.f Add to the initial conditions: "Another Reactor Operator is controlling the reactor, auxiliary feed, and other portions of the control room.
Task Element 8 should be a Critical Step.
Task Element 12: Typos. Change "the" to "then" in items 2 and 3.
Task standard on page 2 should be 530 rpm.
Task Element 4: Step C1: after OVERVIEW, add, "or CONTROL Task Element 4: Step C2: add a note to the standard warning the examiner that other screens may be used to accomplish this task Task Element 4: Step C3: remove reference to TURBINE MANUAL and lamp extinguishes on manual panel Task Element 8: This is a critical step.
Task Element 10: In the standard, this information is found on C-01, not (2-03.
- 1)
Task Element 5: Change wording to ask applicant for suggestions on how to establish a reactor vessel head vent path.
- 1)
- 2)
Delete "(Le., do NOT perform steps f and g of Task Element 6: Change cue to: "If asked about any required action for P-52-A, tell candidate to follow procedures."
SOP-I 6, 7.3.6)."
Statement added.
Changed to critical step.
Typos fixed.
Task standard changed to 530.
Change added.
Change made.
Change made.
Agreed, changed to critical task.
Agreed, changed to C-03.
- 1)
Change made.
- 1)
Facility agrees. Deletion made.
- 2)
Change made.
Palisades Operating Test Comments No comment.
No comment.
- 20.
21 *
- 22.
- 24.
NIA NIA JPM 6.1.g JPM 6.2.a JPM B.2.b JPM B.2.c
- 1)
- 2)
- 3)
- 4)
Add "Radwaste" in front of "panel C-40."
to clearly specify the panel.
Task Element 9. Standard is a cue, not a standard. Remove cue.
Task Element 14: add the response procedure noun name Task Element 15: this is not a critical task.
Facility agreed. Change made.
Facility agreed. Cue removed.
Facility agreed. ARI-8 added.
Facility agreed. Critical Task removed.
No comment.
I NIA