ML081770397
| ML081770397 | |
| Person / Time | |
|---|---|
| Site: | Susquehanna  |
| Issue date: | 04/25/2008 |
| From: | Caruso J Operations Branch I |
| To: | Peal R Susquehanna |
| Caruso J | |
| Shared Package | |
| ML080390056 | List: |
| References | |
| TAC U01762 | |
| Download: ML081770397 (15) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9
~~ ~
Notes: Comment Resolution listed in Bold & Italicsprint. Eight questions were unsat (10.7%). Exam R e v i e w conducted by B. Fuller & J. Caruso. All comments provided to licensee o n 4/28/08 comments resolved by 5/2/08
- 7. 8.
UIEIS Explanation I Distractors not plausible e.g. trips of recirc and CRD pumps not plausible Q replaced with a new Q using same WA E Licensee added a bullet to stem HPCI Aux Oil Pump in Auto based on reviewers comment S
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
- 3. Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated true/false statements.
The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
- 5. Check Questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
- 6. Enter question source: (Blank, (Mbdified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
ES-401 2 Form ES-401-9 Psychometric Flaws I 4. Job Content Flaws I -I
- 5. Other 6. I 7. I 8.
SRO BlMlN UIEIS Explanation Only B E B not credible - immediate % scram with battery power. 8 revised IMIEl Licensee requested change to stem to add Unit 2 Standby..based on validators comment IN/ I U The WA testing relationship between RPS and process monitor no direct relationship to Rx sample line and process monitor. Replaced this new Q with a modified bank Q using testing same WA.
IMIU/ C&D not plausible feed pump speed increases with total steam signal fails dowscale. Replaced with a new Q testing the same WA revise D no change in level lNIEI Higher order must know reactor level requirement and power supplies. Changed to Higher Order B S I I I lMIEI First sentence of stem has errors. Justification for answer D is incomplete Fixed N S I I I Note: May be SRO level question - licensee said no appropriate for RO and LO.Licensee cautioned not to link references to questions directly Le., applicants must know which reference to use to answer the Q. The one exception is the ON for level instruments used on 2 questions. LO provided for Q.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B M N U M S Explanation Focus Dist. Link units ward WA Only 25 H 3 Y N S Typo in stem Fixed 26 H N B U Not a WA match?? Licensee replaced the Q with a bank Q using a different W A since LP core spray was already tested on 3 other Qs.
27 H 3 Y M S 28 H 3 Y N S
ES-401 2 Form ES-401-9 I I Back- Q= SRO BIMIN UIEIS Explanation ward WA Only Y N E May not be a full WA match. WA is for system valves Added explanation for WAjustification that Instrument Air is moniforec in this case and effectively scram air inlet and outlet valves are like IA system valves.
Y N S I I I I I IyI I N I E l Licensee added to stem Main Turbine is tripped based on validation comment and RPVpressure is stable on bullet.
I I I Y N I E 1°Cjustification incomplete sentence. Fixed lyI l B I S l Yes this Q is appropriate for ROs - EOP strategy fair game with EOf in hand.
Y N E Licensee added Control Panel number to stem based on validation commenf.
Y B U A&B not plausible answer C obvious simple logic - Licensee replaced with a modified bank Q using same WA.
lyI lNIEl
~~
Licensee added the word below to choice B based on validafion commenf.
Y N S Y B E Recommended - Reactor pressure is fluctuating between.. rathe than changing from Changemade.
Y B S Y N S rN I I Is-I ~
C
.-0 4-m C
-m W
cdz Z
m m
8
TO: John Caruso, Chief Examiner FROM: Chris Michaels, SSES Exam D e v e l o p e r 6
SUBJECT:
Summary of Changes for SSES 2008 RO Written Exam DATE: 5/7/08 The following is a summary of changes to the written exam following operator exam validations and NRC Reviews.
RO Written Exam Outline, rev 5 Question #26: LPCS oversampled. WA reselected based on discussion with Chief Examiner. Refer to ES-401-4, Record of Rejected WAS, attached.
Incorporated Chief Examiners comments on ES-401-4, Record of Rejected WAS.
Question #I Comment:
Plausibility of Choices C and D.
Resolution:
Question replaced with a NEW question.
Question #2 Comment:
Validator comments.
Resolution:
Added 3rdbullet HPCI Aux Oil Pump Handswitch 1P213 in AUTO.
Question #9 Comment:
Plausibility of Choice B Resolution:
Revised Choice B to separate the instruments.
Question # I 4 Comment:
Validator Comments.
Resolution:
Add words Unit 2 before Standby Liquid Control.. .
Page 1 of 7
Question # I 6 Comment:
Concern for WA match. No direct relationship between RPS, FO19 and Process Rad systems in the question.
Resolution:
Question replaced with a MODIFIED bank question.
Question # I 7 Comment:
Concern for Choice C and D plausibility with this total failure.
Resolution:
Replaced with a NEW question.
Question # I 8 Comment:
Question is at the High Cognitive level.
Resolution:
Changed classification from Low to High Cognitive level (Comprehensive / Analysis).
Question #20 Comment:
Validator comments.
Resolution:
Revised last bullet to Five minutes later, ENGINE LUBE OIL PRESSURE LOW (LA-0521-A01) alarm received at local Panel OC521A and the NPO reports lube oil pressure is lowering.
Revised Choices A and B from will immediately Shutdown to will trip Question #23 Comment:
Chief Examiner requires a learning objective.
Resolution:
Learning objectives provided for this WA.
Question #25 Comment:
Typo levels and add and Resolution:
Typos corrected.
Page 2 of 7
Question #26 Comment:
Question is OK but is a poor WA match.
Resolution:
WA reselected and question replaced with a MODIFIED bank question.
Question #29 Comment:
Typo is 3rdbullet.
Resolution:
Typos corrected.
Question #31 Comment:
Typos in choices and need spaces with the csymbol.
Resolution:
Added spaces.
Question #33 Comment:
Choice C is always correct. Plausibility of Choices A and B.
Resolution:
Replaced with NEW question.
Question #36 Comment:
Could be considered a direct lookup on two choices.
Resolution:
Replaced question with MODIFIED bank question.
Question #38 Comment:
Validator comments. Reasons in the choices are misleading. Consider deleting reasons e.g., "to control RPV pressure".
Resolution:
Deleted reasons in all four choices.
Page 3 of 7
Question #39 Comment:
Concern for plausibility of Choice C due to normal SP level.
Also, cognitive level on this is LOW.
Resolution:
Supp Pool level changed in the stem to value below normal but above that which maintains choice C incorrect.
Changed cognitive level to Memory /Fundamental knowledge.
Question #40 Comment:
Typo extra question mark.
Resolution:
Typo corrected.
1 Question #41 Comment:
Validator comment. Change first statement to ". ..a blown fuse results in a loss of all 125 VDC control power to.. ." to prevent confusion with 16 CRD pump which has alternate tripping power (and internal ATS).
Resolution:
Change first statement to ". . .a blown fuse results in a loss of all 125 VDC control power to ..."
Question #43 Comment:
Delete last statement in Choice D justification.
Resolution:
Last sentence in Choice D deleted.
Question #46 Comment:
Plausibility of Choice C.
Resolution:
Choice C replaced.
Question #47 Comment:
Plausibility of Choices A and B.
Resolution:
Revised all choices to improve operational validity and plausibility.
Page 4 of 7
Question #48 Comment:
Capitalize and underline NEXT.
Resolution:
Next capitalized and underlined.
Question #49 Comment:
Question OK but correct answer has components not directly supplied by Instrument Air as identified in the WA. Provide justification for this plant specific reason.
Resolution:
Added justification to WA to provide basis for the components included in Instrument Air System components.
Question #51 Comment:
Validator comments. Add bullet to focus on status of MSlVs or Turbine. Also, change RPV pressure is rising slowly to RPV pressure is stable since rising pressure implies that power is higher than the capacity of the open SRVs.
Resolution:
Added 2dbullet The Main Turbine is tripped.
Changed 6h bullet to 4 SRVs automatically OPENED and RPV pressure is stable.
Question #52 Comment:
Complete statement in Choice C justification.
Resolution:
Statement in Choice C justification completed. Statement supports the plausibility since high radiation on the Refuel Floor affects SPING operability.
Question #55 Comment:
Validator comments. Add the panel location of the indications.
Resolution:
Added at panel 1C651 to enhance stem focus.
Reviewed and approved by Chief Examiner.
Question #56 Comment:
Simple knowledge question. Not sufficiently discriminating.
Resolution:
Question replaced with a MODIFIED bank question.
Page 5 of 7
Question #57 Comment:
Change approx. to below.
Resolution:
Changed to below.
Question #60 Comment:
Suggest editorial comment changing from to fluctuating between.
Resolution:
Changed to fluctuating between.
Question #64 Comment:
Typos - add dashes to alarm response procedures.
Resolution:
Typos corrected.
Question #66 Comment:
Validator comments. Underline PCO on the On-coming Shift. Also revise the stem to focus on the on-coming shift not the current shift.
Resolution:
Changed stem to:
Due to staffing issues, the on-coming shift complement will be at MINIMUM staffing levels required by Tech Specs.
Prior to turnover, a PCO on the on-coming shift has called off due to a personal emergency and cannot report to work.
Question #68 Comment:
Editorial comment to revise feed and bleed portion of the work instructions.
Add words as approved by the SO rep for consistency with the admin procedure.
Resolution:
Revised to .feed and bleed of the jacket water cooling system as approved by the SO I..
Rep.
Question #69 Comment:
Validator comments. Enhance choices A and B to reflect the direction of travel.
Resolution:
Choices A and B enhanced as stated.
Reviewed and approved by Chief Examiner Page 6 of 7
Question #70 Comment:
Editorial comment that bullets are confusing and needs stem focus for the additional dose.
Resolution:
Bullets revised and stem focus enhanced. Additional dose allowance has its own statement.
Question #71 Comment:
Validator comments. Underline Lifesaving.
Resolution:
Lifesaving underlined.
Question #72 Comment:
Validator comments. Consider a qualifying statement to support that the isolation cannot be reset.
Resolution:
Revised statement to I'. . .FIN report the isolation logic relay is failed and must be replaced."
Question #74 Comment:
Typo on value of Cond Demin Inlet conductivity.
Resolution:
Corrected typo on CDI value.
Question #75 Comment:
Potential Cue on Choices A and C with time frames in years.
Resolution:
Time frames deleted on Choices A and C.
- End of Summary -
Page 7 of 7