ML053000559

July 2005 Initial Examination - ES-401-9

ML053000559
Person / Time
Site:	Davis Besse
Issue date:	07/18/2005
From:	Beilby M NRC/RGN-III/DRS/OLB
To:	FirstEnergy Nuclear Operating Co
References
50-346/05-301
Download: ML053000559 (13)

Text

ES-401 Written Examination Review Worksheet Form ES-401-9 Davis-Besse July 2005 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward K/A Only 1 F 2  ? New. The reference provided (i.e., DB-OP-02515, page 18) does not S support distractor C as the correct answer. Need more information.

RESOLUTION: Reference provided that supports answer.

2 F 2 X E Bank. Distractor C is not plausible that Demin water flow greater than 2 gph for standpipe flush is an interlock for RCP start. Suggest changing distractor C to Power level less than 75% of full power (not correct, since power level must be less than 60% power).

RESOLUTION: Comment incorporated as stated.

3+ F 2  ? Modified. The reference provided (i.e., DB-OP-02000, Table 2, Sheet 2 S of 4) does not support distractor C as the correct answer. Need more information.

RESOLUTION: Reference provided that supports answer.

Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

• The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

• The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

• The answer choices are a collection of unrelated true/false statements.

• The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

• One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

• The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

• The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

• The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

• The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).

6. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

7. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).

Page 1 of 13

ES-401 Form ES-401-9 Davis-Besse July 2005 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward K/A Only 4 H 1 X U New. 1) Distractor C is not correct that valve DH14B fails open if the valve has a mechanical stop at 30% open. Thus, there is no correct answer. 2) Distractors A and D are not plausible that certain valves fail as-is (unless the valve is at its mechanical stop). 3) Distractor B is not plausible because it is silent on how valve DH14B reacts to a loss of instrument air.

RESOLUTION: 1) Revised C to incorporate mechanical stop in answer.

2) Revised A and D to eliminate reference to DH14B. 3) Revised B to reference DH14B position on loss of instrument air.

5 H 2 U New. Question K/A, since the decision to go to piggyback operation S per Specific Rule 3.4 is not related to RCS temperature, including superheat, saturation, and subcooled.

RESOLUTION: Although changes in parameters is not specifically asked for in the question, have to determine the status of subcooling in stem to determine correct answer. Question meets KA, leave as-is.

6+ H  ? Bank. 1) The reference provided (i.e., Tech Spec Table 3.3-3 pages 3-11 S and 3-12a) does not support distractor B as the correct answer.

2) In addition, the references do not explain how the SFAS Channel 1 sequencer being OOS affects the result. Need more information.

RESOLUTION: Reference provided to support B as correct answer and explain how SFAS Channel 1sequencer OOS affects result.

7 F 2 X U New. 1) Question K/A, since the question is related to maintainimg Quench Tank temperature below design limits instead of Quench Tank pressure. 2) The reference provided does not support distractor A as the correct answer, since it does not show that the Quench Tank Circ Pump autostarts at 150 degF. 3) Distractors C and D are not plausible that the pump would auto start on Quench Tank pressure instead of temperature.

RESOLUTION: Question rewritten to address pressure problem with Quench tank. References provided to justify answer.

8 F 2 E Modified. This question should be classified as Fundamental instead of at the Higher Cognitive Level.

RESOLUTION: Question changed to Fundamental.

Page 2 of 13

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward K/A Only 9+ F 2 E Bank. In distractor B, change Reactor Coolant Drain Tank temperature to Quench Tank temperature to make this distractor incorrect in accordance with procedure DB-SP-03363, step 2.2.1.f.

RESOLUTION: Comment incorporated.

10 H 2  ? Bank. The reference provided (i.e., DB-OP-06403, Attachment 4) does S not provide enough information to support distractor C as the correct answer. Need more information.

RESOLUTION: Reference provided to support C as correct answer.

11 H 2 S New.

12 H 3 X E New. Since the saturation pressure for 260 degF is 35.43 psia (20.73 psig), change the question stem to state that containment pressure is 22 psig instead of 18 psig.

RESOLUTION: Common incorporated.

13+ F 2 S Bank 14 F 2 X E New. Distractor C is not plausible that there would be no suction path to the CS pumps after DH 7A and DH 7B were closed until DH 9A and DH9B automatically stroked open. Suggest changing distractor C to :

Open DH 9A and DH 9B. Close DH 7A and DH 7B. Verify CS 1530 and CS 1531 are fully open.

RESOLUTION: Comment incorporated.

15 H 1 X U New. 1) Distractors B and D are not plausible that valve CS 1531 is closed (suggest changing valve to open). 2) Distractor C is not plausible that valve DH 7A is closed (suggest changing distractor so that valve DH7A is open and valve DH 7B is closed).

RESOLUTION: Comments for 1) and 2) correct and incorporated.

16+ F 2 E Bank. 1) This question is at the SRO level per 10CFR55.43(b)(2) as a Tech Spec Bases question, unless it can be shown that the RCS cooldown rate limitation and its reason are specified in a Learning Objective for the RO to know this. 2) In stem add The turbine control remains in ICS automatic control.

RESOLUTION: 1) The question is Satisfactory since the ROs have a Learning Objective to know the RCS cooldown rate limitation and its reason. 2) Incorporated.

Page 3 of 13

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward K/A Only 17 F 2 S Bank.

18 H 3 S New.

19+ H X U New. 1) Distractor B is not plausible that the RCS cooldown rate will be limited by the ability to reach cold shutdown boron concentration.

2) Distractor C is not plausible that the RCS cooldown rate will be limited by the ability to maintain the RCS at minimum adequate subcooling margin.

RESOLUTION: 1) B changed to Specific Rule 5, PTS requirements. 2) C changed to reactor vessel head cooldown rate.

20 F 2  ? Bank. 1) In the question stem, change the third bullet to: A lockout of A S bus then occurs. 2) The reference provided does not support distractor A as the correct answer. The reference only shows that the second bullet of distractor A is correct. Need more information.

RESOLUTION: 1) Comment incorporated. 2) Reference provided to support A as correct answer.

21 H 2 E Modified. Bullet 2 in stem, add ..., with its breaker racked in.

RESOLUTION: Incorporated.

22 H 2 S Bank.

23+ F 2 X E Bank. 1) Distractor A is not plausible that the NORMAL supply breaker will AUTO CLOSE to energize the bus. 2) To make distractor B more plausible, change to: EDG 1 will start, but the output breaker will NOT AUTO CLOSE until the EDG 1 Lockout Relay is manually reset. 3) To make distractor C more clear, change to: No equipment actuations will occur until the EDG 1 Lockout Relay is manually reset, and then EDG 1 will start and the output breaker will AUTO CLOSE.

RESOLUTION: 1) A changed to EDG 1 start, but output breaker will NOT AUTO CLOSE until EDG 1 lockout relay is manually reset. 2) B changed to partially incorporate comment, but eliminate three choices dealing with lockout relay. 3) Comment incorporated.

Page 4 of 13

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward K/A Only 24 F 2 X U Bank. 1) The question stem is not clear as to what is being asked, when it states which combinations will cause AUTOMATIC closure of valve WM 1876 (i.e., either or both conditions required to cause closure of the valve). 2) Distractors A and D are not plausible because one should know that condition 4 (High Radiation) will cause automatic closure of the valve. 3) Suggest changing the question so that valves WM 1877A and WM 1877B (which also close on high radiation per drawing 0S-029, Sheet 1) are included in the distractors. RESOLUTION: Question rewritten to a fill in the blank format.

25 F 2 S New.

26+ H 2 X E Bank. Distractor D is not plausible that one would attempt a restart on a pump after a relay target on the pump breaker shows an instantaneous overcurrent trip.

RESOLUTION: Rewrote D with another incorrect action.

27 F 2 S Bank.

28 F 3 S Bank.

29+ H 3 E New. 1) In the question stem, change the third bullet to: A single control rod then drops without causing a reactor trip. 2) Stem, bullet 2, replace ICS is... with The Rod Control Panel and Reactor Demand are..., and add bullet for All other ICS Stations are in automatic.

RESOLUTION: Comments incorporated.

30 H 3 S New.

31 H 3 E New. Stem, second line, delet Using the numbers in parenthesis below,... and capitalize W in which...

RESOLUTION: Incorporated.

32 H 3 E Bank. Typo: From Note 25 of the attached reference (0S-001A, Sheet 1), it appears that distractor C is the correct answer (i.e., the loop with the highest flow).

RESOLUTION: C is the correct answer, typo corrected.

33+ F 3 S Bank.

34 H 2 S New.

Page 5 of 13

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward K/A Only 35 H 2 S New.

36+ F 2 S New.

37 H 2 S Modified.

38 F 3 S New.

39+ H 2 X U Bank. 1) Distractor A is not plausible that RCS pressure would be stable with a stuck open PZR PORV. 2) Distractor C is not plausible that the blue PORV indicating light would show that the PORV is open.

RESOLUTION: 1) A changed stable to decreasing. 2) C changed to Accelerometer alarm on the Vibration and Loose Parts Monitor.

40 H 2 S Bank.

41 H 1 U Bank. By just knowing that the SFRCS output module lights is not correct, one gets distractor A as the correct answer. Suggest changing the question stem to state: Which of the following indications/equipment can be used to verify the current plant condition?, with the distractors being: A) SPDS, B) SFRCS output module lights, C) SFAS data lights in Channels 1, 2, 3, 4, and D) some other Main Control Board or local indications.

RESOLUTION: Comment incorporated, rewrote D as RPS Channels 1, 2, 3, 4 bistable output state lights.

42 H 3 X U New. 1) In distractor A it is not required to vent MU Pump 1 if not starting the pump (as per DB-OP-02512, step 4.1.8, which only states to vent the affected Makeup Pump prior to starting). Thus, distractor A could be interpreted to be incorrect, and thus there are no correct answers. Suggest deleting the first part of distractor A which states:

Vent MU Pump 1. 2) To make distractor B more plausible, change to:

Vent MU Pump 2. Align MU Pump 2 to BWST to provide makeup flow.

3) Change distractor C to: Lineup and start HPI piggyback operation, which would be correct (per DB-OP-02512, step 4.1.11) if the standby MU Pump was not available. 4) Change the question stem to : Which one of the following additional actions is required to re-establish makeup flow?

RESOLUTION: 1) Deleted first part of A, comments for B and C, and stem change incorporated.

Page 6 of 13

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward K/A Only 43+ F 2 X E Bank. To make distractor D more plausible, change to: To prevent damage due to water hammer in the DH system (i.e., do not mention damage to the standby pump).

RESOLUTION: Comment incorporated.

44 F 2 E New. In distractor C, delete the second sentence, since the other distractors do not mention what can be performed after CCW is re-established.

RESOLUTION: Comment incorporated in C, also changed stopped to tripped, and added HPI and LPI pumps can operate as long as the ECCS room coolers are in service.

45 H 3 S Bank.

46+ H 1 X U New. 1) LOD =1, since distractor C is obviously correct. 2) Distractor B is not plausible because if this answer were correct, then distractor C would be even more correct. Suggest changing distractors B and C so that the correct answer is IR channels indicating a value which is only a one decade decline and slowly lowering (DB-OP-02000, page 12, step 3.3 states that the IR channels show a 2 decade decline immediately after a reactor shutdown). To incorporate this change, the question stem would also need to be changed to specify the initial reactor power level.

RESOLUTION: Comment incorporated as follows: 1) added following bullet to stem The plant was at 100% power; 2) replaced B with None of the RPS parameter specific trip bistable annunciators are in alarm.;

and 3) replaced C with Intermediate Range NIs indicate 10-5 amps and slowly lowering.

47 H 2 E Bank. Modified. To increase the LOD of the question, change the question stem so that the Current Conditions are that RCS pressure is 750 psig instead of 550 psig. Then the correct answer becomes distractor A, since the SG delta P will increase from about 350 psid to about 440 psid. This would also change this question to Modified instead of Bank. NOTE: Question requires a reference.

RESOLUTION: Comments incorporated, choices rearranged such that B is correct (old A). Reference provided.

48 H 2 S Bank.

Page 7 of 13

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward K/A Only 49+ H 2 X U New. Distractors A and D are not plausible that the TBVs would be available with no condenser vacuum. Suggest changing TBVs to AVVs.

RESOLUTION: A and D are distractors, substituting AVV for TBV does not make either more correct or less obvious. Knowledge of vacuum is a valid thing to test. Rating changed from U to E.

50 H 1 U Bank. LOD = 1, that distractor B is correct with Incore T/Cs trending upwards. Suggest changing question stem so that RCS delta T is greater than 50 degF, and then change distractor B to reflect that this is the reason for not declaring the existence of Natural Circulation.

RESOLUTION: Comment incorporated.

51 H 2 E Bank. Editorial: In distractor D, change the wording in parentheses to (EDG 1 output breaker) to reflect which EDG is referred to.

RESOLUTION: Comment incorporated.

52 H 3 S New.

53+ H 3 E New. Delete the second part of distractor C since this statement (if correct) would also logically apply to distractors A and D.

RESOLUTION: Comment incorporated.

53a H 3 U During exam administration, licensee addressed applicant question and incorrectly changed Q 53 stem to ...SFAS Low-Low Pressure... vice

...SFAS Low Pressure... bistable Channel 3 trip which changed correct answer from D to A and B.

RESOLUTION: Discussed with IOHS on 8/9/05, applicants not present for the question stem change graded on Q53; others graded on Q53a.

54 H 3 E Bank. Editorial: In distractor D, change the word may to will.

RESOLUTION: Comment incorporated.

55 H 2 S Bank.

56+ F 3 S Bank.

Page 8 of 13

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward K/A Only 57 H 3 U Bank. Since there is an auto turbine trip at a condenser pressure of 7.5 inches Hg , the turbine will already be tripped at 7.9 inches Hg (as a condition stated in the third bullet of the question stem) if all systems operated as designed (as stated in the fourth bullet of the question stem).

Thus, distractor C (which states to trip the turbine ) is incorrect and there is no correct answer. Suggest replacing the fourth bullet in the question stem with a Main Generator load at 400 MWe (or whatever would correspond to about 50% power with a degraded condenser vacuum).

With these changes, distractor C would be the correct answer.

RESOLUTION: Replaced 4th bullet of stem with Generator Output is 420 MWe which makes C correct.

58 F 2 S Bank.

59+ H 2 E New. Editorial: In distractor A, change the last word fromstart to starts.

RESOLUTION: Comment incorporated.

60 F 3 S New.

61 F 3 X U New. Since letdown is isolated for a SGTR, why would a LETDOWN RADIATION HI alarm come in as stated in the question stem?

RESOLUTION: Question stem was rewritten to change tense of equipment and operator actions. Stem now reflects plant was at 100%,

received fuel leak alarm followed by SGTR and rapid shutdown in progress.

62 H 3 E Bank. The question stem states that station annunciators have lost power. However, DB-OP-02532, page 8, states that the following alarms will come in : (14-6-D) ICS IN TRACK and (14-1-C) ICS 24V DC BUS TRIP? To clarify this, suggest changing the question stem to state:

Station annunciators lost power 5 minutes ago. Also, change the question stem to state: The RO then reports the following:

RESOLUTION: Tense of stem changed per comment.

63+ F 2 S Modified Page 9 of 13

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward K/A Only 64 H 3 X E Bank. In the question stem, change the first sentence to: A small break LOCA has occurred which resulted in a loss of Subcooling Margin (SCM) to clarify that the loss of SCM is in the past tense.

RESOLUTION: Comment incorporated.

65 H 3 S Modified.

66+ H 3 E Bank. Distractor A. 2., add ...to auto.

RESOLUTION: Comment incorporated.

67 F 2 X U New. 1) Distractor B is not plausible that components operating at 100%

power are contained within a Dashed Box. Suggest changing this to: for equipment that will be installed per a future modification.

2) Distractor C is not plausible that components in a standby condition at 100% power are contained within a Dashed Box.

RESOLUTION: B changed as follows: are part of a plant modification that has been partially implemented; C changed as follows: indicate changes made during the last drawing revision.

68 F 2 X E Bank. Distractor B is not plausible that one can verify that a procedure is current using the procedure for Procedure Use and Adherence.

RESOLUTION: A plausible third distractor could not be identified.

Question was replaced with another for the same KA.

69+ F 3 S New.

70 F 2 S Bank.

71 F 2 E Bank. This question should be classified as Fundamental instead of at the Higher Cognitive Level.

RESOLUTION: Question changed to Fundamental.

72 F 2 X U Bank. 1) Distractors B and D are not plausible that NRC approval is required to exceed 1000 mR (TEDE) per year. Suggest changing the question stem to delete the second part of the question: and the ______

is required to monitor the individuals dose. Then change diststractor B to ONLY the Manager - RP, and change distractor D to ONLY the Plant Manager.

RESOLUTION: Second part of stem question was deleted. B changed to Manager - DB Operations only; D changed to Plant Manager only.

Page 10 of 13

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward K/A Only 73+ F 3 S Bank.

74 H 2 S New.

75 F 2 S Bank.

76+ F 2 X S New.

77 H 2 X X U New. Distractors B and C are not plausible that the turbine is tripped with Main Generator load at 430 MWe and lowering at 150 MWe per minute.

RESOLUTION: Plausible distractors for B and C could not be identified, so the question was rewritten to the same KA.

78 F 2 X U New. The question stem asks which condition requires notification of ALL D-B Managers. However, Attachment 2 of DB-OP-00002 only requires notification of the Duty Operations Manager and Duty Plant Manager. It appears that the word ALL is incorrect, and that there is no correct answer. Suggest changing the question stem to state: Which one of the following conditions would require notification of the Duty Operations Manager and the Duty Plant Manager?

RESOLUTION: Stem changed per comment. Upon further review, also changed A to Adjustments to generated megawatts to compensate for changing condenser pressure due to weather conditions and D to Entering Mode 3 during a scheduled plant shutdown.

79+ H 3 X E Modified. Distractor B, change DAN to DAP.

RESOLUTION: Incorporated.

80 H 2 X S Bank.

81 H 2 X S Bank.

82 H 3 X  ? New. Need more information to show what the expected overlap is S between the Source Range and Intermediate range detectors.

RESOLUTION: Reference provided to support answer D.

83+ H 2 X S New.

84 H 3 X S Bank.

85 H 3 X S Bank.

Page 11 of 13

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward K/A Only 86+ H 2 X S New.

87 H 2 X S New.

88 H 2 X S Bank.

89+ F 2 X E New. Editorial: In the question stem, delete the word LCO since the Total Channels and Channels to Trip are not LCOs.

RESOLUTION: Comment incorporated.

90 F 2 X S New.

91 H 2 X S New.

92 H 3 X S New.

93+ H 3 X S New.

94 H 2 X E Bank. 1) Editorial: In the question stem, change the word statement to statements. 2) Editorial: In distractor A, capitalize the first letter in the word Heat.

RESOLUTION: Comments incorporated.

95 F 1 X X U Bank. 1) Distractor B is not plausible that any operations personnel could substitute for an RO temporary absence from the Control Room. 2)

Distractor D is not plausible, since it is a subset of distractor A (i.e., if distractor D were correct, then distractor A would also be correct). 3) The correct answer (distractor C) is correct irrespective of whether the other RO or SRO attended the turnover. Thus the words who attended turnover should be deleted.

RESOLUTION: Question could not be corrected so another was written to the same KA for control room manning requirements.

96+ F 3 X S New.

97 F 2 X S Bank.

98 F 3 X S Bank.

99+ H 3 X S Bank.

Page 12 of 13

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward K/A Only 100 F 2 X S New A + in the Q# column indicates that question / references /KAs were reviewed as part of the representative sample of 30 questions.

Unsat Questions: RO: 16/75=21.33%; SRO: 3/25=12.0%

Page 13 of 13