ML11145A015

2010 Byron Nuclear Station Initial License Examination ES-401-9 Rev 1 Form

ML11145A015
Person / Time
Site:	Byron
Issue date:	09/30/2010
From:	Bielby M Operations Branch III
To:
References
Download: ML11145A015 (9)

Text

ES-401 Written Examination Review Worksheet Rev 0 Form ES-401-9

1. questions reviewed in depth.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 1 F 2.0 B S NRC: Question modified to reduce overlap with independently B written audit retake written exam 2010-2 Q#3.

2 H 3.0 S+

M Response: Revised VCT pressure parameter in question stem which changed correct answer as indicated.

3 F 2.0 N S 4 H 3.0 N S 5 F 2.5 B S 6 H 3.0 M S 7 H 3.0 B S Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

• The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

• The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

• The answer choices are a collection of unrelated true/false statements.

• The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

• One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

• The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

• The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

• The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

• The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).

ES-401 2 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only NRC: Question asking interlock, not higher cognitive.

Response: Change question cognitive level to F. However, the facility still considers this question H because the candidate must H recognize the plant power level is below 10% (P-7 light LIT) and 8 2.0 M E know which trips are NOT blocked at this power level. Candidate F

must evaluate the parameters given to determine which trip setpoints are exceeded, and then determine which one would cause a trip in this particular set of circumstances.

Note: Validation performance: 62.5% pass 9 H 2.5 N S 10 H 2.0 B S 1/2 twice NRC: Explain answer more fully, appears only to be testing knowledge of P-11 light being lit, ie, SI is blocked and there is only one choice (B). Also, clarify A. and C. by replacing ALWAYS with something like on a large OR small break Response: The candidate must know the steamline SI signal is 11 H 3.0 B E procedurally blocked when below P-11. Before being blocked, an SI and a MSL isolation will occur on steamline low pressure or rate of change. After the signal is blocked, the SI is blocked, but a MSLI will occur if there is a rapid lowering of steam line pressure, as will occur on a large break.

Comment incorporated into A and C.

Note: Validation performance: 62.5% pass 12 H 3.0 N S NRC: To clearly meet KA, add procedure reference (BOP VP-1) to 13 F 2.5 M E stem.

Response: Added procedure reference to stem.

14 H 2.5 B S 15 F 2.0 B S 1/2 twice NRC: Revise last line of stem to read, Under these conditions, the operator is required to Also, delete Only in A.

16 H 3.0 N E and B. and add, (Reset unnecessary).

Response: Comment incorporated.

17 H 3.0 B S 18 H 2.5 N S

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only NRC: A., B., and C. not plausible, ie, feeding 1A and 1B dry SGs.

U 19 H 2.5 N Response: Identified procedural instances of filling dry SG(s) which S

makes A, B, and C plausible (incorrect for given conditions).

NRC: Low LOD. Make question more operationally oriented. Give results, identify loss of bus or the loads. Would expect to ask for response based on malfunction or event, something not so straight forward in order to evaluate applicant competency.

NOTE: Revised from U to E, and not Low LOD because question 1.0 U 20 F N originally written to meet KA, and licensee incorporated comments.

2.5 E Response: Note: with the MTG not online, the UAT feeds are de-energized. If the SAT feed to Bus 143 trips, the loads on Bus 143 are de-energized since the Bus cannot ABT. The following loads are powered from Bus 143: 1A and 1C CW Pump, 1A VP Chiller, 1A SAC, 0A WS Pump; Bus 157: 1C HD Pump; Bus 159: Startup Feed Pump; Bus 144: 1B SAC NRC: Implausible distracters: D. implausible, never seen DG output breaker without synch. Cues: A. and B. both transformer feed breakers, if one incorrect answer, then so is other (they eliminate each other as possible answer); C. is only possible answer.

NOTE: Based on discussions and improved answer justification, question is satisfactory as written.

Response: Answer justification:

A. ACB 1411 is closed only on a dead bus, so does not require a U synchro check. All the other breakers are capable of being paralleled 21 F 2.0 N S so do require a synchro check.

B. ACB 1412 is one of the 4 supplies to BUS 141. It is a transformer feed breaker to the bus, and is plausible as it is one of the 4 so does not stand out as another busses breaker would.

C. (correct) ACB 1413 will close WITHOUT a synchro check when it is automatically closing, which makes it a plausible distractor.

D. ACB 1414 is a bus crosstie breaker, supplied from the opposite unit. Bus crossties do not always require synchro checks, ie; the ESF to Non-ESF bus crosstie is only used for dead bus transfer so it does not require a synchro check, which makes this choice plausible.

22 F 2.0 B S 23 H 3.0 B S 1/2 twice 24 F 2.5 N S 25 F 2.5 B S 1/2 twice 26 F 2.5 B S

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only NRC: KA is asking for backup (crossover) system to the normal IA system. As written the question appears to address only the normal IA supply.

Response: IA is supplied from the SA header in the Turbine Building through dryers to a TB IA header, which supplies the Aux Bldg IA header, which then supplies IA to CNMT. Distractors are plausible U because these would all be viable designs of the IA system.

27 F 2.0 N S

This meets the K/A of knowing the design of the IA system that supplies CNMT IA. The Service Air system provides air pressure to the IA dryers that supply IA Receivers. The receivers are connected to the Turbine Building IA system, which is cross-connected to the Auxiliary Building IA system. The AB IA system supplies the Unit 1 and Unit 2 containments separately, through IA CNMT isolation valves.

NRC: B. is implausible because if have HI-2 would also have HI-1.

28 H 3.0 M E Response: Remove first line of choice D so it reflects the same logic as choice B. This also provides more symmetry for the choices, with two having one bistable, and two having two bistables.

NRC: Question modified to reduce overlap with independently written audit retake written exam 2010-2 Q#29.

B Response: Changed stem as follows: Unit stable at 50%

29 H 2.5 S+ power; Rod height is 160 steps ; N-44 fails to 102%.

M Changed D.: step in, and will be blocked from automatic withdrawal; changed A.: inserted sufficient between a and Tave-Tref. This made A. the correct answer as indicated.

30 H 2.5 B S 31 H 3.0 M S 32 F 2.5 B S NRC: B. is not plausible, no relationship between SI signal and Cnmt Charcoal Filter Fan.

Response: Changed Distractor B to be more like Distractor D. The charcoal filter fan trips when the deluge valve is manually opened.

33 H 2.5 N E The valve does not automatically open, and the fan is not affected by Phase A. Distractors are plausible because the Phase A signal could have these effects on the VA system, and because the provided information could be interpreted as not having tripped the running fan, but simply caused DP to go low.

34 H 3.0 M S 35 H 2.5 N S 36 F 2.5 N S

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 37 F 2.0 B S 38 H 3.0 N S 39 F 2.5 B S 40 H 3.0 B S 41 H 2.0 N S 42 H 3.0 N S reference NRC: Remove underlined term prevent boiling from stem because it is a cue to the correct curve labeling (to Prevent Boiling) which makes question more of a direct lookup.

43 H 2.0 N E Response: Revised last stem sentence to eliminate term prevent boiling by inserting minimum between the and required, and inserted maintain in subcooled region at end of sentence.

44 H 2.5 N S 45 H 2.5 N S 46 F 2.5 N S 47 F 2.5 B S 48 H 3.0 N S 49 F 2.5 M S 50 H 2.5 B S 51 F 3.0 N S 52 H 3.0 N S reference 53 H 3.0 N S reference 54 H 3.0 B S 55 F 2.5 B S 56 H 2.5 B S reference 57 F 2.5 B S 58 F 2.5 B S 59 F 2.5 B S

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 60 H 2.0 N S 61 H 2.0 N S 62 H 3.0 B S 63 F 2.5 B S 64 F 2.0 N S 65 F 2.0 B S 66 F 2.0 B S 67 F 2.0 B S NRC: As written, having the procedure in hand could be interpreted as correct (although not complete). Reference only states may 68 F 2.5 N U perform immediate actions from memory.

Response: Rephrase first part of question with immediate actions as the correct answer, and from memory in the stem.

69 F 2.0 B S 70 F 2.0 B S 71 H 2.0 B S 72 F 2.0 B S NRC: Provide more justification to support for higher cognitive level vs fundamental (memory).

Response: The question is Level 2 (higher-comprehension) because the candidate must determine that RH pressure will be higher than CC pressure in this situation. If RH were aligned for 73 H 3.0 N E injection, or for MODE 6 refueling operations, RH pressure would be lower than CC pressure. The candidate must then use that information, and recognize the relationships between the 3 systems, and how the systems interact, including the consequences of leaks. This determination of cognitive level was made after referring to Appendix B, page 5.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only NRC: Procedure transition is an SRO function.

U 74 F 2.0 B Response: ROs are required to know immediate action steps from S memory. Included in immediate action steps of BEP-0 are the transition to various procedures as identified in the question.

75 F 2.0 N S 76 H 2.5 N S 77 H 2.5 N S 78 H 2.5 N S reference. NRC: Direct lookup, applicant references Table and is directed to Condition D. Explain how interpretation of TS is required.

Response: TLCO 3.i action D requires initiation of alternate method of monitoring within 72 hours8.333333e-4 days <br />0.02 hours <br />1.190476e-4 weeks <br />2.7396e-5 months <br /> (3 days) and restoration in 7 days.

Other actions in this TLCO have required completion times of 14 days and 30 days, or require entering TLCO 3.0.c, creating plausibility for the distractors.

U 79 F 3.0 B Each unit has one stack, with 1 monitor per stack. The TS table S

requires 1 monitor (which means 1 monitor per stack). The candidate must know that 1 inoperable monitor will have action requirements and not confuse "1 required" as meaning only 1 for both stacks.

After determining the LCO is not met, the candidate must select the proper action which is a greater than 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />, so it is not expected the candidate would have the action memorized.

80 H 2.5 N S 1/2 twice

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only NRC: C. appears to be a correct answer. Explain why C. is incorrect.

Response: If the spray valve fails open, RCS pressure will drop.

Both RCPs have to be tripped because of the loss of npsh. With no loops in operation in MODE 4, TS 3.4.6 condition A applies.

Tripping both RCPs with the spray valve open may be chosen if the E candidate thinks that makes a loop inoperable.

81 H 3.0 N The candidate may think that tripping both RCPs and using 1BEP S

ES-0.2 may be chosen to utilize natural circulation, however, 1BEP ES-0.2 is not entered directly, but from 1BEP-0.

In other situations, such as a trip of the 1C RCP with the 1D RCP running, the correct action would be to close the 1C spray valve to prevent "short cycling" the spray path. This can be confused by the candidate, making this distractor plausible, but incorrect.

82 F 2.5 N S 83 F 2.0 N S 1/2 twice NRC: A. and C. Loss of heat sink is not a plausible distractor.

84 H 2.5 N U Response: Change A.(2) and C.(2) Loss of Heat Sink distractors to Loss of RCP Net Positive Suction Head. This would happen only if RCS pressure dropped to <300 PSIG. Replace B.(2) and D.(2) with exceeding departure from nucleate boiling ratio.

85 H 2.5 N S 1/2 twice 86 F 3.0 M S 87 H 3.0 N S reference.

88 H 3.0 N S 89 H 3.0 N S 90 H 3.0 B S 91 H 2.5 N S reference. NRC: Distractor D is not plausible since depressurization wouldnt continue with subcooling too low.

92 H 3.0 N E Response: Change Distractor D to stop the depressurization.

93 H 3.0 B S 94 F 2.0 B S 95 H 3.0 B S

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 96 F 2.0 N S NRC: Choice A. (Plant Manager) is also correct answer.

Response: The Shift Manager and RP Department may waive the requirement for VA exhaust fans in operation for releases. BCP 400-TCNMT/ROUTINE, Revision 20, Page 12, Section 4.2 Positions used as distractors are all responsible for reviews or 97 F 2.0 N E approvals of other administrative items.

The Plant Manager may have signature authority for the Shift Manager, but they are signing for the Shift Manager position. It would be the same for a SM qualified Unit Supervisor. The Shift Manager position has the authority to waive the requirement for fans in operation.

98 H 3.0 N S 99 H 3.0 M S reference.

100 H 2.5 N S