ML13317A667

2013 Clinton Power Station Initial Licensed Examination ES-401-9

ML13317A667
Person / Time
Site:	Clinton
Issue date:	08/27/2013
From:	David Reeser Operations Branch III
To:	AmerGen Energy Co
David Reeser
Shared Package
ML11354A433	List: ML13317A622 ML13317A649 ML13317A667 ML13317A669
References
Download: ML13317A667 (20)

Text

ES-401 Written Examination Review Worksheet Form ES-401-9 2013 Clinton Power Station Initial Licensed Operator Written Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 1 F(H) 2 Y N E CPS 4411.97 directs use of Narrow Range instruments when on scale above Minimum Useable Level. This is Fundamental H S (Memory) level of knowledge. Temperature effects on level indication is also a Fundamental (Memory) LOK.

RE: Knowing how temperature affects the indication requires some analysis since the impact of elevated temperature is not the same for all level instruments.

No Changes were made to the question.

2 F 2 X Y B E No previous NRC use.

Why is choice A plausible. The explanation provided seems to support implausibility.

RE: Distracter A is plausible since smoke exhausted from containment could conceivably (although unlikely) migrate to the MCR HVAC intakes Add Unfiltered after (CCP).

RE: Unfiltered added after (CCP) in distracter C 3 F 2 Y B S LaSalle 2008 and Cooper 2008 4 F 2 Y N S 5 H 3 N N U The K/A is asking how breakers and relays are affected by events related to Generator Voltage and Grid Disturbances. As discussed in the front matter of the K/A manual the APE 700000 K/As were added to address lessons learned from the August 2003 major blackout and are related primarily to degraded voltage..The question as written is simply testing the knowledge of how the distribution system responds to any Generator Lockout. The question does not test if the breakers/relays are affected by or respond directly to a Generator Voltage or Grid Disturbance.

RE: Question revised to indicate a degraded voltage on 4160V Buses 1A & 1B and ask how breakers are expected to respond.

5R H 3 Y N S 6 H 2 Y N S 1

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 7 F 2 X N N U First sentence in stem is not necessary to answer question.

The first sentence asks for the reason for automatic function (K/A),

but answer choices state the function and the reason for the function is unnecessary to pick the correct answer.

RE: Question revised to identify reason for isolation..

7R F 2 Y N S 8 F 2 X X N B U DAEC 2005 Y E DAEC is a Mark 1 containment style. Question as written is not applicable to CPS.

Question is related to Containment Pressure, but K/A specifies Drywell Pressure.

Stem should state, or clearly indicate, that LOCA is in the Drywell and not the Containment.

RE: After discussion with facility, agreed that question is applicable to CPS and that question meets K/A. The decision to blowdown on High Drywell/Containment pressure is actually dependent upon (limited by) Containment Pressure and not Drywell Pressure. Facility also stated that since the question indicates that a Loss of Coolant Accident is in progress that Containment Pressure would not be rising unless Drywell Pressure was high. Stem will be revised to include containment/drywell temperature information and will provide additional information to support that Drywell Pressure is driving Containment Pressure.

Stem needs to be revised to include additional data or a statement added to signify that efforts to control pressure have failed (e.g.,

Containment Sprays are ineffective or degraded)

RE: Since this is a RO question and ROs are not responsible for decision making, this additional information is unnecessary.

The question stem clearly states that the blowdown is being performed because of pressure; therefore distracters B and C are not plausible unless there is some indication in the stem that DW or CT temperatures are elevated.

RE: Stem revised to include containment/drywell temperature information. With this change question upgraded from U(nsat) to E(hancement) 9 F 2 Y B S Grand Gulf 2005 2

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 10 H 2 Y B S MNGP 2009 11 F(H) 2 X Y N E Plant condition table is unnecessary to choose the correct answer.

Question can be simply answered based on memorized knowledge H

of Group 3 Isolation setpoint and expected action.

RE: Table will be removed. Applicant has to determine the system response to lowering level and then the impact on the RHR pump, therefore High LOK.

12 F 2 N N U 1/2X2; K/A is related to IA system valve operation in response to a partial or complete loss of IA. Question test examinees knowledge of valve response to a Containment Isolation (i.e. electrical deenergization). Valve recovery is different in each case.

RE: FACILITYS POSITION is that since the containment isolation results in a partial loss of air that the question meets the K/A.

12R H 3 Y N S New question to indicate loss of air to Control Building and to determine impact on air supply to Containment. LOK changed from F(undamental) to H(igher).

13 H 3 Y N S 14 H 3 Y N S If possible shrink graphic displays to fit on one page.

15 F 2 Y N S 16 H 2 X Y N U Given that turbine speed is below 1800 rpm, I dont believe that the turbine is at risk. Therefore there is no correct answer.

RE: Turbine speed changed to a value GTE 1800 rpm.

16R H 2 Y N S 17 H 3 X Y N E Given the initial conditions, Method 4, and therefore distracter D is not a plausible choice. I dont believe any applicant would believe that RHR C is powered from 4160 1C1. Additionally, RHR C does not have a heat exchanger and therefore no heat removal capability other than by Method 1.

RE: Deleted Method 4 and replaced Distracter D with Method 2 ONLY and reordered the distracters.

3

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 18 F 2 X Y N S 1/2X2; EOC-RPT is designed to trip the RR pumps off, not downshift.

This ends up being two separate unrelated questions.

RE: Facility provided documentation to show that pumps do downshift. Comment withdrawn.

19 F 2 N N U K/A refers to AREA Radiation Levels. Question refers to PROCESS radiation monitors.

RE: Changed stem to indicate that fuel is being moved in the Spent Fuel Pool, added ARM for Spent Fuel Pool Area, and changed PRMs to Containment Exhaust (CCP) PRMs. Since these PRMs are GM detectors they will be impacted by elevated radiation levels in the vicinity of the Spent Fuel Pool. Cognitive level increased since examinee must now evaluate 19R F 3 Y N S 20 F 2 Y B E No previous NRC exam usage.

Add discussion to Answer Explanation related to Loss of Excitation to CW pumps RE: Enhanced explanation.

21 H 3 X Y N E Delete the words to control DW pressure from distracter D. This is the only distracter with a reason.

RE: The words to control DW pressure were deleted from distracter D.

Remove the table of valve positions. Specific valve descriptions provide unnecessary clues to answer the question.

RE: Table replaced with graphic.

22 H 3 X Y N E Recommend revising distracter C A filteredin progress via the Common Station HVAC stack. The Fuel.

Recommend revising distracter D HVAC stack. The Fuel Building Ventilation (VF) system is in operation, but the VF Exhaust Fan has tripped.

RE: No change to distracter C. Distracter D reworded.

23 F 2 Y N S 4

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 24 H 3 N N U The event described in the question does not look like an inadvertent reactivity addition. Control rods were withdrawn in the Y E approved sequence and the control rod in question was only withdrawn one notch.

RE: While the describe event is not strictly an inadvertent addition, it is an unplanned power excursion resulting from an unexpected change in reactivity, meeting the intent of the K/A.

No correct answer. Revise d to require insertion of ALL control rods. Instructions for Criticality for a Beginning of Cycle (BOC) startup, state that if the reactor goes critical prior to the specified step (step 4) then to insert (all) control rods to the ALL RODS IN condition. [Enhancement]

RE: Revise distracter A by changing rod number to 16-45. Revise distracter D to state Insert SKIP until the reactor is subcritical.

With this change question upgraded from U(nsat) to E(hancement) 25 H 2 X X N N U K/A justification states that the examinee must choose a sequence to preclude localized heating. Question simply asks for FIRST SRV Y E to be operated. Question is not related to response to Suppression Pool high temperature. There is nothing in the question to imply that a high temperature condition exists.

RE: High temperature condition is implied since the operation of RCIC and/or operation of SRVs is needed to control pressure.

Applicant needs to know there is a preferred sequence in order to select the appropriate SRV.

Question also requires that the examinee assume that HPCS is running (preferred vs alternate injection source). IF HPCS is not running then both C and D could be correct.

RE: Stem revised to state that the plant had been operating at full power for a prolonged period. Therefore HPCS operation would be required to maintain RPV water level. With this change, question upgraded from U(nsat) to E(hancement) 26 F 2 Y N S 27 H 2 Y N E Replace the words loss of coolant accident in the stem, with the words reactor coolant system leak. Identified plant conditions are not consistent with an accident.

RE: Changed as requested.

28 H 3 Y N S 5

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 29 F 2 Y N S 30 H 2 Y N E Remove the words on the High Pressure Core Spray System (HP) from the first sentence.

RE: The words on the High Pressure Core Spray System (HP) were removed.

31 F 2 Y N S 32 H 2 Y N E Change distracters A and B from All to Any seven RE: All changed to Any 33 H 3 Y N S 34 H 3 Y N E Recommend changing distracter A to a parameter (e.g., Drywell Pressure or Reactor Neutron Flux) that is not a Group 1 isolation S

signal RE: After discussion with facility, left question unchanged.

35 H 3 Y N S 36 F 2 Y B S DAEC 1999 37 F(H) 2 X Y N E 1/2X2; Due to the oscillatory nature of LPRM 30-31C, and if one were to incorrectly assume that LPRMs contributed to the thermal S

power calculation, why would part 2 of B and D be plausible?

RE: No change. Indicates lower is just as plausible as higher.

To answer question, simple recall of two separate facts is required.

This does not make it a higher cognitive level question.

RE: Cognitive level changed to F(undamental).

38 F 2 Y N S 6

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 39 F(H) 2 Y B E Hope Creek 2009 (M)

H Question should be listed as Modified. RE: Agreed.

Load Shed and Restored Automatically = In-service. Why differentiate.

RE: Division battery chargers are not load shed but do lose power until EDGs reenergize the busses. Reworded 2nd part of distracter C to say In-Service so that two of the choices related to load shedding and two of the choices related to de-energized and re-energized.

Fundamental recall of AC supply to battery chargers.

RE: LOK unchanged; requires evaluation of impact.

40 H 2 X Y N U A is also correct. Lowering KW load would also bring operation to within the limits of the curve.

FACILITYS POSITION was that EDG operation was limited to maintained GTE power factor of 0.8 by procedure. However manufacturer recommendations allow operation at less than 0.8 power factor.

RE: Question was revised to eliminate two possible answers.

40R H 2 Y N S 41 H 3 Y N S 42 F(H) 2 Y N S Recall of bus power sources.

H RE: LOK was not changed; examinee must evaluate impact with reserve power source not available.

43 H 3 B E Vermont Yankee 2009 (M)

S Question should be listed as Modified. RE: Agreed Recommend revising distracter D to state that remains constant due to error detection circuit replacing failed input with average of other three inputs. RE: OK as is; No Change.

44 H 3 Y M S 45 H 2 Y N S 7

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 46 F 2 X Y N E Remove emphasis from the word AND in the stem or remove reference to controlling flow rate completely. Flowrate is controlled primarily by adjusting F053B. Cooldown rate is primarily controlled by adjusting F003B and F048B to control flow through the heat exchanger. Under the conditions given in the stem throttling F003B will have little effect on system flow rate.

RE: Deleted reference to controlling system flow rate.

47 F 2 N N U K/A refers to operation/monitoring of the RHR pumps in the LPCI mode and not operation of SX Pumps.

Y S RE: There is no separate K/A for SX, and SX is required to support operation of RHR.

48 H 2 N N U No interpretation of reference material is required. Applicant is asked to calculate reactor period based on doubling time, and then Y S determine if period is within the procedurally recommended band.

RE: Calculated value must be compared to acceptable range given in the approved procedure.

49 F 2 N N U Inhibiting ADS is neither an entry condition, nor an immediate action step. Question is more suited to K/A 2.4.6 Y E RE: While not an immediate action by the strictest definition it is the first action step of EOP 1A and prompt performance is expected to mitigate unnecessary reactivity addition.

Recommend changing distracters as follows:

B. Scram with no high pressure injection sources available C. Station Blackout D. Scram without Shutdown Criteria satisfied.

RE: Will change distracters.

50 H 3 Y N S 51 F 2 Y B S No previous NRC exam usage.

52 F 2 Y N S 8

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 53 F 3 X X Y N U Not operationally valid. The question implies that specific RR loop temperature indications are used under the condition specified in the E

stem. The location specified is used anytime that RR loop temperature monitoring is being performed IAW CPS 9000.06, Reactor Coolant and Vessel Metal/Pressure/Temperature Limit Logs, and the procedure specifically identifies the location. Thus the only knowledge being tested is if the applicant can locate a specific recorder in the MCR.

A more operationally valid question would be one related to the validity of the indication when SDC is not in operation.

RE: Examinees must know the limitations of the specified instrument monitoring points. Stem reworded to clarify the focus of the question and one of the locations changed to make the distracter more plausible. With these changes, question upgraded from U(nsat) to E(hancement) 54 F(H) 2 X N N E The question does not test the applicants knowledge of the affects that a loss CCW has on the system only the end result.

H Y RE: Replaced annunciator with statement that there has been an extended loss of CCW to the NRHX. This change also restores LOK to H(igher) 55 H 2 X Y N E Change second part of distracters B and D from NOT change to lower.

S RE: No changes were made.

9

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 56 F 2 N N U The examinee does not have to assess the effect on suppression pool temperature; he is told to realign RHR. Question should be H Y E revised to assess whether the pool cooling mode is first impacted, and then whether the full cooling capability is immediately available or not.

RE: The word FULL will be inserted into the final sentence of the stem just prior Suppression Pool Cooling Mode to require the applicant to assess the impact of F048A cycling for 10 minutes (satisfying the K/A). This also increases the LOK to High. With this change, question upgraded from U(nsat) to E(hancement).

Potential double jeopardy with question 36 RE: Question 36 tests the response of the LPCS system, to an auto initiation system, when the system is not in standby. Question 56 tests the response of the RHR system to an auto initiation, but also includes knowledge of auto initiation overrides associated with pool cooling. Questions test significantly different knowledge factors and will not conflict.

57 F 2 Y N S 1/2X2 58 F 2 X Y N U The stem contains part of the answer to the first question. Delete the first question. Insert the words to validate the alarm after the word E

pushbutton.

Reword the second question to choose the appropriate action:

A) Generator operation may continue at the current load B) Immediately trip the turbine generator C) Reduce generator load to less than 316 MVA D) Reduce generator load until the alarm clears RE: First part of question reworded to ask what additional action is required to be taken. No changes made to second part. With this change, question upgraded from U(nsat) to E(hancement).

10

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 59 F(H) 3 X Y B U River Bend 2010 (M)

Question should be listed as Modified.

Question simply requires recall of setpoints.

Header pressure should never have dropped to 125 psig unless there is a demand on the system. Without any demand only the A pump should be running. Also if both pumps are running then pressure should be much higher. The stem and/or answer choices need to be revised. An argument could also be made that neither pump is running, otherwise how did pressure get to 125 psig.

RE: Question revised to first state that there was a loss of power to the MWPH; then answer will be changed to only DFP A running.

With change LOK will be HIGH 59R H 3 Y B S 60 F 3 Y B S No previous NRC exam usage 61 H 4 N N U Question tests the examinees knowledge of how heater drains are impacted but does not test knowledge of the impact on the Y S Condensate system.

RE: Not controlling level could lead to steam flow in drain cooler section leading to tube rupture and diversion of Condensate System flow. Question SAT as written.

62 H 2 X Y N U The first part of the question is LOD=1; distracters B and D not credible. Suggested rewrite to ask if water level changes and why.

FACILITY POSITION: B and D plausible if applicant believes that demand signal to RFPTs is a level demand and not a flow demand.

RE: A lack of knowledge does not create plausibility.

Question rewritten to include a graphic of the feed controllers, then asks examinee to determine from the graphic what signal is controlling the associated feed pump.

62R H 2 Y N S 63 H 3 Y N S 11

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 64 F(H) 2 X Y N U Simple recall of power distribution to HPU pumps E RE: Question tests whether the examinee knows that the auto bus cross-tie occurs between the associated Unit Subs (correct) or between the associated MCCs (incorrect)

Add Automatically to beginning of Distracters A, B, & C. With this change, question upgraded from U(nsat) to E(hancement) 65 H(F) 3 Y B S No previous NRC exam usage Comprehension/Analysis since the examinee must evaluate the impact of Bus 1A1 OOS and subsequent loss or failure event.

RE: LOK changed to HIGH.

66 H 3 Y N E Should not need to provide rated power conditions. In first sentence of stem S

RE: No changes made.

67 F 2 X X X Y B U DAEC 2005.

H E Rewrite stem to eliminate the YES/NO choice. As written the stem provides a hint that there is clearly a method to use from the MCR.

The question could simply ask which of the following procedurally approved methods can be used to maintain level, with operations limited to the MCR?

RE: Stem rewritten to be similar to above suggestion, and YES/NO deleted from distracters. Question High cog since must evaluate impact of losing RWCU with continued operation of CRD.

If you want to rely on a procedural technicality to eliminate choice Bthe question should ask for approved methods. I am not aware of any technical reason why this method could not be used in MODE 5.

I think the intent of the MODE 4 restriction is to prevent putting water in the steam lines when the plant is hot/pressurized. This is not the condition in MODE 5.

RE: Question revised to ask for procedurally approved method.

If the answer to the first part is NO then there are two correct answers. Thus C and D could be eliminated.

RE: Concern eliminated by changes.

With these changes, question upgraded from U(nsat) to E(hancement) 12

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 68 F 2 Y B S No previous NRC exam usage 69 F(H) 2 Y B S Grand Gulf 2011; Recall of MODE definitions H RE: Requires evaluation of temperature and determination of procedural restraints since MODES 1 and 2 have no temperature limit stated in definition.

70 F(H) 2 Y N S Simple recall of drawing symbol legend.

71 F 2 Y B S Quad Cities 2009 72 H(F) 2 Y B S Quad Cities 2009; Requires calculation to determine accumulated dose.

73 F(H) 2 Y B E No previous NRC exam usage H Reword distracter A to eliminate the words isolation signal (e.g.,

continue to operate normally)

RE: Reworded distracter A to eliminate the words by the isolation signal.

A better question might include pump status (running without a suction or discharge path). Not incorporated.

RE: High cog since must determine impact of level transient.

74 F 2 Y B S 1/2X2; No previous NRC exam usage 75 F 3 Y B E MNGP 2010 S Need to add punctuation to separate post scram condition from reason for resetting the scram.

In the second sentence of the stem, replace the word during with the word following.

The first sentence could be eliminated.

RE: No changes were made.

Bank = 19 8/75 Unsat (11%)

Modified = 3 F/H 32/43(43/57%)

New = 53 F(H)/H(F) 4/5 13

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 76(1) H 2 Y Y N S 77(2) H 3 X X Y Y B U Oyster Creek 2011 (M)

Stem states that EOP-2 has been entered, but EOP6 parameters and Details are included.

There is no correct answer. EOP 2 includes the necessary steps for blowdown, so EOP 3 is NOT entered.

Question should have been labeled as modified RE: Replace 2nd sentence of distracter with an item in Parameter table that RPV level cannot be determined.

Change Reactor Power to 4% and cycling Change distracter A to Lower pressure and maintain 600-800 psig.

Change distracter B to Blowdown ONLY Change from Bank to New or Modified 77(2)R H 3 Y Y M S 78(3) H 2 N Y B U River Bend 2010 Y E A bellows rupture or leak is not a fuel handling accident unless the cause of the leak or rupture were due to impact by a fuel bundle or fuel handling equipment.

RE: Fuel handling accident since irradiated fuel could be uncovered.

The question has written is more suited to AA2.02 (Fuel Pool Level).

RE: NO change to K/A If core alterations are in progress then secondary containment would already be established.

RE: Secondary Containment not required if reactor has been shutdown for more than 24 hours2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br />.

Question may require knowledge of procedures beyond that which is required to be memorized.

RE: Facility objective PB4011.01.01.05 Revised stem to Given conditions, Which listed action is required?

79(4) H 3 Y Y B S MNGP 2009 14

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 80(5) H 2 Y N N U Not SRO only. An RO should know that if you dont have air the MSIVs shut and you cant use the bypasses. They know you have Y E to change your mitigation strategy. Question doesntt ask what to do or what mitigating strategy to use, just what event requires a change.

Changing EOP strategy doesnt equate to highest priority for alarm response. Delete and will thus be prioritized the highest RE: Revised stem to state that a Feedwater transient caused the SCRAM and reworded question to ask: Which of the following 4 annunciators, if received simultaneously, would be prioritized the highest? With this change, question upgraded from U(nsat) to E(hancement).

81(6) H 3 N Y B U MNGP 2005; The focus of the K/A is High Reactor Pressure. The focus of the question is an ATWS.

RE: Change answer (D) to Stabilize RPV pressure below 1065 psig using SRVs. This change brings question into alignment with K/A.

Reclassified as M(odified) since answer focus was changed.

81(6)R H 3 Y Y M S 82(7) H 3 N N N U K/A is related to High Drywell Temperature. The question is focused on High Containment Temperature.

S RE: Question OK as IS since examinee must also evaluate whether instruments are impacted by high Drywell temperature.

83(8) F 2 Y Y B S No previous NRC Exam usage.

84(9) H 2 X Y Y B U Cooper 2008; The question as written is not operationally valid. An automatic isolation of the MSIVs has failed to occur. The immediate action is to shut the MSIVs. With the valves shut the action to trip the failed instruments is mute. The failed trip channels do not have to be tripped within the specified time frame, but must be restored before reopening the MSIVs if staying in Mode 3 or before restart..

RE: Question and K/A replaced.

84(9)R H 3 Y Y B S No previous NRC Exam usage.

15

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 85(10) H 2 X Y Y N E Distracter B is not plausiblle since the stem provides clear indication that MST temperature is not NORMAL. It would only be plausible if the Area Temperature Limits table were not included.

RE: Change distracter B to No actions are required until Aux Bldg Steam Tunnel temperature has exceeded Mas Safe.

86(11) H 3 X X Y Y B U No previous NRC Exam usage E The Otherwise statements in distracters B thru D require application of Table 3.3.6.1-1 which is not provided. It is not reasonable to require applicants to memorize which conditions (G-O) are applicable from Condition F.1. Question is answered by eliminating which answer are wrong, not by knowing which or finding which answer is correct.

RE: Tech Spec tables to be provided. With this change, question upgraded from U(nsat) to E(hancement).

87(12) H 3 X Y N N U 1/2X2; The second part of C is a subset of the second part of D Tank level must be verified as well as concentration.

Y E ROs would know based on chemistry fundamentals that Boron Concentration is a function of tank volume. With a decrease in tank volume it only makes sense that a chemistry sample is appropriate.

Dont need to know the tank level limits (curve) to answer the question.

RE: SROs are responsible for determining OPERABILITY.

RE: Add the word ONLY to distracters A(2) and C(2). This was considered an enhancement. With this change, question upgraded from U(nsat) to E(hancement).

16

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 88(13) F(H) 3 Y N N U Stem question asks two questions. Question is answered solely by the secondary part of the distracters (memory cognitive level).

H Y E Therefore the question is not SRO only. Based on the answer the question should be When can injection be stopped or What are the indications of a flooded MSL.

RE: Monitoring RPV to determine when the vessel is flooded is an STA function and STAs are required to be SRO licensed at CPS.

The source of injection is not important except that steam driven sources are not considered due to lack of steam supply (RPV blown down).

RE: Add that Shutdown criteria is met to the stem.

Change question to: Which of the following scenarios represents a condition where injection can be slowed or stopped?

LOK is HIGH since each of the scenarios must be evaluated to determine if it meets the criteria to terminate injection. With these changes, question upgraded from U(nsat) to E(hancement).

89(14) F 2 Y N B U No previous NRC Exam usage Y S ROs are required to have knowledge of the Limiting Conditions for Operation of SSCs listed in Technical Specification. LCO 3.8.8 clearly states that an inverter must be capable of supplying the required distribution system. All action statements are <1 hour.

RE: LCO simply states that the Inverter must be operable. TS Bases state that the NSPS bus must be power from the Inverter NORMAL supply for Inverter to be considered operable. This is SRO knowledge since it is contained in the bases.

17

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 90(15) H(F) 3 X Y N B U Brunswick 2008; Should this be identified as Modified?

Y E 1/2X2; The answer to the first part of the question is RO knowledge.

RE: Facilitys position is that determination of availability is a SRO function and involves more than simply identifying whether power is available or not. Answer explanation will be enhanced to provide additional information regarding this position.

Additionally, the facilitys position is that since the Tech Spec Bases describes what is meant by administrative means, that the question is SRO only because ROs are not responsible for knowing the Tech Spec bases.

The action table statement provided in the stem provides a cue to the answer of the second part of the question (filling and venting the HPCS system is not an administrative means).

RE: The Tech Spec Action table removed from question With this change, question upgraded from U(nsat) to E(hancement)..

Assessment of availability is a higher order cognitive level.

RE: LOK changed to High.

91(16) H 3 Y Y N S 92(17) H 2 Y Y B E No previous NRC exam usage. Third bullet should state that testing was completed.

RE: Question changed as requested.

93(18) H 2 Y Y B S Fitzpatrick 2008 94(19) F 2 Y Y B S Quad Cities 2011; 1/2X2 95(20) F 2 Y Y B S Oyster Creek 2010 96(21) H 2 Y Y N E Delete Which of required?

Reorder distracters in time sequence (soonest to latest).

RE: Changes made as requested.

97(22) F 2 Y Y B S Quad Cities 2011; 1/2X2 98(23) F 2 Y Y M S 18

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 99(24) H 3 Y N N U Question as submitted is not SRO ONLY.

Part one is answered with system knowledge (RO). This alarm is actuated whenever a Turbine Bypass Valve is open with power approaching, or above, the RC&IS LPSP to alert the operator of possible non-conservative enforcement of rod withdrawal limits.

ROs are required to have knowledge of SSC Limiting Conditions for Operation and system knowledge can be used to answer the second part of the question.

RE: Facility believes that since the LCO applicability is specified in ITS Table 3.3.2.1-1, that the ROs are not responsible for knowing when the LCO is applicable.

ROs are expected to know RCIS/RPC/RWL transition points (LPSP, LPAP, and HPSP) and expected to know which rod withdrawal limitations are enforced in each of these zones.

RE: Part 2 of question changed to read: Has the Rod Pattern Controller Operability status changed? and correct answer changed to C This change brings question into alignment with the SRO only criteria.

99(24)R H 3 Y Y N S 100(25) F 3 Y N N U The question is related to basic EOP control strategies of which the ROs are also responsible.

Y E RE: Selection of level control band is an SRO function/responsibility.

RE: Part 1 changed to read: Under these conditions, the level control band is selected to ___________: With this change, question upgraded from U(nsat) to E(hancement).

Bank = 12 4/25 Unsat (16%)

Modified = 3 F/H 7/18(32/68%)

New = 10 F(H)/H(F) 0/1 19

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

• The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

• The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

• The answer choices are a collection of unrelated true/false statements.

• The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

• One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

• The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

• The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

• The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

• The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).

20