ML12095A361

From kanterella
Jump to navigation Jump to search
2010 Clinton Power Station Initial License Examination Revised Written Examination Forms
ML12095A361
Person / Time
Site: Clinton Constellation icon.png
Issue date: 04/04/2012
From: Mcneil D
Operations Branch III
To:
References
Download: ML12095A361 (27)
v • d • e


Text

April 4, 2011 MEMORANDUM FROM: Dell McNeil, Senior Operations Engineer, RIII TO: FILE

SUBJECT:

CLINTON 2010 INITIAL LICENSE EXAMINATION REVIEW While performing an in-house inspection of the 2010 Clinton Power Station Initial License Examination documents, it was noted by the lead auditor that the Form ES-401-9 (Written Examination Review Worksheet) for the Clinton Power Station contained some Level of Difficulty (LOD) scores of 1.5, some Q=K/A boxes marked with an N, and other psychometric or job content boxes checked without a corresponding resolution for these indications of unsatisfactory questions. A review of the entire administered written examination was assigned to me. Upon review of the examination, I found 15 questions that I considered unsatisfactory for use on an NRC Initial License Examination. The chief examiner stated that he thought an LOD = 1.5 question was satisfactory and a question was not unsatisfactory until an LOD = 1.0 was assigned. My review indicated that some of the questions marked LOD = 1.5 were LOD = 1.0, and some were LOD = 2.0. Those questions assigned an LOD = 1.5 by the chief examiner were identified to the facility licensee and, during discussions with the facility licensee, the chief examiner was convinced by the facility licensee that the questions were acceptable for use on the examination. The chief examiner did not fully document all of these discussions on the ES-401-9 Form.

I competed a new ES-401-9 Form, outlining my assessment of the questions on the examination. After determining which questions I considered unsatisfactory, I completed a Form ES-401-1, BWR Written Examination Outline, and a Form ES-401-3, Generic Knowledge and Abilities Outline (Tier 3), eliminating the questions I considered unsatisfactory from those forms. The new Form 401-1 revealed no zeroes in any column of the tier total rows, and no zeroes in any of the administrative area totals. Because 80% of the examination was still considered satisfactory, and the Forms ES-401-1 and ES-401-3 had no zeroes in their tier total rows, I concluded the written examination was a valid licensing tool.

The applicant written examination grading sheets were re-graded with the proposed unsatisfactory questions deleted from the examination and answer key. All of the resultant applicant grades were above 80%, therefore, no licensing decisions were flawed.

The question numbers from the Clinton Power Station 2010 Initial License written examination that were found to be unsatisfactory were: 12, 20, 21, 22, 24, 26, 27, 30, 32, 47, 50, 54, 55, 56, and 60. Most of these question were determined to be of low discriminatory value, although there were some questions that had other fatal flaws. The revised Examiner Standards Forms are included below.

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO Link ward (F/H) (1-5) Focus Dist. units K/A Only B/M/N U/E/S Explanation Is distractor C plausible??? Why would a vacuum breaker line ever be under water??? Need to change distractor C.

1 F 2.0 Y N E Independent Reviewer (IR) comment: Replaced distractor C.

Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
3. Check the appropriate box if a psychometric flaw is identified:
  • The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
  • The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
  • The answer choices are a collection of unrelated true/false statements.
  • The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
  • One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
4. Check the appropriate box if a job content error is identified:
  • The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
  • The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
  • The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
  • The question requires reverse logic or application compared to the job requirements.
5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
7. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
8. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO Link ward (F/H) (1-5) Focus Dist. units K/A Only B/M/N U/E/S Explanation Is there enough info in the question stem to determine if you 're i n an unsafe region of the pressure suppression pressure (N) chart, no level given??? Assuming a normal level you could continue to spray until 0 psig in Cn mt. Question stem says you are a t 0.1 psig, and explanation says you don 't have to stop until 0 psi g, so is 2 H 2.0 x x Y B U there a correct answer??? What is c n m t negative design pressure? Question was revised to address all concerns.

IR - Minor change was made to the stem of the question to clarify Distractors were credible. This is RO knowledge. Question was not unsatisfactory, but enhancements made.

3 H 2.0 x x Y B S IR - the distractors were credible.

4 F 2.0 x Y B S Why is distractor B incorrect??? Need to delete "for each RHR Shutdown Cooling Subsystem.. Resolution: Question 5 F 3.0 x Y B E was revised to address all concerns. IR - Distractor b. was acceptable as written. Modified distractor c.

What does the procedure number mean??? If 4003 indicates RCIC system w hy would anybody pic k anything but D??? Why is C plausible if a breaker trips? Why would 6 F 3.0 N B I reclose it without first checking it out??? The station was able to explain why all distractors were plausible, therefore the question was satisfactory. IR - The question also matches the K/A.

IR - the Q was LOD = 2.0. The question was satisfactory 7 H 1.5 Y B S as written.

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO Link ward (F/H) (1-5) Focus Dist. units K/A Only B/M/N U/E/S Explanation Change "collapsing voids" to higher pressure in distractor A.

Does the MDRFP auto start on low level??? Distractor D needs to be changed because I don't think it is plausible, Feedwater doesn't isolate on a turbine trip. Resolution:

Question was revised to address all concerns. IR -

8 F 1.5 x Y M E determined the question was not revised. Distractor a.

(correct answer) was better with "collapsing voids" and left. Distractor d. was a weak distractor, but was not changed. Question was still satisfactory with one implausible distractor. LOD = 2.0 Is there enough info in the stem to answer the question???

Resolution: Question was replaced. IR - Difficulty level as 9 H 4.0 x Y B U assigned was too high - 2.0. The original question could have been retained with minor modifications. Stem focus was correct.

Not sure if A and C are plausible? Resolution: Question was revised to address all concerns. Only distractor C needed to 10 F 2.0 x Y B E be changed. IR - distractor c. was revised and one plant condition was revised. The question stem focus was correct.

Seems like a very easy question. Not sure the second part of the distractors A and D are plausible. Resolution: Question was revised to address all concerns. Clinton operational 11 H 2.0 Y B E philosophy may be to remain at a low power condition while a problem with SRM is fixed. IR - distractor a. was revised -

removed 1 out of 2 taken twice. Question was satisfactory.

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO Link ward (F/H) (1-5) Focus Dist. units K/A Only B/M/N U/E/S Explanation Seems like a very easy question. Straight forward setpoint question. IR - should have been replaced. If you know 12 F 1.5 Y B S the 105 second timer is involved, b. is the only correct answer and the rest is not needed. LOD < 2.0. Question was unsatisfactory.

13 H 2.0 Y B S Distractor C is not plausible. Change distractor C to be "Throttle closed RHR B Hx Service Water Outlet Valve."

Must also change question to ask the procedurally required 14 H 2.0 Y B E action to maintain 50F/hr C/D rate. Resolution: Question was revised to address all concerns. Distractors B and C were edited to provide better distractors. IR - agree.

Resolution: Question was revised to address all concerns.

15 H 3.0 Y M E Distractor D was edited as proposed. IR - Question was satisfactory as modified.

16 F 1.5 Y B S Seems like a very easy question. IR - As-written, LOD = 2.0 17 H 3.0 x Y B S IR - Stem focus is correct.

Do we need to state that the service air system is in its normal system alignment? IR - no changes were made to 18 H 2.0 x Y B S the stem. The applicant is not allowed to assume there is something wrong. Stem focus is correct.

Plant conditions slightly modified to give a reason for the 19 H 2.0 x Y B S valve being shut was provided. Stem focus ok.

Seems like a very easy question. Requires knowledge of 20 F 1.5 Y M S how to actuate MSL isolation. IR - LOD = 1. Question should have been replaced.

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO Link ward (F/H) (1-5) Focus Dist. units K/A Only B/M/N U/E/S Explanation Seems like a very easy question. Only need to know what the VG system flow rate is supposed to be to answer it. IR -

The visual aid was changed for the administered 21 H 2.0 x Y B S examination moving SGTS flow even lower that in the proposed question. Change makes the LOD = 1.0. The question was unsatisfactory Seems like a very easy question. IR - agree. LOD = 1. The 22 H 1.5 Y B S question was unsatisfactory.

Need to change the description of 1BF09Y. It is "Fuel Building Supply Outboard Isolation Damper." Resolution:

23 H 3.0 Y B S Question was revised to address all concerns. 1VF09Y terminology was revised as stated above. IR - agreed.

Question should have been marked as Enhancement.

Seems like a very easy question. IR - the difficulty level is appropriate, however, the K/A was not adequately satisfied. There may be immediate action steps/entry 24 F 2.0 Y B S conditions associated with the answer that should have been added to the question. Question was unsatisfactory.

In distractor D "double verified" should be capitalized so that 25 F 3.0 Y B E it resembles the other distractors. Resolution: Question was revised to address concerns stated above. IR - agreed.

Seems like a very easy question. IR - the LOD should have 26 F 1.5 Y N S been LOD = 1 and the question rejected.

IR - question does not match the K/A - should have been 27 H 2.0 N B S replaced. The question was unsatisfactory.

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO Link ward (F/H) (1-5) Focus Dist. units K/A Only B/M/N U/E/S Explanation IR - agreed. Reviewed the distractors, the distractors are credible. If an operator does not know how the system 28 H 3.0 x Y M S works or doesn't understand the meters, all of the distractors are equally difficult. Question was satisfactory.

I don't think distractor D is plausible. Change distractor D.

Resolution: Question was left as is based on explanation provided by the Station. IR - new distractor d. is better.

29 H 3.0 x Y N E Distractor a. is eliminated because of grammar error (a in the beginning) and occurred was spelled incorrectly.

Question was satisfactory.

Easy setpoint question. Potentially minutia. IR - lod = 1.

30 F 2.0 Y B S Question was unsatisfactory.

Need to add a comma after Lockout. IR - station re-worded 31 H 3.0 N B E the stem, still left out the comma. Question was satisfactory.

Seems like a very easy question. IR - Agreed. Q is 32 F 2.0 Y B S LOD = 1. Question was unsatisfactory.

Change distractor D to 25 minutes. Why isn't this a direct lookup? Resolution: Question was revised to address concerns stated above. IR - Question stem focus is 33 H 2.0 x x Y M E correct.Not minutia - needed to know to properly operate the plant. Not direct lookup, the operator has to demonstrate the proper use of the spider graph.

Question was satisfactory.

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO Link ward (F/H) (1-5) Focus Dist. units K/A Only B/M/N U/E/S Explanation Need to make the < and > bold and bigger. Distractors C and D need to be changed to state "the RPV Flange" not irradiated fuel seated in the vessel. Resolution: Question was revised to address concerns stated above. Distractor C 34 F 2.0 x N N E was not changed to state "the RP Fante" because if it were it would be a correct answer also. IR - The distractors were credible, but needed modification. The question matched the K/A. The question was satisfactory.

Question need to differentiate between VC air handling equipment and VC cooling equipment. You can't purge if you don't have fans. Distractors A and C are not plausible and i'm 35 F 3.0 x Y N U not sure about disttactor D. Resolution: Question was revised to address concerns stated above. Cooling capacity was specified in the distractors. IR - Agree. Question was fixed.

36 F 3.0 x Y B S Seems like a very easy question. IR - the stem has correct 37 F 2.0 x Y N S focus. Agree with difficulty level.

38 F 2.5 Y B S IR - Agree Seems like a very easy question. IR - agree the question 39 F 2.0 x Y B S seem easy. However, LOD = 2.0. Stem focus was correct for the question. The question was satisfactory.

Pretty good question. Resolution: Question was revised to 40 H 3.0 x Y N S change the question stem to remove unnecessary info. IR -

Agree 41 H 3.0 Y B S IR - Agree

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO Link ward (F/H) (1-5) Focus Dist. units K/A Only B/M/N U/E/S Explanation Distractor D says 0VG02CA tripped on high cnmt pressure, this is incorrect according to key but if 1VG01YA closes does fan trip on DP or another interlock??? If it does then 0VG02CA tripped as a result of high cnmt pressure.

42 F 3.0 x Y B U Resolution: Question was not revised to address concerns stated above. The Station provided reasonalbe assurance that distractor D is not a correct answer. IR - Agree -

question is satisfactory. The stem focus is correct.

Need to change distractors C and D. C should read "positive pressure to ensure the overall Auxiliary Building HVAC system flow is balanced." D should read "positive pressure to ensure hydrogen gas is removed from the battery room and 43 F 2.0 Y B E the room stays below the flammability limit." Resolution:

Question was revised to address concerns stated above.

Distractors were revised to make them more selectable. IR -

Question is satisfactory.

IR - The administered question had several changes 44 H 3.0 Y B S made to the stem of the question. Changes were acceptable.

Where is MCPR documented??? IR - distractor a. is 45 H 3.0 Y N S implausible, the remainder of the question is acceptable.

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO Link ward (F/H) (1-5) Focus Dist. units K/A Only B/M/N U/E/S Explanation Why is distractor A wrong??? If you add water to the pool with water that is < 104F, you are maximizing cooling. D is not plausible, need to change distractor. Perhaps go with a feed and bleed distractor. Resolution: Question stem was 46 F 2.0 x Y N U/E revised to address concerns stated above. The stem was changed to add a pool level which would preclude the addition of cooler water. IR - the correct answer is the only answer adding heat to the suppression pool.

However, the question was acceptable.

Seems like a very easy question. Need to switch A(2) and D(2) to make distractors more plausible. Resolution:

Question was revised to address concerns stated above. IR -

47 F 1.5 x Y N E Question as submitted and revised is LOD = 1. Why would I choose pressure when temperature is the only value being challenged? Question was unsatisfactory.

How is the amount of radiation released and break flow reduced following scram??? Are distractors B & C plausible??? The wording of this question is very, very, poor.

48 F 2.0 Y N U/E Consider replacing question. Resolution: Question was revised to address concerns stated above. The question stem was revised to enhance readability and add clarity. IR -

Fixed question is acceptable.

Will these feedwater valves fail closed eventually???

Distractor D is not plausible. Change it to "Open to prevent Thermal transients on the feedwater nozzles." Resolution:

49 F 2.0 Y B E/S Question was not revised to address concerns stated above.

Station was able to provide justification as to why question was satisfactory. IR - Agree.

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO Link ward (F/H) (1-5) Focus Dist. units K/A Only B/M/N U/E/S Explanation Seems like a very easy question. IR - Question should 50 F 2.0 Y B S have been LOD = 1 and replaced.

Is this a direct look-up??? Are you allowed to operate the D/G with negative KVARs when paralleled with the grid???

Distractor B is very close to needing an adjustment to increase KVARs, need to get this indication away from the 51 H 2.0 Y B E capability curve. Resolution: Question was revised to address concerns stated above. Provided indications were revised to make question exam-worthy. IR - Not a direct look-up as the applicant has to apply knowledge to arrive at the right answer. Question was satisfactory.

A is not plausible because a deflagration shouldn't occur if mixers and igniters work. C is not plausible if these mixing compressors are just fans that circulate air within the drywell

& cnmt. Resolution: Question was revised to address concerns stated above. Distractor A was changed and the station was able to provide assurance that distractor C is 52 F 2.0 x x Y B U/E plausible because the applicants may confuse the mixing compressors with recombiners. IR - The stem elicits the correct answer. However, the correct answer may not be correct. The mixing compressors don't remove hydrogen, but disperse it throughout the containment.

with other containment gasses Question was acceptable.

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO Link ward (F/H) (1-5) Focus Dist. units K/A Only B/M/N U/E/S Explanation I don't have enough knowledge or material to know what is the correct answer for this question. Is bus 1B1 energized by the D/G or is it completely de-energized??? Not sure why picture of system is given, does it tell you where the leak is, 53 H 2.0 N B U/E or that the system is in an unusual alignment??? Resolution:

The Station was able to provide reasonable assurance that this question is acceptable as long as we changed the stem to state an overcurrent condition exists on bus 1B1. IR -

Agree. The Question matches the K/A.

Why would anybody pick anything other than 4 when alternate power is lost??? Resolution: The station was able to provide reasonable assurance that this question is 54 F 1.0 Y B U/E acceptable based on common misconceptions. IR - the question should have been replaced. It is an LOD = 1 question. Question was unsatisfactory.

Seems like a very easy question. LOD = 1. You don't even have to know what the setpoint is. You just need to know what systems actuate on hi MSL tunnel temp. Resolution:

Question was revised to address concerns stated above.

The stem was altered to get closer to the setpoint and 55 F 1.0 Y B U/E distractor A was replaced. IR - The question should have been re-worked. If an applicant knows something isolates, a. is wrong. Main steam is in the other 3 distractors, so it is not considered. b. is a subset of d.,

so d. does not need to be considered - two implausible distractors. Question was unsatisfactory.

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO Link ward (F/H) (1-5) Focus Dist. units K/A Only B/M/N U/E/S Explanation Distractor A is not plausible and needs to be changed.

Distractor C needs ONLY deleted. Distractor D needs to have RHR C deleted. Resolution: Question was revised to address concerns stated above.

56 H 2 Y N U/E Distractors C & D were revised and the Station was able to provide reasonable assurance that distractor A is plausible IR - distractor a. was still not plausible. one division failing should not inop all the remaining equipment. The question is borderline, but acceptable.

Change distractor B to "...source OR verify frequency greater than 57 Hertz ONLY." Resolution: Question was revised to 57 F 2.0 x Y N E address concerns stated above. IR - Agree. Job link to RO is correct.

No information is provided so I can't verify which answer is correct and why. Resolution: Information was provided to 58 F 2.0 x Y N U/S ensure only one correct answer is provided. IR - distractors were acceptable. Question was satisfactory.

Why don 't we need to give info in the stem regarding suppression pool temperature??? If it is 200F and RHR is taking a suction from the suppression pool is 'A' a concern

??? I don 't like the way this question is asked, that is to find the exception. Asking this question in that style makes the question much easier than asking the applicant to determine 59 H 2.0 x Y N E/S what they should consider when suppression pool level reaches 11ft. Resolution: Question was NOT revised to address concerns stated above. Station provided reasonable assurance that RHR pump damage will not occur from conditions stated in the stem. IR - the questions stem focus is correct.

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO Link ward (F/H) (1-5) Focus Dist. units K/A Only B/M/N U/E/S Explanation Somebody needs to explain to me why distractors A and C are plausible. Resolution: Question was revised to address concerns stated above. Distractors A and C were edited to make them more likely to be selected. IR - the question as 60 F 2.0 x Y N U/E written has improbable distractors. The condenser vacuum trip (distractor b.) is totally separate of what's causing the vacuum, and, what high radiation trip (distractor c.) Question was unsatisfactory.

Seems like a very easy question. May want to change distractor D to 20 inches. Needed to change the question stem so that only one correct answer was provided. No correct answer existed in original question without an initial reactor power level. IR - Only distractor d. was changed.

The difficulty level is 2.0 and the distractors are 61 F 1.5 x x N N E/U plausible. The question matches the K/A. The stated correct answer (b.) appears to be incorrect and should be (c.) However, distractor (c.) may also be incorrect. A clarification of the correct answer and a re-grade may be necessary. Otherwise, the question is satisfactory.

Why not ask for the setpoint also??? Give instrument readings of power and make applicants realize if they are 62 H 2.5 Y B S above or below setpoint. IR - No changes were made.

Question was acceptable as written.

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO Link ward (F/H) (1-5) Focus Dist. units K/A Only B/M/N U/E/S Explanation LOD = 1 If you' re going to ask a power supply question it needs to be integrated into the question. System integration i.e. power is lost to a bus and the Rx scrams, how does the plant respond? Resolution: Question was revised to address 63 F 1.0 Y N U/E concerns stated above. The stem was altered to make the question higher order, instead of a 'What's the power supply to IC CCW pump" question. IR - Question was satisfactory.

Need to capitalize only in distractor B. Resolution: Question 64 H 3.0 Y B E was revised to address concerns stated above. IR - agree.

Why is distractor D.2 plausible??? Replace with improved mixing. Resolution: Question was revised to address concerns stated above. IR - the question is not a higher 65 H 2.0 Y N E order question, its two memory items. Acceptable as written.

Why are distractor A and D plausible??? You tell them it's an instrumentation problem and then distractor D says RR FCV damage my occur, I don't think so and I don't think anybody would pick this distractor. Resolution: Question was NOT 66 H 2.0 revised to address concerns stated above. Station was able to provide reasonable assurance that distractors A and D were in fact plausible. IR - Agree. Question was satisfactory.

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO Link ward (F/H) (1-5) Focus Dist. units K/A Only B/M/N U/E/S Explanation What transient occurred. Pick one that doesn' t affect the question. What is normal RPV level at stem conditions? If its normally 30 inches and stem indicates 45 inches is that a concern??? Would any of the distractors be correct if I expect RPY level to be 30 inches and its indicating 45 inches???

What I 'm asking is, is there more than one correct answer 67 H 2.0 x Y B U based on th e info given in the stem??? Is there enough info in the stem to answer??? Seems like you're testing very basic knowledge on how level indication system works at reduced power. Resolution: Question was revised to address concerns stated above. Question was rewritten to address concerns. IR - Agree.

Need to explain why distractors B, C, and D are plausible.

Need to change B to Ensure 99% of total fission products released from dropped fuel assembly's rods is retained by the cavity water. C needs to be changed to ensures a sufficient water level to ensure dose rates to personnel are maintained below acceptable limits following a fuel handling accident. D 68 H 2.0 x Y B U need to be changed to Minimum level needed to provide an adequate heat sink in the event of a loss be RHR Shutdown Cooling. Resolution: Question was revised to address concerns stated above. Distractors b. and C were revised to address the stated concerns. IR - Agreed.

Why are distractors Band 0 plausible??? Resolution:

Question was NOT revised to address concerns stated above. Station was able to explain why distractors Band D 69 H 2.0 x Y N U/E were plausible. IR - Stem focus was correct. Question was acceptable.

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO Link ward (F/H) (1-5) Focus Dist. units K/A Only B/M/N U/E/S Explanation Why arc distractors C and D plausible??? Is it possible for radiation levels to increase as a result of water entering the vessel pool. Can this become an airborne contamination event??? Resolution: Question was NOT revised to address concerns stated above. Station was able to provide 70 H 3.0 x x N N U/E reasonable assurance that distractors C and D are plausible.

The Station also indicated that rad level will not increase due to the leakage based on previous plant experience. IR - The stem focus is correct; the distractors are credible. The question was satisfactory.

Seems like a very easy question. Why not ask what A SLC pump tripped on??? Low suction pressure, Over current, Manually turned off. IR - Stem focus is correct. No 71 H 1.5 x Y N S changes were needed for the question. LOD = 2.0 Question was satisfactory.

Seems like a very easy question. This is a straight forward power supply question. If you ' re going to ask a power supply question it needs to be integrated into the question. System integration i.e. power is lost to a bus and the Rx scrams, how does the plant respond? Resolution : Question was NOT 72 F 1.0 Y N U/S revised to address concerns stated above. Station was able to clarify that this \-vas not a simple power supply question because you need to determine the impact on plant operation. IR - Agree with station feedback. Question LOD = 2.0. Question was satisfactory.

Seems like a very easy question. Close to question 72 above but better. It could still be a little more integrated. IR - the 73 F 1.5 Y N S question was satisfactory as written. LOD = 2.0.

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO Link ward (F/H) (1-5) Focus Dist. units K/A Only B/M/N U/E/S Explanation Why is distractor D plausible??? A should be changed to search area after receiving a locked high rad briefing. D should also be changed to after receiving a locked high rad briefing. Resolution: Question was NOT revised to address concerns stated above. The question \-vas replaced because the station didn't want to make recommended changes. The 74 H 2.0 x Y N E new question was changed to replace "Incident Commander" with "Work Control Supervisor". IR - The proposed question and the administered question have the change to Work Control Supervisor. The original proposed question appears to be missing. The administered question was satisfactory.

Are you really suppose to close F006A before you open F004A??? and then start the A RHR Pp. How did the A RHR Pp trip??? It doesn't seem like there is a correct answer provided for this question. It also seems like a very easy 75 H 1.5 Y B U/S question. Resolution: Question was NOT revised to address concerns stated above. This is the guidance provided by the procedure. IR - Question is LOD = 2.0, and satisfactory.

ES-401 BWR Examination Outline Form ES-401-1 Emergency and Abnormal Plant Evolutions - Tier 1/Group 1 Facility: Clinton (6 RO Applicants - 0 SRO Applicants) Date of Exam: 11/01/2010 RO K/A Category Points SRO-Only Points K K K K K K A A A A G Tier Group

  • A2 G* Total 1 2 3 4 5 6 1 2 3 4 Total
1. 1 2 3 3 2 3 4 17 0 0 0 Emergency & 2 1 0 0 N/A 1 1 2 5 0 0 0 Abnormal Plant N/A Evolutions Tier Totals 3 3 3 3 4 6 22 0 0 0
2. 1 3 2 2 1 2 2 3 2 2 2 1 22 0 0 0 Plant 2 1 0 1 1 1 1 1 1 1 1 1 10 0 0 0 0 Systems Tier Totals 4 1 3 3 4 3 4 3 3 3 2 32 0 0 0
3. Generic Knowledge and Abilities 1 2 3 4 1 2 3 4 Categories 2 2 1 1 6 0 0 0 0 Note: 1. Ensure that at least two topics from every applicable K/A category are sampled within each tier of the RO and SRO-only outlines (i.e., except for one category in Tier 3 of the SRO-only outline, the Tier Totals in each K/A category shall not be less than two).
2. The point total for each group and tier in the proposed outline must match that specified in the table. The final point total for each group and tier may deviate by +/-1 from that specified in the table based on NRC revisions. The final RO exam must total 75 points and the SRO-only exam must total 25 points.
3. Systems/evolutions within each group are identified on the associated outline; systems or evolutions that do not apply at the facility should be deleted and justified; operationally important, site-specific systems that are not included on the outline should be added. Refer to Section D.1.b of ES-401 for guidance regarding the elimination of inappropriate K/A statements.
4. Select topics from as many systems and evolutions as possible; sample every system or evolution in the group before selecting a second topic for any system or evolution.
5. Absent a plant-specific priority, only those K/As having an importance rating (IR) of 2.5 or higher shall be selected. Use the RO and SRO ratings for the RO and SRO-only portions, respectively.
6. Select SRO topics for Tiers 1 and 2 from the shaded systems and K/A categories.

7.* The generic (G) K/As in Tiers 1 and 2 shall be selected from Section 2 of the K/A Catalog, but the topics must be relevant to the applicable evolution or system. Refer to Section D.1.b of ES-401 for the appropriate K/As.

8. On the following pages, enter the K/A numbers, a brief description of each topic, the topics importance ratings (IRs) for the applicable license level, and the point totals (#) for each system and category. Enter the group and tier totals for each category in the table above; if fuel handling equipment is sampled in other than Category A2 or G* on the SRO-only exam, enter it on the left side of Column A2 for Tier 2, Group 2 (Note #1 does not apply). Use duplicate pages for RO and SRO-only exams.
9. For Tier 3, select topics from Section 2 of the K/A catalog, and enter the K/A numbers, descriptions, IRs, and point totals

(#) on Form ES-401-3. Limit SRO selections to K/As that are linked to 10 CFR 55.43.

ES-401 BWR Examination Outline Form ES-401-1 Emergency and Abnormal Plant Evolutions - Tier 1/Group 1 RO E/APE # / Name / Safety Function K K K A A G K/A Topic(s) IR #

1 2 3 1 2 295001 Partial or Complete Loss of Forced x AA1.04 Ability to operate and/or monitor the following as 2.6 9 Core Flow Circulation / 1 & 4 they apply to PARTIAL OR COMPLETE LOSS OF FORCED CORE FLOW CIRCULATION: Rod control and information system: BQWR-5&6 295003 Partial or Complete Loss of AC / 6 x AK3.06 Knowledge of the reasons for the following 3.7 49 responses as they apply to PARTIAL OR COMPLETE LOSS OF A.C. POWER: Containment isolation 295004 Partial or Total Loss of DC Pwr / 6 AK1.03 Deleted 2.9 56 295005 Main Turbine Generator Trip / 3 x AK3.01 Knowledge of the reasons for the following 3.8 45 responses as they apply to MAIN TURBINE GENERATOR TRIP: Reactor Scram:

295006 SCRAM / 1 x AK3.01 Knowledge of the reasons for the following 3.8 8 responses as they apply to SCRAM: Reactor water level response 295016 Control Room Abandonment / 7 x 2.4.11 Emergency Procedures / Plan: Knowledge of 4.0 6 abnormal condition procedures 295018 Partial or Total Loss of CCW / 8 x AA2.01 Ability to determine and/or interpret the following 3.3 4 as they apply to PARTIAL OR COMPLETE LOSS OF COMPONENT COOLING WATER:Component temperatures 295019 Partial or Total Loss of Inst. Air / 8 AA1.04 Deleted 30 295021 Loss of Shutdown Cooling / 4 x 2.2.25 Equipment Control: Knowledge of bases in 3.2 5 technical specifications for limiting conditions for operations and safety limits 295023 Refueling Acc Cooling Mode / 8 x AK2.02 Knowledge of the interrelations between 2.9 68 REFUELING ACCIDENTS and the following: Fuel pool cooling and cleanup system 295024 High Drywell Pressure / 5 x EK1.02 Knowledge of the operational implications of the 3.9 2 following concepts as they apply to HIGH DRYWELL PRESSURE: Containment building integrity: Mark-III 295025 High Reactor Pressure / 3 x 2.2.42 - Equipment Control: Ability to recognize system 3.9 37 parameters that are entry-level conditions for Technical Specifications 295026 Suppression Pool High Water Temp. x EK2.01 - Knowledge of the interrelations between 3.9 46

/5 SUPPRESSION POOL HIGH WATER TEMPERATURE and the following: Suppression pool cooling 295027 High Containment Temperature / 5 x EK2.04 Knowledge of the interrelations between HIGH 2.6 64 CONTAINMENT TEMPERATURE (MARK III CONTAINMENT ONLY) and the following:

SPDS/ERIS/CRIDS/GDS: Mark-III 295028 High Drywell Temperature / 5 EK2.04 Deleted 47 295030 Low Suppression Pool Wtr Lvl / 5 x EK1.01 Knowledge of the operational implications of the 3.8 1 following concepts as they apply to LOW SUPPRESSION POOL WATER LEVEL: Steam condensation

ES-401 BWR Examination Outline Form ES-401-1 Emergency and Abnormal Plant Evolutions - Tier 1/Group 1 RO 295031 Reactor Low Water Level / 2 x 2.2.39 - Equipment Control: Knowledge of less than one 3.9 34 hour3.935185e-4 days <br />0.00944 hours <br />5.621693e-5 weeks <br />1.2937e-5 months <br /> technical specification action statements for systemssurization system 295037 SCRAM Condition Present x EA2.04 Ability to determine and/or interpret the following 4.0 36 and Power Above APRM Downscale as they apply to SCRAM CONDITION PRESENT AND or Unknown / 1 REACTOR POWER ABOVE APRM DOWNSCALE OR UNKNOWN: Suppression pool temperature 295038 High Off-site Release Rate / 9 x EA2.03 Ability to determine and/or interpret the following 3.5 3 as they apply to HIGH OFF-SITE RELEASE RATE:

Radiation levels 600000 Plant Fire On Site / 8 Not Selected 700000 Generator Voltage and Electric Grid x AA1.02 Ability to operate and/or monitor the following as 3.8 29 Disturbances / 6 they apply to GENERATOR VOLTAGE AND ELECTRIC GRID DISTURBANCES: Turbine/generator controls K/A Category Totals: 2 3 3 2 3 4 Group Point Total: 17

ES-401 BWR Examination Outline Form ES-401-1 Emergency and Abnormal Plant Evolutions - Tier 1/Group 2 RO E/APE # / Name / Safety Function K K K A A G K/A Topic(s) IR #

1 2 3 1 2 295002 Loss of Main Condenser Vac / 3 295007 High Reactor Pressure / 3 295008 High Reactor Water Level / 2 x AA2.01 - Ability to determine and/or interpret the following 3.9 67 as they apply to HIGH REACTOR WATER LEVEL:

Reactor water level 295009 Low Reactor Water Level / 2 295010 High Drywell Pressure / 5 295011 High Containment Temp / 5 295012 High Drywell Temperature / 5 295013 High Suppression Pool Temp. / 5 295014 Inadvertent Reactivity Addition / 1 295015 Incomplete SCRAM / 1 295017 High Off-site Release Rate / 9 295020 Inadvertent Cont. Isolation / 5 & 7 x 2.4.11 - Emergency Procedures / Plan: Knowledge of 4.0 70 abnormal condition procedures 295022 Loss of CRD Pumps / 1 x AA1.01 - Ability to operate and/or monitor the following as 3.1 7 they apply to LOSS OF CRD PUMPS: CRD hydraulic system 295029 High Suppression Pool Wtr Lvl / 5 EK3.01 Deleted 50 295032 High Secondary Containment Area EK2.06 Deleted 55 Temperature / 5 295033 High Secondary Containment Area Radiation Levels / 9 295034 Secondary Containment Ventilation High Radiation / 9 295035 Secondary Containment High Differential Pressure / 5 295036 Secondary Containment High x EK1.01 Knowledge of the operational implications of the 2.9 48 Sump/Area Water Level / 5 following concepts as they apply to SECONDARY CONTAINMENT HIGH SUMP/AREA WATER LEVEL:

Radiation releases 500000 High CTMT Hydrogen Conc. / 5 x 2.4.6 Emergency Procedures / Plan: Knowledge of EOP 3.7 52 mitigation strategies K/A Category Point Totals: 1 0 0 1 1 2 Group Point Total: 5

ES-401 BWR Examination Outline Form ES-401-1 Plant Systems - Tier 2/Group 1 RO System # / Name K K K K K K A A A A G K/A Topic(s) IR #

1 2 3 4 5 6 1 2 3 4 203000 RHR/LPCI: Injection x A2.16 Ability to(a) predict the impacts of the 4.4 75 Mode following on the RHR/LPCI: INJECTION MODE (PLANT SPECIFIC) and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal conditions or operations: Loss of coolant accident 205000 Shutdown Cooling x A1.01 Ability to predict and/or monitor changes in 3.3 14 parameters associated with operating the SHUTDOWN COOLING SYSTEM (RHR SHUTDOWN COOLING MODE) controls including: Heat exchanger cooling flow 206000 HPCI N/A to Clinton 207000 Isolation (Emergency)

N/A to Clinton Condenser 209001 LPCS x A4.03 Ability to manually operate and/or monitor 3.7 19 in the control room: Injection valves 209002 HPCS x K1.05 Knowledge of the physical connections 2.8 65 and/or cause-effect relationships between HIGH PRESSURE CORE SPRAY SYSTEM (HPCS) and the following: Standby liquid control system:

Plant Specific x K5.06 Deleted 22 211000 SLC A1.10 Ability to predict and/or monitor changes in parameters associated with operating the 3.7 71 STANDBY LIQUID CONTROL SYSTEM controls including: Lights and alarms 212000 RPS x K1.13 - Knowledge of the physical connections 3.5 10 and/or cause-effect relationships between REACTOR PROTECTION SYSTEM and the following: Containment pressure x 2.2.36 - Equipment Control: Ability to analyze 3.1 57 the effect of maintenance activities, such as degraded power sources, on the status of limiting conditions for operations.

215003 IRM x A3.01 - Ability to monitor automatic operations of 3.3 69 the INTERMEDIATE RANGE MONITOR (IRM)

SYSTEM including: Meters and recorders 215004 Source Range Monitor x K3.03 Knowledge of the effect that a loss or 3.3 11 malfunction of the SOURCE RANGE MONITOR (SRM) SYSTEM will have on following: Rod control and information system: Plant Specific 215005 APRM / LPRM x K2.02 Knowledge of electrical power supplies to 2.6 72 the following: APRM channels 217000 RCIC x A2.02 Ability to (a) predict the impacts of the 3.8 15 following on the REACTOR CORE ISOLATION COOLING SYSTEM (RCIC); and (b) based on those predictions, use procedures to correct,

ES-401 BWR Examination Outline Form ES-401-1 Plant Systems - Tier 2/Group 1 RO control, or mitigate the consequences of those abnormal conditions or operations: Turbine trips 218000 ADS x K1.06 - Knowledge of the physical connections 3.9 38 and/or cause-effect relationships between AUTOMATIC DEPRESSURIZATION SYSTEM and the following: Safety/relief valves 12 K4.01 Deleted 223002 PCIS/Nuclear Steam 2.4.49 Deleted 20 Supply Shutoff 239002 SRVs x K6.03 Knowledge of the effect that a loss or 2.7 16 malfunction of the following will have on the RELIEF/SAFETY VALVES: A.C. power: Plant Specific 259002 Reactor Water Level x A3.10 Ability to monitor automatic operations of 3.1 17 Control the REACTOR WATER LEVEL CONTROL SYSTEM including: TDRFP lockup: TDRFP 261000 SGTS x K6.09 Knowledge of the effect that a loss or 3.1 42 malfunction of the following will have on the STANDBY GAS TREATMENT SYSTEM: Primary containment high pressure: Plant-Specific 21 2.1.31 Deleted 262001 AC Electrical Distribution x K4.01 - Knowledge of A.C. ELECTRICAL 3.0 31 DISTRIBUTION design feature(s) and/or interlocks which provide for the following: Bus lockouts 262002 UPS (AC/DC) x K3.17 - Knowledge of the effect that a loss or 2.9 40 malfunction of the UNINTERRUPTABLE POWER SUPPLY (A.C./D.C.) will have on following: Process monitoring: Plant-Specific 263000 DC Electrical Distribution x x K5.01 Knowledge of the operational implications 2.6 43 of the following concepts as they apply to D.C.

ELECTRICAL DISTRIBUTION: Hydrogen generation during battery charging A1.01 Ability to predict and/or monitor changes in 2.5 28 parameters associated with operating the D.C.

ELECTRICAL DISTRIBUTION controls including:

Battery charging/discharging rate 264000 EDGs x K5.06 Knowledge of the operational implications 3.4 13 of the following concepts as they apply to EMERGENCY GENERATORS (DIESEL/JET):

Load sequencing 300000 Instrument Air x A4.01 Ability to manually operate and/or monitor 2.6 18 in the control room: Pressure gauges 400000 Component Cooling Water x K2.01 - Knowledge of electrical power supplies 2.9 63 to the following: CCW pumps K/A Category Point Totals: 3 2 2 1 2 2 3 2 2 2 1 Group Point Total: 22

ES-401 BWR Examination Outline Form ES-401-1 Plant Systems - Tier 2/Group 2 RO System # / Name K K K K K K A A A A G K/A Topic(s) IR #

1 2 3 4 5 6 1 2 3 4 201001 CRD Hydraulic K2.01 Deleted 54 201002 RMCS Not Applicable to Clinton 201003 Control Rod and Drive Mechanism 201004 RSCS Not Applicable to Clinton 201005 RCIS x A1.01 Ability to predict and/or monitor changes 3.2 62 in parameters associated with operating the ROD CONTROL AND INFORMATION SYSTEM (RCIS) controls including: First stage shell pressure/turbine load: BWR-6 201006 RWM Not Applicable to Clinton 202001 Recirculation x K1.23 - Knowledge of the physical connections 3.4 66 and/or cause-effect relationships between RECIRCULATION SYSTEM and the following:

Average power range monitor flow converters:

Plant Specific 202002 Recirculation Flow Control 204000 RWCU x A2.06 - Ability to (a) predict the impacts of the 2.5 53 following on the REACTOR WATER CLEANUP SYSTEM; and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal conditions or operations: A.C. failure 214000 RPIS 2.4.1 Deleted 4.6 24 215001 Traversing In-core Probe 215002 RBM Not Applicable to Clinton 216000 Nuclear Boiler Inst.

219000 RHR/LPCI: Torus/Pool Cooling Mode 223001 Primary CTMT and Aux. x 2.4.20 - Emergency Procedures / Plan: 3.8 59 Knowledge of operational implications of EOP warnings, cautions, and notes.

226001 RHR/LPCI: CTMT Spray Mode 230000 RHR/LPCI: Torus/Pool Not Applicable to Clinton Spray Mode 233000 Fuel Pool Cooling/Cleanup A4.04 Deleted 234000 Fuel Handling Equipment 239001 Main and Reheat Steam 239003 MSIV Leakage Control 241000 Reactor/Turbine Pressure

ES-401 BWR Examination Outline Form ES-401-1 Plant Systems - Tier 2/Group 2 RO Regulator 245000 Main Turbine Gen. / Aux.

256000 Reactor Condensate 259001 Reactor Feedwater x A4.08 - Reactor Feedwater System: Ability to 3.3 61 manually operate and/or monitor in the control room: FWRV position 268000 Radwaste 271000 Offgas 272000 Radiation Monitoring x A3.09 - Ability to monitor automatic operations 3.6 23 of the RADIATION MONITORING SYSTEM including: Containment isolation indications 286000 Fire Protection x K6.05 - Knowledge of the effect that a loss or 2.6 73 malfunction of the following will have on the FIRE PROTECTION SYSTEM: Screen wash system: Plant-Specific 288000 Plant Ventilation 290001 Secondary CTMT x K4.01 - Knowledge of SECONDARY 3.5 58 CONTAINMENT design feature(s) and/or interlocks which provide for the following:

personnel access without breaching secondary containment: plant-specific 290002 Reactor Vessel Internals x K3.07 - Knowledge of the effect that a loss or 3.1 41 malfunction of the REACTOR VESSEL INTERNALS will have on the following: Nuclear boiler instrumentation 290003 Control Room HVAC x K5.03 Knowledge of the operational 2.6 35 implications of the following concepts as they apply to the CONTROL ROOM HVAC:

Temperature control K/A Category Point Totals: 1 0 1 1 1 1 1 1 1 1 1 Group Point Total: 10

ES-401 Generic Knowledge and Abilities Outline (Tier 3) Form ES-401-3 Facility: Clinton Power Station Date of Exam: December 2010 Category RO SRO-Only K/A # Topic IR # IR #

2.1.25 Ability to interpret reference materials, such as graphs, curves, tables, etc. 3.9 33 Conduct of Operations 2.1.36 Knowledge of procedures and limitations involved in core alterations. 3.0 25 Subtotal 2 2.2.12 Deleted 3.7 26 2.2.22 Knowledge of limiting conditions for operations and safety limits. 4.0 44

2. Equipment 2.2.44 Ability to interpret control room indications to verify the status and operation of Control a system, and understand how operator actions and directives effect plant 4.2 51 and system conditions.

Subtotal 2 2.3.4 Deleted 3.2 32 2.3.11 Deleted 3.8 60

3. Radiation 2.3.12 Knowledge of Radiological Safety Principles pertaining to licensed operator Control 3.2 74 duties, such as containment entry requirements, fuel handling responsibilities, access to locked high-radiation areas, aligning filters, etc.

Subtotal 1 2.4.14 Knowledge of general guidelines for EOP usage. 3.8 39

4. Emergency Procedures / Plan 2.4.9 Deleted 3.8 27 Subtotal 1 Tier 3 Point Total 6
Retrieved from "https://kanterella.com/w/index.php?title=ML12095A361&oldid=2102723"