ML13210A057

Initial Exam 2013-301 Final Administrative Documents

ML13210A057
Person / Time
Site:	Watts Bar
Issue date:	07/26/2013
From:	NRC/RGN-II
To:	Tennessee Valley Authority
References
50-390/10-301, ES-401, ES-401-9
Download: ML13210A057 (49)

Text

ES-401 Written Examination Review Worksheet Form ES-401-9 Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

• The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

• The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

• The answer choices are a collection of unrelated true/false statements.

• The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

• One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

• The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

• The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

• The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

• The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).

ES-401 2 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 1 H 2 X M U 007 EK1.06 S Stem Focus: AFW manipulations would not be required until after STM Dumps, PORVs and BD Isolation valves are closed. To address this, consider the following.

Initial conditions:

Unit 1 is operating at 100% power when a reactor trip occurs RCS Temperature is being monitored IAW ES-0.1 Tave is 556 oF and dropping Current conditions:

Steam dumps, SG PORVs and blowdown isolation valves have been ensured closed All SG levels are 26% and stable Total AFW flow is 400 gpm Tave is 555 oF and dropping Change the 1st part of the question to: Based on the current conditions, AFW flow ________

Needs to be increased (Correct by procedure)

Needs to be dropped (plausible because your cooling down)

Cred Dist. B&D 2nd part are not plausible. It is not discriminating to test if decay heat level decreases with time.

Changed question as recommended.

SAT 2/7 KDS

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 2 H 3 X N E 008 AK3.03 S In the correct answer, resulting in the insulation becoming flammable seems confusing and not necessary. Remove.

Cred Dist: The first part of C&D is not plausible enough when compared to the 1st part of A&B. Recommend asking for the first part. The Ice Condenser Air handling Unit Breakers _____ (are/are not) opened to prevent hydrogen combustion in teh air duct system.

Changed question as recommended.

SAT 2/6 KDS 3 F 2 X N S 011 EG2.4.47 015 AK2.08 4 F 2 N S 5 H 2 X N U 026 AA1.06 Cred Dist: Second part of A&C having flow automatically restored to the IX is not plausible. Recommend for the second part: Based on a maximum temperature out of the letdown heat exchanger (actual TI) the CVCS mixed bed demineralizers _________ should/should not have automatically bypassed.

6 H 3 X B E 027 AK2.03 Cred Dist: Using the logic that both heaters and spray are controlled by the master controller in this instance (incorrectly), A & D are plausible in that they are what you would expect for a high or low pressure condition. In B however, they go in the opposite direction i.e. if pressure appeared to be low, the spray valves would go closed but the heaters would remain energized. B is not plausible due to the interrelation between heaters & spray.

029 G2.4.20 7 F 2 X N E Stem Focus: Change should/should not to required/not required 8 H 2 X N E 040AA1.23 On the second part of the question, I would dump the ALL and ONLY, then change the numbers to 1 or 2. Add Designated Post Accident Monitors.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 9 H 2 X N E 054 AA2.08 Stem Focus: Need to make sure the question is asking about the flow error before the trip.

Cred Dist: The 1st part of C&D seem obvious. If I didnt know the answer, it seems like the easy choice. Due to cueing concerns, recommend deleting the alarm unless it is required for accuracy of the question?

10 2 X M S 055EA2.06 11 H 3 M S 056 AK1.04 12 H 2 X N S 058 AK3.02 13 H 3 B S 062 AA2.01 Walk through the drawing with the various leak locations.

14 H 2 X X N E 065 AK3.08 S Partial: Were concerned that D could be argued as correct. Need to discuss.

Stem Focus: The question states a large air line rupture. In section 3.3 step 7 it states: check control air pressure greater than 83 psig. If not, the RNO has you go to section 3.2. Based on the enclosed procedure, you assume that the operator stays in section 3.3.

Licensee to walk through this procedure step by step to ensure ONLY one correct answer. May need to give an air pressure greater than 83 psig.

Changed question as recommended.

SAT2/7 KDS 15 H 2 X N E 077 AG2.1.7 S Cred Dist: The second part of A&C. The voltage of both components are obviously high as opposed to low so moving in the positive direction is not plausible. Change voltage in the question stem to 510 Kv.

Changed voltage to 509 Kv, modified question.

SAT 2/6.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 16 H 2 X N E W/E04 EA1.3 S Stem Focus: Per the procedure, 1-FCV-63-94 (The cold leg injection valve) should be opened prior to opening the cross tie valves.

Leaving this out of the question could affect the operational validity of the question. Recommend testing the following: If RCS pressure is stable after 1-FCV-63-94 is closed, ECA-1.2 requires 1-FCV-63-94 to be _____ (open/closed). Changed as recommended.

Ok 2/6 W/E05 EK2.1 17 H 2 X B U Cred Dist: The only thing in the stem of the question that could have S caused a FWI was the SI. Unless its possible to reset FWI without resetting SI, A&C are not plausible. Re-wrote question.

Ok 2/21 18 H 3 X M S W/E11 EK1.3 19 F 2 X N E 001 AA2.02 S Step Focus: The first bullet states that control rods moved out a step. The 4th bullet stated that the control rods continue to withdraw after being placed in MANUAL. When did the control rods start to withdrawal? The stem to be more clear. The rest of the question is ok. Modified 4th bullet to be more straight forward.

Ok 2/21 20 H 2 B S 036 AK2.01 21 H 2 M S 037 AK1.01 22 H 2 N S/E 051 AA1.04 S The analysis for A states that this could be correct if the increase in backpressure is large enough (i.e. a magnitude higher than the conditions in the question). Lets discuss this to ensure that A cannot be correct also. Good as is.

Ok 2/6

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 23 H 2 X M U/E 059 AK3.02 S Cred Dist: The 1st question when coupled with C&D do not make a lot of sense. It the monitor works properly, nothing happens? Not plausible. Could you remove the RIA from the stem and ask which RIA should have isolated the release? If it wouldnt be too obvious.

KA: Knowledge of the KA does not appear to be tested. It may be difficult to write an RO question for this KA. May need to replace the KA. Replaced KA. New question good.

Ok 2/21 24 H 2 X N E 074 EA2.07 S Cred Dist: A If the SI pump were injecting, why would it be required to go to FR-C.1? Lets discuss the plausibility. Modified stem.

Ok 2/6 25 H 2 X N U W/E03 EG2.4.46 S Cred Dist: Why would 70A SI ACTUATED be lit before you reached the setoint? C&D Not Plausible. Recommend giving a pressure and asking if the permissive is lit or not and if it stays on after SI is bypassedsomething like that. Modified question to ask if permissive light goes back out as pressure decreases.

Ok 2/6 W.E14 EA1.1 26 H 3 X M E Cred Dist: Too much emphasis is placed on the applicants confusing S the one hour with other times. Recommend putting an initial pressure something above 9.5 psi such that containment pressure is greater than 9.5 psi the whole time. Then give one option that is less than one hour. This would be incorrect IAW FR-Z.1 due to not being one hour. Changed question per recommendation.

Ok2/7 27 F 2 B E W/E15 EK3.1 S Stem Focus: Add IAW FR-Z.2, chemistryto the question. Modified stem as recommended.

Ok 2/7

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 28 H 2 X M U 003 K6.04 S Cred Dist: B losing motor cooling but not having to secure the RCP is not plausible. Is allowable.

A a phase A isolation only securing flow to only some of the RCPs not plausible. Changed question format.

Change 1st part of A&B to cooling water flow to RCP 1&3 motors Ok 2/7 29 F 3 N U 004 A2.13 S Cred Dist: 2nd part of B&D The RWST LO LO alarm blocking the CCP auto swap to the RWST is not plausible. If the ARI has you secure the CCP, recommend making the 2nd part of the question whether the CCP is allowed to operate with a RWST LO LO alarm in. Re-wrote question.

Ok 2/7 30 F 2 M E 004 K4.13 S Add IAW procedure title/number to the question. Changed as recommended.

Ok 2/7 31 F 3 N S 005 A1.02 32 H 2 X X N E/U 006 K5.01 S Stem Focus: This has to be it will or it wont . There cant be a could cause. From the information provided, it doesnt look like you can say that there will be a change in temperature. There may have to be a new question.

Cred Dist: 2nd part of B&D dont seem plausible. If you cant explain how containment pressure is plausible, you may have to replace the second part of B&D..

Recommend asking: ARIs for CLA level hi/lo alarms for CLA ____

(1/4 or 2/3) contain a note that states that accumulator level channel indication may change when containment temperature is affected by containment purge. Changed to RWST level. Question SAT.

Ok 2/28

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 33 H 3 X X M U/E 007 A2.02 S Stem Focus: The first question needs to have the same tense as the answer choices.

Cred Dist: 2nd part o B&D not plausible. This is actually ok.

Is there anything that will automatically happen as PRT pressure increases? Modified to ask valve operation.

Recommend: IAW the ARI, pressure is required to be lowered to

_____ (<8 psi/< the value of the upper level in the normal operating band).

Ok 2/7 34 F 2 X B U 007 B2.1.31 S Cred Dist: 1st part of C&D not plausible. Can it be monitored from the plant computer? How many different locations in the control room can you read PRT temp?

Recommend asking: PRT temperature verification _____ (can/can not) be determined from panel 1-M-4. Modified as recommended.

If the alarm is valid, 1-FCV-68-303 ______ (can/can not) be opened from 0-L-2. Incorporated into question.

Ok 2/7 35 F 2 M S 008 A3.05 36 H 3 M S 010 K5.02 37 H 2 M S 010 K6.01 38 H 2 N S/E 012 K3.02 S Does a reactor trip or turbine trip annunciator occur without the actual trip? If so, this is plausible. If not.its not. This is valid.

Ok 2/8

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 39 H 2 X N E 013 K4.22 S Stem Focus: add IAW TS 3.4.12 after 1st part of C&D. Done Modify 2nd part of each answer choice to remove everything after minutes. Done Ok 2/8 40 F 2 B S 022 K2.02 Changed to make all 480 v Ok 2/7 41 F 2 X N E 025 A1.03 S Cred Dist: 2nd part of B&D not plausible because your stating that a temperature will be reached in exactly two hours. Is there another component (damper, switch) that you can use. Left as is.

Ok 2/8 026 A2.08 42 F 2 M S 43 F 2 M E 026 A4.01 S A is checked as correct. The analysis has B being correct. Reading the analysis, it sounds like A could be correct. Licensee to verify correct answer and modify the analysis to support the correct answer. Answer verified.

Ok 2/8 44 F 2 M S 039 A4.04 45 F 2 N E 039 K1.01 S The criteria provided states that temperatures are to be within 5 degrees or within 12 degrees. The answer is 5 degrees. I think you could appeal and get the question thrown out. Recommend making A&B 379 oF and C&D 386 oF. Modified as recommended.

Ok 2/8

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 46 H 3 X N E 059 A3.06 S Cred Dist: A&B Choosing 1 MFWP tripping over 2 MFWPs when next to each doesnt look plausible. Recommend changing the 1st part of A&B to neither tripped. Modified as recommended.

Ok 2/8 47 F 2 N E 061 K5.05 S Edit: 3rd bullet drop one of the Thes and drop the is. Recommend dropping the steam binding of AFW Pump(s) or from C&D. We can discuss if necessary. Left answers as is.

Ok 2/8 48 H 3 B E 062 K4.03 S Cred Dist: D If the shutdown board is not affected by the 161Kv line loss, why would the DG disconnect? Maybe test how it transfers instead if it transfers. Left as is.

Ok 2/8 49 H 3 X N U/E 063 G2.2.44 S Cred Dist: RPS being a de-energize to trip system, it is not plausible to think that the B Rx Trip Bkr wont open on a trip. Are there any Reactor Trip related functions that wont work upon a loss of control power. Something similar to the 2nd part of the question only that it will not work. If not, you may need a new question.

Replaced question Ok 2/21 50 L 2 B S 063 K2.01 51 H 3 X E 064 K3.02 S Is this new?

Stem Focus: The stem needs to clearly distinguish the time when your asking about the pump start and or trip. Recommend asking:

At t=20sec, AFW 1A-A is/is not operating Modified as recommended.

At t=30 sec, AFW 1A-A is/is not operating Modified as recommended.

Ok 2/8

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 52 F 2 X M E 073 A4.03 S Cred Dist: C & B Assuming that the lights will go light as the meter goes full scale, it is not plausible to thing I would get the red light without getting the amber light as well. B&C both state that they May illuminate. What does that mean?

D does not appear to be worded correctly. Re-wrote question.

Ok 2/8 53 F* 2 N E 076 K3.03 S Would changing Major to Complete still work with the question.

We would prefer complete blockage as long as it does not affect the validity of the question. Modified as recommended.

Stem Focus: Change loss of to reduction of in A&B. left as is Ok 2/8 54 F 2 X N E 078 K1.05 S Cred Dist: 2nd part of B&D is not specific enough to make them plausible. Recommend: Put a specific time that is plausible or change to Enable MSIV closure in the event of a steam line break.

Modified as recommended Ok 2/8 55 F 3 M S 103 G2.2.36 56 H 3 X M S 001 K4.13 57 H 3 X M E 002 K1.12 S Cred Dist: The 2nd part of D, a manual trip required at < 1% but not at 18% is not plausible. A recommendation:

Modify D to state that an Auto Rx Trip is not required in either case and a MANUAL Rx Trip is not required in either case. Modified as recommended Ok 2/8 58 F 2 B S 015 K2.01

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 59 F 2 X M E 028 K5.03 S Partial: The question states after the initial accident over the next 12 hours1.388889e-4 days <br />0.00333 hours <br />1.984127e-5 weeks <br />4.566e-6 months <br />. The analysis states that H2 from aluminum is more of a long term source (not in the first 10 hours1.157407e-4 days <br />0.00278 hours <br />1.653439e-5 weeks <br />3.805e-6 months <br />). Could B be correct since your looking at +10 hours? Recommend changing the first question to 10 hours1.157407e-4 days <br />0.00278 hours <br />1.653439e-5 weeks <br />3.805e-6 months <br />. Modified as recommended Recommend changing C&D to zirconium. Modified as recommended Ok 2/8 60 H 3 X X N U/E 033 A3.02 S Stem Focus: 4th bullet, remove a lot of Modified as recommended Recommend changing the 2nd part of A&C to 5 mr. Modified as recommended Ok 2/8 61 F 2 X X N E 034 A1.02 S Stem Focus: Change the 2nd part of the question to give an elevation and ask if that elevation is adequate per design. It would be cleaner and easier to understand. Modified as recommended Cred Dist: What refueling activities use the top of hot legs. On the surface it doesnt seem to plausible. The analysis isnt detailed enough to change that opinion. Removed 2nd part.

Ok 2/8 62 H 3 X N E 042 A4.04 S Stem Focus: Incorporate the last bullet into the first question. As the CRO adjusts, the indication on 1-XI-I-33..will_____. Modified as recommended Add to the second question: Based only on the indications given above, conditionschanged per first comment Recommend removing the bullet containing STEAM DUMP DEMAND indicates 12%. Modified as recommended Ok 2/8

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 63 F 3 M E/S 072 G2.2.39 S How ABGTS radiation protection mode differ from operation as stated in TS 3.3.8?

Licensee to walk through the path for determining the correct answer.

I couldnt be sure with the information provided.

Cred Dist: 2nd part of B&D dont appear to be plausible because of AB ventilation not interfacing with Phase A isolation. Does isolate on phase A.

Ok 2/8 64 H 3 X M S 075 A2.03 65 H X B U/E 086 K6.04 S Cred Dist: The 2nd part of B states that the trouble would clear and the 1st part states that it would be indicated. They seem to contradict each other. Modified question 2nd part of A&C. A trouble alarm masking a fire alarm isnt plausible unless you have examples. I didnt see any statements of why it would be plausible. Modified question.

Walk through this question and explain how each are plausible.

Ok 2/8 66 F 2 X N S/E G2.1.15 S Stem Focus: It looks like the analysis for B and D need to be switched.

Is there any situation in which the Ops Manager could sign for the Superintendent? Changed ops mgr to shift mgr Are there any periodicities between 90 days and a year that you could use. 90 days seems short for a standing order. Good as is The procedure included states that the standing order should not exceed 1 year. Is the question correct to state that it is outdated after 1 year? Suggest that the question needs to precisely mimic the words in the procedure and test whether or not standing orders should be allowed for longer than 1 year.

Ok 2/8 67 F 2 M S G2.1.28

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 68 F 2 X M S G2.1.42 69 F 2 X M U G2.2.1 S Cred Dist: 2nd part of B&D is not plausible. They look as if energizing the heaters is the purpose of opening the spray valves. Re-wrote 2nd part to ask which heaters are energized What is the normal configuration of backup heaters.

Explore the idea of testing whether or not the C heater bank is energized.

Ok 2/8 70 F 2 M E/U G2.2.20 S Cred Dist: B&D not plausible to think that you would need to test the circuit if you just confirmed that the fuse was the problem.

Recommend asking if a work order ___ (is/is) not required prior to fuse replacement and as the second part, ask if verification via MAXIMO or other design output documents _____ (is/is not) required IAW OPDP-7. Modified as recommended Ok 2/8 71 F 2 M E G 2.2.22 S Recommend asking if the RCS Pressure Limit is _____ (2500 psia

/2735 psig) as the first part. This will allow deletion of the time line.

Modified as recommended Ok 2/8 72 F 2 N S G 2.3.12

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 73 H 3 X B U G 2.3.13 S Cred Dist: 2nd part of C&D. Thinking that a SR Hi Flux alarm would not warrant a containment evac is not plausible.

Recommend:

Dropping the 4th bullet (the alarm) and asking Of the CRs in the answer choices, which is the lowest that will cause 81-B, SOURCE RANGE HI FLUX AT SHUTDOWN to alarm.

A. 9 B. 12 C. 15 D. 21 Modified as recommended Ok 2/8 74 F 2 N S G 2.4.13 75 F 2 N S G 2.4.49 76 H 3 N E 007 EA2.06 S Fix Spacing on A&C. Recommend adding as a 3rd bullet under Current Conditions -The remainder of RPS circuitry operates as designed. 3rd bullet added.

Is the licensee ok with not providing the reference. Request operations management concurrence that this is memory knowledge.

If a reference is provided, you need to ensure its not a direct lookup.

Ops mgmt ok with notification being a memory item.

Ok 2/21

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 77 H 3 X N U 009 EA2.38 S Cred Dist: The 2nd part has to be a will result instead of a could result.

KA: The first part of the question matches the KA but it is not at the SRO level. The first part does require detailed knowledge of the procedure; however, the detailed knowledge is not needed to make the procedure selection. The second part of the question is at the SRO level but doesnt match the KA.

2nd part of question modified to include the procedure path dealing with having a bubble.

Ok 2/21 78 H 2 X N U/E 027 AA2.04 S Cred Dist: 2nd part of C&D not plausible.

Recommend testing something out of the TS Bases that would be interpreting the TS limits.

2nd part modified to question basis for TS action/inaction.

Ok 2/21 79 H 3 X N E 040 AG2.4.41 Partial: Which will happen first, SG pressure < 675 psig or both channels of SI? I believe it will be pretty close which means you S

could have A as a correct answer also. We can discuss but A can in no way shape or form be correct for this question to stay as is.

Ran on the simulator and operational validity ok.

Are they to make a classification without a reference? If so, we need operations management concurrence.

Ops mgmt ok with making a call without a reference.

Ok 2/21 80 H 3 X M E 057 AG2.4.11 S Stem Focus: Assuming that the loss of power resulted in the loss of control air to valves controlling Pzr level, is the last bullet necessary?

Question ok as is with further discussion.

Ok 2/21

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 81 H 2 X X N U/E 062 AG 2.4.45 S Stem Focus: Is it required to implement?

A possible solution could be to test exactly what the note states.

Partial: Explain why D is incorrect. It appears to meet the entry criteria for the AOI section 3.4 Strainer DP alarm LIT AND LOW flow on individual supply header with HIGH pressure indicated on IPS supply header. Ok after discussion with licensee.

The times2100 and 0330 annunciators numbers are the same but the nomenclature is different. Corrected Licensee needs to walk through the issue with the drawing to explain why this could be anything other than a clogged strainer Ok 2/21 82 L 3 N E 059 AG2.4.21 S Add IAW EPIP-1 at the end of the second question. Added.

We want operations management concurrence that this is acceptable as a memory level question.

Ops mgmt ok with this as a memory item.

Ok 1/21 83 H 3 M E 067 AA2.04 S Are they required to know the attachments by number? Lets walk through the question with the reference.

Discuss the use of the word ONLY. Modified to remove ONLY.

What page is going to be provided as a reference. The document states page 16 but it looks like page 10. Page 10 Ok 1/21

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 84 H 3 X N U/E W/E07 EG2.4.18 S Cred Dist: A&B Would you ever enter AOI-6 after entering the EOP?

The title is Small Reactor Coolant System Leak and your telling them that they are in Saturated Core Cooling. It seems that you are way beyond AOI-6. Re-wrote question, AOI-6 removed.

The first part of the question seems to match the KA but is it SRO level knowledge. The 2nd part doesnt appear to match the KA.

Knowledge of the KA must be tested at the SRO level.

Ok 2/21 85 H 2 X N S W/E15 EA2.2 86 H 3 X N U/E 004 A2.23 S Cred Dist: A&B, if the safety upstream of the orifices lifts, how would you determine what the leak rate is. Based on the information provided, how would you determine what that leak rate was from either relief. Is there any more information that could be added to fix this question. Rewrote 1st part and stem to specify the relief lifting. It goes to the VCT and counts as operational leakage.

Ok 2/21 87 H 3 X N U 006 A2.13 S Cred Dist: C&D 1st part. Stating that you would not transition to ES-1.1 from E-0 would have to include something credible to transition from. The analysis suggest that they would transition in from E-1 based on common methodology. Suggesting that with the set of conditions given, that they would be in E-1 LOSS OF REACTOR OR SECONDARY COOLANT is not plausible. Corrected Would the SI annunciator be lit? Test if both trains of SI need to be actuated IAW E-0 prior to transition to ES-1.1? Incorporated.

2nd part good.

Ok 2/21 88 H 3 N S 022 A2.04 89 F 4 N S 059 G2.2.22 Need to get operations management concurrence that this is a memory item for SROs.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 90 F 1 N U/E 064 G2.2.25 S LOD: This question just does not discriminate. It seems obvious that you would not remove an electrical source when the risk of losing offsite power is going to be elevated. A&D not plausible. Disregard, there are surveillances that disable the DG for longer than the next 12 hours1.388889e-4 days <br />0.00333 hours <br />1.984127e-5 weeks <br />4.566e-6 months <br /> that are allowed.

Would you be allowed to substitute the C-S DG while performing the outage on the 1A-A DG? The note in the beginning of 3.8.1 states that it can be substituted for any of the required DGs.

Explain the analysis for A. I had a hard time understanding it. The surveillance mentioned in it ( 0-SI-82-13) could be part of a more discriminating question.

Ok 4/6 91 H 3 N E 001 A2.01 S Change 2nd question to. Performance and documentation of an engineering evaluation _____ (is/is not) required. Changed question stem.

Ok 4/6 92 H 1 X M U 029 G2.2.40 S SRO: It appears that you can answer the question with LCO entry level knowledge which is RO. Re-wrote question LOD: Level equal to one due to the plausibility of the distracters.

Ok 2/21 93 H 3 N S 086 A2.02 Licensee to walk through the reference material.

What states that this is a tracking item?

94 F 2 N E G2.1.17 S Walk thorugh reference material to verify the first question. Changed to GE to ensure only D is correct.

Ok 2/21 95 F 2 N S G2.1.3

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only G2.2.11 96 H 2 X M U/E Cred Dist. Do you have an example of when adding instrumentation S required a 50.59? Your not changing how the system operates so its hard to say that the 1st part of A&B are plausible. Changed time to 120 days Walk through how an applicant could get each distractor.

Ok 2/21 97 L 2 M S G 2.2.12 Add 12 hour1.388889e-4 days <br />0.00333 hours <br />1.984127e-5 weeks <br />4.566e-6 months <br /> before SR in the second question.

98 L 2 X B E/S G 2.3.6 S Cred Dist: 1st part of C&D dont seem plausible in that you take one sample when the rad monitor is working. So doing nothing extra doesnt seem plausible. Can you change the 1st part to:

A&B: 2 independent samples would be required prior to the release Changed as recommended C&D: samples would be required at least every 6 hours6.944444e-5 days <br />0.00167 hours <br />9.920635e-6 weeks <br />2.283e-6 months <br /> during the release.

We can discuss.

Ok 4/6 G 2.4.26 99 L 3 M S 100 L 2 M E G2.4.40 S Add be before relieved in the question. Done Walk us through the documentation to ensure that D is not correct.

Changed Site VP to RP Manager Ok 4/12

Watts Bar 2013-301 FINAL WRITTEN EXAM SAMPLE PLAN North Anna Final Written Exam Sample Plan is the combination of the Draft Sample Plan and Form ES-401-4.

ES-201 Examination Preparation Checklist Form ES-201-1 Facility: L!7.S i3<C) Date of Examination: m4. 2-i3 Developed by: Written - Facility NRC D II Operating - Facility NRC E Target Date* Task Description (Reference)

-180 1. Examination administration date confirmed (CIa; C.2.a and b)

-120 2. NRC examiners and facility contact assigned (C.1.d; C.2.e)

-120 3. Facility contact briefed on security and other requirements (C.2.c)

-120 4. Corporate notification letter sent (C.2.d)

[-90] [5. Reference material due (C.1.e; C.3.c; Attachment 3)]

{-75} 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-5, ES-D-ls, ES-401-1/2, ES-401-3, and ES-401-4, as applicable (C.1.e and f; C.3.d)

{-70} {7. Examination outline(s) reviewed by NRC and feedback provided to facility licensee (C.2.h; C.3.e)}

{-45} 8. Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6, and any Form ES-201-3 updates), and reference materials due (C.1.e, f, g and h; C.3.d)

-30 9. Preliminary license applications (NRC Form 398s) due (C.1.l; C.2.g; ES-202)

-14 10. Final license applications due and Form ES-201-4 prepared (C.1 .1; C.2.i; ES-202)

-14 11. Examination approved by NRC supervisor for facility licensee review (C.2.h; C.3.f)

-14 12. Examinations reviewed with facility licensee (C.1 .j; C.2.f and h; C.3.g)

-7 13. Written examinations and operating tests approved by NRC supervisor (C.2.i; C.3.h)

-7 14. Final applications reviewed; 1 or2 (if>10) applications audited to confirm qualifications I eligibility; and examination approval and waiver letters sent (C.2.i; Attachment 5; ES-202, C.2.e; ES-204)

-7 15. Proctoring/written exam administration guidelines reviewed with facility licensee (C.3.k)

-7 16. Approved scenarios, job pertormance measures, and questions distributed to NRC examiners (C.3.i)

Target dates are generally based on facility-prepared examinations and are keyed to the identified in the corporate notification letter. They are for planning purposes and may be adjustedexam(nation date case basis in coordination with the facility licensee. on a case-by

[Applies only] {Does not apply} to examinations prepared by the NRC.

ES-201, Page 25 of 28

ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility: Date of Examination: 03/18/13 Watts Bar Item Task Description

1. a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401.

w R b. Assess whether the outline was systematically and randomly prepared in accordance with Section D.1 of ES-401 and whether all K/A categories are appropriately sampled.

c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.

d. Assess whether the justifications for deselected or rejected K/A statements are appropriate.

2. a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, S and major transients.

M b. Assess whether there are enough scenario sets (and spares) to test the projected number U and mix of applicants in accordance with the expected crew composition and rotation schedule L without compromising exam integrity, and ensure that each applicant can be tested using A at least one new or significantly modified scenario, that no scenarios are duplicated T from the applicants audit test(s), and that scenarios will not be repeated on subseat 0 c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative R and quantitative criteria specified on Form ES-301-4 and described in Appendix D.

3. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:

(1) the outline(s) contain(s) the required number of control room and in-plant tasks W distributed among the safety functions as specified on the form

/ (2) task repetition from the last two NRC examinations is within the limits specified on the form T (3) no tasks are duplicated from the applicants audit test(s)

(4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form.

b. Verifythatthe administrative outline meets the criteria specified on Form ES-301-1:

(1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations

c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.

4. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections.

b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.

N c. Ensure that K/A importance ratings (except for plant-specific priorities) are at least 2.5.

d. Check for duplication and overlap among exam sections.

A e. Check the entire exam for balance of coverage.

f. Assess whether the exam fits the appropriate job level (RD or SRO).

a. Author

b. Facility Reviewer (*)

c. NRC Chief Examiner (#)

d. NRC Supervisor Note: # Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

Not applicable for NRC-prepared examination outlines ES-201, Page 26 of 28

ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of N 9 T as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of /3 From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE(2) DATE NOTE

• i1l 7&L (

1 q/Iq/ L-4

2. e. 7/

3. 4i1 . 4w1

4. Lu &r.e fcAchA ac Joz (2.

5. t(.i Tic& RrL ¶,k. S. -Lz_ 2/Z/(2. £1 Y/5/ 2,

6. 15 S+r..

2

.( S,wldca øItLfr /Z £

7. XL..-- ,Ccc.r

8. sLt a4qiz 9.),. ,,ul.t4jr 1

S /,v/ii -mSé ?P& I1 ld:--c -_( _/

11. S+L.L-I& .qD- I 1 1

12. k,-r 6(:L,. -/fl/f2... t,

13. /r2J )XLLz12 -- -- u/qfij -

4fi1/3

14. ML 15._ r&fr \k\;cc3o -

• -tzfA l

4 .

NOTES: 1 0

ES-201, Page 27 of 28

ES-201 Examination Security Agreement Form ES-201-3

1. Pro-Examination / /

/:1J3 acki tiwlr ic trit have (;cluired specialiied knowledge about the NRC licensing examinations scheduled for the week(s) of Nov201 2 as of the rlate of my signature I agree that I will not knowingly divulge any inlornialion about these examinations to tiny persons who have not been authorized by the NRC ;liof examiner I ciricerstarid that am not to instruct, evaluate, or provide porlormance feedback to those applicants scheduled to he administered thus hiccnsi,mg examinations from this date until completion of examination administratio n, except as specifically rioted 1)010w and authorized by the NRC Log.. uctiiig as ii simulator booth operator or conimunicator is acceptable ii the iidividual does not select the training content or provide direct or indirect korthock). Furthermore. I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and ii k:rstaiii Ill nit v iotitiomi of lIme ccnditiom is of this agreement may result in cancellation of the examinations arid/or an enforcement action against me or hoc lacility licensee. I wilt ininiediately report to facility management or the NRC chief examiner any indications or suggestions that examination security 110, Imio nci;mm comimpromiiisud.

2. Post-Examination To tti tmst oh ny kmmowle;lgo I did riot divulge to any unnuttiorized persons army information concerning the NRC licensing examinations administered liii in ilit It ki 1)f.3,4 From the dole tlvit I cmi cm od into this security igreement until the completion of exominotion odminislrolion I din not in trui:t. i*iitute or provide pertormance feectback to those applicants who were administered these licensing examinations, except as opecilically noted Polo.. :uirl omilhnri,oil by the NRC I RINrIED NAME .1DB TITLE I RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE

.1 i., .,

2. a..u t-m4 c v vd,,n c.;/i io_ ;_____ zz i -

HF .- .------

It ,

dLLL Li iF. .i. cj(ti(i lJ1)EE S ES-201, Page 27 of 28

£8401 Exrn1naflan SeeuriW Anresmant Form ES401

. Patoi (acmaø4ete mat I have acct(ied epec!affzed bo.*de about the NRC Uens)n exarnne*n scitdutec fflte week(s) of as of the date of my stnatn. I fS that vftI not iOwQ4y zsgean Weatat1i abovt these axsrr*ia*n tteq perare wit huwe riot Seen authorized by the NRC cNefezatnther. I wastand that I t not In test?ruc errnftiala, or proMda fltna*ioe edbactc thoen appoanIs sdieduled In be snlsterccl the liceniflg exsrnlnetions hon tN date urWt coriipledon xamthatton adrnfriMratlort exoept pecJfta1W noted beio* end autiiodzed by the NRC (as, aoting as asMn booth opemtor oreommunicator 1* acceptsIe fle lndMdiisl 4oas not seIa the tngnteot or provide dfrector thdfr feedbat Furthermore I ait sweta of the physIaI security rnsewrea ar rsqufrernents (a ctieto4 In tIn faty licenseS pmoedurss) and underd that violation of tire csndItioiis of this eresmn *yitfl cwilatton cUbe esan*iasta aridicr an sWorn nenttrz sgeinst rneor the facility Jicenseeb wtil distely report to facil4y mn)eniwA fle NRC ciifeamdia airy nsszreuesIiona that ezamiSoir seçsry rr have bacn compromiaet t ?0*fr4x**Jion ma best of my knowfle. d M 4M.stgs to any unoulhocized poan enyInitirmation totmnhtrj The NRC iicenfl nnatisns adtNntslnred C-)

dwin9 the week(s) a14+/- From thu date that I entered hito thiz security ansement unta the coinplatton of ercaniinettn adnsntsfliii, I not instmct errflJate. orpWMe perfamence feedbadcto those app&[cas*who were atmInistere these Itoenfl exartat}ans 4 aøtcept ass eota rioted 1

b&

cwaMeeo*ized Sj the NRC PRINTEO NAME J0t3 ufLE I RESPONSEIUTY flGMTtJRE,(i) OATh SIGNATU RE 2) DATE NOTE

1. .

a. .

tk1s .  :

$. 4$ & 7.

4, .L4*l.&4cc... I

5. M.?zj kflg *.

a........... p3 p3 V

*frzr i: V Z

10 Iji-. A ra- (

!frW- 15tizrzz-I ttaiasjf 0

£3

.4.... I r

14. . ..

S ... .. .

. n

1r p...__j44& ..... .

4qa_

-A

-t 0

ES-ZUL Pass 27 cf 2$

0 CM

. rfr

LI 9 JO Le ed 6 IOS3 3!ON JVG () UftLVNDIS JNG U) 3Ufl!VNOIS A+/-flIISNOdSI I 1!LL or 31,AJVN GLNIId DeIN 8144 Aq poZ!JoLI1fle PLJ M08q poou Aiieoijioeds se 4de3xe suoi4euiwexe 6uisueoii osoq paio}suwpe OJOM 014M sTueolldde osoq 04 peqpee eouewoped ep!A0J,d Jo o4enIeo lonJTsuI 40U pip i UOI4BJ4SIUIWpE uoi4eu!wexe 40 U01481d Woo °-n niun ueweej6e /4!JnOos siq olu! ioiu I eq oep 8144 woJ ,ç2//Jo (s)eoM 0144 6U!Jflp p0J84S!UiWpe Su014eu!WBXO 6uisueoii DUN 8144 6U!uJOOuOO uoi4ewJoJui ,cue suosJod poZIJOq4neun Aue 04 O6IflA!P 40U P!P1 8WP6IMOWI ,cw jo soq 0144 oj UO!;eu!WBX3-lSOd peswoJdwoo uooq OAB14 Aew i!Jfl°°S UO14BU!WBXO 4B144 SUoiSe66flS JO 5UO!48O!UI Aue JOU!WBXO 40!143 DUN 0144 JO uowo6euew A4!I!0e4 oi JodeJ /e4eipewwi WM I 0sU0fl Ai!I!081 0144

.io ow suie6e uoioe ueweoojuo ue o,pue suoi4euiwexo 0144 JO uo!ieIIooueo U! ilnsej Aew ueweej6e S!L44 JO SUOI41pUOO 8144 JO uo!ieIo!A eq puesopun pue (seJnp000Jd soosuoo i!I!oeJ 0144 U! peuewnoop se) sueweJinbeJ pue senseew ,c4iJnoes Ieo!sAqd eqjo eee we i eJowJoqiJnd (joeqpooj 408JIpu! io oeJ!p opiAoJd JO 4U04U00 6U!U!eJ4 8144 pees 40U seop Ieflp!A!pUi 8144 ji eiqedeooe si JO4EDIUflWWOO o Jo4eJedo qooq Joielnw!s e se 6u!ioe *6o)

DUN 0144 Aq peZ!JOlfjflB pue M0eq P81OU ,c e3!J!oOdS se dooxo U0!4eJ4S!uiWpe UO4BU!WBXO 40 U0!ieId WOO I!iufl 84Bp S1Lfi WOJ4 SUOflBU!WBXO 6U!SUeOii OSOlfi 11 pOJOTS!U!Wpe eq 04 Ofl0LpS SiUeOiIdde esoq 04 peqpeaJ eouewJoped 8p!AOJd JO OieflIeAO 4OflJTSU! 04 lOU W8 i 48144 PUB4SJOPUfl I J0U!WX0 401143 DUN 0144 cq p8Z1JOL44fl8 ueeq 40U 0A814 OL4M suOsJod Aue 04 suoi4eu!wexe eSoq noqe uoi4ewJoJui Aue eSInAip A16u!MOuN ou IM I 48144 88J68 I 8Jn4eU6iS Aw jo 848 814410 Se JO (s)NeeM 0144 JO4 P0IflP0L13S SUOI4BUIW8XO 6uisuooii DUN 8144 noqe 86p8IMOUN p8Z!IeiDedS peJnboe 8A814 4844 O6pOIM0LDjO8 I

//b &P1)

Uo!;BU!weX3-oJd I E-IO-S3 wioi ueweai6y Ai1Jnes UO!4eU!WeX3 IO-S]

ES-201 Examination Security Agreement Form ES-201-3

1. PreExamination (fl2(Z% 2ç,l tI7cIit I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-ExaminatIon To the best of my knowleJge, I id not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of 3/(g i/) From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE i,;1 f Lj/ -

1. j j/2J/ /J ../ /

2. 4 ReQ./o_OPf

- rc.1o

,7_

3. 4/L),4<(JAJ cRz .--.

4. *,4\ S2__

5.

L J L

6. /-.iA_

l:r *1 /4/ S 7 xi.2I- Sct._L

8. L *L_o.- l(tL1 9.

10 .

I4 I ;Irilez

12. rc k, 00

13. .

f ___,.-.-( iid . ..

14. ,;;_-__

__r__ a... iA(\H 1 7t/c NOTES:

ES-201 Page 27 of 28

• - 1-I) 0 0

ES2O1 ahon SeoufltyAqreøna - En 8-2 0 Ia tta1TJiflafl rnflLk# 2osE that J-tra asquzecf pedaed kncwedge about the NRC lcesstng ezan*istJor sdiedue for the waeks) t as of the dato of flh#s reflsf wifi riot ksim4n[y te any hifccáUon about these zandneUors to arty peMons who have no been horzsd by the NRC cikf eanilra uru$erstand that I ant nvt t ffistruot, etaá or n4de perfmanee feedbad to those appThfl sthethAe to be adrnhisteted these flcsnsAng tma5natians ütm thiS thite una flbQfl a1 i*iation mInbon, aept as speflcaIflote betow and authed by its NRC (ag.. aZng as a a3muator booth opaaur ortnwr flacc4*abe if the 1ndMduz does ru seleot the nirilngconnt or prcsMa dfre or inth f back). Fwtherrnore am are of the ptiysicat seeurity measbtas sod reqi*ernent (as doownerited hi the fatif fly !icetess prooadwes) end unOfland that 6oislfan of the oondItlocs of tfis agreennt may rst4thi cenceffaflon of the enmiria5onaar4tqran etmernent acUso %siflst me or the fadlky Ltcensse, I will frornecliately report fadilfty m naenerf or the NRC etS elanta any Mdiceltoee crsigona that nfrta*an security may have been cornprornset

2. Poet.Exernlnatten To the best of rwj k fp4e tftd nst dlvutØ to any utauThcwted pemons C-)

anyThformfln eoncfl the NRC itoareing axe k$cosJmIWstnd during the sveaks) of/i$r cii.. From the date that I entesS into this secccizy eprent well Ste completIon of s,aeninal adnectistmon tId not inslnfl sealuste, or wMo perfornca .toedtst* to those opplt.c at whe vise adrnlnlstesod these bnslng axanettone, except as spedilcally noted below and authcried by the Nfl PIiINTED NAME ta i-inst RESPONSISJLrn 1 SIGNATURE (1) OATh SiGNATURE L2) DATE NOTE IE > tfLtSSQft tfl4 2R.

MtC4aw4at cz ha etcfcr dpenJ-4-..

. J4p

smr

£ I)

V V

9. e 7i 5 .tG rwa t ttøi W7J 4-C-V. 441c rn ;w a, I

aziec,_ ELCZ. . C) 13.j4 US) .

2

.4C .-- .

r ms, W t4.In] f -kJ 7n7T. 0 1

0, I

-U I)

ES-201, Page 27 of 28

ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination 1Ai-, 203 k 11t3 I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of as oft e date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowl 9

dge, I cud not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of i 2 From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or Ørovide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE(2) DATE NOTE

1. -L, 7/-e S

. q/q7

6.  ? SwrFr 7,fz<- vz -//

7. ,L4AJ C1_,,

8. Dc- **

t 6

c cY A

1zfr

9. taqq, ij!3 1O.Mac4)qL S?o ZLA.57

11. I/i4rL4.jJ, L4,LL!.c $jc 1&

12. :t:t_1- ciz -1 RR , L/ -5

13. *4.S RoUA 14.fij,u ien IC 4/4 lS.JDu(- rA-f IA,f1-NOTES:

ES-201, Page 27 of 28

ES-201 Examination Security Agreement Form ES-201 -3

1. Pre-Examination 42M3 I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of-N 2012 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowlpdge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of L1/..?. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE Iy..-k NOTES:

ES-201, Page 27 of 28 fL Ii

ES-301 Administrative Topics Outline Form ES-301-1 Facility: Watts Bar Date of Examination: March 2013 Examination Level: RO SRO El Operating Test Number: 1 Administrative Topic T yp e

• Describe activity to be performed (See Note) Code

1. Calculate Target Boron Concentration for Load Escalation.

Conduct of Operations M,R 2.1.25 Ability to interpret reference materials, such as graphs, curves, tables, etc. (3.9 / 4.2) (CFR 41.10

/45.12/43.5)

2. Evaluate Critical Safety Function Status Trees.

2.1.7 Ability to evaluate plant performance and make operational judgments based on operating Conduct of Operations M,R characteristics reactor behavior, and instrument interpretation. (4.4/4.7) (CFR 41.5/43.5 /45.12 /

45.13)

3. Perform a Clearance Without Use Of eSOMS Computer.

Equipment Control M,R 2.2.13 Knowledge of tagging and clearance procedures.

(4.1/4.3) (CFR: 41.10/45.13)

4. Determine requirements for Locked High Radiation Area.

Radiation Control M,R 2.3.4 Knowledge of radiation exposure limits under normal or emergency conditions. (3.2/3.7) (CFR 41.12/43.4 /45.10)

Emergency Procedures!

N/A N/A Plan NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.

Type Codes & Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank (< 3 for ROs; <4 for SROs & RO retakes)

(N)ew or (M)odified from bank (> 1)

(P)revious 2 exams (< 1; randomly selected)

ES 301, Page 22 of 27

ES-301 Administrative Topics Outline Form ES-301-1 Facility: Watts Bar Date of Examination: March 2013 Examination Level: RO E SRO Operating Test Number: I Administrative Topic T p e Describe activity to be performed (See Note) Code *

1. Calculate Target Boron Concentration for Load Escalation.

Conduct of Operations M,R 2.1.25 Ability to interpret reference materials, such as graphs, curves, tables, etc. (3.9 / 4.2) (CFR 41.10

/45.12/43.5)

2. Evaluate Critical Safety Function Status Trees.

2.1.7 Ability to evaluate plant performance and make operational judgments based on operating Conduct of Operations M R .

charactenstics, reactor behavior, and instrument interpretation. (4.4/4.7) (CFR 41.5/43.5/45.12 /

45.13)

3. Perform a Clearance Without Use Of eSOMS Computer.

Equipment Control N R 2.2.13 Knowledge of tagging and clearance procedures.

(4.1/4.3) (CFR: 41.10/45.13)

4. Determine requirements for Locked High Radiation Area.

Radiation Control M,R 2.3.4 Knowledge of radiation exposure limits under normal or emergency conditions. (3.2/3.7) (CFR 41.12/43.4/45.10)

5. Classify the Event, per the REP.

Emergency Procedures / 2.4.40 Knowledge of SRO responsibilities in emergency Plan M R

, plan implementation. (2. 7/4. 5)(CFR 41.10 / 43.5 /

45.11)

NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.

Type Codes & Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank (< 3 for ROs; <4 for SROs & RO retakes)

(N)ew or (M)odified from bank (> 1)

(P)revious 2 exams (< 1; randomly selected)

ES 301, Page 22 of 27

ES-301 Control Roomlln-Plant Systems Outline Form ES-301-2 Facility: Watts Bar Date of Examination: March 2013 Exam Level: RO SRO-l El SRO-U fl Operating Test Number: I Control Room Systems@ (8 for RO); (7 for SRO-l); (2 or 3 for SRO-U, including 1 ESF)

System I JPM Title Type Code*

A. Respond to PRT High Level Alarm, A,M 5 007 Pressurizer Relief Tank (A4.1 0) (3.6/3.8) (CFR: 41.7! 45.5 to 45.8)

B. Establish RCS Bleed and Feed. A,D,EN 4P E05 Loss of Secondary Heat Sink (EA1 .1) (4.1/4.0) (CFR: 41.7! 45.5/ 45.6)

C. Perform an Alternate Dilution to Flush the Blender. M 1 004 Chemical and Volume Control System (A4.07) ( 3.9/3.7) (CFR: 41.7! 45.5 to 45.8)

D. Isolate Leaking Steam Generator. AL,M 3 037 Steam Generator Tube Leak (AA2.1 1) ( 3.8/3.8) (CFR 43.5 / 45.13)

E. Transfer from Bypass Regulating to Main Feedwater Regulating Valve. N 4S 059 Main Feedwater(MFW)System (A4.08) (3.0/2.9) (CFR 41.7! 45.5 to 45.8)

F. Synchronize the DG from Main Control Room. AM 6 064 Emergency Diesel Generators (A4.01) (4.014.3) (CFR: 41.7 / 45.5 to 45.8)

G. Return Failed RCS Temperature Channel to Service. A,M 7 016 Non-Nuclear Instrumentation System_(A4.01)_(2.9/2.8)_(CFR: 41.7! 45.5 to 45.8)

H. Start Upper Containment Purge. M 8 029 Containment Purge System (A2.03) (2.7/3.2) (CFR 41.5 I 43.5/ 45.3/45.13)

In-Plant Systems@ (3 for RO); (3 for SRO-I); (3 or 2 for SRO-U)

I. Remove a 120V AC Vital Inverter From Service per SOI-235.01. D 6 057.Loss of Vital AC Electrical Instrument Bus (AA1 .01) (3.7/3.7) (CFR 41.7 / 45.5/ 45.6)

J. LocalOperation of Turbine Driven AFW Pump. A,D,E,L,R 4S 061 Auxiliary Feedwater System (A2.04)(3.4/3.8)(CFR 41 .5/43.5/45.3/45.13)

K. Align Upper Containment Monitor To Lower Containment Locally. M,R 7 073 Process Radiation Monitors (A4.02) (3.7/3.7) (CFR 41.7 / 45.5 to 45.6)

@ All RO and SRO-l control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

• Type Codes Criteria for RO I SRO-I I SRO-U (A)lternate path 4-6 / 4-6 / 2-3 (C)ontrol room (D)irect from bank < 9 I < 8 / < 4 (E)mergency or abnormal in-plant 1 I 1 I 1 (EN)gineered safety feature - I - I > 1 (L)ow-Power / Shutdown > 1 / > 1 I > 1 (N)ew or (M)odified from bank including 1(A) 2 I 2 I > I (P)revious 2 exams < 3 3 I < 2 (randomly selected)

(R)CA 1 I >1 / >1 (S)imulator

ES-301 Control Roomlln-Plant Systems Outline Form ES-301-2 Facility: Watts Bar Date of Examination: March 2013 Exam Level: RO SRO-I SRO-U Q Operating Test Number: I Control Room Systems (8 for RO); (7 for SRO-l); (2 or 3 for SRO-U, including I ESF)

System / JPM Title Type Code*

Function A. Respond to PRT High Level Alarm. A,M 5 007 Pressurizer Relief Tank (A4.1 0) (3.6/3.8) (CFR: 41.7/ 45.5 to 45.8)

B. Establish RCS Bleed and Feed. A,D,EN 4P E05 Loss of Secondary Heat Sink (EA1 .1)_(4.1/4.0)_(CFR: 41.7 / 45.5 / 45.6)

C. Perform an Alternate Dilution to Flush the Blender. M 1 004 Chemical and Volume Control System (A4.07) ( 3.9/3.7) (CFR: 41.7 / 45.5 to 45.8)

D. Isolate Leaking Steam Generator. A,L,M 3 037 Steam Generator Tube Leak (AP2.1 1) ( 3.8/3.8) (CFR 43.5 / 45.13)

E. Transfer from Bypass Regulating to Main Feedwater Regulating Valve. N 4S 059 Main Feedwater(MFW)System (A4.08)(3.0?2.9)(CFR 41.7 / 45.5 to 45.8)

F. Synchronize the DO from Main Control Room. A,M 6 064 Emergency Diesel Generators (A4.01) (4.0/4.3) (CFR: 41.7 / 45.5 to 45.8)

G. Return Failed RCS Temperature Channel to Service. A,M 7 016 Non-Nuciear instrumentation System_(A4.01)_(2.9/2.8)_(CFR: 41.7 / 45.5 to 45.8)

H. Not Applicable In-Plant Systems@ (3 for RO); (3 for SRO-l); (3 or 2 for SRO-U)

I. Remove a 120V AC Vital Inverter From Service per S0I-235.01. D 6 057.Loss of Vital AC Electrical Instrument Bus (AA1 .01) (3.7/3.7) (CFR 41.7? 45.5 / 45.6)

J. Local Operation of Turbine Driven AFW Pump. A,D,EL,R 4S 061 Auxiliary Feedwater System (A2.04) (3.4/3.8) (CFR 41.5/43.5/45.3/45.13)

K. Align Upper Containment Monitor To Lower Containment Locally. M,R 7 073 Process Radiation Monitors (A4.02) (3.7/3.7) (CFR 41.7 / 45.5 to 45.6)

@ All RO and SRO-l control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

• Type Codes Criteria for RO / SRO-l / SRO-U (A)lternate path 4-6 I 4-6 I 2-3 (C)ontrol room (D)irectfrom bank <9 / <8 / <4 (2)mergency or abnormal in-plant  ? 1 I 1 I 1 (EN)gineered safety feature - I - / 1 (L)ow-Power / Shutdown > 1 I > 1 I > I (N)ew or (M)odified from bank including 1(A) 2 / 2 I 1 (P)revious 2 exams < 3 < 3 / < 2 (randomly selected)

(R)CA ?1 / >1 I >1 (S)imulator

ES-301 Control Roomlln-Plant Systems Outline Form ES-301-2 Facility: Watts Bar Date of Examination: March 2013 Exam Level: RD SRO-l El SRO-tJ Operating Test Number: 1 Control Room Systems@ (8 for RO); (7 for SRO-l); (2 or 3 for SRO-U, including 1 ESF)

System / JPM Title Type Code*

Fn A. Respond to PRT High Level Alarm. AM 5 007 Pressurizer Relief Tank (A4.1 0) (3.6/3.8) (CFR: 41.7! 45.5 to 45.8)

B. Establish RCS Bleed and Feed. A,D,EN 4P E05 Loss of Secondary Heat Sink (EA1 .1) (4.1/4.0) (CFR: 41.7 / 45.5/ 45.6)

C. Not Applicable D. Not Applicable

. E. Not Applicable F. Not Applicable G. Not Applicable H. Not Applicable In-Plant Systems@ (3 for RO); (3 for SRO-l); (3 or 2 for SRO-U)

I. Remove a 120V AC Vital Inverter From Service per SOl-235.01. D 6 057.Loss of Vital AC Electrical Instrument Bus (Ml .01) (3.7/3.7) (CFR 41.7 / 45.5 / 45.6)

J. Local Operation of Turbine Driven AFW Pump. A,D,EL,R 4S 061 Auxiliary Feedwater System (A2.04) (3.4/38) (CFR 41.5/43.5/45.3/45.13)

K. Align Upper Containment Monitor To Lower Containment Locally. M,R 7 073 Process Radiation Monitors (A4.02) (3.7/3.7) (CFR 41.7 / 45.5 to 45.6)

@ All RD and SRO-l control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

• Type Codes Criteria for RO / SRO-l / SRO-U (A)lternate path 4-6 / 4-6 / 2-3 (C)ontrol room (D)irectfrom bank <9 I <8 I <4 (E)mergency or abnormal in-plant ?1 / 1 I ?1 (EN)gineeredsafetyfeature - I - I 1 (L)ow-Power I Shutdown > 1 I > 1 I > 1 (N)ew or (M)odified from bank including 1(A) 2 / ?2 I ?1 (P)revious 2 exams < 3 < 3 I < 2 (randomly selected)

(R)CA >1 I 1 / >1 (S)imulator

ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: Watts Bar Date of Examination: 03/18/13 Operating Test Number: 1 Initials

1. General Criteria

a. The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).

v V V

b. There is no day-to-day repetition between this and other operating tests to be administered V

during this examination. VL 3

j

- f5

c. The operating test shall not duplicate items from the applicants audit test(s). (see Section D.1 .a.) C 3Rs 1

8

d. Overlap with the written examination and between different parts of the operating test is within p/

acceptable limits. -i

e. It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license level. _*

2. Walk-Through Criteria -- --

a. Each JPM includes the following, as applicable:

• initial conditions initiating cues references and tools, including associated procedures

• reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facilty censee -

• operationally important specific performance criteria that include:

detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important observations to be made by the applicant criteria for successful completion of the task identification of critical steps and their associated performance standards restrictions on the sequence of steps, if applicable

b. Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified fy on those forms and Form ES-201-2.

3. Simulator Criteria -- --

The associated simulator operating tests (scenario sets) have been reviewed in accordance with n Form ES-301-4 and a copy is attached. :k Printed Name I Signature Date

a. Author Brian G. Kaye / I)_.-. ( fr_ I,

b. Facility Reviewer(*) Steven R. Smith / k-Q .,L.Z

c. NRC Chief Examiner (#)

d. NRC Supervisor /

NOTE: The facility signature is not applicable for NRC-developed tests.

1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

ES-301, Page 24 of 27

ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Facility: Watts Bar Date of Exam:3118113 Scenario Numbers: 1/21314/5 Operating Test No.:1 QUALITATIVE ATTRIBUTES ln[tials a b* f

1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events. 5

2. The scenarios consist mostly of related events. t.

3. Each event description consists of

. the point in the scenario when it is to be initiated

. the malfunction(s) that are entered to initiate the event

. the symptoms/cues that will be visible to the crew ..L 5 S

. the expected operator actions (by shift position)

• the event termination point (if applicable)

4. No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event. .

5. The events are valid with regard to physics and thermodynamics. Jt S

6. Sequencing and timing of events is reasonable, and allows the examination team to obtain .

complete evaluation results commensurate with the scenario objectives. !_,c

7. If time compression techniques are used, the scenario summary clearly so indicates.

Operators have sufflcient time to carry out expected activities without undue time constraints.

Cues are given.

3

8. The simulator modeling is not altered. Sfts

9. The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.

10. Every operator will be evaluated using at least one new or significantly modified scenario.

All other scenarios have been altered in accordance with Section D.5 of ES-301.

11. All individual operator competencies can be evaluated, as verified using Form ES-301-6 fhl3 (submit the form along with the simulator scenarios).

12. Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).

13. The level of difficulty is appropriate to support licensing decisions for each crew position. /L.

Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes -- --

1. Total malfunctions (58) 617/5/817

2. Malfunctions after EOP entry (12) 212/1/2/2

3. Abnormal events (24) 414141414

4. Major transients (12) 212/1/1/2

5. EOPs entered/requiring substantive actions (12) 2/21111/2

6. EOP contingencies requiring substantive actions (02) OIl/I/ill

7. Critical tasks (23) 2/4/2/3/2

ES-301 Transient and Event Checklist Form ES-301-5 Facility: Watts Bar Date of Exam: March 2013 Operating Test No: 1 A E Scenarios P V Scenario I T M E

0 I L N CREW CREW CREW CREW T N I T A I C POSITION POSITION POSITION POSITION L M A T S A B S A B S A B S A B U N Y R T 0 R T 0 R T 0 R T 0 M 0 C P 0 C P 0 C P 0 C D R IU E

RO RX 0110 SRO-l NOR 1 1 1 1 I/C 2,3,4,5 4 4 4 2 SRO-U MAJ 6 TS 2,3 2022 RO RX i 1 110 NOR 0111 SRO-l I/C 2,4 2 442 SRO-U MAJ 6 1 221 TS 0 022 RO RX 0110 NOR 1 1 iii SRO-l I/C 3,5 2 442 SRO-U MAJ 6 1 221 TS 0 022 RO RX 110 NOR 111 SRO-I I/C 442 SRO-U MAJ 2 2 1 TS 022 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.

2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.

3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

ES-301 Transient and Event Checklist Form ES-301-5 Facility: Watts Bar Date of Exam: March 2013 Operating Test No.: I A E Scenarios P V T M Scenario 2 E

0 I L N CREW CREW CREW CREW T N I T A I C POSITION POSITION POSITION POSITION L M A T S A B S A B S A B S A B U N R R T T 0 0 R T 0 R T 0 0 C P 0 C P 0 C P 0 C R IU E

RO RX 0110 SRO-l NOR 1 1 1 1 I/C 1,2.3,4 4 4 4 2 SRO-U MAJ 2 2 2 1 TS 1.2 2 022 RO RX 5 1 110 NOR 0111 SRO-I I/C 2 442 SRO-U MAJ 6.7 2 2 2 1 TS 0 022 RO RX 0110 NOR 5 1 111 SRO-l I/C 2,4 2 442 SRO-U MAJ 6,7 2 2 2 1 TS 0 022 RO RX 110 NOR 111 SRO-I I/C 442 SRO-U MAJ 2 2 1 TS 022 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.

2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.

3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

ES-301 Transient and Event Checklist Form ES-301-5 Facility: Watts Bar Date of Exam: March 2013 Operating Test No.: I A E Scenarios P V Scenario 3 T M P E L

o I N

I T CREW CREW CREW CREW A I C POSITION POSITION POSITION POSITION L M A T S A B B S A S A B S A B U N R T 0 R T 0 R T 0 R T 0 Mf 0 C P 0 C P 0 C P 0 C R IU E

RD RX 0110 SRO-I NOR 1 1 1 1 I/C 1,2,5,5 4 4 4 2 SRO-U MAJ 1221 TS 1,2.5 3 022 RO RX 1110 NOR 0111 SRO-I I/C 1,3 2 442 SRO-U MAJ 1 2 2 1 TS 0 022 RO RX 0110 NOR 4 1 111 SRO-I I/C 2,5,5a 3 4 4 2 SRO-U MAJ 7 1 221 TS 0 022 RD RX 110 NOR 111 SRO-l -

I/C 4 42 SRO-U MAJ 2 2 1 TS 022 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RD applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.

2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.

3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

ES-301 Transient and Event Checklist Form ES-301-5 Facility: Watts Bar Date of Exam: March 2013 Operating Test No.: I A E Scenarios P V Scenario 4 T M 0 I L N CREW CREW CREW CREW T N I T C POSITION POSITION POSITION POSITION A T S A S B A B S A B S A B U N R T 0 R T 0 R T 0 R T 0 M 0 C P 0 C P 0 C P 0 C D R IU E

RO RX 0110 SRO-l NOR 1 1 1 1 I/C 234,5,6 5 4 4 2 SRO-U MAJ 1 2 2 1 TS 2 022 RO RX 1 110 NOR 0111 SRO-I I/C 4,5,6 3 4 4 2 SRO-U MAJ 1 221 TS 0022 RO RX 0110 NOR 1 1 111 SRO-l I/C 2,3 2 442 SRO-U MAJ 7 1 221 TS 0 022 RO RX 110 NOR 111 SRO-l I/C 442 SRO-U MAJ 2 2 1 TS 022 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.

2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.

3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

ES-301 Transient and Event Checklist Form ES-301-5 Facility: Watts Bar Date of Exam: March 2013 Operating Test No.: I A E Scenarios P V Scenario 5 T M P E L N o I I T CREW CREW CREW CREW A I C POSITION POSITION POSITION POSITION L M A T S A B S A B S A B A B S U N Y R T 0 R T 0 R T T 0 R 0 M) 0 C P 0 C P 0 C P 0 C R IU E

RO RX 0110 SRO-I NOR 1 1 1 1 I/C 1,2,3,4 4 4 4 2 SRO-U MAJ 2221 TS 1,2,4 3 0 2 2 RO RX 1 110 NOR 0111 SRO-I I/C 1,4 2 442 SRO-U MAJ 6,7 2 2 2 1 TS 0 022 RO RX 0110 NOR 1 111 SRO-I I/C 2,3 2 442 SRO-U MAJ 6,7 2 2 2 1 TS 0 022 RO RX 110 NOR 111 SRO-l I/C 442 SRO-U MAJ 2 2 1 TS 022 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.

2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.

3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

ES-301 Competencies Checklist Form ES-301-6 Facility: Watts Bar Date of Examination: 3/18/2013 Operating Test No.: I APPLICANTS RD X RD X RD RD SRO-I SRO-I SRO-l X SRO-I X SRO-U SRO-U SRO-U SRO-U Competencies SCENARiO CNAlQ CNALO 12345 1 2345 I + 6! 1,2,3, 1,2,3, 1,2,3, 2,3,4, 1,2,3, 1,2,3,4, 1,2,3, 1,2,3, 2,3,4, 1,2,3, InLerpreu agnose 4,6,7 4,6,7 5,5a,6 5,6,8 4,5,7, 6,7 4,6,7 5.Sa,6 5,6,8 4,5,7, Events and Conditions 7 8 7 8 ALL ALL ALL ALL ALL ALL ALL ALL ALL ALL Comply With and UseProcedures(1) r +

...JperaLe t +

..onLroI I 1,2.3. ALL 1.2,3, 2,3,4, 1,2,3, 1.2,3,4. ALL 1.2.3. 2,3,4, 1.2.3, 4,6,7 5,5a,7 5.6,8 4,5,7, 6.7 5,Sa,7 5.6.8 4,5,7, Boards (2) 8 8 ALL ALL ALL ALL ALL ALL ALL ALL ALL ALL Communicate and Interact 6 + 1,2,3.4, 1,2,3, 1,2,3, 1,2,3, 1,2,3, ne 4,5,6, 6,7 4,6,7 5,5a,7 4.5.7, Supervisory Ability (3) 8 8 2.3 1,2 1.2.5 4,5 1,2 Comply With and Use Tech. Specs. (3)

Notes:

(1) Includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant

ES-301 Competencies Checklist Form ES-301-6 Facility: Watts Bar Date of Examination: 3/1812013 Operating Test No.: I APPLICANTS RO RO RO RO SRO-l SRO-l SRO-l SRO-I SRO-U X SRO-U X SRO-U SRO-U Competencies CENARIO CNARIO j______ -p----- - --

1.2.3, 1.2,3. 1,2,3, 2,3,4, 1,2,3, I nterpret/Diag nose 4.6,7 4.6.7 5,5a,6 5.6,8 4.5,7.

Events and Conditions 8 ALL ALL ALL ALL ALL Comply With and UseProcedures(1)

Operate Control Boards(2)

ALL ALL ALL ALL ALL Communicate and Interact 1.2.3, 1,2,3, 1,2,3, 1,2,3, 1,2,3, Demonstrate 4,6,7 4,6,7 5,5a,7 4,5,6, 4,5,7, Supervisory Ability (3) 8 8 2.3 1,2 1,2,5 4,5 1,2 Comply With and Use Tech. Specs. (3) = = = = = = = = = =

Notes:

(1) Includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant

Watts Bar 0312013-301 RO Exam NRC Exam I ES-401 Record of Rejected K/As Form ES-401-4 Tier I Randomly Reason for Rejection Group Selected K/A 1/2 059 AK3.02 Unable to write a quality question to the originally randomly selected K/A.

Replaced with 059 AK3.01 on 02/07/13 by the Chief Examiner.

Watts Bar 031201 3-301 SRO Exam NRC Exam I ES-401 Record of Rejected K/As Form ES-401-4 Tier I Randomly Reason for Rejection Group Selected K/A G2.2.2.5 tests the same processes as does G2.2.1 I 3 G2.2.5 which is also on the test.

K/A G2.2.5 replaced by the Chief Examiner on 12/11/12 with K/A G2.2.12

ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: Watts Bar Date of Exam: 03/18/13 Exam Level: ROE SROE Initial Item Description a b*

1. Questions and answers are technically accurate and applicable to the facility. 31.. S4_s

2. a. NRC K/As are referenced for all questions.

b. Facility learning objectives are referenced as available. fit. 5 -

3. SRO questions are appropriate in accordance with Section D.2.d of ES-401 jJ(. R S

4. The sampling process was random and systematic (If more than 4 RD or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR DL program office).

5. Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:

the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or L 5 ci5 the examinations were developed independently; or V the licensee certifies that there is no duplication; or other (explain)

6. Bank use meets limits (no more than 75 percent Bank Modifled New from the bank, at least 10 percent new, and the rest (7i newormodified); enterthe actual RO/SRO-only 10 / 1 31 / 7 34 / 17 question distribution(s) at right.

7. Between 50 and 60 percent of the questions on the RD Memory C/A exam are written at the comprehension! analysis level; the SRO exam may exceed 60 percent if the randomly selected K/As support the higher cognitive levels; enter 34 / 9 41 / 16 s

5 the actual RD / SRD question distribution(s) at right.

8. References/handouts provided do not give away answers flt or aid in the elimination of distractors.

9. Question content conforms with specific K/A statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; iL deviations are justified.

10. Question psychometric quality and format meet the guidelines in ES Appendix B. $

11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet. J S PrintedName / Signature Date

a. Author Brian G.Kaye/

b Facility Reviewer(*) Steven R. Smith! .3 .j3

d. NRC ReonalSupervor Note: The facility reviewers initials/signature are not applicable for NRC-developed examinations.

1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

ES-401, Page 29 of 33

ES-403, Rev. 9 Written Examination Grading Form ES-403-1 Quality Checklist Facility: Date of Exam: Exam Level: RO/SRO Initials a b c Item Description

1. Clean answer sheets copied before grading

,k1,//

2. Answer key changes and question deletions justified and documented

3. Applicants scores checked for addition errors (reviewers spot check > 25% of examinations)

4. Grading for all borderline cases (80 +/-2% overall and 70 or 80, as applicable, +/-4% on the SRO-only) reviewed in detail (75 (I..L/4

5. All other failing examinations checked to ensure that grades are justified E AJ%f

6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions_missed by half or more of the_applicants Printed Name/Signature Date

a. Grader /lan.c ,201

b. Facility Reviewer(*)

c. NRC Chief Examiner (*) A.

d. NRC Supervisor (*)

(*) The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.