ML17191B483

Exam Administrative Items 2C - Delay Release 2 Yrs

ML17191B483
Person / Time
Site:	Turkey Point
Issue date:	07/10/2017
From:	NRC/RGN-II
To:
References
Download: ML17191B483 (52)

Text

ES-201, Page 25 of 28 ES-201 Examination Preparation Checklist Form ES-201-1 Facility: ___________________________________

Date of Examination: __________

Developed by: Written: Facility NRC

//

Operating Facility NRC Target Date*

Task Description (Reference)

Chief Examiners Initials

-180 1.

Examination administration date confirmed (C.1.a; C.2.a and b)

-150 2.

NRC examiners and facility contact assigned (C.1.d; C.2.e)

-150 3.

Facility contact briefed on security and other requirements (C.2.c)

-150 4.

Corporate notification letter sent (C.2.d)

[-120]

5.

Reference material due (C.1.e; C.3.c; Attachment 3)

{-90}

6.

Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-5, ES-D-1, ES-401-1/2, ES-401N-1/2, ES-401-3, ES-401N-3, ES-401-4, and ES-401N-4, as applicable (C.1.e and f; C.3.d)

{-85}

7.

Examination outline(s) reviewed by NRC and feedback provided to facility licensee (C.2.h; C.3.e)

{-60}

8.

Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6, ES-401N-6, and any Form ES-201-2, ES-201-3, ES-301-1, or ES-301-2 updates), and reference materials due (C.1.e, f, g and h; C.3.d)

-45 9.

Written exam and operating test reviews completed. (C.3.f)

-30 10.

Preliminary license applications (NRC Form 398's) due (C.1.l; C.2.g; ES-202)

-21 11.

Examination approved by NRC supervisor for facility licensee review (C.2.h; C.3.f)

-21 12.

Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g)

-14 13.

Final license applications due and Form ES-201-4 prepared (C.1.l; C.2.i; ES-202)

-14 14.

Written examinations and operating tests approved by NRC supervisor (C.2.i; C.3.h)

-7 15.

Facility licensee management queried regarding the licensees views on the examination. (C.2 j)

-7 16.

Final applications reviewed; 1 or 2 (if >10) applications audited to confirm qualifications / eligibility; and examination approval and waiver letters sent (C.2.i; ; ES-202, C.2.e; ES-204)

-7 17.

Proctoring/written exam administration guidelines reviewed with facility licensee (C.3.k)

-7 18.

Approved scenarios, job performance measures, and questions distributed to NRC examiners (C.3.i)

• Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.

[Applies only] {Does not apply} to examinations prepared by the NRC.

2016-301 Turkey Point 8/22/16 X

X PGC PGC PGC PGC PGC PGC PGC PGC PGC PGC PGC PGC PGC PGC PGC PGC PGC PGC

L-16-1 NRC EXAM SECURE INFORMATION ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility.

Date of Examination.

Initials Item Task Description

1.

a.

Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401 or ES-401 N.

R b.

Assess whether the outline was systematically and randomly prepared in accordance with Section D.1 of ES-401 or ES-401N and whether all K/A categories are appropriately sampled.

1j L c.

Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.

N d.

Assess whether the justifications for deselected or rejected K/A statements are appropriate.

,fl 2.

a.

Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, and major S

transients.

V M

b.

Assess whether there are enough scenario sets (and spares) to test the projected number and U

mix of applicants in accordance with the expected crew composition and rotation schedule L

without compromising exam integrity, and ensure that each applicant can be tested using at fV f3(

A least one new or significantly modified scenario, that no scenarios are duplicated from the T

applicants audit test(s), and that scenarios will not be repeated on subsequent days.

c.

To the extent possible, assess whether the outline(s) conform(s) with the qualitative and quantitative criteria specified on Form ES-301-4 and described in Appendix D.

3.

a.

Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:

(1) the outline(s) contain(s) the required number of control room and in-plant tasks distributed W

among the safety functions as specified on the form

-.0 A

(2) task repetition from the last two NRC examinations is vithin the limits specified on the form ir L

(3) no tasks are duplicated from the applicants audit test(s)

V V V

K (4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on T

the form.

H R

b.

Verify that the administrative outline meets the criteria specified on Form ES-301-1:

(1) the tasks are distributed among the topics as specified on the form IA jjit.

U (2) at least one task is new or significantly modified V V G

(3) no more than one task is repeated from the last two NRC licensing examinations

H c.

Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.

4.

a.

Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the

(,

appropriate exam sections.

1W b.

Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.

E c.

Ensure that K/A importance ratings (except for plant-specific priorities) are at least 2.5.

R d.

Check for duplication and overlap among exam sections.

L e.

Check the entire exam for balance of coverage.

..r.

f.__Assess_whether the_exam_fits_the_appropriate_job_level_(RD_or_SRO).

a. Author

b. Facility Reviewer (*)

EP)J UO)J\\

c. NRC Chief Examiner (#)

/ 4iL_

d. NRC Supervisor cflc4 rtcC...-\\/

Note:

1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

• Not applicable for NRC-prepared examination outlines.

1.

1.

1.

1.

1.

1.

1.

1.

1. Signed on page 2

2.

2.

2.

2.

2.

2.

2.

2.

2. Signed on page 3

1.

1.

1.

1.

1.

1.

1.

1.

1. Signed on page 4

L-16-1 NRC EXAM SECURE INFORMATION ES-301 Administrative Topics Outline Form ES-301-1 Facility: Turkey Point Units 3 & 4 Date of Examination: 08/22/2016 Examination Level: RO SRO Operating Test Number: 2016-301 Administrative Topic (see Note)

Type Code*

Describe activity to be performed Conduct of Operations R, M Calculate a Manual Makeup to the VCT 2.1.25 (3.9):

Ability to interpret reference materials, such as graphs, curves, tables, etc.

Conduct of Operations R, D Determine Heatup of the RCS 2.1.20 (4.6):

Ability to interpret and execute procedure steps.

Equipment Control R, N Review an ECO for the 3A Heater Drain Pump 2.2.13 (4.1):

Knowledge of tagging and clearance procedures.

Radiation Control R, D, P Evaluate Conditions for Restart of Refueling Pre-shuffle in the Spent Fuel Pit 2.3.12 (3.2):

Knowledge of radiological safety principles pertaining to licensed operator duties, such as containment entry requirements, fuel handling responsibilities, access to locked high-radiation areas, aligning filters, etc.

Emergency Procedures/Plan NOT SELECTED FOR RO EXAM NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.

• Type Codes & Criteria:

(C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank ( 3 for ROs; 4 for SROs & RO retakes)

(N)ew or (M)odified from bank ( 1)

(P)revious 2 exams ( 1; randomly selected)

L-16-1 NRC EXAM SECURE INFORMATION ES-301-1 RO Page 1 of 2

L-16-1 NRC EXAM SECURE INFORMATION JPM

SUMMARY

STATEMENTS A.1.a Calculate a Manual Makeup to the VCT - Unit is at 100% power, with a VCT level of 20%. Examinee is given a desired VCT level and boric acid flow rate and is directed to calculate the primary water flow rate, boric acid and primary water volumes, and controller potentiometer settings for the manual makeup. This is a modified bank JPM.

A.1.b Determine Heatup of the RCS - Unit has undergone a heatup to 380°F and relevant data is provided on, Heatup Data Sheet, of 3-OSP-041.7, Reactor Coolant System Heatup and Cooldown Temperature Verification. Examinee must complete the procedure and record any discrepancies and subsequent procedural actions that apply. This is a bank JPM.

A.2 Review an ECO for the 3A Heater Drain Pump - Power is reduced to 35%, to support the replacement of a damaged mechanical seal package on the 3A HDP. Examinee is directed to review the prepared ECO for completeness and accuracy (with eSOMS NOT available) and identify any items that do not meet plant conditions or the requirements of OP-AA-101-1000, Clearance and Tagging. This is a new JPM.

A.3 Evaluate Conditions for Restart of Refueling Pre-shuffle in the Spent Fuel Pit - Refueling pre-shuffle activities in the SFP were interrupted and management desires to resume the shuffle. Examinee is provided a list of plant conditions and inoperable equipment and must determine whether recommencement may occur in accordance with 3-NOP-040.03, Fuel Handling and Insert Shuffle in the Spent Fuel Pit. Examinee will use Attachment 2, Restart Minimum Equipment Checklist, and must identify four items that preclude recommencement. This is a bank JPM, previously used on the 2013 NRC exam.

A.4 NOT SELECTED FOR RO EXAM L-16-1 NRC EXAM SECURE INFORMATION ES-301-1 RO Page 2 of 2

L-16-1 NRC EXAM SECURE INFORMATION ES-301 Administrative Topics Outline Form ES-301-1 Facility: Turkey Point Units 3 & 4 Date of Examination: 08/22/2016 Examination Level: RO SRO Operating Test Number: 2016-301 Administrative Topic (see Note)

Type Code*

Describe activity to be performed Conduct of Operations R, M Calculate a Manual Makeup to the VCT 2.1.25 (4.2):

Ability to interpret reference materials, such as graphs, curves, tables, etc.

Conduct of Operations R, D Determine Heatup of the RCS 2.1.20 (4.6):

Ability to interpret and execute procedure steps.

Equipment Control R, D Evaluate TS Conditions While Performing a Valve Operability Test 2.2.40 (4.7):

Ability to apply Technical Specifications for a system.

Radiation Control R, D Authorize Emergency Exposure Limits 2.3.4 (3.7):

Knowledge of radiation exposure limits under normal or emergency conditions.

Emergency Procedures/Plan R, D Classify Event and Complete SNF 2.4.41 (4.6):

Knowledge of the emergency action level thresholds and classifications.

NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.

• Type Codes & Criteria:

(C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank ( 3 for ROs; 4 for SROs & RO retakes)

(N)ew or (M)odified from bank ( 1)

(P)revious 2 exams ( 1; randomly selected)

L-16-1 NRC EXAM SECURE INFORMATION ES-301-1 SRO Page 1 of 2

L-16-1 NRC EXAM SECURE INFORMATION JPM

SUMMARY

STATEMENTS A.1.a Calculate a Manual Makeup to the VCT - Unit is at 100% power, with a VCT level of 20%. Examinee is given a desired VCT level and boric acid flow rate and is directed to calculate the primary water flow rate, boric acid and primary water volumes, and controller potentiometer settings for the manual makeup. This is a modified bank JPM.

A.1.b Determine Heatup of the RCS - Unit has undergone a heatup to 380°F and relevant data is provided on, Heatup Data Sheet, of 3-OSP-041.7, Reactor Coolant System Heatup and Cooldown Temperature Verification. Examinee must complete the procedure and record any discrepancies, subsequent procedural actions, and/or Technical Specification actions that apply. This is a bank JPM.

A.2 Evaluate TS Conditions While Performing a Valve Operability Test - Unit is in Mode 3 and 4-OSP-047.1E, Letdown Line Isolation Valve Test, is in progress. Given Control Room indications, examinee must determine if any actions are required with regard to ESFAS instrumentation, accident monitoring instrumentation, or containment isolation valves. This is a bank JPM.

A.3 Authorize Emergency Exposure Limits - A General Emergency has been declared and an Owner Controlled Area evacuation is in progress. A rescue of an unconscious person in a high-dose area is to be performed. Examinee must select two individuals from a list of available rescuers and determine whether they should be issued potassium iodide. This is a bank JPM.

A.4 Classify Event and Complete SNF - Unit is in Mode 5, when it experiences a loss of all AC power. Plant and meteorological conditions are provided and examinee must classify the event using 0-EPIP-20101, Duties of Emergency Coordinator, and issue protective action recommendations using 0-EPIP-20134, Offsite Notifications and Protective Action Recommendations. This is a bank JPM.

L-16-1 NRC EXAM SECURE INFORMATION ES-301-1 SRO Page 2 of 2

L-16-1 NRC EXAM SECURE INFORMATION ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 Facility: Turkey Point Units 3 & 4 Date of Examination: 08/22/2016 Exam Level: RO SRO-I SRO-U Operating Test Number: 2016-301 Control Room Systems:* 8 for RO; 7 for SRO-I; 2 or 3 for SRO-U System / JPM Title Type Code*

Safety Function

a. 001 Control Rod Drive System (A4.14, 3.0) / Respond to Control Bank D Demanded Past 230 Steps A, D, P, S 1

b. 004 Chemical and Volume Control System (A4.06, 3.6) / Place Excess Letdown In Service A, D, S 2

c. EPE 038 Steam Generator Tube Rupture (EA1.04, 4.3) / Establish Auxiliary Pressurizer Spray per 3-EOP-E-3 A, N, S 3

d. APE 025 Residual Heat Removal System (AA1.03, 3.4) / Respond to a Loss of RHR L, D, P, S 4P

e. 026 Containment Spray System (A3.01, 4.3) / Manually Initiate Containment Spray D, EN, S 5

f. EPE 055 Station Blackout (EA1.07, 4.3) / Restore Power to the 3A 4kV Bus A, N, S 6

g. 015 Nuclear Instrumentation System (A4.02, 3.9) / Place N-3-42 Power Range Drawer in Service D, S 7

h. APE 068 Control Room Evacuation (AA1.23, 4.3) / Respond to Control Room Evacuation Condition - Unit 3 RO D, S 8

In-Plant Systems* (3 for RO); (3 for SRO-I); (3 or 2 for SRO-U)

i. EPE 029 Anticipated Transient Without Scram (EA1.12, 4.1) / Locally Trip the Reactor and Turbine D, E 1

j. APE 054 Loss of Main Feedwater (AA1.01, 4.5) / Control Steam Generator Level Locally with Auxiliary Feedwater Control Valve D, E 4S

k. APE 026 Loss of Component Cooling Water (AA1.03, 3.6) / Align Emergency Service Water to the Charging Pumps D, E, R 8

All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all five SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

• Type Codes Criteria for RO / SRO-I / SRO-U (A)lternate path (C)ontrol room (D)irect from bank (E)mergency or abnormal in-plant (EN)gineered safety feature (L)ow-Power / Shutdown (N)ew or (M)odified from bank including 1(A)

(P)revious 2 exams (R)CA (S)imulator 4-6 / 4-6 / 2-3 9 / 8 / 4 1 / 1 / 1 1 / 1 / 1 (control room system) 1 / 1 / 1 2 / 2 / 1 3 / 3 / 2 (randomly selected) 1 / 1 / 1 L-16-1 NRC EXAM SECURE INFORMATION ES-301-2 RO Page 1 of 2

L-16-1 NRC EXAM SECURE INFORMATION JPM

SUMMARY

STATEMENTS

a. Respond to Control Bank D Demanded Past 230 Steps - Examinee enters 3-ONOP-028, Reactor Control System Malfunction, to restore the Rod Control System to normal configuration with Bank D at 229 steps withdrawn. When examinee places the Rod Control Selector Switch in automatic, rods begin inserting at fast speed, and examinee must respond by placing the Rod Control Selector Switch in manual. This is a bank alternate-path JPM, previously used on the 2013 NRC exam.

b. Place Excess Letdown In Service - Examinee uses 3-OP-047, CVCS Charging and Letdown, to place excess letdown in service. When CV-3-387 (Excess Letdown Isolation Valve) is opened, examinee must recognize that RV-3-304 has failed open and provides a direct path to the containment sump. Examinee must either close CV-3-387 or transition to 3-ONOP-041.3, Excessive Reactor Coolant System Leakage, to start a charging pump and maintain pressurizer level.

This is a bank alternate-path JPM.

c. Establish Auxiliary Pressurizer Spray per 3-EOP-E The unit has experienced a SGTR. The ruptured SG has been isolated, the RCS has been cooled down, and the examinee is directed to depressurize the RCS to minimize break flow and refill the pressurizer. Examinee must recognize that the PORVs can NOT be opened and, alternatively, will establish auxiliary pressurizer spray using Attachment 4 of 3-EOP-E-3, Steam Generator Tube Rupture. This is a new alternate-path JPM.

d. Respond to a Loss of RHR - The unit is on RHR cooling, when MOV-3-750 (RHR Pump Suction from RCS) inadvertently closes and the running RHR pumps shaft shears. To mitigate, examinee enters 3-ONOP-050 (Loss of RHR) and re-opens the suction valve, secures the damaged pump, realigns RHR, starts the standby pump, and reinitiates cooling flow. This is a bank shutdown JPM, previously used on the 2015 NRC exam.

e. Manually Initiate Containment Spray - The unit has tripped and safety injection/phase-A containment isolation have actuated. Examinee is performing prompt action verifications in Attachment 3 of 3-EOP-E-0 (Reactor Trip or Safety Injection) and must recognize that containment spray/phase-B containment isolation have NOT actuated; examinee will manually initiate at least one train of containment spray, actuate a phase-B containment isolation and manually close phase-B valves that fail to reposition, secure RCPs, and secure the Unit 4 HHSI pumps. This is a bank engineered-safeguards JPM.

f.

Restore Power to the 3A 4kV Bus - The unit has experienced a loss of all AC power. The 3A EDG did NOT start. The 3B EDG started but did not energize the 3B 4kv Bus. The Examinee is directed to restore power with a priority on the 3B EDG. The Examinee will discover the 3B 4KV Bus is locked out will restore power to the 3A 4kV Bus via the SBO tie line. This is a new alternate-path and time critical JPM.

g. Place N-3-42 Power Range Drawer in Service - The unit is at 100% power and examinee is directed to place the N-3-42 power range drawer in service using 3-OSP-059.4, Power Range Nuclear Instrumentation Analog Channel Operational Test. This is a bank JPM.

h. Respond to Control Room Evacuation Condition (Unit 3 RO) - Due to a fire, examinee responds as the unit RO per 4 of 0-ONOP-105, Control Room Evacuation, and trips the reactor/ turbine, closes the MSIVs, trips the main feedwater pumps, closes the atmospheric steam dumps, closes the PORVs/block valves, and trips the RCPs.

This is a time-critical bank JPM.

i.

Locally Trip the Reactor and Turbine - The unit has experienced an ATWS and the examinee is directed to trip the reactor and turbine locally. Examinee will proceed to the 3B MCC Room, open all reactor trip, bypass, and MG set breakers, and then trip the turbine at the turbines front standard. This is a bank JPM.

j.

Control Steam Generator Level Locally with Auxiliary Feedwater Control Valve - The unit has tripped. AFW flow is required to the 3C SG. Examinee is directed to investigate and locally restore AFW flow to the 3C SG per 3-ONOP-075, Auxiliary Feedwater System Malfunction. Examinee will discover that train-2 flow to the 3C SG is NOT available and train-1 flow control valve will NOT open manually. Examinee will transition to Attachment 3 of the ONOP to locally manipulate valves and restore feedwater flow to the 3C SG. This is a bank emergency JPM.

k. Align Emergency Service Water to the Charging Pumps - Level can NOT be maintained in the CCW Surge Tank and a loss of cooling to the charging pumps is imminent. Examinee will use Attachment 1 of 3-ONOP-030, Component Cooling Water Malfunction, to locally establish emergency cooling water to these pumps. This is a bank RCA/emergency JPM.

L-16-1 NRC EXAM SECURE INFORMATION ES-301-2 RO Page 2 of 2

L-16-1 NRC EXAM SECURE INFORMATION ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 Facility: Turkey Point Units 3 & 4 Date of Examination: 08/22/2016 Exam Level: RO SRO-I SRO-U Operating Test Number: 2016-301 Control Room Systems:* 8 for RO; 7 for SRO-I; 2 or 3 for SRO-U System / JPM Title Type Code*

Safety Function

a. 001 Control Rod Drive System (A4.14, 3.4) / Respond to Control Bank D Demanded Past 230 Steps A, D, P, S 1

b. 004 Chemical and Volume Control System (A4.06, 3.1) / Place Excess Letdown In Service A, D, S 2

c. EPE 038 Steam Generator Tube Rupture (EA1.04, 4.1) / Establish Auxiliary Pressurizer Spray per 3-EOP-E-3 A, N, S 3

d. APE 025 Residual Heat Removal System (AA1.03, 3.3) / Respond to a Loss of RHR L, D, P, S 4P

e. 026 Containment Spray System (A3.01, 4.5) / Manually Initiate Containment Spray D, EN, S 5

f. EPE 055 Station Blackout (EA1.07, 4.5) / Restore Power to the 3A 4kV Bus A, N, S 6

g. 015 Nuclear Instrumentation System (A4.02, 3.9) / Place N-3-42 Power Range Drawer in Service D, S 7

h. NOT SELECTED FOR SRO EXAM In-Plant Systems* (3 for RO); (3 for SRO-I); (3 or 2 for SRO-U)

i. EPE 029 Anticipated Transient Without Scram (EA1.12, 4.0) / Locally Trip the Reactor and Turbine D, E 1

j. APE 054 Loss of Main Feedwater (AA1.01, 4.4) / Control Steam Generator Level Locally with Auxiliary Feedwater Control Valve D, E 4S

k. APE 026 Loss of Component Cooling Water (AA1.03, 3.6) / Align Emergency Service Water to the Charging Pumps D, E, R 8

All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all five SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

• Type Codes Criteria for RO / SRO-I / SRO-U (A)lternate path (C)ontrol room (D)irect from bank (E)mergency or abnormal in-plant (EN)gineered safety feature (L)ow-Power / Shutdown (N)ew or (M)odified from bank including 1(A)

(P)revious 2 exams (R)CA (S)imulator 4-6 / 4-6 / 2-3 9 / 8 / 4 1 / 1 / 1 1 / 1 / 1 (control room system) 1 / 1 / 1 2 / 2 / 1 3 / 3 / 2 (randomly selected) 1 / 1 / 1 L-16-1 NRC EXAM SECURE INFORMATION ES-301-2 SRO Page 1 of 2

L-16-1 NRC EXAM SECURE INFORMATION JPM

SUMMARY

STATEMENTS

a. Respond to Control Bank D Demanded Past 230 Steps - Examinee enters 3-ONOP-028, Reactor Control System Malfunction, to restore the Rod Control System to normal configuration with Bank D at 229 steps withdrawn. When examinee places the Rod Control Selector Switch in automatic, rods begin inserting at fast speed, and examinee must respond by placing the Rod Control Selector Switch in manual. This is a bank alternate-path JPM, previously used on the 2013 NRC exam.

b. Place Excess Letdown In Service - Examinee uses 3-OP-047, CVCS Charging and Letdown, to place excess letdown in service. When CV-3-387 (Excess Letdown Isolation Valve) is opened, examinee must recognize that RV-3-304 has failed open and provides a direct path to the containment sump. Examinee must either close CV-3-387 or transition to 3-ONOP-041.3, Excessive Reactor Coolant System Leakage, to start a charging pump and maintain pressurizer level.

This is a bank alternate-path JPM.

c. Establish Auxiliary Pressurizer Spray per 3-EOP-E The unit has experienced a SGTR. The ruptured SG has been isolated, the RCS has been cooled down, and the examinee is directed to depressurize the RCS to minimize break flow and refill the pressurizer. Examinee must recognize that the PORVs can NOT be opened and, alternatively, will establish auxiliary pressurizer spray using Attachment 4 of 3-EOP-E-3, Steam Generator Tube Rupture. This is a new alternate-path JPM.

d. Respond to a Loss of RHR - The unit is on RHR cooling, when MOV-3-750 (RHR Pump Suction from RCS) inadvertently closes and the running RHR pumps shaft shears. To mitigate, examinee enters 3-ONOP-050 (Loss of RHR) and re-opens the suction valve, secures the damaged pump, realigns RHR, starts the standby pump, and reinitiates cooling flow. This is a bank shutdown JPM, previously used on the 2015 NRC exam.

e. Manually Initiate Containment Spray - The unit has tripped and safety injection/phase-A containment isolation have actuated. Examinee is performing prompt action verifications in Attachment 3 of 3-EOP-E-0 (Reactor Trip or Safety Injection) and must recognize that containment spray/phase-B containment isolation have NOT actuated; examinee will manually initiate at least one train of containment spray, actuate a phase-B containment isolation and manually close phase-B valves that fail to reposition, secure RCPs, and secure the Unit 4 HHSI pumps. This is a bank engineered-safeguards JPM.

f.

Restore Power to the 3A 4kV Bus - The unit has experienced a loss of all AC power. The 3A EDG did NOT start. The 3B EDG started but did not energize the 3B 4kv Bus. The Examinee is directed to restore power with a priority on the 3B EDG. The Examinee will discover the 3B 4KV Bus is locked out will restore power to the 3A 4kV Bus via the SBO tie line. This is a new alternate-path and time critical JPM.

g. Place N-3-42 Power Range Drawer in Service - The unit is at 100% power and examinee is directed to place the N-3-42 power range drawer in service using 3-OSP-059.4, Power Range Nuclear Instrumentation Analog Channel Operational Test. This is a bank JPM.

h. NOT SELECTED FOR SRO EXAM

i.

Locally Trip the Reactor and Turbine - The unit has experienced an ATWS and the examinee is directed to trip the reactor and turbine locally. Examinee will proceed to the 3B MCC Room, open all reactor trip, bypass, and MG set breakers, and then trip the turbine at the turbines front standard. This is a bank JPM.

j.

Control Steam Generator Level Locally with Auxiliary Feedwater Control Valve - The unit has tripped. AFW flow is required to the 3C SG. Examinee is directed to investigate and locally restore AFW flow to the 3C SG per 3-ONOP-075, Auxiliary Feedwater System Malfunction. Examinee will discover that train-2 flow to the 3C SG is NOT available and train-1 flow control valve will NOT open manually. Examinee will transition to Attachment 3 of the ONOP to locally manipulate valves and restore feedwater flow to the 3C SG. This is a bank emergency JPM.

k. Align Emergency Service Water to the Charging Pumps - Level can NOT be maintained in the CCW Surge Tank and a loss of cooling to the charging pumps is imminent. Examinee will use Attachment 1 of 3-ONOP-030, Component Cooling Water Malfunction, to locally establish emergency cooling water to these pumps. This is a bank RCA/emergency JPM.

L-16-1 NRC EXAM SECURE INFORMATION ES-301-2 SRO Page 2 of 2

L-16-J NRC EXAM SECURE INFORMATION ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: ft.e7 I41 ti?15.Ei-i Date of Examination:

Operating Test Number:2O..1 Initials

1. General Criteria

a b*

c#

a.

The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).

b.

There is no day-to-day repetition between this and other operating tests to be administered during this examination.

lv

c.

The operating test shall not duplicate items from the applicants audit test(s). (see Section D.1.a.)

j_ ¶j_

d.

Overlap with the written examination and between different parts of the operating test is within acceptable limits.

e.

It appears that the operating test will differentiate between competent and less-than-competent j

applicants at the designated license level.

2. Walk-Through Criteria a.

Each JPM includes the following, as applicable:

initial conditions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee operationally important specific performance criteria that include:

detailed expected actions with exact criteria and nomenclature

system response and other examiner cues

statements describing important observations to be made by the applicant

criteria for successful completion of the task

identification of critical steps and their associated performance standards

restrictions on the sequence of steps, if applicable

b.

Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-3d-i and 2) have not caused the test to deviate from any of the acceptance

(,.

criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified 11 on those forms and Form ES-201-2.

3. Simulator Criteria The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-(A I3 301-4 and a copy is attached.

Vd JL a.

Author b.

Facility Reviewer(*)

c.

NRC Chief Examiner f#)

d.

NRC Supervisor NOTE:

• The facility signature is not applicable for NRC-developed tests.

1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

L-16-1 NRC EXAM SECURE INFORMATION

L-16-1 NRC EXAM SECURE INFORMATION ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Facility: Turkey Point Units 3 & 4 Date of Exam: 0812212016 Scenario Numbers:

1 /2/3/4 / 5 Operating Test No.: 2016-301 QUALITATIVE ATTRIBUTES Initials a

b*

c#

1.

The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events.

V J

2.

The scenarios consist mostly of related events.

.L 3.

Each event description consists of the point in the scenario when it is to be initiated the malfunction(s) or conditions that are entered to initiate the event 93 the symptoms/cues that will be visible to the crew A

the expected operator actions (by shift position)

the event termination point (if applicable) 4.

The events are valid with regard to physics and thermodynamics.

J4 *% J_

5.

Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.

IlL

6.

If time compression techniques are used, the scenario summary clearly so indicates.

Operators have sufficient time to carry out expected activities without undue time 4

constraints.

lilA 11 Cues are given.

V 7.

The simulator modeling is not altered.

LV\\

8.

The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to iA 9

ensure that functional fidelity is maintained while running the planned scenarios.

9.

Every operator will be evaluated using at least one new or significantly modified scenario.

All other scenarios have been altered in accordance with Section D.5 of ES-301.

10. All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the form along with the simulator scenarios).

1 1. The scenario set provides the opportunity for each applicant to be evaluated in each of the applicable rating factors. (Competency Rating factors as described on forms ES-303-1 and A A 1

)L ES-303-3.)

V\\

12. Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).

13. The level of difficulty is appropriate to support licensing decisions for each crew position.

Target Quantitative Attributes (Per Scenario; See Section D.5.d)

Actual Attributes 1.

MalfunctionsafterEOPentry(1-2) 2/2/2/2/

/

2.

Abnormal events (2-4) 4 / 5 / 3 / 3 /

3.

Major transients (12) 1 / 1 /1 / 2 /

4.

EOPs entered/requiring substantive actions (12) 1 / 1 / 1 / 2 /

J4L..

5.

EOP contingencies requiring substantive actions (0-2) 0 / 1 /0 / 0 /

6.

EOP based Critical tasks (23) 2 / 2 / 2 / 2 /

NOTE:

The facility signature is not applicable for NRC developed tests.

.c

1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

ES-301 L-16-1 NRC EXAM SECURE INFORMATION Transient and Event Checklist Form ES-301-5 Facility: Turkey Point Units 3 & 4 Date of Exam: 8122116 Operating Test No.: 2016-301 Scenarios E

L-16-i Ni L-16-1 N2 L-16-i N3 L-16-l N4

\\

L-16-i N5

)

M A

V

\\

I (Spare) i T

I P

E f

0 N

P N

IT I

L T

CREW CREW CREW CREW

\\\\ CREW 1

A M

I POSITION POSITION POSITION POSITION

\\IOSITION/

C T

jJ Mf)_

A S

A B

S A

B S

A B

S A

B SAJW N

D R

T 0

R T

0 R

T 0

R T

0 RT Jo R

I T

E 0

C P

0 C

P 0

C P

0 C

P RX 4

2 5

\\

3 1

NOR 1*

1 1

SROI-1 IC 23,5 3, 4 MAJ 6

5,7 6

4 2

TS 3,5 1,4 4

2 RX 4

2 5

3 1

NOR 1*

i 1

SROI-2 I/C 1,2 3,4

\\

8 4

425%3 1

SROI-3 I/C 2,3,5 1,3,4 2,4 8

4 MAJ 6

5,7 6

4 2

IS 3513 4

2 Instructions:

1.

Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (AIC) and balance-of-plant (BOP) positions. Instant SROs (SRO-I) must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position.

If an SRO-l additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the AIC position.

2.

Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D.

(*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a one-for-one basis.

3.

Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

4.

For licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-l applicants in either the ATC or BOP position to best evaluate the SRO-I in manipulating plant controls.

Page 1 of 3

L-16-1 NRC EXAM SECURE INFORMATION ES-301 Transient and Event Checklist Form ES-301-5 Facility: Turkey Point Units 3 & 4 Date of Exam: 8122116 Operating Test No.: 2016-301 Scenarios F

L-16-i Ni L-76-1 N2 L-16-i N3 L-16-1 N4 L-16-i N5 M

A V

(Spare)

T P

E 0

N P

N T

L T

CREW CREW CREW CREW CREW A

M I

POSITION POSITION POSITION POSITION POSITION L

U C

T M)

A Y

S A

B S

A B

S A

B S

A B

S A

B N

P R

T 0

R T

0 R

T 0

R T

0 R

T 0

R T

E 0

C P

0 C

P 0

C P

0 C

P 0

C P

RX 5

1 1

NOR 4

1 1

RO-1 I/C 3,5 2,4 4

4 MAJ 6

6 2

2 TS 0

0 RX 4

1 1

NOR 2

5 2

1 RO-2 I/C 1,2 1,3 1,3 6

4 MAJ 6

5,7 6

4 2

TS

0 0

RX 5

1 1

NOR 4

2 2

1 RO-3 I/C 3,5 1,3 2,4 6

4 MAJ 6

5,7 6

4 2

TS 0

0 RX 2

1 1

NOR 5

1 1

RO-4 I/C 3,4 1,3 4

4 MA]

5,7 6

3 2

TS 0

0 RX 4

1 1

NOR 1

2 2

1 RO-5 I/C 1,2 2,4 1,3 6

4 MAJ 6

8 5,7 4

2 IS 0

0 Page2of3

L-16-1 NRC EXAM SECURE INFORMATION ES-301 Transient and Event Checklist Form ES-301-5 Facility: Turkey Point Units 3 & 4 Date of Exam: 8122116 Operating Test No.: 2016-301 Scenarios A

L-16-i Ni L-16-i N2 L-16-i N3 L-16-1 N4 L-16-i N5 M

(Spare)

T I

P 2

0 N

P N

T L

T CREW CREW CREW CREW CREW A

M I

POSITION POSITION POSITION POSITION POSITION L

U C

T M(*)

A Y

S A

B S

A B

S A

B S

A B

S A

B N

R T

0 R

T 0

R T

0 R

T 0

R T

0 R

T E

0 C

P 0

C P

0 C

P 0

C P

0 C

P RX 1

1 1

NOR 5

1 1

RO-7 I/C 3,6 1,3 4

4 MAJ 8

6 2

2 TS 0

0 RO-6 RX NOR I/C MAJ TS Instructions:

4 3,5 6

2 3,4 5,7 4

3 0

4 2

0 Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. RO5 must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions. Instant SROs (SRO-l) must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position.

If an SRO-l additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.

2.

Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D.

(*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a one-for-one basis.

3.

Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

4.

For licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-l applicants in either the ATC or BOP position to best evaluate the SRO-l in manipulating plant controls.

Page3of3

L-16-1 NRC EXAM SECURE INFORMATION ES-301 Competencies Checklist Form ES-301-6 Facility: Turkey Point Units 3&4 Date of Examination: 8122116 Operating Test No.: 2016-301 APPLICANTS SRO RO BOP SCENARIO SCENARIO SCENARIO Competencies i

2 3

s i

2 3[

Interpret/Diagnose 1-6 [

1-6 1-6 1-5 1-6 1-6 1-6 1-6 1-5 1-6 1-6 1-6 1-6 1-5 1-6 Events and Conditions 8

7 8

7 8

7 Comply With and 1-6 1-6 1-6 1-5 1-6 1-6 1-6 1-6 1-5 1-6 1-6 1-6 1-6 1-5 1-6 Use Procedures (1) 8 7

8 7

8 7

Operate Control N/A N/A N/A N/A N/A 1,2 1,2 1,3 2,3,4 2,4 2,3 3,4 1,2 1,2,3 1,3 Boards (2) 4,6 4,6 6,8 57 5,6 5,6 5,6 4,8 57 5,6 Communicate 1-6 1-6 1-6 1-5 1-6 1-6 1-6 1-6 1-5 1-6 1-6 1-6 1-6 1-5 16 and Interact 8

7 8

7 8

7 Demonstrate 1-6 1-6 1-5 1-6 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A Supervisory Ability (3) 8 7

Comply With and 1 3 3 5 2 5 1 3 1 4 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A Use Tech. Specs. (3)

Notes:

(1)

Includes Technical Specification compliance for an RD.

(2)

Dptional for an S RD-U.

(3)

DnIy applicable to SRDs.

Instructions:

Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant. (This includes all rating factors for each competency.) (Competency Rating factors as described on forms ES-303-1 and ES-303-3.)

ES-401, Rev. 10 PWR Examination Outline Form ES-401-2 Facility:

Date of Exam:

Tier Group RO K/A Category Points SRO-Only Points K

1 K

2 K

3 K

4 K

5 K

6 A

1 A

2 A

3 A

4 G

Total A2 G*

Total

1.

Emergency &

Abnormal Plant Evolutions 1

N/A N/A 18 6

2 9

4 Tier Totals 27 10

2.

Plant Systems 1

28 5

2 10 3

Tier Totals 38 8

3. Generic Knowledge and Abilities Categories 1

2 3

4 10 1

2 3

4 7

1. Ensure that at least two topics from every applicable K/A category are sampled within each tier of the RO and SRO-only outlines (i.e., except for one category in Tier 3 of the SRO-only, the Tier Totals in each K/A category shall not be less than two). (One Tier 3 Radiation Control K/A is allowed if the K/A is replaced by a K/A from another Tier 3 Category).

2. The point total for each group and tier in the proposed outline must match that specified in the table.

The final point total for each group and tier may deviate by +/-1 from that specified in the table based on NRC revisions.

The final RO exam must total 75 points and the SRO-only exam must total 25 points.

3. Systems/evolutions within each group are identified on the associated outline; systems or evolutions that do not apply at the facility should be deleted and justified; operationally important, site-specific systems that are not included on the outline should be added. Refer to section D.1.b of ES-401 for guidance regarding the elimination of inappropriate K/A statements.

4. Select topics from as many systems and evolutions as possible; sample every system or evolution in the group before selecting a second topic for any system or evolution.

5. Absent a plant-specific priority, only those K/As having an importance rating (IR) of 2.5 or higher shall be selected.

Use the RO and SRO ratings for the RO and SRO-only portions, respectively.

6. Select SRO topics for Tiers 1 and 2 from the shaded systems and K/A categories.

7. *The generic (G) K/As in Tiers 1 and 2 shall be selected from Section 2 of the K/A Catalog, but the topics must be relevant to the applicable evolution or system. Refer to section D.1.b of ES-401 for the applicable KAs.

8. On the following pages, enter the K/A numbers, a brief description of each topic, the topics= importance ratings (IRs) for the applicable license level, and the point totals (#) for each system and category. Enter the group and tier totals for each category in the table above; if fuel handling equipment is sampled in other than Category A2 or G* on the SRO-only exam, enter it on the left side of Column A2 for Tier 2, Group 2 (Note # 1 does not apply). Use duplicate pages for RO and SRO-only exams.

9. For Tier 3, select topics from Section 2 of the K/A catalog, and enter the K/A numbers, descriptions, IRs, and point totals (#) on Form ES-401-3. Limit SRO selections to K/As that are linked to 10 CFR 55.43..

3 3

3 3

3 3

2 1

2 1

2 1

5 4

5 4

5 4

3 2

2 2

3 3

3 3

1 3

3 1

0 1

1 1

1 1

1 1

1 1

4 2

3 3

4 4

4 4

2 4

4 3

2 2

1 3

2 2

2 3

3 6

2 2

5 5

10 3

2 2

1 3

18 27 38 9

28 10 4

3 5

8 Turkey Point 2016 PTN L-16-1 NRC Exam Security Agreement In Effect

NAME / SAFETY FUNCTION:

K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

KA RO SRO IR ES-401, REV 10 T1G1 PWR EXAMINATION OUTLINE FORM ES-401-2 Reactor Trip - Stabilization - Recovery

/ 1 Knowledge of RO tasks performed outside the main control room during an emergency and the resultant operational effects 007EG2.4.34 4.2 4.1 Pressurizer Vapor Space Accident / 3 LPI System 008AA1.05 3.4 3.3 Small Break LOCA / 3 Use of steam tables 009EK1.02 3.5 4.2 Large Break LOCA / 3 Starting auxiliary feed pumps and flow, ED/G, and service water pumps 011EK3.03 4.1 4.3 RCP Malfunctions / 4 CCWS 015AK2.08 2.6 2.6 Loss of Rx Coolant Makeup / 2 Reason for changing from manual to automatic control of charging flow valve controller 022AK1.04 2.9 3

Loss of RHR System / 4 LPI pump switches, ammeter, discharge pressure gauge, flow meter, and indicators 025AA1.09 3.2 3.1 Pressurizer Pressure Control System Transfer of heaters to backup power supply 027AA1.05 3.3 3.2 ATWS / 1 Breakers, relays, and disconnects.

029EK2.06 2.9 3.1 Steam Gen. Tube Rupture / 3 Magnitude of rupture 038EA2.13 3.1 3.7 Loss of Main Feedwater / 4 Steam flow-feed trend recorder 054AA2.08 2.9 3.3 Page 1 of 2 9:35 AM 2/1/2016 PTN L-16-1 NRC Exam Security Agreement In Effect 1.

2.

3.

4.

5.

6.

7.

8.

9.

10.

11.

• • No Charging flow valve controller on our plant. Suggest expand scope to charging pump speed controller. Changed to AK1.03 Malfunction / 3

• • No Backup power supply at our plant. Suggest expand scope. Could hit K/A on EDG max loading? Changed to AA1.03

NAME / SAFETY FUNCTION:

K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

KA RO SRO IR ES-401, REV 10 T1G1 PWR EXAMINATION OUTLINE FORM ES-401-2 Station Blackout / 6 Ability to use plant computer to evaluate system or component status.

055EG2.1.19 3.9 3.8 Loss of Off-site Power / 6 Definition of subcooling: use of steam tables to determine it 056AK1.03 3.1 3.4 Loss of Vital AC Inst. Bus / 6 Actions contained in EOP for loss of vital ac electrical instrument bus 057AK3.01 4.1 4.4 Loss of Nuclear Svc Water / 4 The automatic actions (alignments) within the nuclear service water resulting from the actuation of the ESFAS 062AK3.02 3.6 3.9 Loss of Instrument Air / 8 When to commence plant shutdown if instrument air pressure is decreasing 065AA2.05 3.4 4.1 Inadequate Heat Transfer - Loss of Secondary Heat Sink / 4 Facility's heat removal systems, including primary coolant, emergency coolant, the decay heat removal systems and relations between the proper operation of these systems to the operation of the facility.

WE05EK2.2 3.9 4.2 Steam Line Rupture - Excessive Heat Transfer / 4 Ability to interpret control room indications to verify the status and operation of a system, and understand how operator actions and directives affect plant and system conditions we12EG2.2.44 4.2 4.4 Page 2 of 2 9:35 AM 2/1/2016 PTN L-16-1 NRC Exam Security Agreement In Effect 12.

13.

14.

15.

16.

17.

18.

• • Double Jeopardy w/ Q. 13. Suggest keep 3 and change 13. Changed to AK1.04

NAME / SAFETY FUNCTION:

K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

KA RO SRO IR ES-401, REV 10 T1G2 PWR EXAMINATION OUTLINE FORM ES-401-2 Dropped Control Rod / 1 Interaction of ICS control stations as well as purpose, function and modes of operation of ICS 003AK1.13 3.2 3.6 Inoperable/Stuck Control Rod / 1 Stuck or inoperable rod from in-core and ex-core NIS, in-core or loop temperature measurements 005AA2.01 3.3 4.1 Emergency Boration / 1 When boron dilution is taking place 024AA2.06 3.6 3.7 Fuel Handling Accident / 8 Different inputs that will cause a reactor building evacuation 036AK3.01 3.1 3.7 Steam Generator Tube Leak / 3 Knowledge of the emergency action level thresholds and classifications.

037AG2.4.41 2.9 4.6

• • SRO level. Suggest New K/A. Changed to G2.4.20 051AA1.04 Loss of Condenser Vacuum / 4 Rod position 2.5 2.5 LOCA Cooldown - Depress. / 4 Facility's heat removal systems, including primary coolant, emergency coolant, the decay heat removal systems and relations between the proper operation of these systems to the operation of the facility.

WE03EK2.2 3.7 4.0 Degraded Core Cooling / 4 Annunciators and conditions indicating signals, and remedial actions associated with the (Degraded Core Cooling).

WE06EK1.3 3.7 3.9 Containment Flooding / 5 Manipulation of controls required to obtain desired operating results during abnormal and emergency situations.

WE15EK3.3 2.9 2.9 Page 1 of 1 9:35 AM 2/1/2016 PTN L-16-1 NRC Exam Security Agreement In Effect 19.

20.

21.

22.

23.

24.

25.

26.

27.

• • No ICS. Suggest NewK/A. Changed to AK1.02

• • Relationship issue. Suggest how to write this question? Changed to 0067 Plant fire on-site AA1.06 Fire Alarm

• • No actions or controls maipulated. Suggest New K/A. Changed to EK3.2 3.5

NAME / SAFETY FUNCTION:

K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

KA RO SRO IR ES-401, REV 10 T2G1 PWR EXAMINATION OUTLINE FORM ES-401-2 Reactor Coolant Pump RPS 003K3.04 3.9 4.2 Chemical and Volume Control Purpose of VCT divert valve 004K6.09 2.8 3.1 Chemical and Volume Control Design minimum and maximum flow rates for letdown system.

004K6.22 2.6 2.9 Residual Heat Removal RCS pressure boundary motor-operated valves 005K2.03 2.7 2.8 Emergency Core Cooling 006A4.03 3.5 3.5 Pressurizer Relief/Quench Tank 007A4.04 2.6 2.6 Component Cooling Water Transfer from boron storage tank to boron injection tank Changed to A4.08 PZR vent valve Changed to A4.10 Automatic start of standby pump 008K4.01 3.1 3.3 Pressurizer Pressure Control Controller for PZR spray valve 010K2.02 2.5 2.7 Reactor Protection RPIS 012K1.04 3.2 3.3 Engineered Safety Features Actuation Definitions of safety train and ESF channel 013K5.01 2.8 3.2 Containment Cooling Knowledge of surveillance procedures.

022G2.2.12 3.7 4.1 Page 1 of 3 9:35 AM 2/1/2016 PTN L-16-1 NRC Exam Security Agreement In Effect 28.

29.

30.

31.

32.

33.

34.

35.

36.

37.

38.

• • No BIT. Suggest New K/A.

• • Clarify "vent valve". Does PORV, safety apply?

NAME / SAFETY FUNCTION:

K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

KA RO SRO IR ES-401, REV 10 T2G1 PWR EXAMINATION OUTLINE FORM ES-401-2 Containment Cooling SWS/cooling system 022K1.01 3.5 3.7 Containment Spray Ability to recognize abnormal indications for system operating parameters which are entry-level conditions for emergency and abnormal operating procedures.

026G2.4.4 4.5 4.7 Main and Reheat Steam Isolation of the MRSS 039A3.02 3.1 3.5 Main Feedwater 059A1.07 2.5 2.6 Main Feedwater Feed Pump speed, including normal control speed for ICS No FWP Speed control. Changed to A1.03 Automatic feedwater isolation of MFW 059K4.19 3.2 3.4 Auxiliary/Emergency Feedwater Diesel fuel oil 061K1.10 2.6 2.7 Auxiliary/Emergency Feedwater Relationship between AFW flow and RCS heat transfer 061K5.01 3.6 3.9 3.4 3.8

46.

062A1.01 AC Electrical Distribution

47.

063A1.01 DC Electrical Distribution Significance of D/G load limits Battery capacity as it is affected by discharge rate 2.5 3.3 DC Electrical Distribution Major breakers and control power fuses 063A4.01 2.8 3.1 Emergency Diesel Generator Air receivers 064K6.07 2.7 2.9 Page 2 of 3 9:35 AM 2/1/2016 PTN L-16-1 NRC Exam Security Agreement In Effect 39.

40.

41.

42.

43.

44.

45.

48.

49.

• • No ICS. Suggest New K/A.

• • Expand scope? DDSSFP fits. Yes, S/U FW pumps will work.

NAME / SAFETY FUNCTION:

K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

KA RO SRO IR ES-401, REV 10 T2G1 PWR EXAMINATION OUTLINE FORM ES-401-2 Process Radiation Monitoring Radioactive effluent releases 073K3.01 3.6 4.2 Process Radiation Monitoring Radiation intensity changes with source distance 073K5.02 2.5 3.1 Service Water Loss of SWS 076A2.01 3.5 3.7 Service Water Service water header pressure 076A2.02 2.7 3.1 Instrument Air Knowledge of the bases in Technical Specifications for limiting conditions for operations and safety limits.

078G2.2.25 3.2 4.2 Containment Changed to G2.2.44 Containment evacuation (including recognition of the alarm) 103A2.04 3.5 3.6 Page 3 of 3 9:35 AM 2/1/2016 PTN L-16-1 NRC Exam Security Agreement In Effect 50.

51.

52.

53.

54.

55.

• • RCAT question. Hard to write to LOD. Request ideas or New K/A. Changed to 039 MRSS K5.08

• • Same topic area with #54. Changed to 003A2.02

• • Relationship issue. Request New K/A.

NAME / SAFETY FUNCTION:

K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

KA RO SRO IR ES-401, REV 9 T2G2 PWR EXAMINATION OUTLINE FORM ES-401-2 Reactor Coolant Consequences of forced circulation loss 002K5.14 3.8 4.2 Pressurizer Level Control PZR level inputs to RPS 011K4.05 3.7 4.1 Rod Position Indication Control rod position indication on control room panels 014A1.02 3.2 3.6 In-core Temperature Monitor Sensors and detectors 017K6.01 2.7 3.0 Containment Purge Containment purge flow rate 029A4.01 2.5 2.5 Spent Fuel Pool Cooling Inadequate SDM 033A2.01 3.0 3.5 Steam Generator Knowledge symptom based EOP mitigation strategies.

035G2.4.6 3.7 4.7 Condenser Air Removal Main condenser 055K3.01 2.5 2.7 Liquid Radwaste Automatic isolation 068A3.02 3.6 3.6 Station Air IAS 079K1.01 3.0 3.1 Page 1 of 1 9:35 AM 2/1/2016 PTN L-16-1 NRC Exam Security Agreement In Effect 56.

57.

58.

59.

60.

61.

62.

63.

64.

65.

NAME / SAFETY FUNCTION:

K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

KA RO SRO IR ES-401, REV 10 T3 PWR EXAMINATION OUTLINE FORM ES-401-2 Conduct of operations Knowledge of procedures and limitations involved in core alterations G2.1.36 3.0 4.1 Conduct of operations Ability to identify and interpret diverse indications to validate the response of another indication G2.1.45 4.3 4.3 Conduct of operations Ability to coordinate personnel activities outside the control room.

G2.1.8 3.4 4.1 Equipment Control Knowledge of surveillance procedures.

G2.2.12 3.7 4.1 Equipment Control Ability to obtain and interpret station electrical and mechanical drawings G2.2.41 3.5 3.9 Radiation Control Knowledge of radiation monitoring systems G2.3.15 2.9 3.1 Radiation Control Ability to comply with radiation work permit requirements during normal or abnormal conditions G2.3.7 3.5 3.6 Emergency Procedures/Plans Knowledge of the lines of authority during implamentation of an emergency plan.

G2.4.37 3.0 4.1 Emergency Procedures/Plans Knowledge of the organization of the operating procedures network for normal, abnormal and emergency evolutions.

G2.4.5 3.7 4.3 75.

G2.4.8 G2.4.3 Emergency Procedures/Plans Knowledge of how abnormal operating procedures are used in conjunction with EOPs.

3.8 4.5 Page 1 of 1 9:36 AM 2/1/2016 PTN L-16-1 NRC Exam Security Agreement In Effect 66.

67.

68.

69.

70.

71.

72.

73.

74.

• • Doesn't match for RCO. Double Jeopardy with SRO #100. Request New K/A. Change to G2.4.3 Changed to G2.2.2

NAME / SAFETY FUNCTION:

K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

KA RO SRO IR ES-401, REV 10 SRO T1G1 PWR EXAMINATION OUTLINE FORM ES-401-2 Reactor Trip - Stabilization - Recovery /

1 If reactor should have tripped but has not done so, manually trip the reactor and carry out actions in ATWS EOP 007EA2.04 4.6 4.4 RCP Malfunctions / 4 Knowledge of the parameters and logic used to assess the status of safety functions 015AG2.4.21 4.0 4.6 Loss of Component Cooling Water / 8 The valve lineups necessary to restart the CCWS while bypassing the portion of the system causing the abnormal condition 026AA2.03 2.6 2.9 Loss of Nuclear Svc Water / 4 Knowledge of system set points, interlocks and automatic actions associated with EOP entry conditions.

062AG2.4.2 4.5 4.6 Loss of Instrument Air / 8 Knowledge of events related to system operations/status that must be reported to internal orginizations or outside agencies.

065AG2.4.30 2.7 4.1 LOCA Outside Containment / 3 Facility conditions and selection of appropriate procedures during abnormal and emergency operations.

WE04EA2.1 3.4 4.3 Page 1 of 1 9:36 AM 2/1/2016 PTN L-16-1 NRC Exam Security Agreement In Effect 76.

77.

78.

79.

80.

81.

• • RO only. Any ideas? Changed to EA2.02

• • RO only. Any ideas? Give example question

• • RO only. Any ideas? Give example question

• • Any ideas on how to write to this relationship? New concept CSF INVENTORY. Changed to 2.4.31 Knowledge of ARPs, indic, or response procedures.

NAME / SAFETY FUNCTION:

K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

KA RO SRO IR ES-401, REV 10 SRO T1G2 PWR EXAMINATION OUTLINE FORM ES-401-2 Accidental Gaseous Radwaste Rel. / 9 Knowledge of less than one hour technical specification action statements for systems.

Changed to 2.2.40 Apply TS 060AG2.2.39 3.9 4.5 ARM System Alarms / 7 Required actions if alarm channel is out of service 061AA2.06 3.2 4.1 Loss of CTMT Integrity / 5 Loss of containment integrity 069AA2.01 3.7 4.3 LOCA Cooldown - Depress. / 4 Knowledge of operational implications of EOP warnings, cautions and notes.

we03EG2.4.20 3.8 4.3 Page 1 of 1 9:36 AM 2/1/2016 PTN L-16-1 NRC Exam Security Agreement In Effect 82.

83.

84.

85.

• • RO only. Suggest different topic and system. New K/A.

NAME / SAFETY FUNCTION:

K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

KA RO SRO IR ES-401, REV 10 SRO T2G1 PWR EXAMINATION OUTLINE FORM ES-401-2 Chemical and Volume Control Ability to locate and operate components, including local controls.

004G2.1.30 4.4 4.0 Engineered Safety Features Actuation Loss of instrument bus 013A2.04 3.6 4.2 Auxiliary/Emergency Feedwater pump failure or improper operation 061A2.04 3.4 3.8 Emergency Diesel Generator Knowledge of low power / shutdown implications in accident (e.g. LOCA or loss of RHR) mitigation strategies.

064G2.4.9 3.8 4.2 Process Radiation Monitoring Detector failure 073A2.02 2.7 3.2 Page 1 of 1 9:36 AM 2/1/2016 PTN L-16-1 NRC Exam Security Agreement In Effect 86.

87.

88.

89.

90.

NAME / SAFETY FUNCTION:

K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

KA RO SRO IR ES-401, REV 10 SRO T2G2 PWR EXAMINATION OUTLINE FORM ES-401-2 Station blackout 3.8 4.0 Hydrogen Recombiner and Purge Control The H2 air concentration in excess of limit flame propagation or detonation with resulting equipment damage in containment 028A2.03 3.4 4.0 Condenser Air Removal Knowledge of RO tasks performed outside the main control room during an emergency and the resultant operational effects 4.2 4.1 Page 1 of 1 9:37 AM 2/1/2016 PTN L-16-1 NRC Exam Security Agreement In Effect 92.

91.

001A2.09 Control Rod Drive

• • Relationship issue. Ideas? Suggest expand topic. Changed to A2.17

• • Abandoned and taught with SACRGs after test is given. Expand to PAHMs time critical basis? Changed to 045A2.08

93.

055G2.4.34

• • RO only. Any ideas? Changed to 017G2.4.30

NAME / SAFETY FUNCTION:

K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

KA RO SRO IR ES-401, REV 10 SRO T3 PWR EXAMINATION OUTLINE FORM ES-401-2 Conduct of operations Knowledge of individual licensed operator responsibilities related to shift staffing, such as medical requirements, "no-solo" operation, maintenance of active license statur, 10CFR55 etc.

G2.1.4 3.3 3.8 Equipment Control Knowledge of maintenance work order requirements.

G2.2.19 2.3 3.4 Equipment Control Knowledge of the process used to track inoperable alarms G2.2.43 3.0 3.3 Radiation Control Knowledge of radiation or contamination hazards that may arise during normal, abnormal, or emergency conditions or activities G2.3.14 3.4 3.8 Radiation Control Ability to aprove release permits G2.3.6 2.0 3.8 Emergency Procedures/Plans Knowledge of facility protection requirements including fire brigade and portable fire fighting equipment usage.

G2.4.26 3.1 3.6 Emergency Procedures/Plans Knowledge of how abnormal operating procedures are used in conjunction with EOPs.

G2.4.8 3.8 4.5 Page 1 of 1 9:37 AM 2/1/2016 PTN L-16-1 NRC Exam Security Agreement In Effect 94.

95.

96.

97.

98.

99.

100.

• • Same topic area with #98 These are two different topics.

Changed to G2.1.36

L-16-1 NRC EXAM SECURE INFORMATION ES-401 Record of Rejected K/As ES-401-4 Tier /

Group Randomly Selected K/A Reason for Rejection 1 / 1 022 / AK1.04 No charging flow controller at PTN. Changed to AK1.03.

1 / 1 027 / AA1.05 No backup power supply at PTN. Changed to AA1.03.

1 / 1 056 / AK1.03 Double jeopardy with Q3. Changed to AK1.04.

1 / 2 003 / AK1.13 No ICS at PTN. Changed to AK1.02.

1 / 2 037 / AG2.4.41 SRO level. Changed to G2.4.20.

1 / 2 051 / AA1.04 No ICS at PTN. Changed to 067 AA1.06.

1 / 2 WE15 / EK3.3 No actions or controls manipulated at PTN. Changed to EK3.2.

2 / 1 006 / A4.03 No BIT at PTN. Changed to A4.08.

2 / 1 007 / A4.04 Limited test topic-minutia. Changed to A4.10.

2 / 1 059 / A1.07 No ICS at PTN. Changed to A1.03.

2 / 1 073 / K5.02 KA was not system friendly, was more of a GET/RWT question. Changed to 039 K5.08.

2 / 1 076 / A2.02 Double jeopardy with Q53. Changed to 003 A2.02.

2 / 1 078 / G2.2.25 SRO level. Changed to G2.2.44.

3 2.3.7 Rad worker practices at RCAT level. Changed to 2.2.2.

3 2.4.8 Double Jeopardy with Q100. Changed to 2.4.3.

1 / 1 007 / EA2.04 RO KA ONLY. Changed to EA2.02 to meet SRO criteria.

1 / 1 015 / AG2.4.21 SRO. No system to topic relationship for PTN. Changed to 2.4.31.

1 / 2 060 / AG2.2.39 RO only. Changed to 2.2.40.

2 / 2 001 / A2.09 No system to topic relationship for PTN. Changed to A2.17.

2 / 2 028 / A2.03 Post exam material (SACRGs). Changed to 045 A2.08.

2 / 2 055 / G2.4.34 RO only. Changed to 017G2.4.30.

3 2.3.6 Jeopardy with JPM. Changed to 2.1.36.

1/1 065 / AA2.05 Changed to AA2.06

L-16-1 NRC EXAM SECURE INFORMATION ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: 7j %>

344ateofExam: c/22/,.

Exam Level:

RO SRO V

Initial Item Description 1.

Questions and answers are technically accurate and appliceble to the facility.

b.

2.

a.

NRC K/As are referenced for all questions.

.4 b.

Facility learning ob(ectives are referenced as available.

V L9

?

3.

SRD questions are appropriate in accordance with Section D.2.d of ES-401

.-1 4

The sampling process was random and systematic (If more than 4 RD or 2 SRD questions were repeated from the last two NRC licensing exams, consult the NRRJNRD DL program 1,A,

-17 5.

Question duplication from the licensee screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate The audit exam was systematically and randomly developed, or the audit exam was completed before the license exam was started; or the examinations were developed independently; or the licensee certifies that there is no duplication; or other (explain) 6.

Bank use meets limits (no more than 75 percent from the Bank Modified New

,j/1 bank, at least 10 percent new, and the rest new or f V t

modified); enter the actual RD / SRO-only question IZ 6.2 distribution(s) at right 14.ç

çi..

7 Between 50 and 60 percent of the questions on the RD Memory C/A exam are written at the comprehension/ analysis level; the V L SRO exam may exceed 60 percent if the randomly selected K/As support the higher cognitive levels; enter the actual RD / SRD question distribution(s) at right.

i:hc /;.ç,cy7ç ic/s.c 8.

References/handouts provided do not give away answers or aid in the elimination of A

distractors 9.

Question content conforms to specific K/A statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are justified.

10.

Question psychometric quality and format meet the guidelines in ES Appendix B.

/

11.

The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet a.

b.

c.

d Author Facility Reviewer (*)

NRC Chief Examiner )#)

NRC Regional Supervisor Note.

The facility reviewers initials or signature are not applicable for NRC-developed examinations.

Independent NRC reviewer initials items in Column c; chief examiner concurrence required.

Bao ES-401 Turkey Point 2015-301 Pre-Submittal Written Examination Review Worksheet Form ES-401-9 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only 1

F 3

X N

E S

Add the word Both to the 3rd bullet. Do you need to identify that the AFW pump is in the AFW cage? Are all 3 pumps in the cage?

Procedure does not use terminology ASP transfer switches, should be T&TV Xfer Switches. D.2 plausibility? Are there any switches where taking it to LOCAL cause a start? R: Could confuse local start with local to cause a start.

2 H

3 X

N E

S A.1 Surge line has low plausibility. Why would PZR level increase on surge line break?

R: Change 3rd bullet to state indicated PZR level to make A.1 more plausible.

3 H

3 B

S 4

H 3

N E S Remove via ECCS or via RHR HXs.

5 H

3 X

N E

S Is at any time in your procedure does it allow 3 RCPs operating after securing an RCP? If not, A is not plausible.

Increase temp to 235 degrees and entered ONOP-41 to make A.1 plausible. Remove immediately.

6 H

3 M

S 7

F 3

M S

8 H

3 M

S Does this answer another question? Check for overlap.

Verified no overlap.

9 F

2 B

S 10 F

3 M

S Doesnt match KA. Licensee stated that this is the transition from tube leak to tube rupture. Agree, SAT.

11 H

2 N

S 12 H

3 N

S Double Jeopardy w/ Q26. Will change Q26 to a higher temp to send you to FR-C.1.

13 H

3 B

S 14 F

3 X

B S

ECCS is a de-energized to activate system. B & D not very plausible. R: Plant specific detail provided to explain plausibility.

15 F

3 N

S No procedure support for plausibility statement associated with high ICW flow. R: Licensee stated thermal barrier flow is an example.

Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only 16 H

3 N

E S

A.2 & C.2 plausibility? How does energizing the heaters maintain the PZR level band? R: Plant does not have direction to reduce plant power. Will look to change 2nd half.

Changed PZR htrs to letdown valves. SAT 17 H

3 M

S 18 F

2 B

E S

Change SG level to be for Accident conditions to increase LOD?

R: 20% and 185 degrees F.

Changed made as noted. SAT 19 H

3 N

E S

You state in the 2nd question the given Tavg-Tref mismatch. It appears that this is a leading statement and not needed.

R: Agree and switch question 1 & 2. SAT 20 H

3 N

S 21 H

3 N

S Not sure if enough info is provided to ascertain a dilution is occurring. Isnt there an associated dilution alarm? R: Yes, based on being in Emergency Boration procedure. SAT 22 H

3 N

E S

Bubbles are stated in ONOP-3.03. Reword to remove 3rd bullet and include in the question. Still needs work. New question gives away the answer. Change to ask what causes a containment isolation alarm and which one causes a containment evacuation alarm.

Question revised. Contaminated water spill not plausible. Change to local CAM alarm goes off. Agreed to change to cavity water. Verified changes made to add cavity water to the description of the water spill to increase this distractors plausibility.

23 F

3 B

S 24 F

3 M

E S

Remove ready for further response. Removed as requested. SAT

Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only 25P F

2 X

X Y

N B

M U

S K/A WE03EK2.2

1. Q=K/A, but weak; the first part Q is GFES-level knowledge.

2. First and third bullets in the Given information are unnecessary and can be deleted without affecting the question. If the crew is in ES-1.2 then it is a SBLOCA by definition; RCS pressure value is not needed and if all HHSI pumps are running in ES-1.2 and the crew can stop the first SI pump, the applicant should know an approximate RCS pressure value.

3. Why would only one RCP be running? Is this information necessary for the Q?

4. Distractors A(2) and C(2) are non-plausible. We are taught in the first part Q that stopping a HHSI pump will result in RCS temperature rising (bad result from a subcooling point of view) or RCS pressure lowering (also a bad result from a subcooling point of view), so why would an applicant think that we would need less subcooling, not more, to stop the second (another) HHSI pump?

Q as submitted is U due to multiple non plausible distractors. Also, first part Q is GFES level and may not be suitable for the site-specific exam.

New question. SAT.

26 H

3 N

E S Overlaps w/ Q12. Change to make red path FR-C.1 27 F

3 N

E S

Only need to know 1st half to get it correct. Rewrite to make A&B same source and an unexpected one. Question was revised to remove the 2nd half of the question but failed to remove it from the answer choices. Still the same issue exist.

Revised to include other expected sources. SAT.

28 F

3 N

S 29 H

3 N

S 30 F

3 N

S 31 F

3 N

E S Do we need the word current? Leading word. Removed 32 H

3 N

S 33 H

3 B

S 34 F

3 N

S

Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only 35 F

3 N

E S Add word indicates to 2nd bullet.

36 H

3 N

S 37 H

3 N

S 38 F

3 N

S 39 F

3 N

E S Separate each column and change to D to SI Signal - D 40 F

3 N

S 41 H

3 N

U S

Only need to know MSIL criteria to get correct answer and therefore does not meet the KA criteria.

Question revised to separate portions of the MSIL signal in a 2X2 format. SAT 42 F

3 N

S 43 F

3 N

E S

Change question to get rid of Rx Trip 2/ Low Tavg to prevent overlap w/ Q#40. Change 1st question to A(n)

MSIL signal _____ with choices being will or will NOT cause an AFW actuation.

REF update logic Changes made as noted above.

44P F

3 N

E S Choices are for Unit 3 but question asks about Unit 4.

45 H

3 B

E S C1 & D1 not plausible. Change to lower and stabilize or Increase initially than lower.

46 H

3 N

S 47 F

3 M

U S 2nd question answers the 1st question. Fix by asking about vital disc amps. Changes made as noted. SAT

Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only 48P H

2 X

X X

Y N

B M

E S

K/A 063A4.01

1. Q=K/A, Q is on RO level.

2. Parallelism with distractors C and D: one says NOT function, and the other says NOT open, please pick one version for both.

3. Could be argued that B is a correct answer because both parts are logically true, need to tighten the stem to ensure the second part Q is specifically giving the reason or cause for the initial response of the breaker.

4. Distractor C is non plausible due to the inter-relationships between distractors as follows: the question stem states that it is true that you have lost electrical power (voltage) to the breaker, so why would anyone believe that the undervoltage function of the breaker would not work, given the undervoltage condition?

Q as submitted would be technically rated an E, however it may need extensive revision based upon the distractor inter-relationships as described above.

Overlap w/Q#9. Changed Q#9 (SAT now) 49 H

3 M

S 50 F

3 N

U S

Doesnt meet the KA. Can answer for high alarm not PRM failure. Answer does not agree with answer given in distractor. Changes to the question now match the KA.

51 H

3 N

S 52 H

3 M

E S

Change C.1 to Fast Load Reduction and the ARP to Fast Load Reduction procedure. Change D.1 to Fast Load Reduction. Revised as noted. SAT 53 H

3 N

S 54 H

3 N

S 55 F

3 N

S 56 H

3 N

E S B not plausible. Change to just voltage. Revised as noted.

SAT 57 H

3 N

E S

Checking for operationally validity.

Confirmed via simulator response.

Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only 58 H

3 N

S 59 F

3 N

S 60 F

3 M

E S Change to DCS ONLY or DCS & VPB. Revised as noted.

SAT 61 H

3 N

S Distractor B states you are in a short term TS, clarify this distractor plausibility. Completed SAT.

62 H

3 M

E S

CAPS only 63 H

3 M

E Why not use HG Vacuum as read in the MCR? Yes, add On DCS, Revised as noted. SAT 64 F

3 N

E S

Compare to Q#50. Last bullet not needed. Verify question 50 changed to eliminate overlap with this question. Verified no overlap between the two.

65 H

3 N

E S Distractor D does not have valve # like other choices.

Revised to include valve #. SAT 66 F

3 N

E S

Add, During Core Alterations, at a minimum Delete Core Alts from the end. C2 & D2 should be SRMs, not Gamma Metrics. Revised as indicated with the exception of gamma metrics. Site confirmed this part is correct.

67 H

3 M

S 68 F

3 N

E S

Possible overlap w/ JPM. Minutia? Why not use CR Evacuation?

REF Update New question written that meets above criteria. SAT 69 H

3 N

S 70 H

3 N

E S KA is an AND. Question only uses Mechanical print. New question uses both prints. SAT

Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only 71 F

3 B

U S

Add HIGH to 3rd bullet at the end of the sentence: in HIGH alarm.

This question overlaps with a scenario event. B& C are incorrect and are performed in a sim scenario.

Maybe key switch. This was in scenario 5. This is a spare scenario and should not be needed. Delete event if not needed.

72 F

3 N

U S

Overlaps with SU scenario. Maybe start above POAH.

Feed bypasses / station service. New question still overlaps with scenario. New question written. No longer overlaps with any scenarios.

73 F

3 M

E S

2nd question is SRO Only. Revise 2nd question to be at the RO level.

If SM not present the RO ____ be required to perform the emergency classification. Revised as noted above. SAT 74 F

3 M

S 75 F

2 X

X Y

N B

U E

S K/A G2.4.3

1. Q=K/A on the second part Q only, Q is RO-level but arguable.

2. MODE is not given in the stem, and would be needed to correctly answer the Q given the intent. First part Q statement is worded awkwardly (saying that a TS LCO makes something a required control board instrument?)

3. First part Q is asking minutia in my opinion, other Chief Examiners may disagree. Argument is as follows: none of the ACTION statements in TS 3.3.3.3 require one hour actions or less, and fundamentally the Q is requiring the applicant to recall the full Table 3.3-5 information from memory. Because none of the ACTION statements are one hour or less, a reference would be required, or it would be SRO-only to know specific information from the Bases.

Q as submitted is U due to minutia (requiring applicant to know TS Table 3.3-5 from memory with no reference).

Change relied upon to available?

Revised as noted. SAT

Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only 76 H

3 N

E S

Condition of Caution statement that the correct answer is based upon is not met. The reactor is not subcritical at this point. No correct answer given. Still need to change 2nd question to say the reactor is subcritical. Change to say Subsequently, the reactor is subcritical.

77 H

3 X

N E

S Stem states in Mode 4. Two of the choices are for Hot Standby procedure usage. Need to change stem to be in Mode 3. Easy fix so therefore column 7 marked as Enhancement.

Revised as noted. SAT 78 H

3 X

N E

S D.3 plausibility statement for Part 2 is incorrect. This is not an action in the ONOP. No isolation steps in this procedure.

Revised question selection to use ONOP-41.3 vs. ONOP-46.4. SAT 79 F

1 X

X M

U S

Both parts are RO questions; therefore, not SRO only. Rx trip criteria is RO knowledge. D.2 Turbine Brg Temp referenced. There are no temperatures in ONOP-011.

Revised during prep week. SAT 80 F

2 X

N E

S NRCOC not used in the procedure, spell out Ops Center. Is 4 hr.

selection for distractor D plausible w/o a reference? If no, need to increase difficulty of question if reference given, otherwise this is a direct lookup. Made editorial change. Question does not require reference to respond correctly per OPS mgmt.

81 H

3 X

M E

S Question asked for Unit 4 response. Several Unit 3 EOP procedures given as reference. C.2 not plausible, if you choose to go to ECA-1.1, the only way out is to return to the procedure if effect prior to entry which would be ECA-1.2. This is not given as a choice. Revised question to include above choice as choice D.

82 H

3 N

S 83 H

3 N

E S Incorrect TS Table given. CHRRMS is given in Table 3.3-5 not 3.3.-

4. Remove commas from C & D, not needed. Revised. SAT 84 H

3 N

S U S Not SRO. 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> TS call is RO knowledge. Low LOD. Question changed to ask for different LCO that is not 1 hr and therefore not RO knowledge.

85 H

3 N

E S

Possible overlap with Q81. Asked for licensee to check during validation to ask if applicant used knowledge from Q81 for this question? Added last bullet to lock down the timeline.

86 F

3 N

E S Licensee to provide procedure source that states locally implies from the control room. Licensee verified use of the word locally.

87 H

3 N

E S Is the SU Xfrmr INOP or the EDG? Licensee to verify. Verified

Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only 88 H

3 X

N E

S Change 4th bullet to 5% vs. Off-scale low to increase plausibility of other distractor choices. Also, D distractor states verify the event in progress, if you are in a LOCA as stated in the question, why would you enter this procedure? Distractor D plausibility is for FR-H.1 not for E-1. Needs correction. Revised as noted.

CET temp increase added to include procedure change that became effective before the procedure freeze occurred.

89 H

3 N

E S

U S

Question stem gives a 2 hr. restoration. No 2 hr. designation in the reference provided. Need to look to have a time that could be misapplied using the reference provided. Licensee provided reasonable logic for misapplication.

Follow-up review. The core head is off in Mode 4 so it is not plausible to use feed pump to establish secondary heat sink. No NC flow would exist to provide for core cooling. Plausibility analysis statement is incorrect. It states that the procedure allows this. This is an incorrect statement.

Question stem changed to mode 5 to allow plausibility of bleed and feed as an option and allow plausibility of B2 & D2.

90 F

3 X

B E

S A.2, B.2 distractor is not provided as an option to pick incorrectly in the reference. Need reference provided (handout) that includes the incorrect answer. Reference added. SAT 91 H

3 X

N E

S E

S Isnt a question reference required to answer this question? Change from 12 and 4 hrs as choices to 5 and 4 hrs and add a reference since the ST allows for a 1 hr thermal soak after rod motion. The answer will still be 4 hrs. No rod motion has occurred. Changes made. SAT Follow-up review. How would you know the rod is mechanically bound? The B plausibility statement states this would be a required shutdown. Source not stated. But if true, why would you be asking the 2nd question? Not relevant if you need to shutdown. Remove mechanically bound portion to remove the questionable part?

Mechanically bound removed as a bullet and therefore no implication of reactor shutdown is implied.

92 F

3 N

E S

Supporting reference not provided for answer D.2. Licensee needs to provide this information. Reference provided.

NRCOC is not required to be notified and is not plausible. Possibly change to NRC resident notification.

93 H

3 N

E S Answer given A does not match correct answer C in the plausibility statement. Also, the highlighted answer per the key is marked as an ALERT. The correct answer is a SAE. All corrections made. SAT 94 H

3 B

S

Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only 95 F

3 N

S 96 F

3 N

S Questioned plausibility of distractor C. Data provided by licensee to indicate question choice has been chosen in the past due to confusion by operators.

97 F

2 X

X Y

N Y

N U

U U

S K/A G 2.3.14

1. Q=K/A, Q is on SRO-only level.

2. Cues: second part Q statement of sampling frequency must be increased is teaching in the Q statement.

3. Minutia concern: Second part Q is asking actions greater than 2 hours2.314815e-5 days <br />5.555556e-4 hours <br />3.306878e-6 weeks <br />7.61e-7 months <br /> without a reference. I do not know of any K/A statement or other requirement that says SRO applicants must know TS action statements >1 hrs from memory.

Q as submitted is U due to minutia concerns (asking >1 hr ACTION statement/requirements without a reference provided).

7/15/16 New question submitted. Still UNSAT. Does not meet KA.

New question written but does not meet SRO Only criteria. Add SRO piece such as EAL or TS basis.

2nd half question changed to ask SRO related question. SAT.

98 H

2 Y

Y B

S K/A G 2.1.36

1. Q=K/A, Q is on SRO only level

2. Q appears S at this time.

99 F

3 N

E S

Originally thought A train was not very plausible as all plant use train B as the safety train. Licensee stated that there are train A items for fire zone. Asked licensee to provide and possibly change question to this with a reference provided.

100 F

3 N

S

Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1.

Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2.

Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3.

Check the appropriate box if a psychometric flaw is identified:

The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

The answer choices are a collection of unrelated true/false statements.

The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4.

Check the appropriate box if a job content error is identified:

The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirements.

5.

Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).

6.

Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7.

Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8.

At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).

ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Facility: /tjcfçy Po,jy Date of Exam: %,xam Level:

RD X SRO Item Description Initials 1.

Clean answer sheets copied before grading

,1/

2.

Answer key changes and question deletions justified and documented y

3.

Applicants scores checked for addition errors (reviewers spot check> 25% of examinations)

/l )J/

4.

Grading for all borderline cases (80 +/-2% overall and 70 or 80, as applicable, +/-4% on the SRO-only) reviewed in detail y

1//4 j(

5.

All other failing examinations checked to ensure that grades are justified

7

.4/4; 44L 6.

Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of il/A questions missed by half or more of the applicants 111 1

Printed Name/Signature Date a.

Grader

/H,46t w%

b.

Facility Reviewer(*)

/7 f7 c.

NRC Chief Examiner (*)

L.

U.

NRC Supervisor (*)

SEQkJ 3.

(*)

The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.