Text

Exam Administrative Items 2C - Delay Release 2 Yrs
	ML17191B483
Person / Time
Site:	Turkey Point
Issue date:	07/10/2017
From:	; NRC/RGN-II
To:	;
References
	Download: ML17191B483 (52)
	v • d • e

ES-201 Examination Preparation Checklist Form ES-201-1 2016-301 Turkey Point Facility: ___________________________________ 8/22/16 Date of Examination: __________

Developed by: Written: Facility X NRC // Operating Facility X NRC Chief Target Task Description (Reference) Examiners Date*

Initials

-180 1. Examination administration date confirmed (C.1.a; C.2.a and b) PGC

-150 2. NRC examiners and facility contact assigned (C.1.d; C.2.e) PGC

-150 3. Facility contact briefed on security and other requirements (C.2.c) PGC

-150 4. Corporate notification letter sent (C.2.d) PGC

[-120] 5. Reference material due (C.1.e; C.3.c; Attachment 3) PGC

{-90} 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-5, ES-D-1, ES-401-1/2, ES-401N-1/2, ES-401-3, ES-401N-3, PGC ES-401-4, and ES-401N-4, as applicable (C.1.e and f; C.3.d)

{-85} 7. Examination outline(s) reviewed by NRC and feedback provided to facility licensee (C.2.h; C.3.e)

PGC

{-60} 8. Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6, ES-401N-6, and any Form ES-201-2, ES-201-3, PGC ES-301-1, or ES-301-2 updates), and reference materials due (C.1.e, f, g and h; C.3.d)

-45 9. Written exam and operating test reviews completed. (C.3.f) PGC

-30 10. Preliminary license applications (NRC Form 398's) due (C.1.l; C.2.g; ES-202) PGC

-21 11. Examination approved by NRC supervisor for facility licensee review (C.2.h; C.3.f) PGC

-21 12. Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g) PGC

-14 13. Final license applications due and Form ES-201-4 prepared (C.1.l; C.2.i; ES-202) PGC

-14 14. Written examinations and operating tests approved by NRC supervisor (C.2.i; C.3.h) PGC

-7 15. Facility licensee management queried regarding the licensees views on the PGC examination. (C.2 j)

-7 16. Final applications reviewed; 1 or 2 (if >10) applications audited to confirm PGC qualifications / eligibility; and examination approval and waiver letters sent (C.2.i; Attachment 5; ES-202, C.2.e; ES-204)

-7 17. Proctoring/written exam administration guidelines reviewed with facility licensee PGC (C.3.k)

-7 18. Approved scenarios, job performance measures, and questions distributed to NRC PGC examiners (C.3.i)

Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.

[Applies only] {Does not apply} to examinations prepared by the NRC.

ES-201, Page 25 of 28

L-16-1 NRC EXAM SECURE INFORMATION ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility. Date of Examination.

Initials Item Task Description

1. a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401 or ES-401 N.

R b. Assess whether the outline was systematically and randomly prepared in accordance with Section D.1 of ES-401 or ES-401N and whether all K/A categories are appropriately sampled. 1j L

c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics. _.

N

d. Assess whether the justifications for deselected or rejected K/A statements are appropriate. ,fl

2. a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, and major S transients. V M b. Assess whether there are enough scenario sets (and spares) to test the projected number and U mix of applicants in accordance with the expected crew composition and rotation schedule L without compromising exam integrity, and ensure that each applicant can be tested using at least one new or significantly modified scenario, that no scenarios are duplicated from the fV f3(

A T applicants audit test(s), and that scenarios will not be repeated on subsequent days.

c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative and quantitative criteria specified on Form ES-301-4 and described in Appendix D.

3. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:

(1) the outline(s) contain(s) the required number of control room and in-plant tasks distributed W among the safety functions as specified on the form -.0 A (2) task repetition from the last two NRC examinations is vithin the limits specified on the form ir L (3) no tasks are duplicated from the applicants audit test(s) V V V K (4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on T the form.

H R b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:

(1) the tasks are distributed among the topics as specified on the form IA jjit.

U (2) at least one task is new or significantly modified VV G (3) no more than one task is repeated from the last two NRC licensing examinations H

c. Determine if there are enough different outlines to test the projected number and mix of -

applicants and ensure that no items are duplicated on subsequent days.

4. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the (,

appropriate exam sections. 1W

b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.

c. Ensure that K/A importance ratings (except for plant-specific priorities) are at least 2.5.

E R d. Check for duplication and overlap among exam sections.

L e. Check the entire exam for balance of coverage. ..r.

f.__Assess_whether the_exam_fits_the_appropriate_job_level_(RD_or_SRO).

a. Author

b. Facility Reviewer (*) EP)J UO)J\

c.

d.

NRC Chief Examiner NRC Supervisor

(#)

cflc4 rtcC...-\/

/ 4iL_

Note: # Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

Not applicable for NRC-prepared examination outlines.

1.

1. Signed on page 2

2.

2. Signed on page 3

1.

1. Signed on page 4

L-16-1 NRC EXAM SECURE INFORMATION ES-301 Administrative Topics Outline Form ES-301-1 Facility: Turkey Point Units 3 & 4 Date of Examination: 08/22/2016 Examination Level: RO SRO Operating Test Number: 2016-301 Administrative Topic Type Describe activity to be performed (see Note) Code*

Calculate a Manual Makeup to the VCT Conduct of Operations R, M 2.1.25 (3.9): Ability to interpret reference materials, such as graphs, curves, tables, etc.

Determine Heatup of the RCS Conduct of Operations R, D 2.1.20 (4.6): Ability to interpret and execute procedure steps.

Review an ECO for the 3A Heater Drain Pump Equipment Control R, N 2.2.13 (4.1): Knowledge of tagging and clearance procedures.

Evaluate Conditions for Restart of Refueling Pre-shuffle in the Spent Fuel Pit Radiation Control R, D, P 2.3.12 (3.2): Knowledge of radiological safety principles pertaining to licensed operator duties, such as containment entry requirements, fuel handling responsibilities, access to locked high-radiation areas, aligning filters, etc.

NOT SELECTED FOR RO EXAM Emergency Procedures/Plan NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.

Type Codes & Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank ( 3 for ROs; 4 for SROs & RO retakes)

(N)ew or (M)odified from bank ( 1)

(P)revious 2 exams ( 1; randomly selected)

L-16-1 NRC EXAM SECURE INFORMATION ES-301-1 RO Page 1 of 2

L-16-1 NRC EXAM SECURE INFORMATION JPM

SUMMARY

STATEMENTS A.1.a Calculate a Manual Makeup to the VCT - Unit is at 100% power, with a VCT level of 20%. Examinee is given a desired VCT level and boric acid flow rate and is directed to calculate the primary water flow rate, boric acid and primary water volumes, and controller potentiometer settings for the manual makeup. This is a modified bank JPM.

A.1.b Determine Heatup of the RCS - Unit has undergone a heatup to 380°F and relevant data is provided on Attachment 2, Heatup Data Sheet, of 3-OSP-041.7, Reactor Coolant System Heatup and Cooldown Temperature Verification. Examinee must complete the procedure and record any discrepancies and subsequent procedural actions that apply. This is a bank JPM.

A.2 Review an ECO for the 3A Heater Drain Pump - Power is reduced to 35%, to support the replacement of a damaged mechanical seal package on the 3A HDP. Examinee is directed to review the prepared ECO for completeness and accuracy (with eSOMS NOT available) and identify any items that do not meet plant conditions or the requirements of OP-AA-101-1000, Clearance and Tagging. This is a new JPM.

A.3 Evaluate Conditions for Restart of Refueling Pre-shuffle in the Spent Fuel Pit - Refueling pre-shuffle activities in the SFP were interrupted and management desires to resume the shuffle. Examinee is provided a list of plant conditions and inoperable equipment and must determine whether recommencement may occur in accordance with 3-NOP-040.03, Fuel Handling and Insert Shuffle in the Spent Fuel Pit. Examinee will use Attachment 2, Restart Minimum Equipment Checklist, and must identify four items that preclude recommencement. This is a bank JPM, previously used on the 2013 NRC exam.

A.4 NOT SELECTED FOR RO EXAM L-16-1 NRC EXAM SECURE INFORMATION ES-301-1 RO Page 2 of 2

L-16-1 NRC EXAM SECURE INFORMATION ES-301 Administrative Topics Outline Form ES-301-1 Facility: Turkey Point Units 3 & 4 Date of Examination: 08/22/2016 Examination Level: RO SRO Operating Test Number: 2016-301 Administrative Topic Type Describe activity to be performed (see Note) Code*

Calculate a Manual Makeup to the VCT Conduct of Operations R, M 2.1.25 (4.2): Ability to interpret reference materials, such as graphs, curves, tables, etc.

Determine Heatup of the RCS Conduct of Operations R, D 2.1.20 (4.6): Ability to interpret and execute procedure steps.

Evaluate TS Conditions While Performing a Valve Operability Test Equipment Control R, D 2.2.40 (4.7): Ability to apply Technical Specifications for a system.

Authorize Emergency Exposure Limits Radiation Control R, D 2.3.4 (3.7): Knowledge of radiation exposure limits under normal or emergency conditions.

Classify Event and Complete SNF Emergency Procedures/Plan R, D 2.4.41 (4.6): Knowledge of the emergency action level thresholds and classifications.

NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.

Type Codes & Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank ( 3 for ROs; 4 for SROs & RO retakes)

(N)ew or (M)odified from bank ( 1)

(P)revious 2 exams ( 1; randomly selected)

L-16-1 NRC EXAM SECURE INFORMATION ES-301-1 SRO Page 1 of 2

L-16-1 NRC EXAM SECURE INFORMATION JPM

SUMMARY

STATEMENTS A.1.a Calculate a Manual Makeup to the VCT - Unit is at 100% power, with a VCT level of 20%. Examinee is given a desired VCT level and boric acid flow rate and is directed to calculate the primary water flow rate, boric acid and primary water volumes, and controller potentiometer settings for the manual makeup. This is a modified bank JPM.

A.1.b Determine Heatup of the RCS - Unit has undergone a heatup to 380°F and relevant data is provided on Attachment 2, Heatup Data Sheet, of 3-OSP-041.7, Reactor Coolant System Heatup and Cooldown Temperature Verification. Examinee must complete the procedure and record any discrepancies, subsequent procedural actions, and/or Technical Specification actions that apply. This is a bank JPM.

A.2 Evaluate TS Conditions While Performing a Valve Operability Test - Unit is in Mode 3 and 4-OSP-047.1E, Letdown Line Isolation Valve Test, is in progress. Given Control Room indications, examinee must determine if any actions are required with regard to ESFAS instrumentation, accident monitoring instrumentation, or containment isolation valves. This is a bank JPM.

A.3 Authorize Emergency Exposure Limits - A General Emergency has been declared and an Owner Controlled Area evacuation is in progress. A rescue of an unconscious person in a high-dose area is to be performed. Examinee must select two individuals from a list of available rescuers and determine whether they should be issued potassium iodide. This is a bank JPM.

A.4 Classify Event and Complete SNF - Unit is in Mode 5, when it experiences a loss of all AC power. Plant and meteorological conditions are provided and examinee must classify the event using 0-EPIP-20101, Duties of Emergency Coordinator, and issue protective action recommendations using 0-EPIP-20134, Offsite Notifications and Protective Action Recommendations. This is a bank JPM.

L-16-1 NRC EXAM SECURE INFORMATION ES-301-1 SRO Page 2 of 2

L-16-1 NRC EXAM SECURE INFORMATION ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 Facility: Turkey Point Units 3 & 4 Date of Examination: 08/22/2016 Exam Level: RO SRO-I SRO-U Operating Test Number: 2016-301 Control Room Systems: 8 for RO; 7 for SRO-I; 2 or 3 for SRO-U Safety System / JPM Title Type Code* Function

a. 001 Control Rod Drive System (A4.14, 3.0) / Respond to Control Bank D A, D, P, S 1 Demanded Past 230 Steps

b. 004 Chemical and Volume Control System (A4.06, 3.6) / Place Excess A, D, S 2 Letdown In Service

c. EPE 038 Steam Generator Tube Rupture (EA1.04, 4.3) / Establish Auxiliary A, N, S 3 Pressurizer Spray per 3-EOP-E-3

d. APE 025 Residual Heat Removal System (AA1.03, 3.4) / Respond to a Loss L, D, P, S 4P of RHR

e. 026 Containment Spray System (A3.01, 4.3) / Manually Initiate Containment D, EN, S 5 Spray

f. EPE 055 Station Blackout (EA1.07, 4.3) / Restore Power to the 3A 4kV Bus A, N, S 6

g. 015 Nuclear Instrumentation System (A4.02, 3.9) / Place N-3-42 Power D, S 7 Range Drawer in Service

h. APE 068 Control Room Evacuation (AA1.23, 4.3) / Respond to Control D, S 8 Room Evacuation Condition - Unit 3 RO In-Plant Systems (3 for RO); (3 for SRO-I); (3 or 2 for SRO-U)

i. EPE 029 Anticipated Transient Without Scram (EA1.12, 4.1) / Locally Trip D, E 1 the Reactor and Turbine

j. APE 054 Loss of Main Feedwater (AA1.01, 4.5) / Control Steam Generator D, E 4S Level Locally with Auxiliary Feedwater Control Valve

k. APE 026 Loss of Component Cooling Water (AA1.03, 3.6) / Align D, E, R 8 Emergency Service Water to the Charging Pumps

All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all five SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

Type Codes Criteria for RO / SRO-I / SRO-U (A)lternate path 4-6 / 4-6 / 2-3 (C)ontrol room (D)irect from bank 9/8/4 (E)mergency or abnormal in-plant 1/1/1 (EN)gineered safety feature 1 / 1 / 1 (control room system)

(L)ow-Power / Shutdown 1/1/1 (N)ew or (M)odified from bank including 1(A) 2/2/1 (P)revious 2 exams 3 / 3 / 2 (randomly selected)

(R)CA 1/1/1 (S)imulator L-16-1 NRC EXAM SECURE INFORMATION ES-301-2 RO Page 1 of 2

L-16-1 NRC EXAM SECURE INFORMATION JPM

SUMMARY

STATEMENTS

a. Respond to Control Bank D Demanded Past 230 Steps - Examinee enters 3-ONOP-028, Reactor Control System Malfunction, to restore the Rod Control System to normal configuration with Bank D at 229 steps withdrawn. When examinee places the Rod Control Selector Switch in automatic, rods begin inserting at fast speed, and examinee must respond by placing the Rod Control Selector Switch in manual. This is a bank alternate-path JPM, previously used on the 2013 NRC exam.

b. Place Excess Letdown In Service - Examinee uses 3-OP-047, CVCS Charging and Letdown, to place excess letdown in service. When CV-3-387 (Excess Letdown Isolation Valve) is opened, examinee must recognize that RV-3-304 has failed open and provides a direct path to the containment sump. Examinee must either close CV-3-387 or transition to 3-ONOP-041.3, Excessive Reactor Coolant System Leakage, to start a charging pump and maintain pressurizer level.

This is a bank alternate-path JPM.

c. Establish Auxiliary Pressurizer Spray per 3-EOP-E The unit has experienced a SGTR. The ruptured SG has been isolated, the RCS has been cooled down, and the examinee is directed to depressurize the RCS to minimize break flow and refill the pressurizer. Examinee must recognize that the PORVs can NOT be opened and, alternatively, will establish auxiliary pressurizer spray using Attachment 4 of 3-EOP-E-3, Steam Generator Tube Rupture. This is a new alternate-path JPM.

d. Respond to a Loss of RHR - The unit is on RHR cooling, when MOV-3-750 (RHR Pump Suction from RCS) inadvertently closes and the running RHR pumps shaft shears. To mitigate, examinee enters 3-ONOP-050 (Loss of RHR) and re-opens the suction valve, secures the damaged pump, realigns RHR, starts the standby pump, and reinitiates cooling flow. This is a bank shutdown JPM, previously used on the 2015 NRC exam.

e. Manually Initiate Containment Spray - The unit has tripped and safety injection/phase-A containment isolation have actuated. Examinee is performing prompt action verifications in Attachment 3 of 3-EOP-E-0 (Reactor Trip or Safety Injection) and must recognize that containment spray/phase-B containment isolation have NOT actuated; examinee will manually initiate at least one train of containment spray, actuate a phase-B containment isolation and manually close phase-B valves that fail to reposition, secure RCPs, and secure the Unit 4 HHSI pumps. This is a bank engineered-safeguards JPM.

f. Restore Power to the 3A 4kV Bus - The unit has experienced a loss of all AC power. The 3A EDG did NOT start. The 3B EDG started but did not energize the 3B 4kv Bus. The Examinee is directed to restore power with a priority on the 3B EDG. The Examinee will discover the 3B 4KV Bus is locked out will restore power to the 3A 4kV Bus via the SBO tie line. This is a new alternate-path and time critical JPM.

g. Place N-3-42 Power Range Drawer in Service - The unit is at 100% power and examinee is directed to place the N-3-42 power range drawer in service using 3-OSP-059.4, Power Range Nuclear Instrumentation Analog Channel Operational Test. This is a bank JPM.

h. Respond to Control Room Evacuation Condition (Unit 3 RO) - Due to a fire, examinee responds as the unit RO per Attachment 14 of 0-ONOP-105, Control Room Evacuation, and trips the reactor/ turbine, closes the MSIVs, trips the main feedwater pumps, closes the atmospheric steam dumps, closes the PORVs/block valves, and trips the RCPs.

This is a time-critical bank JPM.

i. Locally Trip the Reactor and Turbine - The unit has experienced an ATWS and the examinee is directed to trip the reactor and turbine locally. Examinee will proceed to the 3B MCC Room, open all reactor trip, bypass, and MG set breakers, and then trip the turbine at the turbines front standard. This is a bank JPM.

j. Control Steam Generator Level Locally with Auxiliary Feedwater Control Valve - The unit has tripped. AFW flow is required to the 3C SG. Examinee is directed to investigate and locally restore AFW flow to the 3C SG per 3-ONOP-075, Auxiliary Feedwater System Malfunction. Examinee will discover that train-2 flow to the 3C SG is NOT available and train-1 flow control valve will NOT open manually. Examinee will transition to Attachment 3 of the ONOP to locally manipulate valves and restore feedwater flow to the 3C SG. This is a bank emergency JPM.

k. Align Emergency Service Water to the Charging Pumps - Level can NOT be maintained in the CCW Surge Tank and a loss of cooling to the charging pumps is imminent. Examinee will use Attachment 1 of 3-ONOP-030, Component Cooling Water Malfunction, to locally establish emergency cooling water to these pumps. This is a bank RCA/emergency JPM.

L-16-1 NRC EXAM SECURE INFORMATION ES-301-2 RO Page 2 of 2

L-16-1 NRC EXAM SECURE INFORMATION ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 Facility: Turkey Point Units 3 & 4 Date of Examination: 08/22/2016 Exam Level: RO SRO-I SRO-U Operating Test Number: 2016-301 Control Room Systems: 8 for RO; 7 for SRO-I; 2 or 3 for SRO-U Safety System / JPM Title Type Code* Function

a. 001 Control Rod Drive System (A4.14, 3.4) / Respond to Control Bank D A, D, P, S 1 Demanded Past 230 Steps

b. 004 Chemical and Volume Control System (A4.06, 3.1) / Place Excess A, D, S 2 Letdown In Service

c. EPE 038 Steam Generator Tube Rupture (EA1.04, 4.1) / Establish Auxiliary A, N, S 3 Pressurizer Spray per 3-EOP-E-3

d. APE 025 Residual Heat Removal System (AA1.03, 3.3) / Respond to a Loss L, D, P, S 4P of RHR

e. 026 Containment Spray System (A3.01, 4.5) / Manually Initiate Containment D, EN, S 5 Spray

f. EPE 055 Station Blackout (EA1.07, 4.5) / Restore Power to the 3A 4kV Bus A, N, S 6

g. 015 Nuclear Instrumentation System (A4.02, 3.9) / Place N-3-42 Power D, S 7 Range Drawer in Service

h. NOT SELECTED FOR SRO EXAM In-Plant Systems (3 for RO); (3 for SRO-I); (3 or 2 for SRO-U)

i. EPE 029 Anticipated Transient Without Scram (EA1.12, 4.0) / Locally Trip the D, E 1 Reactor and Turbine

j. APE 054 Loss of Main Feedwater (AA1.01, 4.4) / Control Steam Generator D, E 4S Level Locally with Auxiliary Feedwater Control Valve

k. APE 026 Loss of Component Cooling Water (AA1.03, 3.6) / Align D, E, R 8 Emergency Service Water to the Charging Pumps

All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all five SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

Type Codes Criteria for RO / SRO-I / SRO-U (A)lternate path 4-6 / 4-6 / 2-3 (C)ontrol room (D)irect from bank 9/8/4 (E)mergency or abnormal in-plant 1/1/1 (EN)gineered safety feature 1 / 1 / 1 (control room system)

(L)ow-Power / Shutdown 1/1/1 (N)ew or (M)odified from bank including 1(A) 2/2/1 (P)revious 2 exams 3 / 3 / 2 (randomly selected)

(R)CA 1/1/1 (S)imulator L-16-1 NRC EXAM SECURE INFORMATION ES-301-2 SRO Page 1 of 2

L-16-1 NRC EXAM SECURE INFORMATION JPM

SUMMARY

STATEMENTS

a. Respond to Control Bank D Demanded Past 230 Steps - Examinee enters 3-ONOP-028, Reactor Control System Malfunction, to restore the Rod Control System to normal configuration with Bank D at 229 steps withdrawn. When examinee places the Rod Control Selector Switch in automatic, rods begin inserting at fast speed, and examinee must respond by placing the Rod Control Selector Switch in manual. This is a bank alternate-path JPM, previously used on the 2013 NRC exam.

b. Place Excess Letdown In Service - Examinee uses 3-OP-047, CVCS Charging and Letdown, to place excess letdown in service. When CV-3-387 (Excess Letdown Isolation Valve) is opened, examinee must recognize that RV-3-304 has failed open and provides a direct path to the containment sump. Examinee must either close CV-3-387 or transition to 3-ONOP-041.3, Excessive Reactor Coolant System Leakage, to start a charging pump and maintain pressurizer level.

This is a bank alternate-path JPM.

c. Establish Auxiliary Pressurizer Spray per 3-EOP-E The unit has experienced a SGTR. The ruptured SG has been isolated, the RCS has been cooled down, and the examinee is directed to depressurize the RCS to minimize break flow and refill the pressurizer. Examinee must recognize that the PORVs can NOT be opened and, alternatively, will establish auxiliary pressurizer spray using Attachment 4 of 3-EOP-E-3, Steam Generator Tube Rupture. This is a new alternate-path JPM.

d. Respond to a Loss of RHR - The unit is on RHR cooling, when MOV-3-750 (RHR Pump Suction from RCS) inadvertently closes and the running RHR pumps shaft shears. To mitigate, examinee enters 3-ONOP-050 (Loss of RHR) and re-opens the suction valve, secures the damaged pump, realigns RHR, starts the standby pump, and reinitiates cooling flow. This is a bank shutdown JPM, previously used on the 2015 NRC exam.

e. Manually Initiate Containment Spray - The unit has tripped and safety injection/phase-A containment isolation have actuated. Examinee is performing prompt action verifications in Attachment 3 of 3-EOP-E-0 (Reactor Trip or Safety Injection) and must recognize that containment spray/phase-B containment isolation have NOT actuated; examinee will manually initiate at least one train of containment spray, actuate a phase-B containment isolation and manually close phase-B valves that fail to reposition, secure RCPs, and secure the Unit 4 HHSI pumps. This is a bank engineered-safeguards JPM.

f. Restore Power to the 3A 4kV Bus - The unit has experienced a loss of all AC power. The 3A EDG did NOT start. The 3B EDG started but did not energize the 3B 4kv Bus. The Examinee is directed to restore power with a priority on the 3B EDG. The Examinee will discover the 3B 4KV Bus is locked out will restore power to the 3A 4kV Bus via the SBO tie line. This is a new alternate-path and time critical JPM.

g. Place N-3-42 Power Range Drawer in Service - The unit is at 100% power and examinee is directed to place the N-3-42 power range drawer in service using 3-OSP-059.4, Power Range Nuclear Instrumentation Analog Channel Operational Test. This is a bank JPM.

h. NOT SELECTED FOR SRO EXAM

i. Locally Trip the Reactor and Turbine - The unit has experienced an ATWS and the examinee is directed to trip the reactor and turbine locally. Examinee will proceed to the 3B MCC Room, open all reactor trip, bypass, and MG set breakers, and then trip the turbine at the turbines front standard. This is a bank JPM.

j. Control Steam Generator Level Locally with Auxiliary Feedwater Control Valve - The unit has tripped. AFW flow is required to the 3C SG. Examinee is directed to investigate and locally restore AFW flow to the 3C SG per 3-ONOP-075, Auxiliary Feedwater System Malfunction. Examinee will discover that train-2 flow to the 3C SG is NOT available and train-1 flow control valve will NOT open manually. Examinee will transition to Attachment 3 of the ONOP to locally manipulate valves and restore feedwater flow to the 3C SG. This is a bank emergency JPM.

k. Align Emergency Service Water to the Charging Pumps - Level can NOT be maintained in the CCW Surge Tank and a loss of cooling to the charging pumps is imminent. Examinee will use Attachment 1 of 3-ONOP-030, Component Cooling Water Malfunction, to locally establish emergency cooling water to these pumps. This is a bank RCA/emergency JPM.

L-16-1 NRC EXAM SECURE INFORMATION ES-301-2 SRO Page 2 of 2

L-16-J NRC EXAM SECURE INFORMATION ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: ft.e7 I41 ti?15 .Ei- i Date of Examination: Operating Test Number:2O..1

. . Initials

1. General Criteria a b* c#

a. The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).

b. There is no day-to-day repetition between this and other operating tests to be administered during this examination. lv

c. The operating test shall not duplicate items from the applicants audit test(s). (see Section D.1.a.) j_ ¶j_

d. Overlap with the written examination and between different parts of the operating test is within , <

acceptable limits.

e. It appears that the operating test will differentiate between competent and less-than-competent j applicants at the designated license level.

2. Walk-Through Criteria -- --

a. Each JPM includes the following, as applicable:

initial conditions

initiating cues

references and tools, including associated procedures

- reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee

operationally important specific performance criteria that include:

detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important observations to be made by the applicant criteria for successful completion of the task identification of critical steps and their associated performance standards restrictions on the sequence of steps, if applicable

b. Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-3d-i and 2) have not caused the test to deviate from any of the acceptance (, .

criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified 11 -

on those forms and Form ES-201-2.

3. Simulator Criteria -- --

The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES- (A Vd I3 301-4 and a copy is attached. JL

a. Author

b. Facility Reviewer(*)

c. NRC Chief Examiner f#)

d. NRC Supervisor NOTE:

The facility signature is not applicable for NRC-developed tests.

Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

L-16-1 NRC EXAM SECURE INFORMATION

L-16-1 NRC EXAM SECURE INFORMATION ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Facility: Turkey Point Units 3 & 4 Date of Exam: 0812212016 Scenario Numbers: 1 /2/3/4 / 5 Operating Test No.: 2016-301 QUALITATIVE ATTRIBUTES Initials a b* c#

1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events. V J

2. The scenarios consist mostly of related events. .L

3. Each event description consists of

. the point in the scenario when it is to be initiated

the malfunction(s) or conditions that are entered to initiate the event 93

. the symptoms/cues that will be visible to the crew A

. the expected operator actions (by shift position)

. the event termination point (if applicable)

4. The events are valid with regard to physics and thermodynamics.

J4 *% J_

5. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives. IlL

6. If time compression techniques are used, the scenario summary clearly so indicates.

Operators have sufficient time to carry out expected activities without undue time 4 constraints. lilA V

11 Cues are given.

7. The simulator modeling is not altered. LV\

8. The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.

iA 9

9. Every operator will be evaluated using at least one new or significantly modified scenario.

All other scenarios have been altered in accordance with Section D.5 of ES-301.

10. All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the form along with the simulator scenarios).

1 1. The scenario set provides the opportunity for each applicant to be evaluated in each of the applicable rating factors. (Competency Rating factors as described on forms ES-303-1 and AV\ 1 A )L ES-303-3.)

12. Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).

13. The level of difficulty is appropriate to support licensing decisions for each crew position.

Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes -- -- --

1. MalfunctionsafterEOPentry(1-2) 2/2/2/2/

/

2. Abnormal events (2-4) 4/5/3/3/

3. Major transients (12) 1 / 1 /1 / 2 /

4. EOPs entered/requiring substantive actions (12) 1 /1 /1 /2/ J4L ..

5. EOP contingencies requiring substantive actions (0-2) 0 / 1 /0 / 0 /

6. EOP based Critical tasks (23) 2/2/2/2/

NOTE: The facility signature is not applicable for NRC developed tests. .c

Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

L-16-1 NRC EXAM SECURE INFORMATION ES-301 Transient and Event Checklist Form ES-301-5 Facility: Turkey Point Units 3 & 4 Date of Exam: 8122116 Operating Test No.: 2016-301 Scenarios E

A V L-16-i Ni L-16-1 N2 L-16-i N3 L-16-l N4 \

\

L-16-i N5 I

) M (Spare) i T I P E f 0 N P N IT I L T CREW CREW CREW CREW \\ CREW 1 A M I POSITION POSITION POSITION POSITION \IOSITION/

C A

T jJ Mf)_

S A B S A B S A B S A B SAJW N D R T 0 R T 0 R T 0 R T 0 RT Jo R I T E 0 C P 0 C P 0 C P 0 C P RX 4 2 5

\ 3 1 NOR 1* 1 1 IC SROI-1 23,5 3, 4 MAJ 6 5,7 6 4 2 TS 3,5 1,4 4 2 RX 4 2 5 3 1 NOR 1* i 1 I/C

\

SROI-2 1,2 3,4 8 4 425%3 1 SROI-3 I/C 2,3,5 1,3,4 2,4 8 4 MAJ 6 5,7 6 4 2 IS 3513 4 2 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (AIC) and balance-of-plant (BOP) positions. Instant SROs (SRO-I) must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an SRO-l additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the AIC position.

2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a one-for-one basis.

3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

4. For licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-l applicants in either the ATC or BOP position to best evaluate the SRO-I in manipulating plant controls.

Page 1 of 3

L-16-1 NRC EXAM SECURE INFORMATION ES-301 Transient and Event Checklist Form ES-301-5 Facility: Turkey Point Units 3 & 4 Date of Exam: 8122116 Operating Test No.: 2016-301 Scenarios F L-16-1 N4 L-16-i N5 M L-16-i Ni L-76-1 N2 L-16-i N3 A V T (Spare)

P E 0 N P N T L T CREW CREW CREW CREW CREW A M I POSITION POSITION POSITION POSITION POSITION L U C T M)

A Y S A B S A B S A B S A B S A B N P R T 0 R T 0 R T 0 R T 0 R T 0 R T E 0 C P 0 C P 0 C P 0 C P 0 C P RX 5 1 1 NOR 4 1 1 I/C 3,5 2,4 4 4 RO-1 MAJ 6 6 2 2 TS 0 0 RX 4 1 1 NOR 2 5 2 1 I/C 1,2 1,3 1,3 6 4 RO-2 MAJ 6 5,7 6 4 2 TS 0 0 RX 5 1 1 NOR 4 2 2 1 I/C 3,5 1,3 2,4 6 4 RO-3 MAJ 6 5,7 6 4 2 TS 0 0 RX 2 1 1 NOR 5 1 1 I/C 3,4 1,3 4 4 RO-4 MA] 5,7 6 3 2 TS 0 0 RX 4 1 1 NOR 1 2 2 1 I/C 1,2 2,4 1,3 6 4 RO-5 MAJ 6 8 5,7 4 2 IS 0 0 Page2of3

L-16-1 NRC EXAM SECURE INFORMATION ES-301 Transient and Event Checklist Form ES-301-5 Facility: Turkey Point Units 3 & 4 Date of Exam: 8122116 Operating Test No.: 2016-301 Scenarios L-16-i Ni L-16-i N2 L-16-i N3 L-16-1 N4 L-16-i N5 M A

(Spare) T I P 2 0 N P N T

L T CREW CREW CREW CREW CREW A M I POSITION POSITION POSITION POSITION POSITION L U C T M(*)

A Y A B S A B A B S A B S A B S S N R T 0 R T 0 R T 0 R T 0 R T 0 R T E 0 C P 0 C P 0 C P 0 C P 0 C P RX 2 NOR 4 RO-6 I/C 3,5 3,4 4 4 MAJ 6 5,7 3 2 TS 0 0 RX 1 1 1 NOR 5 1 1 RO-7 I/C 3,6 1,3 4 4 MAJ 8 6 2 2 TS 0 0 Instructions:

Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. RO5 must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions. Instant SROs (SRO-l) must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an SRO-l additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.

2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a one-for-one basis.

3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

4. For licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-l applicants in either the ATC or BOP position to best evaluate the SRO-l in manipulating plant controls.

Page3of3

L-16-1 NRC EXAM SECURE INFORMATION ES-301 Competencies Checklist Form ES-301-6 Facility: Turkey Point Units 3&4 Date of Examination: 8122116 Operating Test No.: 2016-301 APPLICANTS SRO RO BOP SCENARIO SCENARIO SCENARIO Competencies i 2 3 s i 2 3[

Interpret/Diagnose Events and Conditions Comply With and 1-6

[ 1-6 1-6 8

1-6 1-5 7

1-5 1-6 1-6 1-6 1-6 8

1-6 1-5 7

1-5 1-6 1-6 1-6 1-6 8

1-6 1-5 7

1-5 1-6 1-6 1-6 1-6 1-6 1-6 1-6 1-6 1-6 1-6 Use Procedures (1) 8 7 8 7 8 7 Operate Control 1,2 1,2 1,3 2,3,4 2,4 2,3 3,4 1,2 1,2,3 1,3 N/A N/A N/A N/A N/A 57 Boards (2) 4,6 4,6 6,8 5,6 5,6 5,6 4,8 57 5,6 Communicate 1-6 1-5 1-6 1-5 1-6 1-5 1-6 1-6 1-6 1-6 1-6 1-6 1-6 1-6 16 and Interact 8 7 8 7 8 7 Demonstrate 1-6 1-5

.. 1-6 1-6 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A Supervisory Ability (3) 8 7 Comply With and 1 3 35 2 5 1 3 1 4 N/A N/A N/A N/A N/A N/A N/A N/A N/A N/A Use Tech. Specs. (3)

Notes:

(1) Includes Technical Specification compliance for an RD.

(2) Dptional for an S RD-U.

(3) DnIy applicable to SRDs.

Instructions:

Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant. (This includes all rating factors for each competency.) (Competency Rating factors as described on forms ES-303-1 and ES-303-3.)

PTN L-16-1 NRC Exam Security Agreement In Effect ES-401, Rev. 10 PWR Examination Outline Form ES-401-2 Facility: Turkey Point Date of Exam: 2016 RO K/A Category Points SRO-Only Points Tier Group K K K K K K A A A A G A2 G* Total 1 2 3 4 5 6 1 2 3 4

Total

1. 1 3 3 3 3 3 3 18 18 3 3 66 Emergency &

2 2 1 2 1 2 1 99 2 2 44 Abnormal Plant N/A N/A Evolutions Tier Totals 5 4 5 4 5 4 27 27 5 5 1010 1 3 2 2 2 3 3 3 3 1 3 3 28 28 3 2 55 2.

2 1 0 1 1 1 1 1 1 1 1 1 10 10 2 1 33 Plant Systems Tier Totals 4 2 3 3 4 4 4 4 2 4 4 38 38 3 88

3. Generic Knowledge and Abilities 1 2 3 4 10 1 2 3 4 7 Categories 3 2 2 3 1 2 2 2

1. Ensure that at least two topics from every applicable K/A category are sampled within each tier of the RO and SRO-only outlines (i.e., except for one category in Tier 3 of the SRO-only, the Tier Totals in each K/A category shall not be less than two). (One Tier 3 Radiation Control K/A is allowed if the K/A is replaced by a K/A from another Tier 3 Category).

2. The point total for each group and tier in the proposed outline must match that specified in the table.

The final point total for each group and tier may deviate by +/-1 from that specified in the table based on NRC revisions.

The final RO exam must total 75 points and the SRO-only exam must total 25 points.

3. Systems/evolutions within each group are identified on the associated outline; systems or evolutions that do not apply at the facility should be deleted and justified; operationally important, site-specific systems that are not included on the outline should be added. Refer to section D.1.b of ES-401 for guidance regarding the elimination of inappropriate K/A statements.

4. Select topics from as many systems and evolutions as possible; sample every system or evolution in the group before selecting a second topic for any system or evolution.

5. Absent a plant-specific priority, only those K/As having an importance rating (IR) of 2.5 or higher shall be selected.

Use the RO and SRO ratings for the RO and SRO-only portions, respectively.

6. Select SRO topics for Tiers 1 and 2 from the shaded systems and K/A categories.

7. *The generic (G) K/As in Tiers 1 and 2 shall be selected from Section 2 of the K/A Catalog, but the topics must be relevant to the applicable evolution or system. Refer to section D.1.b of ES-401 for the applicable KAs.

8. On the following pages, enter the K/A numbers, a brief description of each topic, the topics= importance ratings (IRs) for the applicable license level, and the point totals (#) for each system and category. Enter the group and tier totals for each category in the table above; if fuel handling equipment is sampled in other than Category A2 or G* on the SRO-only exam, enter it on the left side of Column A2 for Tier 2, Group 2 (Note # 1 does not apply). Use duplicate pages for RO and SRO-only exams.

9. For Tier 3, select topics from Section 2 of the K/A catalog, and enter the K/A numbers, descriptions, IRs, and point totals (#) on Form ES-401-3. Limit SRO selections to K/As that are linked to 10 CFR 55.43..

PTN L-16-1 NRC Exam Security Agreement In Effect ES-401, REV 10 T1G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO

1. 007EG2.4.34 Reactor Trip - Stabilization - Recovery

/1 4.2 4.1 Knowledge of RO tasks performed outside the main control room during an emergency and the resultant operational effects

2. 008AA1.05 Pressurizer Vapor Space Accident / 3 3.4 3.3 LPI System

3. 009EK1.02 Small Break LOCA / 3 3.5 4.2 Use of steam tables

4. 011EK3.03 Large Break LOCA / 3 4.1 4.3 Starting auxiliary feed pumps and flow, ED/G, and service water pumps

5. 015AK2.08 RCP Malfunctions / 4 2.6 2.6 CCWS

6. 022AK1.04 Loss of Rx Coolant Makeup / 2 2.9 3 Reason for changing from manual to automatic control of charging flow valve controller

- No Charging flow valve controller on our plant. Suggest expand scope to charging pump speed controller. Changed to AK1.03

7. 025AA1.09 Loss of RHR System / 4 3.2 3.1 LPI pump switches, ammeter, discharge pressure gauge, flow meter, and indicators

8. 027AA1.05 Pressurizer Pressure Control System 3.3 3.2 Transfer of heaters to backup power supply Malfunction / 3

- No Backup power supply at our plant. Suggest expand scope. Could hit K/A on EDG max loading? Changed to AA1.03

9. 029EK2.06 ATWS / 1 2.9 3.1 Breakers, relays, and disconnects.

10. 038EA2.13 Steam Gen. Tube Rupture / 3 3.1 3.7 Magnitude of rupture

11. 054AA2.08 Loss of Main Feedwater / 4 2.9 3.3 Steam flow-feed trend recorder Page 1 of 2 2/1/2016 9:35 AM

PTN L-16-1 NRC Exam Security Agreement In Effect ES-401, REV 10 T1G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO

12. 055EG2.1.19 Station Blackout / 6 3.9 3.8 Ability to use plant computer to evaluate system or component status.

13. 056AK1.03 Loss of Off-site Power / 6 3.1 3.4 Definition of subcooling: use of steam tables to determine it

- Double Jeopardy w/ Q. 13. Suggest keep 3 and change 13. Changed to AK1.04

14. 057AK3.01 Loss of Vital AC Inst. Bus / 6 4.1 4.4 Actions contained in EOP for loss of vital ac electrical instrument bus

15. 062AK3.02 Loss of Nuclear Svc Water / 4 3.6 3.9 The automatic actions (alignments) within the nuclear service water resulting from the actuation of the ESFAS

16. 065AA2.05 Loss of Instrument Air / 8 3.4 4.1 When to commence plant shutdown if instrument air pressure is decreasing

17. WE05EK2.2 Inadequate Heat Transfer - Loss of Secondary Heat Sink / 4 3.9 4.2 Facility's heat removal systems, including primary coolant, emergency coolant, the decay heat removal systems and relations between the proper operation of these systems to the operation of the facility.

18. we12EG2.2.44 Steam Line Rupture - Excessive Heat 4.2 4.4 Ability to interpret control room indications to verify the Transfer / 4 status and operation of a system, and understand how operator actions and directives affect plant and system conditions Page 2 of 2 2/1/2016 9:35 AM

PTN L-16-1 NRC Exam Security Agreement In Effect ES-401, REV 10 T1G2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO

19. 003AK1.13 Dropped Control Rod / 1 3.2 3.6 Interaction of ICS control stations as well as purpose, function and modes of operation of ICS

- No ICS. Suggest NewK/A. Changed to AK1.02

20. 005AA2.01 Inoperable/Stuck Control Rod / 1 3.3 4.1 Stuck or inoperable rod from in-core and ex-core NIS, in-core or loop temperature measurements

21. 024AA2.06 Emergency Boration / 1 3.6 3.7 When boron dilution is taking place

22. 036AK3.01 Fuel Handling Accident / 8 3.1 3.7 Different inputs that will cause a reactor building evacuation 037AG2.4.41 Steam Generator Tube Leak / 3 2.9 4.6 Knowledge of the emergency action level thresholds and

23. classifications.

- SRO level. Suggest New K/A. Changed to G2.4.20 051AA1.04 Loss of Condenser Vacuum / 4 2.5 2.5 Rod position

24. 3.5

- Relationship issue. Suggest how to write this question? Changed to 0067 Plant fire on-site AA1.06 Fire Alarm WE03EK2.2 LOCA Cooldown - Depress. / 4 3.7 4.0 Facility's heat removal systems, including primary

25. coolant, emergency coolant, the decay heat removal systems and relations between the proper operation of these systems to the operation of the facility.

26. WE06EK1.3 Degraded Core Cooling / 4 3.7 3.9 Annunciators and conditions indicating signals, and remedial actions associated with the (Degraded Core Cooling).

27. WE15EK3.3 Containment Flooding / 5 2.9 2.9 Manipulation of controls required to obtain desired operating results during abnormal and emergency

- No actions or controls maipulated. Suggest New K/A. Changed to EK3.2 situations.

Page 1 of 1 2/1/2016 9:35 AM

PTN L-16-1 NRC Exam Security Agreement In Effect ES-401, REV 10 T2G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO 003K3.04 Reactor Coolant Pump 3.9 4.2 RPS 28.

29.

004K6.09 Chemical and Volume Control 2.8 3.1 Purpose of VCT divert valve

30. 004K6.22 Chemical and Volume Control 2.6 2.9 Design minimum and maximum flow rates for letdown system.

31. 005K2.03 Residual Heat Removal 2.7 2.8 RCS pressure boundary motor-operated valves

32. 006A4.03 Emergency Core Cooling 3.5 3.5 Transfer from boron storage tank to boron injection tank

- No BIT. Suggest New K/A. Changed to A4.08

33. 007A4.04 Pressurizer Relief/Quench Tank 2.6 2.6 PZR vent valve

- Clarify "vent valve". Does PORV, safety apply? Changed to A4.10

34. 008K4.01 Component Cooling Water 3.1 3.3 Automatic start of standby pump

35. 010K2.02 Pressurizer Pressure Control 2.5 2.7 Controller for PZR spray valve

36. 012K1.04 Reactor Protection 3.2 3.3 RPIS

37. 013K5.01 Engineered Safety Features Actuation 2.8 3.2 Definitions of safety train and ESF channel

38. 022G2.2.12 Containment Cooling 3.7 4.1 Knowledge of surveillance procedures.

Page 1 of 3 2/1/2016 9:35 AM

PTN L-16-1 NRC Exam Security Agreement In Effect ES-401, REV 10 T2G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO

39. 022K1.01 Containment Cooling 3.5 3.7 SWS/cooling system

40. 026G2.4.4 Containment Spray 4.5 4.7 Ability to recognize abnormal indications for system operating parameters which are entry-level conditions for emergency and abnormal operating procedures.

41. 039A3.02 Main and Reheat Steam 3.1 3.5 Isolation of the MRSS

42. 059A1.07 Main Feedwater 2.5 2.6 Feed Pump speed, including normal control speed for ICS

- No ICS. Suggest New K/A. No FWP Speed control. Changed to A1.03

43. 059K4.19 Main Feedwater 3.2 3.4 Automatic feedwater isolation of MFW

44. 061K1.10 Auxiliary/Emergency Feedwater 2.6 2.7 Diesel fuel oil

- Expand scope? DDSSFP fits. Yes, S/U FW pumps will work.

45. 061K5.01 Auxiliary/Emergency Feedwater 3.6 3.9 Relationship between AFW flow and RCS heat transfer

46. 062A1.01 AC Electrical Distribution 3.4 3.8 Significance of D/G load limits

47. 063A1.01 DC Electrical Distribution 2.5 3.3 Battery capacity as it is affected by discharge rate

48. 063A4.01 DC Electrical Distribution 2.8 3.1 Major breakers and control power fuses

49. 064K6.07 Emergency Diesel Generator 2.7 2.9 Air receivers Page 2 of 3 2/1/2016 9:35 AM

PTN L-16-1 NRC Exam Security Agreement In Effect ES-401, REV 10 T2G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO

50. 073K3.01 Process Radiation Monitoring 3.6 4.2 Radioactive effluent releases

51. 073K5.02 Process Radiation Monitoring 2.5 3.1 Radiation intensity changes with source distance

- RCAT question. Hard to write to LOD. Request ideas or New K/A. Changed to 039 MRSS K5.08

52. 076A2.01 Service Water 3.5 3.7 Loss of SWS

- Same topic area with #54. Changed to 003A2.02

53. 076A2.02 Service Water 2.7 3.1 Service water header pressure

54. 078G2.2.25 Instrument Air 3.2 4.2 Knowledge of the bases in Technical Specifications for limiting conditions for operations and safety limits.

- Relationship issue. Request New K/A.

Changed to G2.2.44

55. 103A2.04 Containment 3.5 3.6 Containment evacuation (including recognition of the alarm)

Page 3 of 3 2/1/2016 9:35 AM

PTN L-16-1 NRC Exam Security Agreement In Effect ES-401, REV 9 T2G2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO

56. 002K5.14 Reactor Coolant 3.8 4.2 Consequences of forced circulation loss

57. 011K4.05 Pressurizer Level Control 3.7 4.1 PZR level inputs to RPS

58. 014A1.02 Rod Position Indication 3.2 3.6 Control rod position indication on control room panels

59. 017K6.01 In-core Temperature Monitor 2.7 3.0 Sensors and detectors

60. 029A4.01 Containment Purge 2.5 2.5 Containment purge flow rate

61. 033A2.01 Spent Fuel Pool Cooling 3.0 3.5 Inadequate SDM

62. 035G2.4.6 Steam Generator 3.7 4.7 Knowledge symptom based EOP mitigation strategies.

63. 055K3.01 Condenser Air Removal 2.5 2.7 Main condenser

64. 068A3.02 Liquid Radwaste 3.6 3.6 Automatic isolation

65. 079K1.01 Station Air 3.0 3.1 IAS Page 1 of 1 2/1/2016 9:35 AM

PTN L-16-1 NRC Exam Security Agreement In Effect ES-401, REV 10 T3 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO

66. G2.1.36 Conduct of operations 3.0 4.1 Knowledge of procedures and limitations involved in core alterations

67. G2.1.45 Conduct of operations 4.3 4.3 Ability to identify and interpret diverse indications to validate the response of another indication

68. G2.1.8 Conduct of operations 3.4 4.1 Ability to coordinate personnel activities outside the control room.

69. G2.2.12 Equipment Control 3.7 4.1 Knowledge of surveillance procedures.

70. G2.2.41 Equipment Control 3.5 3.9 Ability to obtain and interpret station electrical and mechanical drawings

71. G2.3.15 Radiation Control 2.9 3.1 Knowledge of radiation monitoring systems

72. G2.3.7 Radiation Control 3.5 3.6 Ability to comply with radiation work permit requirements during normal or abnormal conditions Changed to G2.2.2

73. G2.4.37 Emergency Procedures/Plans 3.0 4.1 Knowledge of the lines of authority during implamentation of an emergency plan.

74. G2.4.5 Emergency Procedures/Plans 3.7 4.3 Knowledge of the organization of the operating procedures network for normal, abnormal and emergency evolutions.

75. G2.4.8 G2.4.3 Emergency Procedures/Plans 3.8 4.5 Knowledge of how abnormal operating procedures are used in conjunction with EOPs.

- Doesn't match for RCO. Double Jeopardy with SRO #100. Request New K/A. Change to G2.4.3 Page 1 of 1 2/1/2016 9:36 AM

PTN L-16-1 NRC Exam Security Agreement In Effect ES-401, REV 10 SRO T1G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO

76. 007EA2.04 Reactor Trip - Stabilization - Recovery /

1 4.6 4.4 If reactor should have tripped but has not done so, manually trip the reactor and carry out actions in ATWS EOP

- RO only. Any ideas? Changed to EA2.02

77. 015AG2.4.21 RCP Malfunctions / 4 4.0 4.6 Knowledge of the parameters and logic used to assess the status of safety functions

- Any ideas on how to write to this relationship? New concept CSF INVENTORY. Changed to 2.4.31 Knowledge of ARPs, indic, or response procedures.

78. 026AA2.03 Loss of Component Cooling Water / 8 2.6 2.9 The valve lineups necessary to restart the CCWS while bypassing the portion of the system causing the abnormal

- RO only. Any ideas? Give example question condition

79. 062AG2.4.2 Loss of Nuclear Svc Water / 4 4.5 4.6 Knowledge of system set points, interlocks and automatic actions associated with EOP entry conditions.

- RO only. Any ideas? Give example question

80. 065AG2.4.30 Loss of Instrument Air / 8 2.7 4.1 Knowledge of events related to system operations/status that must be reported to internal orginizations or outside agencies.

81. WE04EA2.1 LOCA Outside Containment / 3 3.4 4.3 Facility conditions and selection of appropriate procedures during abnormal and emergency operations.

Page 1 of 1 2/1/2016 9:36 AM

PTN L-16-1 NRC Exam Security Agreement In Effect ES-401, REV 10 SRO T1G2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO

82. 060AG2.2.39 Accidental Gaseous Radwaste Rel. / 9 3.9 4.5 Knowledge of less than one hour technical specification action statements for systems.

- RO only. Suggest different topic and system. New K/A. Changed to 2.2.40 Apply TS

83. 061AA2.06 ARM System Alarms / 7 3.2 4.1 Required actions if alarm channel is out of service

84. 069AA2.01 Loss of CTMT Integrity / 5 3.7 4.3 Loss of containment integrity

85. we03EG2.4.20 LOCA Cooldown - Depress. / 4 3.8 4.3 Knowledge of operational implications of EOP warnings, cautions and notes.

Page 1 of 1 2/1/2016 9:36 AM

PTN L-16-1 NRC Exam Security Agreement In Effect ES-401, REV 10 SRO T2G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO

86. 004G2.1.30 Chemical and Volume Control 4.4 4.0 Ability to locate and operate components, including local controls.

87. 013A2.04 Engineered Safety Features Actuation 3.6 4.2 Loss of instrument bus

88. 061A2.04 Auxiliary/Emergency Feedwater 3.4 3.8 pump failure or improper operation

89. 064G2.4.9 Emergency Diesel Generator 3.8 4.2 Knowledge of low power / shutdown implications in accident (e.g. LOCA or loss of RHR) mitigation strategies.

90. 073A2.02 Process Radiation Monitoring 2.7 3.2 Detector failure Page 1 of 1 2/1/2016 9:36 AM

PTN L-16-1 NRC Exam Security Agreement In Effect ES-401, REV 10 SRO T2G2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO

91. 001A2.09 Control Rod Drive 3.8 4.0 Station blackout

- Relationship issue. Ideas? Suggest expand topic. Changed to A2.17

92. 028A2.03 Hydrogen Recombiner and Purge Control 3.4 4.0 The H2 air concentration in excess of limit flame propagation or detonation with resulting equipment damage in containment

- Abandoned and taught with SACRGs after test is given. Expand to PAHMs time critical basis? Changed to 045A2.08

93. 055G2.4.34 Condenser Air Removal 4.2 4.1 Knowledge of RO tasks performed outside the main control room during an emergency and the resultant

- RO only. Any ideas? Changed to 017G2.4.30 operational effects Page 1 of 1 2/1/2016 9:37 AM

PTN L-16-1 NRC Exam Security Agreement In Effect ES-401, REV 10 SRO T3 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:

RO SRO

94. G2.1.4 Conduct of operations 3.3 3.8 Knowledge of individual licensed operator responsibilities related to shift staffing, such as medical requirements, "no-solo" operation, maintenance of active license statur, 10CFR55 etc.

95. G2.2.19 Equipment Control 2.3 3.4 Knowledge of maintenance work order requirements.

96. G2.2.43 Equipment Control 3.0 3.3 Knowledge of the process used to track inoperable alarms

97. G2.3.14 Radiation Control 3.4 3.8 Knowledge of radiation or contamination hazards that may arise during normal, abnormal, or emergency

- Same topic area with #98 These are two different topics. conditions or activities

98. G2.3.6 Radiation Control 2.0 3.8 Ability to aprove release permits Changed to G2.1.36

99. G2.4.26 Emergency Procedures/Plans 3.1 3.6 Knowledge of facility protection requirements including fire brigade and portable fire fighting equipment usage.

100. G2.4.8 Emergency Procedures/Plans 3.8 4.5 Knowledge of how abnormal operating procedures are used in conjunction with EOPs.

Page 1 of 1 2/1/2016 9:37 AM

L-16-1 NRC EXAM SECURE INFORMATION ES-401 Record of Rejected K/As ES-401-4 Tier / Randomly Reason for Rejection Group Selected K/A 1 / 1 022 / AK1.04 No charging flow controller at PTN. Changed to AK1.03.

1/1 027 / AA1.05 No backup power supply at PTN. Changed to AA1.03.

1/1 056 / AK1.03 Double jeopardy with Q3. Changed to AK1.04.

1/2 003 / AK1.13 No ICS at PTN. Changed to AK1.02.

1/2 037 / AG2.4.41 SRO level. Changed to G2.4.20.

1/2 051 / AA1.04 No ICS at PTN. Changed to 067 AA1.06.

1/2 WE15 / EK3.3 No actions or controls manipulated at PTN. Changed to EK3.2.

2/1 006 / A4.03 No BIT at PTN. Changed to A4.08.

2/1 007 / A4.04 Limited test topic-minutia. Changed to A4.10.

2/1 059 / A1.07 No ICS at PTN. Changed to A1.03.

2/1 073 / K5.02 KA was not system friendly, was more of a GET/RWT question. Changed to 039 K5.08.

2/1 076 / A2.02 Double jeopardy with Q53. Changed to 003 A2.02.

2/1 078 / G2.2.25 SRO level. Changed to G2.2.44.

3 2.3.7 Rad worker practices at RCAT level. Changed to 2.2.2.

3 2.4.8 Double Jeopardy with Q100. Changed to 2.4.3.

1/1 007 / EA2.04 RO KA ONLY. Changed to EA2.02 to meet SRO criteria.

1/1 015 / AG2.4.21 SRO. No system to topic relationship for PTN. Changed to 2.4.31.

1/2 060 / AG2.2.39 RO only. Changed to 2.2.40.

2/2 001 / A2.09 No system to topic relationship for PTN. Changed to A2.17.

2/2 028 / A2.03 Post exam material (SACRGs). Changed to 045 A2.08.

2/2 055 / G2.4.34 RO only. Changed to 017G2.4.30.

3 2.3.6 Jeopardy with JPM. Changed to 2.1.36.

1/1 065 / AA2.05 Changed to AA2.06

L-16-1 NRC EXAM SECURE INFORMATION ES-401 Written Examination Quality Checklist Form ES-401-6 Facility:

7j %> 344ateofExam:

c/22/,. Exam Level: RO SRO V Initial Item Description

b.

1. Questions and answers are technically accurate and appliceble to the facility.

2. a. NRC K/As are referenced for all questions.

.4

b. Facility learning ob(ectives are referenced as available. V L9 ?

3. SRD questions are appropriate in accordance with Section D.2.d of ES-401 .-1 4 The sampling process was random and systematic (If more than 4 RD or 2 SRD questions were repeated from the last two NRC licensing exams, consult the NRRJNRD DL program 1,A,

-17

5. Question duplication from the licensee screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate The audit exam was systematically and randomly developed, or the audit exam was completed before the license exam was started; or the examinations were developed independently; or the licensee certifies that there is no duplication; or other (explain)

6. Bank use meets limits (no more than 75 percent from the Bank Modified New ,j/1 bank, at least 10 percent new, and the rest new or fV t modified); enter the actual RD / SRO-only question IZ 6.2 distribution(s) at right 14.ç çi..

7 Between 50 and 60 percent of the questions on the RD Memory C/A exam are written at the comprehension/ analysis level; the V L SRO exam may exceed 60 percent if the randomly selected K/As support the higher cognitive levels; enter the actual RD / SRD question distribution(s) at right. i:hc /;.ç ,cy7ç ic/s.c

8. References/handouts provided do not give away answers or aid in the elimination of A distractors

9. Question content conforms to specific K/A statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are justified.

10. Question psychometric quality and format meet the guidelines in ES Appendix B. /

11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet

a. Author

b. Facility Reviewer (*)

c. NRC Chief Examiner )#)

d NRC Regional Supervisor Note.

The facility reviewers initials or signature are not applicable for NRC-developed examinations.

Independent NRC reviewer initials items in Column c; chief examiner concurrence required.

Bao ES-401 Turkey Point 2015-301 Pre-Submittal Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only Add the word Both to the 3rd bullet. Do you need to identify that 1 F 3 X N E the AFW pump is in the AFW cage? Are all 3 pumps in the cage?

Procedure does not use terminology ASP transfer switches, should be T&TV Xfer Switches. D.2 plausibility? Are there any switches where taking it to LOCAL cause a start? R: Could confuse local S start with local to cause a start.

A.1 Surge line has low plausibility. Why would PZR level increase on 2 H 3 X N E surge line break?

S R: Change 3rd bullet to state indicated PZR level to make A.1 more plausible.

3 H 3 B S Remove via ECCS or via RHR HXs.

4 H 3 N ES Is at any time in your procedure does it allow 3 RCPs operating after 5 H 3 X N E securing an RCP? If not, A is not plausible.

S Increase temp to 235 degrees and entered ONOP-41 to make A.1 plausible. Remove immediately.

H 6 3 M S 7 F 3 M S Does this answer another question? Check for overlap.

8 H 3 M S Verified no overlap.

9 F 2 B S Doesnt match KA. Licensee stated that this is the transition from 10 F 3 M S tube leak to tube rupture. Agree, SAT.

11 H 2 N S Double Jeopardy w/ Q26. Will change Q26 to a higher temp to send 12 H 3 N S you to FR-C.1.

13 H 3 B S ECCS is a de-energized to activate system. B & D not very 14 F 3 X B S plausible. R: Plant specific detail provided to explain plausibility.

No procedure support for plausibility statement associated with high 15 F 3 N S ICW flow. R: Licensee stated thermal barrier flow is an example.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A.2 & C.2 plausibility? How does energizing the heaters maintain 16 H 3 N E the PZR level band? R: Plant does not have direction to reduce S plant power. Will look to change 2nd half.

Changed PZR htrs to letdown valves. SAT 17 H 3 M S Change SG level to be for Accident conditions to increase LOD?

18 F 2 B E R: 20% and 185 degrees F.

S Changed made as noted. SAT You state in the 2nd question the given Tavg-Tref mismatch. It 19 H 3 N E appears that this is a leading statement and not needed.

S R: Agree and switch question 1 & 2. SAT 20 H 3 N S Not sure if enough info is provided to ascertain a dilution is 21 H 3 N S occurring. Isnt there an associated dilution alarm? R: Yes, based on being in Emergency Boration procedure. SAT Bubbles are stated in ONOP-3.03. Reword to remove 3rd bullet and 22 H 3 N E include in the question. Still needs work. New question gives away the answer. Change to ask what causes a containment isolation alarm and which one causes a containment evacuation alarm.

Question revised. Contaminated water spill not plausible. Change to local CAM alarm goes off. Agreed to change to cavity water. Verified changes made to add cavity water to the description of the water S

spill to increase this distractors plausibility.

23 F 3 B S Remove ready for further response. Removed as requested. SAT 24 F 3 M E S

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A WE03EK2.2 25P F 2 X X Y N B U

1. Q=K/A, but weak; the first part Q is GFES-level knowledge.

2. First and third bullets in the Given information are unnecessary and can be deleted without affecting the question. If the crew is in ES-1.2 then it is a SBLOCA by definition; RCS pressure value is not needed and if all HHSI pumps are running in ES-1.2 and the crew can stop the first SI pump, the applicant should know an approximate RCS pressure value.

3. Why would only one RCP be running? Is this information necessary for the Q?

4. Distractors A(2) and C(2) are non-plausible. We are taught in the first part Q that stopping a HHSI pump will result in RCS temperature rising (bad result from a subcooling point of view) or RCS pressure lowering (also a bad result from a subcooling point of view), so why would an applicant think that we would need less subcooling, not more, to stop the second (another) HHSI pump?

Q as submitted is U due to multiple non plausible distractors. Also, first part Q is GFES level and may not be suitable for the site-M S specific exam.

New question. SAT.

26 H 3 N ES Overlaps w/ Q12. Change to make red path FR-C.1 27 F 3 N E Only need to know 1st half to get it correct. Rewrite to make A&B same source and an unexpected one. Question was revised to remove the 2nd half of the question but failed to S remove it from the answer choices. Still the same issue exist.

Revised to include other expected sources. SAT.

28 F 3 N S 29 H 3 N S 30 F 3 N S Do we need the word current? Leading word. Removed 31 F 3 N E S 32 H 3 N S 33 H 3 B S 34 F 3 N S

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 35 F 3 N E S Add word indicates to 2nd bullet.

36 H 3 N S 37 H 3 N S F

38 3 N S 39 F 3 N ES Separate each column and change to D to SI Signal - D 40 F 3 N S 41 H 3 N U Only need to know MSIL criteria to get correct answer and therefore does not meet the KA criteria.

S Question revised to separate portions of the MSIL signal in a 2X2 format. SAT 42 F 3 N S 43 F 3 N E

Change question to get rid of Rx Trip 2/ Low Tavg to prevent overlap w/ Q#40. Change 1st question to A(n)

MSIL signal _____ with choices being will or will NOT cause an AFW actuation.

REF update logic S Changes made as noted above.

44P F 3 N ES Choices are for Unit 3 but question asks about Unit 4.

45 H 3 B ES C1 & D1 not plausible. Change to lower and stabilize or Increase initially than lower.

46 H 3 N S U S 2 question answers the 1 question. Fix by asking about nd st 47 F 3 M vital disc amps. Changes made as noted. SAT

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 063A4.01 48P H 2 X X X Y N B E

1. Q=K/A, Q is on RO level.

2. Parallelism with distractors C and D: one says NOT function, and the other says NOT open, please pick one version for both.

3. Could be argued that B is a correct answer because both parts are logically true, need to tighten the stem to ensure the second part Q is specifically giving the reason or cause for the initial response of the breaker.

4. Distractor C is non plausible due to the inter-relationships between distractors as follows: the question stem states that it is true that you have lost electrical power (voltage) to the breaker, so why would anyone believe that the undervoltage function of the breaker would not work, given the undervoltage condition?

Q as submitted would be technically rated an E, however it may need extensive revision based upon the distractor inter-relationships as described above.

M S Overlap w/Q#9. Changed Q#9 (SAT now) 49 H 3 M S 50 F 3 N U Doesnt meet the KA. Can answer for high alarm not PRM failure. Answer does not agree with answer given in S distractor. Changes to the question now match the KA.

51 H 3 N S 52 H 3 M E Change C.1 to Fast Load Reduction and the ARP to Fast Load Reduction procedure. Change D.1 to Fast Load S Reduction. Revised as noted. SAT 53 H 3 N S 54 H 3 N S 55 F 3 N S 56 H 3 N ES B not plausible. Change to just voltage. Revised as noted.

SAT 57 H 3 N E Checking for operationally validity.

S Confirmed via simulator response.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 58 H 3 N S 59 F 3 N S 60 F 3 M ES Change to DCS ONLY or DCS & VPB. Revised as noted.

SAT 61 H 3 N S Distractor B states you are in a short term TS, clarify this distractor plausibility. Completed SAT.

62 H 3 M E CAPS only S

63 H 3 M E Why not use HG Vacuum as read in the MCR? Yes, add On DCS, Revised as noted. SAT 64 F 3 N E Compare to Q#50. Last bullet not needed. Verify question 50 changed to eliminate overlap with this question. Verified S no overlap between the two.

65 H 3 N ES Distractor D does not have valve # like other choices.

Revised to include valve #. SAT 66 F 3 N E Add, During Core Alterations, at a minimum Delete Core Alts from the end. C2 & D2 should be SRMs, not Gamma Metrics. Revised as indicated with the exception of S gamma metrics. Site confirmed this part is correct.

67 H 3 M S 68 F 3 N E

Possible overlap w/ JPM. Minutia? Why not use CR Evacuation?

REF Update S New question written that meets above criteria. SAT 69 H 3 N S 70 H 3 N ES KA is an AND. Question only uses Mechanical print. New question uses both prints. SAT

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 71 F 3 B U Add HIGH to 3rd bullet at the end of the sentence: in HIGH alarm.

This question overlaps with a scenario event. B& C are incorrect and are performed in a sim scenario.

Maybe key switch. This was in scenario 5. This is a spare scenario and should not be needed. Delete event if not S needed.

72 F 3 N U Overlaps with SU scenario. Maybe start above POAH.

Feed bypasses / station service. New question still overlaps with scenario. New question written. No longer overlaps S with any scenarios.

73 F 3 M E 2nd question is SRO Only. Revise 2nd question to be at the RO level.

If SM not present the RO ____ be required to perform the S emergency classification. Revised as noted above. SAT 74 F 3 M S K/A G2.4.3 75 F 2 X X Y N B U

1. Q=K/A on the second part Q only, Q is RO-level but arguable.

2. MODE is not given in the stem, and would be needed to correctly answer the Q given the intent. First part Q statement is worded awkwardly (saying that a TS LCO makes something a required control board instrument?)

3. First part Q is asking minutia in my opinion, other Chief Examiners may disagree. Argument is as follows: none of the ACTION statements in TS 3.3.3.3 require one hour actions or less, and fundamentally the Q is requiring the applicant to recall the full Table 3.3-5 information from memory. Because none of the ACTION statements are one hour or less, a reference would be required, or it would be SRO-only to know specific information from the Bases.

Q as submitted is U due to minutia (requiring applicant to know TS Table 3.3-5 from memory with no reference).

E Change relied upon to available?

S Revised as noted. SAT

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only Condition of Caution statement that the correct answer is based 76 H 3 N E upon is not met. The reactor is not subcritical at this point. No correct answer given. Still need to change 2nd question to say the reactor is subcritical. Change to say Subsequently, the reactor is S

subcritical.

Stem states in Mode 4. Two of the choices are for Hot Standby 77 H 3 X N E procedure usage. Need to change stem to be in Mode 3. Easy fix S so therefore column 7 marked as Enhancement.

Revised as noted. SAT D.3 plausibility statement for Part 2 is incorrect. This is not an action 78 H 3 X N E in the ONOP. No isolation steps in this procedure.

S Revised question selection to use ONOP-41.3 vs. ONOP-46.4. SAT Both parts are RO questions; therefore, not SRO only. Rx trip 79 F 1 X X M U criteria is RO knowledge. D.2 Turbine Brg Temp referenced. There S are no temperatures in ONOP-011.

Revised during prep week. SAT NRCOC not used in the procedure, spell out Ops Center. Is 4 hr.

80 F 2 X N E selection for distractor D plausible w/o a reference? If no, need to increase difficulty of question if reference given, otherwise this is a direct lookup. Made editorial change. Question does not require S

reference to respond correctly per OPS mgmt.

Question asked for Unit 4 response. Several Unit 3 EOP 81 H 3 X M E procedures given as reference. C.2 not plausible, if you choose to go to ECA-1.1, the only way out is to return to the procedure if effect prior to entry which would be ECA-1.2. This is not given as a S

choice. Revised question to include above choice as choice D.

82 H 3 N S Incorrect TS Table given. CHRRMS is given in Table 3.3-5 not 3.3.-

83 H 3 N ES

4. Remove commas from C & D, not needed. Revised. SAT Not SRO. 1 hour1.157407e-5 days 2.777778e-4 hours 1.653439e-6 weeks 3.805e-7 months TS call is RO knowledge. Low LOD. Question 84 H 3 N SUS changed to ask for different LCO that is not 1 hr and therefore not RO knowledge.

Possible overlap with Q81. Asked for licensee to check during 85 H 3 N E validation to ask if applicant used knowledge from Q81 for this S question? Added last bullet to lock down the timeline.

Licensee to provide procedure source that states locally implies 86 F 3 N ES from the control room. Licensee verified use of the word locally.

Is the SU Xfrmr INOP or the EDG? Licensee to verify. Verified 87 H 3 N ES

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only Change 4th bullet to 5% vs. Off-scale low to increase plausibility 88 H 3 X N E of other distractor choices. Also, D distractor states verify the event in progress, if you are in a LOCA as stated in the question, why would you enter this procedure? Distractor D plausibility is for FR-H.1 not for E-1. Needs correction. Revised as noted.

S CET temp increase added to include procedure change that became effective before the procedure freeze occurred.

Question stem gives a 2 hr. restoration. No 2 hr. designation in the 89 H 3 N E reference provided. Need to look to have a time that could be S misapplied using the reference provided. Licensee provided reasonable logic for misapplication.

Follow-up review. The core head is off in Mode 4 so it is not U plausible to use feed pump to establish secondary heat sink. No NC flow would exist to provide for core cooling. Plausibility analysis statement is incorrect. It states that the procedure allows this. This S is an incorrect statement.

Question stem changed to mode 5 to allow plausibility of bleed and feed as an option and allow plausibility of B2 & D2.

A.2, B.2 distractor is not provided as an option to pick incorrectly in 90 F 3 X B E the reference. Need reference provided (handout) that includes the S incorrect answer. Reference added. SAT Isnt a question reference required to answer this question? Change 91 H 3 X N E from 12 and 4 hrs as choices to 5 and 4 hrs and add a reference since the ST allows for a 1 hr thermal soak after rod motion. The answer will still be 4 hrs. No rod motion has occurred. Changes S

made. SAT E Follow-up review. How would you know the rod is mechanically bound? The B plausibility statement states this would be a required shutdown. Source not stated. But if true, why would you be asking the 2nd question? Not relevant if you need to shutdown. Remove mechanically bound portion to remove the questionable part?

Mechanically bound removed as a bullet and therefore no S implication of reactor shutdown is implied.

Supporting reference not provided for answer D.2. Licensee needs 92 F 3 N E to provide this information. Reference provided.

S NRCOC is not required to be notified and is not plausible. Possibly change to NRC resident notification.

Answer given A does not match correct answer C in the 93 H 3 N ES plausibility statement. Also, the highlighted answer per the key is marked as an ALERT. The correct answer is a SAE. All corrections made. SAT 94 H 3 B S

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 95 F 3 N S Questioned plausibility of distractor C. Data provided by licensee to 96 F 3 N S indicate question choice has been chosen in the past due to confusion by operators.

K/A G 2.3.14 97 F 2 X X Y Y N U

1. Q=K/A, Q is on SRO-only level.

2. Cues: second part Q statement of sampling frequency must be increased is teaching in the Q statement.

3. Minutia concern: Second part Q is asking actions greater than 2 hours2.314815e-5 days 5.555556e-4 hours 3.306878e-6 weeks 7.61e-7 months without a reference. I do not know of any K/A statement or other requirement that says SRO applicants must know TS action statements >1 hrs from memory.

Q as submitted is U due to minutia concerns (asking >1 hr ACTION statement/requirements without a reference provided).

7/15/16 New question submitted. Still UNSAT. Does not meet KA.

N U New question written but does not meet SRO Only criteria. Add U SRO piece such as EAL or TS basis.

S 2nd half question changed to ask SRO related question. SAT.

K/A G 2.1.36 98 H 2 Y Y B S

1. Q=K/A, Q is on SRO only level

2. Q appears S at this time.

Originally thought A train was not very plausible as all plant use train 99 F 3 N E B as the safety train. Licensee stated that there are train A items for S fire zone. Asked licensee to provide and possibly change question to this with a reference provided.

100 F 3 N S

Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

The answer choices are a collection of unrelated true/false statements.

The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).

ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Facility: /tjcfçy Po,jy Date of Exam: %,xam Level: RD X SRO Item Description Initials

1. Clean answer sheets copied before grading ,1/

2. Answer key changes and question deletions justified and documented y %

3. Applicants scores checked for addition errors (reviewers spot check> 25% of examinations) /l

)J/

4. Grading for all borderline cases (80 +/-2% overall and 70 or 80, as applicable, +/-4% on the SRO-only) reviewed in detail 1//4 y j(

5. All other failing examinations checked to ensure that grades are justified

7 .4/4; 44L

6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of il/A questions missed by half or more of the applicants 111 1 Printed Name/Signature Date

a. Grader /H,46t

b. Facility Reviewer(*)

w%/7 f7

c. NRC Chief Examiner (*) L.

U. NRC Supervisor (*) SEQkJ 3.

(*) The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

ML17191B483

Contents

Text

SUMMARY

SUMMARY

SUMMARY

SUMMARY

Navigation menu

ML17191B483

Text

SUMMARY

SUMMARY

SUMMARY

SUMMARY

Navigation menu

Search