ML18044A146

2017 Byron Station Initial License Examination Form ES-301-7

ML18044A146
Person / Time
Site:	Byron
Issue date:	12/14/2017
From:	Jesse Seymour, Bielby M NRC/RGN-III/DRS/OLB
To:	Exelon Generation Co
Seymour J
Shared Package
ML17152A381	List: ML18039A553 ML18039A572 ML18039A648 ML18039A664 ML18044A146 ML18044A169 ML18044A173 ML18044A177
References
Download: ML18044A146 (19)

Text

ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Byron Station Units 1 & 2 Exam Date: December 2017 1 3 4 2

ADMIN Attributes Job Content 5 6 Admin JPMs LOD Topic I/C Critical Scope Perf. Job U/E/S Explanation (1-5) Cues Overlap Key Minutia and K/A Focus Steps (N/B) Std. Link NRC: An overall task standard is not stated; e.g.,

the examinee correctly identifies the eligibility, of Generic comments ALL each watch-stander, to assume the watch.

RESPONSE: This format same as previous submittals for ILE.

NRC: The first two bulleted items in the Initiating COO RA-1 3 E U E Cue are actually Initial Conditions.

2.1.4 RESPONSE

Will move to ICs.

NRC: INITIAL CONDITIONS - 2nd bulleted item is unnecessary since CUE is provided at appropriate step (PS 2).

RESPONSE: Agree, delete 2nd bullet.

NRC: What does C/P stand for? Spell it out or add a NOTE to the Evaluator at the beginning of the JPM.

RESPONSE: Control Power = CP.

NRC: 1) PS 4(19); Step should be listed after PS 17(25); 2) PS 5, 6, 20, and 21; CUES should only address SX Pump operability. Valve status is obtained from control board observations.

Additionally, examinee should not have to ask for pump status, this should be apparent from COO control room indications and/or INITIAL RA-2 2 E U U U 2.1.31 CONDITIONS (i.e., proper lineup and no active LCO Actions).

RESPONSE: Will change order, IC states no LOCARs and no equipment OOS.

NRC: 1) PS 8, 17 and 25; local valve position determination CUE should be WHEN not IF. 2) PS 9(24); why is a CUE necessary if C/P is available?

RESPONSE: Will change.

NRC: 1) PS 25; Not a critical step since valve is already open and alternate flow path is available.

2) How are the Main Body procedure steps supposed to be marked (initials, check marks, etc)

RESPONSE: 1) Agree; 2) circle/initial/slash NRC: INITIAL CONDITIONS/INITIATING CUE are not operationally valid. Unlikely that a carpenter would be able to specify cubicle EC U U RA-3 2 E location unless breaker EID specifies cubicle 2.2.15 S S location. Also likely that the WEC would dispatch an operator to visually investigate the status.

RESPONSE: Discussed, ok as is.

ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Byron Station Units 1 & 2 Exam Date: December 2017 1 3 4 2

ADMIN Attributes Job Content 5 6 Admin JPMs LOD Topic I/C Critical Scope Perf. Job U/E/S Explanation (1-5) Cues Overlap Key Minutia and K/A Focus Steps (N/B) Std. Link NRC: The task itself is not significantly modified.

U The modification simply incorporates EP U RA-4 2 administration in a Training Only platform on the 2.4.43 S S computer.

RESPONSE: Was misidentified as a repeat.

NRC: 1) INITIATING CUE; Bulleted items are unnecessary and provide unintended cues to completing the assigned task. Restate cue: As the responsible on-shift SRO, identify the STA staffing requirements, and implement required actions - if any - to address the above scenario.

2) Add an Evaluator NOTE stating that the COO U Available STAs may be called in any order, and SA-1 2 E E 2.1.5 S that when STA #3 (Edward Fox) availability is confirmed and he is directed to report to work (PS 5 and 6 commpleted), the JPM can be terminated. 3) Add statement to the STANDARD for PS 3, 4, and 7 (or new steps) indicating that the contacted individual need not report to work.

RESPONSE: 1) OK as is. 2) Will add note; 3) Will add bullet.

NRC: 1) This is not a SRO only task. The task simply involves mathematical manipulation and graph reading. 2) PS 5; the allowable band is too wide. A band of 4700 to 4750 is more realistic COO U U SA-2 2 since the reactor pressure (1500 psi) does not 2.1.25 S S require any interpretatijon.

RESPONSE: This is SRO task, 2012 exam competency. 7D is SRO only; 2) Will tighten band.

NRC: 1) INITIATING CUE; Provides an unintended cue to completing the assigned task.

As worded the cue eliminates the determination of whether the door falls within the scope of the EC U E Plant Barrier Impairment. Restate cue: As the SA-3 3 2.2.14 S S WEC, initiate any required actions for the condition described above. 2) NOTE prior to PS 1; Add When requested (or need to reference is identified)

RESPONSE: 1) and 2) OK as is.

ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Byron Station Units 1 & 2 Exam Date: December 2017 1 3 4 2

ADMIN Attributes Job Content 5 6 Admin JPMs LOD Topic I/C Critical Scope Perf. Job U/E/S Explanation (1-5) Cues Overlap Key Minutia and K/A Focus Steps (N/B) Std. Link NRC: 1) NOTE prior to PS 1; Containment Noble Gas Activity and Containment Tritium Activity radiochemistry analyses AND RETDAS generated Pre-Release Permit need to be included with the partially completed BCP 400-TCNMT/ROUTINE provided to the examinee.

RAD U U 2) NOTE prior to PS 2; typo - word (until?)

SA-4 3 2.3.6 S S missing from statement. 3) PS 3; add a bulleted (closed) statement to the STANDARD box with a requirement that the examinee determines that the release cannot be approved until the remainder of section 4.2.1 is completed. Remove NOTE prior to PS 3.

RESPONSE: 1) OK as is; 2) and 3) incorporate.

NRC: 1) Add NOTE PRIOR to PS 2; Radiation Protection Manager Signature not EP SA-5 3 U E required prior to approval. Per the IC, the 2.4.38 TSC and OSC have not be staffed.

RESPONSE: 1) Incorporate.

ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Byron Station Units 1 & 2 Exam Date: December 2017 3 4 1 2 Simulator/In-Plant Attributes Job Content 5 6 Safety Function LOD JPMs I/C Critical Scope Perf. Job U/E/S Explanation and K/A (1-5) Cues Overlap Key Minutia Focus Steps (N/B) Std. Link NRC: 1) An overall task standard is not stated; e.g., the examinee correctly Generic comments ALL identifies the eligibility, of each watch-stander, to assume the watch.

RESPONSE: 1) Incorporate NRC: 1) Better K/A would be 4.06; 2)

Change title: Respond to Excess Letdown High Temperature 2(1) Condition. 3) Change Safety CR-a 2 E 004A4.06 Function in ES-301-2 to 2 (from 1);

Task is related to Inventory Control and not Reactivity Control.

RESPONSE: 1), 2), 3) incorporate.

NRC: 1) ES-301-2 should be revised to reflect change in title (exercise test vs stroke time test). 2) This is not an alternate path JPM. There are no verifiable operator actions after 3 1RY8000B fails to open. 3) PS 15; CR-b 2 U U U 010A4.03 Since valve fails to open, this should not be a critical step. 4) PS 15; 1st bullet of performance standard should be Attempts to OPEN RESPONSE: Incorporate 1), 2), 4).

3) Was not meant to be Alt Path.

4P CR-c 3 S 003A4.08 4S CR-d 2 S 076A4.02 5

CR-e 2 S 026A4.01 6

CR-f 3 S 062A4.01 NRC: 1) PS 2; Standard should include recognition that the discharge 8 valve is not closing. 2) Alternate CR-g 2 U E 075A2.02 Path?

RESPONSE: 1) Incorporate; 2) Was identified as Alt Path last year.

ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Byron Station Units 1 & 2 Exam Date: December 2017 3 4 1 2 Simulator/In-Plant Attributes Job Content 5 6 Safety Function LOD JPMs I/C Critical Scope Perf. Job U/E/S Explanation and K/A (1-5) Cues Overlap Key Minutia Focus Steps (N/B) Std. Link NRC: 1) JPM is too long.

Recommend deleting the source check portion and perform only the functional test of 0PA202 (cue 9

CR-h 4 E performance of BCP 400 step 5.1.2 071A4.25 and terminate the JPM when the functional test of 0PA202 is complete; procedure step 5.1.2.14)

RESPONSE: 1) Will rewrite JPM.

NRC: 1) INITIAL CONDITIONS; recommend changing the second bullet to read _A MG set is running and suppling the Rod Drive Power Cabinet. 2) PS 16; associated procedure step simply states to release the Field Flash pushbutton when voltage is steady (i.e., no numerical value). 3) PS 18; shouldnt adjusting voltage to the required value be critical? 4) PS 22; Closing the _B MG Set Motor Breaker should 1 U U be a separate bullet (closed) and IP-i 4 001G2.1.30 S critical [or better yet a completely separate JPM step]. The associated cue for the Motor Breaker green light

[and control switch flag] should not be given until the examinee simulates closing the breaker.

5) PS 24; the Motor Breaker control switch will already be in AFTER-CLOSE from the previous step.

RESPONSE: Incorporate 1), 2), 3).

4) Note, Motor and Generator auto close within 5 seconds. 5) Auto close.

ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Byron Station Units 1 & 2 Exam Date: December 2017 3 4 1 2 Simulator/In-Plant Attributes Job Content 5 6 Safety Function LOD JPMs I/C Critical Scope Perf. Job U/E/S Explanation and K/A (1-5) Cues Overlap Key Minutia Focus Steps (N/B) Std. Link NRC: 1) PS 3 and 5; NOT a critical step, no action is required. 2) PS 11 and 12; should not be critical steps 6

IP-j 2 U E since once step 10 is completed the APE057AA1.01 CVT is supplying the Inst Bus independent of the inverter.

RESPONSE: Incorporate 1) and 2).

NRC: 1) INITIATING CUE; Remove DO NOT perform 1BOA PRI-5. The first statement specifically directs performance per BOP VC-7. 2) PS 5; Based on the procedural direction to 8

IP-k E HOLD the associated control switch in APE068AA1.24 the previous step, shouldnt the standard for step 5 simply state to release the control switch to the AUTO position.

RESPONSE: Incorporate 1) and 2).

ES-301 7 Form ES-301-7 Instructions for Completing This Table:

Check or mark any item(s) requiring a comment and explain the issue in the space provided using the guide below.

1. Check each JPM for appropriate administrative topic requirements (COO, EC, Rad, and EP) or safety function requirements and corresponding K/A. Mark in column 1.

(ES-301, D.3 and D.4)

2. Determine the level of difficulty (LOD) using an established 1-5 rating scale. Levels 1 and 5 represent an inappropriate (low or high) discriminatory level for the license that is being tested. Mark in column 2 (Appendix D, C.1.f)

3. In column 3, Attributes, check the appropriate box when an attribute is not met:

The initial conditions and/or initiating cue is clear to ensure the operator understands the task and how to begin. (Appendix C, B.4)

The JPM contains appropriate cues that clearly indicate when they should be provided to the examinee. Cues are objective and not leading. (Appendix C, D.1)

All critical steps (elements) are properly identified.

The scope of the task is not too narrow (N) or too broad (B).

Excessive overlap does not occur with other parts of the operating test or written examination. (ES-301, D.1.a, and ES-301, D.2.a)

The task performance standard clearly describes the expected outcome (i.e., end state). Each performance step identifies a standard for successful completion of the step.

A valid marked up key was provided (e.g., graph interpretation, initialed steps for handouts).

4. For column 4, Job Content, check the appropriate box if the job content flaw does not meet the following elements:

Topics are linked to the job content (e.g., not a disguised task, task required in real job).

The JPM has meaningful performance requirements that will provide a legitimate basis for evaluating the applicant's understanding and ability to safely operate the plant. (ES-301, D.2.c)

5. Based on the reviewers judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)nhancement, or (S)atisfactory? Mark the answer in column 5.

6. In column 6, provide a brief description of any (U)nacceptable or (E)nhancement rating from column 5.

Save initial review comments and detail subsequent comment resolution so that each exam-bound JPM is marked by a (S)atisfactory resolution on this form.

ES-301 8 Form ES-301-7 Facility: Byron Station Units 1 & 2 Scenario: N17-1 Exam Date: December 2017 2 3 4 8 1 5 6 7 9 10 Realism/ Required Verifiable Scen.

Event LOD TS CTs U/E/S Explanation Cred. Actions actions Overlap NRC: Enhancement RO actions; indent (one step) all bulleted actions after the 1 React S second bullet.

LICENSEE: Agree NRC: 1) First RO action (as well as HC direction) is not consistent with BOA Inst-2.

For low failure of a pressure instrument, the BOA directs that operator take manual control first then select an operable channel.

2) For the Tech Spec determination:

a. List each applicable LCO including and associated functional units (e.g.,

LCO 3.3.1, Functions 6, 8a, and 8b)

b. For each LCO/Functional Unit, list the applicable CONDITION, 2 E E E REQUIRED ACTION, and COMPLETION TIME (e.g., for LCO 3.3.1, CONDITION A, RA A.1, CT Immediately; for Function 6, CONDITION E, RA E.1 (channel in trip) CT 72 hours8.333333e-4 days <br />0.02 hours <br />1.190476e-4 weeks <br />2.7396e-5 months <br /> OR E.2 (Mode 3), CT 78 hours9.027778e-4 days <br />0.0217 hours <br />1.289683e-4 weeks <br />2.9679e-5 months <br />; Function 8a, CONDITION K, RA K.1 (channel in trip) CT 72 hours8.333333e-4 days <br />0.02 hours <br />1.190476e-4 weeks <br />2.7396e-5 months <br /> OR K.2 (reduce power below P-7) CT 78 hours9.027778e-4 days <br />0.0217 hours <br />1.289683e-4 weeks <br />2.9679e-5 months <br />; for Function 8b, CONDITION E, RA E.1 (channel in trip) CT 72 hours8.333333e-4 days <br />0.02 hours <br />1.190476e-4 weeks <br />2.7396e-5 months <br /> OR E.2 (Mode 3), CT 78 hours9.027778e-4 days <br />0.0217 hours <br />1.289683e-4 weeks <br />2.9679e-5 months <br />).

LICENSEE: Agree NRC: Explain what would cause the 1C FW Pp control to shift to MANUAL (is this the 3 E E same as Speed Setter Control Mode?).

LICENSEE: Has happened for real.

4 E E NRC: CV 121 Fails Open; 2016 Scenario 5, Event 6 NRC: Per the R11 of NUREG 1021, starting the Standby GC pump before the Turbine E

5 Generator (Plant) Trips should be a Critical Task LICENSEE: Agree.

NRC: For the Tech Spec determination:

a. List each applicable LCO including and associated functional units 6 E E b. For each LCO/Functional Unit, list the applicable CONDITION, REQUIRED ACTION, and COMPLETION TIME LICENSEE: Agree 7 E U E NRC: 1) Should loss of Aux Feed be staggered?

ES-301 9 Form ES-301-7 Facility: Byron Station Units 1 & 2 Scenario: N17-1 Exam Date: December 2017 2 3 4 8 1 5 6 7 9 10 Realism/ Required Verifiable Scen.

Event LOD TS CTs U/E/S Explanation Cred. Actions actions Overlap

2) CT-1 not explicitly bounded with measurable performance standards.

LICENSEE: 1) Agree; 2) Word for work from WOG. Will add.

NRC: 1) Event should be classified as a Major Transient and not just a Component 8 U S failure. 2) CT-46 not explicitly bounded with measurable performance standards.

LICENSEE: 1) Will add M(2); 2) CT-46 Word for work from WOG 8 2 1 2 2 1 0/6/2

ES-301 10 Form ES-301-7 Facility: Byron Station Units 1 & 2 Scenario: N17-2 Exam Date: December 2017 3 4 8 1 2 5 6 7 9 10 Required Verifiable Scen.

Event Realism/Cred. LOD TS CTs U/E/S Explanation Actions actions Overlap NRC: 1) 1SI8875B is named Accumulator Vent Vlv in the BOP; Scenario Guide calls it a Fill valve. Nomenclature should be consistent.

2) Step to close 1SI8880 is missing from Scenario Guide

3) For the Tech Spec determination (BOL 5.1):

1 E E

a. List each applicable LCO including and associated functional units

b. For each LCO/Functional Unit, list the applicable CONDITION, REQUIRED ACTION, and COMPLETION TIME LICENSEE: Incorporate 1), 2), 3).

2 S NRC: 1) What is the basis for entering 1BOA Elect 2? There does not appear to be any entry condition.

2) For the Tech Spec determination:

3 E E E a. List each applicable LCO including and associated functional units

b. For each LCO/Functional Unit, list the applicable CONDITION, REQUIRED ACTION, and COMPLETION TIME LICENSEE: 1) Make open bullet; 2) will incorporate 4 2 S Marginal LOD NRC: 1) For the Tech Spec determination:

a. List each applicable LCO including and associated functional units

b. For each LCO/Functional Unit, list the applicable CONDITION, 5 E E E REQUIRED ACTION, and COMPLETION TIME

2) Pzr Level Channel Fails High; 2014 Scenario 4, Event 2 LICENSEE: Will incorporate 1) and 2).

6 S 7 S 8/9 S NRC: 1) May want to delay PORV failure to coincide with LOOP and tie success path to closure of block valve after power restoration. Maybe have PORV not 10 2 S(2) S fully close when C/S taken to close in attempt to close PORV.

LICENSEE: 1) Incorporate

ES-301 11 Form ES-301-7 Facility: Byron Station Units 1 & 2 Scenario: N17-2 Exam Date: December 2017 3 4 8 1 2 5 6 7 9 10 Required Verifiable Scen.

Event Realism/Cred. LOD TS CTs U/E/S Explanation Actions actions Overlap 10 1 1 2 3 2 2 0/5/5

ES-301 12 Form ES-301-7 Facility: Byron Station Units 1 & 2 Scenario: N17-3 Exam Date: December 2017 3 4 8 1 2 5 6 7 9 10 Required Verifiable Scen.

Event Realism/Cred. LOD TS CTs U/E/S Explanation Actions actions Overlap 1 S NRC: 1) BAR 1-9-A4 refers the operator to BOP AB-6. Add clarifying note that BOP AB-6 refers the operator to BOP AB-17. 2) Boric Acid Transfer Pump Trip; 2 E S 2014 Scenario 4, Event 6 LICENSEE: Incorporate 3 S NRC: 1) TS only call for SRO

2) For the Tech Spec determination:

c. List each applicable LCO including and associated functional units 4 E E S

d. For each LCO/Functional Unit, list the applicable CONDITION, REQUIRED ACTION, and COMPLETION TIME LICENSEE: 1) and 2) Agree NRC: 1) For the Tech Spec determination:

e. List each applicable LCO including and associated functional units

f. For each LCO/Functional Unit, list the applicable CONDITION, REQUIRED ACTION, and COMPLETION TIME 5 E E E

2) Should include action for local investigation accumulator/reservoir. 3) SG PORV Trouble 2014 Scenario 4, Event 1; Same actions except that PORV is not open in 2014 Scenario LICENSEE: 1), 2), 3) Agree.

NRC: 1) BOP response box: BAR 1-8-C5 will not alarm due to temp indication failing low. BOP should first refer BAR 1-9-E2 to mitigate the event. 1-9-E2 6 E E eventually refers the operator to 1-8-C5, but there does not appear to anything added to the response actions.

LICENSEE: Agree.

7 S NRC: 1) Feed Pump Speed Control Failure; 2014 Scenario 4, Event 7 and 2014 Scenario 5, Event 3; While the malfunctioning instrument is different, the 8 E S response actions are similar [both events require manual control of feed pump speed; one raises speed and the other lowers speed].

ES-301 13 Form ES-301-7 Facility: Byron Station Units 1 & 2 Scenario: N17-3 Exam Date: December 2017 3 4 8 1 2 5 6 7 9 10 Required Verifiable Scen.

Event Realism/Cred. LOD TS CTs U/E/S Explanation Actions actions Overlap NRC: 1) Recommend moving E-0 Attachment B actions to a separate section/attachment to scenario guide. 2) SG Tube Rupture; 2014 Scenario 4, Event 8; The only notable difference is that the 2014 event utilizes sprays for 9/10 U(2) E S(2)

RPV depressurization. 3) CT-18 and -20 not explicitly bounded with measurable performance standards.

LICENSEE: Agree 1), 2), 3) 10 1 3 1 0 2 2 2 0/2/8

ES-301 14 Form ES-301-7 Facility: Byron Station Units 1 & 2 Scenario: N17-4 Exam Date: December 2017 3 4 8 1 2 5 6 7 9 10 Required Verifiable Scen.

Event Realism/Cred. LOD TS CTs U/E/S Explanation Actions actions Overlap 1 NRC: 1) Delete the word time from event description 2) Add bulleted item to verify valve has been returned to the as found position recorded earlier and to S

repeat the above steps for each valve to be tested.

LICENSEE: Will incorporate 1) and 2) 2 S 3 S 4 NRC: 1) For the Tech Spec determination:

a. List each applicable LCO including and associated functional units

b. For each LCO/Functional Unit, list the applicable CONDITION, E E E REQUIRED ACTION, and COMPLETION TIME

2) MSIV Actuator Trouble; 2014 Scenario 3, Event 6; 2014 event was at lower power (Mode 2) and involved both actuators.

LICENSEE: Incorporate 1) and 2).

5 NRC: For the potential Tech Spec determination:

a. List each applicable LCO including and associated functional units E E b. For each LCO/Functional Unit, list the applicable CONDITION, REQUIRED ACTION, and COMPLETION TIME LICENSEE: Will incorporate.

6 E S NRC: 1) HD Pump trip with inability to start standby pump; 2014 Scenario 3, Event 4; The 2017 Exam events result in a sequential loss, but have the same 7 end result - Turbine runback.

E S LICENSEE: Will verify.

8/9/10 NRC: Events 8-10 should be listed as a single Major Event, an ATWS with Rod Control Malfunction and Turbine Trip Failure. Events 9 and 10 are both tied E

directly to the ATWS mitigation.

LICENSEE: Will rewrite MT events into one MT event.

9 NRC: CT-50 and -52 not explicitly bounded with measurable performance U(2) S standards.

LICENSEE; Will rewrite to incorporate comment.

10 E S 1. Turbine Trip Failure

ES-301 15 Form ES-301-7 Facility: Byron Station Units 1 & 2 Scenario: N17-4 Exam Date: December 2017 3 4 8 1 2 5 6 7 9 10 Required Verifiable Scen.

Event Realism/Cred. LOD TS CTs U/E/S Explanation Actions actions Overlap

a. 2014 Scenario 1, Event 9

b. 2016 Scenario 5, Event 9 9 0/3/7 2 2 3

ES-301 16 Form ES-301-7 Instructions for Completing This Table:

Use this table for each scenario for evaluation.

2 Check this box if the events are not related (e.g., seismic event followed by a pipe rupture) OR if the events do not obey the laws of physics and thermodynamics.

3, 4 In columns 3 and 4, check the box if there is no verifiable or required action, as applicable. Examples of required actions are as follows: (ES-301, D.5f)

• opening, closing, and throttling valves

• starting and stopping equipment

• raising and lowering level, flow, and pressure

• making decisions and giving directions

• acknowledging or verifying key alarms and automatic actions (Uncomplicated events that require no operator action beyond this should not be included on the operating test unless they are necessary to set the stage for subsequent events. (Appendix D, B.3).)

5 Check this box if the level of difficulty is not appropriate.

6 Check this box if the event has a TS.

7 Check this box if the event has a critical task (CT). If the same CT covers more than one event, check the event where the CT started only.

8 Check this box if the event overlaps with another event on any of the last two NRC examinations. (Appendix D, C.1.f) 9 Based on the reviewers judgment, is the event as written (U)nacceptable (requiring repair or replacement), in need of (E)nhancement, or (S)atisfactory? Mark the answer in column 9.

10 Record any explanations of the events here.

In the shaded boxes, sum the number of check marks in each column.

• In column 1, sum the number of events.

• In columns 2-4, record the total number of check marks for each column.

• In column 5, based on the reviewer's judgement, place a checkmark only if the scenario's LOD is not appropriate.

• In column 6, TS are required to be 2 for each scenario. (ES-301, D.5.d)

• In column 7, preidentified CTs should be 2 for each scenario. (Appendix D; ES-301, D.5.d; ES-301-4)

• In column 8, record the number of events not used on the two previous NRC initial licensing exams. A scenario is considered unsatisfactory if there is < 2 new events. (ES-301, D.5.b; Appendix D, C.1.f)

• In column 9, record whether the scenario as written (U)nacceptable, in need of (E)nhancement, or (S)atisfactory from column 11 of the simulator scenario table.

ES-301 17 Form ES-301-7 Facility: Exam Date:

1 2 3 4 5 6 7 8 11 Scenario  % Unsat. Explanation Event Events TS TS CT CT Scenario U/E/S Totals Unsat. Total Unsat. Total Unsat.

Elements CT-50 and -52 not explicitly bounded with measurable performance standards.

1 8 0 2 0 3 2 15 E TS(s) need to list LCO(s); condition(s); required action(s); completion time(s) 2 10 0 3 0 2 0 0 E TS(s) need to list LCO(s); condition(s); required action(s); completion time(s)

CT-50 and -52 not explicitly bounded with measurable performance standards.

3 10 0 2 0 2 2 14 E TS(s) need to list LCO(s); condition(s); required action(s); completion time(s)

CT-50 and -52 not explicitly bounded with measurable performance standards.

4 9 0 2 0 2 2 15 E TS(s) need to list LCO(s); condition(s); required action(s); completion time(s)

Instructions for Completing This Table:

Check or mark any item(s) requiring comment and explain the issue in the space provided.

1, 3, 5 For each simulator scenario, enter the total number of events (column 1), TS entries/actions (column 3), and CTs (column 5).

This number should match the respective scenario from the event-based scenario tables (the sum from columns 1, 6, and 7, respectively).

2, 4, 6 For each simulator scenario, evaluate each event, TS, and CT as (S)atisfactory, (E)nhance, or (U)nsatisfactory based on the following criteria:

a. Events. Each event is described on a Form ES-D-2, including all switch manipulations, pertinent alarms, and verifiable actions. Event actions are balanced between at-the-controls and balance-of-plant applicants during the scenario. All event-related attributes on Form ES-301-4 are met. Enter the total number of unsatisfactory events in column 2.

b. TS. A scenario includes at least two TS entries/actions across at least two different events. TS entries and actions are detailed on Form ES-D-2. Enter the total number of unsatisfactory TS entries/actions in column 4. (ES-301, D.5d)

c. CT. Check that a scenario includes at least two preidentified CTs. This criterion is a target quantitative attribute, not an absolute minimum requirement. Check that each CT is explicitly bounded on Form ES-D-2 with measurable performance standards (see Appendix D). Enter the total number of unsatisfactory CTs in column 6.

2+4+6 7 In column 7, calculate the percentage of unsatisfactory scenario elements: 100%

1+3+5 8 If the value in column 7 is > 20%, mark the scenario as (U)nsatisfactory in column 8. If column 7 is 20%, annotate with (E)nhancement or (S)atisfactory.

9 In column 9, explain each unsatisfactory event, TS, and CT. Editorial comments can also be added here.

ES-301 18 Form ES-301-7 Save initial review comments and detail subsequent comment resolution so that each exam-bound scenario is marked by a (S)atisfactory resolution on this form.

ES-301 19 Form ES-301-7 Site name: Exam Date:

OPERATING TEST TOTALS Total Total Total  %

Total Explanation Unsat. Edits Sat. Unsat.

Admin.

9 1 3 5 JPMs Sim./In-Plant 11 1 5 5 JPMs Scenarios 4 0 17 22 Op. Test 24 2 26 32 8 Totals:

Instructions for Completing This Table:

Update data for this table from quality reviews and totals in the previous tables and then calculate the percentage of total items that are unsatisfactory and give an explanation in the space provided.

1. Enter the total number of items submitted for the operating test in the Total column. For example, if nine administrative JPMs were submitted, enter 9 in the Total items column for administrative JPMs.

For scenarios, enter the total number of simulator scenarios.

Enter the total number of (U)nsatisfactory JPMs and scenarios from the two JPMs column 5 and 2.

simulator scenarios column 8 in the previous tables. Provide an explanation in the space provided.

Enter totals for (E)nhancements needed and (S)atisfactory JPMs and scenarios from the previous 3.

tables. This task is for tracking only.

4. Total each column and enter the amounts in the Op. Test Totals row.

Calculate the percentage of the operating test that is (U)nsatisfactory (Op. Test Total Unsat.)/(Op. Test 5.

Total) and place this value in the bolded % Unsat. cell.

Refer to ES-501, E.3.a, to rate the overall operating test as follows:

• satisfactory, if the Op. Test Total % Unsat. is 20%

• unsatisfactory, if Op. Test Total % Unsat. is > 20%

Update this table and the tables above with post-exam changes if the as-administered operating test 6.

required content changes, including the following:

• The JPM performance standards were incorrect.

• The administrative JPM tasks/keys were incorrect.

• CTs were incorrect in the scenarios (not including postscenario critical tasks defined in Appendix D).

• The EOP strategy was incorrect in a scenario(s).

• TS entries/actions were determined to be incorrect in a scenario(s).