ML21348A266

From kanterella
Jump to navigation Jump to search

NRC Comments on Draft Licensee-Developed Operating Test (Folder 2)
ML21348A266
Person / Time
Site: Susquehanna  Talen Energy icon.png
Issue date: 08/06/2021
From: Todd Fish
Operations Branch I
To:
Talen Energy
Shared Package
ML20259A339 List:
References
EPID: L-2021-OLL-0003
Download: ML21348A266 (9)


Text

ES-301 Facility:

Admin JPMs RO RO RO RO SRO SRO SRO SRO SRO Simulator/In-Plant JPMs A

B C

D E

F G

H I

J K

Susquehanna 1

ADMINTopic and KJA A1-2.1.20 A2-2.2.14 A3-2.2.12 A4-2.3.7 A2-2.2.14 A3-2.2.22 M-2.3.11 A5-2.4.41 Safety Function and KIA 1-202002A205 2-259001A402 3-239001A401 4-205000A206 5-223002A403 6-264000A 103 7-215005A 107 8-400000A201 1-201001A106 7-212000A202 5-295024EA119 2

LOD (1-5) 2.7 2.9 2.9 3.1 3.1 3.2 3.3 3.0 3.0 3.0 3.2 3.2 3.0 3.3 3.3 3.1 3.0 3.1 3.1 Operating Test Review Worksheet Exam Date: 7/26/21 3

4 5

Attributes Job Content 1/C Critical Scope 1-----.---.....----,---..---.....----.---+----..----1 U/E/S Perf.

Cues Overlap Focus Steps (N/B)

Std.

Key Minutia Job Link s

s s

s s

s s

s s

E s

s s

E s

s s

s s

Form ES-301-7 6

Explanation KIA 1s met b/c work request approval could result in rad release into secondary containment.

Reclassified step 13 as critical Enhanced task standard KJA is met b/c manual burst of the rupture disc is a method to control containment atmos here IRT hi OW ress.

ES-301 2

Form ES-301-7 Instructions for Completing This Table:

Check or mark any item(s) requiring a comment and explain the issue in the space provided using the guide below.

1.

Check each JPM for appropriate administrative topic requirements (COO, EC, Rad, and EP) or safety function requirements and corresponding KIA. Mark in column 1.

(ES-301, D.3 and 0.4)

2.

Determine the level of difficulty (LOD) using an established 1-5 rating scale. Levels 1 and 5 represent an inappropriate Qow or high) discriminatory level for the license that is being tested. Mark in column 2 (Appendix D, C.1.f)

3.

In column 3, uAttributes," check the appropriate box when an attribute is not met D The initial conditions and/or initiating cue is clear to ensure the operator understands the task and_ho_w !~_be~!n_._~Appendi~~*-B.~) _ _ ___ _

1 _______ _


*---- ---- *The-JPM*contains* appropriatecuesthartleifrlyinaicate when they snould be provided to-the examinee. Cue~ are obJective and not leading. (Appendix C, 0.1)

All critical steps (elements) are properly identified.

D The scope of the task is not too narrow (N) or too broad (8).

D Excessive overlap does not occur with other parts of the operating test or written examination. (ES-301, O.1.a, and ES-301, D.2.a)

D The task performance standard clearly describes the expected outcome CT.e., end state). Each perfom1ance step identifies a standard for successful completion of the step.

A valid marked up key was provided (e.g., graph interpretation, initialed steps for handouts).

4.

For column 4, "Job Content," check the appropriate box if the job content ffaw does not meet the following elements:

D Topics are linked to the job content (e.g., not a disguised task, task required in real job).

D The JPM has meaningful performance requirements that will provide a legitimate basis for-evaluating the applicant's understanding and ability to safely operate the plant. (ES-301, D.2.c)

5.

Based on the reviewer's Judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)nhancement, or (S)atisfactory? Mark the answer in column 5.

6.

In column 6, provide a brief description of any (U)nacceptable or (E)nhancement rating from column 5.

Save initial review comments and detail subsequent comment resolution so that each exam-bound JPM is marked by a (S}atisfactory resolution on this form.

ES-301 3

Form ES-301-7 Facility:

Susquehanna

  • Scenario:

1 Exam Date: 7/26/21 1

2 3

4 5

6 7

8 9

10 Event Realism/Cred.

Required Verifiable LO TS CTs Seen.

U/E/S Explanation Actions actions overlap 1

2.3 s

2 2.9 X

s 3

2.9 X

E No crew actions for this TS. Eliminated "I" designator.

4 3.0 s

  • - -~--1-*

--5--*-

E Modified malfunction such that onlv 2 bvoass valves fail ooen.

6 3.3 X

s 3.2 X

X E

Modified CT #2: bounded task to spray before sat pressure curve 7

exceeded.

8 3.3 s

9 3.1 s

E Added additional malfunction to qet 2nd Tech Spec determination.

I'/.'_.';,:-**** *,,::\\.:'t*: /:/:;':/.:'.):/;)::.?(> },::,,'.:,:;;;:_:::;:i/ ~\\?::/):'i-/:i. [;:::;;;:\\:/.;:;.'. :/)\\'-):::-,-; l'r::;.-;-:_,*.-*.::=,... ****:.-::::.-/:_:° -.~::-:*:.:_-:".(.-r-~;

4 Form ES-301-7 Facility:

Susauehanna Scenario:

2 Exam Date: 7/26/21 1

2 3

4 5

6 7

28 9

10 Event Realism/Cred.

Required Verifiable LOD TS CTs Seen.

U/E/S Explanation Actions actions Overlap 1

2.3 s

2 2.9 X

E Revised svstem resoonse to include operator actions.

3 3.3 s

4 3.3 s

E Revisea system response to include accumulator trouble, to provide 2nd 5

3.5 Tech Soec determination 6

3.3 X*

E "Eliminated Critical Task APE.CT.03 (not valid CTI.

7 3.2 x,x E

Revised CT; EPE.CT.21 Lower RX level to between -60 to -161" 8

3.2 s

9 3.2 s

ES-301 5

Form ES-301-7 Facilitv:

Susquehanna Scenario:

3 Exam Date: 7/26/21 1

2 3

4 5

6 7

8 9

10 Event Realism/Cred.

Required Verifiable LOD TS CTs Seen.

UJE/S Explanation Actions actions Overlap 1

2.4 s

2 2.9 X

E Eliminated *c* desii:ination b/c no crew actions for this malfunction 3

3.1 X

E Added TS attribute to event type.

4 3.2 s


- - -E-- --------- ------- --

-5

-3:4

-x--

Revised CT: "... close MSIVs and drains before GE conditions met" 6

3.2 X

E Revised CT: "... perform an ED before GE conditions met" 7

3.0 s

8 3.4 s

  • .=.*=?')./:\\i;"} 1"):::/(_:--**,::,,:_*,::,:i_;, *'/

=:.'.. =,::;_-;: :-.=/::.*


**.********-................................................................................ -....... ---~--.. *-**********----*-.. ***.. ***********.. ********................. _____________ _

ES-301 Form ES-301~7

~*

Facilitv:

Susauehanna Scenario:

4 Exam Date: 7/26/21 1

2 3

4 5

6 7

8 9

10 Event Realism/Creel.

Required Verifiable LOD TS CTs Seen.

. U/E/S Explanation Actions actions Overlap 1

2.4 s

2 2.9 X

s 3

3.1 X

E Eliminated "C" desianation b/c no crew actions for this malfunction 4

3.2 X

" s 5

3A s

6 3.2 s

7 3.0 X

E Modified CT to *... before RX level lowers less than -179" 8

3.1 X

s

/

k:*/if/;-'.\\'/:t 1;;:::::(/)),(//:*j/:) 1r=::;:,:::,;,i:(\\i 1<**:::.,.;':.. :.-.,-:'.:::°-:' \\(*:=-:*-:**_*:_.::: r.*** ::::*:./.-

ES-301 7

Form ES-301-7 Instructions for Completing This Table:

Use this table for each scenario for evaluation.

2 Check this box if the events are not related (e.g., seismic event followed by a pipe rupture) OR if the events do not obey the laws of physics and thermodynamics.

3, 4 In columns 3 and 4, check the box if there is no verifiable or required action, as applicable. Examples of required actions are as follows: (ES-301, D.5f) opening, closing, and throttling valves starting and stopping equipment raising and lowering level, flow, and pressure making decisions and giving directions ackn~~~ging or verifyingJ<ey alc1rms and automatic t;!ciLo~(Uncomplicated eventsJhat.r:e_quire_no_operator action_beyond_this__ _ _____________ ----- -- -----

should not be included on the operating test unless they are necessary to set the stage for subsequent events. (Appendix D, 8.3).)

5 Check this box if the level of difficulty is not appropria1e.

6 Check this box if the event has a TS.

7 Check this box if the event has a critical task (C1). If the same CT covers more than one event, check the event where the CT started only.

8 Check this box if the event overlaps with another event on any of the last two NRG examinations. (Appendix D, C.1.t) 9 Based on the reviewer's judgment, is the event as written (U)nacceptable (requiring repair or replacement), in need of (E)nhancement, or (S}atisfactory? Mark the answer in column 9.

10 Record any explanations of the events here.

In the shaded boxes, sum the number of check marks in each column.

In column 1, sum the number of events.

In columns 2-4, record the total number of check marks for each column.

In column 5, based on the reviewer's judgement, place a checkmark only if the scenario's LOO is not appropriate.

In column 6, TS are required to be~ 2 for each scenario. (ES-301, 0.5.d)

In column 7, preidentified CTs should be~ 2 for each scenario. (Appendix D; ES-301, O.5.d; ES-301-4)

In column 8, record the number of events not used on the two previous NRC initial licensing exams. A scenario is considered unsatisfactory if there is < 2 new events. (ES-301, D.5.b; Appendix D, c_ 1.f)

In column 9, record whether the scenario as written (U)nacceptable, in need of (E)nhancement, or (S)atisfactory from column 11 of the simulator scenario table.

ES-301 8

Form ES-301~7 Facility:

Susquehanna Exam Date:

1 2

3 4

5 6

7 8

11 Scenario Event Events TS TS CT CT

% Unsat.

Explanation Totals Unsat Total Unsat.

Total Unsat.

Scenario U/E/S Elements 1

9 0

1 0

2 0

0 E

Added additional TS related event; enhanced boundary for CT 2

9 0

1 0

3 1

0 E

Added addition:;i.l TS related event; eliminated 1 CT 3

8 0

2 0

2 0

0 E

Enhanced boundaries for CT's 4

8 0

2 0

2 0

0 s

Minor boundary revision to 1 CT


~ -- ---

-- --~- -- -----

I.nstructions for Completing This Table:

Check or mark any item(s) requiring comment and explain the issue in the space provided.

1, 3, 5 For each simulator scenario, enter the total number of events (column 1), TS entries/actions (column 3), and CTs (column 5).

This number should match the respective scenario from the event-based scenario tables (the sum from columns 1, 6, and 7, respectively).

2,4,6 For each simulator scenario, evaluate each event, TS, and CT as (S)atisfactory, (E)nhance, or (U)nsatisfactory based on the following criteria:

.a.

Events. Each event is described on a Form ES-D-2, including all switch manipulations, pertinent alarms, and verifiable actions. Event actions are balanced between at-the-controls and balance-of-plant applicants during the scenario. All event-related attributes on Form ES-301-4 are met. Enter the total number of unsatisfactory events in column 2.

b.

TS. A scenario includes at least two TS entries/actions across at least two different events. TS entries and actions are detailed on Form ES-D-2. Enter the total number of unsatisfactory TS entries/actions in column 4. (ES-301, D.5d)

c.

CT. Check that a scenario includes at least two preidentified CTs. This criterion is a target quantitative attribute, not an absolute minimum requirement. Check that each CT is explicitly bounded on Form ES-O-2 with measurable performance standards (see Appendix D). Enter the total number of unsatisfactory CTs in column 6.

7 In column 7, calculate the percentage of unsatisfactory scenario elements:

(2+4+6) 1 +3+5 100%

8 If the value in column 7 is> 20%, mark the scenario as (U)nsatisfactory in column 8. If column 7 is::; 20%, annotate with (E)nhancement or (S)atisfactory.

9 In column 9, explain each unsatisfactory event, TS, and CT. Editorial comments can also be added here.

Save initial review comments and detail subsequent comment resolution so that each exam-bound scenario is marked by a (S)atisfactory resolution on this form.

ES-301 9

Form ES-301-7 Site name:

Susquehanna Exam Date: 07/26/21 OPERATING TEST TOTAll.S Total Total Total Total Explanation Unsat.

Edits Sat.

Unsat.

Admin.

9 0

0 9

JPMs Sim./ln~Plant MINOR EDITS TO CLARIFY INITIATING 11 0

2 11 CUES AND RECLASSIFY SOME JPM STEPS JPMs AS CRITICAL STEPS REVISED DEFINITIONS OF SEVERAL CT'S; Scenarios 4

0 14 4

DpWNGRADED SEVERAL TS RELATED EVENTS B/C MALF DID NOT REQUIRE CREW ACTIONS Op. Test 24 0

16 24 0

Totals:

Instructions for Completing This Table:

i Update data for this table from quality reviews and totals in the previous tables and then calculate the percentage of total items that are unsatisfactory and give an explanation in the space pt 1ovided.

1.

Enter the total number of items submitted for the operatin~ test in the "Total" column. For example, if nine administrative JP Ms were submitted, enter "9" in the 1'Total" items column for administrative JPMs.

For scenarios, enter the total number of simulator scenari9s.

2.
3.
4.
5.
6.

I Enter the total number of (U)nsatisfactory JPMs and scen~rios from the two JPMs column 5 and simulator scenarios column 8 in the previous tables. Provide an explanation in the space provided.

I Enter totals for (E)nhancements needed and (S)atisfactol)i JPMs and scenarios from the previous tables. This task is for tracking only.

i Total each column and enter the amounts in the "Op. Test!Totals" row.

Calculate the percentage of the operating test that is {U)n~atisfactory (Op. Test Total Unsat.)/(Op. Test Total) and place this value in the balded"% Unsat." cell.

i Refer to ES-501, E.3.a, to rate the overall operating test a~ follows:

I satisfactory, if the "Op. Test Total""% Unsat." is s: 2p%

unsatisfactory, if "Op. Test Total""% Unsat." is > 20%

Update this table and the tables above with post-exam changes if the "as-administered" operating test required content changes, including the following:

\\

The JPM performance standards were incorrect.

The administrative JPM tasks/keys were incorrect. i CTs were incorrect in the scenarios (not including postscenario critical tasks defined in Appendix D).

The EOP strategy was incorrect in a scenario(s).

i TS entries/actions were determined to be incorrect in a scenario s.