ML110970432

WT-2011-03 Draft Op Test Comments

ML110970432
Person / Time
Site:	Waterford
Issue date:	03/21/2011
From:	NRC Region 4
To:	Entergy Operations
References
50-382/11-03
Download: ML110970432 (4)

Text

Attachment 10 Page 1 of 4 OBDI 202 - IOLE Process WT - 2011 - 03 DRAFT OPERATING TEST COMMENTS ADMIN JPMS JPM#

1.

Dyn (D/S)

2.

LOD (1-5)

3. Attributes

4. Job Content Errors

5.

U/E/S

6.

Explanation (See below for instructions)

IC Focus Cues Critical Steps Scope (N/B)

Over-lap Job-Link Minutia RO (A1)

S 2

E Task Element 1 - Indicate Figure 1.5.7.4 is used in this step. Fixed RO (A2)

S 3

S Data taken from Simulator - will verify during validation week. Yes RO (A3)

S 3

E Task Standard should include that the Applicant must also determine channel operability.

CRS directs youvice the CRS has directed you. This will be general comment for all JPMs. Fixed RO (A4)

S 2

S SRO (A5)

S 2

E Task Element 1 - Indicate Figure 1.5.7.4 is used in this step. Fixed SRO (A6)

S 2

S SRO (A7)

S 4

E Need to work through this on the Simulator. Should answer to Mode Change Allowed be Critical?

The Shift Manager directs you Already in Mode 1 so step is not critical.

SRO (A8)

S 3

S SRO (A9)

S 3

S Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.

1.

Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment.

2.

Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.

3.

Check the appropriate box when an attribute weakness is identified:

The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.

The JPM does not contain sufficient cues that are objective (not leading).

All critical steps (elements) have not been properly identified.

Scope of the task is either too narrow (N) or too broad (B).

Excessive overlap with other part of operating test or written examination.

4.

Check the appropriate box when a job content error is identified:

Topics not linked to job content (e.g., disguised task, not required in real job).

Task is trivial and without safety significance.

5.

Based on the reviewer=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

6.

Provide a brief description of any U or E rating in the explanation column.

7.

Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form.

0 Page 2 of 4 OBDI 202 - IOLE Process SITE - YEAR - MONTH DRAFT OPERATING TEST COMMENTS CONTROL ROOM/IN-PLANT SYSTEMS JPMS JPM#

1.

Dyn (D/S)

2.

LOD (1-5)

3. Attributes

4. Job Content Errors

5.

U/E/S

6.

Explanation (See below for instructions)

IC Focus Cues Critical Steps Scope (N/B)

Over-lap Job-Link Minutia S1 D

3 E

The CRS directs you (Bank)(Alt-Path) - Place in BOLD where alternate path begins for ease of Examiner review.

- this should be done for all alternate path JPMS Fixed Step through this JPM twice for two rods. Alt path is on second rod. Any reason not to allow alternate path on first rod and delete second rod? Fixed S2 D

3 E

(Modified)(Alt-Path) - Indicate where alternate path begins. Fixed S3 D

2 E

(Bank) - CRS directs you Fixed S4 D

2 S

(Modified)(Alt-Path)

S5 D

3 S

(Bank)

S6 D

4 E

(Bank)(Alt-Path) - The CRS directs you Fixed Task Element 15 - Critical? Marked as critical in step 22 - step 15 is kick to new procedure to begin synchronization.

Task Element 30 - Critical? No S7 D

2 E

(New) - The CRS directs you Fixed S8 D

2 S

(Bank)

P1 D

3 E

(Bank) - Task Element 4 is a verify - Should it be Critical? Yes P2 D

2 E

(Bank)(Alt-Path) - Task Element 8 Critical? No Do not see the alternate path. Fixed P3 D

2 S

(New Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.

1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment.

2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.

3. Check the appropriate box when an attribute weakness is identified:

$ The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.

0 Page 3 of 4 OBDI 202 - IOLE Process

$ The JPM does not contain sufficient cues that are objective (not leading).

$ All critical steps (elements) have not been properly identified.

$ Scope of the task is either too narrow (N) or too broad (B).

$ Excessive overlap with other part of operating test or written examination.

4. Check the appropriate box when a job content error is identified:

• Topics not linked to job content (e.g., disguised task, not required in real job).

• Task is trivial and without safety significance.

5. Based on the reviewer=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

6. Provide a brief description of any U or E rating in the explanation column.

7. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form.

0 Page 4 of 4 OBDI 202 - IOLE Process SITE - YEAR - MONTH DRAFT OPERATING TEST COMMENTS SCENARIOS Scenario Set

1.

ES

2.

TS

3.

Crit

4.

IC

5.

Pred

6.

TL

7.

L/C

8.

Eff

9.

U/E/S

10. Explanation (See below for instructions) 1 E

Event 3 - This should be a component malfunction vice a reactivity event. Fixed 2

E Event 1 - Replace this Normal event with a Malfunction. Fixed 3

S 4

E Event 2 - Loss of Turbine Cooling Water - Loss of running pump with failure of standby pump to Auto Start. Consider moving this event later in the scenario in case the CRS directs a reactor trip thus negating the next two events. Fixed Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating test scenario sets. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.

1.

ES: ES-301 checklists 4, 5, & 6 satisfied.

2.

TS: Set includes SRO TS actions for each SRO, with required actions explicitly detailed.

3.

Crit: Each manipulation or evolution has explicit success criteria documented in Form ES-D-2.

4.

IC: Out of service equipment and other initial conditions reasonably consistent between scenarios and not predictive of scenario events and actions.

5.

Pred: Scenario sequence and other factors avoid predictability issues.

6.

TL: Time line constructed, including event and process triggered conditions, such that scenario can run without routine examiner cuing.

7.

L/C: Length and complexity for each scenario in the set is reasonable for the crew mix being examined, such that all applicants have reasonably similar exposure and events are needed for evaluation purposes.

8.

Eff: Sequence of events is reasonably efficient for examination purposes, especially with respect to long delays or interactions.

9.

Based on the reviewer=s judgment, rate the scenario set as (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory.

10. Provide a brief description of problem in the explanation column.

11. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form.