ML112430557

Wat 2011-08 Retake Draft OP Test Comments

ML112430557
Person / Time
Site:	Waterford
Issue date:	08/08/2011
From:	Kelly Clayton Operations Branch IV
To:
References
Download: ML112430557 (5)

Text

WAT - 2011- 08 DRAFT OPERATING TEST COMMENTS ADMIN JPMS

4. Job Content

3. Attributes 6.

1. 2. Errors 5.

JPM# Dyn LOD Explanation U/E/S (D/S) (1-5) IC Cues Critical Scope Over- Job- Minutia (See below for instructions)

Focus Steps (N/B) lap Link RO (A1) U General comment for ALL Admin JPMs - Are your task standards the description field? You should call this the task standard like the NUREG describes it otherwise it makes it hard to review and see what you are really trying to accomplish with the JPM Modified but no pedigree on what was changed and what exam it came from. This JPM needs more steps and the calc itself is critical and should have error bands around the answer. Unsat because this is not discriminating for an operator-it appears to be a plug and chug JPM and all info is given to complete the problem in the cue and the supplied procedures. If you dont provide the TS info then it might be acceptable but I am not sure.

RO (A2) E Modified but no pedigree on what was changed and what exam it came from. No marked up key was provided.

RO (A3) E No marked up key.

RO (A4) E No error bands on the calcs? Cue has 13498 while sheet key has 13495. Which is right?

SRO (A5) N/A - RO WALK THRU TEST ONLY SRO (A6) N/A - RO WALK THRU TEST ONLY SRO (A7) N/A - RO WALK THRU TEST ONLY SRO (A8) N/A - RO WALK THRU TEST ONLY SRO (A9) N/A - RO WALK THRU TEST ONLY Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.

1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment.

2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.

3. Check the appropriate box when an attribute weakness is identified:

• The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.

• The JPM does not contain sufficient cues that are objective (not leading).

• All critical steps (elements) have not been properly identified.

• Scope of the task is either too narrow (N) or too broad (B).

• Excessive overlap with other part of operating test or written examination.

4. Check the appropriate box when a job content error is identified:

• Topics not linked to job content (e.g., disguised task, not required in real job).

• Task is trivial and without safety significance.

5. Based on the reviewer=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

6. Provide a brief description of any U or E rating in the explanation column.

7. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a 0 Page 1 of 5 OBDI 202 - IOLE Process

(S)atisfactory resolution on this form. 0 Page 2 of 5 OBDI 202 - IOLE Process

SITE - YEAR - MONTH DRAFT OPERATING TEST COMMENTS CONTROL ROOM/IN-PLANT SYSTEMS JPMS

4. Job Content

1. 2. 3. Attributes 6.

Errors 5.

JPM# Dyn LOD Explanation IC Cues Critical Scope Over- Job- Minutia U/E/S (D/S) (1-5) (See below for instructions)

Focus Steps (N/B) lap Link S1 E General comment: Why is history not tracked on these cover sheets for the JPMs? Do you have another tool for tracking this? If so I would like to see it.

Why is step 2 not applicable based on info you gave in the cue.

This JPM was marked in the outline as Previous but I cant find what exam it was used on.

S2 E I think the outline may be wrong because it has no ENS marking for anyJPM - is this the ENS JPM? Look up in NUREG.

Task standard is not correct. Where is the Alt. Path markup in the JPM standard?

S3 S Okay S4 S Okay S5 E 1, Outline has seal leak and a vibration issue while JPM has only vibration issue.

2. Question: Are any RCPs different than the others?

3. Change RCP to 2B.

4. Why two malfunctions for this JPM?

5. Need to mark Alt Path steps better in the JPM standard

6. Are there iny other steps in the Alt Path such as start lift pumps, etc?

S6 E 1. Send DWGs of some of these systems o I can review since validating one day and administering the next.

2. Outline says EDG A JPM says B which is it?

3. Step 12.e.1 Rev pwr trip of EDG is critical S7 E Task std needs work.

S8 E Could we change it to B train to mix it up a bit?

Previously used. Used on Oct 2010 exam P1 E No actions in ALT path therefore this is not alt path.

P2 U Not sure this is Alt Path JPM. Alt path is not labeled either. Breaker cuing, cant say on for bkr, say up or down. This JPM needs work and is very confusing.

Previously used. Used on Oct 2010 exam P3 S Okay.

Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided. 0 Page 3 of 5 OBDI 202 - IOLE Process

1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment.

2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.

3. Check the appropriate box when an attribute weakness is identified:

$ The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.

$ The JPM does not contain sufficient cues that are objective (not leading).

$ All critical steps (elements) have not been properly identified.

$ Scope of the task is either too narrow (N) or too broad (B).

$ Excessive overlap with other part of operating test or written examination.

4. Check the appropriate box when a job content error is identified:

• Topics not linked to job content (e.g., disguised task, not required in real job).

• Task is trivial and without safety significance.

5. Based on the reviewer=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

6. Provide a brief description of any U or E rating in the explanation column.

7. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form. 0 Page 4 of 5 OBDI 202 - IOLE Process

SITE - YEAR - MONTH DRAFT OPERATING TEST COMMENTS SCENARIOS Scenario 1. 2. 3. 4. 5. 6. 7. 8. 9.

10. Explanation (See below for instructions)

Set ES TS Crit IC Pred TL L/C Eff U/E/S 1 N/A - RO WALK THRU TEST ONLY 2 N/A - RO WALK THRU TEST ONLY 3 N/A - RO WALK THRU TEST ONLY N/A - RO WALK THRU TEST ONLY Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating test scenario sets. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.

1. ES: ES-301 checklists 4, 5, & 6 satisfied.

2. TS: Set includes SRO TS actions for each SRO, with required actions explicitly detailed.

3. Crit: Each manipulation or evolution has explicit success criteria documented in Form ES-D-2.

4. IC: Out of service equipment and other initial conditions reasonably consistent between scenarios and not predictive of scenario events and actions.

5. Pred: Scenario sequence and other factors avoid predictability issues.

6. TL: Time line constructed, including event and process triggered conditions, such that scenario can run without routine examiner cuing.

7. L/C: Length and complexity for each scenario in the set is reasonable for the crew mix being examined, such that all applicants have reasonably similar exposure and events are needed for evaluation purposes.

8. Eff: Sequence of events is reasonably efficient for examination purposes, especially with respect to long delays or interactions.

9. Based on the reviewer=s judgment, rate the scenario set as (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory.

10. Provide a brief description of problem in the explanation column.

11. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form. 0 Page 5 of 5 OBDI 202 - IOLE Process