ML022620583

May 2002 Draft Retake Outline Comments

ML022620583
Person / Time
Site:	Arkansas Nuclear
Issue date:	05/06/2002
From:	Gody A NRC Region 4
To:	Anderson C Entergy Operations
References
50-368/02303
Download: ML022620583 (1)

Text

C:\ORPCheckout\FileNET\ML022620583.wpd APPENDIX E - REGION IV OPERATING TEST JOB PERFORMANCE MEASURE QUALITY REVIEW MATRIX

1. 2. 3. Attributes 4. Job Content 5. 6. 7.

JPM# Dyn LOD Errors Set U/E/S Explanation (D/S) (1-5) (See below for instructions)

IC Cues Critical Scope Over- Job- Minutia Focus Steps (N/B) lap Link A.1a S 1 N/A N/A U Too easy. Give him a shift turnover checklist with multiple errors and find the errors. One step is not adequate to check his ability to review and verify documentation. You tell the applicant what step is wrong and how to check the performance of the step - no discrimination.

A.1b S 3 N/A N/A S Is Step 2 a critical task?

A.2 S 2 N/A N/A E Dont believe Step 2 is a critical task. Step 3, which is critical, implements the requirements of Step 2.

A.3 S 2 N/A N/A E Modif initial conditions and cues. Remove initial condition about Joe Mechanic completing Form 1903.035c. Change the cue on Step 3 to include an examiner cue - When asked by the candidate about Form 1903.035c for Joe Mechanic, give him a copy of the completed form.

A.4 S 3 N/A N/A S Is Step 2 a critical task?

Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.

1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically an system reconfiguration or realignment.

2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.

3. Check the appropriate box when an attribute weakness is identified:

• The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.

• The JPM does not contain sufficient cues that are objective (not leading).

• All critical steps (elements) have not been properly identified.

• Scope of the task is either too narrow (N) or too broad (B).

• Excessive overlap with other part of operating test or written examination.

4. Check the appropriate box when a job content error is identified:

• Topics not linked to job content (e.g., disguised task, not required in real job).

• Task is trivial and without safety significance.

5. JPM SET criteria satisfied (i.e., number/distribution of safety functions, A.3 and A.4 integrated with parts B/C, Admin topics per section meet ES).

5. Based on the reviewers judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

6. Provide a brief description of problem in the explanation column.

- Page 1 -