ML061310514

08-2005-Operating Exam Comments

ML061310514
Person / Time
Site:	Palo Verde
Issue date:	08/01/2005
From:	NRC Region 4
To:	Arizona Public Service Co
References
50-528/05-301, 50-529/05-301, 50-530/05-301
Download: ML061310514 (2)

Text

APPENDIX E - REGION IV OPERATING TEST JOB PERFORMANCE MEASURE QUALITY REVIEW MATRIX

1. 2. 3. Attributes 4. Job Content 5. 6.

JPM# Dyn LOD Errors U/E/S Explanation (D/S) (1-5) (See below for instructions)

IC Cues Critical Scope Over- Job- Minutia Focus Steps (N/B) lap Link RO-A1a S 2 E no key was provided RO-A1b S 3 E Step 1 is identified as critical, but it has several aspects for the applicant to note - are all aspects critical, or just the calculation of 1/M? No key was provided.

RO-A2 S 1 X E This JPM needs to be revised such that the applicant has to locate data in the procedure instead of from a table.

RO-A3 S 2 S SRO-A1a S 2 E No key was provided. This JPM is essentially similar to the RO JPM and should be considered to be a BANK question.

SRO-A1b S 3 X E Need to revise the JPM to require documentation of the actions.

SRO-A2 S 3 E Dates incorrect in task standard and Step 1. Step 1 bullet #2 is the same as bullet #1.

SRO-A3 S 3 S SRO-A4 S 3 S Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests.

Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.

1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically an system reconfiguration or realignment.

2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.

3. Check the appropriate box when an attribute weakness is identified:

• The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.

• The JPM does not contain sufficient cues that are objective (not leading).

• All critical steps (elements) have not been properly identified.

• Scope of the task is either too narrow (N) or too broad (B).

• Excessive overlap with other part of operating test or written examination.

4. Check the appropriate box when a job content error is identified:

• Topics not linked to job content (e.g., disguised task, not required in real job).

• Task is trivial and without safety significance.

5. Based on the reviewers judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

6. Provide a brief description of problem in the explanation column. Provide conclusion on whether JPM SET criteria satisfied (i.e., number/distribution of safety functions, A.3 and A.4 integrated with parts B/C, Admin topics per section meet ES).

- Page 1 -

APPENDIX E - REGION IV OPERATING TEST JOB PERFORMANCE MEASURE QUALITY REVIEW MATRIX

1. 2. 3. Attributes 4. Job Content 5. 6.

JPM# Dyn LOD Errors U/E/S Explanation (D/S) (1-5) (See below for instructions)

IC Cues Critical Scope Over- Job- Minutia Focus Steps (N/B) lap Link P-1 S 2 X S P-2 S 2 S P-3 S 2 X E Need a cue on Page 3.

S-1 D 3 X E Why is Step 2 critical when nothing is performed? The notes appear to reduce validity.

S-2 D 3 X E Items 2 & 4, do not appear to be critical. The note states in the STANDARD that the action was a part of initial conditions, but the initial conditions do not identify the stated lineup.

S-3 D 2 X U JPM only requires the operator to check one indication and close one valve - a little too simplistic to provide discriminatory validity.

S-4 D 3 E Flow rates in Step 5 are incorrect.

S-5 D 3 S S-6 D 2 X S S-7 S 2 S S-8 S Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests.

Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.

1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment.

2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.

3. Check the appropriate box when an attribute weakness is identified:

• The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.

• The JPM does not contain sufficient cues that are objective (not leading).

• All critical steps (elements) have not been properly identified.

• Scope of the task is either too narrow (N) or too broad (B).

• Excessive overlap with other part of operating test or written examination.

4. Check the appropriate box when a job content error is identified:

• Topics not linked to job content (e.g., disguised task, not required in real job).

• Task is trivial and without safety significance.

5. Based on the reviewers judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

6. Provide a brief description of problem in the explanation column. Provide conclusion on whether JPM SET criteria satisfied (i.e., number/distribution of safety functions, A.3 and A.4 integrated with parts B/C, Admin topics per section meet ES).

- Page 2 -