ML061310514

08-2005-Operating Exam Comments

ML061310514
Person / Time
Site:	Palo Verde
Issue date:	08/01/2005
From:	NRC Region 4
To:	Arizona Public Service Co
References
50-528/05-301, 50-529/05-301, 50-530/05-301
Download: ML061310514 (2)

Text

- Page 1 -APPENDIX E - REGION IV OPERATING TEST JOB PERFORMANCE MEASURE QUALITY REVIEW MATRIXJPM#1.Dyn(D/S)2.LOD (1-5)3. Attributes4. Job ContentErrors 5.U/E/S 6.Explanation(See below for instructions)

ICFocusCues CriticalStepsScope(N/B)Over-lapJob-LinkMinutiaRO-A1aS2Eno key was providedRO-A1bS3EStep 1 is identified as critical, but it has several aspects for the applicant to "note" - are all aspectscritical, or just the calculation of 1/M? No key was provided.RO-A2S1XEThis JPM needs to be revised such that the applicant has to locate data in the procedure instead offrom a table.RO-A3S2SSRO-A1aS2ENo key was provided. This JPM is essentially similar to the RO JPM and should be considered to bea BANK question.SRO-A1bS3XENeed to revise the JPM to require documentation of the actions.SRO-A2S3EDates incorrect in task standard and Step 1. Step 1 bullet #2 is the same as bullet #1.

SRO-A3S3S SRO-A4S3SInstructions for Completing MatrixThis form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.1.Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically an systemreconfiguration or realignment.2.Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.3.Check the appropriate box when an attribute weakness is identified:*The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.

• The JPM does not contain sufficient cues that are objective (not leading).

• All critical steps (elements) have not been properly identified.

• Scope of the task is either too narrow (N) or too broad (B).

• Excessive overlap with other part of operating test or written examination.4.Check the appropriate box when a job content error is identified:*Topics not linked to job content (e.g., disguised task, not required in real job).

• Task is trivial and without safety significance.5.Based on the reviewer's judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?6.Provide a brief description of problem in the explanation column. Provide conclusion on whether JPM SET criteria satisfied (i.e., number/distribution of safety functions, A.3 and A.4integrated with parts B/C, Admin topics per section meet ES).

- Page 2 -APPENDIX E - REGION IV OPERATING TEST JOB PERFORMANCE MEASURE QUALITY REVIEW MATRIXJPM#1.Dyn(D/S)2.LOD (1-5)3. Attributes4. Job ContentErrors 5.U/E/S 6.Explanation(See below for instructions)

ICFocusCues CriticalStepsScope(N/B)Over-lapJob-LinkMinutiaP-1S2XSP-2S2S P-3S2XENeed a cue on Page 3.

S-1D3XEWhy is Step 2 critical when nothing is performed? The notes appear to reduce validity.

S-2D3XEItems 2 & 4, do not appear to be critical. The note states in the STANDARD that the action was a partof initial conditions, but the initial conditions do not identify the stated lineup.S-3D2XUJPM only requires the operator to check one indication and close one valve - a little too simplistic toprovide discriminatory validity.S-4D3EFlow rates in Step 5 are incorrect.

S-5D3S S-6D2XS S-7S2S S-8SInstructions for Completing MatrixThis form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.1.Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a systemreconfiguration or realignment.2.Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.3.Check the appropriate box when an attribute weakness is identified:*The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.

• The JPM does not contain sufficient cues that are objective (not leading).

• All critical steps (elements) have not been properly identified.

• Scope of the task is either too narrow (N) or too broad (B).

• Excessive overlap with other part of operating test or written examination.4.Check the appropriate box when a job content error is identified:*Topics not linked to job content (e.g., disguised task, not required in real job).

• Task is trivial and without safety significance.5.Based on the reviewer's judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?6.Provide a brief description of problem in the explanation column. Provide conclusion on whether JPM SET criteria satisfied (i.e., number/distribution of safety functions, A.3 and A.4integrated with parts B/C, Admin topics per section meet ES).