ML042990560

RB-09-2004 - Draft - Operating Exam Comments

ML042990560
Person / Time
Site:	River Bend
Issue date:	09/23/2004
From:	Gody A T Operations Branch IV
To:	Hinnenkamp P D Entergy Operations
References
50-458/04-301, NUREG-1021, RB-09-2004 50-458/04-301
Download: ML042990560 (3)

Text

S:\DRS\OB\EXAMS\rb\RB-INIT-EXAM 09-2004\RB 2004 - NRC DRAFT EXAM COMMENTS\RB 2004 -Draft-JPM ADM App E Review.wpd- Page 1 -APPENDIX E - REGION IV OPERATING TEST JOB PERFORMANCE MEASURE QUALITY REVIEW MATRIX JPM#1.Dyn (D/S)2.LOD (1-5)3. Attributes4. Job Content Errors 5.U/E/S 6.Explanation(See below for instructions)

ICFocusCues Critical Steps Scope (N/B)Over-lap Job-Link MinutiaADM-R01S3XSADM-R02S3E (S)The JPM has tolerances on some inputs used to compute the RPV water level, however, the RPVwater level answer does not have a tolerance.

FIXEDADM-R03S3SADM-RS04S2SADM-S01S3XE (S)Time after shutdown is different in Steps 1 and 2. They both should be 40 hours4.62963e-4 days <br />0.0111 hours <br />6.613757e-5 weeks <br />1.522e-5 months <br />.

FIXEDADM-S02S3XE (S)JPM Step1 directs the completion of Blocks 5, 6, and 8, however, 5 and 6 are blank on the master. The same problem also exists with JPM Step 5.

FIXED ADM-S03S3S ADM-S05S3 X E (S)Should the scram time be identified? In Step 1 of JPM, uses Procedure EIP--2-001 for the standardsection whereas Procedure EIP-0-001 is used for the comment section. Procedure. JPM Step 3 says to use Form GSUN0952.1-99-93 (Dec). This form is for a General Emergency instead of the Site AreaEmeragency.

FIXED Instructions for Completing MatrixThis form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency inreviewing operating tests. Additional information on these areas may be found in Exam ination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.1.Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task isbasically a system reconf iguration or realignment.2.Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.3.Check the appropriate box when an attribute weakness is identified:*The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.*The JPM does not contain sufficient cues that are objective (not leading).*All critical steps (elements) have not been properly identified.*Scope of the task is either too narrow (N) or too broad (B).*Excessive overlap with other part of operating test or written examination.4.Check the appropriate box when a job content error is identified:*Topics not linked to job content (e.g., dis guised task, not required in real job).*Task is trivial and without safety significance.5.Based on the reviewer's judgment, is the JPM as written (U) nacceptable (requiring repair or r eplacement), in need of (E)ditorial enhancement, or (S)atisfactory?6.Provide a brief description of problem in the explanation column. Provide conclusion on whether JPM SET criteria satisfied (i.e., number/distribution of safety functions,A.3 and A.4 integrated with parts B/C, Admin topics per section meet ES).

S:\DRS\OB\EXAMS\rb\RB-INIT-EXAM 09-2004\RB 2004 - NRC DRAFT EXAM COMMENTS\RB 2004 -Draft-JPM SYS App E Review.wpd- Page 1 -APPENDIX E - REGION IV OPERATING TEST JOB PERFORMANCE MEASURE QUALITY REVIEW MATRIX JPM#1.Dyn (D/S)2.LOD (1-5)3. Attributes4. Job Content Errors 5.U/E/S 6.Explanation(See below for instructions)

ICFocusCues Critical Steps Scope (N/B)Over-lap Job-Link MinutiaCRS-01S3SCRS-02D3S CRS-03D3S CRS-04D3S CRS-05S3XE (S)not sure step 1 should be "critical" FIXEDCRS-06S3S CRS-07D2S CRS-08S1XU (S)low discriminatory value; only 3 steps (performed twice) with little-or-no opportunity to fail.

REPLACEDIPS-01S3S IPS-02S3S IPS-03S3XSBU-01D3S BU-02D3XE (S)not sure step 1 should be "critical" FIXED Instructions for Completing MatrixThis form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency inreviewing operating tests. Additional information on these areas may be found in Exam ination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.1.Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task isbasically a system reconf iguration or realignment.2.Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.3.Check the appropriate box when an attribute weakness is identified:*The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.*The JPM does not contain sufficient cues that are objective (not leading).*All critical steps (elements) have not been properly identified.*Scope of the task is either too narrow (N) or too broad (B).*Excessive overlap with other part of operating test or written examination.4.Check the appropriate box when a job content error is identified:*Topics not linked to job content (e.g., dis guised task, not required in real job).*Task is trivial and without safety significance.5.Based on the reviewer's judgment, is the JPM as written (U) nacceptable (requiring repair or r eplacement), in need of (E)ditorial enhancement, or (S)atisfactory?6.Provide a brief description of problem in the explanation column. Provide conclusion on whether JPM SET criteria satisfied (i.e., number/distribution of safety functions,A.3 and A.4 integrated with parts B/C, Admin topics per section meet ES).

S:\DRS\OB\EXAMS\rb\RB-INIT-EXAM 09-2004\RB 2004 - NRC DRAFT EXAM COMMENTS\RB 2004 -Draft-Scenario App N Review.wpd- Page 1 -

APPENDIX N - REGION IV OPERATING TEST SCENARIO REVIEW MATRIX Scen Set 1 ES 2 TS 3 Crit 4 IC 5 Pred 6 TL 7 L/C 8 Eff 9 U/E/S 10 Explanation (See below for instructions) 1E (S)ES-301-4 lists 3 abnormal events, but only 2 seem to be in scenario.

FIXED 2E (S)ES-301-4 lists 3 abnormal events, the scenario tally claims 4, and the reviewer only sees 2; form also lists 2 malfunctions after EOP entry, but

scenario only includes 1; FIXED3(B/U)E (S)ES-301-4 lists 2 abnormal events, but the reviewer does not see any AOP entries.

FIXED; B/U scenario switched with #2 during validationweek to eliminate excessive overlap with audit exam.

Instructions for Completing MatrixThis form is not contained in or required by NUREG-1021. Utilit ies are not required or encouraged to use it. The purpose of t his form is to enhance regional consistency in reviewing operating test scenario sets. Addi tional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and ex plain the issue in the space provided.1.ES: ES-301 checklists 4, 5, & 6 satisfied.

2.TS: Set includes SRO TS actions for each SR O, with required actions explicitly detailed.3.Crit: Each manipulation or evolution has explicit success criteria documented in Form ES-D-2.

4.IC: Out of service equipment and other initial conditions r easonably consistent between scenarios and not predictive of scena rio events and actions.5.Pred: Scenario sequence and other factors avoid predictability issues.

6.TL: Time line constructed, including event and process trigger ed conditions, such that scenario can run without routine exami ner cuing.7.L/C: Length and complexity for each scenario in the set is r easonable for the crew mix being examined, such that all applican ts have reasonably similar exposure and events are needed for evaluation purposes.8.Eff: Sequence of events is reasonably effici ent for examination purposes, especially with respect to long delays or interacti ons.9.Based on the reviewer's judgment, is the scenario set as wr itten (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?10.Provide a brief description of problem in the explanation column