ML15344A071

From kanterella
Jump to navigation Jump to search
2015 Dresden Initial License Examination Operating Test Comments
ML15344A071
Person / Time
Site: Dresden  Constellation icon.png
Issue date: 04/30/2015
From: Randy Baker
Operations Branch III
To:
Exelon Generation Co
References
Download: ML15344A071 (3)


Text

Dresden Station, Units 2 & 3 - 04/2015 RESOLVED OPERATING TEST COMMENTS ADMIN JPMS

4. Job Content
1. 2. 3. Attributes 6.

Errors 5.

JPM# Dyn LOD Explanation U/E/S (D/S) (1-5) IC Cues Critical Scope Over- Job- Minutia (See below for instructions)

Focus Steps (N/B) lap Link RO (A1) S 2 S RO (A2) S 2 S RO (A3) S 3 X E (S) NRC: Review Steps 3 & 6 - these may not be critical since it is only reporting previously identified issues.

LIC: Agreed - Removed annotation (*) of steps 3 & 6; not critical steps. JPM is now S.

RO (A4) S 2 X U (S) NRC: This needs to relate to a specific learning objective and require an activity related to a licensed activity, i.e. determine the expected dose or time allowed to perform job-stay time.

LIC: Modified tasking to include interpreting survey map conditions (licensed activity). JPM is now S.

SRO (A5) S 3 S SRO (A6) S 2 S SRO (A7) S 3 X U (S) NRC: This is a direct from bank used on the last NRC Exam (2013).

LIC: Replaced submitted JPM with new proposed JPM to meet prior use reqs. JPM is S.

SRO (A8) S 3 X UE NRC: This is a direct from bank used on the last NRC Exam (2013).

(S) LIC: JPM modified with new data to change Key answer. Prior use reqs met. JPM is S.

SRO (A9) S 3 S Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.

1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment.
2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.
3. Check the appropriate box when an attribute weakness is identified:
  • The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.
  • The JPM does not contain sufficient cues that are objective (not leading).
  • All critical steps (elements) have not been properly identified.
  • Scope of the task is either too narrow (N) or too broad (B).
  • Excessive overlap with other part of operating test or written examination.
4. Check the appropriate box when a job content error is identified:
  • Topics not linked to job content (e.g., disguised task, not required in real job).
  • Task is trivial and without safety significance.
5. Based on the reviewers judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
6. Provide a brief description of any U or E rating in the explanation column.
7. Save initial review comments as normal black text; indicate how comments were resolved so that each JPM used on the exam is reflected as (S)atisfactory on this form.

Page 1 of 3

Dresden Station, Units 2 & 3 - 04/2015 RESOLVED OPERATING TEST COMMENTS CONTROL ROOM/IN-PLANT SYSTEMS JPMS

4. Job Content
1. 2. 3. Attributes 6.

Errors 5.

JPM# Dyn LOD Explanation (D/S) (1-5) IC Cues Critical Scope Over- Job- Minutia U/E/S (See below for instructions)

Focus Steps (N/B) lap Link S1 D 3 S S2 D 3 E (S) NRC: Is the applicant expected to perform the When statement actions? (flow= Zero)?

LIC: Changed JPM steps - now written as expectation/perform. JPM is now S.

S3 D 2 S S4 D 3 E (S) NRC: Step 34 may not be critical; also does the applicant have any way to verify that Steps 36 and 37 have been correctly completed?

LIC: Agreed - Changed JPM tasking to include injection vs lineup; now steps 34, 36 and 37 are critical. JPM is now S.

S5 D 3 S S6 D 2 S S7 D 2 S S8 D 3 S P1 D 2 X E (S) NRC: This may need an additional critical step to have more than 1 critical step.

LIC: Clarified steps to support tasking to verify rise in level as critical. JPM is now S.

P2 D 3 S P3 S 3 E (S) NRC: Limit the Initiating Cue to . . .per DEOP 0500-03. Require applicant to locate correct procedure Section to use.

LIC: Agreed - Modified JPM tasking cue. JPM is now S.

Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.

(See page 1 for applicable Notes.)

Page 2 of 3

Dresden Station, Units 2 & 3 - 04/2015 RESOLVED OPERATING TEST COMMENTS SCENARIOS Scenario 1. 2. 3. 4. 5. 6. 7. 8. 9.

10. Explanation (See below for instructions)

Set ES TS Crit IC Pred TL L/C Eff U/E/S 1 S 2 S 3 X E NRC: No R event and then only 2 I/C ATC - Not good for SRO-I use.

LIC: Agreed - Added 1 more I/C for ATC. Scenario is now S.

Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating test scenario sets. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.

1. ES: ES-301 checklists 4, 5, & 6 satisfied.
2. TS: Set includes SRO TS actions for each SRO, with required actions explicitly detailed.
3. Crit: Each manipulation or evolution has explicit success criteria documented in Form ES-D-2.
4. IC: Out of service equipment and other initial conditions reasonably consistent between scenarios and not predictive of scenario events and actions.
5. Pred: Scenario sequence and other factors avoid predictability issues.
6. TL: Time line constructed, including event and process triggered conditions, such that scenario can run without routine examiner cuing.
7. L/C: Length and complexity for each scenario in the set is reasonable for the crew mix being examined, such that all applicants have reasonably similar exposure and events are needed for evaluation purposes.
8. Eff: Sequence of events is reasonably efficient for examination purposes, especially with respect to long delays or interactions.
9. Based on the reviewers judgment, rate the scenario set as (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory.
10. Provide a brief description of problem in the explanation column.
11. Save initial review comments as normal black text; indicate how comments were resolved so that each JPM used on the exam is reflected by a (S)atisfactory on this form.

NOTE: Review of the Licensees Outline Submittal Package to not identify any significant comments.

Page 3 of 3

Dresden Station, Units 2 & 3 - 04/2015 RESOLVED OPERATING TEST COMMENTS ADMIN JPMS

4. Job Content
1. 2. 3. Attributes 6.

Errors 5.

JPM# Dyn LOD Explanation U/E/S (D/S) (1-5) IC Cues Critical Scope Over- Job- Minutia (See below for instructions)

Focus Steps (N/B) lap Link RO (A1) S 2 S RO (A2) S 2 S RO (A3) S 3 X E (S) NRC: Review Steps 3 & 6 - these may not be critical since it is only reporting previously identified issues.

LIC: Agreed - Removed annotation (*) of steps 3 & 6; not critical steps. JPM is now S.

RO (A4) S 2 X U (S) NRC: This needs to relate to a specific learning objective and require an activity related to a licensed activity, i.e. determine the expected dose or time allowed to perform job-stay time.

LIC: Modified tasking to include interpreting survey map conditions (licensed activity). JPM is now S.

SRO (A5) S 3 S SRO (A6) S 2 S SRO (A7) S 3 X U (S) NRC: This is a direct from bank used on the last NRC Exam (2013).

LIC: Replaced submitted JPM with new proposed JPM to meet prior use reqs. JPM is S.

SRO (A8) S 3 X UE NRC: This is a direct from bank used on the last NRC Exam (2013).

(S) LIC: JPM modified with new data to change Key answer. Prior use reqs met. JPM is S.

SRO (A9) S 3 S Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.

1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment.
2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.
3. Check the appropriate box when an attribute weakness is identified:
  • The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.
  • The JPM does not contain sufficient cues that are objective (not leading).
  • All critical steps (elements) have not been properly identified.
  • Scope of the task is either too narrow (N) or too broad (B).
  • Excessive overlap with other part of operating test or written examination.
4. Check the appropriate box when a job content error is identified:
  • Topics not linked to job content (e.g., disguised task, not required in real job).
  • Task is trivial and without safety significance.
5. Based on the reviewers judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
6. Provide a brief description of any U or E rating in the explanation column.
7. Save initial review comments as normal black text; indicate how comments were resolved so that each JPM used on the exam is reflected as (S)atisfactory on this form.

Page 1 of 3

Dresden Station, Units 2 & 3 - 04/2015 RESOLVED OPERATING TEST COMMENTS CONTROL ROOM/IN-PLANT SYSTEMS JPMS

4. Job Content
1. 2. 3. Attributes 6.

Errors 5.

JPM# Dyn LOD Explanation (D/S) (1-5) IC Cues Critical Scope Over- Job- Minutia U/E/S (See below for instructions)

Focus Steps (N/B) lap Link S1 D 3 S S2 D 3 E (S) NRC: Is the applicant expected to perform the When statement actions? (flow= Zero)?

LIC: Changed JPM steps - now written as expectation/perform. JPM is now S.

S3 D 2 S S4 D 3 E (S) NRC: Step 34 may not be critical; also does the applicant have any way to verify that Steps 36 and 37 have been correctly completed?

LIC: Agreed - Changed JPM tasking to include injection vs lineup; now steps 34, 36 and 37 are critical. JPM is now S.

S5 D 3 S S6 D 2 S S7 D 2 S S8 D 3 S P1 D 2 X E (S) NRC: This may need an additional critical step to have more than 1 critical step.

LIC: Clarified steps to support tasking to verify rise in level as critical. JPM is now S.

P2 D 3 S P3 S 3 E (S) NRC: Limit the Initiating Cue to . . .per DEOP 0500-03. Require applicant to locate correct procedure Section to use.

LIC: Agreed - Modified JPM tasking cue. JPM is now S.

Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.

(See page 1 for applicable Notes.)

Page 2 of 3

Dresden Station, Units 2 & 3 - 04/2015 RESOLVED OPERATING TEST COMMENTS SCENARIOS Scenario 1. 2. 3. 4. 5. 6. 7. 8. 9.

10. Explanation (See below for instructions)

Set ES TS Crit IC Pred TL L/C Eff U/E/S 1 S 2 S 3 X E NRC: No R event and then only 2 I/C ATC - Not good for SRO-I use.

LIC: Agreed - Added 1 more I/C for ATC. Scenario is now S.

Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating test scenario sets. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.

1. ES: ES-301 checklists 4, 5, & 6 satisfied.
2. TS: Set includes SRO TS actions for each SRO, with required actions explicitly detailed.
3. Crit: Each manipulation or evolution has explicit success criteria documented in Form ES-D-2.
4. IC: Out of service equipment and other initial conditions reasonably consistent between scenarios and not predictive of scenario events and actions.
5. Pred: Scenario sequence and other factors avoid predictability issues.
6. TL: Time line constructed, including event and process triggered conditions, such that scenario can run without routine examiner cuing.
7. L/C: Length and complexity for each scenario in the set is reasonable for the crew mix being examined, such that all applicants have reasonably similar exposure and events are needed for evaluation purposes.
8. Eff: Sequence of events is reasonably efficient for examination purposes, especially with respect to long delays or interactions.
9. Based on the reviewers judgment, rate the scenario set as (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory.
10. Provide a brief description of problem in the explanation column.
11. Save initial review comments as normal black text; indicate how comments were resolved so that each JPM used on the exam is reflected by a (S)atisfactory on this form.

NOTE: Review of the Licensees Outline Submittal Package to not identify any significant comments.

Page 3 of 3