ML102230004: Difference between revisions

From kanterella
Jump to navigation Jump to search
(Created page by program invented by StriderTol)
(StriderTol Bot change)
 
(3 intermediate revisions by the same user not shown)
Line 3: Line 3:
| issue date = 06/21/2010
| issue date = 06/21/2010
| title = 2010-07 Draft Operating Test Comments
| title = 2010-07 Draft Operating Test Comments
| author name = Clayton K D
| author name = Clayton K
| author affiliation = NRC/RGN-IV/DRS/OB
| author affiliation = NRC/RGN-IV/DRS/OB
| addressee name =  
| addressee name =  
Line 16: Line 16:


=Text=
=Text=
{{#Wiki_filter:Attachment 10 Page 1 of 3 OBDI 202 - IOLE Process CP-2010-07 DRAFT OPERATING TEST COMMENTS ADMIN JPMS JPM# 1. Dyn (D/S) 2. LOD (1-5) 3. Attributes 4. Job Content Errors 5. U/E/S6. Explanation (See below for instructions) IC Focus Cues Critical Steps Scope (N/B) Over- lap Job-Link Minutia RO (A1)           N/A since no Admin JPMs administered RO (A2)           RO (A3)             RO (A4)
{{#Wiki_filter:Attachment 10 Page 1 of 3 OBDI 202 - IOLE Process CP-2010-07 DRAFT OPERATING TEST COMMENTS ADMIN JPMS JPM#
: 1.
Dyn (D/S)
: 2.
LOD (1-5)
: 3. Attributes
: 4. Job Content Errors
: 5.
U/E/S
: 6.
Explanation (See below for instructions)
IC Focus Cues Critical Steps Scope (N/B)
Over-lap Job-Link Minutia RO (A1)
N/A since no Admin JPMs administered RO (A2)
RO (A3)
RO (A4)
SRO (A5)
SRO (A5)
SRO (A6)
SRO (A6)
Line 22: Line 37:
SRO (A8)
SRO (A8)
SRO (A9)
SRO (A9)
Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.  
Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.
: 1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involv es continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment. 2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested. 3. Check the appropriate box when an attribute weakness is identified:
: 1.
* The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.
Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment.
* The JPM does not contain sufficient cues that are objective (not leading).
: 2.
* All critical steps (elements) have not been properly identified.
Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.
* Scope of the task is either too narrow (N) or too broad (B).
: 3.
* Excessive overlap with other part of operating test or written examination. 4. Check the appropriate box when a job content error is identified:
Check the appropriate box when an attribute weakness is identified:
* Topics not linked to job content (e.g., di sguised task, not required in real job).
The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.
* Task is trivial and without safety significance. 5. Based on the reviewer
The JPM does not contain sufficient cues that are objective (not leading).
=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory? 6. Provide a brief description of any U or E rating in the explanation column. 7. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form.
All critical steps (elements) have not been properly identified.
Attachment 10 Page 2 of 3 OBDI 202 - IOLE Process CP-2010-07 DRAFT OPERATING TEST COMMENTS CONTROL ROOM/IN-PLANT SYSTEMS JPMS JPM# 1. Dyn (D/S) 2. LOD (1-5) 3. Attributes 4. Job Content Errors 5. U/E/S6. Explanation (See below for instructions) IC Focus Cues Critical Steps Scope (N/B) Over- lap Job-Link Minutia S1           N/A since no JPMs administeredS2            S3           S4           S5           S6           S7           S8           P1           P2           P3 Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.  
Scope of the task is either too narrow (N) or too broad (B).
: 1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment. 2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested. 3. Check the appropriate box when an attribute weakness is identified:  
Excessive overlap with other part of operating test or written examination.
: 4.
Check the appropriate box when a job content error is identified:
Topics not linked to job content (e.g., disguised task, not required in real job).
Task is trivial and without safety significance.
: 5.
Based on the reviewer=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
: 6.
Provide a brief description of any U or E rating in the explanation column.
: 7.
Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form.  
 
0 Page 2 of 3 OBDI 202 - IOLE Process CP-2010-07 DRAFT OPERATING TEST COMMENTS CONTROL ROOM/IN-PLANT SYSTEMS JPMS JPM#
: 1.
Dyn (D/S)
: 2.
LOD (1-5)
: 3. Attributes
: 4. Job Content Errors
: 5.
U/E/S
: 6.
Explanation (See below for instructions)
IC Focus Cues Critical Steps Scope (N/B)
Over-lap Job-Link Minutia S1 N/A since no JPMs administered S2 S3 S4 S5 S6 S7 S8 P1 P2 P3 Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.
: 1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment.
: 2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.
: 3. Check the appropriate box when an attribute weakness is identified:  
$ The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.  
$ The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.  
$ The JPM does not contain sufficient cues that are objective (not leading).  
$ The JPM does not contain sufficient cues that are objective (not leading).  
$ All critical steps (elements) have not been properly identified.  
$ All critical steps (elements) have not been properly identified.  
$ Scope of the task is either too narrow (N) or too broad (B).  
$ Scope of the task is either too narrow (N) or too broad (B).  
$ Excessive overlap with other part of operating test or written examination. 4. Check the appropriate box when a job content error is identified:
$ Excessive overlap with other part of operating test or written examination.
* Topics not linked to job content (e.g., di sguised task, not required in real job).
: 4. Check the appropriate box when a job content error is identified:
* Task is trivial and without safety significance. 5. Based on the reviewer
* Topics not linked to job content (e.g., disguised task, not required in real job).
=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory? 6. Provide a brief description of any U or E rating in the explanation column. 7. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form.
* Task is trivial and without safety significance.
Attachment 10 Page 3 of 3 OBDI 202 - IOLE Process CP-2010-07 DRAFT OPERATING TEST COMMENTS SCENARIOS Scenario Set 1. ES 2. TS 3. Crit 4. IC 5. Pred 6. TL 7. L/C 8. Eff 9. U/E/S 10. Explanation (See below for instructions) 1        S  2 X        E
: 5. Based on the reviewer=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
 
: 6. Provide a brief description of any U or E rating in the explanation column.
S Needs two more I/C items to have enough for each position if one applicant takes credit for another's during actual run of scenario
: 7. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form.  
: s. ES 301-5 form needs to be changed accordingly. 


Added 2 more I/C items 3 X             S Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating test scenario sets. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided. 1. ES: ES-301 checklists 4, 5, & 6 satisfied.  
0 Page 3 of 3 OBDI 202 - IOLE Process CP-2010-07 DRAFT OPERATING TEST COMMENTS SCENARIOS Scenario Set
: 2. TS: Set includes SRO TS actions for each SRO, with required actions explicitly detailed. 3. Crit: Each manipulation or evolution has explicit success criteria documented in Form ES-D-2. 4. IC: Out of service equipment and other initial conditions reasonably consistent between scenarios and not predictive of scenario events and actions. 5. Pred: Scenario sequence and other factors avoid predictability issues. 6. TL: Time line constructed, including event and process triggered conditions, such that scenario can run without routine exam iner cuing. 7. L/C: Length and complexity for each scenario in the set is reasonable for the crew mix being examined, such that all applicants have reasonably similar exposure and events are needed for evaluation purposes. 8. Eff: Sequence of events is reasonably efficient for examination purposes, especially with respect to long delays or interact ions. 9. Based on the reviewer
: 1.
=s judgment, rate the scenario set as (U)nacceptable (requiring repai r or replacement), in need of (E)ditorial enhancement, or (S)atisfactory. 10. Provide a brief description of problem in the explanation column. 11. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form.}}
ES
: 2.
TS
: 3.
Crit
: 4.
IC
: 5.
Pred
: 6.
TL
: 7.
L/C
: 8.
Eff
: 9.
U/E/S
: 10. Explanation (See below for instructions) 1 S
2 X
E S
Needs two more I/C items to have enough for each position if one applicant takes credit for anothers during actual run of scenarios. ES 301-5 form needs to be changed accordingly.
Added 2 more I/C items 3
X S
Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating test scenario sets. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.
: 1.
ES: ES-301 checklists 4, 5, & 6 satisfied.
: 2.
TS: Set includes SRO TS actions for each SRO, with required actions explicitly detailed.
: 3.
Crit: Each manipulation or evolution has explicit success criteria documented in Form ES-D-2.
: 4.
IC: Out of service equipment and other initial conditions reasonably consistent between scenarios and not predictive of scenario events and actions.
: 5.
Pred: Scenario sequence and other factors avoid predictability issues.
: 6.
TL: Time line constructed, including event and process triggered conditions, such that scenario can run without routine examiner cuing.
: 7.
L/C: Length and complexity for each scenario in the set is reasonable for the crew mix being examined, such that all applicants have reasonably similar exposure and events are needed for evaluation purposes.
: 8.
Eff: Sequence of events is reasonably efficient for examination purposes, especially with respect to long delays or interactions.
: 9.
Based on the reviewer=s judgment, rate the scenario set as (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory.
: 10. Provide a brief description of problem in the explanation column.
: 11. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form.}}

Latest revision as of 03:28, 14 January 2025

2010-07 Draft Operating Test Comments
ML102230004
Person / Time
Site: Comanche Peak  Luminant icon.png
Issue date: 06/21/2010
From: Kelly Clayton
Operations Branch IV
To:
Luminant Generation Co
References
50-445/10-302, 50-446/10-302
Download: ML102230004 (3)


Text

Attachment 10 Page 1 of 3 OBDI 202 - IOLE Process CP-2010-07 DRAFT OPERATING TEST COMMENTS ADMIN JPMS JPM#

1.

Dyn (D/S)

2.

LOD (1-5)

3. Attributes
4. Job Content Errors
5.

U/E/S

6.

Explanation (See below for instructions)

IC Focus Cues Critical Steps Scope (N/B)

Over-lap Job-Link Minutia RO (A1)

N/A since no Admin JPMs administered RO (A2)

RO (A3)

RO (A4)

SRO (A5)

SRO (A6)

SRO (A7)

SRO (A8)

SRO (A9)

Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.

1.

Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment.

2.

Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.

3.

Check the appropriate box when an attribute weakness is identified:

The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.

The JPM does not contain sufficient cues that are objective (not leading).

All critical steps (elements) have not been properly identified.

Scope of the task is either too narrow (N) or too broad (B).

Excessive overlap with other part of operating test or written examination.

4.

Check the appropriate box when a job content error is identified:

Topics not linked to job content (e.g., disguised task, not required in real job).

Task is trivial and without safety significance.

5.

Based on the reviewer=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

6.

Provide a brief description of any U or E rating in the explanation column.

7.

Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form.

0 Page 2 of 3 OBDI 202 - IOLE Process CP-2010-07 DRAFT OPERATING TEST COMMENTS CONTROL ROOM/IN-PLANT SYSTEMS JPMS JPM#

1.

Dyn (D/S)

2.

LOD (1-5)

3. Attributes
4. Job Content Errors
5.

U/E/S

6.

Explanation (See below for instructions)

IC Focus Cues Critical Steps Scope (N/B)

Over-lap Job-Link Minutia S1 N/A since no JPMs administered S2 S3 S4 S5 S6 S7 S8 P1 P2 P3 Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.

1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment.
2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.
3. Check the appropriate box when an attribute weakness is identified:

$ The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.

$ The JPM does not contain sufficient cues that are objective (not leading).

$ All critical steps (elements) have not been properly identified.

$ Scope of the task is either too narrow (N) or too broad (B).

$ Excessive overlap with other part of operating test or written examination.

4. Check the appropriate box when a job content error is identified:
  • Topics not linked to job content (e.g., disguised task, not required in real job).
  • Task is trivial and without safety significance.
5. Based on the reviewer=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
6. Provide a brief description of any U or E rating in the explanation column.
7. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form.

0 Page 3 of 3 OBDI 202 - IOLE Process CP-2010-07 DRAFT OPERATING TEST COMMENTS SCENARIOS Scenario Set

1.

ES

2.

TS

3.

Crit

4.

IC

5.

Pred

6.

TL

7.

L/C

8.

Eff

9.

U/E/S

10. Explanation (See below for instructions) 1 S

2 X

E S

Needs two more I/C items to have enough for each position if one applicant takes credit for anothers during actual run of scenarios. ES 301-5 form needs to be changed accordingly.

Added 2 more I/C items 3

X S

Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating test scenario sets. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.

1.

ES: ES-301 checklists 4, 5, & 6 satisfied.

2.

TS: Set includes SRO TS actions for each SRO, with required actions explicitly detailed.

3.

Crit: Each manipulation or evolution has explicit success criteria documented in Form ES-D-2.

4.

IC: Out of service equipment and other initial conditions reasonably consistent between scenarios and not predictive of scenario events and actions.

5.

Pred: Scenario sequence and other factors avoid predictability issues.

6.

TL: Time line constructed, including event and process triggered conditions, such that scenario can run without routine examiner cuing.

7.

L/C: Length and complexity for each scenario in the set is reasonable for the crew mix being examined, such that all applicants have reasonably similar exposure and events are needed for evaluation purposes.

8.

Eff: Sequence of events is reasonably efficient for examination purposes, especially with respect to long delays or interactions.

9.

Based on the reviewer=s judgment, rate the scenario set as (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory.

10. Provide a brief description of problem in the explanation column.
11. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form.