ML14017A041: Difference between revisions
StriderTol (talk | contribs) (Created page by program invented by StriderTol) |
StriderTol (talk | contribs) (Created page by program invented by StriderTol) |
||
(2 intermediate revisions by the same user not shown) | |||
Line 2: | Line 2: | ||
| number = ML14017A041 | | number = ML14017A041 | ||
| issue date = 11/15/2013 | | issue date = 11/15/2013 | ||
| title = | | title = 2013-11-Draft Operating Test Comments | ||
| author name = Garchow S | | author name = Garchow S | ||
| author affiliation = NRC/RGN-IV/DRS/OB | | author affiliation = NRC/RGN-IV/DRS/OB | ||
Line 15: | Line 15: | ||
=Text= | =Text= | ||
{{#Wiki_filter: | {{#Wiki_filter:GG-2013-11 DRAFT OPERATING TEST COMMENTS ADMIN JPMS | ||
: | : 4. Job Content | ||
: 1. 3. Attributes | |||
SRO ( | : 2. Errors 6. | ||
-S-18-6 so I can evaluate this JPM. | 5. | ||
JPM is sat. | JPM# Dyn LOD Explanation U/E/S (D/S) (1-5) IC Cues Critical Scope Over- Job- Minutia (See below for instructions) | ||
SRO ( | Focus Steps (N/B) lap Link SRO (AS1) S 3 S No comments. | ||
SRO ( | SRO (AS2) S 3 S Please send procedure 01-S-18-6 so I can evaluate this JPM. JPM is sat. | ||
-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided. | SRO (AS3) S 3 S No comments. | ||
SRO (AS4) S 2 E Add a third operator to the list of candidates. Also, the JPM should ask the candidate for the basis on why he/she selected the operator SRO (AS5) S 3 S We need to make sure we administer this JPM on a day that all the candidates are in the scenario. | |||
Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided. | |||
: 1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment. | : 1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment. | ||
: 2. Determine level of difficulty (LOD) using established 1 | : 2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested. | ||
-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested. | |||
: 3. Check the appropriate box when an attribute weakness is identified: | : 3. Check the appropriate box when an attribute weakness is identified: | ||
The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin. | * The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin. | ||
The JPM does not contain sufficient cues that are objective (not leading). | * The JPM does not contain sufficient cues that are objective (not leading). | ||
All critical steps (elements) have not been properly identified. | * All critical steps (elements) have not been properly identified. | ||
Scope of the task is either too narrow (N) or too broad (B). | * Scope of the task is either too narrow (N) or too broad (B). | ||
Excessive overlap with other part of operating test or written examination. | * Excessive overlap with other part of operating test or written examination. | ||
: 4. Check the appropriate box when a job content error is identified: | : 4. Check the appropriate box when a job content error is identified: | ||
Topics not linked to job content (e.g., disguised task, not required in real job). | * Topics not linked to job content (e.g., disguised task, not required in real job). | ||
Task is trivial and without safety significance. | * Task is trivial and without safety significance. | ||
: 5. Based on the reviewer | : 5. Based on the reviewer=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory? | ||
=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory? | : 6. Provide a brief description of any U or E rating in the explanation column. | ||
: 6. Provide a brief description of any U or E rating in the explanation column. | : 7. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form. 0 Page 1 of 3 OBDI 202 - IOLE Process | ||
: 7. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form. | |||
GG-2013-11 DRAFT OPERATING TEST COMMENTS CONTROL ROOM/IN-PLANT SYSTEMS JPMS | |||
-PLANT | : 4. Job Content | ||
: 1. 2. 3. Attributes 6. | |||
Errors 5. | |||
JPM# Dyn LOD Explanation IC Cues Critical Scope Over- Job- Minutia U/E/S (D/S) (1-5) (See below for instructions) | |||
CR3 D 3 | Focus Steps (N/B) lap Link CR1 D 3 S No comments. | ||
CR2 D 3 S No comments. | |||
CR3 D 3 E E Step 2; Change the cue for the CRS to concur with the candidate to place the vacuum bypass switch in bypass (not direct). | |||
CR4 S 3 S No comments. | |||
CR5 D 3 S No comments. | |||
CR6 D 3 S No comments. | |||
CR7 S 3 S No comments. | |||
Instructions for Completing Matrix This form is not contained in or required by NUREG | PS1 S 3 S No comments. | ||
-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided. | PS2 S 3 S No comments. | ||
PS3 S 3 S No comments. | |||
Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided. | |||
: 1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment. | : 1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment. | ||
: 2. Determine level of difficulty (LOD) using established 1 | : 2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested. | ||
-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested. | |||
: 3. Check the appropriate box when an attribute weakness is identified: | : 3. Check the appropriate box when an attribute weakness is identified: | ||
$ The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin. | |||
$ The JPM does not contain sufficient cues that are objective (not leading). | |||
$ All critical steps (elements) have not been properly identified. | |||
$ Scope of the task is either too narrow (N) or too broad (B). | |||
$ Excessive overlap with other part of operating test or written examination. | |||
: 4. Check the appropriate box when a job content error is identified: | : 4. Check the appropriate box when a job content error is identified: | ||
Topics not linked to job content (e.g., disguised task, not required in real job). | * Topics not linked to job content (e.g., disguised task, not required in real job). | ||
Task is trivial and without safety significance. | * Task is trivial and without safety significance. | ||
: 5. Based on the reviewer | : 5. Based on the reviewer=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory? | ||
=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory? | : 6. Provide a brief description of any U or E rating in the explanation column. | ||
: 6. Provide a brief description of any U or E rating in the explanation column. | : 7. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form. 0 Page 2 of 3 OBDI 202 - IOLE Process | ||
: 7. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form. | |||
GG-2013-11 DRAFT OPERATING TEST COMMENTS SCENARIOS Scenario 1. 2. 3. 4. 5. 6. 7. 8. 9. | |||
2 | : 10. Explanation (See below for instructions) | ||
Set ES TS Crit IC Pred TL L/C Eff U/E/S 1 S No comments. | |||
3 | 2 E E I dont see any discriminatory value in events 6 or 7. Replace with events requiring operator actions. | ||
Instructions for Completing Matrix This form is not contained in or required by NUREG | 3 S No comments. | ||
-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating test scenario sets. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided. | Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating test scenario sets. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided. | ||
: 1. ES: ES-301 checklists 4, 5, & 6 satisfied. | : 1. ES: ES-301 checklists 4, 5, & 6 satisfied. | ||
: 2. TS: Set includes SRO TS actions for each SRO, with required actions explicitly detailed. | : 2. TS: Set includes SRO TS actions for each SRO, with required actions explicitly detailed. | ||
: 3. Crit: Each manipulation or evolution has explicit success criteria documented in Form ES | : 3. Crit: Each manipulation or evolution has explicit success criteria documented in Form ES-D-2. | ||
-D-2. 4. IC: Out of service equipment and other initial conditions reasonably consistent between scenarios and not predictive of scenario events and actions. | : 4. IC: Out of service equipment and other initial conditions reasonably consistent between scenarios and not predictive of scenario events and actions. | ||
: 5. Pred: Scenario sequence and other factors avoid predictability issues. | : 5. Pred: Scenario sequence and other factors avoid predictability issues. | ||
: 6. TL: Time line constructed, including event and process triggered conditions, such that scenario can run without routine examiner cuing. | : 6. TL: Time line constructed, including event and process triggered conditions, such that scenario can run without routine examiner cuing. | ||
: 7. L/C: Length and complexity for each scenario in the set is reasonable for the crew mix being examined, such that all applicants have reasonably similar exposure and events are needed for evaluation purposes. | : 7. L/C: Length and complexity for each scenario in the set is reasonable for the crew mix being examined, such that all applicants have reasonably similar exposure and events are needed for evaluation purposes. | ||
: 8. Eff: Sequence of events is reasonably efficient for examination purposes, especially with respect to long delays or interactions. 9. Based on the reviewer | : 8. Eff: Sequence of events is reasonably efficient for examination purposes, especially with respect to long delays or interactions. | ||
=s judgment, rate the scenario set as (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory. | : 9. Based on the reviewer=s judgment, rate the scenario set as (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory. | ||
: 10. Provide a brief description of problem in the explanation column. | : 10. Provide a brief description of problem in the explanation column. | ||
: 11. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form.}} | : 11. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form. 0 Page 3 of 3 OBDI 202 - IOLE Process}} |
Latest revision as of 10:17, 4 November 2019
ML14017A041 | |
Person / Time | |
---|---|
Site: | Grand Gulf ![]() |
Issue date: | 11/15/2013 |
From: | Garchow S Operations Branch IV |
To: | Entergy Operations |
laura hurley | |
References | |
Download: ML14017A041 (3) | |
Text
GG-2013-11 DRAFT OPERATING TEST COMMENTS ADMIN JPMS
- 4. Job Content
- 1. 3. Attributes
- 2. Errors 6.
5.
JPM# Dyn LOD Explanation U/E/S (D/S) (1-5) IC Cues Critical Scope Over- Job- Minutia (See below for instructions)
Focus Steps (N/B) lap Link SRO (AS1) S 3 S No comments.
SRO (AS2) S 3 S Please send procedure 01-S-18-6 so I can evaluate this JPM. JPM is sat.
SRO (AS3) S 3 S No comments.
SRO (AS4) S 2 E Add a third operator to the list of candidates. Also, the JPM should ask the candidate for the basis on why he/she selected the operator SRO (AS5) S 3 S We need to make sure we administer this JPM on a day that all the candidates are in the scenario.
Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.
- 1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment.
- 2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.
- 3. Check the appropriate box when an attribute weakness is identified:
- The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.
- The JPM does not contain sufficient cues that are objective (not leading).
- All critical steps (elements) have not been properly identified.
- Scope of the task is either too narrow (N) or too broad (B).
- Excessive overlap with other part of operating test or written examination.
- 4. Check the appropriate box when a job content error is identified:
- Topics not linked to job content (e.g., disguised task, not required in real job).
- Task is trivial and without safety significance.
- 5. Based on the reviewer=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 6. Provide a brief description of any U or E rating in the explanation column.
- 7. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form. 0 Page 1 of 3 OBDI 202 - IOLE Process
GG-2013-11 DRAFT OPERATING TEST COMMENTS CONTROL ROOM/IN-PLANT SYSTEMS JPMS
- 4. Job Content
- 1. 2. 3. Attributes 6.
Errors 5.
JPM# Dyn LOD Explanation IC Cues Critical Scope Over- Job- Minutia U/E/S (D/S) (1-5) (See below for instructions)
Focus Steps (N/B) lap Link CR1 D 3 S No comments.
CR2 D 3 S No comments.
CR3 D 3 E E Step 2; Change the cue for the CRS to concur with the candidate to place the vacuum bypass switch in bypass (not direct).
CR4 S 3 S No comments.
CR5 D 3 S No comments.
CR6 D 3 S No comments.
CR7 S 3 S No comments.
PS1 S 3 S No comments.
PS2 S 3 S No comments.
PS3 S 3 S No comments.
Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.
- 1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment.
- 2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.
- 3. Check the appropriate box when an attribute weakness is identified:
$ The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.
$ The JPM does not contain sufficient cues that are objective (not leading).
$ All critical steps (elements) have not been properly identified.
$ Scope of the task is either too narrow (N) or too broad (B).
$ Excessive overlap with other part of operating test or written examination.
- 4. Check the appropriate box when a job content error is identified:
- Topics not linked to job content (e.g., disguised task, not required in real job).
- Task is trivial and without safety significance.
- 5. Based on the reviewer=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 6. Provide a brief description of any U or E rating in the explanation column.
- 7. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form. 0 Page 2 of 3 OBDI 202 - IOLE Process
GG-2013-11 DRAFT OPERATING TEST COMMENTS SCENARIOS Scenario 1. 2. 3. 4. 5. 6. 7. 8. 9.
- 10. Explanation (See below for instructions)
Set ES TS Crit IC Pred TL L/C Eff U/E/S 1 S No comments.
2 E E I dont see any discriminatory value in events 6 or 7. Replace with events requiring operator actions.
3 S No comments.
Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating test scenario sets. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.
- 1. ES: ES-301 checklists 4, 5, & 6 satisfied.
- 3. Crit: Each manipulation or evolution has explicit success criteria documented in Form ES-D-2.
- 4. IC: Out of service equipment and other initial conditions reasonably consistent between scenarios and not predictive of scenario events and actions.
- 5. Pred: Scenario sequence and other factors avoid predictability issues.
- 6. TL: Time line constructed, including event and process triggered conditions, such that scenario can run without routine examiner cuing.
- 7. L/C: Length and complexity for each scenario in the set is reasonable for the crew mix being examined, such that all applicants have reasonably similar exposure and events are needed for evaluation purposes.
- 8. Eff: Sequence of events is reasonably efficient for examination purposes, especially with respect to long delays or interactions.
- 9. Based on the reviewer=s judgment, rate the scenario set as (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory.
- 10. Provide a brief description of problem in the explanation column.
- 11. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form. 0 Page 3 of 3 OBDI 202 - IOLE Process