ML120480179: Difference between revisions

From kanterella
Jump to navigation Jump to search
(Created page by program invented by StriderTol)
(Created page by program invented by StriderTol)
 
(One intermediate revision by the same user not shown)
Line 17: Line 17:


=Text=
=Text=
{{#Wiki_filter:Attachment 10 Page 1 of 6 OBDI 202 - I OLE Process SONGS - 2011 - 11 DRAFT OPERATING TEST COMMENTS ADMIN JPM S JPM# 1. Dyn (D/S) 2. LOD (1-5) 3. Attributes
{{#Wiki_filter:SONGS - 2011 - 11                                             DRAFT OPERATING TEST COMMENTS                                                                 ADMIN JPMS
: 4. Job Content Errors 5. U/E/S 6. Explanation (See below for instructions)
: 4. Job Content
IC Focus Cues  Critical Steps Scope (N/B) Over- lap Job-Link Minutia RA1           E 1. RA1 type codes went from C,M to R,M. What were the changes made to this document from Rev a to Rev c?
: 1. 2.           3. Attributes                                                                                 6.
  (Same comment for 301
Errors 5.
-2) 2. JPM step 6: acceptable range should be 19,100
JPM#    Dyn  LOD                                                                                                      Explanation U/E/S (D/S)  (1-5)  IC  Cues Critical  Scope  Over- Job-    Minutia                                          (See below for instructions)
-19,250 (not 18,900
Focus       Steps     (N/B) lap Link RA1                                                                         1. RA1 type codes went from C,M to R,M. What were the changes made to this document from Rev a to Rev c? (Same comment for 301-2)
-19,300) 3. JPM Classroom Setup page: why provide Attachments 4 and 10?
2. JPM step 6: acceptable range should be 19,100-19,250 (not 18,900-19,300)
: 3. JPM Classroom Setup page: why provide Attachments 4 and 10?
: 4. Need copy of original JPM SEE ATTACHED  
: 4. Need copy of original JPM SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES RA2           E 1. JPM step 7: acceptable range should be 27 +/
OF OP TEST CHANGES RA2                                                                         1. JPM step 7: acceptable range should be 27 +/- 0.5 hrs (not +/- 1 hr). Also update Answer Key.
- 0.5 hrs (not +/
2. JPM step 9: acceptable range should be 3.4 - 3.6. Also update Answer Key.
- 1 hr). Also update Answer Key.
: 3. Answer Key states minimum cooldown rate is 3.3-3.7 (step 8.b) but JPM step 9 states rate is 3.6 +/- 0.2 (which is 3.4-3.8).
: 2. JPM step 9: acceptable range should be 3.4 - 3.6. Also update Answer Key.
: 4. Need copy of original JPM SEE ATTACHED  
: 3. Answer Key states minimum cooldown rate is 3.3
-3.7 (step 8.b) but JPM step 9 states rate is 3.6 +/- 0.2 (which is 3.4
-3.8). 4. Need copy of original JPM SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES RA3             E 1. Answer Key: should step 2 be circled slashed (placekeeping)
OF OP TEST CHANGES RA3                                                                         1. Answer Key: should step 2 be circled slashed (placekeeping)
: 2. JPM steps 5
: 2. JPM steps 5-8: acceptable ranges? How did you determine +/- 0.2?
-8: acceptable ranges? How did you determine  
: 3. JPM step 9: acceptable ranges should be +/- 500 (not 1,000). Thus, total is +/- 2,000 (not 4,000)
+/- 0.2? 3. JPM step 9: acceptable ranges should be +/
- 500 (not 1,000). Thus, total is +/
- 2,000 (not 4,000)
: 4. JPM step 9: Pump 2 flow is 100,500, not 101,000. (Answer Key is correct)
: 4. JPM step 9: Pump 2 flow is 100,500, not 101,000. (Answer Key is correct)
: 5. JPM step 10: update acceptable range to +/
: 5. JPM step 10: update acceptable range to +/- 2,000
- 2,000 6. Need copy of original JPM SEE ATTACHED  
: 6. Need copy of original JPM SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES R A4          S 1. What is the impact if the applicant actually selects "NRC Connection?" SEE ATTACHED  
OF OP TEST CHANGES RA4                                                                      S   1. What is the impact if the applicant actually selects NRC Connection?
SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES S A 1 E 1. RA1 type codes went from C,M to R,M. What were the changes made to this document from Rev a to Rev c?
OF OP TEST CHANGES SA1                                                                          1. RA1 type codes went from C,M to R,M. What were the changes made to this document from Rev a to Rev c?
: 2. JPM step 6: acceptable range should be 19,100
: 2. JPM step 6: acceptable range should be 19,100-19,250 (not 18,900-19,300)
-19,250 (not 18,900
3. Answer Key 2 is missing Attachment 4 pages 1 and 2. (Could submit a PEO on this attachment to record data (2.1.2 and SWC flow rate.)
-19,300) 3. Answer Key 2 is missing Attachment 4 pages 1 and 2.
(Could submit a PEO on this attachment to record data (2.1.2 and SWC flow rate.)
: 4. JPM is missing Attachment 4, step 2.1.3.
: 4. JPM is missing Attachment 4, step 2.1.3.
: 5. Initial Conditions Cue Sheet #2: second bullet  
: 5. Initial Conditions Cue Sheet #2: second bullet - should be Spent Fuel Pool, not just Spent.
- should be Spent Fuel Pool, not just Spent. 7. Need copy of original JPM SEE ATTACHED  
: 7. Need copy of original JPM SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES S A 2            E 1. JPM step 8: acceptable range should be 27 +/
OF OP TEST CHANGES SA2                                                                          1. JPM step 8: acceptable range should be 27 +/- 0.5 hrs (not +/- 1 hr). Also update Answer Key.
- 0.5 hrs (not +/
2. JPM step 10: acceptable range should be 3.4 - 3.6. Also update Answer Key
- 1 hr). Also update Answer Key.
: 3. Answer Key states minimum cooldown rate is 3.3-3.7 (step 8.b) but JPM step 10 states rate is 3.6 +/- 0.2 (which is 3.4-3.8).
: 2. JPM step 10: acceptable range should be 3.4  
: 4. Need copy of original JPM SEE ATTACHED  
- 3.6. Also update Answer Key
: 3. Answer Key states minimum cooldown rate is 3.3
-3.7 (step 8.b) but JPM step 10 states rate is 3.6 +/
- 0.2 (which is 3.4
-3.8). 4. Need copy of original JPM SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES
OF OP TEST CHANGES 0                                                              Page 1 of 6                                                          OBDI 202 - IOLE Process


Attachment 10 Page 2 of 6 OBDI 202 - I OLE Process SONGS - 2011 - 11 DRAFT OPERATING TEST COMMENTS ADMIN JPM S JPM# 1. Dyn (D/S) 2. LOD (1-5) 3. Attributes
SONGS - 2011 - 11                                                           DRAFT OPERATING TEST COMMENTS                                                               ADMIN JPMS
: 4. Job Content Errors 5. U/E/S 6. Explanation (See below for instructions)
: 4. Job Content
IC Focus Cues  Critical Steps Scope (N/B) Over- lap Job-Link Minutia S A 3            E 1. JPM steps 5
: 1.       2.               3. Attributes                                                                                     6.
-8: acceptable ranges? How did you determine +/
Errors 5.
- 0.2? 2. JPM step 9: acceptable ranges should be +/
JPM#      Dyn      LOD                                                                                                              Explanation U/E/S (D/S)    (1-5)    IC    Cues Critical  Scope    Over-  Job-    Minutia                                          (See below for instructions)
- 500 (not 1,000). Thus, total is +/
Focus         Steps     (N/B)   lap   Link SA3                                                                                        1. JPM steps 5-8: acceptable ranges? How did you determine +/- 0.2?
- 2,000 (not 4,000). Also, 3P
: 2. JPM step 9: acceptable ranges should be +/- 500 (not 1,000). Thus, total is +/- 2,000 (not 4,000). Also, 3P-002 should be 96,500, not 97000. Thus, total is 381k.
-002 should be 96,500, not 97000. Thus, total is 381k.
: 3. Need copy of original JPM SEE ATTACHED  
: 3. Need copy of original JPM SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES S A 4          E 1. Do Initial Conditions need a statement that the Plant Computer is not available?
OF OP TEST CHANGES SA4                                                                                        1. Do Initial Conditions need a statement that the Plant Computer is not available?
: 2. JPM step 3: add to Standard "and entered on Step 2.2.3.2."
2. JPM step 3: add to Standard and entered on Step 2.2.3.2.
SEE ATTACHED  
SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES S A5            E 1. JPM step 1: Standard  
OF OP TEST CHANGES SA5                                                                                        1. JPM step 1: Standard - why does applicant need to refer to SONGS EAL Hot and Cold to make this determination?
- why does applicant need to refer to SONGS EAL Hot and Cold to make this determination?
2. JPM step 3: Standard - the EAL numerical designator is 1.1, not AA1.1.
: 2. JPM step 3: Standard  
- the EAL numerical designator is 1.1, not AA1.1.
SEE ATTACHED  
SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES Instructions for Completing Matrix This form is not contained in or required by NUREG
OF OP TEST CHANGES Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.
-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.
: 1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment.
: 1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment.
: 2. Determine level of difficulty (LOD) using established 1
: 2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.
-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.
: 3. Check the appropriate box when an attribute weakness is identified:
: 3. Check the appropriate box when an attribute weakness is identified:
The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.
* The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.
The JPM does not contain sufficient cues that are objective (not leading).
* The JPM does not contain sufficient cues that are objective (not leading).
All critical steps (elements) have not been properly identified.
* All critical steps (elements) have not been properly identified.
Scope of the task is either too narrow (N) or too broad (B).
* Scope of the task is either too narrow (N) or too broad (B).
Excessive overlap with other part of operating test or written examination.
* Excessive overlap with other part of operating test or written examination.
: 4. Check the appropriate box when a job content error is identified:
: 4. Check the appropriate box when a job content error is identified:
Topics not linked to job content (e.g., disguised task, not required in real job).
* Topics not linked to job content (e.g., disguised task, not required in real job).
Task is trivial and without safety significance.
* Task is trivial and without safety significance.
: 5. Based on the reviewer
: 5. Based on the reviewer=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
: 6. Provide a brief description of any U or E rating in the explanation column.
: 6. Provide a brief description of any U or E rating in the explanation column.  
: 7. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form. 0                                                                            Page 2 of 6                                                          OBDI 202 - IOLE Process
: 7. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form.


Attachment 10 Page 3 of 6 OBDI 202 - I OLE Process SONGS - 2011 - 11 DRAFT OPERATING TEST COMMENTS CONTROL ROOM/IN
SONGS - 2011 - 11                                             DRAFT OPERATING TEST COMMENTS                                 CONTROL ROOM/IN-PLANT SYSTEMS JPMS
-PLANT SYSTEM S JPM S JPM# 1. Dyn (D/S) 2. LOD (1-5) 3. Attributes
: 4. Job Content
: 4. Job Content Errors 5. U/E/S 6. Explanation (See below for instructions)
: 1. 2.           3. Attributes                                                                                   6.
IC Focus Cues  Critical Steps Scope (N/B) Over- lap Job-Link Minutia S 1          S  S 2            E 1. Does SONGS have an expectation for place keeping Cautions/Notes?
Errors       5.
Yes 2. Attachment 18, step 1.4: should this be marked N/A since SIAS was not actuated?
JPM#    Dyn  LOD                                                                                                        Explanation IC  Cues Critical  Scope  Over- Job-    Minutia U/E/S (D/S)  (1-5)                                                                                              (See below for instructions)
3.Need copy of original JPM SEE ATTACHED  
Focus       Steps     (N/B) lap Link S1                                                                      S S2                                                                          1. Does SONGS have an expectation for place keeping Cautions/Notes? Yes
: 2. Attachment 18, step 1.4: should this be marked N/A since SIAS was not actuated?
3.Need copy of original JPM SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES S 3          S 1. JPM step 4: Standard  
OF OP TEST CHANGES S3                                                                      S   1. JPM step 4: Standard - why is PZR PRESS HI annunciator in? Is this a combined annunciator? Yes SEE ATTACHED  
- why is PZR PRESS HI annunciator in? Is this a combined annunciator?
Yes SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES S 4            E 1. How can procedure step 6.1.4 be applicable but step 6.1.5 be marked N/A?
OF OP TEST CHANGES S4                                                                          1. How can procedure step 6.1.4 be applicable but step 6.1.5 be marked N/A?
: 2. Which PCS points are selected per procedure step 6.1.9? Should they be marked on   so the applicant can complete step 6.1.25? Or should there be a cue that another operator has checked the points and reports none are in alarm?
: 2. Which PCS points are selected per procedure step 6.1.9? Should they be marked on Attachment 1 so the applicant can complete step 6.1.25? Or should there be a cue that another operator has checked the points and reports none are in alarm?
: 3. JPM step 15: what does "ARO is at 2L
: 3. JPM step 15: what does ARO is at 2L-194 verifying alarm mean?
-194 verifying alarm" mean?
: 4. JPM step 16: Perform Step and Standard - state RCP P002 OC, not P003.
: 4. JPM step 16: Perform Step and Standard  
: 5. JPM step 18: where is the procedure guidance for this step? Should the Examiner Note on step 17 be on step 18 instead?
- state RCP P00 2 OC, not P00
: 3. 5. JPM step 18: where is the procedure guidance for this step?
Should the Examiner Note on step 17 be on step 18 instead?
: 6. Need copy of original JPM SEE ATTACHED  
: 6. Need copy of original JPM SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES S 5          E 1. Should procedure step 6.5.1 be place kept per the Initial Conditions?
OF OP TEST CHANGES S5                                                                      E   1. Should procedure step 6.5.1 be place kept per the Initial Conditions?
: 2. Need copy of original JPM SEE ATTACHED  
: 2. Need copy of original JPM SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES S 6      X        U 1. Should procedure step 6.1.1 be marked as N/A?
OF OP TEST CHANGES S6                                                                          1. Should procedure step 6.1.1 be marked as N/A?
: 2. Delete fourth bullet out of Initial Conditions (CCW loops) as applicant should be able to determine this without cueing (as stated in JPM step 1 Standard).
: 2. Delete fourth bullet out of Initial Conditions (CCW loops) as applicant should be able to X                                            U  determine this without cueing (as stated in JPM step 1 Standard).
: 3. JPM step 5: Standard  
: 3. JPM step 5: Standard - pushbuttons on CR56 OR CR53 are depressed, not AND.
- pushbuttons on CR56 OR CR53 are depressed, not AND. 4. Alternate Path JPMs are to be designed for the applicant to identify the alternate path without direction. JPM step 7 has the CRS provide the alternate success path  
: 4. Alternate Path JPMs are to be designed for the applicant to identify the alternate path without direction. JPM step 7 has the CRS provide the alternate success path - UNSAT.
- UNSAT. 5. Need copy of original JPM SEE ATTACHED  
: 5. Need copy of original JPM SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES S 7      X      U 1. Alternate Path JPMs are to be designed for the applicant to identify the alternate path without direction. JPM step 5 has the CRS provide the alternate success path  
OF OP TEST CHANGES S7                                                                          1. Alternate Path JPMs are to be designed for the applicant to identify the alternate path without direction. JPM step 5 has the CRS provide the alternate success path - UNSAT.
- UNSAT. 2. Who is the SRO Ops Supervisor?
X                                                2. Who is the SRO Ops Supervisor? CRS SEE ATTACHED  
CRS SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES S 8            E 1. Check marks not made in Section 2 of procedure as required by step 1.2.1.
OF OP TEST CHANGES S8                                                                          1. Check marks not made in Section 2 of procedure as required by step 1.2.1.
: 2. Why is procedure step 1.5 marked N/A? Is it common practice to mark a procedure step as N/A and place keep it?
: 2. Why is procedure step 1.5 marked N/A? Is it common practice to mark a procedure step as N/A and place keep it?
: 3. Is the second bullet in Initial Conditions required given procedure step 2.1.4?
: 3. Is the second bullet in Initial Conditions required given procedure step 2.1.4?
SEE ATTACHED  
SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES P1           1. Procedure s need placek ep t. Operationally valid to not place keep.
OF OP TEST CHANGES P1                                                                         1. Procedures need placekept. Operationally valid to not place keep. 0                                                              Page 3 of 6                                                            OBDI 202 - IOLE Process


Attachment 10 Page 4 of 6 OBDI 202 - I OLE Process SONGS - 2011 - 11 DRAFT OPERATING TEST COMMENTS CONTROL ROOM/IN
SONGS - 2011 - 11                                                         DRAFT OPERATING TEST COMMENTS                                 CONTROL ROOM/IN-PLANT SYSTEMS JPMS
-PLANT SYSTEM S JPM S JPM# 1. Dyn (D/S) 2. LOD (1-5) 3. Attributes
: 4. Job Content
: 4. Job Content Errors 5. U/E/S 6. Explanation (See below for instructions)
: 1.       2.                 3. Attributes                                                                                   6.
IC Focus Cues  Critical Steps Scope (N/B) Over- lap Job-Link Minutia  E 2. Need copy of original JPM
Errors       5.
- provided 3. Any reason we can't open the panel instead of using a picture?
JPM#      Dyn    LOD                                                                                                              Explanation IC    Cues Critical    Scope  Over-  Job-    Minutia U/E/S (D/S)    (1-5)                                                                                                    (See below for instructions)
Reactor trip hazard
Focus           Steps     (N/B) lap   Link
: 4. Unit 3 JPM, step 3: what are the procedure enhancements? EPPM Panel is identified a s 2L411 vice 3L411 SEE ATTACHED  
: 2. Need copy of original JPM - provided E    3. Any reason we cant open the panel instead of using a picture? Reactor trip hazard
: 4. Unit 3 JPM, step 3: what are the procedure enhancements? EPPM Panel is identified as 2L411 vice 3L411 SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES P2             E 1. Procedures need placekep
OF OP TEST CHANGES P2                                                                                     1. Procedures need placekept. Fixed
: t. Fixed 2. Nothing in the Initial Conditions states the Control Room is lost- don't understand why we're doing this section of the procedure.
: 2. Nothing in the Initial Conditions states the Control Room is lost dont understand why were doing this section of the procedure. Revised Initiating Cue E    3. Should 2.2.2.3 and 2.2.2.4 be place kept as N/A? Yes for Unit 2 - fixed
Revised Initiating Cue
: 4. Unit 2 and 3 JPMs step 14: Standard - is Exposure Fire Isolation Panel B2L-413 the same as Fire Isolation Panel 2L-413?
: 3. Should 2.2.2.3 and 2.2.2.4 be place kept as N/A?
: 5. Similar comment as #4 above for both JPMs step 16.
Yes for Unit 2  
: 6. Should identify in submittal that these procedures are to be withheld from public. Noted
- fixed 4. Unit 2 and 3 JPM s step 14: Standard  
: 7. Unit 3 JPM step 13: Examiner cue should state Unit 2 operator Fixed SEE ATTACHED  
- is Exposure Fire Isolation Panel B 2L-413 the same as Fire Isolation Panel 2L
-413?  
: 5. Similar comment as #4 above for both JPM s step 16. 6. Should identify in submittal that these procedures are to be withheld from public.
Noted 7. Unit 3 JPM step 13: Examiner cue should state Unit 2 operator Fixed SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES P3           E 1. Need to check boxes in Section 2 as required by Attachment 16
OF OP TEST CHANGES P3                                                                                     1. Need to check boxes in Section 2 as required by Attachment 16, step 1.3.1. Fixed E    2. Provide an electrical drawing depicting battery charger and associated breakers for reference - Provided SEE ATTACHED  
, step 1.3.1. Fixed 2. Provide an electrical drawing depicting battery charger and associated breakers for reference  
- Provided SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES Instructions for Completing Matrix This form is not contained in or required by NUREG
OF OP TEST CHANGES Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.
-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.
: 1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment.
: 1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment.
: 2. Determine level of difficulty (LOD) using established 1
: 2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.
-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.
: 3. Check the appropriate box when an attribute weakness is identified:
: 3. Check the appropriate box when an attribute weakness is identified:
$ The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.
        $ The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.
$ The JPM does not contain sufficient cues that are objective (not leading).
        $ The JPM does not contain sufficient cues that are objective (not leading).
$ All critical steps (elements) have not been properly identified.
        $ All critical steps (elements) have not been properly identified.
$ Scope of the task is either too narrow (N) or too broad (B).
        $ Scope of the task is either too narrow (N) or too broad (B).
$ Excessive overlap with other part of operating test or written examination.
        $ Excessive overlap with other part of operating test or written examination.
: 4. Check the appropriate box when a job content error is identified:
: 4. Check the appropriate box when a job content error is identified:
Topics not linked to job content (e.g., disguised task, not required in real job).
* Topics not linked to job content (e.g., disguised task, not required in real job).
Task is trivial and without safety significance.
* Task is trivial and without safety significance.
: 5. Based on the reviewer
: 5. Based on the reviewer=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
: 6. Provide a brief description of any U or E rating in the explanation column.
: 6. Provide a brief description of any U or E rating in the explanation column.  
: 7. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form. 0                                                                          Page 4 of 6                                                            OBDI 202 - IOLE Process
: 7. Save initial review comments as normal black text; indicate how comments were resolved usin g blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form.


Attachment 10 Page 5 of 6 OBDI 202 - I OLE Process SONGS - 2011 - 11 DRAFT OPERATING TEST COMMENTS SCENARIO S Scenario Set 1. ES 2. TS 3. Crit 4. IC 5. Pred 6. TL 7. L/C 8. Eff 9. U/E/S 10. Explanation (See below for instructions) 1         1. Feedback provided on the Draft Outlines identified a need to add clarifying information in parentheses following each of the Critical Tasks.
SONGS - 2011 - 11                                                     DRAFT OPERATING TEST COMMENTS                                                               SCENARIOS Scenario       1.     2.       3.     4.       5.       6.       7.     8. 9.
This was not done.
: 10. Explanation (See below for instructions)
: 2. Event 1: Step 3a, 3c and 3g  
Set        ES    TS      Crit    IC    Pred      TL      L/C    Eff  U/E/S 1                                                                                   1. Feedback provided on the Draft Outlines identified a need to add clarifying information in parentheses following each of the Critical Tasks. This was not done.
- shouldn't they be answered NO (vice YES) in order to get to the RNO column? Why is step 3i answered NO?
: 2. Event 1: Step 3a, 3c and 3g - shouldnt they be answered NO (vice YES) in order to get to the RNO column? Why is step 3i answered NO?
: 3. Event 2: procedure step 14a RNO states to use Attachment 12, not skill of the craft.
: 3. Event 2: procedure step 14a RNO states to use Attachment 12, not skill of the craft.
RNO directs go to step 14c when standby SWC pump is in service, not to steps 14a1 and 14a2? Is step 14 e answer NO (affected train is A)?
RNO directs go to step 14c when standby SWC pump is in service, not to steps 14a1 and 14a2? Is step 14 e answer NO (affected train is A)?
: 4. Event 3: Add TS LCO 3.2.3 Cond C to TS list. When is SO23 13, Attach 1 performed and by whom? Where is it directed to use SO23 28, RPR? SO23 1.10? SO23-3-2.2? SO23-5-1.7, Sect 6.3?
: 4. Event 3: Add TS LCO 3.2.3 Cond C to TS list. When is SO23-13-13, Attach 1 performed and by whom? Where is it directed to use SO23-13-28, RPR? SO23-3-1.10?
SO23-3-2.19? 5. Event s 4-9: Revise Critical Task statements to include detail
SO23-3-2.2? SO23-5-1.7, Sect 6.3? SO23-3-2.19?
: s. The answer to step s 1.a, 2.a, 7.a, 8.a, 8.c, 11.a and 11.b is NO (thus transition to RNO). 6. Actions for SO23 7, step 5, Verify CCW Configuration, are missing in D
: 5. Events 4-9: Revise Critical Task statements to include details. The answer to steps 1.a, 2.a, 7.a, 8.a, 8.c, 11.a and 11.b is NO (thus transition to RNO).
-2 (page 25) SEE ATTACHED  
: 6. Actions for SO23-12-7, step 5, Verify CCW Configuration, are missing in D-2 (page 25)
SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES 2         SEE ATTACHED  
OF OP TEST CHANGES 2                                                                                   SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES 3         SEE ATTACHED  
OF OP TEST CHANGES 3                                                                                   SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES 4         SEE ATTACHED  
OF OP TEST CHANGES 4                                                                                   SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES 5         1. Add SRO to Event 1 on D
OF OP TEST CHANGES 5                                                                                   1. Add SRO to Event 1 on D-1.
-1. 2. How does crew know to pump approx. 10% of sump for testing? (not in turnover)
: 2. How does crew know to pump approx. 10% of sump for testing? (not in turnover)
: 3. Event 2: step 3.d is NO (thus RNO)
: 3. Event 2: step 3.d is NO (thus RNO)
: 4. Event 3: step s 2.e and 2.h.6 are NO (thus RNO)
: 4. Event 3: steps 2.e and 2.h.6 are NO (thus RNO)
: 5. Events 5/6: Discuss Critical Task for tripping the reactor within one minute after entering SPTAs. What if SRO doesn't "enter" SPTAs for 2 minutes after turbine trip?
: 5. Events 5/6: Discuss Critical Task for tripping the reactor within one minute after entering SPTAs. What if SRO doesnt enter SPTAs for 2 minutes after turbine trip?
Also, D-2s have no steps from SO23 3: consider longer than 30 sec delay for inadvertent turbine trip.
Also, D-2s have no steps from SO23-13-3: consider longer than 30 sec delay for inadvertent turbine trip.
: 6. Events 7
: 6. Events 7-9: Summary states events are initiated upon reactor trip but D-2s state when directed. Are these events auto initiated or upon Lead Examiner cue?
-9: Summary states events are initiated upon reactor trip but D
-2s state "when directed." Are these events auto initiated or upon Lead Examiner cue?
: 7. D-2s state a Critical Task is depressing the start button for Train A HPSI pump but Summary states this pump will overcurrent trip upon SIAS?
: 7. D-2s state a Critical Task is depressing the start button for Train A HPSI pump but Summary states this pump will overcurrent trip upon SIAS?
: 8. SPTA step 8.a  
: 8. SPTA step 8.a - D-2s state Feedwater NOT available and therefore transition to RNO to verify EFAS initiated. Why is feedwater not available?
- D-2s state Feedwater NOT available and therefore transition to RNO to verify EFAS initiated. Why is feedwater not available?
: 9. SPTA step 9.a, RNO 9.a.1) is not on D-2s.
: 9. SPTA step 9.a, RNO 9.a.1) is not on D
SEE ATTACHED  
-2s. SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES 6         SEE ATTACHED  
OF OP TEST CHANGES 6                                                                                   SEE ATTACHED  


==SUMMARY==
==SUMMARY==
OF OP TEST CHANGES Instructions for Completing Matrix This form is not contained in or required by NUREG
OF OP TEST CHANGES Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating test scenario sets. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided. 0                                                                    Page 5 of 6                                                        OBDI 202 - IOLE Process
-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating test scenario sets. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.


Attachment 10 Page 6 of 6 OBDI 202 - I OLE Process SONGS - 2011 - 11 DRAFT OPERATING TEST COMMENTS SCENARIO S 1. ES: ES-301 checklists 4, 5, & 6 satisfied.
SONGS - 2011 - 11                                                     DRAFT OPERATING TEST COMMENTS                                                             SCENARIOS
: 1. ES: ES-301 checklists 4, 5, & 6 satisfied.
: 2. TS: Set includes SRO TS actions for each SRO, with required actions explicitly detailed.
: 2. TS: Set includes SRO TS actions for each SRO, with required actions explicitly detailed.
: 3. Crit: Each manipulation or evolution has explicit success criteria documented in Form ES
: 3. Crit: Each manipulation or evolution has explicit success criteria documented in Form ES-D-2.
-D-2. 4. IC: Out of service equipment and other initial conditions reasonably consistent between scenarios and not predictive of scenario events and actions.
: 4. IC: Out of service equipment and other initial conditions reasonably consistent between scenarios and not predictive of scenario events and actions.
: 5. Pred: Scenario sequence and other factors avoid predictability issues.
: 5. Pred: Scenario sequence and other factors avoid predictability issues.
: 6. TL: Time line constructed, including event and process triggered conditions, such that scenario can run without routine examiner cuing.
: 6. TL: Time line constructed, including event and process triggered conditions, such that scenario can run without routine examiner cuing.
: 7. L/C: Length and complexity for each scenario in the set is reasonable for the crew mix being examined, such that all applicants have reasonably similar exposure and events are needed for evaluation purposes.
: 7. L/C: Length and complexity for each scenario in the set is reasonable for the crew mix being examined, such that all applicants have reasonably similar exposure and events are needed for evaluation purposes.
: 8. Eff: Sequence of events is reasonably efficient for examination purposes, especially with respect to long delays or interactions.
: 8. Eff: Sequence of events is reasonably efficient for examination purposes, especially with respect to long delays or interactions.
: 9. Based on the reviewer
: 9. Based on the reviewer=s judgment, rate the scenario set as (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory.
=s judgment, rate the scenario set as (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory.
: 10. Provide a brief description of problem in the explanation column.
: 10. Provide a brief description of problem in the explanation column.
: 11. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form.
: 11. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form. 0                                                                    Page 6 of 6                                                    OBDI 202 - IOLE Process


SONGS NRC 2011 Synopsis of Operating Exam Changes (From NRC and SONGS Validation)
SONGS NRC 2011 Synopsis of Operating Exam Changes (From NRC and SONGS Validation)
SONGS NRC 2011 Synopsis of Operating Exam Changes Rev 2.doc Admin JPM General Comments:
Admin JPM General Comments:
Incorporated NRC Draft Operating Test comments as appropriate.
* Incorporated NRC Draft Operating Test comments as appropriate.
Incorporated NRC validation comments as appropriate
* Incorporated NRC validation comments as appropriate.
. Updated Form ES
* Updated Form ES-301-1 for RO (removed C Type Code from RA4).
-301-1 for RO (removed "C" Type Code from RA4).
* Provided hard and electronic original copies of Admin JPMs that were modified.
Provided hard and electronic original copies of Admin JPMs that were modified.
: 1. RA1 Reported to CE that Type Codes were changed (C, M to R, M) to allow JPM to be performed in the Classroom vice Plant (time constraints).
: 1. RA1 Reported to CE that Type Codes were changed (C, M to R, M) to allow JPM to be performed in the Classroom vice Plant (time constraints)
Removed Attachment 4 (not required) from Procedure and JPM and retained Attachment 10, Limitations and Specifics (provided as L&S they may be referenced).
. Removed Attachment 4 (not required) from Procedure and JPM and retained Attachment 10, Limitations and Specifics (provided as L&S they may be referenced).
Changed Answer Key to red ink where applicable.
Changed Answer Key to red ink where applicable.
Changed Acceptable Range at Perform Step 2.6 now 19,000 GPM to 19,250 GPM.
Changed Acceptable Range at Perform Step 2.6 now 19,000 GPM to 19,250 GPM.
: 2. RA2 Corrected JPM and Answer Key at Perform Steps 7 & 9.
: 2. RA2 Corrected JPM and Answer Key at Perform Steps 7 & 9.
Changed Answer Key to red ink where applicable.
Changed Answer Key to red ink where applicable.
: 3. RA3 Added place keeping to Procedure Step 2.1.
: 3. RA3 Added place keeping to Procedure Step 2.1.
Arrived at +/- 0.2 for Perform Steps 5 to 8 to accommodate any rounding done by the applicant.
Arrived at +/- 0.2 for Perform Steps 5 to 8 to accommodate any rounding done by the applicant.
Changed acceptable range for pump flow s at Perform Step 9 from +/- 1000 to +/- 500 GPM.
Changed acceptable range for pump flows at Perform Step 9 from +/- 1000 to +/- 500 GPM.
Corrected flow value for 2 P-002 at Perform Step 9 to 101,500 100,500 GPM. Changed acceptable range for total flow at Perform Steps 9 and 10 from +/- 4000 to +/- 2000 GPM. Changed Answer Key to red ink where applicable.
Corrected flow value for 2P-002 at Perform Step 9 to 101,500 100,500 GPM.
: 4. RA4 Removed Control Room from Testing Method to avoid inadvertent activation of ERDS.
Changed acceptable range for total flow at Perform Steps 9 and 10 from +/- 4000 to +/- 2000 GPM.
Changed Answer Key to red ink where applicable.
: 4. RA4 Removed Control Room from Testing Method to avoid inadvertent activation of ERDS.
Modified Examine Note in Simulator Setup.
Modified Examine Note in Simulator Setup.
Removed Examiner Cues to simulate the NRC connection at Perform Steps 4 and 6 (Simulator cannot connect to ERDS, therefore, this action can be performed
Removed Examiner Cues to simulate the NRC connection at Perform Steps 4 and 6 (Simulator cannot connect to ERDS, therefore, this action can be performed).
). Reworded Standard in Perform Steps 4 and 6 to reflect ERDS screen.
Reworded Standard in Perform Steps 4 and 6 to reflect ERDS screen.
Reworded Standards for Perform Steps 2 through 6 to reflect critical versus non
Reworded Standards for Perform Steps 2 through 6 to reflect critical versus non-critical part of task.
-critical part of task. 5. SA1 Reported to CE that Type Codes were changed (C, M to R, M) to allow JPM to be performed in the Classroom vice Plant (time constraints).
: 5. SA1 Reported to CE that Type Codes were changed (C, M to R, M) to allow JPM to be performed in the Classroom vice Plant (time constraints).
Changed Acceptable Range at Perform Step 2.6 now 19,000 GPM to 19,250 GPM.
Changed Acceptable Range at Perform Step 2.6 now 19,000 GPM to 19,250 GPM.
Changed Answer Key to red ink where applicable.
Changed Answer Key to red ink where applicable.
Line 292: Line 261:
Added Pages 1 and 2 to Answer Key #2 and inserted place keeping.
Added Pages 1 and 2 to Answer Key #2 and inserted place keeping.
Made Perform Step 13 a Critical Step to reflect OPERABILITY of Saltwater Cooling System.
Made Perform Step 13 a Critical Step to reflect OPERABILITY of Saltwater Cooling System.
Deleted 3 rd bullet from JPM Cue Sheet #2 as it was not necessary
Deleted 3rd bullet from JPM Cue Sheet #2 as it was not necessary.
. 6. SA2 JPM Cue Sheet #1 is the precursor for having to perform Cue Sheet #2.
: 6. SA2 JPM Cue Sheet #1 is the precursor for having to perform Cue Sheet #2.
Corrected JPM and Answer Key at Perform Steps 8 & 10.
Corrected JPM and Answer Key at Perform Steps 8 & 10.
Changed Answer Key to red ink where applicable.
Changed Answer Key to red ink where applicable.
SONGS NRC 2011 Synopsis of Operating Exam Changes Rev 2.doc


SONGS NRC 2011 Synopsis of Operating Exam Changes (From NRC and SONGS Validation)
SONGS NRC 2011 Synopsis of Operating Exam Changes (From NRC and SONGS Validation)
SONGS NRC 2011 Synopsis of Operating Exam Changes Rev 2.doc
: 7. SA3 Added place keeping to Procedure Step 2.1.
: 7. SA3 Added place keeping to Procedure Step 2.1.
Arrived at +/- 0.2 for Perform Steps 5 to 8 to accommodate any rounding done by the applicant.
Arrived at +/- 0.2 for Perform Steps 5 to 8 to accommodate any rounding done by the applicant.
Changed acceptable range for pump flow s at Perform Step 9 from +/- 1000 to +/- 500 GPM.
Changed acceptable range for pump flows at Perform Step 9 from +/- 1000 to +/- 500 GPM.
Corrected flow value for 3P
Corrected flow value for 3P-002 at Perform Step 9 to 96,500 GPM.
-002 at Perform Step 9 to 96,500 GPM.
Changed acceptable range for total flow at Perform Steps 9 and 10 from +/- 4000 to +/- 2000 GPM and changed answer to 381,000 GPM.
Changed acceptable range for total flow at Perform Steps 9 and 10 from +/- 4000 to +/- 2000 GPM and changed answer to 381,000 GPM.
Changed Answer Key to red ink where applicable.
Changed Answer Key to red ink where applicable.
: 8. SA4 Reworded Task Standard.
: 8. SA4 Reworded Task Standard.
Initial Conditions do not need to state that the Plant Computer System is unavailable since this information is annotated in SO23 15, Attachment 4, Step 2.1.
Initial Conditions do not need to state that the Plant Computer System is unavailable since this information is annotated in SO23-8-15, Attachment 4, Step 2.1.
Changed Answer Key to red ink where applicable.
Changed Answer Key to red ink where applicable.
: 9. SA5 Modified Initial Conditions by removing the bullet for duration of the release and adding unisolable as a prefix to the piping.
: 9. SA5 Modified Initial Conditions by removing the bullet for duration of the release and adding unisolable as a prefix to the piping.
Removed Cold from Standard at Perform Step 1
Removed Cold from Standard at Perform Step 1.
. Reworded Standard in Perform Step 3 to reflect critical versus non
Reworded Standard in Perform Step 3 to reflect critical versus non-critical part of task.
-critical part of task.
SONGS NRC 2011 Synopsis of Operating Exam Changes Rev 2.doc


SONGS NRC 2011 Synopsis of Operating Exam Changes (From NRC and SONGS Validation)
SONGS NRC 2011 Synopsis of Operating Exam Changes (From NRC and SONGS Validation)
SONGS NRC 2011 Synopsis of Operating Exam Changes Rev 2.doc Plant / Simulator JPM General Comments:
Plant / Simulator JPM General Comments:
Incorporated NRC Draft Operating Test comments as appropriate.
* Incorporated NRC Draft Operating Test comments as appropriate.
Incorporated NRC validation comments as appropriate
* Incorporated NRC validation comments as appropriate.
. Provided hard and electronic original copies of Plant / Simulator JPMs that were modified.
* Provided hard and electronic original copies of Plant / Simulator JPMs that were modified.
Updated Form ES
* Updated Form ES-301-2 (removed A Type Code from S-6).
-301-2 (removed "A" Type Code from S
: 1. S-1     Recorded Procedure Enhancement Opportunity (PEO) for SO23-13-11, Emergency Boration of the RCS, in 2011 NRC PEO document (pump nomenclature).
-6). 1. S-1 Recorded Procedure Enhancement Opportunity (PEO) for SO23 11, Emergency Boration of the RCS, in 2011 NRC PEO document (pump nomenclature). 2. S-2 Modified Examiner Cue at Perform Step 3
: 2. S-2     Modified Examiner Cue at Perform Step 3.
. Added place keeping to CAUTION box in Attachment 18 and Step 2.3
Added place keeping to CAUTION box in Attachment 18 and Step 2.3.
. Changed place keeping in Attachment 18, Step 1.4, to N/A since SIAS was not actuated. 3. S-3 Modified Standard at Perform Step 3 to differentiate between critical and non
Changed place keeping in Attachment 18, Step 1.4, to N/A since SIAS was not actuated.
-critical part of task.
: 3. S-3     Modified Standard at Perform Step 3 to differentiate between critical and non-critical part of task.
: 4. S-4 Added place keeping to beginning of SO23 1.7 and corrected place keeping at Step 6.1.4.
: 4. S-4     Added place keeping to beginning of SO23-3-1.7 and corrected place keeping at Step 6.1.4.
Changed Alternate Path from RCP Overcurrent (OC) to Thrust Bearing High Temperature. Re-snapped Simulator after removing Reactor Coolant Pump alarms that were present during verification of Perform Step 6
Changed Alternate Path from RCP Overcurrent (OC) to Thrust Bearing High Temperature.
. Added Examiner Cue at Perform Step 17 that another operator will complete Standard Post Trip Actions
Re-snapped Simulator after removing Reactor Coolant Pump alarms that were present during verification of Perform Step 6.
. Verified PEO already documented for SO23
Added Examiner Cue at Perform Step 17 that another operator will complete Standard Post Trip Actions.
-15.56C, Reactor Coolant Pump OC alarm s (incorrect listing of steps for tripping RCP & Reactor)
Verified PEO already documented for SO23-15.56C, Reactor Coolant Pump OC alarms (incorrect listing of steps for tripping RCP & Reactor).
. Added PEO that RCP Oil Lift & AARD pushbuttons in SIM do not respond as the plants do.
Added PEO that RCP Oil Lift & AARD pushbuttons in SIM do not respond as the plants do.
: 5. S-5 Corrected 2 nd bullet in Initial Conditions.
: 5. S-5     Corrected 2nd bullet in Initial Conditions.
Verified place keeping for SO23 6, Step 6.5.1 is not required.
Verified place keeping for SO23-9-6, Step 6.5.1 is not required.
Moved Examiner Note from Perform Steps 3 and 4 to Perform Steps 1 and 2. Modified Standard at Perform Steps 1 and 2 to differentiate between critical and non
Moved Examiner Note from Perform Steps 3 and 4 to Perform Steps 1 and 2.
-critical part of task.
Modified Standard at Perform Steps 1 and 2 to differentiate between critical and non-critical part of task.
Added wording to Terminating Cue.  
Added wording to Terminating Cue.
: 6. S-6 Removed Alternate Path designation.
: 6. S-6     Removed Alternate Path designation.
Deleted 4 th bullet from Initial Conditions.
Deleted 4th bullet from Initial Conditions.
Reworded Task Standard.
Reworded Task Standard.
Modified place keeping at beginning of Procedure 1.
Modified place keeping at beginning of Procedure 1.
Modified Standard at Perform Step 5 from "
Modified Standard at Perform Step 5 from and to and/or.
and" to "and/or.Expanded Standard in Perform Step 2 to allow tracking of Train A and B components.
Expanded Standard in Perform Step 2 to allow tracking of Train A and B components.
: 7. S-7 Added breaker nomenclature to Standard in Perform Step 1.
: 7. S-7     Added breaker nomenclature to Standard in Perform Step 1.
Modified Standard at Perform Step 11.
Modified Standard at Perform Step 11.
Added band for Emergency Diesel Generator output voltage to Perform Step 15.
Added band for Emergency Diesel Generator output voltage to Perform Step 15.
Moved Alternate Path designation from Perform Step 6 to Perform Step 15.
Moved Alternate Path designation from Perform Step 6 to Perform Step 15.
Removed Critical Step designation from Perform Step 16.
Removed Critical Step designation from Perform Step 16.
Recorded PEO for SO23 2, Transferring of 4 kV Buses, Steps 6.17.6 and 6.17.7 in 2011 NRC PEO document (these steps should be NOTES / CAUTIONS)
Recorded PEO for SO23-6-2, Transferring of 4 kV Buses, Steps 6.17.6 and 6.17.7 in 2011 NRC PEO document (these steps should be NOTES / CAUTIONS).
.
SONGS NRC 2011 Synopsis of Operating Exam Changes Rev 2.doc
 
SONGS NRC 2011 Synopsis of Operating Exam Changes (From NRC and SONGS Validation)
SONGS NRC 2011 Synopsis of Operating Exam Changes (From NRC and SONGS Validation)
SONGS NRC 2011 Synopsis of Operating Exam Changes Rev 2.doc
: 8. S-8 Moved 2nd bullet in Initial Conditions to Initiating Cue.
: 8. S-8 Moved 2 nd bullet in Initial Conditions to Initiating Cue
Added place keeping checkmark into Procedure 1 at Step 2.1.1.
. Added place keeping checkmark into Procedure 1 at Step 2.1.1.
Added Examiner Cue at Perform Step 4 Procedure 2.
Added Examiner Cue at Perform Step 4 Procedure 2.
Changed color of dot for 2R
Changed color of dot for 2R-7804 from green to blue in Standard of Perform Step 14.
-7804 from green to blue in Standard of Perform Step 14
: 9. P-1 Added note to Plant Setup to provide a color copy of the power supply inside the EPPM.
.
: 9. P-1 Added note to Plant Setup to provide a color copy of the power supply inside the EPPM.
Recorded PEO for labeling (procedure vs. actual) on the power supply inside the EPPM.
Recorded PEO for labeling (procedure vs. actual) on the power supply inside the EPPM.
Verified that the Control Room Supervisor is the point of contact when the headset is connected in Perform Step 2. [Refer to SO23 2, Attachment 2(3), Step 7.0 for Unit 2(3)
Verified that the Control Room Supervisor is the point of contact when the headset is connected in Perform Step 2. [Refer to SO23-13-2, Attachment 2(3), Step 7.0 for Unit 2(3).]
.] Added plant temperatures to Examiner Cues as required.
Added plant temperatures to Examiner Cues as required.
Moved Examiner Cue for oscillating indication and added Examiner Cue once handswitches were cycled.
Moved Examiner Cue for oscillating indication and added Examiner Cue once handswitches were cycled.
Separated out critical from non
Separated out critical from non-critical portions of Standards.
-critical portions of Standards.
: 10. P-2 Added Note to bottom of 1st page to withhold from public disclosure per 10 CFR 2.390.
: 10. P-2 Added Note to bottom of 1 st page to withhold from public disclosure per 10 CFR 2.390.
Added place keeping as required in SO23-13-25, Attachment 3.
Added place keeping as required in SO23-13-25, Attachment 3.
Inserted place keeping and N/A for Unit 3 portion of Unit 2 actions and vice versa.
Inserted place keeping and N/A for Unit 3 portion of Unit 2 actions and vice versa.
Recorded PEO to add list of Unit 2 and Unit 3 LOCAL/CONTROL Room Switches from SO23-13-2, Attachment 1, to SO23 25, Attachment 3.
Recorded PEO to add list of Unit 2 and Unit 3 LOCAL/CONTROL Room Switches from SO23-13-2, Attachment 1, to SO23-13-25, Attachment 3.
Reworded Initial Conditions and Initiating Cue so that JPM would start at Step 2.2.2.
Reworded Initial Conditions and Initiating Cue so that JPM would start at Step 2.2.2.
Corrected Examiner Cue at Perform Step 12 (previously Perform Step 13) for Unit 3 JPM
Corrected Examiner Cue at Perform Step 12 (previously Perform Step 13) for Unit 3 JPM.
. 11. P-3 Added place keeping checkmarks where appropriate.
: 11. P-3 Added place keeping checkmarks where appropriate.
Electrical drawing is provided within the procedure (Attachment 18).
Electrical drawing is provided within the procedure (Attachment 18).
Modified Examiner Cue at Perform Step 5.
Modified Examiner Cue at Perform Step 5.
Added Examiner Note at Perform Step 7 for breaker location.
Added Examiner Note at Perform Step 7 for breaker location.
Modified Examiner Cues at Perform Steps 8, 9, 11, 12, 13, 15 and 16
Modified Examiner Cues at Perform Steps 8, 9, 11, 12, 13, 15 and 16.
. Recorded PEO for SO23-6-15, Attachment 16, Step 2.1.13.3 does not list a desired band (i.e., 125 to 135 VDC) for Battery Charger voltage
Recorded PEO for SO23-6-15, Attachment 16, Step 2.1.13.3 does not list a desired band (i.e., 125 to 135 VDC) for Battery Charger voltage.
.
SONGS NRC 2011 Synopsis of Operating Exam Changes Rev 2.doc
 
SONGS NRC 2011 Synopsis of Operating Exam Changes (From NRC and SONGS Validation)
SONGS NRC 2011 Synopsis of Operating Exam Changes (From NRC and SONGS Validation)
SONGS NRC 2011 Synopsis of Operating Exam Changes Rev 2.doc Simulator Scenario General Comments:
Simulator Scenario General Comments:
Incorporated NRC comments as appropriate.
* Incorporated NRC comments as appropriate.
Modified RNO statements throughout the scenarios (NO vs. YES)
* Modified RNO statements throughout the scenarios (NO vs. YES).
. Added additional Technical Specifications as identified
* Added additional Technical Specifications as identified.
. Added additional Examiner Notes where appropriate.
* Added additional Examiner Notes where appropriate.
Corrected typos (procedure steps/wording) throughout.
* Corrected typos (procedure steps/wording) throughout.
Reworded Critical Safety Function criteria during Standard Post Trip Actions.
* Reworded Critical Safety Function criteria during Standard Post Trip Actions.
Aligned Emergency Chillers to Unit 3 throughout
* Aligned Emergency Chillers to Unit 3 throughout.
. 1. Scenario #1 Changed wording on all 3 CT statements.
: 1. Scenario #1 Changed wording on all 3 CT statements.
Added steps and changed wording as required in Event 3.
Added steps and changed wording as required in Event 3.
Added explanations to facilitate understanding of procedures in use (Examiner Notes).
Added explanations to facilitate understanding of procedures in use (Examiner Notes).
Rearranged steps for both CT s in Events 4 and 5.
Rearranged steps for both CTs in Events 4 and 5.
: 2. Scenario #2 Changed wording on first two CT statements. Added A.2 and B.2 REQUIRED ACTIONS to Event 2 Technical Specifications.
: 2. Scenario #2 Changed wording on first two CT statements.
Added A.2 and B.2 REQUIRED ACTIONS to Event 2 Technical Specifications.
Requested TV-0224B, Demineralizer Temperature Control Valve, be added as a new malfunction to Procedure Enhancement Opportunity (PEO) List.
Requested TV-0224B, Demineralizer Temperature Control Valve, be added as a new malfunction to Procedure Enhancement Opportunity (PEO) List.
Added Examiner Note to explain why placing Train A EDG in Maintenance Lockout was not a CT (SONGS to provide Annunciator Response Procedure SO23 2.35.1, Local Diesel Alarm Panel)
Added Examiner Note to explain why placing Train A EDG in Maintenance Lockout was not a CT (SONGS to provide Annunciator Response Procedure SO23-5-2.35.1, Local Diesel Alarm Panel).
. Added steps for SO23 11, Attachment 8 prior to transitioning to SO23 11, Attachment 24.
Added steps for SO23-12-11, Attachment 8 prior to transitioning to SO23-12-11, Attachment 24.
: 3. Scenario #3 Changed wording on 1 st CT statement.
: 3. Scenario #3 Changed wording on 1st CT statement.
Added wording from SO23 2.13, Attachment 1, to identify Core Protection Calculator nomenclature (Event 2). Added Floor Cues to Event 3 to clarify required actions and/or SRO recommendations.
Added wording from SO23-3-2.13, Attachment 1, to identify Core Protection Calculator nomenclature (Event 2).
Added steps for Emergent Manual CEA Positioning per SO23 2.19 and Turbine Operation per SO23-5-1.7, Section 6.4 to Event 3.
Added Floor Cues to Event 3 to clarify required actions and/or SRO recommendations.
Added Examiner Note to explain why manually actuating the Main Steam Isolation Signal was not a CT. 4. Scenario #
Added steps for Emergent Manual CEA Positioning per SO23-3-2.19 and Turbine Operation per SO23-5-1.7, Section 6.4 to Event 3.
4 Changed wording on 1 st CT statement.
Added Examiner Note to explain why manually actuating the Main Steam Isolation Signal was not a CT.
: 4. Scenario #4 Changed wording on 1st CT statement.
Added Examiner Note to Event 2 about shortening length if desired.
Added Examiner Note to Event 2 about shortening length if desired.
Corrected Unit 2 and Unit 3 wording in Event 2.
Corrected Unit 2 and Unit 3 wording in Event 2.
: 5. Scenario #
: 5. Scenario #5 Added SRO as a NORMAL to Event 1.
5 Added SRO as a NORMAL to Event 1
Identified CCW Swing Pump (P-025) HPSI Swing Pump (P-018) in the scenario summary.
. Identified CCW Swing Pump (P
Added Examiner Note explaining difference between Low Pressure and High Pressure Nuclear Service Water Pumps.
-025) HPSI Swing Pump (P
Added place keeping to procedure SO23-2-16 for Event 1.
-018) in the scenario summary
. Added Examiner Note explaining difference between Low Pressure and High Pressure Nuclear Service Water Pumps.
Added place keeping to procedure SO23 16 for Event 1.
Added A.2 REQUIRED ACTIONS to Event 2 Technical Specifications.
Added A.2 REQUIRED ACTIONS to Event 2 Technical Specifications.
Added final step when bypassing Feedwater Control System instrument in Event 2
Added final step when bypassing Feedwater Control System instrument in Event 2.
. 6. Scenario #6 (spare) Corrected typo wording on 2 nd CT statement.
: 6. Scenario #6 (spare)
Reworded plants status on Shift Turnover Sheet.}}
Corrected typo wording on 2nd CT statement.
Reworded plants status on Shift Turnover Sheet.
SONGS NRC 2011 Synopsis of Operating Exam Changes Rev 2.doc}}

Latest revision as of 08:05, 12 November 2019

2011-11-Draft OP Test Comments
ML120480179
Person / Time
Site: San Onofre  Southern California Edison icon.png
Issue date: 10/28/2011
From:
NRC Region 4
To:
Southern California Edison Co
References
50-206/11-11, 50-361/11-11, 50-362/11-11 50-206/OL-11, 50-361/OL-11, 50-362/OL-11
Download: ML120480179 (11)


Text

SONGS - 2011 - 11 DRAFT OPERATING TEST COMMENTS ADMIN JPMS

4. Job Content
1. 2. 3. Attributes 6.

Errors 5.

JPM# Dyn LOD Explanation U/E/S (D/S) (1-5) IC Cues Critical Scope Over- Job- Minutia (See below for instructions)

Focus Steps (N/B) lap Link RA1 1. RA1 type codes went from C,M to R,M. What were the changes made to this document from Rev a to Rev c? (Same comment for 301-2)

E 2. JPM step 6: acceptable range should be 19,100-19,250 (not 18,900-19,300)

3. JPM Classroom Setup page: why provide Attachments 4 and 10?
4. Need copy of original JPM SEE ATTACHED

SUMMARY

OF OP TEST CHANGES RA2 1. JPM step 7: acceptable range should be 27 +/- 0.5 hrs (not +/- 1 hr). Also update Answer Key.

E 2. JPM step 9: acceptable range should be 3.4 - 3.6. Also update Answer Key.

3. Answer Key states minimum cooldown rate is 3.3-3.7 (step 8.b) but JPM step 9 states rate is 3.6 +/- 0.2 (which is 3.4-3.8).
4. Need copy of original JPM SEE ATTACHED

SUMMARY

OF OP TEST CHANGES RA3 1. Answer Key: should step 2 be circled slashed (placekeeping)

2. JPM steps 5-8: acceptable ranges? How did you determine +/- 0.2?
3. JPM step 9: acceptable ranges should be +/- 500 (not 1,000). Thus, total is +/- 2,000 E (not 4,000)
4. JPM step 9: Pump 2 flow is 100,500, not 101,000. (Answer Key is correct)
5. JPM step 10: update acceptable range to +/- 2,000
6. Need copy of original JPM SEE ATTACHED

SUMMARY

OF OP TEST CHANGES RA4 S 1. What is the impact if the applicant actually selects NRC Connection?

SEE ATTACHED

SUMMARY

OF OP TEST CHANGES SA1 1. RA1 type codes went from C,M to R,M. What were the changes made to this document from Rev a to Rev c?

2. JPM step 6: acceptable range should be 19,100-19,250 (not 18,900-19,300)

E 3. Answer Key 2 is missing Attachment 4 pages 1 and 2. (Could submit a PEO on this attachment to record data (2.1.2 and SWC flow rate.)

4. JPM is missing Attachment 4, step 2.1.3.
5. Initial Conditions Cue Sheet #2: second bullet - should be Spent Fuel Pool, not just Spent.
7. Need copy of original JPM SEE ATTACHED

SUMMARY

OF OP TEST CHANGES SA2 1. JPM step 8: acceptable range should be 27 +/- 0.5 hrs (not +/- 1 hr). Also update Answer Key.

E 2. JPM step 10: acceptable range should be 3.4 - 3.6. Also update Answer Key

3. Answer Key states minimum cooldown rate is 3.3-3.7 (step 8.b) but JPM step 10 states rate is 3.6 +/- 0.2 (which is 3.4-3.8).
4. Need copy of original JPM SEE ATTACHED

SUMMARY

OF OP TEST CHANGES 0 Page 1 of 6 OBDI 202 - IOLE Process

SONGS - 2011 - 11 DRAFT OPERATING TEST COMMENTS ADMIN JPMS

4. Job Content
1. 2. 3. Attributes 6.

Errors 5.

JPM# Dyn LOD Explanation U/E/S (D/S) (1-5) IC Cues Critical Scope Over- Job- Minutia (See below for instructions)

Focus Steps (N/B) lap Link SA3 1. JPM steps 5-8: acceptable ranges? How did you determine +/- 0.2?

2. JPM step 9: acceptable ranges should be +/- 500 (not 1,000). Thus, total is +/- 2,000 E (not 4,000). Also, 3P-002 should be 96,500, not 97000. Thus, total is 381k.
3. Need copy of original JPM SEE ATTACHED

SUMMARY

OF OP TEST CHANGES SA4 1. Do Initial Conditions need a statement that the Plant Computer is not available?

E 2. JPM step 3: add to Standard and entered on Step 2.2.3.2.

SEE ATTACHED

SUMMARY

OF OP TEST CHANGES SA5 1. JPM step 1: Standard - why does applicant need to refer to SONGS EAL Hot and Cold to make this determination?

E 2. JPM step 3: Standard - the EAL numerical designator is 1.1, not AA1.1.

SEE ATTACHED

SUMMARY

OF OP TEST CHANGES Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.

1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment.
2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.
3. Check the appropriate box when an attribute weakness is identified:
  • The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.
  • The JPM does not contain sufficient cues that are objective (not leading).
  • All critical steps (elements) have not been properly identified.
  • Scope of the task is either too narrow (N) or too broad (B).
  • Excessive overlap with other part of operating test or written examination.
4. Check the appropriate box when a job content error is identified:
  • Topics not linked to job content (e.g., disguised task, not required in real job).
  • Task is trivial and without safety significance.
5. Based on the reviewer=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
6. Provide a brief description of any U or E rating in the explanation column.
7. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form. 0 Page 2 of 6 OBDI 202 - IOLE Process

SONGS - 2011 - 11 DRAFT OPERATING TEST COMMENTS CONTROL ROOM/IN-PLANT SYSTEMS JPMS

4. Job Content
1. 2. 3. Attributes 6.

Errors 5.

JPM# Dyn LOD Explanation IC Cues Critical Scope Over- Job- Minutia U/E/S (D/S) (1-5) (See below for instructions)

Focus Steps (N/B) lap Link S1 S S2 1. Does SONGS have an expectation for place keeping Cautions/Notes? Yes

2. Attachment 18, step 1.4: should this be marked N/A since SIAS was not actuated?

E 3.Need copy of original JPM SEE ATTACHED

SUMMARY

OF OP TEST CHANGES S3 S 1. JPM step 4: Standard - why is PZR PRESS HI annunciator in? Is this a combined annunciator? Yes SEE ATTACHED

SUMMARY

OF OP TEST CHANGES S4 1. How can procedure step 6.1.4 be applicable but step 6.1.5 be marked N/A?

2. Which PCS points are selected per procedure step 6.1.9? Should they be marked on Attachment 1 so the applicant can complete step 6.1.25? Or should there be a cue that E another operator has checked the points and reports none are in alarm?
3. JPM step 15: what does ARO is at 2L-194 verifying alarm mean?
4. JPM step 16: Perform Step and Standard - state RCP P002 OC, not P003.
5. JPM step 18: where is the procedure guidance for this step? Should the Examiner Note on step 17 be on step 18 instead?
6. Need copy of original JPM SEE ATTACHED

SUMMARY

OF OP TEST CHANGES S5 E 1. Should procedure step 6.5.1 be place kept per the Initial Conditions?

2. Need copy of original JPM SEE ATTACHED

SUMMARY

OF OP TEST CHANGES S6 1. Should procedure step 6.1.1 be marked as N/A?

2. Delete fourth bullet out of Initial Conditions (CCW loops) as applicant should be able to X U determine this without cueing (as stated in JPM step 1 Standard).
3. JPM step 5: Standard - pushbuttons on CR56 OR CR53 are depressed, not AND.
4. Alternate Path JPMs are to be designed for the applicant to identify the alternate path without direction. JPM step 7 has the CRS provide the alternate success path - UNSAT.
5. Need copy of original JPM SEE ATTACHED

SUMMARY

OF OP TEST CHANGES S7 1. Alternate Path JPMs are to be designed for the applicant to identify the alternate path U without direction. JPM step 5 has the CRS provide the alternate success path - UNSAT.

X 2. Who is the SRO Ops Supervisor? CRS SEE ATTACHED

SUMMARY

OF OP TEST CHANGES S8 1. Check marks not made in Section 2 of procedure as required by step 1.2.1.

2. Why is procedure step 1.5 marked N/A? Is it common practice to mark a procedure step E as N/A and place keep it?
3. Is the second bullet in Initial Conditions required given procedure step 2.1.4?

SEE ATTACHED

SUMMARY

OF OP TEST CHANGES P1 1. Procedures need placekept. Operationally valid to not place keep. 0 Page 3 of 6 OBDI 202 - IOLE Process

SONGS - 2011 - 11 DRAFT OPERATING TEST COMMENTS CONTROL ROOM/IN-PLANT SYSTEMS JPMS

4. Job Content
1. 2. 3. Attributes 6.

Errors 5.

JPM# Dyn LOD Explanation IC Cues Critical Scope Over- Job- Minutia U/E/S (D/S) (1-5) (See below for instructions)

Focus Steps (N/B) lap Link

2. Need copy of original JPM - provided E 3. Any reason we cant open the panel instead of using a picture? Reactor trip hazard
4. Unit 3 JPM, step 3: what are the procedure enhancements? EPPM Panel is identified as 2L411 vice 3L411 SEE ATTACHED

SUMMARY

OF OP TEST CHANGES P2 1. Procedures need placekept. Fixed

2. Nothing in the Initial Conditions states the Control Room is lost dont understand why were doing this section of the procedure. Revised Initiating Cue E 3. Should 2.2.2.3 and 2.2.2.4 be place kept as N/A? Yes for Unit 2 - fixed
4. Unit 2 and 3 JPMs step 14: Standard - is Exposure Fire Isolation Panel B2L-413 the same as Fire Isolation Panel 2L-413?
5. Similar comment as #4 above for both JPMs step 16.
6. Should identify in submittal that these procedures are to be withheld from public. Noted
7. Unit 3 JPM step 13: Examiner cue should state Unit 2 operator Fixed SEE ATTACHED

SUMMARY

OF OP TEST CHANGES P3 1. Need to check boxes in Section 2 as required by Attachment 16, step 1.3.1. Fixed E 2. Provide an electrical drawing depicting battery charger and associated breakers for reference - Provided SEE ATTACHED

SUMMARY

OF OP TEST CHANGES Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.

1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment.
2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.
3. Check the appropriate box when an attribute weakness is identified:

$ The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.

$ The JPM does not contain sufficient cues that are objective (not leading).

$ All critical steps (elements) have not been properly identified.

$ Scope of the task is either too narrow (N) or too broad (B).

$ Excessive overlap with other part of operating test or written examination.

4. Check the appropriate box when a job content error is identified:
  • Topics not linked to job content (e.g., disguised task, not required in real job).
  • Task is trivial and without safety significance.
5. Based on the reviewer=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
6. Provide a brief description of any U or E rating in the explanation column.
7. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form. 0 Page 4 of 6 OBDI 202 - IOLE Process

SONGS - 2011 - 11 DRAFT OPERATING TEST COMMENTS SCENARIOS Scenario 1. 2. 3. 4. 5. 6. 7. 8. 9.

10. Explanation (See below for instructions)

Set ES TS Crit IC Pred TL L/C Eff U/E/S 1 1. Feedback provided on the Draft Outlines identified a need to add clarifying information in parentheses following each of the Critical Tasks. This was not done.

2. Event 1: Step 3a, 3c and 3g - shouldnt they be answered NO (vice YES) in order to get to the RNO column? Why is step 3i answered NO?
3. Event 2: procedure step 14a RNO states to use Attachment 12, not skill of the craft.

RNO directs go to step 14c when standby SWC pump is in service, not to steps 14a1 and 14a2? Is step 14 e answer NO (affected train is A)?

4. Event 3: Add TS LCO 3.2.3 Cond C to TS list. When is SO23-13-13, Attach 1 performed and by whom? Where is it directed to use SO23-13-28, RPR? SO23-3-1.10?

SO23-3-2.2? SO23-5-1.7, Sect 6.3? SO23-3-2.19?

5. Events 4-9: Revise Critical Task statements to include details. The answer to steps 1.a, 2.a, 7.a, 8.a, 8.c, 11.a and 11.b is NO (thus transition to RNO).
6. Actions for SO23-12-7, step 5, Verify CCW Configuration, are missing in D-2 (page 25)

SEE ATTACHED

SUMMARY

OF OP TEST CHANGES 2 SEE ATTACHED

SUMMARY

OF OP TEST CHANGES 3 SEE ATTACHED

SUMMARY

OF OP TEST CHANGES 4 SEE ATTACHED

SUMMARY

OF OP TEST CHANGES 5 1. Add SRO to Event 1 on D-1.

2. How does crew know to pump approx. 10% of sump for testing? (not in turnover)
3. Event 2: step 3.d is NO (thus RNO)
4. Event 3: steps 2.e and 2.h.6 are NO (thus RNO)
5. Events 5/6: Discuss Critical Task for tripping the reactor within one minute after entering SPTAs. What if SRO doesnt enter SPTAs for 2 minutes after turbine trip?

Also, D-2s have no steps from SO23-13-3: consider longer than 30 sec delay for inadvertent turbine trip.

6. Events 7-9: Summary states events are initiated upon reactor trip but D-2s state when directed. Are these events auto initiated or upon Lead Examiner cue?
7. D-2s state a Critical Task is depressing the start button for Train A HPSI pump but Summary states this pump will overcurrent trip upon SIAS?
8. SPTA step 8.a - D-2s state Feedwater NOT available and therefore transition to RNO to verify EFAS initiated. Why is feedwater not available?
9. SPTA step 9.a, RNO 9.a.1) is not on D-2s.

SEE ATTACHED

SUMMARY

OF OP TEST CHANGES 6 SEE ATTACHED

SUMMARY

OF OP TEST CHANGES Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating test scenario sets. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided. 0 Page 5 of 6 OBDI 202 - IOLE Process

SONGS - 2011 - 11 DRAFT OPERATING TEST COMMENTS SCENARIOS

1. ES: ES-301 checklists 4, 5, & 6 satisfied.
2. TS: Set includes SRO TS actions for each SRO, with required actions explicitly detailed.
3. Crit: Each manipulation or evolution has explicit success criteria documented in Form ES-D-2.
4. IC: Out of service equipment and other initial conditions reasonably consistent between scenarios and not predictive of scenario events and actions.
5. Pred: Scenario sequence and other factors avoid predictability issues.
6. TL: Time line constructed, including event and process triggered conditions, such that scenario can run without routine examiner cuing.
7. L/C: Length and complexity for each scenario in the set is reasonable for the crew mix being examined, such that all applicants have reasonably similar exposure and events are needed for evaluation purposes.
8. Eff: Sequence of events is reasonably efficient for examination purposes, especially with respect to long delays or interactions.
9. Based on the reviewer=s judgment, rate the scenario set as (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory.
10. Provide a brief description of problem in the explanation column.
11. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form. 0 Page 6 of 6 OBDI 202 - IOLE Process

SONGS NRC 2011 Synopsis of Operating Exam Changes (From NRC and SONGS Validation)

Admin JPM General Comments:

  • Incorporated NRC Draft Operating Test comments as appropriate.
  • Incorporated NRC validation comments as appropriate.
  • Updated Form ES-301-1 for RO (removed C Type Code from RA4).
  • Provided hard and electronic original copies of Admin JPMs that were modified.
1. RA1 Reported to CE that Type Codes were changed (C, M to R, M) to allow JPM to be performed in the Classroom vice Plant (time constraints).

Removed Attachment 4 (not required) from Procedure and JPM and retained Attachment 10, Limitations and Specifics (provided as L&S they may be referenced).

Changed Answer Key to red ink where applicable.

Changed Acceptable Range at Perform Step 2.6 now 19,000 GPM to 19,250 GPM.

2. RA2 Corrected JPM and Answer Key at Perform Steps 7 & 9.

Changed Answer Key to red ink where applicable.

3. RA3 Added place keeping to Procedure Step 2.1.

Arrived at +/- 0.2 for Perform Steps 5 to 8 to accommodate any rounding done by the applicant.

Changed acceptable range for pump flows at Perform Step 9 from +/- 1000 to +/- 500 GPM.

Corrected flow value for 2P-002 at Perform Step 9 to 101,500 100,500 GPM.

Changed acceptable range for total flow at Perform Steps 9 and 10 from +/- 4000 to +/- 2000 GPM.

Changed Answer Key to red ink where applicable.

4. RA4 Removed Control Room from Testing Method to avoid inadvertent activation of ERDS.

Modified Examine Note in Simulator Setup.

Removed Examiner Cues to simulate the NRC connection at Perform Steps 4 and 6 (Simulator cannot connect to ERDS, therefore, this action can be performed).

Reworded Standard in Perform Steps 4 and 6 to reflect ERDS screen.

Reworded Standards for Perform Steps 2 through 6 to reflect critical versus non-critical part of task.

5. SA1 Reported to CE that Type Codes were changed (C, M to R, M) to allow JPM to be performed in the Classroom vice Plant (time constraints).

Changed Acceptable Range at Perform Step 2.6 now 19,000 GPM to 19,250 GPM.

Changed Answer Key to red ink where applicable.

Corrected wording in Initial Conditions on JPM Cue Sheet #2 (Spent Fuel Pool).

Added Pages 1 and 2 to Answer Key #2 and inserted place keeping.

Made Perform Step 13 a Critical Step to reflect OPERABILITY of Saltwater Cooling System.

Deleted 3rd bullet from JPM Cue Sheet #2 as it was not necessary.

6. SA2 JPM Cue Sheet #1 is the precursor for having to perform Cue Sheet #2.

Corrected JPM and Answer Key at Perform Steps 8 & 10.

Changed Answer Key to red ink where applicable.

SONGS NRC 2011 Synopsis of Operating Exam Changes Rev 2.doc

SONGS NRC 2011 Synopsis of Operating Exam Changes (From NRC and SONGS Validation)

7. SA3 Added place keeping to Procedure Step 2.1.

Arrived at +/- 0.2 for Perform Steps 5 to 8 to accommodate any rounding done by the applicant.

Changed acceptable range for pump flows at Perform Step 9 from +/- 1000 to +/- 500 GPM.

Corrected flow value for 3P-002 at Perform Step 9 to 96,500 GPM.

Changed acceptable range for total flow at Perform Steps 9 and 10 from +/- 4000 to +/- 2000 GPM and changed answer to 381,000 GPM.

Changed Answer Key to red ink where applicable.

8. SA4 Reworded Task Standard.

Initial Conditions do not need to state that the Plant Computer System is unavailable since this information is annotated in SO23-8-15, Attachment 4, Step 2.1.

Changed Answer Key to red ink where applicable.

9. SA5 Modified Initial Conditions by removing the bullet for duration of the release and adding unisolable as a prefix to the piping.

Removed Cold from Standard at Perform Step 1.

Reworded Standard in Perform Step 3 to reflect critical versus non-critical part of task.

SONGS NRC 2011 Synopsis of Operating Exam Changes Rev 2.doc

SONGS NRC 2011 Synopsis of Operating Exam Changes (From NRC and SONGS Validation)

Plant / Simulator JPM General Comments:

  • Incorporated NRC Draft Operating Test comments as appropriate.
  • Incorporated NRC validation comments as appropriate.
  • Provided hard and electronic original copies of Plant / Simulator JPMs that were modified.
  • Updated Form ES-301-2 (removed A Type Code from S-6).
1. S-1 Recorded Procedure Enhancement Opportunity (PEO) for SO23-13-11, Emergency Boration of the RCS, in 2011 NRC PEO document (pump nomenclature).
2. S-2 Modified Examiner Cue at Perform Step 3.

Added place keeping to CAUTION box in Attachment 18 and Step 2.3.

Changed place keeping in Attachment 18, Step 1.4, to N/A since SIAS was not actuated.

3. S-3 Modified Standard at Perform Step 3 to differentiate between critical and non-critical part of task.
4. S-4 Added place keeping to beginning of SO23-3-1.7 and corrected place keeping at Step 6.1.4.

Changed Alternate Path from RCP Overcurrent (OC) to Thrust Bearing High Temperature.

Re-snapped Simulator after removing Reactor Coolant Pump alarms that were present during verification of Perform Step 6.

Added Examiner Cue at Perform Step 17 that another operator will complete Standard Post Trip Actions.

Verified PEO already documented for SO23-15.56C, Reactor Coolant Pump OC alarms (incorrect listing of steps for tripping RCP & Reactor).

Added PEO that RCP Oil Lift & AARD pushbuttons in SIM do not respond as the plants do.

5. S-5 Corrected 2nd bullet in Initial Conditions.

Verified place keeping for SO23-9-6, Step 6.5.1 is not required.

Moved Examiner Note from Perform Steps 3 and 4 to Perform Steps 1 and 2.

Modified Standard at Perform Steps 1 and 2 to differentiate between critical and non-critical part of task.

Added wording to Terminating Cue.

6. S-6 Removed Alternate Path designation.

Deleted 4th bullet from Initial Conditions.

Reworded Task Standard.

Modified place keeping at beginning of Procedure 1.

Modified Standard at Perform Step 5 from and to and/or.

Expanded Standard in Perform Step 2 to allow tracking of Train A and B components.

7. S-7 Added breaker nomenclature to Standard in Perform Step 1.

Modified Standard at Perform Step 11.

Added band for Emergency Diesel Generator output voltage to Perform Step 15.

Moved Alternate Path designation from Perform Step 6 to Perform Step 15.

Removed Critical Step designation from Perform Step 16.

Recorded PEO for SO23-6-2, Transferring of 4 kV Buses, Steps 6.17.6 and 6.17.7 in 2011 NRC PEO document (these steps should be NOTES / CAUTIONS).

SONGS NRC 2011 Synopsis of Operating Exam Changes Rev 2.doc

SONGS NRC 2011 Synopsis of Operating Exam Changes (From NRC and SONGS Validation)

8. S-8 Moved 2nd bullet in Initial Conditions to Initiating Cue.

Added place keeping checkmark into Procedure 1 at Step 2.1.1.

Added Examiner Cue at Perform Step 4 Procedure 2.

Changed color of dot for 2R-7804 from green to blue in Standard of Perform Step 14.

9. P-1 Added note to Plant Setup to provide a color copy of the power supply inside the EPPM.

Recorded PEO for labeling (procedure vs. actual) on the power supply inside the EPPM.

Verified that the Control Room Supervisor is the point of contact when the headset is connected in Perform Step 2. [Refer to SO23-13-2, Attachment 2(3), Step 7.0 for Unit 2(3).]

Added plant temperatures to Examiner Cues as required.

Moved Examiner Cue for oscillating indication and added Examiner Cue once handswitches were cycled.

Separated out critical from non-critical portions of Standards.

10. P-2 Added Note to bottom of 1st page to withhold from public disclosure per 10 CFR 2.390.

Added place keeping as required in SO23-13-25, Attachment 3.

Inserted place keeping and N/A for Unit 3 portion of Unit 2 actions and vice versa.

Recorded PEO to add list of Unit 2 and Unit 3 LOCAL/CONTROL Room Switches from SO23-13-2, Attachment 1, to SO23-13-25, Attachment 3.

Reworded Initial Conditions and Initiating Cue so that JPM would start at Step 2.2.2.

Corrected Examiner Cue at Perform Step 12 (previously Perform Step 13) for Unit 3 JPM.

11. P-3 Added place keeping checkmarks where appropriate.

Electrical drawing is provided within the procedure (Attachment 18).

Modified Examiner Cue at Perform Step 5.

Added Examiner Note at Perform Step 7 for breaker location.

Modified Examiner Cues at Perform Steps 8, 9, 11, 12, 13, 15 and 16.

Recorded PEO for SO23-6-15, Attachment 16, Step 2.1.13.3 does not list a desired band (i.e., 125 to 135 VDC) for Battery Charger voltage.

SONGS NRC 2011 Synopsis of Operating Exam Changes Rev 2.doc

SONGS NRC 2011 Synopsis of Operating Exam Changes (From NRC and SONGS Validation)

Simulator Scenario General Comments:

  • Incorporated NRC comments as appropriate.
  • Modified RNO statements throughout the scenarios (NO vs. YES).
  • Added additional Technical Specifications as identified.
  • Added additional Examiner Notes where appropriate.
  • Corrected typos (procedure steps/wording) throughout.
  • Reworded Critical Safety Function criteria during Standard Post Trip Actions.
  • Aligned Emergency Chillers to Unit 3 throughout.
1. Scenario #1 Changed wording on all 3 CT statements.

Added steps and changed wording as required in Event 3.

Added explanations to facilitate understanding of procedures in use (Examiner Notes).

Rearranged steps for both CTs in Events 4 and 5.

2. Scenario #2 Changed wording on first two CT statements.

Added A.2 and B.2 REQUIRED ACTIONS to Event 2 Technical Specifications.

Requested TV-0224B, Demineralizer Temperature Control Valve, be added as a new malfunction to Procedure Enhancement Opportunity (PEO) List.

Added Examiner Note to explain why placing Train A EDG in Maintenance Lockout was not a CT (SONGS to provide Annunciator Response Procedure SO23-5-2.35.1, Local Diesel Alarm Panel).

Added steps for SO23-12-11, Attachment 8 prior to transitioning to SO23-12-11, Attachment 24.

3. Scenario #3 Changed wording on 1st CT statement.

Added wording from SO23-3-2.13, Attachment 1, to identify Core Protection Calculator nomenclature (Event 2).

Added Floor Cues to Event 3 to clarify required actions and/or SRO recommendations.

Added steps for Emergent Manual CEA Positioning per SO23-3-2.19 and Turbine Operation per SO23-5-1.7, Section 6.4 to Event 3.

Added Examiner Note to explain why manually actuating the Main Steam Isolation Signal was not a CT.

4. Scenario #4 Changed wording on 1st CT statement.

Added Examiner Note to Event 2 about shortening length if desired.

Corrected Unit 2 and Unit 3 wording in Event 2.

5. Scenario #5 Added SRO as a NORMAL to Event 1.

Identified CCW Swing Pump (P-025) HPSI Swing Pump (P-018) in the scenario summary.

Added Examiner Note explaining difference between Low Pressure and High Pressure Nuclear Service Water Pumps.

Added place keeping to procedure SO23-2-16 for Event 1.

Added A.2 REQUIRED ACTIONS to Event 2 Technical Specifications.

Added final step when bypassing Feedwater Control System instrument in Event 2.

6. Scenario #6 (spare)

Corrected typo wording on 2nd CT statement.

Reworded plants status on Shift Turnover Sheet.

SONGS NRC 2011 Synopsis of Operating Exam Changes Rev 2.doc