ML21298A146
| ML21298A146 | |
| Person / Time | |
|---|---|
| Site: | Point Beach  |
| Issue date: | 08/12/2021 |
| From: | Chuck Zoia NRC/RGN-III/DRS/OLB |
| To: | |
| Zoia C | |
| Shared Package | |
| ML20139A042 | List: |
| References | |
| Download: ML21298A146 (50) | |
Text
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Admin JPMs 1
ADMIN Topic and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link GENERIC COMMENTS
- 1.
All to be administered JPM cover pages need to be fully completed with review and approval signatures/dates.
RO A1 Perform RCS Leak Rate Determination COO 009 EA 2.33
[G2.1.20]
2 X
X E
- 1.
Outline (301-1) identified K/A should be listed on the cover page. Corrected.
- 2.
For operational validity, the applicant should locate and read the associated parameters, otherwise all that is required of the applicant is to transfer given data from one sheet of paper to another then perform the calculation.
Consider providing the data via a photograph or graphic display, screenshot etc.; or have the applicant locate the physical instrument/display in the simulator and provide verbal cues as needed. Discussed below Reply: Discussed during on-site validation: The task was to perform the calculation, not locate the indications. Decision was made to hand the examinee pictures of the PPCS trend screen that contains the information. This also allows running this JPM outside the simulator, and allows for multiple, simultaneous gives.
Also, since digital readings are being provided to the examinee, removed the instrument reading ranges from the performance step standards.
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Admin JPMs 1
ADMIN Topic and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link
- 3.
JPM Performance Steps (PS) 11 through 21 should not be listed separately. Completion of the associated entries in Attachment A should be included in PS 1 through 10.
Incorporated.
- a.
The actual data entries should be in the standards for PS 1-10.
Incorporated
- b.
Since section 5.1 of the procedure does not appear to have a specific substep linked to Step 3.0 on Attachment A, PS 17 would need to be renumbered as PS 5 or 7 and subsequent steps renumbered.
Reply: Attachment A Steps 2, 3, and 4.1 are performed as part of Step 5.1.7
- c.
PS 7[8], 8[9] and 9[10] would become critical steps.
Incorporated
- d.
PS, starting with PS 22, would need to be renumbered.
Renumbered.
Reply: See #5 comment, below, from on-site validation discussion.
- e.
This will prevent having to flip back and forth between PSs to document completion of the steps.
- 4.
Since this a RO only Admin JPM, it seems that once the applicant
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Admin JPMs 1
ADMIN Topic and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link provides Attachment A to the SRO for review, the JPM should be terminated.
All subsequent steps of OI-55 appear to be associated with SRO responsibilities. The RO is expected to complete all sections.
Reply: Discussed during on-site validation: Decision made to end the JPM when the examinee turns attachment A over to OS for review.
Removed all remaining performance steps (PS 13 - PS 19)
- 5.
Consider revising the INITIATING CUE to read: Complete Step[Section] 5.1 (including all applicable Attachments) of OI-55, Primary Leak Rate Calculation. Not incorporated, see above comment.
Reply: Discussed during on-site validation: Decision was made to end the JPM when Attachment A is completed and keep the Initiating Cue as is.
NRC: SAT with incorporated changes.
RO A2 Perform OP 3B Appendix A, Shutdown Margin Calculation COO G2.1.43 3
X X
E
- 1.
The post-trip information in the INITIAL CONDITIONS should be removed.
This is information that can be obtained/inferred based on the pre-trip information and other facts stated in the INITIAL CONDITIONS. Will discuss OV.
Reply: Discussed at on-site
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Admin JPMs 1
ADMIN Topic and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link validation: Determined that all information in the Initial Conditions is required for the task completion.
- 2.
PS 1 - The numerical value recorded in procedure step 5.1.3 is less important than the conclusion reached in procedure step 5.1.6 that the RCS Boron concentration is less than the value obtained from ROD 9. Therefore, the critical element of the STANDARD should be a final bullet stating, Continues to procedure step 5.2. Incorporated.
- 3.
PS 9 and PS 14 - To be consistent with other steps involving calculations, it seems that these steps should be critical. [These values will be input to the calculation in in the next step PS 15 (procedure step 5.8)] Incorporated
- 4.
PS 18 - Critical step designation missing (should be Y) Incorporated
- 5.
PS 20 - Please explain how a value of 7.31 pcm/ppm was determined. I obtained 7.33 by interpolating table in ROD 6.2 Typo fixed.
- 6.
Step 5.2.6 should be 100% not 100F.
Error in procedure. Will put in PCR after exam.
NRC: SAT with incorporated changes.
RO A3 PERFORM DIESEL EC G2.2.12 2
X X
U
- 1.
Since the performance of this task involves manipulation (simulation) of plant components (the compressor
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Admin JPMs 1
ADMIN Topic and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link GENERATOR TESTING control switch), this is technically not an Admin JPM and should be replaced.
Will discuss OV.
Reply: Discussed at on-site validation: Decision made to replace in-plant portion with picture of compressor switch panel.
- 2.
PS 6(5.1.1.f) and PS 15(5.1.2.f) should be critical steps since the air compressors are being returned to a standby configuration. Incorporated Reply: Discussed at on-site validation: Returned these performance steps to NOT Critical due to being JPM implemented in classroom.
- 3.
Is this really intended to be an in-plant JPM? The cover sheet says it is. Will discuss at OV.
Reply: Discussed at on-site validation: JPM will be implemented in the classroom, only, as an Admin JPM - Evaluator cues have been revised to remove the in-plant aspects of the JPM.
- 4.
Explain PS 16 allowable values and errors. AGREED NRC: SAT with incorporated changes.
RO A4 Prepare for Entry into RC G2.3.13 2
X X
E
- 1.
The extra copy of the Survey map is incomplete.
Reply: Replaced the map embedded in the JPM document with the latest
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Admin JPMs 1
ADMIN Topic and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link Locked High Radiation Area version of the handout.
- 2.
May want to update permit # to reflect current year. Now a fleet form, so we no longer have the ability to modify it.
Discuss at OV.
Reply: Discussed at on-site validation. Chief Examiner concurs that no need to make current year permit.
- 3.
PS 8 - Would a lower dose estimate be acceptable? The 55 mRem/hr dose rate is the contact dose on the filter unit. 30 mRem/hr might be more appropriate unless the applicant believes that they must be closer to the filter to assess the leak rate.
Incorporated Reply: Following on-site validation, added to the range of possible dose to be calculated by the examinee, to consider for the areas they might stand to perform the task.
- 4.
PS 8, 9, and 10 - Standards should provide a range of expected values.
Reply: Ranges were added to PS 8 and PS 9, and incorporated validation data from the Ops representative.
- 5.
Suggest providing a photograph of the room to show accessibility of components. Dont have one. Discuss OV.
Reply: Discussed at on-site
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Admin JPMs 1
ADMIN Topic and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link validation - no picture needed.
- 6.
Survey map Area # (6-3 ?)should be filled in. Incorporated
- 7.
PS 8 - Jump Ticket or Trip Ticket; be consistent. Incorporated
- 8.
Provide a KEY of a correctly completed Trip Ticket Incorporated
- 9.
Does trip ticket include Protective Clothing requirements? No, the RWP does.
NRC: SAT with incorporated changes.
SRO A1 Review a Pressurizer Heater Group Input Test Calc COO G2.1.7 3
X E
- 1.
Task Standard should be more specific about the errors, and required actions, to be identified. Incorporated
- 2.
PS 6 should include requirement to identify the TS Required Action (TS LCO 3.4.9 B.1 Restore to operable status within 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />). Include change to Critical Step. Incorporated. Discuss at OV Reply: Discussed during on-site validation: Added procedure step numbers to each performance step that corresponds. Added the full Tech Spec number to the standard of PS 6. Added the word correctly to the standard of PS 2.
NRC: SAT with incorporated changes.
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Admin JPMs 1
ADMIN Topic and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link SRO A2 Review Control Room Reactor Startup Checklist COO G2.1.18 3
X U
- 1.
INTITIAL CONDITIONS - Remove last two bullets (Charging Pump Status).
Status is indicated on the PBF-2140.
Incorporated
- 2.
If the TASK Standard requires the examinee to explain how to disposition the discrepancies, why are PS 1 and PS 5 NOT Critical? Change Incorporated.
Reply: During on-site validation week: Added Tech Spec implications to PS 2 and 5.
Changed cover sheet to indicate this JPM is NOT time critical and it is not an alternate path JPM.
NRC: SAT with incorporated changes.
SRO A3 Review IT 100 G-01, Seat Leakage Test of Diesel Air Compressor Discharge Check Valves G-01 EC G2.2.12 X
E EARLY SUBMITTAL
- 1.
Mark-up of procedure Attachments does not match Admin Procedure Setup instructions. Corrections were made so that procedure markup matches the Setup Instructions.
- 2.
Required Materials - In item 1 suggest replacing updated with marked up The recommended change was made.
- 3.
Performance Step (PS) 1 Below changes were incorporated.
- a.
Remove bulleted list from step description
- b.
Standard - Replace bulleted list with list currently in the Evaluator Note
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Admin JPMs 1
ADMIN Topic and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link
- c.
Evaluator Note - replace with No errors in this section.
- 4.
PS 2 Below changes were incorporated.
- a.
Remove bulleted list from step description
- b.
Standard - Replace bulleted list with list currently in the Evaluator Note
- c.
Evaluator Note - replace with No errors in this section.
- 5.
PS 3 Below changes were incorporated.
- a.
Remove bulleted list from step description
- b.
Evaluator Cue - 1) Move No errors in this section to Evaluator Note; 2) move bulleted list to the Standard; then delete Evaluator Cue
- c.
Evaluator Note - see b
- 6.
PS 4 Below changes were incorporated.
- a.
- 1) Remove bulleted list from step description; 2) Remove list of procedure steps (list is included in Standard)
- b.
Standard - 1) add step 5.1.1.e to list of steps; replace bulleted list with list currently in the Evaluator Note; add (Test Duration) TD = 8 and include calculation from PS 5
- c.
Evaluator Note - replace with No
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Admin JPMs 1
ADMIN Topic and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link errors in this section.
- 7.
PS 5 - After moving the TD info to PS 4 delete this step and renumber
- 8.
PS 6 [now PS 5] Below changes were incorporated.
- a.
Remove bulleted list from step description
- b.
Standard - Replace bulleted list with list currently in the Evaluator Note
- 9.
PS 7 [now PS 6] Below changes (a.
and b.) were incorporated.
- a.
This step should not be critical; there are no errors.
- b.
Remove bulleted list from step description.
- c.
Standard should include an addition item After ensuring that the errors on Attachment A are corrected, signs and dates the attachment. (Incorporated)
- 10. PS 8 [now PS 7] Below changes were incorporated.
- a.
Remove bulleted list from step description.
- b.
Evaluator Cue - 1) Move No errors in this section to Evaluator Note; 2) move bulleted list to the Standard; then delete Evaluator Cue
- c.
Evaluator Note - see b
- 11. PS 9 [now PS 8] Below changes were incorporated.
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Admin JPMs 1
ADMIN Topic and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link
- a.
This is a Critical Step; Since the value for the Final [Air] Pressure is less than the minimum air bank pressure for operability of 165 psig, it is critical for the examinee to recognize that the air start system is inoperable.
- b.
Remove bulleted list from step description
- c.
Standard - 1) In the Standard description replace it is complete and accurate with that step 5.1.2.c was performed incorrectly in that K-5A was not returned to AUTO when air pressure reached 180 psig and therefore air bank pressure dropped to less than the minimum pressure for operability (165 psig); 2) Replace bulleted list with list currently in the Evaluator Note.
- d.
After moving bulleted list delete both Evaluator Notes
- e.
Evaluator Cue - delete first sentence; Tech Specs are to be provided per the required materials.
- 12. PS 10 [now PS 9] Below changes were incorporated.
- a.
Consider if this step should be critical since the magnitude of the error has no impact on the calculation of the pressure drop in
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Admin JPMs 1
ADMIN Topic and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link step 5.1.2.g An evaluator note was added to discuss that the identified error was insignificant and step change to non-critical.
- b.
Remove bulleted list from step description
- c.
Standard - Replace bulleted list with list currently in the Evaluator Note
- d.
Evaluator Note - Delete after moving content to Standard
- e.
Evaluator Cue - delete first sentence; Tech Specs are to be provided per the required materials.
- 13. PS 11 [now PS 10] Below changes were incorporated.
- a.
Remove bulleted list from step description
- b.
Standard - Replace bulleted list with list currently in the Evaluator Note
- c.
Evaluator Note - Delete after moving content to Standard
- d.
Evaluator Cue - delete first sentence; Tech Specs are to be provided per the required materials.
- 14. PS 12 [now PS 11] Below changes were incorporated.
- a.
Remove bulleted list from step description
- b.
Standard - Insert the following in
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Admin JPMs 1
ADMIN Topic and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link the 2nd bulleted item: and should contain a comment stating why the Acceptance Criteria is not met.
- c.
Revised the statement regarding SRO signature to add unless the errors are corrected.
- d.
Evaluator Note - Move bulleted item to list in Standard.
- e.
Evaluator Cue - delete first sentence; Tech Specs are to be provided per the required materials.
- 15. PS 13 [now PS 12] Below changes were incorporated.
- a.
Remove bulleted item from step description
- b.
1st Evaluator Note - 1) delete Errors in this section; 2) move bulleted items to the Standard.
- c.
Deleted 2nd Evaluator Note; Tech Specs to be provided.
- 16. PS 14 [now PS 13] The following comment was addressed.- RE:
Standard - Verify that just because the IST acceptance criteria is not met, that the air start system would not be inoperable, assuming that air bank pressure is restored to (or maintained)
> 165 psig.
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Admin JPMs 1
ADMIN Topic and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link Reply: On-site Validation changes:
- Changed initial condition to reflect review of the whole test procedure and not just the attachments.
- PS3 and PS7, added evaluator note that examinee may note no errors at that time but will identify them in subsequent performance steps.
- PS5 added evaluator note on what portion of the step is critical.
- PS6, added to standard that examinee verifies step 5.1.1.h is initialed.
- PS11 added to standard to note that 5.1.2.h is initialed by the AO.
- PS14: Changed PS14 to PS13 and moved evaluator note to the Standard NRC: SAT with incorporated changes.
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Admin JPMs 1
ADMIN Topic and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link SRO A4 Review Release Permit RC G2.3.6 2
X E
- 1.
PS 3 and 4 - These two steps should not be critical since the information is given. This would be consistent with similar steps in other JPMs. These steps are performed by the RO and handed to the SRO, however, a transposition error here, like in other JPMs, (ECP) has the ability to cause the JPM to be stopped at that point.
Substep D would be unable to be performed. Discuss at OV.
Reply: During on-site validation, the two data steps were INITIALLY deemed critical in order to determine IF they can proceed with the next step (5.1.4.d).
Upon CE review, PSs 3 & 4 were found NOT critical, but PS 5 was critical. Also, enhance the JPM PSs to specify which step of the procedure is being performed.
NRC: SAT with incorporated changes.
SRO A5 Respond to Injured Person EP G2.4.38 3
X E
EARLY SUBMITTAL
- 1.
Title does not reflect the task being performed (i.e., Authorize Emergency Exposure) - confusing. Title was unchanged - the JPM was revised to reflect implementation of EPIP 11.2
- 2.
Task #/Title -- Nothing in the Initial Conditions or Initiating Cue indicates actions associated with direct implementation of EPIP 11.2. Either provide a task associated with
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Admin JPMs 1
ADMIN Topic and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link Emergency Exposure Authorization OR revise the JPM to reflect implementation of EPIP 11.2 JPM revised to reflect implementation of EPIP 11.2
- 3.
Delete 2.3.4 from K/A list; It does fit with E-Plan Implementation. K/A removed.
- 4.
INITIAL CONDITIONS
- a.
Group the 4th - 7th bulleted items as one RP Tech Report with 4 sub-bullets. Also consider the following: Would the RP Tech supporting the radiography be expected to render First Aid. If not add to the report that the injuries do not appear to be immediately life threating and he has moved to a low dose area. Intent of change incorporated and validated at OV.
- b.
The bulleted items related to other first responders OS2 does not seem immediately pertinent to the task. Bulleted items removed.
NRC: Due to a significant rewrite of this JPM, some previous comments were no longer applicable and were deleted.
- 8.
TASK STANDARD and INITIATING CUE - Revise to simply reflect/direct completion of EPIP 11.2 Attachment A.
Incorporated
- 9.
PS 1 Evaluator Note - Revise Note to state that completion of Attachment A
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Admin JPMs 1
ADMIN Topic and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link (procedure step 5.1.1) ensures completion of procedure steps 5.1.2 through 5.1.6. Delete PS 2 through PS 6 and focus completion of the attachment. Renumber subsequent steps accordingly. Incorporated
- 10. PS 3 Standard - recommend revising location to at the entrance to Pipeway
- 2. Consider including the building name. Incorporated - Building name not needed since Pipeway 2 is a standard term. At OV: Examiners agreed.
- 11. PS 4 Standard use same location info as in previous step. Incorporated
- 12. PS 5 - Why wouldnt the examinee simulate completing this action? Is this something that would be normally delegated? Yes, delegated.
- 13. PS 7 Standard for 2.3 revise to include OR Potentially Contaminated Incorporated
- 14. PS 14 through PS 21 - Combine steps into one PS with the Standard being the call to Aurora Medical Center -
Manitowoc County. Incorporated
- 15. On-site validation comments:
- PS6, added evaluator cue about if asked if 911 has been called.
- PS8 added location to the standard.
- PS13, enhanced Evaluator Cue to clarify the RP Tech is
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Admin JPMs 1
ADMIN Topic and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link acknowledging the order to complete Attachment B NRC: SAT with incorporated changes.
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Simulator/In-Plant JPMs 1
Safety Function and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link S-A Perform Rod Exercise Test SF-1 001A3.05 (Alt Path) 2 E
- 1.
PS 13 - Is an IV expected for the completion of Attachment A, Step 9.0? There does not appear to be a requirement in the marked-up procedure that was provided.
Discussed at on-site validation.
An IV is not required - peer check.
- 2.
PS 16 and 17 - Is procedure step 5.5.2.a performed twice in succession prior to performing 5.5.2.b OR is 5.5.2.a and 5.5.2.b, each performed once, then both steps repeated? Incorporated Discussed during on-site validation: changed note to say the two steps are performed in sequence and then repeated.
- 3.
Identify where the Alternate Path begins (PS 6) and ends (PS 13). Incorporated
- 4.
PS 22 - Add an Evaluator Cue:
When procedure step 5.5.7 is complete, inform the examinee that the remainder of the exercise test will be completed by another operator and that the JPM is complete. Incorporated
- 5.
Terminating Cue - reword to state that the JPM is terminated by the examiner/evaluator when procedure step 5.5.7 is
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Simulator/In-Plant JPMs 1
Safety Function and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link completed. Incorporated
- 6.
On-site validation comments:
PS4 added values for bank positions on 1C-120A to standard.
PS15, added cue that another operator will monitor PPCS.
PS19, added cue to report PPCS activity.
NRC: SAT with incorporated changes.
S-B Shift Charging Pump Suction Between the VCT and RWST SF-2 004A3.01 (Alt Path) 2 X
U
- 1.
PS 5 - Revise Evaluator Cue to acknowledge report and if necessary, to ask for a recommendation on how to proceed. The examinee must determine the alternate path.
Incorporated
- 2.
PS 5 Comment - add begins here Incorporated NRC: SAT with incorporated changes.
S-C Adjust Accumulator Pressure SF-3 006A1.13 2
E
- 1.
INITIATING CUE - Insert approximately between by and 40 Incorporated
- 2.
PS 6 (5.5.4.c) - This step should not be critical. The only action specified (implied) is to monitor accumulator pressure as it lowers.
- a.
The Standard should be simply to monitor pressure.
The standard currently indicates pressure monitoring.
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Simulator/In-Plant JPMs 1
Safety Function and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link Discuss OV.
Discussed during on-site validation: Decision made to move evaluator note down to PS 7.
- b.
The referenced pressure drop, of approximately 40 psig, should be incorporated into the next PS Incorporated
- 3.
PS 7 - Recommend adding a target pressure band (e.g., 40 +/- 10 psig) or a minimum pressure drop (e.g., 30 psig) to the Standard.
Incorporated
- 4.
Evaluate whether contingency steps should be added for actions to raise pressure if applicant waits too long to shut the vent valve. No actions explicitly in procedure to reference.
Discussed during on-site validation:
Determination was made to not add steps to repressurize, since dropping below 710 psig would be a failed critical step.
Added cue to PS 7 that if pressure drips below 710 psig, another CO will repressurize the accumulator and the examinee should continue with the current procedure section.
NRC: SAT with incorporated changes.
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Simulator/In-Plant JPMs 1
Safety Function and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link S-D Stroke Open Test 1SI-852A, Low Head SI Core Deluge SF-4P 005A1.07 3
X X
E
- 1.
Task Standard - remove the word partial Incorporated
- 2.
INITIATING CUE - Insert to perform before to stroke test
. Ensure same change is made on the examinees cue sheet. Incorporated
- 3.
PS 3 Standard - procedure step (5.4.3) does not require timing.
Replace stroke time with data (position indicating lights status).
Incorporated
- 4.
PS 4 Standard - To be consistent with other steps, replace stroke time with data Incorporated
- 5.
PS 5 Standard - Revise to state:
Attachment C, circles SAT, and fills in the Performer Signature, Date, and Time.
- 6.
Since the direction is to stoke time 1SI-852A only, and there is no direction to return the RHR pump to standby in section 5.4, delete PS 6. Incorporated
- 7.
Discussion at on-site validation:
Added note in PS1 concerning use of Attachment H.
Added new PS6 for use of Attachment H.
Added procedure page to procedure package, that has the note for use of Attachment
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Simulator/In-Plant JPMs 1
Safety Function and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link H. Revised Terminating cues due to the addition of new PS6.
NRC: SAT with incorporated changes.
S-E Align Containment Spray Pump for Containment Sump Recirc with Suction Supplied by the RHR Pump SF-5 026A4.01 (Alt Path) 3 X
E
- 1.
PS 2 Standard - include the action(s) or indication(s) to be checked to ensure that the Containment Spray signal is RESET. Incorporated Discussed during on-site validation to add to evaluator note the alarm that clears.
- 2.
PS 8 Comments - add ALTERNATE PATH BEGINS HERE. Incorporated
- 3.
PS 9 Standard - insert (1FI-928 + 1FI-963) between flow and less and add an acceptable range or minimum value for flow (minimum needed to ensure the Task Standard is satisfied).
Incorporated FSAR value for the minimum flow value from the Containment Spray Analysis.
NRC: SAT with incorporated changes.
S-F Island EDG Per 1-SOP-4KV-001 SF-6 064A4.01 3
X X
E
- 1.
INITIAL CONDITIONS &
INITIATING CUES
- a.
Revise the NOTE to state:
The plant MODE and battery charger lineups in the current simulator setup do not match the INITIAL CONDITIONS
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Simulator/In-Plant JPMs 1
Safety Function and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link required for the performance of 1-SOP-4KV-001, but have been signed off in the procedure. This deviation was evaluated and verified to not affect the way the EDG will operate during this JPM..
Discuss at OV if student needs to be told that information.
At on-site validation.
Decision made to change current statement to match the above wording.
- b.
Add this NOTE to the examinee TURNOVER SHEET. Incorporated Updated version has been incorporated.
- 2.
PS 8 - Standard should reflect whether any B Train Service Water Pumps are required to be shut down or a statement that no pumps are required to be shutdown. Discuss OV Discussed during on-site validation. During validation, in this IC, no B train pumps needed to be secured. Added evaluator note to PS8.
- 3.
PS 16 and PS 17 - Will any adjustments to EDG output frequency and voltage be
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Simulator/In-Plant JPMs 1
Safety Function and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link REQUIRED? Discuss OV and established desired result.
During on-site validation, since the voltage and frequency were within the tolerance band during setup, no adjustment was required. These two performance steps changed to NOT critical.
- a.
If bus frequency and voltage are within the specified ranges following separation from offsite power, then these steps should not be critical
- b.
Additionally, if bus frequency and voltage are expected to be within the specified ranges following separation from offsite power, the Evaluator Notes are unnecessary and should be removed.
Evaluator note removed from both PS16 and PS17.
- 4.
During on-site validation:
- PS7 add a note of which pumps are A Train in the Standard.
- PS10, revised Evaluator Note calculation and the standard value to match actual conditions and ranges.
- 5.
Page headers initially reflected the task title, instead of the
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Simulator/In-Plant JPMs 1
Safety Function and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link JPM title. Replaced the header title with the JPM title.
NRC: SAT with incorporated changes.
S-G Perform a Flux Map Using Incore Instrumentation SF-7 064A4.01 015A4.02 3
X E
- 1.
Is this a task that is typically performed by ROs or reactor engineers?
Recently, approximately a year ago, turned over to Operations for ROs to complete.
- 2.
INITIAL CONDITIONS - Provide a list of the Potential alarms that have been briefed and flag the alarms if that is the station practice. Discuss at OV.
At on-site validation: Wording unchanged in the Initial Conditions, with no need to make a list since the entire JPM is performed in the backpanel area and the examinee will not attend alarms.
- 3.
PS 4 - Do all detectors insert with depression of a single SCAN push-button or does each detector have an associated SCAN push-button? Ensure step reflects the response. OV At on-site validation: The comment above applies to PS2 not PS4. A single, common, SCAN pushbutton controls all detectors that are not in OFF.
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Simulator/In-Plant JPMs 1
Safety Function and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link
- 4.
If this a task that ROs typically perform, consider shortening JPM to just section 5.4 or section 5.5.
This JPM taking could take much longer that the 25 minutes validation time, in part due to the large number of steps, and the issue of working around non-functional recorders. OV Discussed during on-site validation: JPM will be truncated to have the examinee only responsible for the A&B detectors and complete section 5.4 and then 5.5 up to the first time through 5.5.7. The JPM will end at that point.
- 5.
Other items during on-site validation:
- Add setup instruction to turn on the recorder monitors.
- Add setup instruction to unplug the NIXIE Tube power supply, and turn off the monitors, when all JPMs are completed.
- With the replacement of the old, obsolete, recorders with monitors, changed the initial condition, and PS2 that states the recorders are non-functional with a statement that the monitors provide pen
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Simulator/In-Plant JPMs 1
Safety Function and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link position, but no trace lines.
- Add to initiating cue that the examinee will be responsible for just the A&B detectors, and another operator will be responsible for C&D.
- Added Evaluator cue to PS6, due to procedure not having the normal position limit range of the rest of the steps.
NRC: SAT with incorporated changes.
S-H Shift Ventilation Lineups for Various Modes SF-9 060AA1.02 X
X E
- 1.
TITLE - Recommend changing the Title to Shift Control Room Ventilation Operating Mode.
Discussed during on-site validation: Decision made to change the title as suggested.
- 2.
PS 10 - Is there any particular reason for starting W-13B2? If not, then leave the decision up to the applicant. This is the normal fan for returning to MODE 1.
Discussed during on-site validation: Added Evaluator Note that as long as a 13B fan is started, the critical part is met. If the examinee does not start 13B2, after the evaluator cue is given, a comment should be made on the grading sheet. Added, IF asked to the evaluator cue.
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Simulator/In-Plant JPMs 1
Safety Function and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link
- 3.
PS 12 - Preface the Evaluator Cue with ONLY after the examinee describes the location of DPI gage, provide the following cue:.. Discuss OV Discussed during on-site validation: decision made to enhance the current cue with IF asked and to add to the cue to ask where the DPI is located, if the examinee does not show where it is in the Control Room.
- 4.
PS 14 Standard - The report from the examinee should be that Control Room Ventilation operation has been shifted to Mode 1 and that there are no apparent issues with operation of the system. The decision to exit the TSAC/TRM 3.7.9 and declare the system OPERABLE are SRO responsibilities and not the board operators. Incorporated Discussed during on-site validation: Changing from the original fix incorporated from the #4 comment above, to replacing the statement of the examinee recommending OS1 review TS to reporting no apparent issues with operation.
NRC: SAT with incorporated changes.
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Simulator/In-Plant JPMs 1
Safety Function and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link IP-I Determine SW Flow as a Function of Header DP SF-4S 076A2.02 (Alt Path) 3 X
E
- 1.
PS 2 -- Neither the name nor the location of PI-4483 is identified within the procedure. Is the location of PI-4483 expected to be memorized by the examinee?
Similarly, locations of the sensing line isolation valves are not specified. No Discussed during on-site validation: No change needed.
- 2.
PS 3 - Neither the name nor the location of PI-2845 is identified within the procedure. Is the location of PI-2845 expected to be memorized by the examinee?
No Discussed during on-site validation: Resolved - no change needed.
- 3.
PS 17 - Why isnt this step critical? A person can physically turn the selector without lifting the plug.
- 4.
PS 17, 18, and 21 - Is the plug position visible such that the operator can observe the plug moving? YES Discussed during on-site validation: Yes, handle position points to the plug position.
- 5.
Other on-site validation comments:
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Simulator/In-Plant JPMs 1
Safety Function and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link
- PS4 add a plus sign (+) in front of 12, 11, and 13.
- PS9 add a range to the standard.
- PS12 added an initial value for strainer DP.
- PS19 added value for strainer DP for after the strainer is shifted.
- PS25 change the cue value to the same initial value, 740.
NRC: SAT with incorporated changes.
IP-J Transfer Fuel Oil Between Day Tanks SF-6 064K1.03 X
E
- 1.
PS 6 - Typo; being should be begin Incorporated
- 2.
PS 8 - If the tank level indicators are labeled in %, then the Evaluator Cue should be reported in % and not gallons.
Incorporated
- 3.
PS 8 - Standard needs to include observation of a 2% change in tank level, followed by stopping the pump. Incorporated
- 4.
Discussion from on-site validation: Truncate JPM at the end of PS9. The rest of the JPM is just repeats of the same valve manipulations.
NRC: SAT with incorporated changes.
IP-K SF-8 033A2.02 E
- 1.
This is not an Alt Path JPM. The initial condition is insufficient
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July, 2021 Simulator/In-Plant JPMs 1
Safety Function and K/A 2
LOD (1-5) 3 Attributes 4
Job Content 5
U/E/S 6
Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link Respond to Loss of Spent Fuel Pool Cooling (Alt Path) cooling to the SFP, and the expected response would be to provide additional cooling. Fixed by revising JPM.
- 2.
JPM should continue through Step 5.4.11 of OP 8A. Added
- 3.
Other discussions from on-site validation week:
- PS2, added evaluator cue to ensure they attempt to start P-12A.
- PS3, added cue that LAO is monitoring FI-652. Also added all readings from C172 to cue.
And added evaluator note for the location of the indications.
- PS4, Enhanced cues for flow change.
- PS6, added cue that if examinee asks Control Room about SW-2927B position.
- PS13, enhanced cue for readings on C172 NRC: SAT with incorporated changes.
ES-301 Operating Test Review Worksheet Form ES-301-7 Instructions for Completing This Table:
Check or mark any item(s) requiring a comment and explain the issue in the space provided using the guide below.
- 1.
Check each JPM for appropriate administrative topic requirements (COO, EC, Rad, and EP) or safety function requirements and corresponding K/A. Mark in column 1. (ES-301, D.3 and D.4)
- 2.
Determine the level of difficulty (LOD) using an established 1-5 rating scale. Levels 1 and 5 represent an inappropriate (low or high) discriminatory level for the license that is being tested. Mark in column 2 (Appendix D, C.1.f)
- 3.
In column 3, Attributes, check the appropriate box when an attribute is not met:
The initial conditions and/or initiating cue is clear to ensure the operator understands the task and how to begin. (Appendix C, B.4)
The JPM contains appropriate cues that clearly indicate when they should be provided to the examinee. Cues are objective and not leading.
(Appendix C, D.1)
All critical steps (elements) are properly identified.
The scope of the task is not too narrow (N) or too broad (B).
Excessive overlap does not occur with other parts of the operating test or written examination. (ES-301, D.1.a, and ES-301, D.2.a)
The task performance standard clearly describes the expected outcome (i.e., end state). Each performance step identifies a standard for successful completion of the step.
A valid marked up key was provided (e.g., graph interpretation, initialed steps for handouts).
- 4.
For column 4, Job Content, check the appropriate box if the job content flaw does not meet the following elements:
Topics are linked to the job content (e.g., not a disguised task, task required in real job).
The JPM has meaningful performance requirements that will provide a legitimate basis for evaluating the applicant's understanding and ability to safely operate the plant. (ES-301, D.2.c)
- 5.
Based on the reviewers judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)nhancement, or (S)atisfactory? Mark the answer in column 5.
- 6.
In column 6, provide a brief description of any (U)nacceptable or (E)nhancement rating from column 5.
Save initial review comments and detail subsequent comment resolution so that each exam-bound JPM is marked by a (S)atisfactory resolution on this form.
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Scenario: 1 (FREE LOOK Comments Provided)
Exam Date: July 2021 1
Event 2
Realism/
Cred.
3 Required Actions 4
Verifiable actions 5
LOD 6
TS 7
CTs 8
Scen.
Overlap 9
U/E/S 10 Explanation ALL E
- 1.
The scenario guide needs to specify the positions responsible for completing specific STUDENT RESPONSE ACTIONS. NUREG 1021, Appendix D, Section B, Step 3 (page D-3) states in part; For each event listed on Form ES-D-1, prepare Form ES-D-2, Required Operator Actions (or equivalent), as follows:
Identify the symptoms or cues that the operators will be provided, the expected actions to be taken, communications to be made, the references to be used by each operating position (e.g., the SRO, RO, and BOP operators) on the crew, and the event terminus (i.e., the anticipated point at which the examiners or evaluators will have enough information on operator performance to move on to the next event).
- 1.
Normal Up-Power (R-ATC, N-BOP)
X X
E
- 1.
There are no verifiable actions listed for the reactivity maneuver (dilution/rod withdrawal). Need to identify the actions to be performed by the RO-ATC for setting up/controlling the dilution and or control rod movement.
- 2.
The actions listed (step 5.37) are typically assigned to the BOP and considered activities associated with the NORMAL evolution.
- 3.
If the actions listed are the expected scope for the event, then the event cannot be both a REACTIVITY MANIPULATION and a NORMAL evolution.
- 2.
Single Dropped Rod (C-ATC, TS)
X X
X X
E 2019 NRC Exam; Scenario 3; Event 3 [Initiated at a higher power level - 60% vs 30%]
- 1.
Need to identify the symptoms or cues (power change, alarms, automatic actions, etc.) to be used by the responsible operator(s) to diagnose the event.
- 2.
What is the significance of the asterisk lines and the thicker black boxes around steps 1, 5, and 8 of the AOP?
Response: Continuous Action Steps
ES-301 Operating Test Review Worksheet Form ES-301-7
- 3.
Specify the Tavg limits to be maintained.
- 4.
Specify the personnel to be notified.
- 5.
If placing rod control in MANUAL is the only verifiable action for the RO, then this event provides little insight into the ROs ability to mitigate the event. If the BOP is manipulating the turbine to control Tave, then the BOP should receive credit for this even also.
- 6.
Need to add an action for the SRO to assign responsibility for verifying SDM, whether that is a crew member or support staff. Include the necessary action steps, or provide the necessary cues, to ensure that the action is completed.
- 7.
Include applicable steps of AOP-6H and the responsible position for completing the activities.
- 8.
Remove action steps that are not applicable due to plant conditions (e.g., verifying QPT, reducing power to less than 75%)
- 9.
With the initial power condition (approx 30%) LCO 3.2.4 is not applicable. This LCO cannot be used to evaluate TS implementation.
- 10. If Tavg is expected to drop below 540°F, then, under NUREG 1021 R11 guidance, restoring Tavg above 540°F may be a critical task. Otherwise the plant must be tripped (placed in MODE 2) within 30 minutes to comply with TS.
- 3.
SG B ASDV Fails Open (C-BOP)
X X
E
- 1.
Need to identify the symptoms or cues (power change, alarms, automatic actions, etc.) to be used by the responsible operator(s) to diagnose the event.
- 2.
Identify the expected actions to be taken to maintain plant within limits.
- 3.
Identify the Tave limits and the expected actions to be taken.
- 4.
Identify the expected actions to be taken for each AOP step 4-14. If no action required for a particular step provide a brief explanation as to why no action required. (e.g., Step 4 all containment conditions normal; Step 6 all valves shut; Step 7 MSR parameters normal; Step 11 no additional action required since leak was isolated in Step 5.b RNO; etc.)
- 5.
What is the verifiable action for this event?
- a.
Manual operation of the controller cannot be credited since the action is unsuccessful. SEE REPLY
- b.
Directing an equipment operator to locally close the ADV isolation valves is not a verifiable action.
ES-301 Operating Test Review Worksheet Form ES-301-7
- 4.
Loss of All Safeguards AC Power (M)
X E
- 1.
Need to identify the symptoms or cues (power change, alarms, automatic actions, etc.) to be used by the responsible operator(s) to diagnose the event.
- 2.
Revise the event description on the outline to clarify that the loss of AC Power is to the safeguards buses only. SEE REPLY
- 3.
Identify the expected actions to be taken for each EOP step.
If no action required for a particular step provide a brief explanation as to why no action required.
- 4.
Clearly identify which steps are to be performed to satisfy the Critical Task. (ECA 0.0 Step 7 RNO)
- 5.
P-32A/B SW Pump Auto-Start Failure (C-BOP)
X E
- 1.
Need to identify the symptoms or cues (power change, alarms, automatic actions, etc.) to be used by the responsible operator(s) to diagnose the event.
- 2.
Provide a brief explanation why D-07 is the only applicable battery charger to be reset (e.g., the only charger with an AC source).
- 3.
Clearly identify/flag which steps are to be performed to satisfy the Critical Task. (ECA 0.0 Step 9.c RNO)
- 6.
Multiple (4) Stuck Rods on Plant Trip (C-ATC)
X E
2017 NRC Exam; Scenario 3; Event 6
- 1.
Need to identify the symptoms or cues (power change, alarms, automatic actions, etc.) to be used by the responsible operator(s) to diagnose the event.
- 2.
Identify the expected actions to be taken for each EOP step.
If no action required for a particular step provide a brief explanation as to why no action required.
- 3.
Identify steps of OP-5B to be performed.
- 4.
TERMINATION CRITERIA specify completion of EOP-0.1 Step 3. Should this be Step 4 (step 4 is included in the guide)
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Scenario: 1 [~30% Power]
Exam Date: July 2021 1
Event 2
Realism/
Cred.
3 Required Actions 4
Verifiable actions 5
LOD 6
TS 7
CTs 8
Scen.
Overlap 9
U/E/S 10 Explanation
- 1.
Normal Up-Power (R-ATC, N-BOP)
E
- 1.
Free look comments addressed.
NRC: SAT with incorporated changes.
- 2.
Single Dropped Rod (C-ATC, TS)
X X
E 2019 NRC Exam; Scenario 3; Event 3 [Initiated at a higher power level - 60% vs 30%]
- 1.
Free look comments addressed.
- 2.
BOP response - Will BOP suspend load ramp without direction from the SRO? If so, the action should be reworded accordingly. Added SRO Directs NRC: SAT with incorporated changes.
- 3.
SG B ASDV Fails Open (C-BOP)
X E
- 1.
Free look comments addressed.
- a.
[RE: Free Look Comment 5] BOP operation of ADV controller is creditable since operation significantly reduces leakage, even though valve is not completed shut. Valve failure malfunction reduced from 50% stuck open to 10% stuck open following controller operation.
- 2.
NOTE following AOP Step 3 - Revise No Actions to Step 4 and Steps 6 - 10 require no actions. Incorporated
- 3.
Move NOTE following Step 15 to just before step 15.
Incorporated OSV Comment 1: SM should acknowledge and provide drawing for 1MS-15 if asked.
Detail added to ROLE PLAY on page 14.
NRC: SAT with incorporated changes.
- 4.
Loss of All Safeguards AC Power (M)
X E
- 1.
Free look comments addressed except for D1 (outline) comment. Revised D1 Event Description to Loss of AC Power to All Safeguards Buses Incorporated OSV Comment 1: RO placed steam dump control in Manual because BOP was up getting EDG keys. (does this need to be changed in sim guide?
BOP is still normally expected to take this action
ES-301 Operating Test Review Worksheet Form ES-301-7 despite the experienced RO during OV taking it upon himself to look ahead and get the diesel key.
NRC: SAT with incorporated changes.
- 5.
P-32A/B SW Pump Auto-Start Failure (C-BOP)
X E
- 1.
Free look comments addressed.
NRC: SAT with incorporated changes.
- 6.
Multiple (4) Stuck Rods on Plant Trip (C-ATC)
X E
2017 NRC Exam; Scenario 3; Event 6
- 1.
Free look comments addressed.
- 2.
EOP-0 (Also ECA-0.0 in previous event) - Typically Turbine Trip and AC Power verifications are performed by BOP; verify actions are properly assigned. Verified.
OSV comment 1: At step 4 of IAs in EOP-0, crew may SI and continue or NOT SI and transition to EOP-0.1. Write in the ability to go either way based on plant indications at the time the step is encountered.
Allowed flow paths written into the Sim Guide.
OSV comment 2: Do we lose the bean for emergency borate?
The bean will be completed if scenario performed as written. If scenario sped up for time and bean is lost, we would still meet minimum requirements.
OSV Comment 3: Critical Task wording needs revision to demonstrate the bad that is being prevented.
Critical Task wording has been revised.
NRC: SAT with incorporated changes.
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Scenario: 2 [0% Power - MODE 2]
Exam Date: July 2021 1
Event 2
Realism/
Cred.
3 Required Actions 4
Verifiable actions 5
LOD 6
TS 7
CTs 8
Scen.
Overlap 9
U/E/S 10 Explanation
- 2.
Raise Power to POAH (R-ATC)
X E
- 1.
Identify the actions to be performed by the RO-ATC for setting up/controlling the dilution and or control rod movement. Incorporated.
- 2.
Verify during OV that control rod pulls are significant enough to provide an adequate evaluation of reactivity maneuver.
Discussed during OV. Determined to be acceptable.
OSV Comment 1: Step 5.16.48.d 3rd bullet talks about Rx Eng reactivity computer display. Simulator doesnt model that. Explain in sim guide.
Note added about Rx Eng Computer not modeled.
OSV Comment 2: Make a fuel oil TS call before the power increase (now Event 1, SRO/TS) for another TS opportunity.
Incorporated.
OSV Comment 3: No verifiable actions listed for BOP.
Bolded TS actions in Event 1 for SRO.
Bolded observable actions in Event 2.
NRC: SAT with incorporated changes.
- 3.
1A06, 4160 Safeguards Bus Feeder Breaker trip (C-BOP, TS)
P-32A Service Water Pump Trip. (C-BOP, C-SRO, TS-SRO)
X U
- 1.
Step 13 of AOP-18A - Explain why an additional charging pump must be started, especially since Letdown should have isolated. Will not start additional but will adjust current running speed as stated in step. Can show OV.
- 2.
Step 18 of AOP-18A - How many fans are expected to be running? Include actions to start fans if required. One fan running - Start one.
- 3.
Step 21 of AOP-18A - Identify actions to be taken to restore PAB ventilation. Incorporated
- 4.
TS LCO 3.8.1; D.1 - Are there any redundant features inoperable? [Affects applicability of LCO D.1] No redundant features are OOS.
- 5.
Role Play refers to breaker for 1CV285 - How does this impact the event and or subsequent events? Prevents crew from going on excess letdown. No impact on other events.
ES-301 Operating Test Review Worksheet Form ES-301-7 OSV Comment: The 4160v loss and TS call needed to be clarified and removed. Replaced with another TS call. This also addressed the issue with either restoring letdown or just using excess letdown.
Used the Service Water Leak from validated Scenario 5 (no longer needed) and lowered the leak size. Moving the same size leak into a 0% power scenario may prompt the crew to reconsider addressing it as expected, and just trip the Unit.
1A-06 4160V bus loss removed from scenario.
Replaced with SW Pump trip and Tech Spec.
NRC: SAT with incorporated changes.
- 4.
1P-1B RCP thrust bearing failure/vibrations requiring manual reactor trip and
- 5. Reactor Trip breakers buttons on 1C04 are unsuccessful; Trip buttons on panel C01 still work. (C-ATC, TS)
X E
2017 NRC Exam; Scenario 4; Event 5 (Reactor Trip Button Failure) [Full Power Scenario].
- 1.
What is the actual trigger requiring shutdown of pump, vibration, temperature, or seal leakoff? AOP steps 2, 4, and 5 are clearly identified as continuous action steps (CAS).
What about AOP step 1? Added FOP vibration criteria. Step 1 not a continuous action step.
- 2.
D1 identifies this event as one implementing Tech Specs. D2 does not include any Tech Spec application. Error in D-1 fixed.
- 3.
Combine Event 3 and 4 into a single event.
- a.
The verifiable action for Event 3 is the completion of Event 4 and subsequent trip of the RCP after the immediate actions of EOP-0 are complete. Discuss a and b OV. OV - no additional change needed.
- b.
The failure of the 1C04 trip buttons is simply a secondary malfunction related to the required action of tripping the reactor for the RCP failure. See above.
- c.
Consider splitting the RCP malfunction into two separate component malfunction events. 1st event you could fail either the CC supply or return valve closed (or partly closed) with the ability to reopen the valve. This event could then be followed by the high vibration event (simulating bearing damage from the loss of cooling transient). If this is not incorporated, another event will need to be added. No longer needed due to N+1 for those required. Discussed on phone call with CE.
ES-301 Operating Test Review Worksheet Form ES-301-7 OV comment 1: ADD NOTE for possible need to trip RCPs based on subcooling.
Page 19 includes information for CT 5 about Foldout page RCP Trip criteria and subcooling.
NRC: SAT with incorporated changes.
- 5.
Reactor Trip breakers fail to auto open and buttons on 1C04 are unsuccessful (C01 still works)
(C-RO)
E Discussed and addressed as part of Event 4 above.
NRC: SAT with incorporated changes.
- 6.
Design Basis LBLOCA (M-All)
X X
E 2017 NRC Exam; Scenario 1; Event 6 [Full Power Scenario]
With no successful mitigative actions for the trip of RHR Pump 1P-10B, it should be included as part of the setup for the major event and not part of Event 6. Discussed during OV event layout.
Validated that mitigating actions existed in the Sim Guide.
OV Comment: Include an allowance for time compression in EOP 1.3 if desired by lead examiner, and if needed, have a 34% RWST Snap ready to go.
34% RWST Snap ready to be used for time compression if desired. Notes on page 23 explain the possible use of time compression and which IC to use if needed.
NRC: SAT with incorporated changes.
- 7.
1P-10B Trips, 1P-10A RHR pump fails to auto start (C-ATC)
X X
E 2017 NRC Exam; Scenario 1; Event 5 [Full Power Scenario]
- 1.
Scenario guide (D2) identifies Containment Sump Recirc as event 6, rather than a continuation of Event 5 (the Major Event) (LBLOCA). Resolved during OV as Event 7.
OSV Comment 1: Critical Task wording needs revision to describe consequences being prevented.
Critical Task wording has been revised.
NRC: SAT with incorporated changes.
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Scenario: 3 (Spare) [Full Power]
Exam Date: July 2021 1
Event 2
Realism/
Cred.
3 Required Actions 4
Verifiable actions 5
LOD 6
TS 7
CTs 8
Scen.
Overlap 9
U/E/S 10 Explanation
- 1.
Shift HDT Pumps (N-BOP)
S 2017 NRC Exam; Scenario 4; Event 1 [Full Power Scenario]
- 2.
Loss of Control Power to 1P-15B, Safety Injection Pump (TS)
X S
- 3.
1PC-2273 Feedwater Heater Emergency Bypass Valve fails full open and will not close (R-ATC, C-BOP)
S
- 4.
RCS Bypass loop approx 20 gpm leak, then increases until PZR level cannot be maintained (C-ATC, TS)
X E
- 1.
D1 states 12 gpm leak, D2 states 20 gpm leak. They should be the same. Changed D-1 to 20 gpm.
- 2.
The level control system will increase charging flow automatically. Is the initial leak large enough to require operator intervention to stabilize level? At what point is the operator expected to take manual control? To take credit for the event the operator should be allowed to stabilize level before the leak size is increased. Operator will take control and stabilize level as soon as a leak is identified. This was observed during OV.
NRC: SAT with incorporated changes.
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Scenario: 3 (Spare) [Full Power]
Exam Date: July 2021 1
Event 2
Realism/
Cred.
3 Required Actions 4
Verifiable actions 5
LOD 6
TS 7
CTs 8
Scen.
Overlap 9
U/E/S 10 Explanation
- 5. SBLOCA on trip (M)
X E
- 1.
This event should start with activation of Trigger 5 which forces the reactor trip. The actions listed under event 4 to respond to the increase in leak size, should be moved to event 5. Incorporated
- 2.
Isolating letdown, while expected, should not be bolded since the action does not isolate the leak. Discuss OV. We bold all other actions taken by operators. No actions isolate this leak, but this is a mitigative strategy. This action was observed to be successfully accomplished during OSV as procedurally directed.
NRC: SAT with incorporated changes.
- 7. Train A ESF Sequencer Fails to Actuate (C-ATC)
X 2019 NRC Exam; Scenario 1; Event 8 [Full Power Scenario] -
Both ESF trains were available; therefore, starting Train A components was not a CT.
- 1.
The response for this component failure is the required mitigative action for Event 5 and therefore should be included as a part of Event 5 and not a separate event. It would still be a malfunction after EOP entry. Validated on OV and left as Event 7, but within Event 5.
- 2.
This is designated as an ATC bean. How do we ensure that Attachment A is assigned to the ATC and not the BOP?
Validate with team on OV. This was changed to a BOP assignment in the sim guide and on the D-1.
NRC: SAT with incorporated changes.
- 6.
1P-53 MD AFW Pump sheared shaft and 1P-29 TD AFW Pump Trips on Over speed (M, C-BOP)
X S
2017 NRC Exam; Scenario 4; Event 7 [Full Power Scenario]
- 1.
This event (Loss of Heat Sink) should be classified as a 2nd Major Event. Discuss OV. Discussed during OSV. Not needed to classify as 2nd major event.
- 2.
This is designated as a BOP bean. How do we ensure that the event response is assigned to the BOP and not the ATC?
Discuss OV. During OSV, task was completed by BOP and as expected during completion of Att A of CSP-H.1.
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Scenario: 3 (Spare) [Full Power]
Exam Date: July 2021 1
Event 2
Realism/
Cred.
3 Required Actions 4
Verifiable actions 5
LOD 6
TS 7
CTs 8
Scen.
Overlap 9
U/E/S 10 Explanation OSV Comment: Critical Task wording needs revision to demonstrate the bad that is being prevented.
Critical Task wording was revised.
NRC: SAT with incorporated changes
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Scenario: 4 [~50% Power]
Exam Date: July 2021 1
Event 2
Realism/
Cred.
3 Required Actions 4
Verifiable actions 5
LOD 6
TS 7
CTs 8
Scen.
Overlap 9
U/E/S 10 Explanation
- 1.
Letdown inadvertently isolates, needs to be re-established (C-ATC)
S
- 1.
Step 52 of AOP-1D - When it says normal charging, does this mean one pump running at minimum flow (i.e., the condition resulting from step 49)? Discuss OV. YES
- 2.
Step 56 of AOP-1D - Does level have to be at the program level, or simply trending toward it, to exit the AOP? Wont exit unless operator has control. Will exit if trending to. At OSV it was shown that PZR level does not have to be at program to exit the AOP. It can be under Operator control and trending to program.
OSV Comment 1: Scenario has only 1 TS call.
Included CST level transmitter failing low after event and changed D-1 to include this TS event (Event 2).
NRC: SAT with incorporated changes
- 3.
Inadvertent Turbine trip with no reactor trip (R-ATC, C-BOP)
E
- 1.
What actions by the ATC are expected that makes this event a Reactivity Manipulation versus a response to a component failure (turbine trip). It appears that the control systems respond to stabilize the reactor at approximately the initial power. Procedure has you maneuver plant to under 40%.
Demonstrated at OV. Observed during OSV. Accepted as Reactivity Manipulation.
- 2.
AOP-25 lists two choices for stabilizing power/temperature.
Scenario Guide only refers to one of those. Explain why that method is preferred over the other. Automatic control is assumed if available over MANUAL control. Discuss at OV.
OV chose scripting both methods. Changes were incorporated into Sim Guide.
- 3.
Is boration/dilution expected? No NRC: SAT with incorporated changes
- 4.
Seismic event; 1P-11A, CCW pumps failure due to a X
2019 NRC Exam; Scenario 1; Event 1 [Full Power Scenario] -
seal leak requiring pump shift.
- 1.
This is designated as a ATC bean. Typically, this would fall under the scope of the BOP. Need to ensure that
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Scenario: 4 [~50% Power]
Exam Date: July 2021 1
Event 2
Realism/
Cred.
3 Required Actions 4
Verifiable actions 5
LOD 6
TS 7
CTs 8
Scen.
Overlap 9
U/E/S 10 Explanation mechanical failure requiring pump shift (C-ATC, TS) responsibility is assigned to the appropriate position. Will discuss and observe with crew. ATC took action during OSV due to Event 3 actions.
- 2.
SEG references AOP-9B but does describe pump shifting.
AOP assumes pump failure. Are the symptoms sufficient to conclude pump failure? Control room indications are sufficient. During OSV, observed conditions sufficient to identify sheared shaft.
- 3.
This appears to be the only TS event for this scenario. Need to add another event to adequately evaluate application of TS. N+1 applicants will have enough. Discussed on phone call and added a 2nd TS event (Event 2).
NRC: SAT with incorporated changes
- 5.
Seismic event causes multiple dropped rods, without an automatic RX Trip (M C-ATC) 2019 NRC Exam; Scenario 3; Event 6 [60% Power Scenario] -
- 1.
This is not the Major Event. The Major Event is the Seismic Event leading to the SG Fault. Discuss OV See below.
- 2.
If the SG Fault is delayed, then this could be a Component Failure requiring a Reactor Trip. Without the SG Fault, this would be an uncomplicated reactor trip. Discuss OV. See below.
NRC: SAT with incorporated changes
- 6.
Steam Generator fault in containment upstream of the orifice (C-BOP M)
X
- 1.
The faulted SG is the Major Event. It is an apparent consequence of the seismic event, initiated when the reactor is tripped in response to the previous event (multiple dropped rods). Incorporated During OSV, determined S/G Fault to be the major event.
NRC: SAT with incorporated changes
- 7.
Containment Spray fails to actuate (C-BOP)
X 2017 NRC Exam; Scenario 1; Event 8 [Full Power Scenario]
OSV Comment 1: Critical Task wording needs revision to demonstrate the bad that is being prevented.
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Scenario: 4 [~50% Power]
Exam Date: July 2021 1
Event 2
Realism/
Cred.
3 Required Actions 4
Verifiable actions 5
LOD 6
TS 7
CTs 8
Scen.
Overlap 9
U/E/S 10 Explanation Critical Task wording has been revised.
NRC: SAT with incorporated changes
ES-301 Operating Test Review Worksheet Form ES-301-7 Instructions for Completing This Table:
Use this table for each scenario for evaluation.
2 Check this box if the events are not related (e.g., seismic event followed by a pipe rupture) OR if the events do not obey the laws of physics and thermodynamics.
3, 4 In columns 3 and 4, check the box if there is no verifiable or required action, as applicable. Examples of required actions are as follows: (ES-301, D.5f) opening, closing, and throttling valves starting and stopping equipment raising and lowering level, flow, and pressure making decisions and giving directions acknowledging or verifying key alarms and automatic actions (Uncomplicated events that require no operator action beyond this should not be included on the operating test unless they are necessary to set the stage for subsequent events. (Appendix D, B.3).)
5 Check this box if the level of difficulty is not appropriate.
6 Check this box if the event has a TS.
7 Check this box if the event has a critical task (CT). If the same CT covers more than one event, check the event where the CT started only.
8 Check this box if the event overlaps with another event on any of the last two NRC examinations. (Appendix D, C.1.f) 9 Based on the reviewers judgment, is the event as written (U)nacceptable (requiring repair or replacement), in need of (E)nhancement, or (S)atisfactory? Mark the answer in column 9.
10 Record any explanations of the events here.
In the shaded boxes, sum the number of check marks in each column.
In column 1, sum the number of events.
In columns 2-4, record the total number of check marks for each column.
In column 5, based on the reviewer's judgement, place a checkmark only if the scenario's LOD is not appropriate.
In column 6, TS are required to be 2 for each scenario. (ES-301, D.5.d)
In column 7, preidentified CTs should be 2 for each scenario. (Appendix D; ES-301, D.5.d; ES-301-4)
In column 8, record the number of events not used on the two previous NRC initial licensing exams. A scenario is considered unsatisfactory if there is < 2 new events. (ES-301, D.5.b; Appendix D, C.1.f)
In column 9, record whether the scenario as written (U)nacceptable, in need of (E)nhancement, or (S)atisfactory from column 11 of the simulator scenario table.
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Point Beach Exam Date: July 2021 Scenario 1
2 3
4 5
6 7
8 11 Event Totals Events Unsat.
TS Total TS Unsat.
% Unsat.
Scenario Elements U/E/S Explanation 1 (Free Look) 6 0
2 0
2 0
0 E
Free Look scenario - Comments Addressed.
2 7
0 2
1 2
0 9
E One unclear TS related to a previously included event was replaced.
3 (Spare) 7 0
2 0
2 0
0 E
SPARE SCENARIO - not included in Operating Test Totals.
4 7
0 2
1 2
0 9
E Added a needed TS event for 2 TS opportunities Instructions for Completing This Table:
Check or mark any item(s) requiring comment and explain the issue in the space provided.
1, 3, 5 For each simulator scenario, enter the total number of events (column 1), TS entries/actions (column 3), and CTs (column 5).
This number should match the respective scenario from the event-based scenario tables (the sum from columns 1, 6, and 7, respectively).
2, 4, 6 For each simulator scenario, evaluate each event, TS, and CT as (S)atisfactory, (E)nhance, or (U)nsatisfactory based on the following criteria:
- a.
Events. Each event is described on a Form ES-D-2, including all switch manipulations, pertinent alarms, and verifiable actions. Event actions are balanced between at-the-controls and balance-of-plant applicants during the scenario. All event-related attributes on Form ES-301-4 are met. Enter the total number of unsatisfactory events in column 2.
- b.
TS. A scenario includes at least two TS entries/actions across at least two different events. TS entries and actions are detailed on Form ES-D-2. Enter the total number of unsatisfactory TS entries/actions in column 4. (ES-301, D.5d)
- c.
CT. Check that a scenario includes at least two preidentified CTs. This criterion is a target quantitative attribute, not an absolute minimum requirement.
Check that each CT is explicitly bounded on Form ES-D-2 with measurable performance standards (see Appendix D). Enter the total number of unsatisfactory CTs in column 6.
7 In column 7, calculate the percentage of unsatisfactory scenario elements:
8 If the value in column 7 is > 20%, mark the scenario as (U)nsatisfactory in column 8. If column 7 is 20%, annotate with (E)nhancement or (S)atisfactory.
9 In column 9, explain each unsatisfactory event, TS, and CT. Editorial comments can also be added here.
Save initial review comments and detail subsequent comment resolution so that each exam-bound scenario is marked by a (S)atisfactory resolution on this form.
2 + 4 + 6 1 + 3 + 5100%
ES-301 50 Form ES-301-7 Site name: Point Beach Exam Date: July 2021 OPERATING TEST TOTALS Total Total Unsat.
Total Total Unsat.
Explanation Edits Sat.
Admin.
JPMs 9
2 7
0 1 RO and 1 SRO Admin JPM was UNSAT Sim./In-Plant JPMs 11 1
10 0
1 Sim JPM was UNSAT Scenarios 3
0 4
0 All scenarios SAT with edits Op. Test Totals:
23 3
21 0
13 Overall operating test was SAT Instructions for Completing This Table:
Update data for this table from quality reviews and totals in the previous tables and then calculate the percentage of total items that are unsatisfactory and give an explanation in the space provided.
- 1.
Enter the total number of items submitted for the operating test in the Total column. For example, if nine administrative JPMs were submitted, enter 9 in the Total items column for administrative JPMs. For scenarios, enter the total number of simulator scenarios.
- 2.
Enter the total number of (U)nsatisfactory JPMs and scenarios from the two JPMs column 5 and simulator scenarios column 8 in the previous tables. Provide an explanation in the space provided.
- 3.
Enter totals for (E)nhancements needed and (S)atisfactory JPMs and scenarios from the previous tables.
This task is for tracking only.
- 4.
Total each column and enter the amounts in the Op. Test Totals row.
- 5.
Calculate the percentage of the operating test that is (U)nsatisfactory (Op. Test Total Unsat.)/(Op. Test Total) and place this value in the bolded % Unsat. cell.
Refer to ES-501, E.3.a, to rate the overall operating test as follows:
satisfactory, if the Op. Test Total % Unsat. is 20%
unsatisfactory, if Op. Test Total % Unsat. is > 20%
- 6.
Update this table and the tables above with post-exam changes if the as-administered operating test required content changes, including the following:
The JPM performance standards were incorrect.
The administrative JPM tasks/keys were incorrect.
CTs were incorrect in the scenarios (not including post scenario critical tasks defined in Appendix D).
The EOP strategy was incorrect in a scenario(s).
TS entries/actions were determined to be incorrect in a scenario(s).