ML22179A245
| ML22179A245 | |
| Person / Time | |
|---|---|
| Site: | Prairie Island  |
| Issue date: | 10/16/2018 |
| From: | Randy Baker NRC/RGN-III/DRS/OLB |
| To: | Nuclear Malaysia, Nuclear Management Co |
| Baker R | |
| Shared Package | |
| ML17165A317 | List: |
| References | |
| Download: ML22179A245 (13) | |
Text
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: PRAIRIE ISLAND NUCLEAR GENERATING PLANT UNITS 1 and 2 Exam Date: September 10 - 21, 2018 1 2 3 4 5 6 ADMIN Attributes Job Content Admin LOD Topic and U/E/S Explanation JPMs (1-5) I/C Critical Scope Perf.
K/A Job Cues Overlap Key Minutia Focus Steps (N/B) Std. Link SRO-A1 NRC: (15 min) JPM is SRO-Only and is Direct from the ADMIN-19 Evaluate COO1 B Bank.
System Operating {Also need to update K/A reference on the ES 301-1}
Conditions When 2.2.22(4.7) S Security Analysis is 2.1.25(4.2) 3 Out of Service Response: K/A Corrected. JPM is SAT as written.
NRC: (09 min) JPM is SRO-Only and is Direct from the Bank.
SRO-A2 B {Need to review a copy of SWI-02 to confirm that the COO2 ADMIN-88 Assess S last 2 performance steps are both Critical.}
Shift Staffing Levels 2.1.5(3.9) 2 Response: Last two steps are both critical. JPM is SAT as written.
NRC: (10 min) JPM is SRO-Only and Modified from the SRO-A3 Bank.
M ADMIN-96 Perform EC {Need to see how this is modified from the bank JPM.}
S Shutdown Safety 2.2.18(3.9)
Assessment 3 Response: JPM has been significantly modified. JPM is SAT as written.
NRC: (10 min) JPM is SRO-Only, is Direct from the Bank, and Previously used from the last 2 NRC Exams SRO-A4 RC (2016).
B, P ADMIN-22 071 {Initiating Cue should state that C21.3-10.8 has been X E Authorize Waste A4.26(3.9) completed through step 7.10.}
Gas Release 2 2.3.6(4.3) {Also need to update K/A reference on the ES 301-1}
Response: K/A Corrected. JPM is now SAT.
NRC: (15 min) JPM is SRO-Only, satisfies the New/Mod JPM requirement.
{Also need to update K/A reference on the ES 301-1 and correct the JPM cover page}
How is this different from the 2016 ILE JPM?
The Initial Conditions given are not sufficient to SRO-A5 EP N determine the time required for completing the task.
ADMIN-106 Review U 2.4.44(4.6) X N X X Therefore, validation time is not accurate and may be Emergency S Notification Report 2.4.40(4.5) 3 incorrect. Although the JPM tasking is very Narrow and not specifically Time Critical, the evolution it supports is Time Critical (15 minutes).
Response: K/A Corrected. Clarified Stem Initial Conditions and the JPM is annotated as Time Critical.
ES-301 Operating Test Review Worksheet Form ES-301-7 NRC: (08 min) This JPM is Direct from the Bank.
{Also need to update K/A reference on the ES 301-1}
The applicant is simply required to subtract 2 numbers (which are provided as cues) and state whether the temperature requirement for starting an RCP is satisfied. (The limit is also provided to the applicant RO-A1 directly in the procedure step.)
ADMIN-48 COO1 B RCS/Steam 002 U Was this the same as the Modified 2016 ILE JPM?
X N Generator K5.11(4.0) 1 S Why would the first performance step be Critical if this Temperature 2.1.20(4.6) 2 information is provided in the Cue? This JPM may be Verification too Narrowly focused to be discriminating.
Response: K/A Corrected. Modified the provided data information to allow calculating an incorrect answer if a math error occurs. JPM is now SAT.
NRC: (13 min) This JPM is Direct from the Bank and Previously used from the last 2 NRC Exams (2016).
Also, what determines the error bands? An applicant is expected to be able to read a graph to within 1/2 a minor RO-A2 division, therefore the tolerance on the answers to the ADMIN-78 Turbine B, P COO2 Critical Steps should be based on an initial total band of Start Up and Load X E Time 2.1.25(3.9) 21/2 minutes, and the answer bands adjusted 3
accordingly.
Response: Agreed - Error bands adjusted. JPM is now SAT.
NRC: (07 min) This JPM is Direct from the Bank.
Why is the applicant provided both the final reading of PRT level and the time of completion that the reading was taken as Cues? Procedure, as marked up, states the reading was taken 2 hours2.314815e-5 days <br />5.555556e-4 hours <br />3.306878e-6 weeks <br />7.61e-7 months <br /> after the initial reading?
The applicant is simply required to subtract 2 numbers (which are provided as cues) and divide by the elapsed RO-A3 B time (which is also provided in the cue) to determine the ADMIN-100 Perform EC U N leak rate.
RCS Leakage 2.2.12(3.7) 1 S Investigation (PRT) 2 This JPM may be too Narrowly focused to be discriminating.
Response: Initial data provided was modified so that the applicant will need to calculate required values for completing SP. JPM is now SAT.
EP M NRC: (15 min) This JPM satisfies the New/Mod JPM RO-A4 X E 035 requirement. [Modified from 2016 NRC ILE]
ES-301 Operating Test Review Worksheet Form ES-301-7 ADMIN-29 A4.08(4.1) 2 {Need to correct initiating cue on page 2.}
Determine Steam 2.4.11(4.0) {Also need to update K/A reference on the ES 301-1}
Generator Leakage Also, what determines the error bands? These are Correlation to R-15 Counts simply mathematical operations using data given in the cue. The applicant may truncate or round the answers, but a 10 GPD band on the correct answer is not applicable. (118 - 120 GPD/hr is reasonable.)
Why is the second performance step on page 4 included, and why is the third performance step not Critical?
Response: K/A, error band, and Cue Corrected. JPM is now SAT.
1 Simulator/In-Plant Safety Function JPMs and K/A NRC: (10 min) This JPM is New, and is also ALT PATH.
The initiating cue is to borate 10 gallons to the RCS, and the component failure requires securing the boration by an alternate means. Does an over-boration S-A (Free Sample) 1 event occur? Is the ALT PATH the stopping of the VC-29SF A, N 004 boration by an alternate means?
Malfunction of S AUTO Makeup A4.12 {Need to have some alternate actions to accomplish 2
During Boration (3.8/3.3) tasking.}
Response: Recognizing the unintended boration and securing it by some method are the critical steps in this JPM. JPM is SAT as written..
NRC: (08 min) This JPM is New.
Each of the Simulator JPM must test a different safety S-B 2 N function, but each JPM must also test different systems.
VC-104S Return 13 004 011 S (ES-301-D.4.a) This is the 2nd CVCS system simulator Charging Pump to A4.081 Standby 3 JPM.
(3.5/3.2)
Response: Corrected K/A given. JPM is SAT as written.
4P NRC: (14 min) This JPM is ALT PATH and Previously S-C A, P 003 used from the last 2 NRC Exams.
RC-24SF Align for S hot leg injection A4.08 2
(3.2/2.9) JPM is SAT as written.
A, N, NRC: (07 min) This JPM is New, is ALT PATH, satisfies S-D 4S EN, the engineered safety feature requirement, and satisfies AF-21SF Stop 061 L S the Low-Power/Shutdown requirement.
TDAFW Pump w/ K4.01 Accumulator Failure (4.1/4.2) 3 JPM is SAT as written.
ES-301 Operating Test Review Worksheet Form ES-301-7 NRC: (07 min) This JPM is Direct from the Bank, is ALT PATH, and also satisfies the engineered safety feature S-E 5 A, D, requirement.
ZC-1SF Alternate 022 EN How is this different from the 2016 ILE JPM?
S CFCUs w/ CFCU A4.01 {Need to Add an S to the Type Code on ES-301-2.}
High Temperature (3.6/3.6) 3 Response: Different section of SP. 301-2 Corrected.
NRC: (10 min) This JPM is New(?), and also satisfies the engineered safety feature requirement.
S-F 6 N, EG-20S Manual 064 EN {Need to correct typo in the Initiating Cue (Step 6.1.1 Q E
Start D5 from the A3.06 vs. 5.1.1 Q) and in the final two performance steps on Control Room (3.3/3.4) 3 page 4 & 5 (6.1.1 P & Q vs. 5.1.1 P &Q.}
Response: Agreed - Corrected. JPM is now SAT.
S-G (Not SRO-I) 7 NRC: (08 min) This JPM is Previously used from the P
RM-5S PRM/Secure 073 last 2 NRC Exams (2016).
S R11/12 in Control A4.02 Room 3 (3.7/3.7) JPM is SAT as written.
NRC: (05 min) This JPM is New.
This JPM may be too Narrowly focused to be discriminating.
8 N S-H (Free Sample) Response: JPM Initial Conditions were modified to 086 E FP-8S Fire Alarm N state that a fire had occurred (location specified) and Monthly Test 2.2.12 1 S that the operator was to respond to the fire alarm (3.7/4.1) 2 Annunciator. Now also include resetting the Fire Alarm panel to allow subsequent alarms to be received.
NRC: (04 min) This JPM is Direct form the Bank, satisfies the Emergency or Abnormal in-plant requirement, satisfies the requirement to perform 2
actions within the RCA, and also satisfies the Low-APE 067 IP-I D, E, Power/Shutdown requirement.
028 RC-8 RCP Seal L, R {Which K/A supports this JPM for Safety Function 2?
Isolation after Loss AA2.67 S (Only 0022 & 0028 for APE/EPE)}
of All AC AA1.03 2 {Why not include step 8.a as part of the local actions?
(2.9/3.1)
Where is MV-32166 located?}
(2.9/2.9)
Response: MV-23166 is located inside containment.
K/A Corrected. JPM is SAT as written.
NRC: (12 min) This JPM is Direct from the Bank, is ALT IP-J 4S A, D, PATH, and satisfies the engineered safety feature AF-16F-1 Local 061 EN S requirement.
Operation of 22 A2.04 TDAFW Pump (3.4/3.8) 3 JPM is SAT as written.
IP-K 6 NRC: (11 min) This JPM is Direct from the Bank.
D DC-1 Startup APE 058 S
Portable Battery AA1.03 JPM is SAT as written.
Charger 3 (3.1/3.3)
ES-301 Operating Test Review Worksheet Form ES-301-7 ES-301 6 Form ES-301-7 Instructions for Completing This Table:
Check or mark any item(s) requiring a comment and explain the issue in the space provided using the guide below.
- 1. Check each JPM for appropriate administrative topic requirements (COO, EC, Rad, and EP) or safety function requirements and corresponding K/A. Mark in column 1.
(ES-301, D.3 and D.4)
- 2. Determine the level of difficulty (LOD) using an established 1-5 rating scale. Levels 1 and 5 represent an inappropriate (low or high) discriminatory level for the license that is being tested. Mark in column 2 (Appendix D, C.1.f)
- 3. In column 3, Attributes, check the appropriate box when an attribute is not met:
- The initial conditions and/or initiating cue is clear to ensure the operator understands the task and how to begin. (Appendix C, B.4)
- The JPM contains appropriate cues that clearly indicate when they should be provided to the examinee. Cues are objective and not leading. (Appendix C, D.1)
- All critical steps (elements) are properly identified.
- The scope of the task is not too narrow (N) or too broad (B).
- Excessive overlap does not occur with other parts of the operating test or written examination. (ES-301, D.1.a, and ES-301, D.2.a)
- The task performance standard clearly describes the expected outcome (i.e., end state). Each performance step identifies a standard for successful completion of the step.
- A valid marked up key was provided (e.g., graph interpretation, initialed steps for handouts).
- 4. For column 4, Job Content, check the appropriate box if the job content flaw does not meet the following elements:
- Topics are linked to the job content (e.g., not a disguised task, task required in real job).
- The JPM has meaningful performance requirements that will provide a legitimate basis for evaluating the applicant's understanding and ability to safely operate the plant. (ES-301, D.2.c)
- 5. Based on the reviewers judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)nhancement, or (S)atisfactory? Mark the answer in column 5.
- 6. In column 6, provide a brief description of any (U)nacceptable or (E)nhancement rating from column 5.
Save initial review comments and detail subsequent comment resolution so that each exam-bound JPM is marked by a (S)atisfactory resolution on this form.
ES-301 7 Form ES-301-7 Facility: PRAIRIE ISLAND NUCLEAR GENERATING PLANT UNITS 1 and 2 Scenario: 1 (Rx Pwr 100%) Exam Date: September 10 - 21, 2018 1 2 3 4 5 6 7 8 9 10 Realism/ Required Verifiable Scenario Event LOD TS CTs U/E/S Explanation Cred. Actions actions Overlap 1-Transfer Bus 15 from CT11 to 1RY N-BOP, SRO S 2-Letdown HX High Temp C-ATC, BOP, & SRO S 3-11 CFCU in LOCAL C-BOP, SRO & TS-SRO X S Similar Event (1PT-485 fails Low) during 2016 ILE Scenario 2.
4-RCS TAVG Fails High Must include an observable change in Rx Power from Reactivity I-ATC, SRO & TS-SRO X X S change.
5-11 MFP Stator High Temp, Rapid Load Reduction X S R-ATC, N-SRO 6-Loss of Feed/AUTO Rx Trip Failure C-ATC, SRO S 7-Loss of Heat Sink M-ALL X S 7 Events 0 0 0 - 2 2 6 S
ES-301 8 Form ES-301-7 Facility: PRAIRIE ISLAND NUCLEAR GENERATING PLANT UNITS 1 and 2 Scenario: 2 (Rx Pwr 90%) Exam Date: September 10 - 21, 2018 1 2 3 4 5 6 7 8 9 10 Realism/ Required Verifiable Scenario Event LOD TS CTs U/E/S Explanation Cred. Actions actions Overlap 1-Swap EH Oil Pumps N-BOP, SRO S 2-PRZR Level White Channel Fails Low X S I-ATC, SRO & TS-SRO 3-First Stage Pressure Fails Low I-ATC, SRO & TS-SRO X X S Similar Event (1PT-485 fails Low) during 2016 ILE Scenario 2.
4-Loss of All AC M-ALL X S 5-D1 Fails to AUTO Start C-BOP, SRO S 6-11 TD AFW Pump Fails to AUTO Start X S C-ATC, SRO 7-Stuck Rod After Rx Trip Requires Boration S C-ATC, SRO 7 Events 0 0 0 - 2 2 6 S
ES-301 9 Form ES-301-7 Facility: PRAIRIE ISLAND NUCLEAR GENERATING PLANT UNITS 1 and 2 Scenario: 3 (Low Pwr [10-8]) Exam Date: September 10 - 21, 2018 1 2 3 4 5 6 7 8 9 10 Realism/ Required Verifiable Scenario Event LOD TS CTs U/E/S Explanation Cred. Actions actions Overlap 1-Raise Power to the POAH R-ATC, SRO S 2-Secure 12 MD Aux Feedwater Pump N-BOP, SRO S 3-PRZR Level White (INTRLK)
Channel Fails High X S I-ATC, SRO & TS-SRO 4-B PRZR PORV Leakage C-BOP, SRO & TS-SRO X S 5-12 Steam Generator Tube Rupture M-ALL 4X S All CTs result from the SGTR event.
6-11 & 12 Safety Injection Pumps Fail to Automatically Start S C-BOP, SRO 7-CTMT Isolation Relay AUTO Actuation Failure S C-BOP, SRO 7 Events 0 0 0 - 2 4 7 S
ES-301 10 Form ES-301-7 Facility: PRAIRIE ISLAND NUCLEAR GENERATING PLANT UNITS 1 and 2 Scenario: 4 (Rx Pwr 60%) Exam Date: September 10 - 21, 2018 1 2 3 4 5 6 7 8 9 10 Realism/ Required Verifiable Scenario Event LOD TS CTs U/E/S Explanation Cred. Actions actions Overlap 1-Place 2nd Letdown Orifice in Service N-BOP, SRO S 2-Raise Rx Power from 60% to 70%
R-ATC, SRO S 3-Controlling PRZR Press Channel Fails Low X X S Similar Event (1PT-431 fails Low) during 2016 ILE Scenario 3.
I-ATC, SRO & TS-SRO 4-SI Accumulator Leakage C-BOP, SRO & TS-SRO X S 5-LBLOCA w/ Transfer to Similar Event (LBLOCA w/ ECCS transfer to recirculation)
Recirculation X X S during 2016 ILE Scenario 4.
M-ALL 6-11 & 12 RHR Pumps Fail to Automatically Start X S C-BOP, SRO 7-SI to CC Relay Actuation Failure C-BOP, SRO S 8-12 MDAFWP Auto Start Failure C-BOP, SRO S 8 Events 0 0 0 - 2 2 6 S
ES-301 11 Form ES-301-7 Instructions for Completing This Table:
Use this table for each scenario for evaluation.
2 Check this box if the events are not related (e.g., seismic event followed by a pipe rupture) OR if the events do not obey the laws of physics and thermodynamics.
3, 4 In columns 3 and 4, check the box if there is no verifiable or required action, as applicable. Examples of required actions are as follows: (ES-301, D.5f)
- opening, closing, and throttling valves
- starting and stopping equipment
- raising and lowering level, flow, and pressure
- making decisions and giving directions
- acknowledging or verifying key alarms and automatic actions (Uncomplicated events that require no operator action beyond this should not be included on the operating test unless they are necessary to set the stage for subsequent events. (Appendix D, B.3))
5 Check this box if the level of difficulty is not appropriate.
6 Check this box if the event has a TS.
7 Check this box if the event has a critical task (CT). If the same CT covers more than one event, check the event where the CT started only.
8 Check this box if the event overlaps with another event on any of the last two NRC examinations. (Appendix D, C.1.f) 9 Based on the reviewers judgment, is the event as written (U)nacceptable (requiring repair or replacement), in need of (E)nhancement, or (S)atisfactory? Mark the answer in column 9.
10 Record any explanations of the events here.
In the shaded boxes, sum the number of check marks in each column.
- In column 1, sum the number of events.
- In columns 2-4, record the total number of check marks for each column.
- In column 5, based on the reviewer's judgement, place a checkmark only if the scenario's LOD is not appropriate.
- In column 6, TS are required to be 2 for each scenario. (ES-301, D.5.d)
- In column 8, record the number of events not used on the two previous NRC initial licensing exams. A scenario is considered unsatisfactory if there is < 2 new events. (ES-301, D.5.b; Appendix D, C.1.f)
- In column 9, record whether the scenario as written (U)nacceptable, in need of (E)nhancement, or (S)atisfactory from column 11 of the simulator scenario table.
ES-301 12 Form ES-301-7 Facility: PRAIRIE ISLAND NUCLEAR GENERATING PLANT UNITS 1 and 2 Exam Date: September 10 - 21, 2018 1 2 3 4 5 6 7 8 11 Scenario % Unsat. Explanation Event Events TS TS CT CT Scenario U/E/S Totals Unsat. Total Unsat. Total Unsat.
Elements Scenario 1 7 0 2 0 2 0 0 S Scenario 2 7 0 2 0 4 0 0 S Scenario 3 7 0 2 0 2 0 0 S Scenario 4 8 0 2 0 2 0 0 S Instructions for Completing This Table:
Check or mark any item(s) requiring comment and explain the issue in the space provided.
1, 3, 5 For each simulator scenario, enter the total number of events (column 1), TS entries/actions (column 3), and CTs (column 5).
This number should match the respective scenario from the event-based scenario tables (the sum from columns 1, 6, and 7, respectively).
2, 4, 6 For each simulator scenario, evaluate each event, TS, and CT as (S)atisfactory, (E)nhance, or (U)nsatisfactory based on the following criteria:
- a. Events. Each event is described on a Form ES-D-2, including all switch manipulations, pertinent alarms, and verifiable actions. Event actions are balanced between at-the-controls and balance-of-plant applicants during the scenario. All event-related attributes on Form ES-301-4 are met. Enter the total number of unsatisfactory events in column 2.
- b. TS. A scenario includes at least two TS entries/actions across at least two different events. TS entries and actions are detailed on Form ES-D-2. Enter the total number of unsatisfactory TS entries/actions in column 4. (ES-301, D.5d)
- c. CT. Check that a scenario includes at least two preidentified CTs. This criterion is a target quantitative attribute, not an absolute minimum requirement. Check that each CT is explicitly bounded on Form ES-D-2 with measurable performance standards (see Appendix D). Enter the total number of unsatisfactory CTs in column 6.
2+4+6 7 In column 7, calculate the percentage of unsatisfactory scenario elements: 100%
1+3+5 8 If the value in column 7 is > 20%, mark the scenario as (U)nsatisfactory in column 8. If column 7 is 20%, annotate with (E)nhancement or (S)atisfactory.
9 In column 11, explain each unsatisfactory event, TS, and CT. Editorial comments can also be added here.
Save initial review comments and detail subsequent comment resolution so that each exam-bound scenario is marked by a (S)atisfactory resolution on this form.
ES-301 13 Form ES-301-7 Facility: PRAIRIE ISLAND NUCLEAR GENERATING PLANT UNITS 1 and 2 Exam Date: September 10 - 21, 2018 OPERATING TEST TOTALS Total Total Total %
Total Explanation Unsat. Edits Sat. Unsat.
Admin. These numbers will probably change based 9 3 3 3 JPMs upon resolution with the facility.
Sim/In-Plant These numbers will probably change based 11 0 3 8 JPMs upon resolution with the facility.
These numbers will probably remain Scenarios 4 0 0 4 unchanged.
Op. Test This final percentage will be updated following 24 3 6 15 12.5 Totals: onsite validation.
Instructions for Completing This Table:
Update data for this table from quality reviews and totals in the previous tables and then calculate the percentage of total items that are unsatisfactory and give an explanation in the space provided.
- 1. Enter the total number of items submitted for the operating test in the Total column. For example, if nine administrative JPMs were submitted, enter 9 in the Total items column for administrative JPMs.
For scenarios, enter the total number of simulator scenarios.
Enter the total number of (U)nsatisfactory JPMs and scenarios from the two JPMs column 5 and 2.
simulator scenarios column 8 in the previous tables. Provide an explanation in the space provided.
Enter totals for (E)nhancements needed and (S)atisfactory JPMs and scenarios from the previous 3.
tables. This task is for tracking only.
- 4. Total each column and enter the amounts in the Op. Test Totals row.
Calculate the percentage of the operating test that is (U)nsatisfactory (Op. Test Total Unsat.)/(Op. Test 5.
Total) and place this value in the bolded % Unsat. cell.
Refer to ES-501, E.3.a, to rate the overall operating test as follows:
- satisfactory, if the Op. Test Total % Unsat. is 20%
- unsatisfactory, if Op. Test Total % Unsat. is > 20%
Update this table and the tables above with post-exam changes if the as-administered operating test 6.
required content changes, including the following:
- The JPM performance standards were incorrect.
- The administrative JPM tasks/keys were incorrect.
- CTs were incorrect in the scenarios (not including post scenario critical tasks defined in Appendix D).
- The EOP strategy was incorrect in a scenario(s).
- TS entries/actions were determined to be incorrect in a scenario(s).