ML21020A117

From kanterella
Jump to navigation Jump to search
Initial License Exam Forms ES-301-7
ML21020A117
Person / Time
Site: Monticello Xcel Energy icon.png
Issue date: 11/03/2020
From:
Nuclear Management Co
To:
NRC/RGN-III/DRS/OLB
Zoia C
Shared Package
ML19127A312 List:
References
Download: ML21020A117 (28)


Text

ES-301 Operating Test Review Worksheet Form ES-301-7 1

Facility: Monticello Exam Date: October 19-30, 2020 1 2 3 4 5 6 Attributes Job Content Admin LOD ADMIN Topic and K/A U/E/S Explanation JPMs (1-5) I/C Critical Scope Perf. Job Cues Overlap Key Minutia Focus Steps (N/B) Std. Link 2015 NRC Exam NRC:

1. INITIATING CUE; What does fully qualified mean as it relates to the Chemist and RP Spec.? Significance?
2. JPM Step 2; Performance Standard (PS) should include a determination (non-critical) that minimum staffing requirements for Licensed Operators is maintained without Craig.
3. PS 3; Revise Standard to include the words for Fire Brigade between staffing and must. Also removed procedure reference in the standard.

SRO-A1.1 Crew Staffing 3 X E 4. Is there a separate qualification need to be a (ADMIN 5) Determination (G2.1.5)

Fire Brigade Leader? If so the Standard for PS 3 should include an item to designate a Fire Brigade Leader.

Response

1. Chemists and RP qualifications are not annotated on the Operations Org Chart. This tells the examinee that they are qualified Fire Brigade.
2. Added Non-Critical Step
3. Added words to standard.
4. No, there is not a separate qualification for Fire Brigade Leader.

NRC (Post OV):

The JPM is now SAT 2016 NRC Exam SRO - NRC License NRC:

SRO-A1.2 Maintenance 1. PS 1; Add when requested to the end of 2 X E (ADMIN 6) Responsibilities the Evaluator Cue.

(G2.1.4) Response:

1. Words added as requested.

ES-301 Operating Test Review Worksheet Form ES-301-7 2

Facility: Monticello Exam Date: October 19-30, 2020 1 2 3 4 5 6 Attributes Job Content Admin LOD ADMIN Topic and K/A U/E/S Explanation JPMs (1-5) I/C Critical Scope Perf. Job Cues Overlap Key Minutia Focus Steps (N/B) Std. Link NRC:

1. The initial conditions, specifically the last bullet, is unnecessarily leading the examinee. The determination of the regulatory impact (TS, TRM, or other applicable requirements) is an SRO responsibility. The bulleted item should end simply with the fact that Door 34 is NOT a fire door.
2. The Initiating Cue should simply be for the examinee to determine the impact of the door being open on any regulatory requirements. The examinee should then determine the applicability of LCO 3.0.9.
3. Add a step prior to JPM step 2 for applicant to identify applicability of step 4.3.2.F.2
4. JPM step 2; Step number referenced is incorrect (based on references supplied);

Should be Step 4.3.2.F.2

Response

SRO-A2 LCO 3.0.9 Application 2 X E 1. The task standard for this JPM is to apply (ADMIN 7) Determination (G2.2.40)

Technical Specifications (LCO 3.0.9) and NOT specifically to determine what room Door 34 is for as this information would be provided to the CRS by the operators. The information provided in the ICs allows for the examinee to efficiently work towards the actual task being tested.

2. Removing the IC information and simply asking what is the regulatory impact is an open-ended question not specific to the task which will result in a time intensive non-discriminatory JPM. Simplified cue as discussed during OV week.
3. Procedure OWI-02.07 recently revised which adjusted procedure step numbers. LCO 3.0.9 Use now starts with section 4.10. JPM updated.
4. N/A NRC (Post OV):

The JPM is now SAT

ES-301 Operating Test Review Worksheet Form ES-301-7 3

Facility: Monticello Exam Date: October 19-30, 2020 1 2 3 4 5 6 Attributes Job Content Admin LOD ADMIN Topic and K/A U/E/S Explanation JPMs (1-5) I/C Critical Scope Perf. Job Cues Overlap Key Minutia Focus Steps (N/B) Std. Link NRC:

1. Initiating Cue; Cue is unnecessarily leading the applicant to the ODCM requirements.

The cue should simply state: Determine the regulatory impacts associated with these instruments being Non-Functional.

2. Task Standard: Insert and associated Completion Times after actions.
3. PS 3; Standard should include that the examinee determines that with both monitors inoperable the minimum required channels is not met.

SRO-A3 ODCM Requirements 4. PS 4; Standard should include that the 2 X X E (ADMIN 8) (G2.3.15) examinee determines that the minimum required channels (single channel?) is not met.

Response

1. Removing the IC information and simply asking what is the regulatory impact is an open-ended question not specific to the task which will result in a time intensive non-discriminatory JPM.

Revised IC to just state using ODCM.

2. Updated task standards.
3. PS3 updated
4. PS4 updated.

NRC (Post OV):

The JPM is now SAT NRC:

1. INTIAL CONDITIONS
a. Add a blank line between the Duck and Cover bullet and the Approximately 30 minutes bullet to more clearly identify the time separation.

SRO-A4 Classify Event

b. Move the You are the on-shift SRO to (ADMIN According to Security 3 X X E the top of the list and change to Shift
9) Condition (G2.4.41)

Manager.

c. Move/incorporate the HPCI and RCIC bullet with the Reactor Status Bullet.
d. After the Busses 15 and 16 bullet may want to repeat that reactor status has not changed.

ES-301 Operating Test Review Worksheet Form ES-301-7 4

Facility: Monticello Exam Date: October 19-30, 2020 1 2 3 4 5 6 Attributes Job Content Admin LOD ADMIN Topic and K/A U/E/S Explanation JPMs (1-5) I/C Critical Scope Perf. Job Cues Overlap Key Minutia Focus Steps (N/B) Std. Link

2. There is only one (1) identified critical step.

PS 4 should be broken up into two (2) separate critical steps: 1) Locate the appropriate EAL; and 2) make the formal declaration. NOTE procedurally the formal notification is not listed until after the SEC is summoned to the Control Room.

3. PS 7; Consider having summoning the SEC as a critical step.

Response

1. Updated as requested above.
2. The JPM has 2 critical steps - see 3 below.

PS4 encompasses one procedural step that doesnt specifically state make a formal declaration. Standard has been updated to single bullet.

3. While important, summoning the SEC to the Control Room is NOT critical and is routinely performed by the one of the Control Room ROs.
4. New PS8 was added; Critical step to declare emergency.

NRC (Post OV):

1. PS 4; Need to add a closing parenthesis after the words Security Shift Supervisor.
2. PS 4; Add an Evaluator Note stating that the formal declaration (PS 8) may be performed at this time or may be delayed until later.
3. PS 8; Add an Evaluator Note similar to the one added to PS 4 stating that the formal declaration may have been made earlier.

The JPM is now SAT NRC:

1. JPM step 5 Standard (PS); In the last bullet the 9 day stretch should read 10-day RO-A1.1 Overtime Restrictions/ stretch.

(ADMIN Fatigue Management 3 X E 2. PS 5; The last bulleted item appears to be

1) (G 2.1.5) the critical element of the step. There are two parts. Item should be broken up into two separated items, both of which would be critical. The item related to the day off

ES-301 Operating Test Review Worksheet Form ES-301-7 5

Facility: Monticello Exam Date: October 19-30, 2020 1 2 3 4 5 6 Attributes Job Content Admin LOD ADMIN Topic and K/A U/E/S Explanation JPMs (1-5) I/C Critical Scope Perf. Job Cues Overlap Key Minutia Focus Steps (N/B) Std. Link needs to specify that the day off needs to be on or before Wednesday to ensure that the 72-hour in 7-day period is not violated. As currently written, this part of the Standard is inadequate.

3. PS 6; Define the 24-hour [0700 Fri to 0700 Sat] and 48-hour [0700 Thurs to 0700 Sat]

periods in question.

4. PS 6; Additionally, the 10-hour break between consecutive work periods [1500 to 1800 on Fri] would be violated.
5. TASK STANDARD needs to be revised to reflect the specific actions the applicant is expected to perform. For example, the examinee is expected to identify that they proposed work schedule for weeks 3 and 4 cannot be implemented without violating the 10 CFR 26 work hour restrictions.

Response

1. Standard reworded and associated statement was deleted.
2. Standard reworded to simply identify the that 10 CFR 26 restrictions will be violated for at least one of two reasons. Identification of when a day off must be taken is no longer required.
3. Times defined.
4. Reworded to include 10-hour break as one of the reasons for violating 10CFR26 restrictions.
5. Task standard originally written to match the MNGP task list. Standard has been updated.
6. Updated JPM to change evaluation to a week to week basis.

NRC (Post OV):

1. Revise PS 5 and 6 standards to state at least ONE . - DONE
2. Task Standard needs to be reworded for clarity. - DONE
a. Typo; they should be the
b. Add comma after proposed work

ES-301 Operating Test Review Worksheet Form ES-301-7 6

Facility: Monticello Exam Date: October 19-30, 2020 1 2 3 4 5 6 Attributes Job Content Admin LOD ADMIN Topic and K/A U/E/S Explanation JPMs (1-5) I/C Critical Scope Perf. Job Cues Overlap Key Minutia Focus Steps (N/B) Std. Link schedule and replace and identify with specifically

3. PS 6; In the last bullet, replace This would exceed with There isnt a (see last bullet of PS 5 standard). - DONE The JPM is now SAT 2016 NRC Exam NRC:
1. PS 3 and PS 5; PS 5 Standard includes step to reposition the valve when directed whereas PS 3 does not. Need to be consistent. Since this is an admin JPM the steps should probably not include valve repositioning.

RO-A1.2 Independent Verification 2 E 2. The TASK STANDARD needs to be revised (ADMIN 2) of RHR (G2.1.31) to reflect the specific actions the applicant is expected to perform (i.e., identifies that two valves are not in the expected position)

Response

1. Updated PS 5 evaluator cue.
2. Clarified Task Standard.

NRC (Post OV):

The JPM is now SAT

ES-301 Operating Test Review Worksheet Form ES-301-7 7

Facility: Monticello Exam Date: October 19-30, 2020 1 2 3 4 5 6 Attributes Job Content Admin LOD ADMIN Topic and K/A U/E/S Explanation JPMs (1-5) I/C Critical Scope Perf. Job Cues Overlap Key Minutia Focus Steps (N/B) Std. Link NRC:

1. PS 2; What is meant by the phrase normal oscillation? If data points are not static, then a range of values need to be specified.

Additionally, do the recorders provide digital values for each parameter or are the readings obtained from a chart that could lead to a range of recorded values; if so, Standard specify a range for each value

2. PS 2 Standard should state Record the listed parameter values from the specified recorders.
3. If PS 2 is critical, then should PS 4 also be RO-A2 Accident Monitoring critical?

(ADMIN Instrument Checks 2 X U

Response

3) (G2.2.37)
1. That is the way the procedure is written in the event the values arent stable. However, the data values in the simulator will be static.
2. PS 2 updated and ranges added.
3. PS4 and PS 5 are critical - fixed.

NRC (Post OV):

1. PS 3; In standard change Record and calculates to Calculates and records. -

DONE

2. PS 5; In standard change Record and calculates to Calculates and records. -

DONE The JPM is now SAT 2013 NRC Exam NRC:

1. Need to add a TASK STANDARD
2. PS 1; Procedure step D.1 requires the worker to identify area dose rates for ALL regions the RO-A3 LHRA Entry - Radwaste worker is expected to enter. The Standard 3 X X X U (ADMIN 4) Pump Room (2.3.7) should be revised to include the expected dose rates along the transit route also.
3. PS 2; completion of this step requires the examinee to assume that the highest expected dose rate is to be used for the 45-minute duration and that the expected task

ES-301 Operating Test Review Worksheet Form ES-301-7 8

Facility: Monticello Exam Date: October 19-30, 2020 1 2 3 4 5 6 Attributes Job Content Admin LOD ADMIN Topic and K/A U/E/S Explanation JPMs (1-5) I/C Critical Scope Perf. Job Cues Overlap Key Minutia Focus Steps (N/B) Std. Link time include transit to and from the valve location. Is that expectation documented somewhere? I can foresee applicants attempting to breakdown the task to three parts: transit to the valve, repairs and cleanup, and transit out of the area. it has been done in the past with similar JPMs; especially with applicants who have not made actual entries in the past. (Question)

4. PS 3; The determination that the expected dose will exceed the allowable entry dose should be part of PS 4; step D.3 of the procedure simply requires determination of the allowable entry dose. Should step PS 3 not be critical and PS 4 should be with the Standard specifying that the examinee; 1) determines allowable entry dose will be exceeded and 2) contacts RPC for resolution.

Response

1. Task standard added.
2. Updated ICs to state transit time dose is negligible.
3. Specified ICs to state the job is 45 minutes at the valve.
4. Updated PS4 to make it critical. PS3 would still be critical.

NRC (Post OV):

The JPM is now SAT

ES-301 Operating Test Review Worksheet Form ES-301-7 9

Facility: Monticello Exam Date: October 19-30, 2020 3 4 1 2 5 6 Attributes Job Content Simulator/In-Plant JPMs Safety Function LOD I/C Critical Scope Perf. Job Cues Overlap Key Minutia U/E/S Explanation and K/A (1-5) Focus Steps (N/B) Std. Link 2018 NRC Exam NRC:

1. TASK STANDARD needs to be revised to indicate that task includes response to loss of CRD Pump Flow (sheared shaft on the 12 CRD Pump). [NUREG 1021; App C; B.3]
2. PS 8; This JPM needs to be terminated by the evaluator. The assigned task is not completed since the 12 CRD Pump has SF1 failed and transition was made to AOP.

S1; CRD Pump 201001 A4.01 2 X E 3. Although not specifically stated in the AOP, Swap-over there should be a step to verify system (Alt Path) parameters returned to normal. This could be incorporated into the Standard for PS 6. [NUREG 1021; App C; B.3]

Response

1. Task standard revised
2. This is part of our standard JPM template.

PS8 removed.

3. Added parameter monitoring to PS6.

NRC (Post OV):

The JPM is now SAT NRC:

1. TASK STANDARD needs to be revised to indicate that task includes response to severe vibrations on the 12 Reactor Feed pump. [NUREG 1021; App C; B.3]
2. PS 6 and 7; S2; Place 12 SF2 a. Why is this NOT a critical step? The RFP In Service 259001 A4.02 2 X E procedure gives specific guidance to from Warm-Up (Alt Path) shut down the feed pump if any abnormal noise or vibration.
b. If trouble alarm comes in immediately with activation of malfunction, consider switching the order of steps PS 6 and 7. Alternatively consider combining the two steps.

ES-301 Operating Test Review Worksheet Form ES-301-7 10 Facility: Monticello Exam Date: October 19-30, 2020 3 4 1 2 5 6 Attributes Job Content Simulator/In-Plant JPMs Safety Function LOD I/C Critical Scope Perf. Job Cues Overlap Key Minutia U/E/S Explanation and K/A (1-5) Focus Steps (N/B) Std. Link

c. Condition the evaluator cue on 12 RFP vibrations until after the trouble alarm comes in.
d. ALT PATH begins upon either acknowledgement of high vibration report OR verification high vibrations per ARP.
3. Delete PS 9; Per PS 8, this JPM is terminated by the evaluator. The assigned task is not completed since the 12 Reactor Feed pump has failed.

Response

1. Performance task revised. Task Standard was revised to include response to high vibration.
2. PS 6 and 7
a. The critical step would be to shutdown the RFP, not monitor parameters.

PS 6 revised to respond to Alarm 6-A-2 and validate cause of alarm.

b. The alarm doesnt come in immediately.
c. Conditioned cue.
d. Updated Alternate Path start step as requested. PS 7 (formerly PS-8), now a critical step, to reflect that Trip of RFP can be due to either step D.8 of the OP or step 2 of the ARP. Original actions of PS-7 incorporated into PS 6.
3. This is part of our standard JPM template.

PS9 removed.

NRC (Post OV):

The JPM is now SAT

ES-301 Operating Test Review Worksheet Form ES-301-7 11 Facility: Monticello Exam Date: October 19-30, 2020 3 4 1 2 5 6 Attributes Job Content Simulator/In-Plant JPMs Safety Function LOD I/C Critical Scope Perf. Job Cues Overlap Key Minutia U/E/S Explanation and K/A (1-5) Focus Steps (N/B) Std. Link NRC:

1. TASK STANDARD needs to be revised to indicate that task includes response to failure of Recirc MG Drive Motor Breaker to automatically trip. [NUREG 1021; App C; B.3]
2. PS 16; This JPM needs to be terminated by the evaluator. The assigned task is not completed due to malfunction.
3. PS 10; The operator should perform this S3; Start No. SF4 step. OK to have another operator record 11 Recirc 202001 A4.01 3 X E completion.

Pump (Alt Path)

Response

1. Task standard revised.
2. This is part of our standard JPM template.

PS 16 removed.

3. IAW validating operators, this step would be completed by another operator and a TS SR brief would have occurred. No change made to this step.

NRC (Post OV):

The JPM is now SAT 2016 NRC Exam NRC:

1. TASK STANDARD needs to be revised to state that examinee manually closes at least one of the RCIC Steam Line Isolation Valves.
2. PS 1; Standard should specify how the S4; Manually SF5 examinee verifies that NO Group V isolation is present (i.e., list the indications Insert A Group 223002 A4.02 2 X E that should be checked).

5 Isolation (Alt Path) 3. PS 5; Identification of the leak should be a separate step or incorporated into PS 6.

4. PS 6; Responds to, and implements to ARP for, annunciator 4-A-05
a. Confirms validity of alarm
b. Determines failure to automatically isolate.

ES-301 Operating Test Review Worksheet Form ES-301-7 12 Facility: Monticello Exam Date: October 19-30, 2020 3 4 1 2 5 6 Attributes Job Content Simulator/In-Plant JPMs Safety Function LOD I/C Critical Scope Perf. Job Cues Overlap Key Minutia U/E/S Explanation and K/A (1-5) Focus Steps (N/B) Std. Link

5. PS 7; should specify IAW ARP C.6-004-A-05 Operator Action Step 1 AND/OR AOP C.4-B.04.01.E Subsequent Operator Action Step 1 (provided reference shows Step 2 as the applicable step)
6. PS 7; Standard should be to close both valves but indicate that closure of either valve satisfy the critical element of he step.
7. Delete PS 8; Per PS 7, this JPM is terminated by the evaluator. The assigned task is not completed due to the malfunction.

Response

1. Task standard revised.
2. Updated PS 1
3. Leak is triggered by this action and should remain in this step as this is where it will be recognized. No changes made.
4. Updated PS 6 and added evaluator note for response using ARP guidance.
5. PS7 updated
6. PS7 updated
7. PS8 removed.

NRC (Post OV):

The JPM is now SAT NRC:

1. INITIATING CUE; Combine the 1st and 3rd bullets into one statement.
2. PS 2; is 103/104 LC BUS TIE ACB-52-309 S5; Restore expected to be closed. If so, then step is SF6 NOT critical.

LC-103 from 2 X  ? E 295003 AA1.01 Response:

LC-104 1. 1st and 3rd bullet combined

2. Yes, the tie breaker is expected to be closed. PS2 is not critical NRC (Post OV):

The JPM is now SAT

ES-301 Operating Test Review Worksheet Form ES-301-7 13 Facility: Monticello Exam Date: October 19-30, 2020 3 4 1 2 5 6 Attributes Job Content Simulator/In-Plant JPMs Safety Function LOD I/C Critical Scope Perf. Job Cues Overlap Key Minutia U/E/S Explanation and K/A (1-5) Focus Steps (N/B) Std. Link S6; Removing SF7 the Bypass of 2 S 215005 A4.04 a LPRM NRC:

1. PS 1; Recommend initiating the TB Siding Deluge system as part of the Simulator Setup.
2. Delete PS 5; Actions completed in PS 4.

Response

S7; Transformer 1. This Deluge wouldnt have necessarily Deluge Initiation SF8 initiated due to the initial conditions. This is 2 E from Control 286000 A4.01 an automatic feature that adds no value to Room the JPM. No changes made to step.

2. PS 5 removed.
3. Updated PS1 and PS2 standard to include the non-critical portion of step to verify amber light is lit.

NRC (Post OV):

The JPM is now SAT 2016 NRC Exam NRC:

1. INITIATING CUE; Specifying performance of step 1-4 is unnecessarily leading the applicant.

S8; Manually 2. Include step for determining need to SF9 perform step 5 of procedure.

Initiate SBGT 2 E 261000 A4.07 Response:

A Train 1. IC changed as requested.

2. Included PS for procedure step 5.
3. Changed when to if in evaluator cue for PS2 NRC (Post OV):

The JPM is now SAT

ES-301 Operating Test Review Worksheet Form ES-301-7 14 Facility: Monticello Exam Date: October 19-30, 2020 3 4 1 2 5 6 Attributes Job Content Simulator/In-Plant JPMs Safety Function LOD I/C Critical Scope Perf. Job Cues Overlap Key Minutia U/E/S Explanation and K/A (1-5) Focus Steps (N/B) Std. Link NRC:

1. INITIAL CONDITIONS; In the last bullet, or earlier, specify that C.5-3101 is being implemented.
2. TASK STANDARD; Revise to include from the ASDS Panel.
3. PS 1; Evaluator Note should simply state that this JPM is administered in the Simulator.
4. PS 1; Evaluator Cues should be conditioned by After the examinee explains where the procedure(key) can be obtained
5. PS 7 and the Terminating Cue should P1; match. PS 7 implies that the task (JPM) is Depressurize complete when reported as complete. The SF1 the Scram Air 2 E Terminating Cue implies that the evaluator 295037 EA1.05 terminates the JPM.

Header from ASDS Panel Response:

1. ICs have been updated.
2. Task standard updated.
3. This JPM was originally going to be administered at the Simulator ASDS Panel.

However, due to the simulator time constraints from compressing the operating exam into one week, this JPM will be simulated in the plant. Evaluator cues added to applicable steps.

4. Cue updated.
5. Terminating cue updated.
6. Updated evaluator cue in PS6 NRC (Post OV):

The JPM is now SAT

ES-301 Operating Test Review Worksheet Form ES-301-7 15 Facility: Monticello Exam Date: October 19-30, 2020 3 4 1 2 5 6 Attributes Job Content Simulator/In-Plant JPMs Safety Function LOD I/C Critical Scope Perf. Job Cues Overlap Key Minutia U/E/S Explanation and K/A (1-5) Focus Steps (N/B) Std. Link NRC:

1. INITIAL CONDITIONS
a. Separate the current bullet statement into two separate statements.
b. Add a new item to state that the Control Room Supervisor has directed implementation of C.5-3203 PART C.

(Could be added to the statement that two Service Water pumps and both Condensate pumps are in service.)

P2; Use of 2. TASK STANDARD; Recommend revising Alternate to state that the in-plant lineups to crosstie SF2 Injection 3 E Service Water to Condensate/Feedwater 295031 EA1.08 have been completed.

Systems for RPV Makeup 3. PS 4 and PS 5; Revise the last Evaluator Cue to state that hotwell level is rising and that the JPM is complete. Delete PS 5.

Response

1. ICs updated.
2. Task Standard updated
3. PS4 revised, PS5 removed.
4. Updated initiating cue to direct that SW-147 is to be opened 4 turns.

NRC (Post OV):

The JPM is now SAT NRC:

1. Recommend removing the examples in PS 2, 3, and 6.

Response

P3; Reset the 1. Removed example from standard in PS 2, 3 and 6.

Leak Rate SF9 3 E 2. Updated ICs to include sumps have been Change High 223001 A1.10 pumped down to 4.1.

Alarm Timer 3. Updated PS 7 evaluator cue to provide guidance if the black pointer is already at the required position.

NRC (Post OV):

The JPM is now SAT

ES-301 Operating Test Review Worksheet Form ES-301-7 16 Instructions for Completing This Table:

Check or mark any item(s) requiring a comment and explain the issue in the space provided using the guide below.

1. Check each JPM for appropriate administrative topic requirements (COO, EC, Rad, and EP) or safety function requirements and corresponding K/A. Mark in column 1.

(ES-301, D.3 and D.4)

2. Determine the level of difficulty (LOD) using an established 1-5 rating scale. Levels 1 and 5 represent an inappropriate (low or high) discriminatory level for the license that is being tested. Mark in column 2 (Appendix D, C.1.f)
3. In column 3, Attributes, check the appropriate box when an attribute is not met:
  • The initial conditions and/or initiating cue is clear to ensure the operator understands the task and how to begin. (Appendix C, B.4)
  • The JPM contains appropriate cues that clearly indicate when they should be provided to the examinee. Cues are objective and not leading. (Appendix C, D.1)
  • All critical steps (elements) are properly identified.
  • The scope of the task is not too narrow (N) or too broad (B).
  • Excessive overlap does not occur with other parts of the operating test or written examination. (ES-301, D.1.a, and ES-301, D.2.a)
  • The task performance standard clearly describes the expected outcome (i.e., end state). Each performance step identifies a standard for successful completion of the step.
  • A valid marked up key was provided (e.g., graph interpretation, initialed steps for handouts).
4. For column 4, Job Content, check the appropriate box if the job content flaw does not meet the following elements:
  • Topics are linked to the job content (e.g., not a disguised task, task required in real job).
  • The JPM has meaningful performance requirements that will provide a legitimate basis for evaluating the applicant's understanding and ability to safely operate the plant. (ES-301, D.2.c)
5. Based on the reviewers judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)nhancement, or (S)atisfactory? Mark the answer in column 5.
6. In column 6, provide a brief description of any (U)nacceptable or (E)nhancement rating from column 5.

Save initial review comments and detail subsequent comment resolution so that each exam-bound JPM is marked by a (S)atisfactory resolution on this form.

ES-301 Operating Test Review Worksheet Form ES-301-7 17 Facility: Monticello Scenario: 1 Exam Date: October 19-30, 2020 1 2 3 4 5 6 7 8 9 10 Realism/ Required Verifiable Scenario Event LOD TS CTs U/E/S Explanation Cred. Actions actions Overlap 1 X S Normal Event Swap SWC Pumps 2 S APRM Fails Dwnsc 3 Reactivity Event SRV Stuck Open NRC(Post OV)

X E 1. Facility revised event trigger 13 to delay full closure of the SRV until power reduced to <90% on ARPM 1 as requested by the NRC.

2. Facility removed reference to TLCO 3.4.4 based on OV comment.

The event is now SAT 4 BOP manually isolates HPCI on a steam leak after Group IV Auto HPCI Steam Leak Isolation fails.

NRC(Post OV)

1. Adding a Critical Task (CT) to isolate the HPCI steam leak before X X E conditions require a SCRAM was discussed during OV. Provide an explanation for why this is not a CT.

Response: The leak is isolable, therefore EOP step to SCRAM is not applicable to the event even though max safe parameters will be exceeded in two areas due to the leak severity.

The event is SAT 5

SRV Reopens X X S SCRAM 6 NRC: CT-30 does not have a boundary condition for initiating DW spray SRV Tailpipe after containment pressure reaches 12 psig. If applicant does not Steam Leak perform this action, what will be the consequences for this scenario?

X E What is the applicant performing this action to prevent from happening, will containment design parameters be exceeded?

Response: Updated CT-30 as follows:

ES-301 Operating Test Review Worksheet Form ES-301-7 18 Facility: Monticello Scenario: 1 Exam Date: October 19-30, 2020 1 2 3 4 5 6 7 8 9 10 Realism/ Required Verifiable Scenario Event LOD TS CTs U/E/S Explanation Cred. Actions actions Overlap When drywell pressure reaches 12 psig then initiate drywell spray to restore and maintain the safe region to PSP. Failure mode is based on fatigue failure and must be completed within 22 minutes.

The CT is now SAT 7 X S ATC manually controls RPV level with LFFRV.

LFFRV Fails 7 0 0 0 0 2 2 3 E

ES-301 Operating Test Review Worksheet Form ES-301-7 19 Facility: Monticello Scenario: 2 Exam Date: October 19-30, 2020 1 2 3 4 5 6 7 8 9 10 Realism/ Required Verifiable Scenario Event LOD TS CTs U/E/S Explanation Cred. Actions actions Overlap Reactivity Event NRC: This event credits the OATC with a reactivity maneuver and a component failure. This is specifically, prohibited in NUREG 1021, ES-301 which states in part, a power change can be counted as a normal evolution or as a reactivity manipulation, and, similarly, a component failure that immediately results in a major transient counts as one or the 1A/B Raise Power with other, but not both.

E RR Pumps/ Scoop Response: The 12 Recirc Pump Scoop Tube lock occurs immediately Tube Locks Up prior to any significant power change. Once corrected, the OATC will continue with and complete the reactivity manipulation. Recommend administratively separating these into two separate events. This was done for the MNGP 2018 NRC Exam Scenarios 2 and 4. Events split into 1A and 1B.

The events are now SAT 2 Normal Event Start 2nd S Condensate Pump 3 (Post OV) Added item to Expected Student Response for the BOP to CS Valve Leak X X E determine that 11 CS Subsystem must be isolated.

The event is now SAT 4 BOP manually shuts down RCIC when it spuriously starts.

RCIC Spurious X X S Start 5 S Event added post review. See note for event 8.

RWM Failure 6 S CW Pumps Trip 7 ATC manually controls RPV Level until power downscale on Electric ATWS APRMs and restores to normal shutdown level band when all rods inserted.

NRC: CT-47 does not have a boundary condition for inserting control XX E rods. If applicant does not perform this action by a certain time/condition, what will be the consequences for this scenario?

Response: The bounding condition is to promptly achieve an all rods in condition as verified on the RWM and the C-05 full core display.

ES-301 Operating Test Review Worksheet Form ES-301-7 20 Facility: Monticello Scenario: 2 Exam Date: October 19-30, 2020 1 2 3 4 5 6 7 8 9 10 Realism/ Required Verifiable Scenario Event LOD TS CTs U/E/S Explanation Cred. Actions actions Overlap NRC(Post OV)

1. After the transition is made to C.5-2007, all expected RO applicant responses for Events 7 and 8 should be assigned to CREW vice OATC/BOP. Availability of OATC will largely depend on ability to control RPV water level after T&P.
2. All actions listed under Event 8, except for determination of first SBLC pump failure to start and start of the other pump, should be listed under Event 7.
3. Consider the following revision to CT-47 During failure to scram conditions with a critical reactor, PRIOR to exceeding a Torus Temperature of 110°F: inject SBLC; AND/OR promptly begin control rod insertion using one or more of the methods contained within C.5-3101 to achieve reactor shutdown under all conditions.

The event is now SAT 8 Added RWM failure for and additional OATC malfunction in the event SBLC Pump Fails this malfunction is not addressed in the fast-moving scenario.

NRC(Post OV)

E

1. D1 should be revised to reflect that the event may be completed by either the OATC or BOP operator.

The event is now SAT 78 0 0 0 0 2 2 5 E

ES-301 Operating Test Review Worksheet Form ES-301-7 21 Facility: Monticello Scenario: 3 Exam Date: October 19-30, 2020 1 2 3 4 5 6 7 8 9 10 Realism/ Required Verifiable Scenario Event LOD TS CTs U/E/S Explanation Cred. Actions actions Overlap 1 Normal Event Place MPR in S Service 2 X S RR Pump Trip 3A/B Component Failure/Reactivity Event Emergency NRC: This event credits the ATC with a reactivity maneuver and a Downpower component failure. This is specifically, prohibited in NUREG 1021, ES-301 which states in part, a power change can be counted as a normal evolution or as a reactivity manipulation, and, similarly, a component failure that immediately results in a major transient counts as one or the X other, but not both.

E Response: The RMCS failure occurs immediately prior to any power change. Once corrected, the OATC will continue with and complete the reactivity manipulation. Recommend administratively separating these into two separate events. This was done for the MNGP 2018 NRC Exam Scenario 4. Event split into 3A and 3B The events are now SAT 4 NRC: Include specific components to be manipulated in the D-2 for XFMR Oil Leak transferring busses 11-14 to 1R.

X X E Response: Components added.

The event is now SAT 5 X X S Rods Drift 6 NRC(Post OV)

LOCA with Loss 1. After the SCRAM immediate actions are completed, all expected of HP Injection RO applicant responses for Events 6 and 7 should be assigned to CREW vice OATC/BOP. Availability of any particular operator for a XX X E specific response will depend on the flow of the scenario.

2. Add an Expected RO action to ensure 2 or more Injection Subsystems (Detail R) are aligned for injection with the pumps running.

The event is now SAT 7 X S ATC/BOP restores RPV Level with Low Pressure ECCS.

ES-301 Operating Test Review Worksheet Form ES-301-7 22 Facility: Monticello Scenario: 3 Exam Date: October 19-30, 2020 1 2 3 4 5 6 7 8 9 10 Realism/ Required Verifiable Scenario Event LOD TS CTs U/E/S Explanation Cred. Actions actions Overlap CS Pump Fails to NRC(Post OV)

Start

1. The CRS expected response to injection sources lined up for injection is incomplete and should probably be included in Event 6.

(see related Event 6 comment)

The event is now SAT 7 0 1 0 0 2 3 3 E

ES-301 Operating Test Review Worksheet Form ES-301-7 23 SCENARIO 4 REMOVED FROM THE EXAM PACKAGE DUE TO A REDUCED NUMBER OF REQUIRED SCENARIOS.

ES-301 Operating Test Review Worksheet Form ES-301-7 24 Facility: Monticello Scenario: 5 (SPARE) Exam Date: October 19-30, 2020 1 2 3 4 5 6 7 8 9 10 Realism/ Required Verifiable Scenario Event LOD TS CTs U/E/S Explanation Cred. Actions actions Overlap 1 Normal Event Test BPVs X S 2 Reactivity Event X S Main Turbine Vibes NRC: RBM is required to be operable at power levels > 30%, that is when RBM is in effect. Why is TS 3.3.2.1 not applicable? Are we expecting to lower power below 30% in the previous event?

3 X Response: Greater than 30% is the power of applicability; however, the RBM Upscale S applicability also requires MCPR to be below the limit specified in the COLR. MCPR is not below the limit in the COLR, therefore this LCO is not applicable, and as such, it is NOT being credited for a TS call.

BOP manually inhibits ADS.

NRC(Post OV) 4 1. Inhibiting ADS should be a critical task since failing to do so will ADS Timer X X S Initiation result/require a Reactor Scram.

Response: Due to the nature of the malfunction, ADS valves will not open even if timer times out.

5 S Loss of LC-107 NRC: CT-10 does not have a boundary condition for ordering reactor scram following a design basis earthquake. If applicant does not perform this action by a certain time/condition, what will be the consequences for this scenario?

Response

6 1. CT-10 Manually scram the reactor if a design basis earthquake has Design Basis XX X E occurred causing plant degradation (Torus Rupture) and has been verified Earthquake by:

  • One of the following:

o Actually having felt the indications OR o By confirmation from outside agencies

ES-301 Operating Test Review Worksheet Form ES-301-7 25 Facility: Monticello Scenario: 5 (SPARE) Exam Date: October 19-30, 2020 1 2 3 4 5 6 7 8 9 10 Realism/ Required Verifiable Scenario Event LOD TS CTs U/E/S Explanation Cred. Actions actions Overlap Following a DBA, Safety System degradation may occur from continued operation with these condition that could challenge the ability to protect the health and safety of the public.

NRC(Post OV)

The event is now SAT 7 ATC manually inserts control rod which failed to scram.

Control Rod Fails S to Insert 7 0 0 0 0 2 2 3 E

ES-301 Operating Test Review Worksheet Form ES-301-7 26 Instructions for Completing This Table:

Use this table for each scenario for evaluation.

2 Check this box if the events are not related (e.g., seismic event followed by a pipe rupture) OR if the events do not obey the laws of physics and thermodynamics.

3, 4 In columns 3 and 4, check the box if there is no verifiable or required action, as applicable. Examples of required actions are as follows: (ES-301, D.5f)

  • opening, closing, and throttling valves
  • starting and stopping equipment
  • raising and lowering level, flow, and pressure
  • making decisions and giving directions
  • acknowledging or verifying key alarms and automatic actions (Uncomplicated events that require no operator action beyond this should not be included on the operating test unless they are necessary to set the stage for subsequent events. (Appendix D, B.3))

5 Check this box if the level of difficulty is not appropriate.

6 Check this box if the event has a TS.

7 Check this box if the event has a critical task (CT). If the same CT covers more than one event, check the event where the CT started only.

8 Check this box if the event overlaps with another event on any of the last two NRC examinations. (Appendix D, C.1.f) 9 Based on the reviewers judgment, is the event as written (U)nacceptable (requiring repair or replacement), in need of (E)nhancement, or (S)atisfactory? Mark the answer in column 9.

10 Record any explanations of the events here.

In the shaded boxes, sum the number of check marks in each column.

  • In column 1, sum the number of events.
  • In columns 2-4, record the total number of check marks for each column.
  • In column 5, based on the reviewer's judgment, place a checkmark only if the scenario's LOD is not appropriate.
  • In column 6, TS are required to be 2 for each scenario. (ES-301, D.5.d)
  • In column 7, pre-identified CTs should be 2 for each scenario. (Appendix D; ES-301, D.5.d; ES-301-4)
  • In column 8, record the number of events not used on the two previous NRC initial licensing exams. A scenario is considered unsatisfactory if there is < 2 new events. (ES-301, D.5.b; Appendix D, C.1.f)
  • In column 9, record whether the scenario as written (U)nacceptable, in need of (E)nhancement, or (S)atisfactory from column 11 of the simulator scenario table.

ES-301 Operating Test Review Worksheet Form ES-301-7 27 Facility: Monticello Exam Date: October 19-30, 2020 1 2 3 4 5 6 7 8 11 Scenario  % Unsat. Explanation Event Events TS TS CT CT Scenario U/E/S Totals Unsat. Total Unsat. Total Unsat.

Elements 1 7 0 2 0 2 0 0 E 2 8 0 2 0 2 0 0 E 3 7 0 2 0 3 0 0 E 4 N/A 5 7 0 2 0 2 0 0 E Instructions for Completing This Table:

Check or mark any item(s) requiring comment and explain the issue in the space provided.

1, 3, 5 For each simulator scenario, enter the total number of events (column 1), TS entries/actions (column 3), and CTs (column 5).

This number should match the respective scenario from the event-based scenario tables (the sum from columns 1, 6, and 7, respectively).

2, 4, 6 For each simulator scenario, evaluate each event, TS, and CT as (S)atisfactory, (E)nhance, or (U)nsatisfactory based on the following criteria:

a. Events. Each event is described on a Form ES-D-2, including all switch manipulations, pertinent alarms, and verifiable actions. Event actions are balanced between at-the-controls and balance-of-plant applicants during the scenario. All event-related attributes on Form ES-301-4 are met. Enter the total number of unsatisfactory events in column 2.
b. TS. A scenario includes at least two TS entries/actions across at least two different events. TS entries and actions are detailed on Form ES-D-2. Enter the total number of unsatisfactory TS entries/actions in column 4. (ES-301, D.5d)
c. CT. Check that a scenario includes at least two pre-identified CTs. This criterion is a target quantitative attribute, not an absolute minimum requirement.

Check that each CT is explicitly bounded on Form ES-D-2 with measurable performance standards (see Appendix D). Enter the total number of unsatisfactory CTs in column 6.

2+4+6 7 In column 7, calculate the percentage of unsatisfactory scenario elements: 100%

1+3+5 8 If the value in column 7 is > 20%, mark the scenario as (U)nsatisfactory in column 8. If column 7 is 20%, annotate with (E)nhancement or (S)atisfactory.

9 In column 11, explain each unsatisfactory event, TS, and CT. Editorial comments can also be added here.

Save initial review comments and detail subsequent comment resolution so that each exam-bound scenario is marked by a (S)atisfactory resolution on this form.

ES-301 28 Form ES-301-7 Facility: Monticello Exam Date: October 19-30, 2020 OPERATING TEST TOTALS Total Total Total  %

Total Explanation Unsat. Edits Sat. Unsat.

All Admin JPMs required editing before being Admin. considered satisfactory for administration.

9 2 7 0 JPMs Sim/In-Plant 11 0 10 1 JPMs All Scenarios required editing before being considered satisfactory for administration.

Scenarios 4 0 4 0 Op. Test 24 2 21 1 8%

Totals:

Instructions for Completing This Table:

Update data for this table from quality reviews and totals in the previous tables and then calculate the percentage of total items that are unsatisfactory and give an explanation in the space provided.

1. Enter the total number of items submitted for the operating test in the Total column. For example, if nine administrative JPMs were submitted, enter 9 in the Total items column for administrative JPMs.

For scenarios, enter the total number of simulator scenarios.

Enter the total number of (U)nsatisfactory JPMs and scenarios from the two JPMs column 5 and 2.

simulator scenarios column 8 in the previous tables. Provide an explanation in the space provided.

Enter totals for (E)nhancements needed and (S)atisfactory JPMs and scenarios from the previous 3.

tables. This task is for tracking only.

4. Total each column and enter the amounts in the Op. Test Totals row.

Calculate the percentage of the operating test that is (U)nsatisfactory (Op. Test Total Unsat.)/(Op. Test 5.

Total) and place this value in the bolded % Unsat. cell.

Refer to ES-501, E.3.a, to rate the overall operating test as follows:

  • satisfactory, if the Op. Test Total % Unsat. is 20%
  • unsatisfactory, if Op. Test Total % Unsat. is > 20%

Update this table and the tables above with post-exam changes if the as-administered operating test 6.

required content changes, including the following:

  • The JPM performance standards were incorrect.
  • The administrative JPM tasks/keys were incorrect.
  • CTs were incorrect in the scenarios (not including post scenario critical tasks defined in Appendix D).
  • The EOP strategy was incorrect in a scenario(s).
  • TS entries/actions were determined to be incorrect in a scenario(s).