ML21034A622
| ML21034A622 | |
| Person / Time | |
|---|---|
| Site: | Brunswick  |
| Issue date: | 02/03/2021 |
| From: | Gita Samaddar Division of Reactor Safety II |
| To: | |
| References | |
| Download: ML21034A622 (44) | |
Text
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Brunswick Exam Date: 12/07/2020 1
2 3
Attributes 4
Job Content 5
6 Admin JPMs ADMIN Topic and K/A LOD (1-5)
U/E/S Explanation I/C Cues Critical Scope Overlap Perf.
Key Minutia Job Link Focus Steps (N/B)
Std.
Evaluate Status of Operator Licenses (RO)
COO-1 G2.1.4 2
S Verifying SLC Operating Parameters (RO)
COO-2 G2.1.25 2
X X
E
- 1. This JPM provides very minimal discriminatory ability and level of difficulty as written because it gives the procedure number and section for the volume determination, the tank temperature is within normal limits, and the attachment names directly match two of the parameters to be determined. It would be acceptable if you changed the tank temperature to something between 60-65 degrees F and adjusted the answer concerning Tank temperature if required.
- 2. Based on the requirements of 2OP-05 section 6.1.1 step 6, is it even correct to use Attachment 1
for the Tank Temperature part of the question?
11/6/2020- Licensee addressed concerns listed above, see final approved JPM. The JPM is now satisfactory.
Develop a Clearance Boundary -
EC-1 G2.2.13 2
X E
- 1. Sequence description on answer key does not match what is written in the steps.
- 2. Performance standard does not state that some of the sequence is critical for task completion.
- 3. Is the EC-1 Attachment another answer key?
11/6/2020- Licensee addressed concerns listed above, see final approved JPM.
The JPM is now satisfactory.
ES-301 Operating Test Review Worksheet Form ES-301-7 Determine Stay Time Limitations in High Radiation Areas (RO)
RC-1 G2.3.4/2.3.7 2
X E
- 1. Map-Three of four stairwells have the same radiation level. The fourth stairwell has no radiation level. This provides no discriminatory value for stairwell location.
- 2. Need to specify in some way that the workers are not pregnant and are trained radiation workers.
- 3. Need more separation between the two numerical answers.
- 4. Need to specify without an extension.
11/6/2020- Licensee addressed concerns listed above, see final approved JPM.
The JPM is now satisfactory.
Evaluate Level Instrument Operability (SRO)
COO-1 G2.1.7 1
X X
U
- 1. Initiating cue: Determine required Tech Spec action(s) for inoperable instrumentation (if any).
- 2. The note prior to step 12 talks about a 8 hour9.259259e-5 days <br />0.00222 hours <br />1.322751e-5 weeks <br />3.044e-6 months <br /> completion time for LCO 3.3.5.1 Action E2. Where does that come from?
- 3. Unsatisfactory due to LOD = 1. At least have the comparison associated with the inoperable instrument be recorded incorrectly so that the applicants are required to identify that error since all TS LCOs and functional units are identified in that item of the checklist.
11/6/2020- Licensee addressed concerns listed above, see final approved JPM.
The JPM is now satisfactory.
Determine Protected Equipment Actions (SRO)
COO-2 G2.1.1 2
X U
- 1. Performance standard needs to include that the required action statements will be identified.
- 2. Initiating cue should not reference 0AP-25. The applicant should be able to determine the applicable procedure for protected equipment. The procedure name and number along with the table of contents reduces the discriminatory value of this administrative JPM.
- 3. This is packaged as a conduct of operations JPM however it seems much more like an equipment control JPM. The Safety Function is listed as Admin -
Equipment Control. This much more closely relates to the K/A statements in G2.2.14, G2.2.17, or G2.2.19.
Unsatisfactory due to need to have the correct number of each type of Administrative JPM in order to have a valid exam.
ES-301 Operating Test Review Worksheet Form ES-301-7 Evaluate Partial View of Core For Correct Core Loading (SRO)
COO-2 G2.1.42 2
S 10/7/2020 - Licensee submitted new JPM that meets a Conduct of Operations K/A. JPM is now Satisfactory.
Determine Post Maintenance Testing Requirements (SRO)
EC-1 G2.2.21 3
S Determine Authorization Requirements for Protection of Property (SRO)
RC-1 G2.3.4 1
X X
U
- 2. The evaluator notes state that the applicable procedure section WILL be provided to the trainee. If this is so, the level of difficulty for the SRO portion of this JPM will be one and the JPM Unsatisfactory. The Shift Manager should know which procedure and section to go in order to authorize emergency exposure.
- 3. The last part of the note prior to Step 6 is incorrect in accordance with AD-EP-ALL-0205.
- 4. The performance standard statement does not fully match the task.
11/6/2020- Licensee addressed concerns listed above, see final approved JPM.
The JPM is now satisfactory.
Determine Protective Action Recommendations (PARS) IAW AD-EP-ALL-0109, Offsite Protective Action Recommendations (SRO)
EP-1 G2.4.44 2
S All Administrative JPMs will be further reviewed during on-site validation week.
11/7/2020- All Administrative JPMs were validated using licensed operators during on-site validation week.
ES-301 Operating Test Review Worksheet Form ES-301-7 Simulator/In Plant JPMs Safety Function and K/A LOD (1-5)
Attributes 4
Job Content U/E/S Explanation I/C Focus Cues Critical Steps Scope (N/B)
Overlap Perf.
Std.
Key Minutia Job Link Reset Recirc Pump Runback
- Both Recirc Pumps Trip SF 1 202002 A2.01 2
X E
- 2. The 2OP-02 Section 6.1.3 page numbers for Step 5 are incorrect.
- 3. The performance standard should also discuss raising pump speed.
11/6/2020- Licensee addressed concerns listed above, see final approved JPM. The JPM is now satisfactory.
Place SULCV in Service Following a Reactor Scram with a SULCV Failure SF 2 259001 A4.01 2
X E
- 1. The valve numbers in Step 15 required actions and standard do not match for one set. I believe FW-V11 should be FW-V-119.
- 2. Where does the procedural success path for alternate path portion come from? It does not seem to be in excerpt of 0OI-37.17 that is given. There needs to be some reference as to where the success path comes from. It could be included in the step or a note.
- 3. Does the name of the task really match what we are doing?
It seems that the valves being placed in service in the end are heater inlet and outlet valves, not SULCVs. It also does not match the performance standard.
11/6/2020- Licensee addressed concerns listed above, see final approved JPM. The JPM is now satisfactory.
Turbine Overspeed Trip Test SF 3 241000 K1.22 2
X U
The applicants do not really have to recognize there is a failure, they are required to ensue both breakers are open when MWe
ES-301 Operating Test Review Worksheet Form ES-301-7 lowers to zero whether the plant operates as designed or not.
11/6/2020- Licensee addressed concerns listed above, see final approved JPM. The JPM is now satisfactory.
Operate the Hydrogen and Oxygen Monitor Using the Hard Card SF 5 223001 A4.04/A4.05 2
X E
- 1. Terminating cue needs to be modified slightly. What if the applicant did not do everything properly through Step 6c? The JPM could never end.
11/6/2020- Licensee addressed concerns listed above, see final approved JPM. The JPM is now satisfactory.
HPCI Pressure Control SF4 206000 A4.06 2
X E
- 1. Need to add an action verb such as verifies to the standard for Step 4.
- 2. Need to add an action verb such as verifies to the standard for Step 18.
- 3. Need to add an action verb such as verifies to the standard for Step 19.
11/6/2020- Licensee addressed concerns listed above, see final approved JPM. The JPM is now satisfactory.
Restoration of APRM Rod Block and Scram Setpoints from Single Loop Operation to Two Loop Operation SF 7 201005 A1.04 2
S Emergency Isolation of 230 KV Bus 2A SF 6 262001 2
X E
- 1. Step 3 is listed as a critical step, but there is no action performed in the step standard.
2, There is also no action verb in the step standard for Steps 4 and
- 5.
11/6/2020- Licensee addressed concerns listed above, see final approved JPM. The JPM is now satisfactory.
Manual Startup of Control Building Emergency Ventilation SF 9 290003 A4.01 2
X E
- 1. Step 4 is not an ensure step, it is a confirm step.
- 2. Step 5, 6, 7 and 8 also have an ensure vice a confirm.
11/6/2020- Licensee addressed concerns listed above, see final
ES-301 Operating Test Review Worksheet Form ES-301-7 approved JPM. The JPM is now satisfactory.
Maintaining Generator Hydrogen Pressure SF 4 G2.1.30 2
X E
- 1. The standard for all steps that require an action, need to have that action stated in the step standard. Include the direction of rotating the operator, etc. This should be the case for all steps in all JPMs that require action.
- 2. Step 2 is listed as a critical step, but the standard states that the valve is verified open.
- 3. The procedure for step 3 does not say very.
11/6/2020- Licensee addressed concerns listed above, see final approved JPM. The JPM is now satisfactory.
Racking In E6 Cross-Tie SF 6 295003 AA1.01 2
X E
- 1. Need to state what electrical safety equipment is required.
- 2. Step nomenclatures do not match what is in the procedure.
- 3. Step 3 cannot be a critical step if the component is already in its required position.
- 4. Should use prompts for the shutter window, springs charged, etc.
11/6/2020- Licensee addressed concerns listed above, see final approved JPM. The JPM is now satisfactory.
Restoring Service Air Header After Service Air Header Has Isolated SF 8 295019 AA1.04 2
X U
- 1. Step 4 cannot be a critical step if the switch is already in its required position.
- 2. This does not meet the intent of an alternate path JPM and does not provide any discriminatory value on the alternate path portion.
11/6/2020- Licensee addressed concerns listed above, see final approved JPM. The JPM is now satisfactory.
All JPMs will be further reviewed during on-site validation week.
11/7/2020- All JPMs were validated using licensed operators during on-site validation week. All comments listed above were addressed by the licensee and all JPMs are now Satisfactory. See final approved JPMs.
ES-301 7
Form ES-301-7 Instructions for Completing This Table:
Check or mark any item(s) requiring a comment and explain the issue in the space provided using the guide below.
- 1.
Check each JPM for appropriate administrative topic requirements (COO, EC, Rad, and EP) or safety function requirements and corresponding K/A. Mark in column 1.
(ES-301, D.3 and D.4)
- 2.
Determine the level of difficulty (LOD) using an established 1-5 rating scale. Levels 1 and 5 represent an inappropriate (low or high) discriminatory level for the license that is being tested. Mark in column 2 (Appendix D, C.1.f)
- 3.
In column 3, Attributes, check the appropriate box when an attribute is not met:
The initial conditions and/or initiating cue is clear to ensure the operator understands the task and how to begin. (Appendix C, B.4)
The JPM contains appropriate cues that clearly indicate when they should be provided to the examinee. Cues are objective and not leading. (Appendix C, D.1)
All critical steps (elements) are properly identified.
The scope of the task is not too narrow (N) or too broad (B).
Excessive overlap does not occur with other parts of the operating test or written examination. (ES-301, D.1.a, and ES-301, D.2.a)
The task performance standard clearly describes the expected outcome (i.e., end state). Each performance step identifies a standard for successful completion of the step.
A valid marked up key was provided (e.g., graph interpretation, initialed steps for handouts).
- 4.
For column 4, Job Content, check the appropriate box if the job content flaw does not meet the following elements:
Topics are linked to the job content (e.g., not a disguised task, task required in real job).
The JPM has meaningful performance requirements that will provide a legitimate basis for evaluating the applicant's understanding and ability to safely operate the plant. (ES-301, D.2.c)
- 5.
Based on the reviewers judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)nhancement, or (S)atisfactory? Mark the answer in column 5.
- 6.
In column 6, provide a brief description of any (U)nacceptable or (E)nhancement rating from column 5.
Save initial review comments and detail subsequent comment resolution so that each exam-bound JPM is marked by a (S)atisfactory resolution on this form.
ES-301 8
Form ES-301-7 Facility: Brunswick Scenario: 1 Exam Date: 12/07/2020 Event Realism/Cred.
Required Actions Verifiable actions LOD TS CTs Scen.
Overlap U/E/S Explanation Swap Condensate Booster Pumps E
- 1. Page number for Section 6.3.6 on page 15 is incorrect.
Gland Seal Regulator Failure E
- 1. Page numbers for APP and 2OP-26.1 on page 22 are incorrect.
- 2. Page number on page 22 for brief enclosure is incorrect.
Raise Power using control rods X
E
Difficult to Move Rod E
- 1. Page number for Section 6.3.2 on page 26.is also incorrect.
- 2. Page number on page 26 for brief enclosure is incorrect.
IRM Failure X
E
- 1. The IRM failure is listed as a component failure. It should be an instrument failure.
- 2. Page number on page 54 for brief enclosure is incorrect.
CSW Pump Trip, Standby Fails to Auto Start X
X E
- 1. Page number on page 48 for brief enclosure is incorrect.
X E
- 1. The actions needed to manually tie DG3 to E3 and/or DG4 to E4 needs to be listed in the guide.
- 2. Need to discuss and, if possible, identify objective bounding criteria for Critical Task #1. What if the crew does not tie a DG to E3 or E4 and does not enter the SBO procedure? Possibly meeting the entry criteria or emergency plan EAL criteria. Is there a time critical action?
- 3. Page number on page 54 for brief enclosure is incorrect.
LOCA HPCI Aux Oil Pump Failure All LP ECCS Fails to Auto start Restore RPV water level X
X E
- 1. Need objective criteria and exact components required to be operated listed in the guide for Critical Task #2 (LL4 setpoint, ED criteria, which pumps to start, etc.).
- 2. All page numbers for enclosures are incorrect on page 73.
Scenario will be further evaluated during on site validation week.
11/6/2020- Scenario was validated during on-site validation week. Licensee addressed comments listed above. See final approved scenarios.
ES-301 9
Form ES-301-7 Facility: Brunswick Scenario: 2 Exam Date: 12/07/2020 1
2 3
4 5
6 7
8 9
10 Event Realism/Cred.
Required Actions Verifiable actions LOD TS CTs Scen.
Overlap U/E/S Explanation Place SJAE in Full Load E
- 1. Page number on page 13 for brief enclosure is incorrect.
Accumulator Alarm (low pressure)
X E
- 1. Page number on page 21 for brief enclosure is incorrect.
Raise power X
E
- 1. Page number on page 26 for brief enclosure is incorrect.
CRD Pump Trip due to high filter d/P X
E
- 1. Page number on page 33 for brief enclosure is incorrect.
Off Gas Filter d/P E
- 1. Page number on page 41 for brief enclosure is incorrect.
HPCI Logic Bus A Failure X
X E
- 1. Page number on page 26 for brief enclosure is incorrect.
Intake Blockage E
- 1. Page number on page 26 for brief enclosure is incorrect.
ATWS SLC Pump Trip ARI Reset Failure XXX X
E
- 1. All enclosure page numbers are incorrect for this event.
- 2. Need objective bounding criteria for Critical Tasks 1, 2, and 3 listed in the guide.
Scenario will be further evaluated during on site validation week.
11/6/2020- Scenario was validated during on-site validation week. Licensee addressed comments listed above. See final approved scenarios.
ES-301 10 Form ES-301-7 Facility: Brunswick Scenario: 3 Exam Date: 12/07/2020 1
2 3
4 5
6 7
8 9
10 Event Realism/Cred.
Required Actions Verifiable actions LOD TS CTs Scen.
Overlap U/E/S Explanation Perform 0PT-40.2.11, Main Generator Voltage Regulator Manual And Automatic Operational Check S
Failure of DWED pump to run S
Recirc Loop B Flow transmitter failure X
E
- 1. This is listed as a component failure. Should be listed as an instrument failure.
NSW Pump Trip, Standby Fails to Auto Start AOP-X X
S Condenser Tube leak Isolate condenser waterbox S
Lower power due to tube leak X
S
- HPCI Unisolable Steam Leak
- RHR Room Cooler Trip X
E
- 1. Need objective bounding criteria for Critical Task #1.
- 2. Specific details need to be added to guide for Critical Task #2 concerning the time critical action. When is start time? What is the time?
Emergency Depressurization
- 2 ADS Valves Fail to Open X
E
- 1. Need objective bounding criteria for Critical Task #3.
Scenario will be further evaluated during on site validation week.
11/6/2020- Scenario was validated during on-site validation week. Licensee addressed comments listed above. See final approved scenarios.
ES-301 11 Form ES-301-7 Facility: Brunswick Scenario: 4 Exam Date: 12/07/2020 1
2 3
4 5
6 7
8 9
10 Event Realism/Cred.
Required Actions Verifiable actions LOD TS CTs Scen.
Overlap U/E/S Explanation Swap OD Lube Water Pumps S
S 2B RBCCW Pump Trip /
2C Failure to Auto Start S
RWCU High Temperature /
Failure to Auto Isolate X
S HDD Level Controller failure (low level)
X X
E
- 1. Need more specifics (reactor trip setpoint) for Critical Task #1 in the guide.
Lower power using Recirc Flow X
S LOCA in Drywell Auto Scram Failure RHR A Loop Spray Valve O/C Trip RHR B Loop Spray Valve Logic Failure Anticipate/ED (DW Temp approaching 300°F)
X X
E
- 1. Need bounding criteria for Critical Task #2 in the guide (355 degrees F?).
Scenario will be further evaluated during on site validation week.
11/6/2020- Scenario was validated during on-site validation week. Licensee addressed comments listed above. See final approved scenario.
ES-301 12 Form ES-301-7 Instructions for Completing This Table:
Use this table for each scenario for evaluation.
2 Check this box if the events are not related (e.g., seismic event followed by a pipe rupture) OR if the events do not obey the laws of physics and thermodynamics.
3, 4 In columns 3 and 4, check the box if there is no verifiable or required action, as applicable. Examples of required actions are as follows: (ES-301, D.5f) opening, closing, and throttling valves starting and stopping equipment raising and lowering level, flow, and pressure making decisions and giving directions acknowledging or verifying key alarms and automatic actions (Uncomplicated events that require no operator action beyond this should not be included on the operating test unless they are necessary to set the stage for subsequent events. (Appendix D, B.3).)
5 Check this box if the level of difficulty is not appropriate.
6 Check this box if the event has a TS.
7 Check this box if the event has a critical task (CT). If the same CT covers more than one event, check the event where the CT started only.
8 Check this box if the event overlaps with another event on any of the last two NRC examinations. (Appendix D, C.1.f) 9 Based on the reviewers judgment, is the event as written (U)nacceptable (requiring repair or replacement), in need of (E)nhancement, or (S)atisfactory? Mark the answer in column 9.
10 Record any explanations of the events here.
In the shaded boxes, sum the number of check marks in each column.
In column 1, sum the number of events.
In columns 2-4, record the total number of check marks for each column.
In column 5, based on the reviewer's judgement, place a checkmark only if the scenario's LOD is not appropriate.
In column 6, TS are required to be 2 for each scenario. (ES-301, D.5.d)
In column 7, preidentified CTs should be 2 for each scenario. (Appendix D; ES-301, D.5.d; ES-301-4)
In column 8, record the number of events not used on the two previous NRC initial licensing exams. A scenario is considered unsatisfactory if there is < 2 new events. (ES-301, D.5.b; Appendix D, C.1.f)
In column 9, record whether the scenario as written (U)nacceptable, in need of (E)nhancement, or (S)atisfactory from column 11 of the simulator scenario table.
ES-301 13 Form ES-301-7 Facility: Brunswick Exam Date: 11/07/2020 Scenario 1
2 3
4 5
6 7
8 11 Event Totals Events Unsat.
TS Total TS Unsat.
% Unsat.
Scenario Elements U/E/S Explanation 1
8 0
2 0
2 0
0 E
See scenario event comments.
2 8
0 2
0 3
0 0
E See scenario event comments.
3 8
0 2
0 3
0 0
E See scenario event comments.
4 7
0 2
0 2
0 0
E See scenario event comments.
Instructions for Completing This Table:
Check or mark any item(s) requiring comment and explain the issue in the space provided.
1, 3, 5 For each simulator scenario, enter the total number of events (column 1), TS entries/actions (column 3), and CTs (column 5).
This number should match the respective scenario from the event-based scenario tables (the sum from columns 1, 6, and 7, respectively).
2, 4, 6 For each simulator scenario, evaluate each event, TS, and CT as (S)atisfactory, (E)nhance, or (U)nsatisfactory based on the following criteria:
- a.
Events. Each event is described on a Form ES-D-2, including all switch manipulations, pertinent alarms, and verifiable actions. Event actions are balanced between at-the-controls and balance-of-plant applicants during the scenario. All event-related attributes on Form ES-301-4 are met. Enter the total number of unsatisfactory events in column 2.
- b.
TS. A scenario includes at least two TS entries/actions across at least two different events. TS entries and actions are detailed on Form ES-D-2. Enter the total number of unsatisfactory TS entries/actions in column 4. (ES-301, D.5d)
- c.
CT. Check that a scenario includes at least two preidentified CTs. This criterion is a target quantitative attribute, not an absolute minimum requirement. Check that each CT is explicitly bounded on Form ES-D-2 with measurable performance standards (see Appendix D). Enter the total number of unsatisfactory CTs in column 6.
7 In column 7, calculate the percentage of unsatisfactory scenario elements:
8 If the value in column 7 is > 20%, mark the scenario as (U)nsatisfactory in column 8. If column 7 is 20%, annotate with (E)nhancement or (S)atisfactory.
9 In column 9, explain each unsatisfactory event, TS, and CT. Editorial comments can also be added here.
Save initial review comments and detail subsequent comment resolution so that each exam-bound scenario is marked by a (S)atisfactory resolution on this form.
2 + 4 + 6 1 + 3 + 5100%
ES-301 14 Form ES-301-7 Site name: Brunswick Exam Date: 12/07/2020 OPERATING TEST TOTALS Total Total Unsat.
Total Total Unsat.
Explanation Edits Sat.
Admin.
JPMs 9
3 3
3 33 See explanation on individual JPMs.
Sim./In-Plant JPMs 11 2
8 1
18 See explanation on individual JPMs.
Scenarios 4
0 4
0 0
See explanation on individual Scenarios.
Op. Test Totals:
24 5
15 4
20 Instructions for Completing This Table:
Update data for this table from quality reviews and totals in the previous tables and then calculate the percentage of total items that are unsatisfactory and give an explanation in the space provided.
- 1.
Enter the total number of items submitted for the operating test in the Total column. For example, if nine administrative JPMs were submitted, enter 9 in the Total items column for administrative JPMs.
For scenarios, enter the total number of simulator scenarios.
- 2.
Enter the total number of (U)nsatisfactory JPMs and scenarios from the two JPMs column 5 and simulator scenarios column 8 in the previous tables. Provide an explanation in the space provided.
- 3.
Enter totals for (E)nhancements needed and (S)atisfactory JPMs and scenarios from the previous tables. This task is for tracking only.
- 4.
Total each column and enter the amounts in the Op. Test Totals row.
- 5.
Calculate the percentage of the operating test that is (U)nsatisfactory (Op. Test Total Unsat.)/(Op. Test Total) and place this value in the bolded % Unsat. cell.
Refer to ES-501, E.3.a, to rate the overall operating test as follows:
- satisfactory, if the Op. Test Total % Unsat. is 20%
- unsatisfactory, if Op. Test Total % Unsat. is > 20%
- 6.
Update this table and the tables above with post-exam changes if the as-administered operating test required content changes, including the following:
- The JPM performance standards were incorrect.
- The administrative JPM tasks/keys were incorrect.
- CTs were incorrect in the scenarios (not including post scenario critical tasks defined in Appendix D).
- The EOP strategy was incorrect in a scenario(s).
- TS entries/actions were determined to be incorrect in a scenario(s).
ES-401 1
Form ES-401-1 Facility: Brunswick Nuclear Plant Date of Exam: December 7, 2020 Tier Group RO K/A Category Points SRO-Only Points K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G*
Total A2 G*
Total
- 1.
Emergency and Abnormal Plant Evolutions 1
4 3
4 N/A 3
3 N/A 3
20 4
3 7
2 1
1 1
2 1
1 7
2 1
3 Tier Totals 5
4 5
5 4
4 27 6
4 10
- 2.
Plant Systems 1
2 3
3 3
3 1
2 2
3 2
2 26 3
2 5
2 1
1 1
1 1
2 1
1 1
1 1
12 0
2 1
3 Tier Totals 3
4 4
4 4
3 3
3 4
3 3
38 5
3 8
- 3. Generic Knowledge and Abilities Categories 1
2 3
4 10 1
2 3
4 7
2 3
3 2
2 2
2 1
Note: 1. Ensure that at least two topics from every applicable K/A category are sampled within each tier of the RO and SRO-only outline sections (i.e., except for one category in Tier 3 of the SRO-only section, the Tier Totals in each K/A category shall not be less than two). (One Tier 3 radiation control K/A is allowed if it is replaced by a K/A from another Tier 3 category.)
- 2. The point total for each group and tier in the proposed outline must match that specified in the table. The final point total for each group and tier may deviate by +/-1 from that specified in the table based on NRC revisions.
The final RO exam must total 75 points, and the SRO-only exam must total 25 points.
- 3. Systems/evolutions within each group are identified on the outline. Systems or evolutions that do not apply at the facility should be deleted with justification. Operationally important, site-specific systems/evolutions that are not included on the outline should be added. Refer to Section D.1.b of ES-401 for guidance regarding the elimination of inappropriate K/A statements.
- 4. Select topics from as many systems and evolutions as possible. Sample every system or evolution in the group before selecting a second topic for any system or evolution.
- 5. Absent a plant-specific priority, only those K/As having an importance rating (IR) of 2.5 or higher. Use the RO and SRO ratings for the RO and SRO-only portions, respectively.
- 6. Select SRO topics for Tiers 1 and 2 from the shaded systems and K/A categories.
- 7. The generic (G) K/As in Tiers 1 and 2 shall be selected from Section 2 of the K/A catalog, but the topics must be relevant to the applicable evolution or system. Refer to Section D.1.b of ES-401 for the applicable K/As.
- 8. On the following pages, enter the K/A numbers, a brief description of each topic, the topics IRs for the applicable license level, and the point totals (#) for each system and category. Enter the group and tier totals for each category in the table above. If fuel-handling equipment is sampled in a category other than Category A2 or G* on the SRO-only exam, enter it on the left side of Column A2 for Tier 2, Group 2. (Note 1 does not apply.) Use duplicate pages for RO and SRO-only exams.
- 9. For Tier 3, select topics from Section 2 of the K/A catalog, and enter the K/A numbers, descriptions, IRs, and point totals (#) on Form ES-401-3. Limit SRO selections to K/As that are linked to 10 CFR 55.43.
G* Generic K/As These systems/evolutions must be included as part of the sample (as applicable to the facility) when Revision 3 of the K/A catalog is used to develop the sample plan. They are not required to be included when using earlier revisions of the K/A catalog.
These systems/evolutions may be eliminated from the sample (as applicable to the facility) when Revision 3 of the K/A catalog is used to develop the sample plan.
ES-401 2
Form ES-401-1 ES-401 BWR Examination Outline Form ES-401-1 Emergency and Abnormal Plant EvolutionsTier 1/Group 1 (RO/SRO)
E/APE # / Name / Safety Function K1 K2 K3 A1 A2 G*
K/A Topic(s)
IR 295001 (APE 1) Partial or Complete Loss of Forced Core Flow Circulation / 1 & 4 X
AK1.03 Thermal limits 3.6 295003 (APE 3) Partial or Complete Loss of AC Power / 6 X
X G2.2.12 Knowledge of surveillance procedures.
G2.4.9 Knowledge of low power/shutdown implications in accident (e.g., loss of coolant accident or loss of residual heat removal) mitigation strategies.
3.7 4.2 295004 (APE 4) Partial or Total Loss of DC Power / 6 X
AK3.02 Ground isolation/fault determination 2.9 295005 (APE 5) Main Turbine Generator Trip /
3 X
X AA1.03 Reactor manual control/Rod control and information system AA2.02 Turbine vibration 2.7 2.7 295006 (APE 6) Scram / 1 X
G2.4.49 Ability to perform without reference to procedures those actions that require immediate operation of system components and controls.
4.6 295016 (APE 16) Control Room Abandonment
/ 7 X
AA1.07 Control room/local control transfer mechanisms 4.2 295018 (APE 18) Partial or Complete Loss of CCW / 8 X
X AA2.02 Cooling water temperature AA2.03 Cause for partial or complete loss 3.1 3.5 295019 (APE 19) Partial or Complete Loss of Instrument Air / 8 X
X AK3.03 Service air isolations: Plant-Specific AA2.02 Status of safety-related instrument air system loads (see AK2.1 - AK2.19) 3.2 3.7 295021 (APE 21) Loss of Shutdown Cooling /
4 X
AK3.02 Feeding and bleeding reactor vessel 3.3 295023 (APE 23) Refueling Accidents / 8 X
AA2.04 Occurrence of fuel handling accident 3.4 295024 High Drywell Pressure / 5 X
G2.4.1 Knowledge of EOP entry conditions and immediate action steps.
4.6 295025 (EPE 2) High Reactor Pressure / 3 X
EK2.11 Reactor water level 3.5 295026 (EPE 3) Suppression Pool High Water Temperature / 5 X
EK1.02 Steam condensation 3.5 295027 (EPE 4) High Containment Temperature (Mark III Containment Only) / 5 Not Applicable for BNP 295028 (EPE 5) High Drywell Temperature (Mark I and Mark II only) / 5 X
EK1.01 Reactor water level measurement 3.5 295030 (EPE 7) Low Suppression Pool Water Level / 5 X
X EK2.04 RHR/LPCI G2.1.23 Ability to perform specific system and integrated plant procedures during all modes of plant operation 3.7 4.4
ES-401 3
Form ES-401-1 295031 (EPE 8) Reactor Low Water Level / 2 X
X EK1.02 Natural circulation: Plant-Specific G2.2.44 Ability to interpret control room indications to verify the status and operation of a system, and understand how operator actions and directives affect plant and system conditions.
3.8 4.4 295037 (EPE 14) Scram Condition Present and Reactor Power Above APRM Downscale or Unknown / 1 X
EK3.01 Recirculation pump trip/runback:
Plant-Specific 4.1 295038 (EPE 15) High Offsite Radioactivity Release Rate / 9 X
EA2.02 Total number of curies released 2.5 600000 (APE 24) Plant Fire On Site / 8 X
AK2.04 Breakers / relays / and disconnects 2.5 700000 (APE 25) Generator Voltage and Electric Grid Disturbances / 6 X
X AA1.03 Voltage regulator controls AA2.09 Operational status of emergency diesel generators 3.8 4.3 K/A Category Totals:
4 3
4 3
3 4
3 3
Group Point Total:
20/7
ES-401 4
Form ES-401-1 ES-401 BWR Examination Outline Form ES-401-1 Emergency and Abnormal Plant EvolutionsTier 1/Group 2 (RO/SRO)
E/APE # / Name / Safety Function K1 K2 K3 A1 A2 G*
K/A Topic(s)
IR 295002 (APE 2) Loss of Main Condenser Vacuum / 3 X
G2.1.20 Ability to interpret and execute procedure steps.
4.6 295007 (APE 7) High Reactor Pressure / 3 X
AK2.05 Shutdown cooling: Plant-Specific 2.9 295008 (APE 8) High Reactor Water Level / 2 X
G2.4.4 Ability to recognize abnormal indications for system operating parameters that are entry-level conditions for emergency and abnormal operating procedures.
4.5 295009 (APE 9) Low Reactor Water Level / 2 295010 (APE 10) High Drywell Pressure / 5 X
AA1.01 Drywell ventilation/cooling 3.4 295011 (APE 11) High Containment Temperature (Mark III Containment only) / 5 Not Applicable for BNP 295012 (APE 12) High Drywell Temperature /
5 295013 (APE 13) High Suppression Pool Temperature. / 5 295014 (APE 14) Inadvertent Reactivity Addition / 1 295015 (APE 15) Incomplete Scram / 1 X
AA2.02 Control rod position 4.1 295017 (APE 17) Abnormal Offsite Release Rate / 9 295020 (APE 20) Inadvertent Containment Isolation / 5 & 7 295022 (APE 22) Loss of Control Rod Drive Pumps / 1 X
AA1.02 RPS 3.6 295029 (EPE 6) High Suppression Pool Water Level / 5 295032 (EPE 9) High Secondary Containment Area Temperature / 5 X
EK3.01 Emergency/normal depressurization 3.5 295033 (EPE 10) High Secondary Containment Area Radiation Levels / 9 X
EA2.03 Cause of high area radiation 4.2 295034 (EPE 11) Secondary Containment Ventilation High Radiation / 9 295035 (EPE 12) Secondary Containment High Differential Pressure / 5 X
EK1.01 Secondary containment integrity 3.9 295036 (EPE 13) Secondary Containment High Sump/Area Water Level / 5 X
EA2.01 Operability of components within the affected area 3.2 500000 (EPE 16) High Containment Hydrogen Concentration / 5 K/A Category Point Totals:
1 1
1 2
1 2
1 1
Group Point Total:
7/3
ES-401 5
Form ES-401-1 ES-401 BWR Examination Outline Form ES-401-1 Plant SystemsTier 2/Group 1 (RO/SRO)
System # / Name K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G*
K/A Topic(s)
IR 203000 (SF2, SF4 RHR/LPCI)
RHR/LPCI: Injection Mode X
K4.01 Automatic system initiation/ injection 4.2 205000 (SF4 SCS) Shutdown Cooling X
K2.02 Motor operated valves 2.5 206000 (SF2, SF4 HPCIS)
High-Pressure Coolant Injection X
X K2.04 Turbine control circuits: BWR-2,3,4 K3.01 Reactor water level control: BWR-2,3,4 2.5 4.0 207000 (SF4 IC) Isolation (Emergency) Condenser Not Applicable for BNP 209001 (SF2, SF4 LPCS)
Low-Pressure Core Spray X
K1.13 Leak detection 2.8 209002 (SF2, SF4 HPCS)
High-Pressure Core Spray Not Applicable for BNP 211000 (SF1 SLCS) Standby Liquid Control X
X A4.04 Reactor power G2.4.6 Knowledge of EOP mitigation strategies 4.5 4.7 212000 (SF7 RPS) Reactor Protection X
X A4.04 Bypass SCRAM instrument volume high level SCRAM signal K5.01 Fuel thermal time constant 3.9 2.7 215003 (SF7 IRM)
Intermediate-Range Monitor X
X K3.02 Reactor manual control K5.03 Changing detector position 3.6 3.0 215004 (SF7 SRMS) Source-Range Monitor X
K2.01 SRM channels/detectors 2.6 215005 (SF7 PRMS) Average Power Range Monitor/Local Power Range Monitor X
K5.06 Assignment of LPRM's to specific APRM channels 2.5 217000 (SF2, SF4 RCIC) Reactor Core Isolation Cooling X
A3.02 Turbine startup 3.6 218000 (SF3 ADS) Automatic Depressurization X
X K1.03 Nuclear boiler instrument system G2.4.18 Knowledge of the specific bases for EOPs.
3.7 4.0 223002 (SF5 PCIS) Primary Containment Isolation/Nuclear Steam Supply Shutoff X
X A3.01 System indicating lights and alarms K4.07 Physical separation of system components (to prevent localized environmental factors, electrical faults, and physical events from impairing system response) 3.4 2.8 239002 (SF3 SRV) Safety Relief Valves X
A1.07 Turbine load 2.9 259002 (SF2 RWLCS) Reactor Water Level Control X G2.1.27 Knowledge of system purpose and/or function.
3.9 261000 (SF9 SGTS) Standby Gas Treatment X
X A2.06 Valve closures A2.08 D.C. electrical failure 2.9 2.7 262001 (SF6 AC) AC Electrical Distribution X
K3.01 Major system loads 3.5 262002 (SF6 UPS) Uninterruptable Power Supply (AC/DC)
X G2.4.46 Ability to verify that the alarms are consistent with the plant conditions 4.2
ES-401 6
Form ES-401-1 263000 (SF6 DC) DC Electrical Distribution X
X A3.01 Meters, dials, recorders, alarms, and indicating lights K4.01 Manual/ automatic transfers of control:
Plant-Specific 3.2 3.1 264000 (SF6 EGE) Emergency Generators (Diesel/Jet) EDG X
X A2.04 Consequences of operating under/over excited A2.10 LOCA 2.9 4.2 300000 (SF8 IA) Instrument Air X
K6.04 Service air refusal valve 2.6 400000 (SF8 CCS) Component Cooling Water X
X A1.01 CCW flow rate A2.02 High/low surge tank level 2.8 3.0 510000 (SF4 SWS*) Service Water (Normal and Emergency)
Used Revision 2, Supplement 1 to generate this sample plan. See cover sheet.
K/A Category Point Totals:
2 3
3 3
3 1
2 2
3 3
2 2
2 Group Point Total:
26/5
ES-401 7
Form ES-401-1 ES-401 BWR Examination Outline Form ES-401-1 Plant SystemsTier 2/Group 2 (RO/SRO)
System # / Name K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G*
K/A Topic(s)
IR 201001 (SF1 CRDH) CRD Hydraulic X
A2.12 High cooling water flow 2.9 201002 (SF1 RMCS) Reactor Manual Control 201003 (SF1 CRDM) Control Rod and Drive Mechanism X
G2.2.25 Knowledge of the bases in Technical Specifications for limiting conditions for operations and safety limits.
4.2 201004 (SF7 RSCS) Rod Sequence Control 201005 (SF1, SF7 RCIS) Rod Control and Information 201006 (SF7 RWMS) Rod Worth Minimizer X
G2.2.39 Knowledge of less than or equal to one hour Technical Specification action statements for systems.
3.9 202001 (SF1, SF4 RS) Recirculation X
K1.11 Drywell equipment drain sump 2.7 202002 (SF1 RSCTL) Recirculation Flow Control 204000 (SF2 RWCU) Reactor Water Cleanup 214000 (SF7 RPIS) Rod Position Information X
K5.01 Reed switches 2.7 215001 (SF7 TIP) Traversing In-Core Probe X
K6.04 Primary containment isolation system: Mark-I&II(Not-BWR1) 3.1 215002 (SF7 RBMS) Rod Block Monitor 216000 (SF7 NBI) Nuclear Boiler Instrumentation X
K4.04 Inputs to the reactor protection system 3.7 219000 (SF5 RHR SPC) RHR/LPCI:
Torus/Suppression Pool Cooling Mode X
K6.02 D.C. electrical power 2.5 223001 (SF5 PCS) Primary Containment and Auxiliaries 226001 (SF5 RHR CSS) RHR/LPCI: Containment Spray Mode X
A4.15 Suppression chamber pressure:
Mark-I-II 3.6 230000 (SF5 RHR SPS) RHR/LPCI:
Torus/Suppression Pool Spray Mode X
K2.02 Pumps 2.8 233000 (SF9 FPCCU) Fuel Pool Cooling/Cleanup X
A2.03 Low surge tank level/high level 2.8 234000 (SF8 FH) Fuel-Handling Equipment 239001 (SF3, SF4 MRSS) Main and Reheat Steam X
A1.01 Main steam pressure 3.6 239003 (SF9 MSVLCS) Main Steam Isolation Valve Leakage Control 241000 (SF3 RTPRS) Reactor/Turbine Pressure Regulating 245000 (SF4 MTGEN) Main Turbine Generator/Auxiliary 256000 (SF2 CDS) Condensate X
K3.05 HPCI: Plant-Specific 3.3 259001 (SF2 FWS) Feedwater 268000 (SF9 RW) Radwaste 271000 (SF9 OG) Offgas X
A3.02 System flows 2.9 272000 (SF7, SF9 RMS) Radiation Monitoring 286000 (SF8 FPS) Fire Protection X
A2.07 Inadvertent system initiation 2.9 288000 (SF9 PVS) Plant Ventilation 290001 (SF5 SC) Secondary Containment 290003 (SF9 CRV) Control Room Ventilation 290002 (SF4 RVI) Reactor Vessel Internals 51001 (SF8 CWS*) Circulating Water Used Revision 2, Supplement 1 to generate this sample plan. See cover sheet.
ES-401 8
Form ES-401-1 K/A Category Point Totals:
1 1
1 1
1 2
1 1
2 1
1 1
1 Group Point Total:
12/3
ES-401 Generic Knowledge and Abilities Outline (Tier 3)
Form ES-401-3 Facility: Brunswick Nuclear Plant Date of Exam: December 7, 2020 Category K/A #
Topic RO SRO-only IR IR
- 1. Conduct of Operations 2.1.14 Knowledge of criteria or conditions that require plant-wide announcements, such as pump starts, reactor trips, mode changes, etc.
3.1 2.1.8 Ability to coordinate personnel activities outside the control room.
3.4 2.1.34 Knowledge of primary and secondary plant chemistry limits.
3.5 2.1.7 Ability to evaluate plant performance and make operational judgments based on operating characteristics, reactor behavior, and instrument interpretation.
4.7 2.1.
2.1.
Subtotal 2
2
- 2. Equipment Control 2.2.43 Knowledge of the process used to track inoperable alarms.
3.0 2.2.35 Ability to determine Technical Specification Mode of Operation.
3.6 2.2.12 Knowledge of surveillance procedures.
3.7 2.2.14 Knowledge of the process for controlling equipment configuration or status.
4.3 2.2.38 Knowledge of conditions and limitations in the facility license.
4.5 2.2.
Subtotal 3
2
- 3. Radiation Control 2.3.11 Ability to control radiation releases.
3.8 2.3.4 Knowledge of radiation exposure limits under normal or emergency conditions.
3.2 2.3.7 Ability to comply with radiation work permit requirements during normal or abnormal conditions.
3.5 2.3.13 Knowledge of radiological safety procedures pertaining to licensed operator duties, such as response to radiation monitor alarms, containment entry requirements, fuel handling responsibilities, access to locked high-radiation areas, aligning filters, etc.
3.8 2.3.6 Ability to approve release permits 3.8 2.3.
Subtotal 3
2
ES-401 Generic Knowledge and Abilities Outline (Tier 3)
Form ES-401-3
- 4. Emergency Procedures/Plan 2.4.11 Knowledge of abnormal condition procedures.
4.0 2.4.21 Knowledge of the parameters and logic used to assess the status of safety functions, such as reactivity control, core cooling and heat removal, reactor coolant system integrity, containment conditions, radioactivity release control, etc.
4.0 2.4.8 Knowledge of how abnormal operating procedures are used in conjunction with EOPs.
4.5 2.4.
2.4.
2.4.
Subtotal 2
1 Tier 3 Point Total 10 7
ES-401 Record of Rejected K/As Form ES-401-4 Tier /
Group Randomly Selected K/A Reason for Rejection T1G1 295024 G2.4.03 KA is an SRO task.
Chief Examiner selected G2.4.01 as replacement (3/26/20)
T1G2 295008 G2.4.01 KA does not have any EOP entry or Immediate Operator Actions.
Chief Examiner selected G2.4.04 as replacement (3/26/20)
DB DB DB DB DB DB DB DB DB DB DB Digitally signed by Daniel M. Bacon Date: 2020.11.16 15:08:33 -05'00' Digitally signed by Gerald J. McCoy Date: 2021.01.19 15:14:09 -05'00'
Brunswick 2020-301 Initial Operator License Exam ES-401 Written Examination Review Worksheet Form ES-401-9 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 1
H 2
X N
E S
K/A 201006 G2.2.39
- 1. Need an IAW statement in the question.
- 2. Need to add second licensed operator to choice D.
- 3. Need to better explain the distractor analysis for choice B. I am not familiar with the specifics of the previous failure during startup.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
2 F
2 N
S K/A 202001 K1.11 Question is Satisfactory.
3 H
3 B
S K/A 203000 K4.01 Question is Satisfactory.
4 F
3 B
S K/A 205000 K2.02 Used in 2007. Question is Satisfactory.
5 F
2 M
S K/A 206000 K2.04 Question is Satisfactory.
6 H
2 N
U S
K/A 206000 K3.01 Choices A(2) and C(2) are not plausible. Leaving this controller in automatic with a failed transmitter (downscale) is not plausible. Question is Unsatisfactory due to two non-plausible distractors.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
7 H
2 N
S K/A 209001 K1.13 Question is Satisfactory.
8 H
2 N
E S
K/A 211000 A4.04 The first part question does not really relate to the K/A.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
9 F
2 N
S K/A 212000 K5.01 Question is Satisfactory.
10 F
2 B
S K/A 21200 A4.04 Question is Satisfactory.
11 H
2 B
S K/A 214000 K5.01 Question is Satisfactory.
12 H
2 X
B E
S K/A 215001 K6.04
- 1. An s needs to be added to the word follow in the given conditions.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
13 H
2 B
S K/A 215003 K3.02 Question is Satisfactory.
14 H
2 N
S K/A 215003 K5.03 Question is Satisfactory.
15 F
2 B
S K/A 215004 K2.01 Used in 2017. Question is Satisfactory.
Brunswick 2020-301 Initial Operator License Exam Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 16 F
2 X
N U
S K/A Choices A(1) and B(1) are not plausible. Question is Unsatisfactory due to two non-plausible distractors.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
17 F
2 N
S K/A 216000 A4.04 Question is Satisfactory.
18 F
2 B
S K/A 217000 A3.02 Question is Satisfactory.
19 F
2 B
S K/A 218000 K1.03 Question is Satisfactory.
20 F
2 N
S K/A 219000 K6.02 Question is Satisfactory.
21 F
2 B
S K/A 223002 K4.07 Question is Satisfactory.
22 F
2 B
S K/A 223002 A3.01 Used in 2016. Question is Satisfactory.
23 F
2 X
N U
S K/A 226001 A4.15
- 1. Question is Unsatisfactory because there are potentially two correct answers. Choice B is potentially correct based on 5.20 of 0OI-37.8.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
24 F
2 M
S K/A 230000 K2.02 Question is Satisfactory.
25 H
2 X
N U
S K/A 233000 A2.03
- 1. Question is Unsatisfactory due to more than one non-plausible distractor. Choices A(1) and B(1) are not plausible for the issue that is occurring.
- 2. The explanation is missing the word tank.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
26 H
2 X
N S
K/A 239001 A1.01 Question is Satisfactory.
27 H
3 X
N U
S K/A 239002 A1.07
- 1. Question is Unsatisfactory due to more than one non-plausible distractor. Choices A(1) and B(1) are not plausible.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
28 H
2 X
B S
K/A 256000 K3.06 Question is Satisfactory.
29 H
2 X
N U
S K/A 259002 G2.1.27
- 1. Question is Unsatisfactory due to more than one non-plausible distractor. Choices A(2) and C(2) are not plausible. Reactor water level is always an input.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
30 H
3 N
S K/A 261000 A2.06 Question is Satisfactory.
31 H
3 B
S K/A 262001 K3.01 Question is Satisfactory.
Brunswick 2020-301 Initial Operator License Exam Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 32 H
2 X
B E
S K/A 262002 G2.4.46
- 1. Choice B is not plausible.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
33 F
2 N
S K/A 263000 K4.01 Question is Satisfactory.
34 H
2 N
E S
K/A 263000 A3.01
- 1. Distractor analysis does not make sense.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
35 H
2 X
M U
S K/A 264000A2.04
- 1. Question is Unsatisfactory due to more than one non-plausible distractor. Choices A(2) and C(2) are not plausible.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
36 F
2 X
N E
S K/A 271000 A3.02
- 1. The plausibility of A(2) and C(2) is questionable. Will change to satisfactory if you can provide an example of a valve at your plant with the same three positions on a switch that automatically opens regardless of switch position.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
37 F
1.5 X
B E
S K/A 295001 Question was submitted for preliminary review.
The title of TS 3.4.1 is actually Recirculation Loops Operating vice Reactor Coolant System (RCS). Believe it would be more operationally relevant to ask what the critical power ratio would do instead of just the critical power. For the second part question, ask specifically about MCPR instead of generically thermal limits in order to tie the two parts of the question together and make the question more discriminating while testing the same knowledge.
6/22/20- Licensee submitted changes to the question TS 3.4.1 name was corrected. One part of the question was changed to ask MCPR safety limits. Agree with those changes. I believe that a reactor power value should be added to the initial conditions. Wouldnt the answer to the first part question now be different depending on whether you are less than or greater than 23% RTP.
10/10/20-Licensee added reactor power to the initial conditions. The question is now Satisfactory.
38 H
2 N
S K/A 295003 G2.2.12 Question is Satisfactory.
39 H
1 2
X X
N U
E S
K/A 295004 Question was submitted for preliminary review. Reference provided.
Need to see a complete copy of AD-EG-ALL-1219 to fully evaluate this question.
06/22/20- Licensee submitted AD-EG-ALL-1219 for review.
Question is Unsatisfactory due to being LOD = 1 with references provided. The example on attachment 4 provides a direct cue for location of the ground. Also, the table for alert levels on page 8 of AD-EG-ALL-1219 is only an example and site-specific values for the Action Levels are calculated in accordance with the procedure. I believe it does match 0AI-115. We need to discuss this question.
10/10/20-Licensee modified the question and removed the reference to address the concerns listed above.
- 1. The words when required should be removed from choices B(2) and D(2) and placed in the second question statement.
- 2. The 2 in the second question statement is missing the parenthesis.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
Brunswick 2020-301 Initial Operator License Exam Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 40 H
F 1
2 X
X X
N N
U E
S K/A 295005 Question was submitted for preliminary review.
Second part question provides a cue to first part question. Second part question is not discriminating. Unsatisfactory due to LOD = 1. There are various ways you could ask a question about whether or not the reactor is shut down under all conditions and meet this K/A.
06/22/20-Licensee did not submit any changes to this question. They did suggest potentially changing power to less than 26%. We need to discuss this question.
10/10/20-Licensee replaced the question.
- 1. Explanation states that a turbine trip will cause a reactor trip when reactor power is >26%.
Choice C is exactly 26%. A case could be made that Choice D is the correct answer.
- 2. Need to make it clear in the given conditions that the main turbine trip was the cause of the reactor trip.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
41 H
2 X
N E
S K/A 295006 G2.4.49
- 1. This appears to be overlap with the operating test. Need to discuss testing the difference in the immediate actions between the Unit 1 and Unit 2 scram hard cards.
11/5/20-Licensee changed question to testing the differences between Unit 1 and 2. The question is now Satisfactory.
42 H
2 B
S K/A295007 AK2.05 Question is Satisfactory.
43 F
2 N
S K/A 295008 G2.4.4 Question is Satisfactory.
44 H
2 B
S K/A 295010 AA1.01 Question is Satisfactory.
45 H
2 X
N E
S K/A 295015 AA2.22
- 1. The number of rods in the given conditions and explanation do not match. The explanation also talks about another rod in addition to the one that is red. Please clarify explanation.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
46 H
2 M
E S
K/A 295016 AA1.07
- 1. The K/A match statement does not fully match the question.
- 2. The second part question may be over-testing 125VDC on this exam. Could test whether a key is or is not required or valve position versus switch position indication on RSDP.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
47 H
2 X
B E
S K/A 295018 AA2.02
- 1. The distractor analysis talks about pump motor overheating, but the answer choices talk about pump overheating.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
48 H
2 X
B E
S K/A 295019 AK3.03
- 1. Choice B is not plausible.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
49 H
3 X
X
?
N E
S K/A 295021 AK3.02
- 2. Is this procedure selection at the SRO level?
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
50 H
2 B
S K/A 295022 AA1.02 Question is Satisfactory.
Brunswick 2020-301 Initial Operator License Exam Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 51 H
2 B
S K/A 295023 AA2.04 Question is Satisfactory.
52 F
2 X
N U
S K/A 295024 G2.4.1
- 1. Question is Unsatisfactory due to more than one non-plausible distractor. Choices A and B are not plausible.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
53 H
2 B
S K/A 295025 EK2.11 Question is Satisfactory.
54 H
2 B
S K/A 295026 EK1.02 Question is Satisfactory.
55 H
1 B
U S
K/A 295028 EK1.01 Question is Unsatisfactory due to LOD = 1 with provided references.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
56 F
2 N
S K/A 295030 EK2.04 Question is Satisfactory.
57 H
2 X
N E
S K/A 295031 EK1.02
- 1. The level given in the initial conditions does not match the discussion given for the K/A match and explanation.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
58 F
2 X
B U
S K/A 295032 EK3.01
- 1. Potential for two or more correct answers. Look at paragraph that is directly after the only paragraph listed from 0OI-37.9. Also look at step description for the emergency depressurization.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
59 H
3 B
S K/A 295035 EK1.01 Question is Satisfactory. Used on 2001 NRC Exam.
60 F
2 N
S K/A 295037 EK3.01 Question is Satisfactory.
61 F
2 B
S K/A 295038 EA2.02 Question was submitted for preliminary review.
Question is Satisfactory.
62 F
2 N
S K/A 300000 K6.04 Question is Satisfactory.
63 H
2 N
S K/A 400000 A1.01 Question is Satisfactory.
64 F
2 N
E S
K/A 600000 AK2.04
- 1. Question statement needs a question mark at the end of the sentence.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
65 F
2 B
S K/A 700000 AA1.03 Question is Satisfactory. Used on 2012 NRC Exam.
66 F
2 N
S K/A G2.1.8 Question is Satisfactory.
67 F
2 X
N E
S K/A G2.1.14
- 1. All is too wide to be plausible.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
Brunswick 2020-301 Initial Operator License Exam Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 68 F
2 X
X N
U S
K/A G2.2.12 Question was submitted for preliminary review.
Question is Unsatisfactory due to not meeting the generic portion of the Tier 3 K/A. This seems to be a system specific question.
06/22/20- Licensee submitted new question that tests stroke timing methodology and actions to take. The new question is Unsatisfactory due to choices C(1) and D(1). They do not make sense when placed in the question statement.
10/10/20- Licensee corrected wording in the question stem. The question is now Satisfactory.
69 F
2 B
S K/A G2.2.35 Question is Satisfactory. Used on 2012 exam.
70 F
2 B
S K/A G2.2.43 Question is Satisfactory.
71 H
2 X
N U
S K/A G.2.3.4
- 1. Question is Unsatisfactory due to more than one non plausible distractor. Choices C(1) and D(1) are not credible distractors.
11/5/20- Licensee submitted new question. The new question is Satisfactory.
72 F
2 X
B S
K/A G2.3.7 Question is Satisfactory.
73 F
2 X
N B
U S
K/A G2.3.11
- 1. Question is Unsatisfactory due to not meeting the Tier 3 portion of the K/A. This question tests all systems knowledge.
11/5/20- Licensee submitted bank question used on 2012 NRC exam. The question is Satisfactory.
74 F
2 N
S K/A G2.4.11 Question is Satisfactory.
75 H
2 M
E S
K/A G2.4.2.
The second part question is more of a systems question. Recommend giving the indications of four or more parameters listed in Attachment 5 of AD-OP-ALL-1001 and asking which EOP procedure(s) is/are required to be entered. This is basically two non-related questions.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
76 H
2 N
S K/A 201001 A2.12 Question is Satisfactory.
77 F
2 X
M E
S K/A 201003 Question was submitted for preliminary review. Reference provided.
The intent of the first part question is not discriminating, it is just comparing numbers on a table that is given. The first part question is also not specific enough or operationally relevant in the way that it is asked. TS 3.14 looks for no more than 10 slow rods with no more than two slow rods in adjacent locations. Not sure by reading the bases that LHGR is not also correct. Need to discuss.
06/22/20- Licensee changed second part question to address concerns about LHGR. Still need to discuss first part question.
10/10/20-Licensee modified first part question to address concerns. The question is now Satisfactory.
78 H
2 N
E S
K/A 211000 G2.4.6
- 1. Much of the distractor analysis makes absolutely no sense with regard to the question and answer choices.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
Brunswick 2020-301 Initial Operator License Exam Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 79 H
2 X
N S
K/A 218000 G2.4.18 Question is Satisfactory.
80 H
2 N
S K/A 261000 A2.08 Question is Satisfactory.
81 H
2 X
B S
K/A 264000 A2.10
- 1. Question was used in 2017. Question is Satisfactory.
82 F
3 N
S K/A 286000 Question was submitted for preliminary review.
Please explain why this is listed as a High Cognitive level question.
06/22/20- Licensee changed Cog Level to Fundamental. Question is now Satisfactory.
83 H
2 N
S K/A 295003 G2.1.20 Question is Satisfactory.
84 H
2 N
S K/A 295003 G2.4.9 Question is Satisfactory.
85 H
2 N
S K/A 295005 Question was submitted for preliminary review.
Formatting problems with bearing vibrations in current conditions need to be corrected.
06/22/20- Licensee did not see formatting problems in their version of the document. The new version that was submitted did not have the formatting problems described above.
The question is now Satisfactory.
86 H
2 M
S K/A 295018 AA2.03 Question is Satisfactory.
87 H
2 B
S K/A 295019 AA2.02 Question is Satisfactory.
88 H
2 M
E S
K/A 295030 G2.1.23
- 1. K/A number for Low Suppression Pool Water Level is incorrect.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
89 H
2 X
X N
E S
K/A 295031 G2.2.44
- 1. Do not believe shall/shall not works well to make distractor plausible. Need to discuss.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
90 H
2 B
S K/A 295033 EA2.03 Question is Satisfactory.
91 H
2 N
S K/A 295036 EA2.01 Question is Satisfactory.
92 H
2 N
S K/A 400000 A2.02 Question is Satisfactory.
Brunswick 2020-301 Initial Operator License Exam Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 93 H
1 2
X N
E S
K/A 700000 Question was submitted for preliminary review. Reference provided.
Question is Unsatisfactory due to LOD = 1 with reference provided and the correct answer can be obtained using RO knowledge. ROs are responsible for < or = one-hour TS. The correct answer is an immediate TS.
06/22/20- Licensee modified the question to test by what time the unit is required to be in Mode 3. Do not believe the use of the term latest is appropriate in the stem of the question.
Need to discuss. Question now requires minor enhancement.
10/10/20- Licensee reworded question stem to correct the issue described above. The question is now Satisfactory.
94 H
2 B
S K/A G2.1.7
- 1. Used on 2010 NRC exam. Question is Satisfactory.
95 H
1 B
N U
S K/A G2.1.34
- 1. Question is Unsatisfactory due to LOD = 1. All information required to answer the question can be looked up directly from Attachment 3.
11/5/20- Licensee submitted a new question. The new question is Satisfactory.
96 F
2 B
S K/A G2.2.14 Question is Satisfactory.
97 F
2 X
B E
S K/A G2.2.38
- 1. Choice B eliminated with RO knowledge and not plausible.
11/5/20- License changed distractor B. The question is now Satisfactory.
98 H
2 X
B S
K/A G2.3.6
- 1. Used on 2012 NRC exam. Question is Satisfactory.
99 H
F 2
2 X
B N
U S
K/A G2.3.13 Question was submitted for preliminary review.
Question is Unsatisfactory due to not being SRO-Only. It seems that the question could be answered with RO systems knowledge and knowledge of procedure caution statements.
06/22/20-Licensee changed first part question to test procedure selection. With the procedure section names, this could still be answered solely with RO level knowledge.
10/10/20- Licensee submitted new question. The question is Satisfactory.
100 H
2 X
N E
S K/A G2.4.8
- 1. Need in accordance with: statement.
11/6/2020 - Licensee addressed comments listed above. The question is now Satisfactory.
See final approved exam.
Brunswick 2020-301 Initial Operator License Exam Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2.
Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
- 3.
Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated true/false statements.
The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4.
Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
- 5.
Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
- 6.
Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7.
Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8.
At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).