Text

(7) Robinson 2016-301 Final Administrative Documents
	ML16124B059
Person / Time
Site:	Robinson
Issue date:	04/27/2016
From:	; Division of Reactor Safety II
To:	; Duke Energy Progress
References
	50-261/OL-16-301
	Download: ML16124B059 (65)
	v • d • e

ES-301 Administrative Topics Outline Form ES-301-1 (Rev_011016) NUREG-1021, Revision 10 Facility:

HB Robinson Date of Examination:

2/2016 Examination Level

RO Operating Test Number:

N16-1 Administrative Topic (see Note) Type Code*

Describe activity to be performed Conduct of Operations D, R 2.1.7 (4.4) Ability to evaluate plant performance and make operational judgments based on operating characteristics, reactor behavior, and instrument interpretation.

JPM: Calculate QPTR Conduct of Operations N, R 2.1.4 (3.3)

Knowledge of individual licensed operator responsibilities related to shift staffing, such as medical requirements, "no

-solo" operation, maintenance of active license status, 10CFR55, etc.

JPM: Determine License Status Equipment Control D, P, R 2.2.41 (3.5) Ability to obtain and interpret station electrical and mechanical drawings.

JPM: Determine Proper Equipment Boundaries Radiation Control N, R 2.3.7 (3.5) Ability to comply with radiation work permit requirements during normal or abnormal conditions.

JPM: Evaluate Stay Time with Lowered SFP Level NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when 5 are required.

Type Codes & Criteria:

(C)ontrol room, (0) (S)imulator, (0) or Class(R)oom (4) (D)irect from bank ( 3 for ROs; 4 for SROs & RO retakes)

(2) (N)ew or (M)odified from bank (

> 1) (2) (P)revious 2 exams ( 1; randomly selected)

(1)

ES-301 Administrative Topics Outline Form ES-301-1 (Rev_011016) NUREG-1021, Revision 10 RO Admin JPM Summary A1a This is a modified Bank JPM. The operator will be told that the plant is operating at 60% power and that ERFIS is OOS. The operator will be provided with Power Range Excore Nuclear Instrumentation indicated and normalizing detector currents, and directed to manually calculate Quadrant Power Tilt Ratio, and identify whether or not any limitations have been exceeded

. The operator will be expected to calculate QPTR in accordance with FMP-007, Quadrant Power Tilt, and identify that Technical Specification LCO 3.2.4, Quadrant Power Tilt Ratio (QPTR), is NOT met

. A1b This is a new JPM. The operator will be told that they are a Licensed Reactor Operator who was assigned to the day shift staff for a special project, and not routinely standing watch in the Control Room.

They will be provided with a work history and various qualification dates, and then directed to identify any requirements that must be met prior to the end of the quarter that are required to maintain their license ACTIVE; and any additional requirements that are required to maintain their qualification to stand watch in the Control Room. The operator will be expected to evaluate their work history and identify that four 12

-hour shifts must be completed as either the RO or the BOP prior to the end of the quarter to maintain their license ACTIVE, and that an SCBA quantitative and qualitative fit test must be completed prior to standing watch in the Control Room again. A2 This is a Bank JPM. The operator will be told that the plant is in Mode 1 at 100%, Charging Pump "A" suction relief valve CVC

-2080 has failed open, and that the operating crew has entered AOP

-016, Excessive Primary Plant Leakage, to control the plant. The operator will be provided with the EDPs, and the P&IDs, and directed to use all available resources to identify the pump boundary valves needed to be closed to isolate the leak, and identify the motor breaker to electrically isolate the pump motor

. The operator will be expected to identify that the leak can be isolated by closing three valves; CVC

-270, CVC-290 and CVC

-291, and that the pump motor can be electrically isolated by opening Breaker 52/34B

. This JPM was previously used on the 201 4 NRC Exam, randomly selected for use on the 2016 Exam.

A3 This is a new JPM. The operator will be told that a station wide accident has occurred due to an Earthquake, that the plant is in Mode 6 with a full core off

-load, that the Spent Fuel Pool level has lowered to 10 feet above the top of the fuel, and has stabilized at this level, and that the crew is implementing AOP

-036 (SFP Events). The operator will be provided with an R

-5 reading, a dose limit of 25 mrem, and the assignment of a repetitive task within AOP

-036 which will require entry into the Spent Fuel Building for 3 minutes, before exiting; and will be directed to estimate how many times the operator can perform this repetitive task before they must be replaced by another operator. The operator will be expected to determine that the dose rate around the Spent Fuel Pool area is 193 mrem/hour and based on this the operator will determine that the repetitive task can be performed 2 times before another operator will need to perform the task

.

ES-301 Administrative Topics Outline Form ES-301-1 (Rev_011016) NUREG-1021, Revision 10 Facility:

H B Robinson Date of Examination:

2/2016 Examination Level

SRO Operating Test Number:

N16-1 Administrative Topic (see Note) Type Code* Describe activity to be performed Conduct of Operations D, R 2.1.7 (4.7)

Ability to evaluate plant performance and make operational judgments based on operating characteristics, reactor behavior, and instrument interpretation.

JPM: Calculate QPTR Conduct of Operations N, R 2.1.4 (3.8)

Knowledge of individual licensed operator responsibilities related to shift staffing, such as medical requirements, "no

-solo" operation, maintenance of active license status, 10CFR55, etc.

JPM: Determine License Status Equipment Control D, R 2.2.38 (4.5) Knowledge of conditions and limitations in the facility license. JPM: Determine if Mode Change is Permissible Radiation Control N, R 2.3.8 (3.7) Ability to approve release permits.

JPM: Approve a Waste Gas Release Permit Emergency Plan D, R 2.4.41 (4.4) Knowledge of the emergency action level thresholds and classifications.

JPM: Emergency Classification NOTE: All items (5 total

) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when 5 are required.

Type Codes & Criteria:

(C)ontrol room

, (0) (S)imulator

, (0) or Class(R)oom (5) (D)irect from bank ( 3 for ROs; 4 for SROs & RO retakes)

(3) (N)ew or (M)odified from bank (

> 1) (2) (P)revious 2 exams ( 1; randomly selected)

(0)

ES-301 Administrative Topics Outline Form ES-301-1 (Rev_011016) NUREG-1021, Revision 10 SRO Admin JPM Summary A1a This is a modified Bank JPM. The operator will be told that the plant is operating at 100% power and that ERFIS is OOS. The operator will be provided with Power Range Excore Nuclear Instrumentation indicated and normalized detector currents, and directed to calculate Quadrant Power Tilt Ratio, identify whether or not any limitations have been exceeded, and if so, what, if any ACTION, is required. The operator will be expected to calculate QPTR in accordance with FMP

-007, Quadrant Power Tilt, identify that Technical Specification LCO 3.2.4, Quadrant Power Tilt Ratio (QPTR), is NOT met, and identify that all six ACTIONs (A.1

-A.6) must be taken for Condition A of LCO 3.2.4

, including the maximum permitted power level of 91.3%

.

A1b This is a new JPM. The operator will be told that they are a Licensed Senior Reactor Operator who was assigned to the day shift staff for a special project, and not routinely standing watch in the Control Room. They will be provided with a work history and various qualification dates, and then directed to identify any requirements that must be met prior to the end of the quarter that are required to maintain their license ACTIVE; and any additional requirements that are required to maintain their qualification to stand watch in the Control Room. The operator will be expected to evaluate their work history and identify that four 12-hour shifts must be completed as either the SM, CRS, RO or the BOP prior to the end of the quarter to maintain their license ACTIVE, and that an SCBA quantitative and qualitative fit test must be completed prior to standing watch in the Control Room aga in. A2 This is a Bank JPM. The operator will be told that the plant is in Mode 5, returning from a refueling outage, that the RCS temperature is 165°F and there is a bubble in the PZR, and that RHR Loop "A" is maintaining RCS temperature. The operator will be provided with an Inoperable Equipment List and directed to complete the attached OMM

-001-12, MINIMUM EQUIPMENT LIST AND SHIFT RELIEF, Attachment 2, 200°F to 350°F (MODE 4) MEL, that was started on the previous shift and to determine if any Mode 4 restrictions exists. The operator will be expected to complete Attachment 2 and determine that the Mode change cannot occur with current plant conditions, per the attached KEY

. A3 This is a new JPM. The operator will be told that the plant is in Mode 1 at 100% power, and that a Waste Gas Release Permit for the "A" WGDT has been presented to the Shift Manager for review and approval. The operator will be provided with a WGDT Release Permit and directed to review and approve the Waste Gas Release Permit, or to identify all issues found which would prevent approval. The operator will be expected to review the WGDT Release Permit and identify that it cannot be approved because (1) it has been written for the wrong WGDT and (2) the R14C setpoint is less conservative than required. A4 This is a Bank JPM. The operator will be given an initial set of plant conditions. The operator will be directed to classify the event in accordance with the Robinson Nuclear Plant Emergency Action Level Matrix.

The operator will be expected to declare an ALERT based on HA4.1, Confirmed Security event in a plant Protected Area or notification o f either an airborne attack threat or hostile threat within the Owner Controlled Area, within 15 minutes. Then, the operator must prepare an Emergency ES-301 Administrative Topics Outline Form ES-301-1 (Rev_011016) NUREG-1021, Revision 10 Notification Form for this event in accordance with EPCLA-01 (Emergency Control), also within 15 minutes.

ES-301 Control Room/In

-Plant Systems Outline Form ES-301-2 (REV_011116) NUREG-1021, Revision 10 Facility:

H B Robinson Date of Examination:

2/2016 Exam Level (circle one):

RO (only) / SRO(I) / SRO (U) Operating Test No.:

N16-1 Control Room Systems

@ (8 for RO; 7 for SRO

-I; 2 or 3 for SRO

-U) System / JPM Title Type Code*

Safety Function A. 062 AC Electrical Distribution System

[062 A2.08 (3.6/3.4)

] Operation With High Switchyard Voltage S, P, D, A 6 B. 059 Main Feedwater System [059 A4.08 (3.2/2.9)

] Transfer From the FRV Bypass Valves to the FRVs S, M, A 4S C. 007 Pzr Relief Tank/Quench Tank System

[007 A1.01 (2.9

/3.1)] Restore PRT to Normal Operating Conditions S, D, A 5 D. 001 Control Rod Drive System [001 A1.06 (4.1/4.4)] Reactor Startup with Ejected Control Rod S, N, A, L 1 E. 011 Large Break LOCA [EPE 011 EA1.11 (4.2/4.2)

] Transfer to Long Term Recirculation S, D, A, EN 3 F. 006 Emergency Core Cooling System

[006 A4.02 (4.0/3.8)

] Fill a Safety Injection Accumulator S, P, D, EN 2 G. 015 Nuclear Instrumentation System

[015 A4.03 (3.8

/3.9)] Remove Source Range Channel N

-31 From Service S, D, L 7 H. 003 Reactor Coolant Pump System

[003 A4.03 (2.8/2.5)] Start a Reactor Coolant Pump S, D, L 4P In-Plant Systems

@ (3 for RO; 3 for SRO

-I; 3 or 2 for SRO-U) I. APE 055 Loss of Offsite and Onsite Power [EPE 055 EA2.01 (3.4/3.7)] Locally Establish AFW Flow from the SDAFW Pump and Control S/G Levels and Pressures D, P, E 6 J. 065 Loss of Instrument Air

[065 AA1.04 (3.5/3.4)] Respond to a Loss of Instrument Air D, R, E 8 K. APE 062 Loss of Service Water

[APE 062 AA2.01 (2.9/3.5)] Loss of North SW Header in the Auxiliary Building D, R, E 4S ES-301 Control Room/In

-Plant Systems Outline Form ES-301-2 (REV_011116) NUREG-1021, Revision 10 @ All RO and SRO

-I control room (and in

-plant) systems must be different and serve different safety functions; all 5 SRO

-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

Type Codes Criteria for RO / SRO

-I / SRO-U (A)lternate path 4-6 (5) /4-6 (5) / 2

-3 (3) (C)ontrol room (D)irect from bank 9 (9) / 8 (8) / 4 (4) (E)mergency or abnormal in

-plant 1 (3) / 1 (3) / 1 (2) (EN)gineered Safety Feature 1 (2) / 1 (2)/ 1 (2) (Control Room System)

(L)ow-Power / Shutdown 1 (3) / 1 (2) / 1 (1) (N)ew or (M)odified from bank including 1(A) 2 (2) / 2 (2) / 1 (1) (P)revious 2 exams 3 (3) / 3 (3)/ 2 (2) (Randomly Selected)

(R)CA 1 (2 )/ 1 (2) / 1 (1) (S)imulator JPM Summary JPM A This is a Bank JPM. The operator will be told that the plant is at 100% power, that due to abnormal conditions on the Grid, 480V Bus E

-2 currently has exceeded 505 volts, that AOP-031, Operation with High Switchyard Voltage, has been completed up to step 21, and other preliminary information

. The operator will be directed to continue with AOP

-031 until 480V Bus E

-2 voltage is restored to less than 505 Volts. The operator will be expected to transfer 4KV Bus 4 & 5 from the UAT to the SUT (via 4KV Bus 3) in an effort to lower Switchyard Voltage; and when Breaker 50/20 fails to automatically OPEN (Alternate Path

), the operator will manually open it per AOP

-31. This JPM was previously used on the 201 3 NRC Exam, randomly selected for use on the 2016 Exam.

JPM B This is a modified Bank JPM. The operator will be told that a plant startup is in progress with reactor power approximately 18%, that the "A" and "B" S/G levels are being controlled with the Feedwater Regulating Valves operating in AUTO, and that the "C" S/G level is being controlled on the Feedwater Regulating Bypass Valve

. The operator will be directed to transfer the "C" S/G level control to the Main Feedwater Regulating Valve in accordance with Step 6.4.12 of GP-005, Power Operation. The operator will be expected to place the "C" Feed Reg Valve in AUTO, and then take manual control of the "B" Feed Reg Valve and stabilize the "B" S/G level (Alternate Path

) when it is determined that the "B" Feed Reg Valve has failed to control the "B" S/G level in AUTO

. JPM C This is a Bank JPM The operator will be told that the plant is at 100% power, that APP-003-D3, PRT HI/LO LEVEL, has alarmed, that the cause of the low level is known leakage from the PRT to the RCDT, and that the PRT level is stable at 67%

. The operator will be directed to restore PRT level to normal IAW OP-103, Pressurizer Relief Tank Control System. The operator will be expected to refill the PRT in accordance with Section 8.2.2 of OP-103; and then diagnose and relieve the hydraulic lock on RC

-519B (Alternate Path) in accordance with Section 8.4.1 of OP

-103. JPM D This is a New JPM. The operator will be told that the plant is stabilized at 2% power, that the RCS is at normal operating temperature and pressure, and that a plant startup is in progress IAW GP

-003, Normal Plant Startup From Hot Shutdown to Critical, and complete through Step 8.4.7

. They will also be told that they are the OATC, and that the ES-301 Control Room/In

-Plant Systems Outline Form ES-301-2 (REV_011116) NUREG-1021, Revision 10 BOP is temporarily outside the Control Room. The operator will be directed to pull control rods to stabilize reactor power between 3

-5% by continuing with Step 8.4.8 of GP

-003. The operator will start to raise reactor power to 3

-5%. Then, the operator will manually trip the reactor, attempt to manually actuate Safety Injection and manually start SI Pumps in response to an ejected rod (Alternate Path

). JPM E This is a Bank JPM. The operator will be told that a large break LOCA has occurred, and that the plant is currently on Cold Leg Recirculation IAW EOP

-ES-1.3, Transfer to Cold Leg Recirculation

. The operator will be directed to transfer to Long Term Recirculation IAW EOP

-ES-1.4, Transfer to Long Term Recirculation. The operator will be expected to align for Long Term Recirculation per EOP

-ES-1.4, and align only the B RHR Pump for operation when it is determined that SI

-863A has failed to OPEN (Alternate Path

). JPM F This is a Bank JPM. The operator will be told that the plant is at 100% power, that the SI ACCUM C HI/LO LVL (APP

-002-E4) alarm has been received and actions have been reviewed by the RO, that OP-202, Section 5.2.1.1 Initial Conditions have been completed, and other preliminary information

. The operator will be directed to fill SI Accumulator "C" to reset the low level alarm IAW OP

-202, Section 5.2.1. The operator will be expected to refill SI Accumulator "C" to reset the low level alarm without exceeding specified limits

. This was previously used on the 2013 NRC Exam, randomly selected for use on the 2016 Exam.

JPM G This is a Bank JPM. The operator will be told that the plant is shutdown 36 h ours after a trip from 100% power, and that SR Channel N

-31 has just failed low. The operator will be directed to remove SR Channel N

-31 from service IAW OWP

-011, Nuclear Instrumentation. The operator will be expected to remove SR Channel N

-31 from service IAW NI-5 of OWP-011. JPM H This is a Bank JPM. The operator will be told that the plant is shutdown at normal operating temperature and pressure, that the "B" RCP was stopped 7 hours8.101852e-5 days 0.00194 hours 1.157407e-5 weeks 2.6635e-6 months earlier for motor inspection, that Section 8.1 of OP

-101, Reactor Coolant System and Reactor Coolant Pump Startup and Operation, has been completed through Step 8.1.1.2.y in preparation for starting the Reactor Coolant Pump, and that it is intended to bypass the Degraded Grid Protection prior to the RCP start and return it to service after the RCP is started per OP

-101, and an AO is standing by to assist in this process. The operator will be directed to start the B Reactor Coolant Pump by continuing with Step 8.1.1.2.z of OP

-101. The operator will be expected to start the B RCP IAW OP

-101. JPM I This is a Bank JPM. The operator will be told that the Plant has experienced a loss of onsite and offsite power, that EOP

-ECA-0.0, Loss of All AC Power, has been implemented, that Wide Range levels in all three SGs are 55%, that Steam Generator pressures are 1075 psig, and that the SDAFW Pump has just been started. The operator will be directed to locally perform Attachment 4, Local Control Of S/G Level And Pressure, of EOP-ECA-0.0. The operator will be expected to control AFW flow to the Steam Generators and align the Nitrogen System to the SG PORVs IAW Attachment 4 of EOP-ECA-0.0. This was previously used on the 201 4 NRC Exam, randomly selected for use on the 2016 Exam.

JPM J This is a Bank JPM. The operator will be told that the IA Header Pressure is 75 PSIG and lowering, that AOP-017, Loss Of Instrument Air, has been entered, that the Station ES-301 Control Room/In

-Plant Systems Outline Form ES-301-2 (REV_011116) NUREG-1021, Revision 10 Air Compressor is under clearance and disassembled, and that the Station Air Receiver is depressurized and vented.

The operator will be directed to perform AOP

-017 Step 8

. The operator will be expected to start IA Compressors "A" and "B" and align their discharge to supply air to the Instrument Air Header in accordance with Step 8 of AOP

-017. JPM K This is a Bank JPM. The operator will be told that the plant is at 100% power, that the North SW header has ruptured inside the Auxiliary Building, and that the Control Room has implemented AOP

-022 (Loss of Service Water) for a leak in the North header.

The operator will be directed to perform the local subsequent actions IAW Attachment 6 of AOP-022. The operator will be expected to isolate the intact SW header from the ruptured header, isolate the leak, and align cooling water to critical loads IAW Attachment 6 of AP

-022.

ES-401 Record of Rejected K/A's Form ES-401-4 Tier / Group Randomly Selected KA Reason for Rejection RO 2/1 008 A4.03 Facility rarely throttles the CCW Pump discharge valves, and when this does occur (During Testing) indications of the action are in the field. Best effort was made to construct question, but it did NOT result in a psychometrically sound question (No Plausible Distractors)

. Replaced with 008 A4.01, randomly chosen by the Chief Examiner.

RO 1/1 057 AA2.06 The AC instrument busses at the facility have no associated alarms in the Control Room, NOR does the alternate power source for those AC instrument busses. The best effort was made to construct a question but it was determined we could not hit this KA. Replace d with 057 AA2.

15, randomly chosen by the Chief Examiner.

SRO 2/1 012 A2.03 The incorrect bypassing of a channel at RNP results in a plant trip in most cases. Trying to find an instrument that could be incorrectly bypassed, but not cause a trip, and then write a question to an SRO only level (most of these error scenarios would be RO knowledge) was very difficult and in the attempt that was made, could be tied back to a less than one hour tech spec, and thereby removing the SRO only plausibility. Replaced with 012 A2.05, randomly chosen by the Chief Examiner.

ES-401 Written Examination Review Worksheet Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 1 F 2 X B U K/A EPE007 EK2.02 Choices A and C are not plausible distractors.

Question is Unsatisfactory due to two implausible distractors.

1/4/2016

- Revised question is Satisfactory.

2 H 2 ? N E K/A APE008 2.1.30 The first part question is too much overlap with Scenario 3 Event 5. They are the same immediate actions. Also, closing RC

-535 is in all 4 answer choices.

Is knowledge of this power supply minutia? You have used that argument for one of the early submittal questions.

1/4/2016

- Revised question is Satisfactory.

3 H 2 X N E K/A EPE009 EA1.10

Knowledge of entry conditions for yellow paths is generally considered SRO knowledge. Following the procedure for a yellow path is based on the discretion of the SRO. You can test red and orange. 1/4/2016

- Operations Management approves testing safety Yellow CSFST identification. They have valid objectives and ROs monitor the status of safety functions. This is not procedure selection. (John Little) 4 F 2 X N E K/A EPE011 EK3.15 Do not believe that the reason for choices C and D are plausible

. Recommend asking what the maximum RWST level is that requires shifting to ECCS sump recirculation (19% or 27%) and giving times in the initial condition to choose between hot or cold leg recirculation. The "reason" for picking between hot or cold leg would be the time being greater or less than 11 hours1.273148e-4 days 0.00306 hours 1.818783e-5 weeks 4.1855e-6 months .

1/25/2016 - Revised question is Satisfactory.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 5 H 2 X N E K/A APE 022 AA2.03 Need to address timing and equipment in AUTO.

1/4/2016

- Revised question is Satisfactory.

6 H 2 X X N U K/A APE025 2.4.47 Given that RCS flow is 3000 gallons per minute, the bypass valve demand is 60%, and RCS pressure is being controlled, choices B(1) and D(1) are not plausible.

This is also a very good cue that there has not been a loss of RHR flow.

Question is Unsatisfactory due to two implausible distractors.

1/4/2016

- Revised question is Satisfactory.

7 H 2 X X B E K/A APE027 AK2.03

The picture provided for question #2 provides a clue to one of the questions.

The question and given conditions could be reworded and split into two parts that would make it less error likely for the applicants.

1/4/2016

- Revised question is Satisfactory.

8 H 2 X N E K/A EPE029 EK2.06

The question needs to be reworded some because FRP

-S.1 gives you a list of 4 different sets of breakers and tells you to open all of them. It could be argued that there is no correct answer.

1/4/2016

- Revised question is Satisfactory.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 9 H 3 X N E K/A EPE038 EK1.04 With a saturated system, both choices A and D could be argued to be correct. Also, cooling is based on a difference in temperature. Unable to write a operationally valid question to this K/A.

K/A EPE038 EK1.01 1/25/2016 - Revised question is Satisfactory.

10 H 2 X M E K/A APE 040 AK1.05 The first part question does not test the K/A and is more of a systems (tier 2) question. The second part of the question is a GFES question, but is related to the K/A. Recommend asking something about how to add the Boron or how much Boron to add (ECA

-2.1). We can discuss.

1/4/2016

- Revised question is Satisfactory.

11 F 2 X B E K/A APE054 AA1.03 Choice D is not plausible because it is cooled by Service Water.

Is there another option?

1/4/2016

- Revised question is Satisfactory.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 12 F 2 X X N U K/A EPE055 EK3.02 Question submitted for preliminary review and comment IAW ES

-201 paragraph C.2.c.

Distractor B does not appear to be plausible. When starting at a required pressurizer level of only greater than 14% and probable RCP seal leakage, it does not seem reasonable that pressurizer level greater than 7% can be ensured. Also, Distractors A and B are essentially the same thing.

Distractor D is not plausible due to no t being able to reach a red path if the cooldown rate limit is followed.

The stem question statement is not totally correct. The procedure caution statement only says that pressure should not be lowered less than 190 psig, it does not say to stop before.

Question is Unsatisfactory due to two non

-plausible distractors.

Recommendations:

Remove unnecessary information from current initial conditions. We can discuss specifics

. Give two times (30 minutes apart) with S/G pressure and pressurizer level. For the first time, have pressurizer level less than 14%. For the second time, have S/G pressure at 190 psig and pressurizer level going off scale low

. Ask: IAW ECA-0.0, what is the earliest time that the S/G depressurization is required to be stopped AND the reason for stopping the depressurization (preventing injection of accumulator nitrogen into the RCS or ensuring that no Reactor Vessel upper head voiding will occu r).

12/3/2015

- Question has been modified as recommended above. Request that you add something to the effect of "In accordance with EOP-ECA-0.0" to the question statement. Otherwise, the question is now Satisfactory.

1/4/2016

- Revised question is Satisfactory.

13 H 3 B S K/A APE056 AA2.11 Question is Satisfactory.

14 H 3 N S K/A APE057 AA2.15 Question is Satisfactory.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 15 F 2 X N E K/A APE058 AA1.02 Choices B(2) and D(2) are not plausible. Do you have any examples of a case where the electrical output breaker is closed prior to the input breaker when placing a component in service

? There are several other possibilities for this K/A.

1/25/2016 - Revised question is Satisfactory.

16 H 3 X X X N U K/A WE04 G2.4.46 Question submitted for preliminary review and comment IAW ES

-201 paragraph C.2.c.

The second part question appears to be asking procedure transition criteria, which is SRO knowledge.

Question is Unsatisfactory due to license level mismatch.

I am not sure that a leak in this location would always cause an APP-036-D7 alarm. The FSAR states that an alarm in this location would most likely be VCT or RWST water because there are so many check valves downstream. The R

-4 alarm setpoint is 50 millirem per hour.

Did or can you validate on the simulator?

Why ask or mention D8, since it is given in all four answer choices?

12/3/2015

- Revised question was submitted. Choices A and D of the revised question are not plausible. How could you have a LOCA outside containment and not have a process monitor high rad alarm.

Also, you could remove all of the "only" from the choices by adding "ALL of the" to the question stem.

1/4/2016

- Revised question is Satisfactory.

17 H 2 X X M E K/A WE05 EK3.4 Stating that a red condition exists for Heat Sink in the initial conditions makes choice A(2) not plausible.

Also, should not state that the red condition exists when steam generator levels and AFW flow are given. The applicant should be able to figure that out.

This also is more of an SRO question with procedure direction.

1/4/2016

- Revised question is Satisfactory.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 18 H 2 X N E K/A WE11 EK1.1 By my calculations, over 4 hours4.62963e-5 days 0.00111 hours 6.613757e-6 weeks 1.522e-6 months , the RWST level will lower for about 2.7 hours8.101852e-5 days 0.00194 hours 1.157407e-5 weeks 2.6635e-6 months until the SI pump is shut off at 9% and then rise for the remainder.

I do agree that overall the level will be lower. Need to work on the wording of the second part of the question in order for there to be a fully correct answer.

Request and IAW statement be added to the stem question.

1/4/2016

- Revised question is Satisfactory.

19 F 1.5 B S K/A APE005 AK2.02 Question is Satisfactory.

20 H 2 X B U K/A APE028 AK1.01 Choices B and C are not plausible. If the controlling channel increases or decreases

, how could other channels remain the same? Question is Unsatisfactory due to two non

-plausible distractors.

1/4/2016

- Revised question is Satisfactory.

21 H 2 X B E K/A APE032 AA2.02 This question does not appear to work IAW GP

-003. You could go critical on any one of the steps for doubling and the procedure has you go to section 8.3 for critical operations. Is there really a minimum number of doublings?

1/4/2016

- Revised question is Satisfactory.

22 H 3 X B U K/A APE033 AK3.01 Do you expect the ROs to know where 120 cps on the Source Range equates to the Immediate Range for this case?

This does not match the K/A. It tests the cause of the loss of the IR instrument, not the reason for termination of the startup. Tier 1 should normally test procedure/evolution requirements vice systems knowledge, unless otherwise specified by the specific K/A.

Question is Unsatisfactory due to not meeting the K/A.

1/25/2016 - Revised question is Satisfactory.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 23 F 2 N S K/A APE060 AK2.01 Question is Satisfactory.

24 H 2 X X N E K/A APE067 AA1.09 Picture of Fire Alarm Console not provided.

Reviewed picture in SRO exam.

The picture is somewhat blurry on the computer. Need to ensure that the picture is clear and readable on the exams. Also need to ensure that the picture is provided for the RO exam.

Given that both trains are actuated, this makes choices C(1) and D(1) not plausible. It would be OK to give only one train in alarm and test the other way.

Need to correct # of alarms on pictured.

1/25/2016 - Revised question is Satisfactory.

25 H 3 N S K/A APE068 AK3.12 Question is Satisfactory.

26 H 2 X M E K/A APE076 AA2.04

Choices B(1) and D(1) are not plausible.

1/25/2016 - Revised question is Satisfactory.

27 H 2 X M E K/A WE09 2.1.20

With step 9 being a continuous actions step, how are there not two correct answers?

1/25/2016 - Revised question is Satisfactory.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 28 H 2 X N U K/A SYS003 A3.01 The picture seems too hard to read.

Since all of the parameters shown return to their original values, outright failures do not seem to be plausible.

Question is Unsatisfactory due to two non-plausible distractors.

1/25/2016 - Revised question is Satisfactory.

29 H 3 B S K/A SYS003 K4.07 Question is Satisfactory.

30 F 3 X N U K/A SYS004 K2.06 Question submitted for preliminary review and comment IAW ES

-201 paragraph C.2.c.

The question does not meet the K/A. It does not test knowledge of power supplies to the instrumentation, it gives a power supply that is lost and tests knowledge of how the instruments will fail upon a loss of power.

That would be more of a K6 K/A.

Question is Unsatisfactory due to K/A mismatch. 12/7/15- Question is Satisfactory.

31 H 2 X X B U K/A SYS005 A2.02 Choices C and D are not plausible.

Question is Unsatisfactory due to two non

-plausible distractors.

1/25/2016 - Revised question is Satisfactory.

32 H 3 X X B E K/A SYS005 K6.03

Choice C is not plausible.

Licensee explained how choice C could be plausible.

33 F 3 N S K/A SYS006 A1.13 Question is Satisfactory.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 34 F 2 X M E K/A SYS006 K5.01 The second part question needs to be a little more specific concerning temperature (higher, lower, increased, decreased)

.

1/25/2016 - Revised question is Satisfactory.

35 H 2 N S K/A SYS007 K3.01 Question is Satisfactory.

36 H 2 X X B E K/A SYS008 A4.01

Choice D is not plausible.

The question stem does not exactly match the choices.

1/25/2016 - Revised question is Satisfactory.

37 H 1 X N U K/A SYS010 K6.04 Choices A, B, and D are not plausible.

LOD = 1. Question is Unsatisfactory due three non

-plausible distractors and LOD = 1. 1/25/2016 - Revised question is Satisfactory.

38 H 2 B S K/A SYS012 A3.06 Question is Satisfactory.

39 F 2 X ? N E K/A SYS012 K1.05 Choice D is not plausible.

Need to discuss K/A match.

1/25/2016 - Revised question is Satisfactory.

40 F 2 N S K/A SYS013 K5.02 Question is Satisfactory.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 41 H 2 X N E K/A SYS022 A4.04 Choice D is not plausible. Choice A is likely not plausible.

1/25/2016 - Revised question is Satisfactory.

42 H 2 N S K/A SYS026 A2.08 Question is Satisfactory

. 43 F 2 X N E K/A SYS039 A1.10 Choice A is not plausible.

1/25/2016 - Revised question is Satisfactory.

44 F 2 N S K/A SYS059 K4.02 Question is Satisfactory.

45 H 2 X N U K/A SYS061 K5.01 Choices A and D are not plausible.

There is no correct answer (must be > 600 gpm).

Question is Unsatisfactory due to two non

-plausible distractors.

1/25/2016 - Revised question is Satisfactory.

46 H 2 B S K/A SYS062 K1.04 Question is Satisfactory.

47 F 2 B S K/A SYS062 K2.01 Question is Satisfactory.

48 H 2 X N U K/A SYS063 A3.01 Choices A and C are not plausible.

Question is Unsatisfactory due to two non

-plausible distractors.

1/25/2016 - Revised question is Satisfactory.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 49 F 2 X N U K/A SYS064 A2.18 Choices C and D are not plausible.

Question is Unsatisfactory due to two non

-plausible distractors.

1/25/2016 - Revised question is Satisfactory.

50 F 2 ? B E K/A SYS064 K2.02 Can you give any examples where there are A and B components that the B component is powered from the lower numbered MCC?

1/25/2016 - Question is Satisfactory.

51 H 2 B S K/A SYS073 A4.01 Question is Satisfactory.

52 F 3 X X M U K/A SYS073 2.4.9 Question seems to be more related SRO procedure direction than mitigation strategy. It also does not seem to meet the K/A because it does not seem to test the PRM system.

Selected K/A SYS073 2.4.11 1/26/16-New question is Satisfactory.

53 F 3 N S K/A SYS076 K1.15 Question is Satisfactory.

54 F 2 N S K/A SYS078 K3.03 Question is Satisfactory.

55 H 2 X N E K/A SYS103 G2.1.7 Is a spray pump running? Does the number of HVH units running matter concerning the CSFST?

Need to discuss plausibility of choice C.

1/25/2016 - Revised question is Satisfactory.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 56 H 2 X N E K/A SYS001 K6.13 The given conditions "picture" is not included on anything that was submitted. Unable to review fully. It seems that operation or interpretation of RPI would be more relevant than location of cabinets that I&C personnel need to go to. If there is no IRPI rack in the Hagan room, then it is not plausible

. 1/25/2016 - Revised question is Satisfactory.

57 F 2 X N U K/A SYS002 K4.01 Question does not appear to test design features or interlocks.

Question is Unsatisfactory due to not meeting the K/A. 1/25/2016 - Revised question is Satisfactory.

58 F 2 X N E K/A SYS011 A1.02 Question submitted for preliminary review and comment IAW ES

-201 paragraph C.2.c.

Need to state (in the question stem) what procedure these values are in accordance with.

1/25/2016 - Revised question is Satisfactory.

59 H 2 X B U K/A SYS014 K5.01 Choices A and B are not plausible.

Question is Unsatisfactory due to two non

-plausible distractors.

1/25/2016 - Revised question is Satisfactory.

60 F 2 X B U K/A SYS017 A4.01 Choices A and B are not plausible.

Question is Unsatisfactory due to two non

-plausible distractors.

1/28/2016 - Revised question is Satisfactory

.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 61 F 2 B S K/A SYS027 K2.01 Question is Satisfactory.

62 F 2 X N E K/A SYS029 G2.1.23 Need to show where this information is located in OP

-921. I could not find it.

Licensee is breaking stem into two separate questions.

1/28/2016 - Revised question is Satisfactory

. 63 F 2 X X N E K/A SYS033 K3.02 Choices C(1) and D(1) are not plausible. They are process monitors.

1/26/16 - Revised question is Satisfactory.

64 H 2 X X N E K/A SYS035 A2.05

The choices for the second part question provide a direct cue to answer the first part question.

1/26/16 - Revised question is Satisfactory.

65 F 2 X B E K/A SYS068 K1.07 Choice A should probably be in all capital letters to match other choices. 1/26/16 - Revised question is Satisfactory.

66 F 2 N S K/A G2.1.29 Question is Satisfactory.

67 F 2 X B E K/A G2.1.36 Need nomenclature for NI

-51 and NI

-52. 1/26/16 - Revised question is Satisfactory.

68 H 2 X N E K/A G2.1.45 and MW without a reference? Need to discuss.

1/28/2016

- Revised question is Satisfactory.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 69 H 4 M E K/A G2.2.38 It seems that this question requires the applicant to know greater than one hour actions from memory.

Operations (John Little) determined that this is RO required knowledge because it relates directly to licensed power level and the RO is responsible for monitoring.

70 F 2 N S K/A G2.2.39 Question is Satisfactory.

71 F 1 B U K/A G2.3.13 It does not seem plausible that you would not evacuate the containment vessel or initiate closure after a fuel assembly has been dropped and is causing the noble gas radiation monitor to increase.

LOD = 1 Question is Unsatisfactory due to more than one non

-plausible distractor and LOD = 1.

1/26/16 - Revised question is Satisfactory.

72 H 2 B S K/A G2.3.4 Question is Satisfactory.

73 H 3 X N E K/A 2.4.11 The second part question could be reworded to read easier.

1/26/16 - Revised question is Satisfactory.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 74 H 2 X N E K/A G2.4.25 Question submitted for preliminary review and comment IAW ES

-201 paragraph C.2.c.

In the question stem, need to state what procedure the action(s) are in accordance with.

Recommend stating in the initial conditions that either the block valves have been closed or the switches have been placed in the ISOLATED Position, then asking if the other action "is" or "is not" required.

For plausibility, are there any other time critical action s that are 15 minutes? 12/16/15

- Question is Satisfactory.

75 F 1 N U K/A G2.4.31 This has overlap with the operating test. Every BOP will perform this during the operating test.

Question is Unsatisfactory due to LOD = 1.

1/26/16 - Revised question is Satisfactory.

76 H 2 X N E K/A EPE029 EA2.06 With operation of the steam dumps following turbine trip, do not believe that choices A(2) and D(2) are plausible. Could possibly change the second part question to an is or is not question.

1/26/16 - Revised question is Satisfactory.

77 H 1 X X X N U K/A EPE 038 2.4.47 The first part question is direct lookup.

This question can be answered using RO knowledge only. The question is Unsatisfactory due to LOD = 1 and not being SRO only. 1/26/16 - Revised question is Satisfactory.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 78 H 2 X X B U/E K/A APE054 2.4.9 Knowledge of when to initiate bleed and feed is probably RO knowledge and is listed in the continuous action summary for FRP

-H.1. This is also an objective in your lesson plan. The RO would be required to inform the SRO when conditions are met for bleed and feed. It is acceptable for one part of a two part question to be RO knowledge, however both parts should not be able to be answered using RO knowledge.

ROs should also know that PORVs are opened for bleed and feed.

We need to discuss this situation for steps on the foldout page.

Also, since all of the choices listed in the second part question are done in the procedure, need to ask what should be done first.

Question may be Unsatisfactory due to not being SRO only.

1/29/2016 - Revised question is Satisfactory 79 H 3 X ? B E K/A EPE055 EA2.06 Is the first part of the question minutia? Does this lockout need to be cleared prior to re

-energizing the buses? Does this meet the K/A? Please explain

. 1/28/2016

- Revised question is Satisfactory.

80 H 2 X B E K/A APE058 2.2.22 Per the TS 3.8 Bases, the selected answer for the second part question may not be correct.

1/26/16 -Licensee explained Bases, Question is Satisfactory.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 81 H 1 X M U K/A APE077 AA2.03 Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.

The last bullet provides a direct cue that the qualified offsite circuit is INOPERABLE (inadequate voltage for a design basis event). This makes LOD = 1.

Question is Unsatisfactory due to LOD = 1.

12/22/15- Revised question reviewed. Is there any place in AOP

-26 that the EDGs are aligned by the operators to E-1 and E-2 independently? If not, choices C(2) and D(2) are not plausible. The question still needs some enhancement.

1/26/16 - Revised question is Satisfactory.

82 H 2 N S K/A APE001 AA2.02 Question is Satisfactory.

83 H 2 X X X N U K/A APE051 G2.4.35 Question submitted for preliminary review and comment IAW ES

-201 paragraph C.2.c.

The question is not SRO only. SRO only knowledge should not be claimed for major mitigative strategy or AOP entry conditions.

See Attachment 2 of ES

-401.

Also, based on the wording of step 12 of AOP

-012, the note prior to step 12, and the AOP

-038 entry conditions, it appears that the SRO could perform a rapid power reduction if desired.

With no indication of condenser backpressure value or trend, how is going to a rapid power reduction plausible?

The question is Unsatisfactory because it is not SRO only. Based on a review of your procedures, this could be a very hard K/A to satisfy at the SRO only level. We can discuss randomly selecting another K/A.

12/22/15

- Reviewed revised question. Question is Satisfactory.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 84 H 2 X N E K/A APE061 AA2.03 The applicable answer choices do not include that a Portable Area Radiation Monitor in the CV area is also required in accordance with GP-010. 1/26/16 - Revised question is Satisfactory.

85 H 2 X M E K/A WE06 2.1.23 Choice C needs to be worded more clearly.

1/26/16 - Revised question is Satisfactory.

86 H 2 X X N U K/A SYS012 A2.05 Providing LCO 3.3.1 gives clues to the correct answer or gives the correct answer for several other questions on this exam. (Question 1 for example, and also questions that hinge on the set points of Reactor Protection System interlocks)

Question does not meet the K/A due to not predicting the impacts on the RPS. Question is Unsatisfactory due to K/A mismatch.

1/26/16 - Revised question is Satisfactory.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 87 H 2 X X B E K/A SYS039 A2.03 Question submitted for preliminary review and comment IAW ES

-201 paragraph C.2.c.

Please explain why it is required to secure feeding the "A" steam generator as stated in the first part question stem.

Discussing transitioning to E

-2 in the second part question stem provides a cue to the first part question and does not affect the answer. Indications of the faulted steam generator are provided in the initial conditions.

Should just ask IAW the given conditions and E-3.

12/22/15

- Reviewed the revised question.

Based on the given conditions, it appears that the Secondary Integrity Criteria on the foldout page for E

-3 are met. This would require a transfer to E

-2. Since this is not one of the listed choices, there is no correct answer choice for this question.

1/28/2016 - Revised question is Satisfactory

. 88 M 2 N S K/A SYS076 2.1.7 Question is Satisfactory.

89 H 2 X X N U K/A SYS078 A2.01 Question submitted for preliminary review and comment IAW ES

-201 paragraph C.2.c.

Need to remove the information in the bullet that states "causing IA Header pressure to slowly lower." The applicants should know that a clogged air dryer will cause pressure to lower

.

The question does not really appear to be operational valid. We need to discuss the normal lineup of the instrument air system and how we would get in the situation proposed by the question.

The question does not really test the K/A, but can be pretty easily fixed. We can discuss.

Will need the appropriate IAW statement added to the question stem. Also, need to word question with regard to the fact that the use of attachment 2 or 3 is in a step that is based on order of preference.

12/22/15

- Reviewed the revised question.

Question is now Satisfactory.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 90 H 2 X X N U K/A SYS103 G2.4.35 Question submitted for preliminary review and comment IAW ES

-201 paragraph C.2.c.

This does not appear to meet the intent of the K/A. It seems to meet more of the RCP K/A than the type of topics listed for the Containment system.

This does not appear to be an SRO only question. It does not have procedure selection and could be answered with RO knowledge.

Based on a review of your procedures, this could be a very hard K/A to satisfy at the SRO only level. We can discuss randomly selecting another K/A.

K/A SYS103 2.4.41

Revised question is Unsatisfactory due to LOD = 1. The correct answer choice (both halves) is so strong and self

-explanatory that it makes the question provide no discriminatory value.

1/26/16 - Revised question is Satisfactory.

91 H 2 X N E K/A SYS015 A2.04

The bullet in the initial conditions that states that the crew lowered reactor power IAW AOP

-101 needs to be more specific as to what the current reactor power is. It could be argued that if the crew lowered power IAW AOP

-001, then it would be less than or equal to 50% and no further reduction would be required.

It would probably be more clear just to ask whether the CRS is or is not required to direct a power reduction to less than or equal to 50% in accordance with AOP

-001 Attachment 1 for the second part question.

1/26/16 - Revised question is Satisfactory.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 92 F 2 X M E K/A SYS068 A2.02 Need a copy of EMP

-006 to complete review of this question. Your lesson plan states that Chemistry does the sample and then provides the permit. Is determining whether or not the pH is acceptable an SRO job function?

Operations representative (John Little) states that this is SRO job function because the SRO/Shift Manager is required to review and approve the report.

1/28/2016 - Revised question is Satisfactory

. 93 F 2 M E K/A SYS071 2.4.21 Need a copy of PLP

-100 to complete review of this question.

This procedure is not listed in the index provided.

1/28/2016

- Revised question is Satisfactory.

94 H 2 N S K/A G2.1.45 Question is Satisfactory.

95 H 2 X X N E K/A G2.2.21 Choices B(2) and C(2) are not plausible. It is not operationally valid to ask for greater than one hour TS completion times without a reference

. 1/29/2016

- Revised question is Satisfactory 96 H 2 X X N E K/A G2.2.36 Choices A(2) and C(2) are not plausible. It is not operationally valid to ask for greater than one hour TS completion times without a reference.

1/29/2016

- Revised question is Satisfactory

. 97 H 2 X B E K/A G2.3.12 There may be two correct answers to this question. OMM

-001-2 doesn't really state that the RC Supervisor cannot grant access during EOPs, it just describes how he will do it during normal operations.

1/28/2016

- Revised question is Satisfactory.

98 H 2 N S K/A G2.3.14 Question is Satisfactory.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 99 H 2 X M E K/A G2.4.30 Need a copy of AP-030 to complete review of this question.

Licensee is changing leakrate and adding EAL reference.

2/3/16 - Revised question is Satisfactory 100 H 2 X N E K/A G2.4.46 The bullet for "Total calculated "B" RCP #1 seal leakoff flow: 6.5 gpm" is misleading. We need to discuss this.

1/29/2016

- Revised question is Satisfactory Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

The stem lacks sufficient focus to elicit the correct answer (e.g.,

unclear intent, more information is needed, or too much needless information).

The stem or distractors contain cues (i.e.,

clues, specific determiners, phrasing, length, etc).

The answer choices are a collection of unrelated true/false statements.

The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

One or more distractors is (are) partially correct (e.g.,

if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

The question is not linked to the job requirements (i.e.,

the question has a valid K/A but, as written, is not operational in content).

The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e.,

it is not required to be known from memory). The question contains data with an unrealistic level of accuracy or inconsistent units (e.g.,

panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A a nd those that are designated SRO

-only (K/A and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES

-401 Section D.2.f.

7. Based on the reviewer's judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any "U" ratings (e.g.,

how the Appendix B psychometric attributes are not being met).

ES-301 Administrative Topics Outline Form ES-301-1 (Rev_011016) NUREG-1021, Revision 10 Facility:

HB Robinson Date of Examination:

2/2016 Examination Level

RO Operating Test Number:

N16-1 Administrative Topic (see Note) Type Code*

Describe activity to be performed Conduct of Operations D, R 2.1.7 (4.4) Ability to evaluate plant performance and make operational judgments based on operating characteristics, reactor behavior, and instrument interpretation.

JPM: Calculate QPTR Conduct of Operations N, R 2.1.4 (3.3)

Knowledge of individual licensed operator responsibilities related to shift staffing, such as medical requirements, "no

-solo" operation, maintenance of active license status, 10CFR55, etc.

JPM: Determine License Status Equipment Control D, P, R 2.2.41 (3.5) Ability to obtain and interpret station electrical and mechanical drawings.

JPM: Determine Proper Equipment Boundaries Radiation Control N, R 2.3.7 (3.5) Ability to comply with radiation work permit requirements during normal or abnormal conditions.

JPM: Evaluate Stay Time with Lowered SFP Level NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when 5 are required.

Type Codes & Criteria: