ML16124B059: Difference between revisions

From kanterella
Jump to navigation Jump to search
(Created page by program invented by StriderTol)
(StriderTol Bot change)
 
(9 intermediate revisions by the same user not shown)
Line 13: Line 13:
| document type = License-Operator, Part 55 Examination Related Material
| document type = License-Operator, Part 55 Examination Related Material
| page count = 65
| page count = 65
| revision = 0
}}
}}
=Text=
{{#Wiki_filter:Examination Preparation Checklist                                          Form ES-20J-J ES-207 Date of Examination: 2/01/2016 Facility: Robinson NRC              /1    Operating    Facility      x      NRC Developed by: Written:                  Facility x Target                                                Task Description (Reference)                                          Examiners Date                                                                                                                          Initials 8/5/2015
      -180        1.              Examination administration date confirmed (Cia; C.2.a and b) 9/4/2015
      -lC        2.              NRC examiners and facility contact assigned (C.1.d; C.2.e) 9/4/2015
      -150        3.              Facility contact briefed on security and other requirements (C.2.c) 9/4/2015
      -150        4.            Corporate notification letter sent (C.2.d)
N/A
[-i          5.            Reference material due (C.1.e; C.3.c; Attachment 3)
ES-301 -1,    11/3/2015 f- 1        6.            Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-401N-3, ES-301-2, ES-301-5, ES-D-1, ES-401-1/2, ES-401N-i/2, ES-401-3, ES-401-4, and ES-401N-4, as applicable (C.1.e and f; C.3.d) facility licensee      11/8/2015
{-j          7.            Examination outline(s) reviewed by NRC and feedback provided to (C.2.h; C.3.e) ios, as        1213/2015 f- .(      8.            Proposed examinations (including written, walk-through JPMs, and scenar ES-301-4, ES applicable), supporting documentation (including Forms ES-301-3, ES-201-3, 301-5, ES-301-6, and ES-401-6, ES-401N-6, and any Form ES-201-2, f, and h; ES-301-1, or ES-301-2 updates), and reference materials due (C.1.e, g C.3.d) 12/18/2015
          -45      9.            Written exam and operating test reviews completed. (C.3.f)
ES-202)              1/2/2016
          -30        1    .        Preliminary license applications (NRC Form 398s) due (C.i.l; C.2.g; (C.2.h; C.3.f)        1/28/2016
          -21        1  .          Examination approved by NRC supervisor for facility licensee review 1/28/2016
            -21      t.            Examinations reviewed with facility licensee (Cli; C.2.f and h; C.3.g)
ES-202)        1/18/2016
            -14        1.            Final license applications due and Form ES-201-4 prepared (C.1 .1; C.2.i; isor (C.2.i;            2/11/2016
            -14        1    .        Written examinations and operating tests approved by NRC superv C.3.h)                                                                                          1/28/16 on the            2/11/2016
            -7        15.          Facility licensee management queried regarding the licensees views examination. fC.2 j)                                                                            1/28/16 1/29/2016
              -7        1      .      Final applications reviewed; 1 or 2 (if >10) applications audited to confirm sent fC.2.i; qualifications / eligibility; and examination approval and waiver letters Attachments; ES-202,        C.2.e; ES-204) facility licensee          2/11/2016
              -7        17.          Proctoring/written exam administration guidelines reviewed with (C.3.k) to NRC      1/28/2016
              -7        1      . Approved scenarios, job performance measures, and questions distributed examiners (C.3.i) ations and are keyed to the examination date Target dates are generally based on facility-prepared examin ate  notification  letter. They  are for  plannin g purposes and may be adjusted on a case-by identified in the corpor case basis in coordination with the facility                  license e.
by the NRC.
[Applies only] {Does not apply) to examinations prepared
ES-201                                  Examination Outline Quality Checklist                                  Form ES-201-2 Facility: ROBINSON                                                                  Date of Examination:  FEBRUARY 2016 Item                                                                                                                Initials Task Description
: 1.      a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401 or ES-401 N.
: b. Assess whether the outline was systematically and randomly prepared in accordance with Section D.1 of ES-401 or ES-401N and whether all KJA categories are appropriately sampled.
T                                                                                                                  /4    (
: c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.            %1 N
                                                                                                                      %7
: d. Assess whether the justifications for deselected or rejected K/A statements are appropriate.
: 2.      a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, and major S          transients.
M        b. Assess whether there are enough scenario sets (and spares) to test the projected number and u          mix of applicants in accordance with the expected crew composition and rotation schedule L          without compromising exam integrity, and ensure that each applicant can be tested using at A          least one new or significantly modified scenario, that no scenarios are duplicated from the T          applicants audit test(s), and that scenarios will not be repeated on subsequent days.
: c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative and quantitative criteria specified on Form ES-301-4 and described in Appendix D.
: 3.      a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:
(1) the outline(s) contain(s) the required number of control room and in-plant tasks distributed W                among the safety functions as specified on the form A          (2) task repetition from the last two NRC examinations is within the limits specified on the form L          (3) no tasks are duplicated from the applicants audit test(s)
K          (4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on T                the form.
H R        b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:
  ,          (1) the tasks are distributed among the topics as specified on the form U          (2) at least one task is new or significantly modified G          (3) no more than one task is repeated from the last two NRC Ii H
: c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.
: 4.      a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections.
G E      b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.
: c. Ensure that K/A importance ratings (except for R      d. Check for duplication and overlap among exam sections.
L      e. Check the entire exam for balance of coverage.
: f. Assess whether the exam fits the appropriate job level (RD or SRO).
: a. Author                                                                                                          O(4/5
: b. Facility Reviewer (*)                                                    4
: c. NRC Chief Examiner (#)                                  3 i  c                                  tT-              9L/23/_?iJ
: d. NRC Supervisor                          .(fl C
                                                                      /  /
4 1  JVc, Note:                  # Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
Not applicable for NRC-prepared examination outlines.
ES-201                                    Examination Outline Quality Checklist                                  Form ES-201-2 (Rev_O1 2316)
Facility:        Robinson                                                          Date of Examination:            2/2016 Initials Item Task Description h i
: 1.        a. Verify that the outline(s) fit(s) the appropriate model per ES-401 or ES-401 N.                C
: b. Assess whether the outhne was systematicaily and randomiy prepared in accordance with W              Section D.1 of ES-401 or ES-401N and whether au KJA categories are appropriateiy R              sampied.
      .-        c. Assess whether the outhne over-emphasizes any systems, evoiutions, or generic topics.          c.
T        d. Assess whether the justifications for deselected or rejected K/A statements are E              appropriate.
N
: 2.        a. Using Form ES-301 -5, verify that the proposed scenario sets cover the required number of normai evoiutions, instrument and component faiiures, technical specifications, and major transients.
s i        b. Assess whether there are enough scenario sets (and spares) to test the projected number M            and mix of applicants in accordance with the expected crew composition and rotation scheduie without compromising exam integrity; and ensure that each applicant can be U              tested using at least one new or significantly modified scenario, that no scenarios are L            duplicated from the appiicants audit test(s), and scenarios wiil not be repeated on A              subsequent days.
T          c. To the extent possibie, assess whether the outline(s) conform(s) with the quattative and 0              quantitative criteria specified on Form ES-301-4 and described in Appendix D.
R
: 3.        a. Verify that systems waik-through outtne meets the criteria specified on Form ES-301 -2:
(1) the outhne(s) contain(s) the required number of controi room and in-plant tasks, W                    distributed among the safety functions as specified on the form A
(2)  task repetition from the last two NRC examinations is within the hmits specified on L                  the form, K
(3)  no tasks are duplicated from the apptcants audit test(s)
T H              (4)  the number of new or modified tasks meets or exceeds the minimums specified on the form R
0              (5)  the number of aiternate path, iow-power, emergency and RCA tasks meet the criteria on the form.
G        b. Verifythatthe administrative outiine meets the criteria specified on Form ES-301-1:
H              (1)  the tasks are distributed among the topics as specified on the form (2)  at least one task is new or significantiy modified (3)  no more than one task is repeated from the last two NRC licensing examinations
: c. Determine if there are enough different outhnes to test the projected number and mix of apphcants and ensure that no items are duphcated on subsequent days.
: 4.        a. Assess whether plant-specific priorities (inciuding PRA and iPE insights) are covered in the appropriate exam section.
G          b. Assess whether the 10CFR 55.41/43 and 55.45 sampiing is appropriate.                          L.
: c. Ensure that K/A importance ratings (except for piant-specific priorities) are at least 2.5.
E        d. Check for duplication and overiap among exam sections.
R
: e. Check the entire exam for balance of coverage.
L        f. Assess whether the exam fits the appropriate job ievei (RD or SRO).
Printed Name / Signature                                  Date
: a. Author                                                                        i-                                  i/zc ,4
: b. Facuiity Reviewer(*)
: c. NRC Chief Examiner      f#)                Da.v ic.                                                              /,k7) i
: d. NRC Supervisor                                C NOTE:        # independent NRC reviewer initial items in Coiumn c, chief examiner concurrence required.
Not applicabie for NRC-prepared examination outlines NUREG-1021, Revision 10
ES-301                                  Administrative Topics Outline                          Form ES-301-1 (Rev_011016)
Facility:      HB Robinson                                  Date of Examination:          2/2016 Examination Level:                      RO                  Operating Test Number:        N16-1 Administrative Topic          Type Code*                  Describe activity to be performed (see Note) 2.1.7 (4.4)    Ability to evaluate plant performance Conduct of Operations                                            and make operational judgments based on operating characteristics, D, R                        reactor behavior, and instrument interpretation.
JPM:            Calculate QPTR 2.1.4 (3.3)    Knowledge of individual licensed operator Conduct of Operations                                            responsibilities related to shift staffing, such as medical requirements, no-solo N, R                        operation, maintenance of active license status, 10CFR55, etc.
JPM:            Determine License Status 2.2.41 (3.5)    Ability to obtain and interpret station Equipment Control                                                electrical and mechanical drawings.
D, P, R JPM:            Determine Proper Equipment Boundaries 2.3.7 (3.5)    Ability to comply with radiation work Radiation Control                                                permit requirements during normal or abnormal conditions.
N, R JPM:            Evaluate Stay Time with Lowered SFP Level NOTE:        All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when 5 are required.
*Type Codes & Criteria:            (C)ontrol room, (0) (S)imulator, (0) or Class(R)oom (4)
(D)irect from bank ( 3 for ROs;  4 for SROs & RO retakes) (2)
(N)ew or (M)odified from bank (> 1) (2)
(P)revious 2 exams ( 1; randomly selected) (1)
NUREG-1021, Revision 10
ES-301                          Administrative Topics Outline                    Form ES-301-1 (Rev_011016)
RO Admin JPM Summary A1a  This is a modified Bank JPM. The operator will be told that the plant is operating at 60%
power and that ERFIS is OOS. The operator will be provided with Power Range Excore Nuclear Instrumentation indicated and normalizing detector currents, and directed to manually calculate Quadrant Power Tilt Ratio, and identify whether or not any limitations have been exceeded. The operator will be expected to calculate QPTR in accordance with FMP-007, Quadrant Power Tilt, and identify that Technical Specification LCO 3.2.4, Quadrant Power Tilt Ratio (QPTR), is NOT met.
A1b  This is a new JPM. The operator will be told that they are a Licensed Reactor Operator who was assigned to the day shift staff for a special project, and not routinely standing watch in the Control Room. They will be provided with a work history and various qualification dates, and then directed to identify any requirements that must be met prior to the end of the quarter that are required to maintain their license ACTIVE; and any additional requirements that are required to maintain their qualification to stand watch in the Control Room. The operator will be expected to evaluate their work history and identify that four 12-hour shifts must be completed as either the RO or the BOP prior to the end of the quarter to maintain their license ACTIVE, and that an SCBA quantitative and qualitative fit test must be completed prior to standing watch in the Control Room again.
A2    This is a Bank JPM. The operator will be told that the plant is in Mode 1 at 100%,
Charging Pump A suction relief valve CVC-2080 has failed open, and that the operating crew has entered AOP-016, Excessive Primary Plant Leakage, to control the plant. The operator will be provided with the EDPs, and the P&IDs, and directed to use all available resources to identify the pump boundary valves needed to be closed to isolate the leak, and identify the motor breaker to electrically isolate the pump motor.
The operator will be expected to identify that the leak can be isolated by closing three valves; CVC-270, CVC-290 and CVC-291, and that the pump motor can be electrically isolated by opening Breaker 52/34B. This JPM was previously used on the 2014 NRC Exam, randomly selected for use on the 2016 Exam.
A3    This is a new JPM. The operator will be told that a station wide accident has occurred due to an Earthquake, that the plant is in Mode 6 with a full core off-load, that the Spent Fuel Pool level has lowered to 10 feet above the top of the fuel, and has stabilized at this level, and that the crew is implementing AOP-036 (SFP Events). The operator will be provided with an R-5 reading, a dose limit of 25 mrem, and the assignment of a repetitive task within AOP-036 which will require entry into the Spent Fuel Building for 3 minutes, before exiting; and will be directed to estimate how many times the operator can perform this repetitive task before they must be replaced by another operator. The operator will be expected to determine that the dose rate around the Spent Fuel Pool area is 193 mrem/hour and based on this the operator will determine that the repetitive task can be performed 2 times before another operator will need to perform the task.
NUREG-1021, Revision 10
ES-301                                      Administrative Topics Outline                            Form ES-301-1 (Rev_011016)
Facility:      H B Robinson                                    Date of Examination:              2/2016 Examination Level:                        SRO                  Operating Test Number:            N16-1 Administrative Topic                Type                      Describe activity to be performed (see Note)                  Code*
2.1.7 (4.7)        Ability to evaluate plant performance and Conduct of Operations                                                  make operational judgments based on operating characteristics, reactor D, R                            behavior, and instrument interpretation.
JPM:              Calculate QPTR 2.1.4 (3.8)        Knowledge of individual licensed operator Conduct of Operations                                                  responsibilities related to shift staffing, such as medical requirements, no-solo N, R                            operation, maintenance of active license status, 10CFR55, etc.
JPM:              Determine License Status 2.2.38 (4.5)      Knowledge of conditions and limitations in Equipment Control                                                      the facility license.
D, R JPM:              Determine if Mode Change is Permissible 2.3.8 (3.7)        Ability to approve release permits.
Radiation Control                      N, R JPM:              Approve a Waste Gas Release Permit 2.4.41 (4.4)      Knowledge of the emergency action level Emergency Plan                                                          thresholds and classifications.
D, R JPM:              Emergency Classification NOTE:        All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when 5 are required.
*Type Codes & Criteria:              (C)ontrol room, (0) (S)imulator, (0) or Class(R)oom (5)
(D)irect from bank ( 3 for ROs;  4 for SROs & RO retakes) (3)
(N)ew or (M)odified from bank (> 1) (2)
(P)revious 2 exams ( 1; randomly selected) (0)
NUREG-1021, Revision 10
ES-301                            Administrative Topics Outline                  Form ES-301-1 (Rev_011016)
SRO Admin JPM Summary A1a  This is a modified Bank JPM. The operator will be told that the plant is operating at 100% power and that ERFIS is OOS. The operator will be provided with Power Range Excore Nuclear Instrumentation indicated and normalized detector currents, and directed to calculate Quadrant Power Tilt Ratio, identify whether or not any limitations have been exceeded, and if so, what, if any ACTION, is required. The operator will be expected to calculate QPTR in accordance with FMP-007, Quadrant Power Tilt, identify that Technical Specification LCO 3.2.4, Quadrant Power Tilt Ratio (QPTR), is NOT met, and identify that all six ACTIONs (A.1-A.6) must be taken for Condition A of LCO 3.2.4, including the maximum permitted power level of 91.3%.
A1b  This is a new JPM. The operator will be told that they are a Licensed Senior Reactor Operator who was assigned to the day shift staff for a special project, and not routinely standing watch in the Control Room. They will be provided with a work history and various qualification dates, and then directed to identify any requirements that must be met prior to the end of the quarter that are required to maintain their license ACTIVE; and any additional requirements that are required to maintain their qualification to stand watch in the Control Room. The operator will be expected to evaluate their work history and identify that four 12-hour shifts must be completed as either the SM, CRS, RO or the BOP prior to the end of the quarter to maintain their license ACTIVE, and that an SCBA quantitative and qualitative fit test must be completed prior to standing watch in the Control Room again.
A2    This is a Bank JPM. The operator will be told that the plant is in Mode 5, returning from a refueling outage, that the RCS temperature is 165°F and there is a bubble in the PZR, and that RHR Loop A is maintaining RCS temperature. The operator will be provided with an Inoperable Equipment List and directed to complete the attached OMM-001-12, MINIMUM EQUIPMENT LIST AND SHIFT RELIEF, Attachment 2, 200°F to 350°F (MODE 4) MEL, that was started on the previous shift and to determine if any Mode 4 restrictions exists. The operator will be expected to complete Attachment 2 and determine that the Mode change cannot occur with current plant conditions, per the attached KEY.
A3    This is a new JPM. The operator will be told that the plant is in Mode 1 at 100% power, and that a Waste Gas Release Permit for the A WGDT has been presented to the Shift Manager for review and approval. The operator will be provided with a WGDT Release Permit and directed to review and approve the Waste Gas Release Permit, or to identify all issues found which would prevent approval. The operator will be expected to review the WGDT Release Permit and identify that it cannot be approved because (1) it has been written for the wrong WGDT and (2) the R14C setpoint is less conservative than required.
A4    This is a Bank JPM. The operator will be given an initial set of plant conditions. The operator will be directed to classify the event in accordance with the Robinson Nuclear Plant Emergency Action Level Matrix. The operator will be expected to declare an ALERT based on HA4.1, Confirmed Security event in a plant Protected Area or notification of either an airborne attack threat or hostile threat within the Owner Controlled Area, within 15 minutes. Then, the operator must prepare an Emergency NUREG-1021, Revision 10
ES-301                            Administrative Topics Outline            Form ES-301-1 (Rev_011016)
Notification Form for this event in accordance with EPCLA-01 (Emergency Control), also within 15 minutes.
NUREG-1021, Revision 10
ES-301                            Control Room/In-Plant Systems Outline                    Form ES-301-2 (REV_011116)
Facility:      H B Robinson                                    Date of Examination:          2/2016 Exam Level (circle one):        RO (only) / SRO(I) / SRO (U)    Operating Test No.:          N16-1 Control Room Systems (8 for RO; 7 for SRO-I; 2 or 3 for SRO-U)
Type Code*      Safety System / JPM Title Function A. 062 AC Electrical Distribution System [062 A2.08 (3.6/3.4)]
S, P, D, A        6 Operation With High Switchyard Voltage B. 059 Main Feedwater System [059 A4.08 (3.2/2.9)]
S, M, A        4S Transfer From the FRV Bypass Valves to the FRVs C. 007 Pzr Relief Tank/Quench Tank System [007 A1.01 (2.9/3.1)]
S, D, A        5 Restore PRT to Normal Operating Conditions D. 001 Control Rod Drive System [001 A1.06 (4.1/4.4)]
S, N, A, L        1 Reactor Startup with Ejected Control Rod E. 011 Large Break LOCA [EPE 011 EA1.11 (4.2/4.2)]
S, D, A, EN        3 Transfer to Long Term Recirculation F. 006 Emergency Core Cooling System [006 A4.02 (4.0/3.8)]
S, P, D, EN        2 Fill a Safety Injection Accumulator G. 015 Nuclear Instrumentation System [015 A4.03 (3.8/3.9)]
S, D, L        7 Remove Source Range Channel N-31 From Service H. 003 Reactor Coolant Pump System [003 A4.03 (2.8/2.5)]
S, D, L      4P Start a Reactor Coolant Pump In-Plant Systems@ (3 for RO; 3 for SRO-I; 3 or 2 for SRO-U)
I. APE 055 Loss of Offsite and Onsite Power [EPE 055 EA2.01 (3.4/3.7)]
D, P, E        6 Locally Establish AFW Flow from the SDAFW Pump and Control S/G Levels and Pressures J. 065 Loss of Instrument Air [065 AA1.04 (3.5/3.4)]
D, R, E        8 Respond to a Loss of Instrument Air K. APE 062 Loss of Service Water [APE 062 AA2.01 (2.9/3.5)]
D, R, E      4S Loss of North SW Header in the Auxiliary Building NUREG-1021, Revision 10
ES-301                              Control Room/In-Plant Systems Outline                              Form ES-301-2 (REV_011116)
@          All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.
* Type Codes                                    Criteria for RO / SRO-I / SRO-U (A)lternate path                                                            4-6 (5) /4-6 (5) / 2-3 (3)
(C)ontrol room (D)irect from bank                                                            9 (9) / 8 (8) /  4 (4)
(E)mergency or abnormal in-plant                                              1 (3) / 1 (3) /  1 (2)
(EN)gineered Safety Feature                                                    1 (2) / 1 (2)/  1 (2) (Control Room System)
(L)ow-Power / Shutdown                                                        1 (3) / 1 (2) /  1 (1)
(N)ew or (M)odified from bank including 1(A)                                  2 (2) /  2 (2) /  1 (1)
(P)revious 2 exams                                                            3 (3) /  3 (3)/  2 (2) (Randomly Selected)
(R)CA                                                                        1 (2 )/ 1 (2) /  1 (1)
(S)imulator JPM Summary JPM A This is a Bank JPM. The operator will be told that the plant is at 100% power, that due to abnormal conditions on the Grid, 480V Bus E-2 currently has exceeded 505 volts, that AOP-031, Operation with High Switchyard Voltage, has been completed up to step 21, and other preliminary information. The operator will be directed to continue with AOP-031 until 480V Bus E-2 voltage is restored to less than 505 Volts. The operator will be expected to transfer 4KV Bus 4 & 5 from the UAT to the SUT (via 4KV Bus 3) in an effort to lower Switchyard Voltage; and when Breaker 50/20 fails to automatically OPEN (Alternate Path), the operator will manually open it per AOP-31. This JPM was previously used on the 2013 NRC Exam, randomly selected for use on the 2016 Exam.
JPM B This is a modified Bank JPM. The operator will be told that a plant startup is in progress with reactor power approximately 18%, that the A and B S/G levels are being controlled with the Feedwater Regulating Valves operating in AUTO, and that the C S/G level is being controlled on the Feedwater Regulating Bypass Valve. The operator will be directed to transfer the C S/G level control to the Main Feedwater Regulating Valve in accordance with Step 6.4.12 of GP-005, Power Operation. The operator will be expected to place the C Feed Reg Valve in AUTO, and then take manual control of the B Feed Reg Valve and stabilize the B S/G level (Alternate Path) when it is determined that the B Feed Reg Valve has failed to control the B S/G level in AUTO.
JPM C This is a Bank JPM The operator will be told that the plant is at 100% power, that APP-003-D3, PRT HI/LO LEVEL, has alarmed, that the cause of the low level is known leakage from the PRT to the RCDT, and that the PRT level is stable at 67%. The operator will be directed to restore PRT level to normal IAW OP-103, Pressurizer Relief Tank Control System. The operator will be expected to refill the PRT in accordance with Section 8.2.2 of OP-103; and then diagnose and relieve the hydraulic lock on RC-519B (Alternate Path) in accordance with Section 8.4.1 of OP-103.
JPM D This is a New JPM. The operator will be told that the plant is stabilized at 2% power, that the RCS is at normal operating temperature and pressure, and that a plant startup is in progress IAW GP-003, Normal Plant Startup From Hot Shutdown to Critical, and complete through Step 8.4.7. They will also be told that they are the OATC, and that the NUREG-1021, Revision 10
ES-301                      Control Room/In-Plant Systems Outline                Form ES-301-2 (REV_011116)
BOP is temporarily outside the Control Room. The operator will be directed to pull control rods to stabilize reactor power between 3-5% by continuing with Step 8.4.8 of GP-003. The operator will start to raise reactor power to 3-5%. Then, the operator will manually trip the reactor, attempt to manually actuate Safety Injection and manually start SI Pumps in response to an ejected rod (Alternate Path).
JPM E This is a Bank JPM. The operator will be told that a large break LOCA has occurred, and that the plant is currently on Cold Leg Recirculation IAW EOP-ES-1.3, Transfer to Cold Leg Recirculation. The operator will be directed to transfer to Long Term Recirculation IAW EOP-ES-1.4, Transfer to Long Term Recirculation. The operator will be expected to align for Long Term Recirculation per EOP-ES-1.4, and align only the B RHR Pump for operation when it is determined that SI-863A has failed to OPEN (Alternate Path).
JPM F This is a Bank JPM. The operator will be told that the plant is at 100% power, that the SI ACCUM C HI/LO LVL (APP-002-E4) alarm has been received and actions have been reviewed by the RO, that OP-202, Section 5.2.1.1 Initial Conditions have been completed, and other preliminary information. The operator will be directed to fill SI Accumulator C to reset the low level alarm IAW OP-202, Section 5.2.1. The operator will be expected to refill SI Accumulator C to reset the low level alarm without exceeding specified limits. This was previously used on the 2013 NRC Exam, randomly selected for use on the 2016 Exam.
JPM G This is a Bank JPM. The operator will be told that the plant is shutdown 36 hours after a trip from 100% power, and that SR Channel N-31 has just failed low. The operator will be directed to remove SR Channel N-31 from service IAW OWP-011, Nuclear Instrumentation. The operator will be expected to remove SR Channel N-31 from service IAW NI-5 of OWP-011.
JPM H This is a Bank JPM. The operator will be told that the plant is shutdown at normal operating temperature and pressure, that the B RCP was stopped 7 hours earlier for motor inspection, that Section 8.1 of OP-101, Reactor Coolant System and Reactor Coolant Pump Startup and Operation, has been completed through Step 8.1.1.2.y in preparation for starting the Reactor Coolant Pump, and that it is intended to bypass the Degraded Grid Protection prior to the RCP start and return it to service after the RCP is started per OP-101, and an AO is standing by to assist in this process. The operator will be directed to start the B Reactor Coolant Pump by continuing with Step 8.1.1.2.z of OP-101. The operator will be expected to start the B RCP IAW OP-101.
JPM I This is a Bank JPM. The operator will be told that the Plant has experienced a loss of onsite and offsite power, that EOP-ECA-0.0, Loss of All AC Power, has been implemented, that Wide Range levels in all three SGs are 55%, that Steam Generator pressures are 1075 psig, and that the SDAFW Pump has just been started. The operator will be directed to locally perform Attachment 4, Local Control Of S/G Level And Pressure, of EOP-ECA-0.0. The operator will be expected to control AFW flow to the Steam Generators and align the Nitrogen System to the SG PORVs IAW Attachment 4 of EOP-ECA-0.0. This was previously used on the 2014 NRC Exam, randomly selected for use on the 2016 Exam.
JPM J This is a Bank JPM. The operator will be told that the IA Header Pressure is 75 PSIG and lowering, that AOP-017, Loss Of Instrument Air, has been entered, that the Station NUREG-1021, Revision 10
ES-301                    Control Room/In-Plant Systems Outline              Form ES-301-2 (REV_011116)
Air Compressor is under clearance and disassembled, and that the Station Air Receiver is depressurized and vented. The operator will be directed to perform AOP-017 Step 8.
The operator will be expected to start IA Compressors A and B and align their discharge to supply air to the Instrument Air Header in accordance with Step 8 of AOP-017.
JPM K This is a Bank JPM. The operator will be told that the plant is at 100% power, that the North SW header has ruptured inside the Auxiliary Building, and that the Control Room has implemented AOP-022 (Loss of Service Water) for a leak in the North header. The operator will be directed to perform the local subsequent actions IAW Attachment 6 of AOP-022. The operator will be expected to isolate the intact SW header from the ruptured header, isolate the leak, and align cooling water to critical loads IAW Attachment 6 of AP-022.
NUREG-1021, Revision 10
ES-301                                          Operating Test Quality Checklist                      Form ES-301 -3 (Rev_O1 2316)
Facility:          Robinson            Date of                2/2016              Operating Test Number: N 16-1 Examination:
nftials
: 1. GENERALCRITERIA                                                      b*
a                c#
: a. The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g. 10 CFR 55.45, operational importance, safety function distribution).
: b.      There is no day-to-day repetition between this and other operating tests to be administered during this examination.                                                                      .
: c.      The operating test shall not duplicate items from the applicants audit test(s) (see Section D.1.a).
: d.      Overlap with the written examination and between different parts of the operating test is within acceptable limits.
: e.      It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license level.
: 2. WALK-THROUGH CRITERIA                                            -          -
: a. Each JPM includes the following, as applicable:
initial conditions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee                /
C operationally important specific performance criteria that include:
            -  detailed expected actions with exact criteria and nomenclature
            -  system response and other examiner cues
            -  statements describing important observations to be made by the applicant
            -  criteria for successful completion of the task
              -  identification of critical steps and their associated performance standards
              -  restrictions on the sequence of steps, if applicable
: b.      Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301 -1 and 2) have not caused the test to deviate from t._
any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.                                                    =
: 3. SIMULATOR CRITERIA                                            -          -
The associated simulator operating tests (scenario sets) have been reviewed in accordance                          ç with Form ES-301 -4 and a copy is attached.
Printed Name I Signature                              Date
: a.      Author                                                                                                ifi /iC
: b.      Facility Reviewer f*)
: c.      NRC Chief Examiner        (#)            )  roj                            e? tL....              i/  Z711 c U.      NRC Supervisor
(
NOTE:
* The facility signature is not applicable for NRC-developed tests.
                #    Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
NUREG-1021, Revision 10
4 ES-301                                            Simulator Scenario Quality Checklist                            Form ES-301 -4 (Rev_O1 2316) 2/2016        Scenario Numbers:  1, 2,3  Operating Test No.:        N16-1 Facility:    Robinson                  Date of Exam:
Initials QUALITATIVE ATTRIBUTES a    b*      c#
: 1.        The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events.                                          t_-
: 2.        The scenarios consist mostly of related events.                                                          a.
: 3.        Each event description consists of
            .      the point in the scenario when it is to be initiated
            .      the malfunction(s) or conditions that are entered to initiate the event
            .      the symptoms/cues that will be visible to the crew
            .      the expected operator actions (by shift position)
            .      the event termination point (if applicable)
: 4.        The events are valid with regard to physics and thermodynamics.                                            C.
: 5.        Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.
: 6.        If time compression techniques are used, the scenario summary clearly so indicates. Operators have sufficient time to carry out expected activities without undue time constraints. Cues are            t..  \
given.
: 7.        The simulator modeling is not altered.
: 8.        The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure            t that functional fidelity is maintained while running the planned scenarios.
: 9.        Every operator will be evaluated using at least one new or significantly modified scenario. All other scenarios have been altered in accordance with Section D.5 of ES-301.
: 10.      All individual operator competencies can be evaluated, as verified using Form ES-301 -6 (submit                          ttL the form along with the simulator scenarios).
: 11.      The scenario set provides the opportunity for each applicant to be evaluated in each of the applicable rating factors. (Competency Rating factors as described on forms ES-303-1 and ES-303-3.)
: 12.        Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).
L
: 13.        The level of difficulty is appropriate to support licensing decisions for each crew position.
Target Quantitative Attributes (Per Scenario; See Section D.5.d)                Actual Attributes      -
1      2    3
: 1.        Malfunctions after EOP entry (1-2)                                                    1      2    2
: 2.        Abnormal events (2-4)                                                                4      4    5
: 3.        Major transients (1-2)                                                                1      1      1
: 4.        EOPs entered/requiring substantive actions (1-2)                                      2      2      1
: 5.        EOP contingencies requiring substantive actions (0-2)                                  0      1      1
: 6.        Critical tasks (2-3)                                                                  3      3      2 NOTE:
* The facility signature is not applicable for NRC-developed tests.
                        # Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
NUREG-1021, Revision 10
ES-301                                          Simulator Scenario Quality Checklist                            Form ES-301-4 (Rev_012316)
Robinson                    Date of Exam:        2/2016        Scenario Numbers: 4, 5,6  Operating Test No.:        N16-1 Facility:
Initials QUALITATIVE ATTRIBUTES a    b*      c#
: 1.      The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events.                                        t              (j
: 2.        The scenarios consist mostly of related events.                                                          c...
: 3.        Each event description consists of
          .      the point in the scenario when it is to be initiated
          .      the malfunction(s) or conditions that are entered to initiate the event
          .      the symptoms/cues that will be visible to the crew                                                ct.
          .      the expected operator actions (by shift position)
          .      the event termination point (if applicable)
: 4.        The events are valid with regard to physics and thermodynamics.                                          _
: 5.      Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.
: 6.      If time compression techniques are used, the scenario summary clearly so indicates. Operators have sufficient time to carry out expected activities without undue time constraints. Cues are given.                                                                                                                    cO
: 7.      The simulator modeling is not altered.                                                                  L..
: 8.      The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.                                      U
: 9.      Every operator will be evaluated using at least one new or significantly modified scenario. All other scenarios have been altered in accordance with Section D.5 of ES-301.
: 10.      All individual operator competencies can be evaluated, as verified using Form ES-301 -6 (submit the form along with the simulator scenarios).
1 1. The scenario set provides the opportunity for each applicant to be evaluated in each of the applicable rating factors. (Competency Rating factors as described on forms ES-303-1 and ES-              .
303-3.)
: 12.      Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301 -5 (submit the form with the simulator scenarios).
: 13.      The level of difficulty is appropriate to support licensing decisions for each crew position.
Target Quantitative Attributes (Per Scenario; See Section D.5.d)              Actual Attributes      -      -
4      5    6
: 1.        Malfunctions after EOP entry (1-2)                                                    1      1    3
: 2.        Abnormal events (2-4)                                                                4      3    4
: 3.        Major transients (1-2)                                                                2      1    1
: 4.        EOPs entered/requiring substantive actions (1-2)                                      2      2    2
: 5.        EOP contingencies requiring substantive actions (0-2)                                1      1      7
: 6.        Critical tasks (2-3)                                                                  2      2    2 NOTE:
* The facility signature is not applicable for NRC-developed tests.
                      # Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
NUREG-1021, Revision 10
ES-301                                                  Transient and Event Checklist                                                          Form ES-301-5 (Rev_Of 2516)
Facility:            Robinson                                        Date of Exam:          2/2016                    Operating Test No.:              N16-1 A          E                                                                        Scenarios P          V            N16-1-1                  N16-1-2                N16-1-3                N16-1-6                T                      M P          F                                                                                                            0                        I L          N                                                                                                            T                      N CREW                    CREW                    CREW                    CREW I          T            POSITION                POSITION                POSITION                                        A                        I POSITION C                                                                                                                          L                    M A          I                                                                                                                                    u N          Y T          P          S      A        B      S      A        B      S      A      B      S        A      B                    R          I          U E          R      T        0      R      T        0      R      T      0        R        T      0 0      C        P      0      C        P      0      C      P      0        C      P RX                                                                                                                1          1          1            0 2
NOR                                                                                                              2          1          1            1 1,2,                                                    1,4,                            1,3, 17          4        4            2 SROI-l        I/C            5 6                                                        6                                6 MA]                                                                                                              3          2        2            1 1,2 TS                                                                                                                2          0        2            2 2
RX                                                                                                                7          1          1            0 1,3    1 NOR                                                                                                              3          1          1            1 2,4,  2,3,                                                      4,5 9          4        4            2 SROI-3        I/C 6      6                                                        6 MA]                                                                                                              3          2        2            1 TS                                                                                                                2          0        2            2 1
RX                                                                                                                1          1          1            0 3                                        2 NOR                                                                                                              2          1          1            1 2,4,            1,2,                                    1,3, 12          4        4            2 SROI-5        I/C                                        8,9              4,5                                      7,9 6                6                                        6 MA]                                                                                                                          2          2            1 1,5 TS                                                                                                                2          0          2            2 2
RX                                                                                                                1          1          1            0 1      3 NOR                                                                                                              2          1          1            1 3,5    1,2, 4          4            2 SROI-6        I/C                                                                                                              8 6      6                                6 MA]                                                                                                              3          2          2            1 1,5 TS                                                                                                              2          0          2            2 Instructions:
: 1.          Check the applicant level and enter the operating test number and Form ES-D-1 event numbers tor each event type; TS are not applicable for RO applicants. ROs must service in both the at-the-controls (ATC) and balance-ot-plant (BOP) positions; Instant SROs (SRO-l) must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one malor transient, in the ATC position. If an Instant SRO-l additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
: 2.          Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix 0. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.
: 3.          Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.
For licensees that use the ATC operator pnmahly for monitoring plant parameters, the chief examiner may place SRO-l applicants in either the ATC or
* BOP position to best evaluate the SRO-l in manipulating plant controls.
NUREG 1021 Revision 10
ES-301                                                  Transient and Event Checklist                                                          Form ES-301-5 (Rev_O1 2516)
Facility:            Robinson                                        Date of Exam:            2/2016                  Operating Test No.:                N16-7 A            E                                                                      Scenarios P            V            N16-1-1                  N16-1-2                  N16-l-3                  N16-1-6              T                      M P            E                                                                                                            0 L            N                                                                                                            T                      N CREW                    CREW                      CREW                    CREW T          POSITION                POSITION                                                                  A                        I POSITION                POSITION C                                                                                                                          L                      M A            T                                                                                                                                    U N            Y T            P        S      A        B      S      A        B      S      A      B        S        A      B                    R          I          U E        R      T        0      R      T        0      R      T      0        R        T    0 0        C        P      0      C        P      0      CPO                      C      P RX                                                                                            2 1            1        1            0 1
NOR                                                                                                              2            1        1            1 3,5    1,2, SROI-7        I/C                                                                                                              8          4          4            2 MAJ                                                  6      6                                6 3          2          2            1 1,5 TS                                                                                                              2          0          2            2 RX                                                                                                              1            1        1            0 1,3                                                      2 NOR                                                                                                              3            1        1            1 2,4,                                      1,4,            1,3, SROI-8        I/C                                                                                  4,5                      10          4          4            2 6                                        6              6 MAJ                                                                                                              3          2          2            1 IS                                                                                                                2          0          2            2 RX                                                                                                              7          1          1            0 1,3                                                      2 NOR                                                                                                              3          1          1            1 2,4,                                    1,4,            1,3, SROI-9        I/C 10          4          4            2 6                                        6              6 MAJ                                                                                                              3          2          2            1 Is                                                                                                                2          0          2            2 RX                                                                                                                1          1          1            0 NOR                                                                                                              1          1          1            1 1,4,                                                      1,2, RO-1                                                                                                                                        4          4            2 I/C                                                                                                              6 6                                                        6 MAJ                                                                                                              2          2          2            1 TS                                                                                                                0          0          2            2 Instructions:
: 1.          Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must service in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SRO5 (SRO-l) must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO-l additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
: 2.          Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. () Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.
: 3.          Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.
For licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-l applicants in either the ATC or GOP position to best evaluate the SRO-l in manipulating plant controls.
NUREG 1021 Revision 10
ES-301                                                  Transient and Event Checklist                                                            Form ES-301 -5 (Rev_O1 2576)
Facility:            Robinson                                        Date of Exam:          2/2016                  Operating Test No.:                N16-1 A              E                                                                      Scenarios P            V            N16-f-1              N16-1-2                  N16-l-3                  N16-l-6              T                      M P            E                                                                                                          0                        I L            N                                                                                      CREW                T                      N CREW                  CREW                      CREW I            T          POSITION              POSITION                  POSITION                POSITION              A                      I C                                                                                                                          L                      M A            I                                                                                                                                  u N            Y T            P        5      A      B      S        A        B      S      A      B        S      A      B                    R          I          U E        A      1      0      A        1        0      R      1      0        R      1      0 0      C      P      0        C        P    0        C      P      0        C      P 1                                                                    1          1          1          0 RX NOR                                                                                                              1          1          1          1 2.4,                            1,2,                                7          4          4            2 8, 9                            7 RO-2            I/C 6                                6                                    2          2          2          1 MAJ TS                                                                                                                0          0        2            2 1                                                                    1          1          1          0 RX NOR                                                                                                                          1          1          1 24,                              1,2,                                                                    2 7          4          4
: 8. 9                            7 RO-3            I/C 6                                6                                    2          2          2          1 MAJ Is                                                                                                              0          0          2          2 RX                                                                                                              1            1          1          0 1                                                          1            1          1          1 NOR 1,5                                                                                            4          4          4          2 RO-4            I/C 6                                6                                                          2          2          2          1 MA]
TS                                                                                                                0          0          2          2 RX                                                                                                              0          1          1        0 2                          2            1          1          1 NOR 1,2,                                                                      1,3,                                    4          4          2 SROU-1          I/C                                                                                4.5                        8 6                                                                        6                          2          2          2          1 MAJ 1,2                                                                                                  4            0          2          2 TS Instructions:
: 1.          Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must service in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SRO5 (SAC-I) must serve in both the SAC and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position, If an Instant SRO-l additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
: 2.            Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. () Reactivity snd normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.
: 3.          Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.
For licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-l applicants in either the ATC or SOP position to best evaluate the SAC-I in manipulating plant controls.
NUREG 1021 Revision 10
ES-3d                                                    Transient and Event Checklist                                                          Form ES-301-5 (Rev_012516)
Facility:            Robinson                                        Date of Exam:            2/207 6                  Operating Test No.:              N16-1 A            F                                                                      Scenarios P          V              N16-1-1                  N16-1-2                N16-1-6                  N16-1-5              I                      M P            F                                                                                                            0                      I L          N                                                                                                              T                      N CREW                    CREW                    CREW                    CREW I          T            POSITION                POSITION              POSITION                  POSITION              A C                                                                                                                          L                      M A            T                                                                                                                                    u N            Y T            P          S      A        B        S      A      B      S        A      B        S        A      B                    A          I          U E          R      T      0        R      T      0      R        T      0        A        T      0 0        C      P        0      C      P      0        C      P        0        C      P AX                                                                                                              0            1        1            0 1
NOR                                                                                                              2            1        1            1 1,2,                                                                      2,3, 4.5 8            4        4            2 SROU-2        I/C        45 6                                                                        6                          2            2        2            1 MAJ 1,2                                                                                                  4                                  2 TS                                                                                                                            0        2 RX                                                                                                              7            1        1            0 1                                                                1 NOR                                                                                                              2            1        1            7 1,5            2,3,                                                            2,3        8            4        4            2 SROI-2        I/C                                45 6              6                                                                6                                              1 MAJ                                                                                                              3            2        2 TS                                                                                                              2            0        2            2 1
RX                                                                                                              7            1          1          0 1                                      2 NOR                                                                                                              2            1          1            7 2,3,                                    1,3,            4,5, 4,5                                      7,9              7 4        4            2 SROI-4        I/C 6                                        6                6                  3                      2            1 MA]                                                                                                                          2 TS                                                                                                              2            0        2            2 RX                                                                                                                          1          1            0 NOR                                                                                                                          1          1            1 4        4            2 I/C MAJ                                                                                                                          2          2            1 TS                                                                                                                            0          2            2 Instructions:
: 1.          Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable tor RO applicants. ROs must service in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SROs (SRO-l) must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO-l additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
: 2.          Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. () Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-I basis.
3            Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.
For licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-I applicants in either the ATC or BOP position to best evaluate the SRO-l in manipulating plant controls.
NUREG 1021 Revision 10
ES-3D 1                                        Competencies Checklist                      Form ES-3D 1-6 (Rev_Of 2376)
Facility:      Robinson          Date of Examination:          2/2016          Operating Test No.:      N16-1 APPLICANTS SRO (U/I)                    RO/ATC                      BOP Competencies                      SCENARIO                    SCENARIO                SCENARIO 1      2      3      4    1    2    3      4    1    2      3      4 I nterpret/Diag nose Events and                        1-7    1-9    1-8    1-9  1-7  1-9  1-8    1-9    1-7  1-9    1-8    1-9 Conditions Comply With and Use              1-7    1-9    1-8    1-7  1-7  1-9  1-8    1-9    1-7  1-9    1-8    1-9 Procedures (1)
Operate Control                                                                                              2,4, 1 2  1 3    1 2  1 2          1 2 Boards (2)                      NA      NA      NA      NA          4,6, 4:5:  3:7:  3,4,          3:6:
6      7 8,9    6      9    6,7 Communicate and                  1-7    1-9    1-8    1-9  1-7    1-9  1-8    1-9  1-7  1-9    1-8    1-9 Interact Demonstrate Supervisory Ability              1-7    1-9      1-8    1-9  NA    NA  NA    NA    NA    NA      NA    NA (3)
Comply With and Use              1-2    3-4      1,5    4-5  NA    NA  NA    NA    NA    NA      NA    NA Tech. Specs. (3)
Notes:
(1)  Includes Technical Specification compliance for RO.
(2) Optional for an SRO-U.
(3) Only applicable to SROs.
Instructions:
Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant. (This includes all rating factors for each competency.) (Competency Rating factors as described on forms ES-303-1 and ES-303-3.)
NUREG-1021, Revision 10
ES-301                                        Competencies Checklist                    Form ES-301 -6 (Rev 012316)
Facility:    Robinson          Date of Examination:          2/2016        Operating Test No.:  N16-1 APPLICANTS SRO (U/I)                  RO/ATC                  BOP Competencies                        SCENARIO                    SCENARIO            SCENARIO 5      6                  5      6              5    6 Interpret/Diagnose Events and                      1-7    1-9                  1-7    1-9            1-7  1-9 Conditions Comply With and Use                                          1-7    1-9            1-7  1-9 1-7    1-9 Procedures (1)
Operate Control                                              1,4,                        1,2, 24            12 Boards (2)                      NA      NA                  5,6,                        3,6, 56          36 Communicate and                                              1-7    1-9            1-7  1-9 1-7    1-9 Interact Demonstrate Supervisory Ability              1-7      1-9                NA    NA              NA  NA (3)
Comply With and Use                                          NA    NA              NA    NA 3,5    3-4 Tech. Specs. (3)
Notes:
(1)  Includes Technical Specification compliance for RO.
(2)  Optional for an SRO-U.
(3)  Only applicable to SROs.
Instructions:
Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant. (This includes all rating factors for each competency.) (Competency Rating factors as described on forms ES-303-1 and ES-303-3.)
NUREG-1021, Revision 10
ES-401                                          PWR Examination Outline                                          Form ES-401-2 Facility:    ROBNSON                                    Date of Exam:  FEBRUARY 2016 ROK/ACatpoPah-its                                      SRO-Only_Points Tier          Group KKKKKKAAAAG                                                      A2            G*      Total 1    2 3 4 5 6              1  2 3 4
* Total
: 1.              1          3    3  3                  3  3              3      18        3            3        6 Emergency &
Abnormal              2              .1 .2_        N/A      1  2      N/A      1    9          2            2        4 Evolutions        Tier Totals    4    5  5                4    5              4    27          5            5        10 1          33223223332                                          28          3            2        5 2.
Plant              2          111111110                                  ii        10      0    2          1        3 Systems Tier Totals    4    4  3  3    4  3  3    4    3    4    3    38          5            3        8
: 3. Generic Knowledge and AbUities Categories 1L2]3J                      4]      io    [N 1    2    3  j  4      7 3        2        2        3              ftl      2    2      2 Note:      1. Ensure that at least two topics from every applicable K/A category are sampled within each tier of the RO and SRO-only outlines (i.e., except for one category in Tier 3 of the SRO-only outline, the Tier Totals in each K/A category shall not be less than two). (One Tier 3 Radiation Control K/A is allowed if the K/A is replaced by a K/A from another Tier 3 Category).
: 2. The point total for each group and tier in the proposed outline must match that specified in the table. The final point total for each group and tier may deviate by +/-1 from that specified in the table based on NRC revisions. The final RO exam must total 75 points and the SRO-only exam must total 25 points.
: 3. Systems/evolutions within each group are identified on the associated outline; systems or evolutions that do not apply at the facility should be deleted with justification; operationally important, site-specific systems/evolutions that are not included on the outline should be added. Refer to Section D.1 .b of ES-401 for guidance regarding the elimination of inappropriate K/A statements.
: 4. Select topics from as many systems and evolutions as possible; sample every system or evolution in the group before selecting a second topic for any system or evolution.
: 5. Absent a plant-specific priority, only those K/As having an importance rating (IR) of 2.5 or higher shall be selected. Use the RO and SRO ratings for the RO and SRO-only portions, respectively.
: 6. Select SRO topics for Tiers 1 and 2 from the shaded systems and K/A categories.
: 7. The generic (G) K/As in Tiers I and 2 shall be selected from Section 2 of the K/A Catalog, but the topics must be relevant to the applicable evolution or system. Refer to Section D.1 .b of ES-401 for the applicable K/As.
: 8. On the following pages, enter the K/A numbers, a brief description of each topic, the topics importance ratings (IRs) for the applicable license level, and the point totals (#) for each system and category. Enter the group and tier totals for each category in the table above; if fuel handling equipment is sampled in a category other than Category A2 or G on the SRO-only exam, enter it on the left side of Column A2 for Tier 2, Group 2 (Note #1 does not apply). Use duplicate pages for RO and SRO-only exams.
: 9. For Tier 3, select topics from Section 2 of the K/A catalog, and enter the K/A numbers, descriptions, IRs, and point totals f#) on Form ES4OI-3. Limit SRO selections to K/As that are linked to 10 CFR 55.43.
G*    Generic K/As
ES-401, REV 9                                            TIGI PWR EXAMINATION OUTLINE                                                    FORM ES-40f-2 KA          NAME I SAFETY FUNCTION:                  IR    Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO    SRO 007EK2.02    Reactor Trip Stabilization Recovery  2.6  2.8      fl j  1J            fl  Breakers, relays and disconnects
            /1 008AG2. 1.30 Pressurizer Vapor Space Accident / 3  4.4  4.0 DEDüLLJ                        Ability to locate and operate components, including local controls.
OO9EA1 .10  Small Break LOCA/ 3                  3.8  3.9 LELDEL]                        Safety parameter display system 01 1EK3.15  Large Break LOCA /3                  4.3  4.4 LEDE1L1EDDD                    Criteria for shifting to recirculation mode 022AA2.03    Loss of Rx Coolant Makeup 1 2        3.1  3.6 L]DCEÜEIfl ic1L1L              Failures of flow control valve or controller 025AG2.4.47  Loss of RHR System /4                4.2  4.2                                Ability to diagnose and recognize trends in an accurate and timely manner utilizing the appropriate control room reference material.
027AK2.03    Pressurizer Pressure Control System  2.6  2.8 ELüDLDE1                        Controllers and positioners Malfunction / 3 029EK2.06    ATWS/1                                2.9  3.1                                Breakers, relays, and disconnects.
038EK1 .04  Steam Gen. Tube Rupture I 3          3.1  3.3                                Reflux boiling 040AK1 .05                      -
Steam Line Rupture Excessive Heat    4.1                                      Reactivity effects of cooldown LE1DLJL1EELi Transfer I 4 054AA1 .03  Loss of Main Feedwater / 4            3.5  3.7                                AFW auxiliaries, including oil cooling water supply Page 1 of 2                                                06/22/2015 9:28 AM
ES-401, REV 9                                      If GI PWR EXAMINATION OUTLINE                                                      FORM ES-401-2 KA          NAME I SAFETY FUNCTION:              IR    Kl 1(2 K3 1(4 1(5 1(6 Al A2 A3 A4 G TOPIC:
RD    SRO 055EK3.02  Station Blackout / 6              4.3  4.6                                      Actions contained in EOP far loss of offsite and onsite El El 1] El El El El El El El El    power 056AA2.1 1  Loss of Off-site Power I 6        2.9  2.9                                      Operational status of service water booster pump ElEEElElEElElDEl 057AA2fr Loss of Vital AC Inst. Bus / 6                                                                                          fflVer-&aIteete aur Th 3*7    Y*I                                                                P o. C.      o4 ot2cfrttCJ Tko.1        . I 058M1 .02  Loss of DC Power / 6              3.1  3.1                                      Static inverter dc input breaker, ftequency meter, ac CElDElElEElD[1L                    output breaker and ground fault detector weO4EG2.4.% LOCA Outside Containment /3      4.2  4.2                                      Ability to verify that the alarms are consistent with the ElElElEElElDLiDEH                  plant conditions.
WEO5EK3.4                              -
Inadequate Heat Transfer Loss of  3.7  3.9                                      RO ai SRO function within the control room team as EElElDDDElDEEl                      appropriate to the assigned position, in such a way that Secondary Heat Sink / 4 procedures ate adhered to and the limitations in the facilities license and amendments are not violated.
WE11EK1,1  LossofEmergencyCoolantRecirc.I4  3.7  4.0    El El El El El El El El El El    Components, capacity, and function of emergency Systems.
Page 2 of 2                                                  06/22/2015 9:28 AM
ES-401, REV 9                                            TIG2 PWR EXAMINATION OUTLINE                                                        FORM ES-401-2 KA            NAME I SAFETY FUNCTION:                  IR    Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G        TOPIC:
RO    SRO 005AK2.02    lnoperablelstuck Control Rod /1      2.5  2.6 2]      2] 2] 2] 2] 2] 2] 2] 2)) 2]    Breakers, relays, disconnects and control room switches 028AK1 .01    Pressurizer Level Malfunction I 2    2.8  3.1 ]J 2] 2] 2] 2] 2] 2] 2] 2] [2] 2]      PZR reference leak abnormalities 032AA2.02    Loss of Source Range NI I 7          3.6  3.9 2] 2] 2] 2] 2] 2] 2]          2] 2] 2]  Expected change in source range count rate when rods are moved 033AK3.01    Loss of Intermediate Range NI / 7    3.2  3.6 2] 2]      [2] 2] 2] 2] 2] [2] 2] 2]    Termination of startup following loss of intermediate-range instrumentation 060AK2.01    Accidental Gaseous Radwaste Rel. I 9  2.6  2.9 2]      2] 2] 2] 2] 2] 2] 2] 2] 2]      ARM system, including the normal radiation-level indIcations and the operability status 067AA1 .09    Plant Fire On-site / 8                3    3.3 2] 2] 2] 2] 2] [2]      [j 2] 2] 12] 2] Plant fire zone panel (including detector location) 068AK3. 12    Control Room Evac. /8                4.1  4,5 2] 2]      2] 2] 2] 2] 2] 2] 2] 2]      Required sequence of actions for emergency evacuation of control room 076AA2.04    High Reactor Coolant Activity /9    2.6    3  2)) 2)) 2] 2)) 2] 2] 2] J 2)) [2] 2]    Process effluent radiation chart recorder we09EG2. 1.20 Natural Circ. / 4                    4.6    4.6 [1.                                    Ability to execute procedure steps.
2] 2] 2] 2] 2] 2] 2] 2] 2]      [j Page 1 of 1                                                    06/22/2015 9:28 AM
ES-401, REV 9                                  T2GI PWR EXAMINATION OUTLINE                                                        FORM ES-401-2 KA        NAME I SAFETY FUNCTION:            IR    Ki K2 K3 1<4 K5 K6 Al A2 A3 A4 G      TOPIC:
RO    SRO 003A3.01  Reactor Coolant Pump            3.3  3.2            fl                ?1 []    Seal injection flow 003K4.07  Reactor Coolant Pump            3.2  3.4    fl                  fl [J fl EJ J  Minimizing RCS leakage (mechanical seals) 004K2.06  Chemical and Volume Control    2.6  2.7 [] (i)] (J [] [] fl fl [] U U U        Control instrumentation 005A2.02  Residual Heat Removal          3,5  3.7                    tJ U            U  Pressure transient protection during cold shutdown 005K6.03  Residual Heat Removal          2.5  2.6    U U U U                          EJ RHR heat exchanger 006A1.13  Emergency Core Cooling          3.5  3.7            U U Li      rj      U    Accumulator pressure (level. boron concentration) 0061<5.01  Emergency Core Cooling          2.8  3.3 U      U              U    []      Effects of temperatures on water level indications 007K3.O1  Pressurizer Relief/Quench Tank  3.3  3.6    U      U U U U Li Li Li U          Containment 0O8A4e. Component Cooling Water        -26L  Li                                    tt1gg of-thg CGN-pu,..p dJiorgo :ale fM                                  33    3,)                                        c.cbJ    i4,c&t,b6 o.J          o-faU 0101<6.04  Pressurizer Pressure Control    2.9  3.2  U Li Li    [1 Li        U U U U U      PRT 012A3.06  Reactor Protection              3.7  3.7  U Li Li U [1 U Li Li                  Trip logic fl Page 1 of 3                                                  06/22)2015 9:28 AM
ES-401, REV9                                          T2GI PWR EXAMINATION OUTLINE                                                  FORM ES-401-2 KA        NAME I SAFETY FUNCTION:                  IR    K1 K2 K3 K4 K5 K6 Al A2 A3 A4 G  TOPIC:
RO    SRO 012K1.05  Reactor Protection                    3.8  3.9                                  ESFAS Li 013K5.02  Engineered Safety Features Actuation 2.9    3.3 LLiI{DLEL                        Safely system logic and reliability 022A4.04  Containment Cooling                  3.1  3.2                                  Valves in the CCS 026A2.08  Containment Spray                    3.2    3.7                                  Safe securing of containment spray when it can be done)
ELE1L 039A1 .10  Main and Reheat Steam                2.9    3.0                                  Air ejector PRM 059K4.02  Main Feedwater                      3.3    3.5                                  Automatic turbine/reactor trip runback 061 1(5.01 AuxiliarylEmergency Feedwater        3.6    3.9                                  Relationship between AFW flow and RCS heat transfer DLLJL1D[1DE&#xfc;i 062K1 .04  AC Electrical Distribution          3.7  4.2  LDDflLiEE1!ZDE                  Off-site power sources 062K2.01  AC Electrical Distribution          3.3                                        Major system loads DD&#xfc;EiD1 063A3.01  DC Electrical Distribution          2.7  3.1                                  Meters, annunciators, dials, recorders and indicating lights 064A2.18  Emergency Diesel Generator          2.6  2.7                                  Consequences of premature opening of breaker under load Page 2 of 3                                                06122/2015 9:28 AM
ES-401, REV 9                                  12G1 PWR EXAMINATION OUTLINE                                                  FORM ES-401-2 KA        NAME / SAFETY FUNCTION:          IR    K1 K2 K3 K4 K5 K6 Al A2 A3 A4 G    TOPIC:
RO    SRO 064K2.02  Emergency Diesel Generator    2.8  3.1 H        H      .
U  H        Fuel oil pumps 073A4.O1  Process Radiation Monitoring  3.9  3.9    U    H                        Effluent release 073G2.4.9  Process Radiation Monitoring 3.8    4.2 H LI U Li LI LI H Li              Knowledge of low power / shutdown implications in accident (e.g. LOCA or loss of RHR) mitigation strategies.
076K1.15  Service Water                2.5    2.6 j  H Li LI LI [J Li LI  [1      FPS H LI 078K3.03  Instrument Air              3.0    3.4 Li          Ej  U] LI LI [J LI LI Cross-fled units 103G2.l.7  Containment                  4.4    4.7                                  Ability to evaluate plant performance and make
[J 4J ] U] U] U] [] U] U] ]    operational judgments based on operating characteristics, reactor behavior and instrument interpretation.
Page 3 of 3                                                06/22)2015 9:28 AM
ES-401, REV 9                                T2G2 PWR EXAMINATION OUTLINE                                                      FORM ES-401-2 KA        NAME I SAFETY FUNCTION:          IR    KI K2 K3 K4 K5 K6 Al A2 A3 A4 G      TOPIC:
RO    SRO 001K6.13  Control Rod Drive            3.6  3.7 Li Li Li Li LI        Li Li LI Li Li Location and operation of RPIS 002K4.0J  Reactor Coolant              2.7  3.0 Fl LI Li l Li Li [I Li Li El Li      Filling and draining the RCS O1IAI.02  Pressurizer Level Control    3.3  3.5 Li El LI El Li Li        LI Li LI LI Charging and letdown flows 014K5.0l  Rod Position Indication      2.7  3.0 fl      Li J        Li Li LI El Li Reasons for differences between RPIS and step counter 017A4.0l  In-core Temperature Monitor  3.8  4.1    LI Li Li LI Li [1 Li Li          Actual in-core temperatures 027K2.0f  Containment Iodine Removal  3.1  3.4 Li [) Li Li E]  LI El El Li LI LI    Fans 029G2.l.23 Containment Purge            4.3  4.4 Li Li LI Li Li LI Li Li LI El        Ability to perform specific system and integrated plant procedures during all modes of plant operation.
033K3.02  Spent Fuel Pool Cooling      2.8  3.2 Li Li J Li Li; LI Li Li LI Li Li    Area and ventilation radiation monitoring systems 035A2.05  Steam Generator              3.2  3.4 Li Li Li Li Li Li Li i Li Li Li      Unbalanced flows to the 5/Gs 068K1 .07  Liquid Radwaste              2.7  2.9    LI Li LI Li El Li Li LI Li LI    Sources of liquid wastes fo LRS Page 1 of 1                                                  06/22)2015 9:28 AM
ES-401, REV 9                                  T3 PWR EXAMINATION OUTLINE                                                          FORM ES-401-2 KA        NAME I SAFETY FUNCTION:        IR      Ki K2 K3 K4 1(5 1(6 Al A2 A3 A4  G  TOPIC:
RO    SRO G2.l .29  Conduct of operations      4.1  4.0  LiD LiD [I [I                        Knowledge of how to conduct system lineups, such as
[I [I [I valves, breakers, switches, etc.
G2.l .36  Conduct of operations      3.0    4.1                                      Knowledge of procedures and limitations involved in core LiD LiD LI LI Li Li Li [I alterations G2.1.45    Conduct of operations      4.3    4.3                                      Ability to identity and interpret diverse indications to LiD Li Li F] Li Li Li validate the response of another indication G2.2.38    Equipment Control          3.6    4.5 [IF] LiLi Li Li Li Li LI [I J        Knowledge of conditions and limitations in the facility license.
G2.2.39    Equipment Control          3.9    4.5                                      Knowledge of less than one hour technical specification LiLi ED Li LI Li EJ Li Li        j action statements for systems.
G2.3.1 3  Radiation Control          3.4    3.8                                      Knowledge of radiological safety procedures pertaining to LiE Li Li F] Li [I Li ]
licensed operator duties G2.3.4    Radiation Control          3.2  3.7                                      Knowledge of radiation exposure limits under normal and LiE LiD Li Li Li Li Li Li emergency conditions G2.4.1 1  Emergency Procedures/Plans 4.0  4.2                                      Knowledge of abnormal condition procedures.
ELi F] F] LI Li Li Li G2.4.25    Emergency Procedures/Plans 3.3  3.7 LiLi LiE F]        F]                Knowledge of fire protection procedures.
Li fl [I [I G2.4.31    Emergency Procedures/Plans 4.2  4.1                                      Knowledge of annunciators alarms, indications or
[I F] Li Li F] Li Li Li Li F] [
response procedures Page 1 of 1                                                    06/22/201 5 9:52 AM
ES-401, REV 9                                      SRO TIGI PWR EXAMINATION OUTLINE                                                    FORM ES4OI-2 KA          NAME I SAFETY FUNCTION:                  IR    1<1 1(2 K3 K4 1(5 K6 Al A2 A3 A4 G TOPIC:
RO    SRO 029EA2.06  ATWS / 1                            3.8  3.9 j                                  Main turbine trip switch position indication            -
038EG2.4.47 Steam Gen. Tube Rupture I 3        4.2    4.2    []                            Ability to diagnose and recognize trends in an accurate J []
and timely manner utilizing the appropriate control room reference material.
054AG2.4.9  Loss of Main Feedwater I 4          3.8    4.2                                    Knowledge of low power! shutdown implications in fl                      []
accident (e.g. LOCA or loss of RHR) mitigation strategies.
055EA2.06  Station Blackout! 6                3.7    4.1                                    Faults and lockouts that must be cleared prior to re energizing buses 058AG2.2.22 Loss of DC Power /6                4.0    4.7 L [J J                            Knowledge of limiting conditions for operations and D fl    J safety limits.
077AA2.03  Generator Voltage and Electric Grid 3.5    3.6                                    Generator current outside the generator capability curve Disturbances / 6
[ [J Page 1 of 1                                                06/22/2015 9:28 AM
ES-401, REV 9                                SRO TIG2 PWR EXAMINATION OUTLINE                                                  FORM ES-401-2 KA          NAME I SAFETY FUNCTION:          IR    Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G  TOPIC:
RO    SRO OO1AA2.02    Continuous Rod Withdrawal Il 4.2    4.2          U U U U        U LI LI  Position of emergency boration valve 051AG2.4.35  Loss of Condenser Vacuum /4  3.8  4.0 LI LI fl LI LI H LI LI LI LI    Knowledge of local auxiliary operator tasks during emergency and the resultant operational effects 061AA2.03    ARM System Alarms /7        3      3.3 LI LI LI LI LI fl LI    LI LI LI Setpoints for alert and high alarms weO6EG2.l.23 Degraded Core Cooling / 4    4.3    4.4    LI LI LI LI [] LI LI LI LI {] Ability to perform specific system and integrated plant procedures during all modes of plant operation.
Page 1 of 1                                              06/22/2015 9:28 AM
ES-401, REV9                          SRO T2GI PWR EXAMINATION OUTLINE                                                  FORM ES-401-2 KA        NAME I SAFETY FUNCTION:    IR    Kl 1(2 K3 1(4 K5 K6 Al A2 A3 A4 G TOPIC:
RO    SRO 01 2A2d.-  Reactor Protection                                                  IM1VtP.-....
E 2O5                            yI 7:-                                        F H)        or                                o  ddor.
                                                                                &            &lC.t)e      cJo 039A203    Main and Reheat Steam                                              Indications and alarms for main steam and area radiation monitors (during SGTR) 076G2.1.7  Service Water          4.4  4.7                                  Ability to evaluate plant performance and make EflDEJL1E operational judgments based on operating characteristics, reactor behavior and instrument interpretation.
078A2.01    Instrument Air          2.4  2.9                                    Air dryer and filter malfunctions 1 03G2.4.35 Containment            3.8  4.0                                    Knowledge of local auxiliary operator tasks during flD1ELEDD emergency and the resultant operational effects Page 1 of I                                              06(2212015 9:28 AM
ES-401, REV9                          SRO T2G2 PWR EXAMINATION OUTLINE                                                  FORM ES-401-2 KA          NAME I SAFETY FUNCTION:      IR    Kl K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO    SRO 015A2.04    Nuclear Instrumentation  3.3  3.8                                Effects au axial flux density of control rod alignment and sequencing, xenon production and decay, and boron vs.
control rod reactivity changes 068A2.02    Liquid Radwaste          2.7 2.8 EDD              L]EEfl          Lack of tank recirculation pnor to release 071 G2.4.21 Waste Gas Disposal      4.0    4.6                                Knowledge of the parameters and logic used to assess the status of safety functions Page 1 of I                                              06/22)2015 9:28AM
ES4OI, REV9                              SRO T3 PWR EXAMINATION OUTLINE                                                    FORM ES-401-2 KA      NAME I SAFETY FUNCTION:        IR    K1 K2 K3 1<4 K5 K6 Al A2 A3 A4 G  Topic:
RO    SRO G2.l.45  Conductof operations        4.3  4.3 El El El El El El El El El El i  Ability to identify and interpret diverse indications to validate the response of another indication G2.2.21  Equipment Control          2.9    4.1                                  Knowledge of pre- and post-maintenance operability ElElLElElElElElLEl requirements.
G2.2.36  Equipment Control          3.1    4.2                                  Ability to analyze the effect of maintenance activities.
ElElElElEElElElElE[
such as degraded power sources, on the status of limiting conditions of operations G2.3.12  Radiation Control          3.2    3.7                                  Knowledge of radiological safety principles pertaining to ElElDElElElElElElEl licensed operator duties G2.3.14  Radiation Control          3.4  3.8                                  Knowledge of radiation or contamination hazards that EElElUElDElElElEl may arise during normal, abnormal, or emergency conditions or activities G2.4.30  Emergency Procedures/Plans 2.7  4.1                                  Knowledge of events related to system operations/status L1ElDElElL]EiElElEl that must be reported to internal orginizations or outside agencies.
G2.4.46  Emergency Procedures/Plans 4.2  4.2                                  Ability to verify that the alarms are consistent with the E1ElEElDDEElElEl plant conditions.
Page 1 of 1                                                  06/22/2015 9:28 AM
ES-401                    Record of Rejected K/A's                        Form ES-401-4 Randomly Selected Tier / Group                                            Reason for Rejection KA Facility rarely throttles the CCW Pump discharge valves, and when this does occur (During Testing) indications of the action are in the field. Best effort was made to construct question, but it RO 2/1        008 A4.03 did NOT result in a psychometrically sound question (No Plausible Distractors). Replaced with 008 A4.01, randomly chosen by the Chief Examiner.
The AC instrument busses at the facility have no associated alarms in the Control Room, NOR does the alternate power source for those AC instrument busses. The best effort was RO 1/1        057 AA2.06 made to construct a question but it was determined we could not hit this KA. Replaced with 057 AA2.15, randomly chosen by the Chief Examiner.
The incorrect bypassing of a channel at RNP results in a plant trip in most cases. Trying to find an instrument that could be incorrectly bypassed, but not cause a trip, and then write a question to an SRO only level (most of these error scenarios SRO 2/1        012 A2.03 would be RO knowledge) was very difficult and in the attempt that was made, could be tied back to a less than one hour tech spec, and thereby removing the SRO only plausibility. Replaced with 012 A2.05, randomly chosen by the Chief Examiner.
ES4OI                                      Written Examination Quality Checklist                                      Form ES4OI-6 fadifty:      Robinson Nudear Plant                            Date of Exam:            2/1/2016      Exam Level;  RD      SRO  C Initial Item Description                                                a    b*
: 1.            Questions and answers are technically accurate and applicable to the faciflty.                            t-
: 2.            a.          NRC K/As are referenced for all questions.
: b.          Facility learning objectives are referenced as available.
: 3.          SRO questions are appropriate in accordance with Section D.2,d of ES-401
: 4.          The sampling process was random and systematic (If more than 4 RD or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR DL program office).
: 5.          Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item that applies) and appears appropriate:
the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or the examinations were developed independently; or                                                      c the ficensee certifies that there is no duplication; or other (explain)
: 6.          Bank use meets limits (no more than 75 percent                      Bank        Modified        New from the bank, at least 10 percent new, and the rest                                                                -
new or modified); enter the actual RD I SRQ-only question distribution(s) at right.                                1$  /    -    5  /        52  /    -
: 7.          Between 50 and 60 percent of the questions on the RD                    Memory                C/A exam are written at the comprehension! analysis level; the SRO exam may exceed 60 percent if the randomly                                                          L...
selected K/As support the higher cognitive levels; enter the actual RD I SRO question distribution(s) at righi 32    I    -          43  /  -
: 8.          RelerencesThandouts provided do not give away answers                                                      ,    &#xa3;_.
or aid in the elimination of distractors.
: 9.          Question content conforms with specific K/A statements in the previously approved examination outline and is appropriate for the tier to which they are assigned;                            (. ft deviations are justified.
: 10.        Question psychometric quality and format meet the guidelines in ES Appendix B.
: 11.        The exam contains the required number of one-point, multiple choice Items; the total is correct and agrees with the value on the cover sheet.
Printed Name I Signature                                  Date
: a. Author                                          Ci(A sSmf,.(
: b. Facility Reviewer f)
: c. NRC Chief Examiner(#)                            Doi          i).  .,d        ,                                        2//    t6 U. NRCRegionalSupervisor                              lQi..p&a c
Note:
* The facility reviewers initials/signature are not applicable br NRC-developed examinations.
              # Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
ES4OI                                    Written Examination Quality Checklist                                      Form ES4OI-6 Fadilty:    Robinson Nuclear Plant                            Date of Exam:          2/1/2016      Exam Level:  RO      SRO    ]
Initial Item Description                                                a    b*    c
: 1.        Questions and answers are technically accurate and applicable to the facility.                            C-  .,,. j,
: 2.        a.          NRC K/As are referenced for all questions.
: b.          Facility learning objectives are referenced as available.
: 3.        SRO questions are appropriate in accordance with Section D.2.d of ES-401 C,.
: 4.        The sampling process was random and systematic (II mote than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR OL program office).                          c.    --
: 5.        Question duplication from the license screenlng!audit exam was controlled as Indicated below (check the Item that applies) and appears appropriate:
            -the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or the examinations were developed Independently; or the licensee certifies that there Is no duplication; or other (explain)
: 6.        Bank use meets limits (no more than 75 percent                      Bank        Modified        New from the bank, at least 10 percent new, and the test new or modified); enter the actual RO I SRO-only                                                            C question distribution(s) at right.                              1$  /  4    5  /  5      52  1    16
: 7.        Between 50 and 60 percent of the questions on the RO                    Memory              C/A exam are written at the comprehension! analysis level; the SRO exam may exceed 60 percent If the randomly                                                        1__.
selected K/As support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at right.
32    /  4          43  /  21
: 8.        References/handouts provided do not give away answers                                                      t._
or aid In the elimination of distractors.
: 9.        Question content conforms with specific K/A statements in the previously approved examination outline and Is appropriate for the tier to which they are assigned; deviations are justified.
: 10.      Question psychometric quality and format meet the guidelines in ES Appendix B.                                          ii
: 11.      The exam contains the required number of one.point, multiple choice items:
the total Is correct  and agrees with the value on the cover sheet.
Printed Name / Signature                                Date
: a. Author                                        Cn&#xe7;e,,ptjt,< M4,jt4                                                      Z]3/It
: b. Facility Reviewer ()                                  .  ..xrrt.e.
: c. NRC Chief Examlnerf#)                            [) r4      n. iJ*6i
: d. NRC Regional Supervisor                                          \                                                    24
(          s.
Note:        The facility reviewers Initials/signature are not applicable for NRC-developed examinations.
            # independent NRC reviewer Initial Items in Column c; chief examiner concurrence required.
ES-401                                                Written Examination Review Worksheet                                                    Form ES-401-9
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q#  LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                                Explanation Focus                Dist.        Link          units ward K/A Only K/A EPE007 EK2.02 1    F    2                          X                                              B  U Choices A and C are not plausible distractors.
Question is Unsatisfactory due to two implausible distractors.
1/4/2016 - Revised question is Satisfactory.
K/A APE008 2.1.30 2    H    2                                              ?                        N  E The first part question is too much overlap with Scenario 3 Event 5.
They are the same immediate actions. Also, closing RC-535 is in all 4 answer choices.
Is knowledge of this power supply minutia? You have used that argument for one of the early submittal questions.
1/4/2016 - Revised question is Satisfactory.
K/A EPE009 EA1.10 3    H    2                                      X                                N  E Knowledge of entry conditions for yellow paths is generally considered SRO knowledge. Following the procedure for a yellow path is based on the discretion of the SRO. You can test red and orange.
1/4/2016 - Operations Management approves testing safety Yellow CSFST identification. They have valid objectives and ROs monitor the status of safety functions. This is not procedure selection. (John Little)
K/A EPE011 EK3.15 4    F    2                          X                                              N  E Do not believe that the reason for choices C and D are plausible.
Recommend asking what the maximum RWST level is that requires shifting to ECCS sump recirculation (19% or 27%) and giving times in the initial condition to choose between hot or cold leg recirculation. The reason for picking between hot or cold leg would be the time being greater or less than 11 hours.
1/25/2016 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                      8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                                Explanation Focus                Dist.        Link          units ward K/A Only K/A APE 022 AA2.03 5  H    2    X                                                                  N  E Need to address timing and equipment in AUTO.
1/4/2016 - Revised question is Satisfactory.
K/A APE025 2.4.47 6  H    2            X            X                                              N  U Given that RCS flow is 3000 gallons per minute, the bypass valve demand is 60%, and RCS pressure is being controlled, choices B(1) and D(1) are not plausible.
This is also a very good cue that there has not been a loss of RHR flow.
Question is Unsatisfactory due to two implausible distractors.
1/4/2016 - Revised question is Satisfactory.
K/A APE027 AK2.03 7  H    2    X      X                                                            B  E The picture provided for question #2 provides a clue to one of the questions.
The question and given conditions could be reworded and split into two parts that would make it less error likely for the applicants.
1/4/2016 - Revised question is Satisfactory.
K/A EPE029 EK2.06 8  H    2    X                                                                  N  E The question needs to be reworded some because FRP-S.1 gives you a list of 4 different sets of breakers and tells you to open all of them. It could be argued that there is no correct answer.
1/4/2016 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                              Explanation Focus                Dist.        Link          units ward K/A Only K/A EPE038 EK1.04 9  H    3    X                                                                  N  E With a saturated system, both choices A and D could be argued to be correct. Also, cooling is based on a difference in temperature.
Unable to write a operationally valid question to this K/A.
K/A EPE038 EK1.01 1/25/2016 - Revised question is Satisfactory.
K/A APE 040 AK1.05 10  H    2                                                                X        M  E The first part question does not test the K/A and is more of a systems (tier 2) question. The second part of the question is a GFES question, but is related to the K/A. Recommend asking something about how to add the Boron or how much Boron to add (ECA-2.1).
We can discuss.
1/4/2016 - Revised question is Satisfactory.
K/A APE054 AA1.03 11  F    2                          X                                              B  E Choice D is not plausible because it is cooled by Service Water. Is there another option?
1/4/2016 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                              Explanation Focus                Dist.        Link          units ward K/A Only K/A EPE055 EK3.02 12  F    2    X                    X                                              N  U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.
Distractor B does not appear to be plausible. When starting at a required pressurizer level of only greater than 14% and probable RCP seal leakage, it does not seem reasonable that pressurizer level greater than 7% can be ensured. Also, Distractors A and B are essentially the same thing. Distractor D is not plausible due to not being able to reach a red path if the cooldown rate limit is followed.
The stem question statement is not totally correct. The procedure caution statement only says that pressure should not be lowered less than 190 psig, it does not say to stop before.
Question is Unsatisfactory due to two non-plausible distractors.
Recommendations:
* Remove unnecessary information from current initial conditions. We can discuss specifics.
* Give two times (30 minutes apart) with S/G pressure and pressurizer level. For the first time, have pressurizer level less than 14%. For the second time, have S/G pressure at 190 psig and pressurizer level going off scale low.
* Ask: IAW ECA-0.0, what is the earliest time that the S/G depressurization is required to be stopped AND the reason for stopping the depressurization (preventing injection of accumulator nitrogen into the RCS or ensuring that no Reactor Vessel upper head voiding will occur).
12/3/2015- Question has been modified as recommended above.
Request that you add something to the effect of In accordance with EOP-ECA-0.0 to the question statement. Otherwise, the question is now Satisfactory.
1/4/2016 - Revised question is Satisfactory.
K/A APE056 AA2.11 13  H    3                                                                        B  S Question is Satisfactory.
K/A APE057 AA2.15 14  H    3                                                                        N  S Question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                              Explanation Focus                Dist.        Link          units ward K/A Only K/A APE058 AA1.02 15  F    2                          X                                              N  E Choices B(2) and D(2) are not plausible. Do you have any examples of a case where the electrical output breaker is closed prior to the input breaker when placing a component in service?
There are several other possibilities for this K/A.
1/25/2016 - Revised question is Satisfactory.
K/A WE04 G2.4.46 16  H    3    X                                X                              X  N  U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.
The second part question appears to be asking procedure transition criteria, which is SRO knowledge.
Question is Unsatisfactory due to license level mismatch.
I am not sure that a leak in this location would always cause an APP-036-D7 alarm. The FSAR states that an alarm in this location would most likely be VCT or RWST water because there are so many check valves downstream. The R-4 alarm setpoint is 50 millirem per hour. Did or can you validate on the simulator?
Why ask or mention D8, since it is given in all four answer choices?
12/3/2015- Revised question was submitted. Choices A and D of the revised question are not plausible. How could you have a LOCA outside containment and not have a process monitor high rad alarm.
Also, you could remove all of the only from the choices by adding ALL of the to the question stem.
1/4/2016 - Revised question is Satisfactory.
K/A WE05 EK3.4 17  H    2                          X            X                                M  E Stating that a red condition exists for Heat Sink in the initial conditions makes choice A(2) not plausible. Also, should not state that the red condition exists when steam generator levels and AFW flow are given. The applicant should be able to figure that out.
This also is more of an SRO question with procedure direction.
1/4/2016 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                                Explanation Focus                Dist.        Link          units ward K/A Only K/A WE11 EK1.1 18  H    2    X                                                                  N  E By my calculations, over 4 hours, the RWST level will lower for about 2.7 hours until the SI pump is shut off at 9% and then rise for the remainder. I do agree that overall the level will be lower. Need to work on the wording of the second part of the question in order for there to be a fully correct answer.
Request and IAW statement be added to the stem question.
1/4/2016 - Revised question is Satisfactory.
K/A APE005 AK2.02 19  F    1.5                                                                        B  S Question is Satisfactory.
K/A APE028 AK1.01 20  H    2                          X                                              B  U Choices B and C are not plausible. If the controlling channel increases or decreases, how could other channels remain the same?
Question is Unsatisfactory due to two non-plausible distractors.
1/4/2016 - Revised question is Satisfactory.
K/A APE032 AA2.02 21  H    2    X                                                                  B  E This question does not appear to work IAW GP-003. You could go critical on any one of the steps for doubling and the procedure has you go to section 8.3 for critical operations. Is there really a minimum number of doublings?
1/4/2016 - Revised question is Satisfactory.
K/A APE033 AK3.01 22  H    3                                                                X        B  U Do you expect the ROs to know where 120 cps on the Source Range equates to the Immediate Range for this case?
This does not match the K/A. It tests the cause of the loss of the IR instrument, not the reason for termination of the startup.
Tier 1 should normally test procedure/evolution requirements vice systems knowledge, unless otherwise specified by the specific K/A.
Question is Unsatisfactory due to not meeting the K/A.
1/25/2016 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                                Explanation Focus                Dist.        Link          units ward K/A Only K/A APE060 AK2.01 23  F    2                                                                        N  S Question is Satisfactory.
K/A APE067 AA1.09 24  H    2    X                    X                                              N  E Picture of Fire Alarm Console not provided.
Reviewed picture in SRO exam.
The picture is somewhat blurry on the computer. Need to ensure that the picture is clear and readable on the exams. Also need to ensure that the picture is provided for the RO exam.
Given that both trains are actuated, this makes choices C(1) and D(1) not plausible. It would be OK to give only one train in alarm and test the other way.
Need to correct # of alarms on pictured.
1/25/2016 - Revised question is Satisfactory.
K/A APE068 AK3.12 25  H    3                                                                        N  S Question is Satisfactory.
K/A APE076 AA2.04 26  H    2                          X                                              M  E Choices B(1) and D(1) are not plausible.
1/25/2016 - Revised question is Satisfactory.
K/A WE09 2.1.20 27  H    2    X                                                                  M  E With step 9 being a continuous actions step, how are there not two correct answers?
1/25/2016 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                  8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                              Explanation Focus                Dist.        Link          units ward K/A Only K/A SYS003 A3.01 28  H    2                          X                                              N  U The picture seems too hard to read.
Since all of the parameters shown return to their original values, outright failures do not seem to be plausible.
Question is Unsatisfactory due to two non-plausible distractors.
1/25/2016 - Revised question is Satisfactory.
K/A SYS003 K4.07 29  H    3                                                                        B  S Question is Satisfactory.
K/A SYS004 K2.06 30  F    3                                                                X        N  U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.
The question does not meet the K/A. It does not test knowledge of power supplies to the instrumentation, it gives a power supply that is lost and tests knowledge of how the instruments will fail upon a loss of power. That would be more of a K6 K/A.
Question is Unsatisfactory due to K/A mismatch.
12/7/15- Question is Satisfactory.
K/A SYS005 A2.02 31  H    2    X                    X                                              B  U Choices C and D are not plausible.
Question is Unsatisfactory due to two non-plausible distractors.
1/25/2016 - Revised question is Satisfactory.
K/A SYS005 K6.03 32  H    3    X                    X                                              B  E Choice C is not plausible.
Licensee explained how choice C could be plausible.
K/A SYS006 A1.13 33  F    3                                                                        N  S Question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                  8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                            Explanation Focus                Dist.        Link          units ward K/A Only K/A SYS006 K5.01 34  F    2    X                                                                  M  E The second part question needs to be a little more specific concerning temperature (higher, lower, increased, decreased).
1/25/2016 - Revised question is Satisfactory.
K/A SYS007 K3.01 35  H    2                                                                        N  S Question is Satisfactory.
K/A SYS008 A4.01 36  H    2    X                    X                                              B  E Choice D is not plausible.
The question stem does not exactly match the choices.
1/25/2016 - Revised question is Satisfactory.
K/A SYS010 K6.04 37  H    1                          X                                              N  U Choices A, B, and D are not plausible. LOD = 1.
Question is Unsatisfactory due three non-plausible distractors and LOD = 1.
1/25/2016 - Revised question is Satisfactory.
K/A SYS012 A3.06 38  H    2                                                                        B  S Question is Satisfactory.
K/A SYS012 K1.05 39  F    2                          X                                    ?        N  E Choice D is not plausible.
Need to discuss K/A match.
1/25/2016 - Revised question is Satisfactory.
K/A SYS013 K5.02 40  F    2                                                                        N  S Question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                  8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                            Explanation Focus                Dist.        Link          units ward K/A Only K/A SYS022 A4.04 41  H    2                          X                                              N  E Choice D is not plausible. Choice A is likely not plausible.
1/25/2016 - Revised question is Satisfactory.
K/A SYS026 A2.08 42  H    2                                                                        N  S Question is Satisfactory.
K/A SYS039 A1.10 43  F    2                          X                                              N  E Choice A is not plausible.
1/25/2016 - Revised question is Satisfactory.
K/A SYS059 K4.02 44  F    2                                                                        N  S Question is Satisfactory.
K/A SYS061 K5.01 45  H    2                          X                                              N  U Choices A and D are not plausible.
There is no correct answer (must be > 600 gpm).
Question is Unsatisfactory due to two non-plausible distractors.
1/25/2016 - Revised question is Satisfactory.
K/A SYS062 K1.04 46  H    2                                                                        B  S Question is Satisfactory.
K/A SYS062 K2.01 47  F    2                                                                        B  S Question is Satisfactory.
K/A SYS063 A3.01 48  H    2                          X                                              N  U Choices A and C are not plausible.
Question is Unsatisfactory due to two non-plausible distractors.
1/25/2016 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                                Explanation Focus                Dist.        Link          units ward K/A Only K/A SYS064 A2.18 49  F    2                          X                                              N  U Choices C and D are not plausible.
Question is Unsatisfactory due to two non-plausible distractors.
1/25/2016 - Revised question is Satisfactory.
K/A SYS064 K2.02 50  F    2                          ?                                              B  E Can you give any examples where there are A and B components that the B component is powered from the lower numbered MCC?
1/25/2016 - Question is Satisfactory.
K/A SYS073 A4.01 51  H    2                                                                        B  S Question is Satisfactory.
K/A SYS073 2.4.9 52  F    3                                      X                        X        M  U Question seems to be more related SRO procedure direction than mitigation strategy. It also does not seem to meet the K/A because it does not seem to test the PRM system.
Selected K/A SYS073 2.4.11 1/26/16-New question is Satisfactory.
K/A SYS076 K1.15 53  F    3                                                                        N  S Question is Satisfactory.
K/A SYS078 K3.03 54  F    2                                                                        N  S Question is Satisfactory.
K/A SYS103 G2.1.7 55  H    2    X                                                                  N  E Is a spray pump running? Does the number of HVH units running matter concerning the CSFST? Need to discuss plausibility of choice C.
1/25/2016 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                              Explanation Focus                Dist.        Link          units ward K/A Only K/A SYS001 K6.13 56  H    2    X                                                                  N  E The given conditions picture is not included on anything that was submitted. Unable to review fully. It seems that operation or interpretation of RPI would be more relevant than location of cabinets that I&C personnel need to go to. If there is no IRPI rack in the Hagan room, then it is not plausible.
1/25/2016 - Revised question is Satisfactory.
K/A SYS002 K4.01 57  F    2                                                                X        N  U Question does not appear to test design features or interlocks.
Question is Unsatisfactory due to not meeting the K/A.
1/25/2016 - Revised question is Satisfactory.
K/A SYS011 A1.02 58  F    2    X                                                                  N  E Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.
Need to state (in the question stem) what procedure these values are in accordance with.
1/25/2016 - Revised question is Satisfactory.
K/A SYS014 K5.01 59  H    2                          X                                              B  U Choices A and B are not plausible.
Question is Unsatisfactory due to two non-plausible distractors.
1/25/2016 - Revised question is Satisfactory.
K/A SYS017 A4.01 60  F    2                          X                                              B  U Choices A and B are not plausible.
Question is Unsatisfactory due to two non-plausible distractors.
1/28/2016 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                      8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                              Explanation Focus                Dist.        Link          units ward K/A Only K/A SYS027 K2.01 61  F    2                                                                        B  S Question is Satisfactory.
K/A SYS029 G2.1.23 62  F    2    X                                                                  N  E Need to show where this information is located in OP-921. I could not find it.
Licensee is breaking stem into two separate questions.
1/28/2016 - Revised question is Satisfactory.
K/A SYS033 K3.02 63  F    2            X            X                                              N  E Choices C(1) and D(1) are not plausible. They are process monitors.
1/26/16 - Revised question is Satisfactory.
K/A SYS035 A2.05 64  H    2    X      X                                                            N  E The choices for the second part question provide a direct cue to answer the first part question.
1/26/16 - Revised question is Satisfactory.
K/A SYS068 K1.07 65  F    2    X                                                                  B  E Choice A should probably be in all capital letters to match other choices.
1/26/16 - Revised question is Satisfactory.
K/A G2.1.29 66  F    2                                                                        N  S Question is Satisfactory.
K/A G2.1.36 67  F    2    X                                                                  B  E Need nomenclature for NI-51 and NI-52.
1/26/16 - Revised question is Satisfactory.
K/A G2.1.45 68  H    2                          X                                              N  E Choice A is not plausible. Is it fair to have the applicant evaluate T and MW without a reference? Need to discuss.
1/28/2016 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                              Explanation Focus                Dist.        Link          units ward K/A Only K/A G2.2.38 69  H    4                                                                        M  E It seems that this question requires the applicant to know greater than one hour actions from memory.
Operations (John Little) determined that this is RO required knowledge because it relates directly to licensed power level and the RO is responsible for monitoring.
K/A G2.2.39 70  F    2                                                                        N  S Question is Satisfactory.
K/A G2.3.13 71  F    1                                                                        B  U It does not seem plausible that you would not evacuate the containment vessel or initiate closure after a fuel assembly has been dropped and is causing the noble gas radiation monitor to increase.
LOD = 1 Question is Unsatisfactory due to more than one non-plausible distractor and LOD = 1.
1/26/16 - Revised question is Satisfactory.
K/A G2.3.4 72  H    2                                                                        B  S Question is Satisfactory.
K/A 2.4.11 73  H    3    X                                                                  N  E The second part question could be reworded to read easier.
1/26/16 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                                Explanation Focus                Dist.        Link          units ward K/A Only K/A G2.4.25 74  H    2    X                                                                  N  E Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.
In the question stem, need to state what procedure the action(s) are in accordance with.
Recommend stating in the initial conditions that either the block valves have been closed or the switches have been placed in the ISOLATED Position, then asking if the other action is or is not required.
For plausibility, are there any other time critical actions that are 15 minutes?
12/16/15 - Question is Satisfactory.
K/A G2.4.31 75  F    1                                                                        N  U This has overlap with the operating test. Every BOP will perform this during the operating test.
Question is Unsatisfactory due to LOD = 1.
1/26/16 - Revised question is Satisfactory.
K/A EPE029 EA2.06 76  H    2                          X                                              N  E With operation of the steam dumps following turbine trip, do not believe that choices A(2) and D(2) are plausible. Could possibly change the second part question to an is or is not question.
1/26/16 - Revised question is Satisfactory.
K/A EPE 038 2.4.47 77  H    1            X            X                                          X  N  U The first part question is direct lookup. This question can be answered using RO knowledge only.
The question is Unsatisfactory due to LOD = 1 and not being SRO only.
1/26/16 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                                  Explanation Focus                Dist.        Link          units ward K/A Only K/A APE054 2.4.9 78  H    2                          X                                          X  B  U/E Knowledge of when to initiate bleed and feed is probably RO knowledge and is listed in the continuous action summary for FRP-H.1. This is also an objective in your lesson plan. The RO would be required to inform the SRO when conditions are met for bleed and feed.
It is acceptable for one part of a two part question to be RO knowledge, however both parts should not be able to be answered using RO knowledge.
ROs should also know that PORVs are opened for bleed and feed.
We need to discuss this situation for steps on the foldout page.
Also, since all of the choices listed in the second part question are done in the procedure, need to ask what should be done first.
Question may be Unsatisfactory due to not being SRO only.
1/29/2016 - Revised question is Satisfactory K/A EPE055 EA2.06 79  H    3    X                                                          ?        B  E Is the first part of the question minutia? Does this lockout need to be cleared prior to re-energizing the buses? Does this meet the K/A?
Please explain.
1/28/2016 - Revised question is Satisfactory.
K/A APE058 2.2.22 80  H    2    X                                                                  B  E Per the TS 3.8 Bases, the selected answer for the second part question may not be correct.
1/26/16 -Licensee explained Bases, Question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                              Explanation Focus                Dist.        Link          units ward K/A Only K/A APE077 AA2.03 81  H    1    X                                                                  M  U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.
The last bullet provides a direct cue that the qualified offsite circuit is INOPERABLE (inadequate voltage for a design basis event). This makes LOD = 1.
Question is Unsatisfactory due to LOD = 1.
12/22/15- Revised question reviewed. Is there any place in AOP-26 that the EDGs are aligned by the operators to E-1 and E-2 independently? If not, choices C(2) and D(2) are not plausible. The question still needs some enhancement.
1/26/16 - Revised question is Satisfactory.
K/A APE001 AA2.02 82  H    2                                                                        N  S Question is Satisfactory.
K/A APE051 G2.4.35 83  H    2    X                    X                                          X  N  U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.
The question is not SRO only. SRO only knowledge should not be claimed for major mitigative strategy or AOP entry conditions. See Attachment 2 of ES-401.
Also, based on the wording of step 12 of AOP-012, the note prior to step 12, and the AOP-038 entry conditions, it appears that the SRO could perform a rapid power reduction if desired.
With no indication of condenser backpressure value or trend, how is going to a rapid power reduction plausible?
The question is Unsatisfactory because it is not SRO only.
Based on a review of your procedures, this could be a very hard K/A to satisfy at the SRO only level. We can discuss randomly selecting another K/A.
12/22/15 - Reviewed revised question. Question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                  8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                              Explanation Focus                Dist.        Link          units ward K/A Only K/A APE061 AA2.03 84  H    2    X                                                                  N  E The applicable answer choices do not include that a Portable Area Radiation Monitor in the CV area is also required in accordance with GP-010.
1/26/16 - Revised question is Satisfactory.
K/A WE06 2.1.23 85  H    2    X                                                                  M  E Choice C needs to be worded more clearly.
1/26/16 - Revised question is Satisfactory.
K/A SYS012 A2.05 86  H    2            X                                                  X        N  U Providing LCO 3.3.1 gives clues to the correct answer or gives the correct answer for several other questions on this exam. (Question 1 for example, and also questions that hinge on the set points of Reactor Protection System interlocks)
Question does not meet the K/A due to not predicting the impacts on the RPS.
Question is Unsatisfactory due to K/A mismatch.
1/26/16 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                                Explanation Focus                Dist.        Link          units ward K/A Only K/A SYS039 A2.03 87  H    2    X      X                                                            B  E Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.
Please explain why it is required to secure feeding the A steam generator as stated in the first part question stem.
Discussing transitioning to E-2 in the second part question stem provides a cue to the first part question and does not affect the answer. Indications of the faulted steam generator are provided in the initial conditions. Should just ask IAW the given conditions and E-3.
12/22/15 - Reviewed the revised question.
Based on the given conditions, it appears that the Secondary Integrity Criteria on the foldout page for E-3 are met. This would require a transfer to E-2. Since this is not one of the listed choices, there is no correct answer choice for this question.
1/28/2016 - Revised question is Satisfactory.
K/A SYS076 2.1.7 88  M    2                                                                        N  S Question is Satisfactory.
K/A SYS078 A2.01 89  H    2    X                                                          X        N  U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.
Need to remove the information in the bullet that states causing IA Header pressure to slowly lower. The applicants should know that a clogged air dryer will cause pressure to lower.
The question does not really appear to be operational valid. We need to discuss the normal lineup of the instrument air system and how we would get in the situation proposed by the question.
The question does not really test the K/A, but can be pretty easily fixed. We can discuss.
Will need the appropriate IAW statement added to the question stem. Also, need to word question with regard to the fact that the use of attachment 2 or 3 is in a step that is based on order of preference.
12/22/15 - Reviewed the revised question.
Question is now Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                      8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                                Explanation Focus                Dist.        Link          units ward K/A Only K/A SYS103 G2.4.35 90  H    2                                                                X    X  N  U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.
This does not appear to meet the intent of the K/A. It seems to meet more of the RCP K/A than the type of topics listed for the Containment system.
This does not appear to be an SRO only question. It does not have procedure selection and could be answered with RO knowledge.
Based on a review of your procedures, this could be a very hard K/A to satisfy at the SRO only level. We can discuss randomly selecting another K/A.
K/A SYS103 2.4.41 Revised question is Unsatisfactory due to LOD = 1. The correct answer choice (both halves) is so strong and self-explanatory that it makes the question provide no discriminatory value.
1/26/16 - Revised question is Satisfactory.
K/A SYS015 A2.04 91  H    2    X                                                                  N  E The bullet in the initial conditions that states that the crew lowered reactor power IAW AOP-101 needs to be more specific as to what the current reactor power is. It could be argued that if the crew lowered power IAW AOP-001, then it would be less than or equal to 50% and no further reduction would be required.
It would probably be more clear just to ask whether the CRS is or is not required to direct a power reduction to less than or equal to 50%
in accordance with AOP-001 Attachment 1 for the second part question.
1/26/16 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                              Explanation Focus                Dist.        Link          units ward K/A Only K/A SYS068 A2.02 92  F    2                                      X                                M  E Need a copy of EMP-006 to complete review of this question. Your lesson plan states that Chemistry does the sample and then provides the permit. Is determining whether or not the pH is acceptable an SRO job function?
Operations representative (John Little) states that this is SRO job function because the SRO/Shift Manager is required to review and approve the report.
1/28/2016 - Revised question is Satisfactory.
K/A SYS071 2.4.21 93  F    2                                                                        M  E Need a copy of PLP-100 to complete review of this question. This procedure is not listed in the index provided.
1/28/2016 - Revised question is Satisfactory.
K/A G2.1.45 94  H    2                                                                        N  S Question is Satisfactory.
K/A G2.2.21 95  H    2    X                    X                                              N  E Choices B(2) and C(2) are not plausible. It is not operationally valid to ask for greater than one hour TS completion times without a reference.
1/29/2016 - Revised question is Satisfactory K/A G2.2.36 96  H    2    X                    X                                              N  E Choices A(2) and C(2) are not plausible. It is not operationally valid to ask for greater than one hour TS completion times without a reference.
1/29/2016 - Revised question is Satisfactory.
K/A G2.3.12 97  H    2    X                                                                  B  E There may be two correct answers to this question. OMM-001-2 doesnt really state that the RC Supervisor cannot grant access during EOPs, it just describes how he will do it during normal operations.
1/28/2016 - Revised question is Satisfactory.
K/A G2.3.14 98  H    2                                                                        N  S Question is Satisfactory.
: 1.      2.          3. Psychometric Flaws              4. Job Content Flaws          5. Other    6.      7.                                      8.
Q#  LOK      LOD (F/H)    (1-5)  Stem Cues        T/F  Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                                                    Explanation Focus                    Dist.        Link            units ward K/A Only K/A G2.4.30 99    H        2      X                                                                                  M      E Need a copy of AP-030 to complete review of this question.
Licensee is changing leakrate and adding EAL reference.
2/3/16 - Revised question is Satisfactory K/A G2.4.46 100  H        2      X                                                                                  N      E The bullet for Total calculated B RCP #1 seal leakoff flow: 6.5 gpm is misleading. We need to discuss this.
1/29/2016 - Revised question is Satisfactory Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
: 1.      Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
: 2.      Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
: 3.      Check the appropriate box if a psychometric flaw is identified:
* The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
* The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
* The answer choices are a collection of unrelated true/false statements.
* The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
* One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
: 4.      Check the appropriate box if a job content error is identified:
* The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
* The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
* The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
* The question requires reverse logic or application compared to the job requirements.
: 5.      Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
: 6.      Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
: 7.      Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
: 8.      At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
ES-403                              Written Examination Grading                      Form ES-403-1 Quality Checklist Facility:                            Date of Exam:            Exam Level:  RD        SRQ Item Description                                      Initials a        b    c
: 1.        Clean answer sheets copied before grading 1li    &
: 2.        Answer key changes and question deletions justified and documented
: 3.        Applicants scores checked for addition errors                      U  A (reviewers spot check> 25% of examinations)                                          ,
: 4.        Grading for all borderline cases (80 +/-2% overall and 70 or 80,      All as applicable, +/-4% on the SRO-only) reviewed in detail              %i      1.ifr
: 5.        All other failing examinations checked to ensure that grades are justified                                                      z                j
: 6.        Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of            41 7/
questions missed by half or more of the applicants Printed Name/Signature                                  Date
: a. Grader
: b. Facility Reviewer(*)
: c. NRC Chief Examiner (*)                                    *f    .
03/i)!
: d. NRC Supervisor (*)                                                              3/Z2J!
(*)      The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.
ES-403, Page 6 of 6
Examination Preparation Checklist                                          Form ES-20J-J ES-207 Date of Examination: 2/01/2016 Facility: Robinson NRC              /1    Operating    Facility      x      NRC Developed by: Written:                  Facility x Target                                                Task Description (Reference)                                          Examiners Date                                                                                                                          Initials 8/5/2015
      -180        1.              Examination administration date confirmed (Cia; C.2.a and b) 9/4/2015
      -lC        2.              NRC examiners and facility contact assigned (C.1.d; C.2.e) 9/4/2015
      -150        3.              Facility contact briefed on security and other requirements (C.2.c) 9/4/2015
      -150        4.            Corporate notification letter sent (C.2.d)
N/A
[-i          5.            Reference material due (C.1.e; C.3.c; Attachment 3)
ES-301 -1,    11/3/2015 f- 1        6.            Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-401N-3, ES-301-2, ES-301-5, ES-D-1, ES-401-1/2, ES-401N-i/2, ES-401-3, ES-401-4, and ES-401N-4, as applicable (C.1.e and f; C.3.d) facility licensee      11/8/2015
{-j          7.            Examination outline(s) reviewed by NRC and feedback provided to (C.2.h; C.3.e) ios, as        1213/2015 f- .(      8.            Proposed examinations (including written, walk-through JPMs, and scenar ES-301-4, ES applicable), supporting documentation (including Forms ES-301-3, ES-201-3, 301-5, ES-301-6, and ES-401-6, ES-401N-6, and any Form ES-201-2, f, and h; ES-301-1, or ES-301-2 updates), and reference materials due (C.1.e, g C.3.d) 12/18/2015
          -45      9.            Written exam and operating test reviews completed. (C.3.f)
ES-202)              1/2/2016
          -30        1    .        Preliminary license applications (NRC Form 398s) due (C.i.l; C.2.g; (C.2.h; C.3.f)        1/28/2016
          -21        1  .          Examination approved by NRC supervisor for facility licensee review 1/28/2016
            -21      t.            Examinations reviewed with facility licensee (Cli; C.2.f and h; C.3.g)
ES-202)        1/18/2016
            -14        1.            Final license applications due and Form ES-201-4 prepared (C.1 .1; C.2.i; isor (C.2.i;            2/11/2016
            -14        1    .        Written examinations and operating tests approved by NRC superv C.3.h)                                                                                          1/28/16 on the            2/11/2016
            -7        15.          Facility licensee management queried regarding the licensees views examination. fC.2 j)                                                                            1/28/16 1/29/2016
              -7        1      .      Final applications reviewed; 1 or 2 (if >10) applications audited to confirm sent fC.2.i; qualifications / eligibility; and examination approval and waiver letters Attachments; ES-202,        C.2.e; ES-204) facility licensee          2/11/2016
              -7        17.          Proctoring/written exam administration guidelines reviewed with (C.3.k) to NRC      1/28/2016
              -7        1      . Approved scenarios, job performance measures, and questions distributed examiners (C.3.i) ations and are keyed to the examination date Target dates are generally based on facility-prepared examin ate  notification  letter. They  are for  plannin g purposes and may be adjusted on a case-by identified in the corpor case basis in coordination with the facility                  license e.
by the NRC.
[Applies only] {Does not apply) to examinations prepared
ES-201                                  Examination Outline Quality Checklist                                  Form ES-201-2 Facility: ROBINSON                                                                  Date of Examination:  FEBRUARY 2016 Item                                                                                                                Initials Task Description
: 1.      a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401 or ES-401 N.
: b. Assess whether the outline was systematically and randomly prepared in accordance with Section D.1 of ES-401 or ES-401N and whether all KJA categories are appropriately sampled.
T                                                                                                                  /4    (
: c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.            %1 N
                                                                                                                      %7
: d. Assess whether the justifications for deselected or rejected K/A statements are appropriate.
: 2.      a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, and major S          transients.
M        b. Assess whether there are enough scenario sets (and spares) to test the projected number and u          mix of applicants in accordance with the expected crew composition and rotation schedule L          without compromising exam integrity, and ensure that each applicant can be tested using at A          least one new or significantly modified scenario, that no scenarios are duplicated from the T          applicants audit test(s), and that scenarios will not be repeated on subsequent days.
: c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative and quantitative criteria specified on Form ES-301-4 and described in Appendix D.
: 3.      a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:
(1) the outline(s) contain(s) the required number of control room and in-plant tasks distributed W                among the safety functions as specified on the form A          (2) task repetition from the last two NRC examinations is within the limits specified on the form L          (3) no tasks are duplicated from the applicants audit test(s)
K          (4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on T                the form.
H R        b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:
  ,          (1) the tasks are distributed among the topics as specified on the form U          (2) at least one task is new or significantly modified G          (3) no more than one task is repeated from the last two NRC Ii H
: c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.
: 4.      a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections.
G E      b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.
: c. Ensure that K/A importance ratings (except for R      d. Check for duplication and overlap among exam sections.
L      e. Check the entire exam for balance of coverage.
: f. Assess whether the exam fits the appropriate job level (RD or SRO).
: a. Author                                                                                                          O(4/5
: b. Facility Reviewer (*)                                                    4
: c. NRC Chief Examiner (#)                                  3 i  c                                  tT-              9L/23/_?iJ
: d. NRC Supervisor                          .(fl C
                                                                      /  /
4 1  JVc, Note:                  # Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
Not applicable for NRC-prepared examination outlines.
ES-201                                    Examination Outline Quality Checklist                                  Form ES-201-2 (Rev_O1 2316)
Facility:        Robinson                                                          Date of Examination:            2/2016 Initials Item Task Description h i
: 1.        a. Verify that the outline(s) fit(s) the appropriate model per ES-401 or ES-401 N.                C
: b. Assess whether the outhne was systematicaily and randomiy prepared in accordance with W              Section D.1 of ES-401 or ES-401N and whether au KJA categories are appropriateiy R              sampied.
      .-        c. Assess whether the outhne over-emphasizes any systems, evoiutions, or generic topics.          c.
T        d. Assess whether the justifications for deselected or rejected K/A statements are E              appropriate.
N
: 2.        a. Using Form ES-301 -5, verify that the proposed scenario sets cover the required number of normai evoiutions, instrument and component faiiures, technical specifications, and major transients.
s i        b. Assess whether there are enough scenario sets (and spares) to test the projected number M            and mix of applicants in accordance with the expected crew composition and rotation scheduie without compromising exam integrity; and ensure that each applicant can be U              tested using at least one new or significantly modified scenario, that no scenarios are L            duplicated from the appiicants audit test(s), and scenarios wiil not be repeated on A              subsequent days.
T          c. To the extent possibie, assess whether the outline(s) conform(s) with the quattative and 0              quantitative criteria specified on Form ES-301-4 and described in Appendix D.
R
: 3.        a. Verify that systems waik-through outtne meets the criteria specified on Form ES-301 -2:
(1) the outhne(s) contain(s) the required number of controi room and in-plant tasks, W                    distributed among the safety functions as specified on the form A
(2)  task repetition from the last two NRC examinations is within the hmits specified on L                  the form, K
(3)  no tasks are duplicated from the apptcants audit test(s)
T H              (4)  the number of new or modified tasks meets or exceeds the minimums specified on the form R
0              (5)  the number of aiternate path, iow-power, emergency and RCA tasks meet the criteria on the form.
G        b. Verifythatthe administrative outiine meets the criteria specified on Form ES-301-1:
H              (1)  the tasks are distributed among the topics as specified on the form (2)  at least one task is new or significantiy modified (3)  no more than one task is repeated from the last two NRC licensing examinations
: c. Determine if there are enough different outhnes to test the projected number and mix of apphcants and ensure that no items are duphcated on subsequent days.
: 4.        a. Assess whether plant-specific priorities (inciuding PRA and iPE insights) are covered in the appropriate exam section.
G          b. Assess whether the 10CFR 55.41/43 and 55.45 sampiing is appropriate.                          L.
: c. Ensure that K/A importance ratings (except for piant-specific priorities) are at least 2.5.
E        d. Check for duplication and overiap among exam sections.
R
: e. Check the entire exam for balance of coverage.
L        f. Assess whether the exam fits the appropriate job ievei (RD or SRO).
Printed Name / Signature                                  Date
: a. Author                                                                        i-                                  i/zc ,4
: b. Facuiity Reviewer(*)
: c. NRC Chief Examiner      f#)                Da.v ic.                                                              /,k7) i
: d. NRC Supervisor                                C NOTE:        # independent NRC reviewer initial items in Coiumn c, chief examiner concurrence required.
Not applicabie for NRC-prepared examination outlines NUREG-1021, Revision 10
ES-301                                  Administrative Topics Outline                          Form ES-301-1 (Rev_011016)
Facility:      HB Robinson                                  Date of Examination:          2/2016 Examination Level:                      RO                  Operating Test Number:        N16-1 Administrative Topic          Type Code*                  Describe activity to be performed (see Note) 2.1.7 (4.4)    Ability to evaluate plant performance Conduct of Operations                                            and make operational judgments based on operating characteristics, D, R                        reactor behavior, and instrument interpretation.
JPM:            Calculate QPTR 2.1.4 (3.3)    Knowledge of individual licensed operator Conduct of Operations                                            responsibilities related to shift staffing, such as medical requirements, no-solo N, R                        operation, maintenance of active license status, 10CFR55, etc.
JPM:            Determine License Status 2.2.41 (3.5)    Ability to obtain and interpret station Equipment Control                                                electrical and mechanical drawings.
D, P, R JPM:            Determine Proper Equipment Boundaries 2.3.7 (3.5)    Ability to comply with radiation work Radiation Control                                                permit requirements during normal or abnormal conditions.
N, R JPM:            Evaluate Stay Time with Lowered SFP Level NOTE:        All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when 5 are required.
*Type Codes & Criteria:            (C)ontrol room, (0) (S)imulator, (0) or Class(R)oom (4)
(D)irect from bank ( 3 for ROs;  4 for SROs & RO retakes) (2)
(N)ew or (M)odified from bank (> 1) (2)
(P)revious 2 exams ( 1; randomly selected) (1)
NUREG-1021, Revision 10
ES-301                          Administrative Topics Outline                    Form ES-301-1 (Rev_011016)
RO Admin JPM Summary A1a  This is a modified Bank JPM. The operator will be told that the plant is operating at 60%
power and that ERFIS is OOS. The operator will be provided with Power Range Excore Nuclear Instrumentation indicated and normalizing detector currents, and directed to manually calculate Quadrant Power Tilt Ratio, and identify whether or not any limitations have been exceeded. The operator will be expected to calculate QPTR in accordance with FMP-007, Quadrant Power Tilt, and identify that Technical Specification LCO 3.2.4, Quadrant Power Tilt Ratio (QPTR), is NOT met.
A1b  This is a new JPM. The operator will be told that they are a Licensed Reactor Operator who was assigned to the day shift staff for a special project, and not routinely standing watch in the Control Room. They will be provided with a work history and various qualification dates, and then directed to identify any requirements that must be met prior to the end of the quarter that are required to maintain their license ACTIVE; and any additional requirements that are required to maintain their qualification to stand watch in the Control Room. The operator will be expected to evaluate their work history and identify that four 12-hour shifts must be completed as either the RO or the BOP prior to the end of the quarter to maintain their license ACTIVE, and that an SCBA quantitative and qualitative fit test must be completed prior to standing watch in the Control Room again.
A2    This is a Bank JPM. The operator will be told that the plant is in Mode 1 at 100%,
Charging Pump A suction relief valve CVC-2080 has failed open, and that the operating crew has entered AOP-016, Excessive Primary Plant Leakage, to control the plant. The operator will be provided with the EDPs, and the P&IDs, and directed to use all available resources to identify the pump boundary valves needed to be closed to isolate the leak, and identify the motor breaker to electrically isolate the pump motor.
The operator will be expected to identify that the leak can be isolated by closing three valves; CVC-270, CVC-290 and CVC-291, and that the pump motor can be electrically isolated by opening Breaker 52/34B. This JPM was previously used on the 2014 NRC Exam, randomly selected for use on the 2016 Exam.
A3    This is a new JPM. The operator will be told that a station wide accident has occurred due to an Earthquake, that the plant is in Mode 6 with a full core off-load, that the Spent Fuel Pool level has lowered to 10 feet above the top of the fuel, and has stabilized at this level, and that the crew is implementing AOP-036 (SFP Events). The operator will be provided with an R-5 reading, a dose limit of 25 mrem, and the assignment of a repetitive task within AOP-036 which will require entry into the Spent Fuel Building for 3 minutes, before exiting; and will be directed to estimate how many times the operator can perform this repetitive task before they must be replaced by another operator. The operator will be expected to determine that the dose rate around the Spent Fuel Pool area is 193 mrem/hour and based on this the operator will determine that the repetitive task can be performed 2 times before another operator will need to perform the task.
NUREG-1021, Revision 10
ES-301                                      Administrative Topics Outline                            Form ES-301-1 (Rev_011016)
Facility:      H B Robinson                                    Date of Examination:              2/2016 Examination Level:                        SRO                  Operating Test Number:            N16-1 Administrative Topic                Type                      Describe activity to be performed (see Note)                  Code*
2.1.7 (4.7)        Ability to evaluate plant performance and Conduct of Operations                                                  make operational judgments based on operating characteristics, reactor D, R                            behavior, and instrument interpretation.
JPM:              Calculate QPTR 2.1.4 (3.8)        Knowledge of individual licensed operator Conduct of Operations                                                  responsibilities related to shift staffing, such as medical requirements, no-solo N, R                            operation, maintenance of active license status, 10CFR55, etc.
JPM:              Determine License Status 2.2.38 (4.5)      Knowledge of conditions and limitations in Equipment Control                                                      the facility license.
D, R JPM:              Determine if Mode Change is Permissible 2.3.8 (3.7)        Ability to approve release permits.
Radiation Control                      N, R JPM:              Approve a Waste Gas Release Permit 2.4.41 (4.4)      Knowledge of the emergency action level Emergency Plan                                                          thresholds and classifications.
D, R JPM:              Emergency Classification NOTE:        All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when 5 are required.
*Type Codes & Criteria:              (C)ontrol room, (0) (S)imulator, (0) or Class(R)oom (5)
(D)irect from bank ( 3 for ROs;  4 for SROs & RO retakes) (3)
(N)ew or (M)odified from bank (> 1) (2)
(P)revious 2 exams ( 1; randomly selected) (0)
NUREG-1021, Revision 10
ES-301                            Administrative Topics Outline                  Form ES-301-1 (Rev_011016)
SRO Admin JPM Summary A1a  This is a modified Bank JPM. The operator will be told that the plant is operating at 100% power and that ERFIS is OOS. The operator will be provided with Power Range Excore Nuclear Instrumentation indicated and normalized detector currents, and directed to calculate Quadrant Power Tilt Ratio, identify whether or not any limitations have been exceeded, and if so, what, if any ACTION, is required. The operator will be expected to calculate QPTR in accordance with FMP-007, Quadrant Power Tilt, identify that Technical Specification LCO 3.2.4, Quadrant Power Tilt Ratio (QPTR), is NOT met, and identify that all six ACTIONs (A.1-A.6) must be taken for Condition A of LCO 3.2.4, including the maximum permitted power level of 91.3%.
A1b  This is a new JPM. The operator will be told that they are a Licensed Senior Reactor Operator who was assigned to the day shift staff for a special project, and not routinely standing watch in the Control Room. They will be provided with a work history and various qualification dates, and then directed to identify any requirements that must be met prior to the end of the quarter that are required to maintain their license ACTIVE; and any additional requirements that are required to maintain their qualification to stand watch in the Control Room. The operator will be expected to evaluate their work history and identify that four 12-hour shifts must be completed as either the SM, CRS, RO or the BOP prior to the end of the quarter to maintain their license ACTIVE, and that an SCBA quantitative and qualitative fit test must be completed prior to standing watch in the Control Room again.
A2    This is a Bank JPM. The operator will be told that the plant is in Mode 5, returning from a refueling outage, that the RCS temperature is 165&deg;F and there is a bubble in the PZR, and that RHR Loop A is maintaining RCS temperature. The operator will be provided with an Inoperable Equipment List and directed to complete the attached OMM-001-12, MINIMUM EQUIPMENT LIST AND SHIFT RELIEF, Attachment 2, 200&deg;F to 350&deg;F (MODE 4) MEL, that was started on the previous shift and to determine if any Mode 4 restrictions exists. The operator will be expected to complete Attachment 2 and determine that the Mode change cannot occur with current plant conditions, per the attached KEY.
A3    This is a new JPM. The operator will be told that the plant is in Mode 1 at 100% power, and that a Waste Gas Release Permit for the A WGDT has been presented to the Shift Manager for review and approval. The operator will be provided with a WGDT Release Permit and directed to review and approve the Waste Gas Release Permit, or to identify all issues found which would prevent approval. The operator will be expected to review the WGDT Release Permit and identify that it cannot be approved because (1) it has been written for the wrong WGDT and (2) the R14C setpoint is less conservative than required.
A4    This is a Bank JPM. The operator will be given an initial set of plant conditions. The operator will be directed to classify the event in accordance with the Robinson Nuclear Plant Emergency Action Level Matrix. The operator will be expected to declare an ALERT based on HA4.1, Confirmed Security event in a plant Protected Area or notification of either an airborne attack threat or hostile threat within the Owner Controlled Area, within 15 minutes. Then, the operator must prepare an Emergency NUREG-1021, Revision 10
ES-301                            Administrative Topics Outline            Form ES-301-1 (Rev_011016)
Notification Form for this event in accordance with EPCLA-01 (Emergency Control), also within 15 minutes.
NUREG-1021, Revision 10
ES-301                            Control Room/In-Plant Systems Outline                    Form ES-301-2 (REV_011116)
Facility:      H B Robinson                                    Date of Examination:          2/2016 Exam Level (circle one):        RO (only) / SRO(I) / SRO (U)    Operating Test No.:          N16-1 Control Room Systems (8 for RO; 7 for SRO-I; 2 or 3 for SRO-U)
Type Code*      Safety System / JPM Title Function A. 062 AC Electrical Distribution System [062 A2.08 (3.6/3.4)]
S, P, D, A        6 Operation With High Switchyard Voltage B. 059 Main Feedwater System [059 A4.08 (3.2/2.9)]
S, M, A        4S Transfer From the FRV Bypass Valves to the FRVs C. 007 Pzr Relief Tank/Quench Tank System [007 A1.01 (2.9/3.1)]
S, D, A        5 Restore PRT to Normal Operating Conditions D. 001 Control Rod Drive System [001 A1.06 (4.1/4.4)]
S, N, A, L        1 Reactor Startup with Ejected Control Rod E. 011 Large Break LOCA [EPE 011 EA1.11 (4.2/4.2)]
S, D, A, EN        3 Transfer to Long Term Recirculation F. 006 Emergency Core Cooling System [006 A4.02 (4.0/3.8)]
S, P, D, EN        2 Fill a Safety Injection Accumulator G. 015 Nuclear Instrumentation System [015 A4.03 (3.8/3.9)]
S, D, L        7 Remove Source Range Channel N-31 From Service H. 003 Reactor Coolant Pump System [003 A4.03 (2.8/2.5)]
S, D, L      4P Start a Reactor Coolant Pump In-Plant Systems@ (3 for RO; 3 for SRO-I; 3 or 2 for SRO-U)
I. APE 055 Loss of Offsite and Onsite Power [EPE 055 EA2.01 (3.4/3.7)]
D, P, E        6 Locally Establish AFW Flow from the SDAFW Pump and Control S/G Levels and Pressures J. 065 Loss of Instrument Air [065 AA1.04 (3.5/3.4)]
D, R, E        8 Respond to a Loss of Instrument Air K. APE 062 Loss of Service Water [APE 062 AA2.01 (2.9/3.5)]
D, R, E      4S Loss of North SW Header in the Auxiliary Building NUREG-1021, Revision 10
ES-301                              Control Room/In-Plant Systems Outline                              Form ES-301-2 (REV_011116)
@          All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.
* Type Codes                                    Criteria for RO / SRO-I / SRO-U (A)lternate path                                                            4-6 (5) /4-6 (5) / 2-3 (3)
(C)ontrol room (D)irect from bank                                                            9 (9) / 8 (8) /  4 (4)
(E)mergency or abnormal in-plant                                              1 (3) / 1 (3) /  1 (2)
(EN)gineered Safety Feature                                                    1 (2) / 1 (2)/  1 (2) (Control Room System)
(L)ow-Power / Shutdown                                                        1 (3) / 1 (2) /  1 (1)
(N)ew or (M)odified from bank including 1(A)                                  2 (2) /  2 (2) /  1 (1)
(P)revious 2 exams                                                            3 (3) /  3 (3)/  2 (2) (Randomly Selected)
(R)CA                                                                        1 (2 )/ 1 (2) /  1 (1)
(S)imulator JPM Summary JPM A This is a Bank JPM. The operator will be told that the plant is at 100% power, that due to abnormal conditions on the Grid, 480V Bus E-2 currently has exceeded 505 volts, that AOP-031, Operation with High Switchyard Voltage, has been completed up to step 21, and other preliminary information. The operator will be directed to continue with AOP-031 until 480V Bus E-2 voltage is restored to less than 505 Volts. The operator will be expected to transfer 4KV Bus 4 & 5 from the UAT to the SUT (via 4KV Bus 3) in an effort to lower Switchyard Voltage; and when Breaker 50/20 fails to automatically OPEN (Alternate Path), the operator will manually open it per AOP-31. This JPM was previously used on the 2013 NRC Exam, randomly selected for use on the 2016 Exam.
JPM B This is a modified Bank JPM. The operator will be told that a plant startup is in progress with reactor power approximately 18%, that the A and B S/G levels are being controlled with the Feedwater Regulating Valves operating in AUTO, and that the C S/G level is being controlled on the Feedwater Regulating Bypass Valve. The operator will be directed to transfer the C S/G level control to the Main Feedwater Regulating Valve in accordance with Step 6.4.12 of GP-005, Power Operation. The operator will be expected to place the C Feed Reg Valve in AUTO, and then take manual control of the B Feed Reg Valve and stabilize the B S/G level (Alternate Path) when it is determined that the B Feed Reg Valve has failed to control the B S/G level in AUTO.
JPM C This is a Bank JPM The operator will be told that the plant is at 100% power, that APP-003-D3, PRT HI/LO LEVEL, has alarmed, that the cause of the low level is known leakage from the PRT to the RCDT, and that the PRT level is stable at 67%. The operator will be directed to restore PRT level to normal IAW OP-103, Pressurizer Relief Tank Control System. The operator will be expected to refill the PRT in accordance with Section 8.2.2 of OP-103; and then diagnose and relieve the hydraulic lock on RC-519B (Alternate Path) in accordance with Section 8.4.1 of OP-103.
JPM D This is a New JPM. The operator will be told that the plant is stabilized at 2% power, that the RCS is at normal operating temperature and pressure, and that a plant startup is in progress IAW GP-003, Normal Plant Startup From Hot Shutdown to Critical, and complete through Step 8.4.7. They will also be told that they are the OATC, and that the NUREG-1021, Revision 10
ES-301                      Control Room/In-Plant Systems Outline                Form ES-301-2 (REV_011116)
BOP is temporarily outside the Control Room. The operator will be directed to pull control rods to stabilize reactor power between 3-5% by continuing with Step 8.4.8 of GP-003. The operator will start to raise reactor power to 3-5%. Then, the operator will manually trip the reactor, attempt to manually actuate Safety Injection and manually start SI Pumps in response to an ejected rod (Alternate Path).
JPM E This is a Bank JPM. The operator will be told that a large break LOCA has occurred, and that the plant is currently on Cold Leg Recirculation IAW EOP-ES-1.3, Transfer to Cold Leg Recirculation. The operator will be directed to transfer to Long Term Recirculation IAW EOP-ES-1.4, Transfer to Long Term Recirculation. The operator will be expected to align for Long Term Recirculation per EOP-ES-1.4, and align only the B RHR Pump for operation when it is determined that SI-863A has failed to OPEN (Alternate Path).
JPM F This is a Bank JPM. The operator will be told that the plant is at 100% power, that the SI ACCUM C HI/LO LVL (APP-002-E4) alarm has been received and actions have been reviewed by the RO, that OP-202, Section 5.2.1.1 Initial Conditions have been completed, and other preliminary information. The operator will be directed to fill SI Accumulator C to reset the low level alarm IAW OP-202, Section 5.2.1. The operator will be expected to refill SI Accumulator C to reset the low level alarm without exceeding specified limits. This was previously used on the 2013 NRC Exam, randomly selected for use on the 2016 Exam.
JPM G This is a Bank JPM. The operator will be told that the plant is shutdown 36 hours after a trip from 100% power, and that SR Channel N-31 has just failed low. The operator will be directed to remove SR Channel N-31 from service IAW OWP-011, Nuclear Instrumentation. The operator will be expected to remove SR Channel N-31 from service IAW NI-5 of OWP-011.
JPM H This is a Bank JPM. The operator will be told that the plant is shutdown at normal operating temperature and pressure, that the B RCP was stopped 7 hours earlier for motor inspection, that Section 8.1 of OP-101, Reactor Coolant System and Reactor Coolant Pump Startup and Operation, has been completed through Step 8.1.1.2.y in preparation for starting the Reactor Coolant Pump, and that it is intended to bypass the Degraded Grid Protection prior to the RCP start and return it to service after the RCP is started per OP-101, and an AO is standing by to assist in this process. The operator will be directed to start the B Reactor Coolant Pump by continuing with Step 8.1.1.2.z of OP-101. The operator will be expected to start the B RCP IAW OP-101.
JPM I This is a Bank JPM. The operator will be told that the Plant has experienced a loss of onsite and offsite power, that EOP-ECA-0.0, Loss of All AC Power, has been implemented, that Wide Range levels in all three SGs are 55%, that Steam Generator pressures are 1075 psig, and that the SDAFW Pump has just been started. The operator will be directed to locally perform Attachment 4, Local Control Of S/G Level And Pressure, of EOP-ECA-0.0. The operator will be expected to control AFW flow to the Steam Generators and align the Nitrogen System to the SG PORVs IAW Attachment 4 of EOP-ECA-0.0. This was previously used on the 2014 NRC Exam, randomly selected for use on the 2016 Exam.
JPM J This is a Bank JPM. The operator will be told that the IA Header Pressure is 75 PSIG and lowering, that AOP-017, Loss Of Instrument Air, has been entered, that the Station NUREG-1021, Revision 10
ES-301                    Control Room/In-Plant Systems Outline              Form ES-301-2 (REV_011116)
Air Compressor is under clearance and disassembled, and that the Station Air Receiver is depressurized and vented. The operator will be directed to perform AOP-017 Step 8.
The operator will be expected to start IA Compressors A and B and align their discharge to supply air to the Instrument Air Header in accordance with Step 8 of AOP-017.
JPM K This is a Bank JPM. The operator will be told that the plant is at 100% power, that the North SW header has ruptured inside the Auxiliary Building, and that the Control Room has implemented AOP-022 (Loss of Service Water) for a leak in the North header. The operator will be directed to perform the local subsequent actions IAW Attachment 6 of AOP-022. The operator will be expected to isolate the intact SW header from the ruptured header, isolate the leak, and align cooling water to critical loads IAW Attachment 6 of AP-022.
NUREG-1021, Revision 10
ES-301                                          Operating Test Quality Checklist                      Form ES-301 -3 (Rev_O1 2316)
Facility:          Robinson            Date of                2/2016              Operating Test Number: N 16-1 Examination:
nftials
: 1. GENERALCRITERIA                                                      b*
a                c#
: a. The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g. 10 CFR 55.45, operational importance, safety function distribution).
: b.      There is no day-to-day repetition between this and other operating tests to be administered during this examination.                                                                      .
: c.      The operating test shall not duplicate items from the applicants audit test(s) (see Section D.1.a).
: d.      Overlap with the written examination and between different parts of the operating test is within acceptable limits.
: e.      It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license level.
: 2. WALK-THROUGH CRITERIA                                            -          -
: a. Each JPM includes the following, as applicable:
initial conditions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee                /
C operationally important specific performance criteria that include:
            -  detailed expected actions with exact criteria and nomenclature
            -  system response and other examiner cues
            -  statements describing important observations to be made by the applicant
            -  criteria for successful completion of the task
              -  identification of critical steps and their associated performance standards
              -  restrictions on the sequence of steps, if applicable
: b.      Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301 -1 and 2) have not caused the test to deviate from t._
any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.                                                    =
: 3. SIMULATOR CRITERIA                                            -          -
The associated simulator operating tests (scenario sets) have been reviewed in accordance                          &#xe7; with Form ES-301 -4 and a copy is attached.
Printed Name I Signature                              Date
: a.      Author                                                                                                ifi /iC
: b.      Facility Reviewer f*)
: c.      NRC Chief Examiner        (#)            )  roj                            e? tL....              i/  Z711 c U.      NRC Supervisor
(
NOTE:
* The facility signature is not applicable for NRC-developed tests.
                #    Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
NUREG-1021, Revision 10
4 ES-301                                            Simulator Scenario Quality Checklist                            Form ES-301 -4 (Rev_O1 2316) 2/2016        Scenario Numbers:  1, 2,3  Operating Test No.:        N16-1 Facility:    Robinson                  Date of Exam:
Initials QUALITATIVE ATTRIBUTES a    b*      c#
: 1.        The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events.                                          t_-
: 2.        The scenarios consist mostly of related events.                                                          a.
: 3.        Each event description consists of
            .      the point in the scenario when it is to be initiated
            .      the malfunction(s) or conditions that are entered to initiate the event
            .      the symptoms/cues that will be visible to the crew
            .      the expected operator actions (by shift position)
            .      the event termination point (if applicable)
: 4.        The events are valid with regard to physics and thermodynamics.                                            C.
: 5.        Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.
: 6.        If time compression techniques are used, the scenario summary clearly so indicates. Operators have sufficient time to carry out expected activities without undue time constraints. Cues are            t..  \
given.
: 7.        The simulator modeling is not altered.
: 8.        The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure            t that functional fidelity is maintained while running the planned scenarios.
: 9.        Every operator will be evaluated using at least one new or significantly modified scenario. All other scenarios have been altered in accordance with Section D.5 of ES-301.
: 10.      All individual operator competencies can be evaluated, as verified using Form ES-301 -6 (submit                          ttL the form along with the simulator scenarios).
: 11.      The scenario set provides the opportunity for each applicant to be evaluated in each of the applicable rating factors. (Competency Rating factors as described on forms ES-303-1 and ES-303-3.)
: 12.        Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).
L
: 13.        The level of difficulty is appropriate to support licensing decisions for each crew position.
Target Quantitative Attributes (Per Scenario; See Section D.5.d)                Actual Attributes      -
1      2    3
: 1.        Malfunctions after EOP entry (1-2)                                                    1      2    2
: 2.        Abnormal events (2-4)                                                                4      4    5
: 3.        Major transients (1-2)                                                                1      1      1
: 4.        EOPs entered/requiring substantive actions (1-2)                                      2      2      1
: 5.        EOP contingencies requiring substantive actions (0-2)                                  0      1      1
: 6.        Critical tasks (2-3)                                                                  3      3      2 NOTE:
* The facility signature is not applicable for NRC-developed tests.
                        # Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
NUREG-1021, Revision 10
ES-301                                          Simulator Scenario Quality Checklist                            Form ES-301-4 (Rev_012316)
Robinson                    Date of Exam:        2/2016        Scenario Numbers: 4, 5,6  Operating Test No.:        N16-1 Facility:
Initials QUALITATIVE ATTRIBUTES a    b*      c#
: 1.      The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events.                                        t              (j
: 2.        The scenarios consist mostly of related events.                                                          c...
: 3.        Each event description consists of
          .      the point in the scenario when it is to be initiated
          .      the malfunction(s) or conditions that are entered to initiate the event
          .      the symptoms/cues that will be visible to the crew                                                ct.
          .      the expected operator actions (by shift position)
          .      the event termination point (if applicable)
: 4.        The events are valid with regard to physics and thermodynamics.                                          _
: 5.      Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.
: 6.      If time compression techniques are used, the scenario summary clearly so indicates. Operators have sufficient time to carry out expected activities without undue time constraints. Cues are given.                                                                                                                    cO
: 7.      The simulator modeling is not altered.                                                                  L..
: 8.      The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.                                      U
: 9.      Every operator will be evaluated using at least one new or significantly modified scenario. All other scenarios have been altered in accordance with Section D.5 of ES-301.
: 10.      All individual operator competencies can be evaluated, as verified using Form ES-301 -6 (submit the form along with the simulator scenarios).
1 1. The scenario set provides the opportunity for each applicant to be evaluated in each of the applicable rating factors. (Competency Rating factors as described on forms ES-303-1 and ES-              .
303-3.)
: 12.      Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301 -5 (submit the form with the simulator scenarios).
: 13.      The level of difficulty is appropriate to support licensing decisions for each crew position.
Target Quantitative Attributes (Per Scenario; See Section D.5.d)              Actual Attributes      -      -
4      5    6
: 1.        Malfunctions after EOP entry (1-2)                                                    1      1    3
: 2.        Abnormal events (2-4)                                                                4      3    4
: 3.        Major transients (1-2)                                                                2      1    1
: 4.        EOPs entered/requiring substantive actions (1-2)                                      2      2    2
: 5.        EOP contingencies requiring substantive actions (0-2)                                1      1      7
: 6.        Critical tasks (2-3)                                                                  2      2    2 NOTE:
* The facility signature is not applicable for NRC-developed tests.
                      # Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
NUREG-1021, Revision 10
ES-301                                                  Transient and Event Checklist                                                          Form ES-301-5 (Rev_Of 2516)
Facility:            Robinson                                        Date of Exam:          2/2016                    Operating Test No.:              N16-1 A          E                                                                        Scenarios P          V            N16-1-1                  N16-1-2                N16-1-3                N16-1-6                T                      M P          F                                                                                                            0                        I L          N                                                                                                            T                      N CREW                    CREW                    CREW                    CREW I          T            POSITION                POSITION                POSITION                                        A                        I POSITION C                                                                                                                          L                    M A          I                                                                                                                                    u N          Y T          P          S      A        B      S      A        B      S      A      B      S        A      B                    R          I          U E          R      T        0      R      T        0      R      T      0        R        T      0 0      C        P      0      C        P      0      C      P      0        C      P RX                                                                                                                1          1          1            0 2
NOR                                                                                                              2          1          1            1 1,2,                                                    1,4,                            1,3, 17          4        4            2 SROI-l        I/C            5 6                                                        6                                6 MA]                                                                                                              3          2        2            1 1,2 TS                                                                                                                2          0        2            2 2
RX                                                                                                                7          1          1            0 1,3    1 NOR                                                                                                              3          1          1            1 2,4,  2,3,                                                      4,5 9          4        4            2 SROI-3        I/C 6      6                                                        6 MA]                                                                                                              3          2        2            1 TS                                                                                                                2          0        2            2 1
RX                                                                                                                1          1          1            0 3                                        2 NOR                                                                                                              2          1          1            1 2,4,            1,2,                                    1,3, 12          4        4            2 SROI-5        I/C                                        8,9              4,5                                      7,9 6                6                                        6 MA]                                                                                                                          2          2            1 1,5 TS                                                                                                                2          0          2            2 2
RX                                                                                                                1          1          1            0 1      3 NOR                                                                                                              2          1          1            1 3,5    1,2, 4          4            2 SROI-6        I/C                                                                                                              8 6      6                                6 MA]                                                                                                              3          2          2            1 1,5 TS                                                                                                              2          0          2            2 Instructions:
: 1.          Check the applicant level and enter the operating test number and Form ES-D-1 event numbers tor each event type; TS are not applicable for RO applicants. ROs must service in both the at-the-controls (ATC) and balance-ot-plant (BOP) positions; Instant SROs (SRO-l) must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one malor transient, in the ATC position. If an Instant SRO-l additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
: 2.          Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix 0. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.
: 3.          Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.
For licensees that use the ATC operator pnmahly for monitoring plant parameters, the chief examiner may place SRO-l applicants in either the ATC or
* BOP position to best evaluate the SRO-l in manipulating plant controls.
NUREG 1021 Revision 10
ES-301                                                  Transient and Event Checklist                                                          Form ES-301-5 (Rev_O1 2516)
Facility:            Robinson                                        Date of Exam:            2/2016                  Operating Test No.:                N16-7 A            E                                                                      Scenarios P            V            N16-1-1                  N16-1-2                  N16-l-3                  N16-1-6              T                      M P            E                                                                                                            0 L            N                                                                                                            T                      N CREW                    CREW                      CREW                    CREW T          POSITION                POSITION                                                                  A                        I POSITION                POSITION C                                                                                                                          L                      M A            T                                                                                                                                    U N            Y T            P        S      A        B      S      A        B      S      A      B        S        A      B                    R          I          U E        R      T        0      R      T        0      R      T      0        R        T    0 0        C        P      0      C        P      0      CPO                      C      P RX                                                                                            2 1            1        1            0 1
NOR                                                                                                              2            1        1            1 3,5    1,2, SROI-7        I/C                                                                                                              8          4          4            2 MAJ                                                  6      6                                6 3          2          2            1 1,5 TS                                                                                                              2          0          2            2 RX                                                                                                              1            1        1            0 1,3                                                      2 NOR                                                                                                              3            1        1            1 2,4,                                      1,4,            1,3, SROI-8        I/C                                                                                  4,5                      10          4          4            2 6                                        6              6 MAJ                                                                                                              3          2          2            1 IS                                                                                                                2          0          2            2 RX                                                                                                              7          1          1            0 1,3                                                      2 NOR                                                                                                              3          1          1            1 2,4,                                    1,4,            1,3, SROI-9        I/C 10          4          4            2 6                                        6              6 MAJ                                                                                                              3          2          2            1 Is                                                                                                                2          0          2            2 RX                                                                                                                1          1          1            0 NOR                                                                                                              1          1          1            1 1,4,                                                      1,2, RO-1                                                                                                                                        4          4            2 I/C                                                                                                              6 6                                                        6 MAJ                                                                                                              2          2          2            1 TS                                                                                                                0          0          2            2 Instructions:
: 1.          Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must service in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SRO5 (SRO-l) must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO-l additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
: 2.          Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. () Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.
: 3.          Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.
For licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-l applicants in either the ATC or GOP position to best evaluate the SRO-l in manipulating plant controls.
NUREG 1021 Revision 10
ES-301                                                  Transient and Event Checklist                                                            Form ES-301 -5 (Rev_O1 2576)
Facility:            Robinson                                        Date of Exam:          2/2016                  Operating Test No.:                N16-1 A              E                                                                      Scenarios P            V            N16-f-1              N16-1-2                  N16-l-3                  N16-l-6              T                      M P            E                                                                                                          0                        I L            N                                                                                      CREW                T                      N CREW                  CREW                      CREW I            T          POSITION              POSITION                  POSITION                POSITION              A                      I C                                                                                                                          L                      M A            I                                                                                                                                  u N            Y T            P        5      A      B      S        A        B      S      A      B        S      A      B                    R          I          U E        A      1      0      A        1        0      R      1      0        R      1      0 0      C      P      0        C        P    0        C      P      0        C      P 1                                                                    1          1          1          0 RX NOR                                                                                                              1          1          1          1 2.4,                            1,2,                                7          4          4            2 8, 9                            7 RO-2            I/C 6                                6                                    2          2          2          1 MAJ TS                                                                                                                0          0        2            2 1                                                                    1          1          1          0 RX NOR                                                                                                                          1          1          1 24,                              1,2,                                                                    2 7          4          4
: 8. 9                            7 RO-3            I/C 6                                6                                    2          2          2          1 MAJ Is                                                                                                              0          0          2          2 RX                                                                                                              1            1          1          0 1                                                          1            1          1          1 NOR 1,5                                                                                            4          4          4          2 RO-4            I/C 6                                6                                                          2          2          2          1 MA]
TS                                                                                                                0          0          2          2 RX                                                                                                              0          1          1        0 2                          2            1          1          1 NOR 1,2,                                                                      1,3,                                    4          4          2 SROU-1          I/C                                                                                4.5                        8 6                                                                        6                          2          2          2          1 MAJ 1,2                                                                                                  4            0          2          2 TS Instructions:
: 1.          Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must service in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SRO5 (SAC-I) must serve in both the SAC and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position, If an Instant SRO-l additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
: 2.            Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. () Reactivity snd normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.
: 3.          Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.
For licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-l applicants in either the ATC or SOP position to best evaluate the SAC-I in manipulating plant controls.
NUREG 1021 Revision 10
ES-3d                                                    Transient and Event Checklist                                                          Form ES-301-5 (Rev_012516)
Facility:            Robinson                                        Date of Exam:            2/207 6                  Operating Test No.:              N16-1 A            F                                                                      Scenarios P          V              N16-1-1                  N16-1-2                N16-1-6                  N16-1-5              I                      M P            F                                                                                                            0                      I L          N                                                                                                              T                      N CREW                    CREW                    CREW                    CREW I          T            POSITION                POSITION              POSITION                  POSITION              A C                                                                                                                          L                      M A            T                                                                                                                                    u N            Y T            P          S      A        B        S      A      B      S        A      B        S        A      B                    A          I          U E          R      T      0        R      T      0      R        T      0        A        T      0 0        C      P        0      C      P      0        C      P        0        C      P AX                                                                                                              0            1        1            0 1
NOR                                                                                                              2            1        1            1 1,2,                                                                      2,3, 4.5 8            4        4            2 SROU-2        I/C        45 6                                                                        6                          2            2        2            1 MAJ 1,2                                                                                                  4                                  2 TS                                                                                                                            0        2 RX                                                                                                              7            1        1            0 1                                                                1 NOR                                                                                                              2            1        1            7 1,5            2,3,                                                            2,3        8            4        4            2 SROI-2        I/C                                45 6              6                                                                6                                              1 MAJ                                                                                                              3            2        2 TS                                                                                                              2            0        2            2 1
RX                                                                                                              7            1          1          0 1                                      2 NOR                                                                                                              2            1          1            7 2,3,                                    1,3,            4,5, 4,5                                      7,9              7 4        4            2 SROI-4        I/C 6                                        6                6                  3                      2            1 MA]                                                                                                                          2 TS                                                                                                              2            0        2            2 RX                                                                                                                          1          1            0 NOR                                                                                                                          1          1            1 4        4            2 I/C MAJ                                                                                                                          2          2            1 TS                                                                                                                            0          2            2 Instructions:
: 1.          Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable tor RO applicants. ROs must service in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SROs (SRO-l) must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO-l additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
: 2.          Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. () Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-I basis.
3            Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.
For licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-I applicants in either the ATC or BOP position to best evaluate the SRO-l in manipulating plant controls.
NUREG 1021 Revision 10
ES-3D 1                                        Competencies Checklist                      Form ES-3D 1-6 (Rev_Of 2376)
Facility:      Robinson          Date of Examination:          2/2016          Operating Test No.:      N16-1 APPLICANTS SRO (U/I)                    RO/ATC                      BOP Competencies                      SCENARIO                    SCENARIO                SCENARIO 1      2      3      4    1    2    3      4    1    2      3      4 I nterpret/Diag nose Events and                        1-7    1-9    1-8    1-9  1-7  1-9  1-8    1-9    1-7  1-9    1-8    1-9 Conditions Comply With and Use              1-7    1-9    1-8    1-7  1-7  1-9  1-8    1-9    1-7  1-9    1-8    1-9 Procedures (1)
Operate Control                                                                                              2,4, 1 2  1 3    1 2  1 2          1 2 Boards (2)                      NA      NA      NA      NA          4,6, 4:5:  3:7:  3,4,          3:6:
6      7 8,9    6      9    6,7 Communicate and                  1-7    1-9    1-8    1-9  1-7    1-9  1-8    1-9  1-7  1-9    1-8    1-9 Interact Demonstrate Supervisory Ability              1-7    1-9      1-8    1-9  NA    NA  NA    NA    NA    NA      NA    NA (3)
Comply With and Use              1-2    3-4      1,5    4-5  NA    NA  NA    NA    NA    NA      NA    NA Tech. Specs. (3)
Notes:
(1)  Includes Technical Specification compliance for RO.
(2) Optional for an SRO-U.
(3) Only applicable to SROs.
Instructions:
Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant. (This includes all rating factors for each competency.) (Competency Rating factors as described on forms ES-303-1 and ES-303-3.)
NUREG-1021, Revision 10
ES-301                                        Competencies Checklist                    Form ES-301 -6 (Rev 012316)
Facility:    Robinson          Date of Examination:          2/2016        Operating Test No.:  N16-1 APPLICANTS SRO (U/I)                  RO/ATC                  BOP Competencies                        SCENARIO                    SCENARIO            SCENARIO 5      6                  5      6              5    6 Interpret/Diagnose Events and                      1-7    1-9                  1-7    1-9            1-7  1-9 Conditions Comply With and Use                                          1-7    1-9            1-7  1-9 1-7    1-9 Procedures (1)
Operate Control                                              1,4,                        1,2, 24            12 Boards (2)                      NA      NA                  5,6,                        3,6, 56          36 Communicate and                                              1-7    1-9            1-7  1-9 1-7    1-9 Interact Demonstrate Supervisory Ability              1-7      1-9                NA    NA              NA  NA (3)
Comply With and Use                                          NA    NA              NA    NA 3,5    3-4 Tech. Specs. (3)
Notes:
(1)  Includes Technical Specification compliance for RO.
(2)  Optional for an SRO-U.
(3)  Only applicable to SROs.
Instructions:
Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant. (This includes all rating factors for each competency.) (Competency Rating factors as described on forms ES-303-1 and ES-303-3.)
NUREG-1021, Revision 10
ES-401                                          PWR Examination Outline                                          Form ES-401-2 Facility:    ROBNSON                                    Date of Exam:  FEBRUARY 2016 ROK/ACatpoPah-its                                      SRO-Only_Points Tier          Group KKKKKKAAAAG                                                      A2            G*      Total 1    2 3 4 5 6              1  2 3 4
* Total
: 1.              1          3    3  3                  3  3              3      18        3            3        6 Emergency &
Abnormal              2              .1 .2_        N/A      1  2      N/A      1    9          2            2        4 Evolutions        Tier Totals    4    5  5                4    5              4    27          5            5        10 1          33223223332                                          28          3            2        5 2.
Plant              2          111111110                                  ii        10      0    2          1        3 Systems Tier Totals    4    4  3  3    4  3  3    4    3    4    3    38          5            3        8
: 3. Generic Knowledge and AbUities Categories 1L2]3J                      4]      io    [N 1    2    3  j  4      7 3        2        2        3              ftl      2    2      2 Note:      1. Ensure that at least two topics from every applicable K/A category are sampled within each tier of the RO and SRO-only outlines (i.e., except for one category in Tier 3 of the SRO-only outline, the Tier Totals in each K/A category shall not be less than two). (One Tier 3 Radiation Control K/A is allowed if the K/A is replaced by a K/A from another Tier 3 Category).
: 2. The point total for each group and tier in the proposed outline must match that specified in the table. The final point total for each group and tier may deviate by +/-1 from that specified in the table based on NRC revisions. The final RO exam must total 75 points and the SRO-only exam must total 25 points.
: 3. Systems/evolutions within each group are identified on the associated outline; systems or evolutions that do not apply at the facility should be deleted with justification; operationally important, site-specific systems/evolutions that are not included on the outline should be added. Refer to Section D.1 .b of ES-401 for guidance regarding the elimination of inappropriate K/A statements.
: 4. Select topics from as many systems and evolutions as possible; sample every system or evolution in the group before selecting a second topic for any system or evolution.
: 5. Absent a plant-specific priority, only those K/As having an importance rating (IR) of 2.5 or higher shall be selected. Use the RO and SRO ratings for the RO and SRO-only portions, respectively.
: 6. Select SRO topics for Tiers 1 and 2 from the shaded systems and K/A categories.
: 7. The generic (G) K/As in Tiers I and 2 shall be selected from Section 2 of the K/A Catalog, but the topics must be relevant to the applicable evolution or system. Refer to Section D.1 .b of ES-401 for the applicable K/As.
: 8. On the following pages, enter the K/A numbers, a brief description of each topic, the topics importance ratings (IRs) for the applicable license level, and the point totals (#) for each system and category. Enter the group and tier totals for each category in the table above; if fuel handling equipment is sampled in a category other than Category A2 or G on the SRO-only exam, enter it on the left side of Column A2 for Tier 2, Group 2 (Note #1 does not apply). Use duplicate pages for RO and SRO-only exams.
: 9. For Tier 3, select topics from Section 2 of the K/A catalog, and enter the K/A numbers, descriptions, IRs, and point totals f#) on Form ES4OI-3. Limit SRO selections to K/As that are linked to 10 CFR 55.43.
G*    Generic K/As
ES-401, REV 9                                            TIGI PWR EXAMINATION OUTLINE                                                    FORM ES-40f-2 KA          NAME I SAFETY FUNCTION:                  IR    Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO    SRO 007EK2.02    Reactor Trip Stabilization Recovery  2.6  2.8      fl j  1J            fl  Breakers, relays and disconnects
            /1 008AG2. 1.30 Pressurizer Vapor Space Accident / 3  4.4  4.0 DED&#xfc;LLJ                        Ability to locate and operate components, including local controls.
OO9EA1 .10  Small Break LOCA/ 3                  3.8  3.9 LELDEL]                        Safety parameter display system 01 1EK3.15  Large Break LOCA /3                  4.3  4.4 LEDE1L1EDDD                    Criteria for shifting to recirculation mode 022AA2.03    Loss of Rx Coolant Makeup 1 2        3.1  3.6 L]DCE&#xdc;EIfl ic1L1L              Failures of flow control valve or controller 025AG2.4.47  Loss of RHR System /4                4.2  4.2                                Ability to diagnose and recognize trends in an accurate and timely manner utilizing the appropriate control room reference material.
027AK2.03    Pressurizer Pressure Control System  2.6  2.8 EL&#xfc;DLDE1                        Controllers and positioners Malfunction / 3 029EK2.06    ATWS/1                                2.9  3.1                                Breakers, relays, and disconnects.
038EK1 .04  Steam Gen. Tube Rupture I 3          3.1  3.3                                Reflux boiling 040AK1 .05                      -
Steam Line Rupture Excessive Heat    4.1                                      Reactivity effects of cooldown LE1DLJL1EELi Transfer I 4 054AA1 .03  Loss of Main Feedwater / 4            3.5  3.7                                AFW auxiliaries, including oil cooling water supply Page 1 of 2                                                06/22/2015 9:28 AM
ES-401, REV 9                                      If GI PWR EXAMINATION OUTLINE                                                      FORM ES-401-2 KA          NAME I SAFETY FUNCTION:              IR    Kl 1(2 K3 1(4 1(5 1(6 Al A2 A3 A4 G TOPIC:
RD    SRO 055EK3.02  Station Blackout / 6              4.3  4.6                                      Actions contained in EOP far loss of offsite and onsite El El 1] El El El El El El El El    power 056AA2.1 1  Loss of Off-site Power I 6        2.9  2.9                                      Operational status of service water booster pump ElEEElElEElElDEl 057AA2fr Loss of Vital AC Inst. Bus / 6                                                                                          fflVer-&aIteete aur Th 3*7    Y*I                                                                P o. C.      o4 ot2cfrttCJ Tko.1        . I 058M1 .02  Loss of DC Power / 6              3.1  3.1                                      Static inverter dc input breaker, ftequency meter, ac CElDElElEElD[1L                    output breaker and ground fault detector weO4EG2.4.% LOCA Outside Containment /3      4.2  4.2                                      Ability to verify that the alarms are consistent with the ElElElEElElDLiDEH                  plant conditions.
WEO5EK3.4                              -
Inadequate Heat Transfer Loss of  3.7  3.9                                      RO ai SRO function within the control room team as EElElDDDElDEEl                      appropriate to the assigned position, in such a way that Secondary Heat Sink / 4 procedures ate adhered to and the limitations in the facilities license and amendments are not violated.
WE11EK1,1  LossofEmergencyCoolantRecirc.I4  3.7  4.0    El El El El El El El El El El    Components, capacity, and function of emergency Systems.
Page 2 of 2                                                  06/22/2015 9:28 AM
ES-401, REV 9                                            TIG2 PWR EXAMINATION OUTLINE                                                        FORM ES-401-2 KA            NAME I SAFETY FUNCTION:                  IR    Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G        TOPIC:
RO    SRO 005AK2.02    lnoperablelstuck Control Rod /1      2.5  2.6 2]      2] 2] 2] 2] 2] 2] 2] 2)) 2]    Breakers, relays, disconnects and control room switches 028AK1 .01    Pressurizer Level Malfunction I 2    2.8  3.1 ]J 2] 2] 2] 2] 2] 2] 2] 2] [2] 2]      PZR reference leak abnormalities 032AA2.02    Loss of Source Range NI I 7          3.6  3.9 2] 2] 2] 2] 2] 2] 2]          2] 2] 2]  Expected change in source range count rate when rods are moved 033AK3.01    Loss of Intermediate Range NI / 7    3.2  3.6 2] 2]      [2] 2] 2] 2] 2] [2] 2] 2]    Termination of startup following loss of intermediate-range instrumentation 060AK2.01    Accidental Gaseous Radwaste Rel. I 9  2.6  2.9 2]      2] 2] 2] 2] 2] 2] 2] 2] 2]      ARM system, including the normal radiation-level indIcations and the operability status 067AA1 .09    Plant Fire On-site / 8                3    3.3 2] 2] 2] 2] 2] [2]      [j 2] 2] 12] 2] Plant fire zone panel (including detector location) 068AK3. 12    Control Room Evac. /8                4.1  4,5 2] 2]      2] 2] 2] 2] 2] 2] 2] 2]      Required sequence of actions for emergency evacuation of control room 076AA2.04    High Reactor Coolant Activity /9    2.6    3  2)) 2)) 2] 2)) 2] 2] 2] J 2)) [2] 2]    Process effluent radiation chart recorder we09EG2. 1.20 Natural Circ. / 4                    4.6    4.6 [1.                                    Ability to execute procedure steps.
2] 2] 2] 2] 2] 2] 2] 2] 2]      [j Page 1 of 1                                                    06/22/2015 9:28 AM
ES-401, REV 9                                  T2GI PWR EXAMINATION OUTLINE                                                        FORM ES-401-2 KA        NAME I SAFETY FUNCTION:            IR    Ki K2 K3 1<4 K5 K6 Al A2 A3 A4 G      TOPIC:
RO    SRO 003A3.01  Reactor Coolant Pump            3.3  3.2            fl                ?1 []    Seal injection flow 003K4.07  Reactor Coolant Pump            3.2  3.4    fl                  fl [J fl EJ J  Minimizing RCS leakage (mechanical seals) 004K2.06  Chemical and Volume Control    2.6  2.7 [] (i)] (J [] [] fl fl [] U U U        Control instrumentation 005A2.02  Residual Heat Removal          3,5  3.7                    tJ U            U  Pressure transient protection during cold shutdown 005K6.03  Residual Heat Removal          2.5  2.6    U U U U                          EJ RHR heat exchanger 006A1.13  Emergency Core Cooling          3.5  3.7            U U Li      rj      U    Accumulator pressure (level. boron concentration) 0061<5.01  Emergency Core Cooling          2.8  3.3 U      U              U    []      Effects of temperatures on water level indications 007K3.O1  Pressurizer Relief/Quench Tank  3.3  3.6    U      U U U U Li Li Li U          Containment 0O8A4e. Component Cooling Water        -26L  Li                                    tt1gg of-thg CGN-pu,..p dJiorgo :ale fM                                  33    3,)                                        c.cbJ    i4,c&t,b6 o.J          o-faU 0101<6.04  Pressurizer Pressure Control    2.9  3.2  U Li Li    [1 Li        U U U U U      PRT 012A3.06  Reactor Protection              3.7  3.7  U Li Li U [1 U Li Li                  Trip logic fl Page 1 of 3                                                  06/22)2015 9:28 AM
ES-401, REV9                                          T2GI PWR EXAMINATION OUTLINE                                                  FORM ES-401-2 KA        NAME I SAFETY FUNCTION:                  IR    K1 K2 K3 K4 K5 K6 Al A2 A3 A4 G  TOPIC:
RO    SRO 012K1.05  Reactor Protection                    3.8  3.9                                  ESFAS Li 013K5.02  Engineered Safety Features Actuation 2.9    3.3 LLiI{DLEL                        Safely system logic and reliability 022A4.04  Containment Cooling                  3.1  3.2                                  Valves in the CCS 026A2.08  Containment Spray                    3.2    3.7                                  Safe securing of containment spray when it can be done)
ELE1L 039A1 .10  Main and Reheat Steam                2.9    3.0                                  Air ejector PRM 059K4.02  Main Feedwater                      3.3    3.5                                  Automatic turbine/reactor trip runback 061 1(5.01 AuxiliarylEmergency Feedwater        3.6    3.9                                  Relationship between AFW flow and RCS heat transfer DLLJL1D[1DE&#xfc;i 062K1 .04  AC Electrical Distribution          3.7  4.2  LDDflLiEE1!ZDE                  Off-site power sources 062K2.01  AC Electrical Distribution          3.3                                        Major system loads DD&#xfc;EiD1 063A3.01  DC Electrical Distribution          2.7  3.1                                  Meters, annunciators, dials, recorders and indicating lights 064A2.18  Emergency Diesel Generator          2.6  2.7                                  Consequences of premature opening of breaker under load Page 2 of 3                                                06122/2015 9:28 AM
ES-401, REV 9                                  12G1 PWR EXAMINATION OUTLINE                                                  FORM ES-401-2 KA        NAME / SAFETY FUNCTION:          IR    K1 K2 K3 K4 K5 K6 Al A2 A3 A4 G    TOPIC:
RO    SRO 064K2.02  Emergency Diesel Generator    2.8  3.1 H        H      .
U  H        Fuel oil pumps 073A4.O1  Process Radiation Monitoring  3.9  3.9    U    H                        Effluent release 073G2.4.9  Process Radiation Monitoring 3.8    4.2 H LI U Li LI LI H Li              Knowledge of low power / shutdown implications in accident (e.g. LOCA or loss of RHR) mitigation strategies.
076K1.15  Service Water                2.5    2.6 j  H Li LI LI [J Li LI  [1      FPS H LI 078K3.03  Instrument Air              3.0    3.4 Li          Ej  U] LI LI [J LI LI Cross-fled units 103G2.l.7  Containment                  4.4    4.7                                  Ability to evaluate plant performance and make
[J 4J ] U] U] U] [] U] U] ]    operational judgments based on operating characteristics, reactor behavior and instrument interpretation.
Page 3 of 3                                                06/22)2015 9:28 AM
ES-401, REV 9                                T2G2 PWR EXAMINATION OUTLINE                                                      FORM ES-401-2 KA        NAME I SAFETY FUNCTION:          IR    KI K2 K3 K4 K5 K6 Al A2 A3 A4 G      TOPIC:
RO    SRO 001K6.13  Control Rod Drive            3.6  3.7 Li Li Li Li LI        Li Li LI Li Li Location and operation of RPIS 002K4.0J  Reactor Coolant              2.7  3.0 Fl LI Li l Li Li [I Li Li El Li      Filling and draining the RCS O1IAI.02  Pressurizer Level Control    3.3  3.5 Li El LI El Li Li        LI Li LI LI Charging and letdown flows 014K5.0l  Rod Position Indication      2.7  3.0 fl      Li J        Li Li LI El Li Reasons for differences between RPIS and step counter 017A4.0l  In-core Temperature Monitor  3.8  4.1    LI Li Li LI Li [1 Li Li          Actual in-core temperatures 027K2.0f  Containment Iodine Removal  3.1  3.4 Li [) Li Li E]  LI El El Li LI LI    Fans 029G2.l.23 Containment Purge            4.3  4.4 Li Li LI Li Li LI Li Li LI El        Ability to perform specific system and integrated plant procedures during all modes of plant operation.
033K3.02  Spent Fuel Pool Cooling      2.8  3.2 Li Li J Li Li; LI Li Li LI Li Li    Area and ventilation radiation monitoring systems 035A2.05  Steam Generator              3.2  3.4 Li Li Li Li Li Li Li i Li Li Li      Unbalanced flows to the 5/Gs 068K1 .07  Liquid Radwaste              2.7  2.9    LI Li LI Li El Li Li LI Li LI    Sources of liquid wastes fo LRS Page 1 of 1                                                  06/22)2015 9:28 AM
ES-401, REV 9                                  T3 PWR EXAMINATION OUTLINE                                                          FORM ES-401-2 KA        NAME I SAFETY FUNCTION:        IR      Ki K2 K3 K4 1(5 1(6 Al A2 A3 A4  G  TOPIC:
RO    SRO G2.l .29  Conduct of operations      4.1  4.0  LiD LiD [I [I                        Knowledge of how to conduct system lineups, such as
[I [I [I valves, breakers, switches, etc.
G2.l .36  Conduct of operations      3.0    4.1                                      Knowledge of procedures and limitations involved in core LiD LiD LI LI Li Li Li [I alterations G2.1.45    Conduct of operations      4.3    4.3                                      Ability to identity and interpret diverse indications to LiD Li Li F] Li Li Li validate the response of another indication G2.2.38    Equipment Control          3.6    4.5 [IF] LiLi Li Li Li Li LI [I J        Knowledge of conditions and limitations in the facility license.
G2.2.39    Equipment Control          3.9    4.5                                      Knowledge of less than one hour technical specification LiLi ED Li LI Li EJ Li Li        j action statements for systems.
G2.3.1 3  Radiation Control          3.4    3.8                                      Knowledge of radiological safety procedures pertaining to LiE Li Li F] Li [I Li ]
licensed operator duties G2.3.4    Radiation Control          3.2  3.7                                      Knowledge of radiation exposure limits under normal and LiE LiD Li Li Li Li Li Li emergency conditions G2.4.1 1  Emergency Procedures/Plans 4.0  4.2                                      Knowledge of abnormal condition procedures.
ELi F] F] LI Li Li Li G2.4.25    Emergency Procedures/Plans 3.3  3.7 LiLi LiE F]        F]                Knowledge of fire protection procedures.
Li fl [I [I G2.4.31    Emergency Procedures/Plans 4.2  4.1                                      Knowledge of annunciators alarms, indications or
[I F] Li Li F] Li Li Li Li F] [
response procedures Page 1 of 1                                                    06/22/201 5 9:52 AM
ES-401, REV 9                                      SRO TIGI PWR EXAMINATION OUTLINE                                                    FORM ES4OI-2 KA          NAME I SAFETY FUNCTION:                  IR    1<1 1(2 K3 K4 1(5 K6 Al A2 A3 A4 G TOPIC:
RO    SRO 029EA2.06  ATWS / 1                            3.8  3.9 j                                  Main turbine trip switch position indication            -
038EG2.4.47 Steam Gen. Tube Rupture I 3        4.2    4.2    []                            Ability to diagnose and recognize trends in an accurate J []
and timely manner utilizing the appropriate control room reference material.
054AG2.4.9  Loss of Main Feedwater I 4          3.8    4.2                                    Knowledge of low power! shutdown implications in fl                      []
accident (e.g. LOCA or loss of RHR) mitigation strategies.
055EA2.06  Station Blackout! 6                3.7    4.1                                    Faults and lockouts that must be cleared prior to re energizing buses 058AG2.2.22 Loss of DC Power /6                4.0    4.7 L [J J                            Knowledge of limiting conditions for operations and D fl    J safety limits.
077AA2.03  Generator Voltage and Electric Grid 3.5    3.6                                    Generator current outside the generator capability curve Disturbances / 6
[ [J Page 1 of 1                                                06/22/2015 9:28 AM
ES-401, REV 9                                SRO TIG2 PWR EXAMINATION OUTLINE                                                  FORM ES-401-2 KA          NAME I SAFETY FUNCTION:          IR    Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G  TOPIC:
RO    SRO OO1AA2.02    Continuous Rod Withdrawal Il 4.2    4.2          U U U U        U LI LI  Position of emergency boration valve 051AG2.4.35  Loss of Condenser Vacuum /4  3.8  4.0 LI LI fl LI LI H LI LI LI LI    Knowledge of local auxiliary operator tasks during emergency and the resultant operational effects 061AA2.03    ARM System Alarms /7        3      3.3 LI LI LI LI LI fl LI    LI LI LI Setpoints for alert and high alarms weO6EG2.l.23 Degraded Core Cooling / 4    4.3    4.4    LI LI LI LI [] LI LI LI LI {] Ability to perform specific system and integrated plant procedures during all modes of plant operation.
Page 1 of 1                                              06/22/2015 9:28 AM
ES-401, REV9                          SRO T2GI PWR EXAMINATION OUTLINE                                                  FORM ES-401-2 KA        NAME I SAFETY FUNCTION:    IR    Kl 1(2 K3 1(4 K5 K6 Al A2 A3 A4 G TOPIC:
RO    SRO 01 2A2d.-  Reactor Protection                                                  IM1VtP.-....
E 2O5                            yI 7:-                                        F H)        or                                o  ddor.
                                                                                &            &lC.t)e      cJo 039A203    Main and Reheat Steam                                              Indications and alarms for main steam and area radiation monitors (during SGTR) 076G2.1.7  Service Water          4.4  4.7                                  Ability to evaluate plant performance and make EflDEJL1E operational judgments based on operating characteristics, reactor behavior and instrument interpretation.
078A2.01    Instrument Air          2.4  2.9                                    Air dryer and filter malfunctions 1 03G2.4.35 Containment            3.8  4.0                                    Knowledge of local auxiliary operator tasks during flD1ELEDD emergency and the resultant operational effects Page 1 of I                                              06(2212015 9:28 AM
ES-401, REV9                          SRO T2G2 PWR EXAMINATION OUTLINE                                                  FORM ES-401-2 KA          NAME I SAFETY FUNCTION:      IR    Kl K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO    SRO 015A2.04    Nuclear Instrumentation  3.3  3.8                                Effects au axial flux density of control rod alignment and sequencing, xenon production and decay, and boron vs.
control rod reactivity changes 068A2.02    Liquid Radwaste          2.7 2.8 EDD              L]EEfl          Lack of tank recirculation pnor to release 071 G2.4.21 Waste Gas Disposal      4.0    4.6                                Knowledge of the parameters and logic used to assess the status of safety functions Page 1 of I                                              06/22)2015 9:28AM
ES4OI, REV9                              SRO T3 PWR EXAMINATION OUTLINE                                                    FORM ES-401-2 KA      NAME I SAFETY FUNCTION:        IR    K1 K2 K3 1<4 K5 K6 Al A2 A3 A4 G  Topic:
RO    SRO G2.l.45  Conductof operations        4.3  4.3 El El El El El El El El El El i  Ability to identify and interpret diverse indications to validate the response of another indication G2.2.21  Equipment Control          2.9    4.1                                  Knowledge of pre- and post-maintenance operability ElElLElElElElElLEl requirements.
G2.2.36  Equipment Control          3.1    4.2                                  Ability to analyze the effect of maintenance activities.
ElElElElEElElElElE[
such as degraded power sources, on the status of limiting conditions of operations G2.3.12  Radiation Control          3.2    3.7                                  Knowledge of radiological safety principles pertaining to ElElDElElElElElElEl licensed operator duties G2.3.14  Radiation Control          3.4  3.8                                  Knowledge of radiation or contamination hazards that EElElUElDElElElEl may arise during normal, abnormal, or emergency conditions or activities G2.4.30  Emergency Procedures/Plans 2.7  4.1                                  Knowledge of events related to system operations/status L1ElDElElL]EiElElEl that must be reported to internal orginizations or outside agencies.
G2.4.46  Emergency Procedures/Plans 4.2  4.2                                  Ability to verify that the alarms are consistent with the E1ElEElDDEElElEl plant conditions.
Page 1 of 1                                                  06/22/2015 9:28 AM
ES-401                    Record of Rejected K/A's                        Form ES-401-4 Randomly Selected Tier / Group                                            Reason for Rejection KA Facility rarely throttles the CCW Pump discharge valves, and when this does occur (During Testing) indications of the action are in the field. Best effort was made to construct question, but it RO 2/1        008 A4.03 did NOT result in a psychometrically sound question (No Plausible Distractors). Replaced with 008 A4.01, randomly chosen by the Chief Examiner.
The AC instrument busses at the facility have no associated alarms in the Control Room, NOR does the alternate power source for those AC instrument busses. The best effort was RO 1/1        057 AA2.06 made to construct a question but it was determined we could not hit this KA. Replaced with 057 AA2.15, randomly chosen by the Chief Examiner.
The incorrect bypassing of a channel at RNP results in a plant trip in most cases. Trying to find an instrument that could be incorrectly bypassed, but not cause a trip, and then write a question to an SRO only level (most of these error scenarios SRO 2/1        012 A2.03 would be RO knowledge) was very difficult and in the attempt that was made, could be tied back to a less than one hour tech spec, and thereby removing the SRO only plausibility. Replaced with 012 A2.05, randomly chosen by the Chief Examiner.
ES4OI                                      Written Examination Quality Checklist                                      Form ES4OI-6 fadifty:      Robinson Nudear Plant                            Date of Exam:            2/1/2016      Exam Level;  RD      SRO  C Initial Item Description                                                a    b*
: 1.            Questions and answers are technically accurate and applicable to the faciflty.                            t-
: 2.            a.          NRC K/As are referenced for all questions.
: b.          Facility learning objectives are referenced as available.
: 3.          SRO questions are appropriate in accordance with Section D.2,d of ES-401
: 4.          The sampling process was random and systematic (If more than 4 RD or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR DL program office).
: 5.          Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item that applies) and appears appropriate:
the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or the examinations were developed independently; or                                                      c the ficensee certifies that there is no duplication; or other (explain)
: 6.          Bank use meets limits (no more than 75 percent                      Bank        Modified        New from the bank, at least 10 percent new, and the rest                                                                -
new or modified); enter the actual RD I SRQ-only question distribution(s) at right.                                1$  /    -    5  /        52  /    -
: 7.          Between 50 and 60 percent of the questions on the RD                    Memory                C/A exam are written at the comprehension! analysis level; the SRO exam may exceed 60 percent if the randomly                                                          L...
selected K/As support the higher cognitive levels; enter the actual RD I SRO question distribution(s) at righi 32    I    -          43  /  -
: 8.          RelerencesThandouts provided do not give away answers                                                      ,    &#xa3;_.
or aid in the elimination of distractors.
: 9.          Question content conforms with specific K/A statements in the previously approved examination outline and is appropriate for the tier to which they are assigned;                            (. ft deviations are justified.
: 10.        Question psychometric quality and format meet the guidelines in ES Appendix B.
: 11.        The exam contains the required number of one-point, multiple choice Items; the total is correct and agrees with the value on the cover sheet.
Printed Name I Signature                                  Date
: a. Author                                          Ci(A sSmf,.(
: b. Facility Reviewer f)
: c. NRC Chief Examiner(#)                            Doi          i).  .,d        ,                                        2//    t6 U. NRCRegionalSupervisor                              lQi..p&a c
Note:
* The facility reviewers initials/signature are not applicable br NRC-developed examinations.
              # Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
ES4OI                                    Written Examination Quality Checklist                                      Form ES4OI-6 Fadilty:    Robinson Nuclear Plant                            Date of Exam:          2/1/2016      Exam Level:  RO      SRO    ]
Initial Item Description                                                a    b*    c
: 1.        Questions and answers are technically accurate and applicable to the facility.                            C-  .,,. j,
: 2.        a.          NRC K/As are referenced for all questions.
: b.          Facility learning objectives are referenced as available.
: 3.        SRO questions are appropriate in accordance with Section D.2.d of ES-401 C,.
: 4.        The sampling process was random and systematic (II mote than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR OL program office).                          c.    --
: 5.        Question duplication from the license screenlng!audit exam was controlled as Indicated below (check the Item that applies) and appears appropriate:
            -the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or the examinations were developed Independently; or the licensee certifies that there Is no duplication; or other (explain)
: 6.        Bank use meets limits (no more than 75 percent                      Bank        Modified        New from the bank, at least 10 percent new, and the test new or modified); enter the actual RO I SRO-only                                                            C question distribution(s) at right.                              1$  /  4    5  /  5      52  1    16
: 7.        Between 50 and 60 percent of the questions on the RO                    Memory              C/A exam are written at the comprehension! analysis level; the SRO exam may exceed 60 percent If the randomly                                                        1__.
selected K/As support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at right.
32    /  4          43  /  21
: 8.        References/handouts provided do not give away answers                                                      t._
or aid In the elimination of distractors.
: 9.        Question content conforms with specific K/A statements in the previously approved examination outline and Is appropriate for the tier to which they are assigned; deviations are justified.
: 10.      Question psychometric quality and format meet the guidelines in ES Appendix B.                                          ii
: 11.      The exam contains the required number of one.point, multiple choice items:
the total Is correct  and agrees with the value on the cover sheet.
Printed Name / Signature                                Date
: a. Author                                        Cn&#xe7;e,,ptjt,< M4,jt4                                                      Z]3/It
: b. Facility Reviewer ()                                  .  ..xrrt.e.
: c. NRC Chief Examlnerf#)                            [) r4      n. iJ*6i
: d. NRC Regional Supervisor                                          \                                                    24
(          s.
Note:        The facility reviewers Initials/signature are not applicable for NRC-developed examinations.
            # independent NRC reviewer Initial Items in Column c; chief examiner concurrence required.
ES-401                                                Written Examination Review Worksheet                                                    Form ES-401-9
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q#  LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                                Explanation Focus                Dist.        Link          units ward K/A Only K/A EPE007 EK2.02 1    F    2                          X                                              B  U Choices A and C are not plausible distractors.
Question is Unsatisfactory due to two implausible distractors.
1/4/2016 - Revised question is Satisfactory.
K/A APE008 2.1.30 2    H    2                                              ?                        N  E The first part question is too much overlap with Scenario 3 Event 5.
They are the same immediate actions. Also, closing RC-535 is in all 4 answer choices.
Is knowledge of this power supply minutia? You have used that argument for one of the early submittal questions.
1/4/2016 - Revised question is Satisfactory.
K/A EPE009 EA1.10 3    H    2                                      X                                N  E Knowledge of entry conditions for yellow paths is generally considered SRO knowledge. Following the procedure for a yellow path is based on the discretion of the SRO. You can test red and orange.
1/4/2016 - Operations Management approves testing safety Yellow CSFST identification. They have valid objectives and ROs monitor the status of safety functions. This is not procedure selection. (John Little)
K/A EPE011 EK3.15 4    F    2                          X                                              N  E Do not believe that the reason for choices C and D are plausible.
Recommend asking what the maximum RWST level is that requires shifting to ECCS sump recirculation (19% or 27%) and giving times in the initial condition to choose between hot or cold leg recirculation. The reason for picking between hot or cold leg would be the time being greater or less than 11 hours.
1/25/2016 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                      8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                                Explanation Focus                Dist.        Link          units ward K/A Only K/A APE 022 AA2.03 5  H    2    X                                                                  N  E Need to address timing and equipment in AUTO.
1/4/2016 - Revised question is Satisfactory.
K/A APE025 2.4.47 6  H    2            X            X                                              N  U Given that RCS flow is 3000 gallons per minute, the bypass valve demand is 60%, and RCS pressure is being controlled, choices B(1) and D(1) are not plausible.
This is also a very good cue that there has not been a loss of RHR flow.
Question is Unsatisfactory due to two implausible distractors.
1/4/2016 - Revised question is Satisfactory.
K/A APE027 AK2.03 7  H    2    X      X                                                            B  E The picture provided for question #2 provides a clue to one of the questions.
The question and given conditions could be reworded and split into two parts that would make it less error likely for the applicants.
1/4/2016 - Revised question is Satisfactory.
K/A EPE029 EK2.06 8  H    2    X                                                                  N  E The question needs to be reworded some because FRP-S.1 gives you a list of 4 different sets of breakers and tells you to open all of them. It could be argued that there is no correct answer.
1/4/2016 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                              Explanation Focus                Dist.        Link          units ward K/A Only K/A EPE038 EK1.04 9  H    3    X                                                                  N  E With a saturated system, both choices A and D could be argued to be correct. Also, cooling is based on a difference in temperature.
Unable to write a operationally valid question to this K/A.
K/A EPE038 EK1.01 1/25/2016 - Revised question is Satisfactory.
K/A APE 040 AK1.05 10  H    2                                                                X        M  E The first part question does not test the K/A and is more of a systems (tier 2) question. The second part of the question is a GFES question, but is related to the K/A. Recommend asking something about how to add the Boron or how much Boron to add (ECA-2.1).
We can discuss.
1/4/2016 - Revised question is Satisfactory.
K/A APE054 AA1.03 11  F    2                          X                                              B  E Choice D is not plausible because it is cooled by Service Water. Is there another option?
1/4/2016 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                              Explanation Focus                Dist.        Link          units ward K/A Only K/A EPE055 EK3.02 12  F    2    X                    X                                              N  U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.
Distractor B does not appear to be plausible. When starting at a required pressurizer level of only greater than 14% and probable RCP seal leakage, it does not seem reasonable that pressurizer level greater than 7% can be ensured. Also, Distractors A and B are essentially the same thing. Distractor D is not plausible due to not being able to reach a red path if the cooldown rate limit is followed.
The stem question statement is not totally correct. The procedure caution statement only says that pressure should not be lowered less than 190 psig, it does not say to stop before.
Question is Unsatisfactory due to two non-plausible distractors.
Recommendations:
* Remove unnecessary information from current initial conditions. We can discuss specifics.
* Give two times (30 minutes apart) with S/G pressure and pressurizer level. For the first time, have pressurizer level less than 14%. For the second time, have S/G pressure at 190 psig and pressurizer level going off scale low.
* Ask: IAW ECA-0.0, what is the earliest time that the S/G depressurization is required to be stopped AND the reason for stopping the depressurization (preventing injection of accumulator nitrogen into the RCS or ensuring that no Reactor Vessel upper head voiding will occur).
12/3/2015- Question has been modified as recommended above.
Request that you add something to the effect of In accordance with EOP-ECA-0.0 to the question statement. Otherwise, the question is now Satisfactory.
1/4/2016 - Revised question is Satisfactory.
K/A APE056 AA2.11 13  H    3                                                                        B  S Question is Satisfactory.
K/A APE057 AA2.15 14  H    3                                                                        N  S Question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                              Explanation Focus                Dist.        Link          units ward K/A Only K/A APE058 AA1.02 15  F    2                          X                                              N  E Choices B(2) and D(2) are not plausible. Do you have any examples of a case where the electrical output breaker is closed prior to the input breaker when placing a component in service?
There are several other possibilities for this K/A.
1/25/2016 - Revised question is Satisfactory.
K/A WE04 G2.4.46 16  H    3    X                                X                              X  N  U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.
The second part question appears to be asking procedure transition criteria, which is SRO knowledge.
Question is Unsatisfactory due to license level mismatch.
I am not sure that a leak in this location would always cause an APP-036-D7 alarm. The FSAR states that an alarm in this location would most likely be VCT or RWST water because there are so many check valves downstream. The R-4 alarm setpoint is 50 millirem per hour. Did or can you validate on the simulator?
Why ask or mention D8, since it is given in all four answer choices?
12/3/2015- Revised question was submitted. Choices A and D of the revised question are not plausible. How could you have a LOCA outside containment and not have a process monitor high rad alarm.
Also, you could remove all of the only from the choices by adding ALL of the to the question stem.
1/4/2016 - Revised question is Satisfactory.
K/A WE05 EK3.4 17  H    2                          X            X                                M  E Stating that a red condition exists for Heat Sink in the initial conditions makes choice A(2) not plausible. Also, should not state that the red condition exists when steam generator levels and AFW flow are given. The applicant should be able to figure that out.
This also is more of an SRO question with procedure direction.
1/4/2016 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                                Explanation Focus                Dist.        Link          units ward K/A Only K/A WE11 EK1.1 18  H    2    X                                                                  N  E By my calculations, over 4 hours, the RWST level will lower for about 2.7 hours until the SI pump is shut off at 9% and then rise for the remainder. I do agree that overall the level will be lower. Need to work on the wording of the second part of the question in order for there to be a fully correct answer.
Request and IAW statement be added to the stem question.
1/4/2016 - Revised question is Satisfactory.
K/A APE005 AK2.02 19  F    1.5                                                                        B  S Question is Satisfactory.
K/A APE028 AK1.01 20  H    2                          X                                              B  U Choices B and C are not plausible. If the controlling channel increases or decreases, how could other channels remain the same?
Question is Unsatisfactory due to two non-plausible distractors.
1/4/2016 - Revised question is Satisfactory.
K/A APE032 AA2.02 21  H    2    X                                                                  B  E This question does not appear to work IAW GP-003. You could go critical on any one of the steps for doubling and the procedure has you go to section 8.3 for critical operations. Is there really a minimum number of doublings?
1/4/2016 - Revised question is Satisfactory.
K/A APE033 AK3.01 22  H    3                                                                X        B  U Do you expect the ROs to know where 120 cps on the Source Range equates to the Immediate Range for this case?
This does not match the K/A. It tests the cause of the loss of the IR instrument, not the reason for termination of the startup.
Tier 1 should normally test procedure/evolution requirements vice systems knowledge, unless otherwise specified by the specific K/A.
Question is Unsatisfactory due to not meeting the K/A.
1/25/2016 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                                Explanation Focus                Dist.        Link          units ward K/A Only K/A APE060 AK2.01 23  F    2                                                                        N  S Question is Satisfactory.
K/A APE067 AA1.09 24  H    2    X                    X                                              N  E Picture of Fire Alarm Console not provided.
Reviewed picture in SRO exam.
The picture is somewhat blurry on the computer. Need to ensure that the picture is clear and readable on the exams. Also need to ensure that the picture is provided for the RO exam.
Given that both trains are actuated, this makes choices C(1) and D(1) not plausible. It would be OK to give only one train in alarm and test the other way.
Need to correct # of alarms on pictured.
1/25/2016 - Revised question is Satisfactory.
K/A APE068 AK3.12 25  H    3                                                                        N  S Question is Satisfactory.
K/A APE076 AA2.04 26  H    2                          X                                              M  E Choices B(1) and D(1) are not plausible.
1/25/2016 - Revised question is Satisfactory.
K/A WE09 2.1.20 27  H    2    X                                                                  M  E With step 9 being a continuous actions step, how are there not two correct answers?
1/25/2016 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                  8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                              Explanation Focus                Dist.        Link          units ward K/A Only K/A SYS003 A3.01 28  H    2                          X                                              N  U The picture seems too hard to read.
Since all of the parameters shown return to their original values, outright failures do not seem to be plausible.
Question is Unsatisfactory due to two non-plausible distractors.
1/25/2016 - Revised question is Satisfactory.
K/A SYS003 K4.07 29  H    3                                                                        B  S Question is Satisfactory.
K/A SYS004 K2.06 30  F    3                                                                X        N  U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.
The question does not meet the K/A. It does not test knowledge of power supplies to the instrumentation, it gives a power supply that is lost and tests knowledge of how the instruments will fail upon a loss of power. That would be more of a K6 K/A.
Question is Unsatisfactory due to K/A mismatch.
12/7/15- Question is Satisfactory.
K/A SYS005 A2.02 31  H    2    X                    X                                              B  U Choices C and D are not plausible.
Question is Unsatisfactory due to two non-plausible distractors.
1/25/2016 - Revised question is Satisfactory.
K/A SYS005 K6.03 32  H    3    X                    X                                              B  E Choice C is not plausible.
Licensee explained how choice C could be plausible.
K/A SYS006 A1.13 33  F    3                                                                        N  S Question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                  8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                            Explanation Focus                Dist.        Link          units ward K/A Only K/A SYS006 K5.01 34  F    2    X                                                                  M  E The second part question needs to be a little more specific concerning temperature (higher, lower, increased, decreased).
1/25/2016 - Revised question is Satisfactory.
K/A SYS007 K3.01 35  H    2                                                                        N  S Question is Satisfactory.
K/A SYS008 A4.01 36  H    2    X                    X                                              B  E Choice D is not plausible.
The question stem does not exactly match the choices.
1/25/2016 - Revised question is Satisfactory.
K/A SYS010 K6.04 37  H    1                          X                                              N  U Choices A, B, and D are not plausible. LOD = 1.
Question is Unsatisfactory due three non-plausible distractors and LOD = 1.
1/25/2016 - Revised question is Satisfactory.
K/A SYS012 A3.06 38  H    2                                                                        B  S Question is Satisfactory.
K/A SYS012 K1.05 39  F    2                          X                                    ?        N  E Choice D is not plausible.
Need to discuss K/A match.
1/25/2016 - Revised question is Satisfactory.
K/A SYS013 K5.02 40  F    2                                                                        N  S Question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                  8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                            Explanation Focus                Dist.        Link          units ward K/A Only K/A SYS022 A4.04 41  H    2                          X                                              N  E Choice D is not plausible. Choice A is likely not plausible.
1/25/2016 - Revised question is Satisfactory.
K/A SYS026 A2.08 42  H    2                                                                        N  S Question is Satisfactory.
K/A SYS039 A1.10 43  F    2                          X                                              N  E Choice A is not plausible.
1/25/2016 - Revised question is Satisfactory.
K/A SYS059 K4.02 44  F    2                                                                        N  S Question is Satisfactory.
K/A SYS061 K5.01 45  H    2                          X                                              N  U Choices A and D are not plausible.
There is no correct answer (must be > 600 gpm).
Question is Unsatisfactory due to two non-plausible distractors.
1/25/2016 - Revised question is Satisfactory.
K/A SYS062 K1.04 46  H    2                                                                        B  S Question is Satisfactory.
K/A SYS062 K2.01 47  F    2                                                                        B  S Question is Satisfactory.
K/A SYS063 A3.01 48  H    2                          X                                              N  U Choices A and C are not plausible.
Question is Unsatisfactory due to two non-plausible distractors.
1/25/2016 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                                Explanation Focus                Dist.        Link          units ward K/A Only K/A SYS064 A2.18 49  F    2                          X                                              N  U Choices C and D are not plausible.
Question is Unsatisfactory due to two non-plausible distractors.
1/25/2016 - Revised question is Satisfactory.
K/A SYS064 K2.02 50  F    2                          ?                                              B  E Can you give any examples where there are A and B components that the B component is powered from the lower numbered MCC?
1/25/2016 - Question is Satisfactory.
K/A SYS073 A4.01 51  H    2                                                                        B  S Question is Satisfactory.
K/A SYS073 2.4.9 52  F    3                                      X                        X        M  U Question seems to be more related SRO procedure direction than mitigation strategy. It also does not seem to meet the K/A because it does not seem to test the PRM system.
Selected K/A SYS073 2.4.11 1/26/16-New question is Satisfactory.
K/A SYS076 K1.15 53  F    3                                                                        N  S Question is Satisfactory.
K/A SYS078 K3.03 54  F    2                                                                        N  S Question is Satisfactory.
K/A SYS103 G2.1.7 55  H    2    X                                                                  N  E Is a spray pump running? Does the number of HVH units running matter concerning the CSFST? Need to discuss plausibility of choice C.
1/25/2016 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                              Explanation Focus                Dist.        Link          units ward K/A Only K/A SYS001 K6.13 56  H    2    X                                                                  N  E The given conditions picture is not included on anything that was submitted. Unable to review fully. It seems that operation or interpretation of RPI would be more relevant than location of cabinets that I&C personnel need to go to. If there is no IRPI rack in the Hagan room, then it is not plausible.
1/25/2016 - Revised question is Satisfactory.
K/A SYS002 K4.01 57  F    2                                                                X        N  U Question does not appear to test design features or interlocks.
Question is Unsatisfactory due to not meeting the K/A.
1/25/2016 - Revised question is Satisfactory.
K/A SYS011 A1.02 58  F    2    X                                                                  N  E Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.
Need to state (in the question stem) what procedure these values are in accordance with.
1/25/2016 - Revised question is Satisfactory.
K/A SYS014 K5.01 59  H    2                          X                                              B  U Choices A and B are not plausible.
Question is Unsatisfactory due to two non-plausible distractors.
1/25/2016 - Revised question is Satisfactory.
K/A SYS017 A4.01 60  F    2                          X                                              B  U Choices A and B are not plausible.
Question is Unsatisfactory due to two non-plausible distractors.
1/28/2016 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                      8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                              Explanation Focus                Dist.        Link          units ward K/A Only K/A SYS027 K2.01 61  F    2                                                                        B  S Question is Satisfactory.
K/A SYS029 G2.1.23 62  F    2    X                                                                  N  E Need to show where this information is located in OP-921. I could not find it.
Licensee is breaking stem into two separate questions.
1/28/2016 - Revised question is Satisfactory.
K/A SYS033 K3.02 63  F    2            X            X                                              N  E Choices C(1) and D(1) are not plausible. They are process monitors.
1/26/16 - Revised question is Satisfactory.
K/A SYS035 A2.05 64  H    2    X      X                                                            N  E The choices for the second part question provide a direct cue to answer the first part question.
1/26/16 - Revised question is Satisfactory.
K/A SYS068 K1.07 65  F    2    X                                                                  B  E Choice A should probably be in all capital letters to match other choices.
1/26/16 - Revised question is Satisfactory.
K/A G2.1.29 66  F    2                                                                        N  S Question is Satisfactory.
K/A G2.1.36 67  F    2    X                                                                  B  E Need nomenclature for NI-51 and NI-52.
1/26/16 - Revised question is Satisfactory.
K/A G2.1.45 68  H    2                          X                                              N  E Choice A is not plausible. Is it fair to have the applicant evaluate T and MW without a reference? Need to discuss.
1/28/2016 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                              Explanation Focus                Dist.        Link          units ward K/A Only K/A G2.2.38 69  H    4                                                                        M  E It seems that this question requires the applicant to know greater than one hour actions from memory.
Operations (John Little) determined that this is RO required knowledge because it relates directly to licensed power level and the RO is responsible for monitoring.
K/A G2.2.39 70  F    2                                                                        N  S Question is Satisfactory.
K/A G2.3.13 71  F    1                                                                        B  U It does not seem plausible that you would not evacuate the containment vessel or initiate closure after a fuel assembly has been dropped and is causing the noble gas radiation monitor to increase.
LOD = 1 Question is Unsatisfactory due to more than one non-plausible distractor and LOD = 1.
1/26/16 - Revised question is Satisfactory.
K/A G2.3.4 72  H    2                                                                        B  S Question is Satisfactory.
K/A 2.4.11 73  H    3    X                                                                  N  E The second part question could be reworded to read easier.
1/26/16 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                                Explanation Focus                Dist.        Link          units ward K/A Only K/A G2.4.25 74  H    2    X                                                                  N  E Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.
In the question stem, need to state what procedure the action(s) are in accordance with.
Recommend stating in the initial conditions that either the block valves have been closed or the switches have been placed in the ISOLATED Position, then asking if the other action is or is not required.
For plausibility, are there any other time critical actions that are 15 minutes?
12/16/15 - Question is Satisfactory.
K/A G2.4.31 75  F    1                                                                        N  U This has overlap with the operating test. Every BOP will perform this during the operating test.
Question is Unsatisfactory due to LOD = 1.
1/26/16 - Revised question is Satisfactory.
K/A EPE029 EA2.06 76  H    2                          X                                              N  E With operation of the steam dumps following turbine trip, do not believe that choices A(2) and D(2) are plausible. Could possibly change the second part question to an is or is not question.
1/26/16 - Revised question is Satisfactory.
K/A EPE 038 2.4.47 77  H    1            X            X                                          X  N  U The first part question is direct lookup. This question can be answered using RO knowledge only.
The question is Unsatisfactory due to LOD = 1 and not being SRO only.
1/26/16 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                                  Explanation Focus                Dist.        Link          units ward K/A Only K/A APE054 2.4.9 78  H    2                          X                                          X  B  U/E Knowledge of when to initiate bleed and feed is probably RO knowledge and is listed in the continuous action summary for FRP-H.1. This is also an objective in your lesson plan. The RO would be required to inform the SRO when conditions are met for bleed and feed.
It is acceptable for one part of a two part question to be RO knowledge, however both parts should not be able to be answered using RO knowledge.
ROs should also know that PORVs are opened for bleed and feed.
We need to discuss this situation for steps on the foldout page.
Also, since all of the choices listed in the second part question are done in the procedure, need to ask what should be done first.
Question may be Unsatisfactory due to not being SRO only.
1/29/2016 - Revised question is Satisfactory K/A EPE055 EA2.06 79  H    3    X                                                          ?        B  E Is the first part of the question minutia? Does this lockout need to be cleared prior to re-energizing the buses? Does this meet the K/A?
Please explain.
1/28/2016 - Revised question is Satisfactory.
K/A APE058 2.2.22 80  H    2    X                                                                  B  E Per the TS 3.8 Bases, the selected answer for the second part question may not be correct.
1/26/16 -Licensee explained Bases, Question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                              Explanation Focus                Dist.        Link          units ward K/A Only K/A APE077 AA2.03 81  H    1    X                                                                  M  U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.
The last bullet provides a direct cue that the qualified offsite circuit is INOPERABLE (inadequate voltage for a design basis event). This makes LOD = 1.
Question is Unsatisfactory due to LOD = 1.
12/22/15- Revised question reviewed. Is there any place in AOP-26 that the EDGs are aligned by the operators to E-1 and E-2 independently? If not, choices C(2) and D(2) are not plausible. The question still needs some enhancement.
1/26/16 - Revised question is Satisfactory.
K/A APE001 AA2.02 82  H    2                                                                        N  S Question is Satisfactory.
K/A APE051 G2.4.35 83  H    2    X                    X                                          X  N  U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.
The question is not SRO only. SRO only knowledge should not be claimed for major mitigative strategy or AOP entry conditions. See Attachment 2 of ES-401.
Also, based on the wording of step 12 of AOP-012, the note prior to step 12, and the AOP-038 entry conditions, it appears that the SRO could perform a rapid power reduction if desired.
With no indication of condenser backpressure value or trend, how is going to a rapid power reduction plausible?
The question is Unsatisfactory because it is not SRO only.
Based on a review of your procedures, this could be a very hard K/A to satisfy at the SRO only level. We can discuss randomly selecting another K/A.
12/22/15 - Reviewed revised question. Question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                  8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                              Explanation Focus                Dist.        Link          units ward K/A Only K/A APE061 AA2.03 84  H    2    X                                                                  N  E The applicable answer choices do not include that a Portable Area Radiation Monitor in the CV area is also required in accordance with GP-010.
1/26/16 - Revised question is Satisfactory.
K/A WE06 2.1.23 85  H    2    X                                                                  M  E Choice C needs to be worded more clearly.
1/26/16 - Revised question is Satisfactory.
K/A SYS012 A2.05 86  H    2            X                                                  X        N  U Providing LCO 3.3.1 gives clues to the correct answer or gives the correct answer for several other questions on this exam. (Question 1 for example, and also questions that hinge on the set points of Reactor Protection System interlocks)
Question does not meet the K/A due to not predicting the impacts on the RPS.
Question is Unsatisfactory due to K/A mismatch.
1/26/16 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                                Explanation Focus                Dist.        Link          units ward K/A Only K/A SYS039 A2.03 87  H    2    X      X                                                            B  E Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.
Please explain why it is required to secure feeding the A steam generator as stated in the first part question stem.
Discussing transitioning to E-2 in the second part question stem provides a cue to the first part question and does not affect the answer. Indications of the faulted steam generator are provided in the initial conditions. Should just ask IAW the given conditions and E-3.
12/22/15 - Reviewed the revised question.
Based on the given conditions, it appears that the Secondary Integrity Criteria on the foldout page for E-3 are met. This would require a transfer to E-2. Since this is not one of the listed choices, there is no correct answer choice for this question.
1/28/2016 - Revised question is Satisfactory.
K/A SYS076 2.1.7 88  M    2                                                                        N  S Question is Satisfactory.
K/A SYS078 A2.01 89  H    2    X                                                          X        N  U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.
Need to remove the information in the bullet that states causing IA Header pressure to slowly lower. The applicants should know that a clogged air dryer will cause pressure to lower.
The question does not really appear to be operational valid. We need to discuss the normal lineup of the instrument air system and how we would get in the situation proposed by the question.
The question does not really test the K/A, but can be pretty easily fixed. We can discuss.
Will need the appropriate IAW statement added to the question stem. Also, need to word question with regard to the fact that the use of attachment 2 or 3 is in a step that is based on order of preference.
12/22/15 - Reviewed the revised question.
Question is now Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                      8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                                Explanation Focus                Dist.        Link          units ward K/A Only K/A SYS103 G2.4.35 90  H    2                                                                X    X  N  U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.
This does not appear to meet the intent of the K/A. It seems to meet more of the RCP K/A than the type of topics listed for the Containment system.
This does not appear to be an SRO only question. It does not have procedure selection and could be answered with RO knowledge.
Based on a review of your procedures, this could be a very hard K/A to satisfy at the SRO only level. We can discuss randomly selecting another K/A.
K/A SYS103 2.4.41 Revised question is Unsatisfactory due to LOD = 1. The correct answer choice (both halves) is so strong and self-explanatory that it makes the question provide no discriminatory value.
1/26/16 - Revised question is Satisfactory.
K/A SYS015 A2.04 91  H    2    X                                                                  N  E The bullet in the initial conditions that states that the crew lowered reactor power IAW AOP-101 needs to be more specific as to what the current reactor power is. It could be argued that if the crew lowered power IAW AOP-001, then it would be less than or equal to 50% and no further reduction would be required.
It would probably be more clear just to ask whether the CRS is or is not required to direct a power reduction to less than or equal to 50%
in accordance with AOP-001 Attachment 1 for the second part question.
1/26/16 - Revised question is Satisfactory.
: 1. 2.        3. Psychometric Flaws          4. Job Content Flaws  5. Other 6. 7.                                    8.
Q# LOK  LOD (F/H) (1-5) Stem Cues    T/F    Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                              Explanation Focus                Dist.        Link          units ward K/A Only K/A SYS068 A2.02 92  F    2                                      X                                M  E Need a copy of EMP-006 to complete review of this question. Your lesson plan states that Chemistry does the sample and then provides the permit. Is determining whether or not the pH is acceptable an SRO job function?
Operations representative (John Little) states that this is SRO job function because the SRO/Shift Manager is required to review and approve the report.
1/28/2016 - Revised question is Satisfactory.
K/A SYS071 2.4.21 93  F    2                                                                        M  E Need a copy of PLP-100 to complete review of this question. This procedure is not listed in the index provided.
1/28/2016 - Revised question is Satisfactory.
K/A G2.1.45 94  H    2                                                                        N  S Question is Satisfactory.
K/A G2.2.21 95  H    2    X                    X                                              N  E Choices B(2) and C(2) are not plausible. It is not operationally valid to ask for greater than one hour TS completion times without a reference.
1/29/2016 - Revised question is Satisfactory K/A G2.2.36 96  H    2    X                    X                                              N  E Choices A(2) and C(2) are not plausible. It is not operationally valid to ask for greater than one hour TS completion times without a reference.
1/29/2016 - Revised question is Satisfactory.
K/A G2.3.12 97  H    2    X                                                                  B  E There may be two correct answers to this question. OMM-001-2 doesnt really state that the RC Supervisor cannot grant access during EOPs, it just describes how he will do it during normal operations.
1/28/2016 - Revised question is Satisfactory.
K/A G2.3.14 98  H    2                                                                        N  S Question is Satisfactory.
: 1.      2.          3. Psychometric Flaws              4. Job Content Flaws          5. Other    6.      7.                                      8.
Q#  LOK      LOD (F/H)    (1-5)  Stem Cues        T/F  Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S                                                    Explanation Focus                    Dist.        Link            units ward K/A Only K/A G2.4.30 99    H        2      X                                                                                  M      E Need a copy of AP-030 to complete review of this question.
Licensee is changing leakrate and adding EAL reference.
2/3/16 - Revised question is Satisfactory K/A G2.4.46 100  H        2      X                                                                                  N      E The bullet for Total calculated B RCP #1 seal leakoff flow: 6.5 gpm is misleading. We need to discuss this.
1/29/2016 - Revised question is Satisfactory Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
: 1.      Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
: 2.      Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
: 3.      Check the appropriate box if a psychometric flaw is identified:
* The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
* The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
* The answer choices are a collection of unrelated true/false statements.
* The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
* One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
: 4.      Check the appropriate box if a job content error is identified:
* The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
* The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
* The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
* The question requires reverse logic or application compared to the job requirements.
: 5.      Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
: 6.      Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
: 7.      Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
: 8.      At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
ES-403                              Written Examination Grading                      Form ES-403-1 Quality Checklist Facility:                            Date of Exam:            Exam Level:  RD        SRQ Item Description                                      Initials a        b    c
: 1.        Clean answer sheets copied before grading 1li    &
: 2.        Answer key changes and question deletions justified and documented
: 3.        Applicants scores checked for addition errors                      U  A (reviewers spot check> 25% of examinations)                                          ,
: 4.        Grading for all borderline cases (80 +/-2% overall and 70 or 80,      All as applicable, +/-4% on the SRO-only) reviewed in detail              %i      1.ifr
: 5.        All other failing examinations checked to ensure that grades are justified                                                      z                j
: 6.        Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of            41 7/
questions missed by half or more of the applicants Printed Name/Signature                                  Date
: a. Grader
: b. Facility Reviewer(*)
: c. NRC Chief Examiner (*)                                    *f    .
03/i)!
: d. NRC Supervisor (*)                                                              3/Z2J!
(*)      The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.
ES-403, Page 6 of 6}}

Latest revision as of 03:17, 19 March 2020

(7) Robinson 2016-301 Final Administrative Documents
ML16124B059
Person / Time
Site: Robinson Duke Energy icon.png
Issue date: 04/27/2016
From:
Division of Reactor Safety II
To:
Duke Energy Progress
References
50-261/OL-16-301
Download: ML16124B059 (65)
v • d • e


Text

Examination Preparation Checklist Form ES-20J-J ES-207 Date of Examination: 2/01/2016 Facility: Robinson NRC /1 Operating Facility x NRC Developed by: Written: Facility x Target Task Description (Reference) Examiners Date Initials 8/5/2015

-180 1. Examination administration date confirmed (Cia; C.2.a and b) 9/4/2015

-lC 2. NRC examiners and facility contact assigned (C.1.d; C.2.e) 9/4/2015

-150 3. Facility contact briefed on security and other requirements (C.2.c) 9/4/2015

-150 4. Corporate notification letter sent (C.2.d)

N/A

[-i 5. Reference material due (C.1.e; C.3.c; Attachment 3)

ES-301 -1, 11/3/2015 f- 1 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-401N-3, ES-301-2, ES-301-5, ES-D-1, ES-401-1/2, ES-401N-i/2, ES-401-3, ES-401-4, and ES-401N-4, as applicable (C.1.e and f; C.3.d) facility licensee 11/8/2015

{-j 7. Examination outline(s) reviewed by NRC and feedback provided to (C.2.h; C.3.e) ios, as 1213/2015 f- .( 8. Proposed examinations (including written, walk-through JPMs, and scenar ES-301-4, ES applicable), supporting documentation (including Forms ES-301-3, ES-201-3, 301-5, ES-301-6, and ES-401-6, ES-401N-6, and any Form ES-201-2, f, and h; ES-301-1, or ES-301-2 updates), and reference materials due (C.1.e, g C.3.d) 12/18/2015

-45 9. Written exam and operating test reviews completed. (C.3.f)

ES-202) 1/2/2016

-30 1 . Preliminary license applications (NRC Form 398s) due (C.i.l; C.2.g; (C.2.h; C.3.f) 1/28/2016

-21 1 . Examination approved by NRC supervisor for facility licensee review 1/28/2016

-21 t. Examinations reviewed with facility licensee (Cli; C.2.f and h; C.3.g)

ES-202) 1/18/2016

-14 1. Final license applications due and Form ES-201-4 prepared (C.1 .1; C.2.i; isor (C.2.i; 2/11/2016

-14 1 . Written examinations and operating tests approved by NRC superv C.3.h) 1/28/16 on the 2/11/2016

-7 15. Facility licensee management queried regarding the licensees views examination. fC.2 j) 1/28/16 1/29/2016

-7 1 . Final applications reviewed; 1 or 2 (if >10) applications audited to confirm sent fC.2.i; qualifications / eligibility; and examination approval and waiver letters Attachments; ES-202, C.2.e; ES-204) facility licensee 2/11/2016

-7 17. Proctoring/written exam administration guidelines reviewed with (C.3.k) to NRC 1/28/2016

-7 1 . Approved scenarios, job performance measures, and questions distributed examiners (C.3.i) ations and are keyed to the examination date Target dates are generally based on facility-prepared examin ate notification letter. They are for plannin g purposes and may be adjusted on a case-by identified in the corpor case basis in coordination with the facility license e.

by the NRC.

[Applies only] {Does not apply) to examinations prepared

ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility: ROBINSON Date of Examination: FEBRUARY 2016 Item Initials Task Description

1. a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401 or ES-401 N.
b. Assess whether the outline was systematically and randomly prepared in accordance with Section D.1 of ES-401 or ES-401N and whether all KJA categories are appropriately sampled.

T /4 (

c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics. %1 N

%7

d. Assess whether the justifications for deselected or rejected K/A statements are appropriate.
2. a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, and major S transients.

M b. Assess whether there are enough scenario sets (and spares) to test the projected number and u mix of applicants in accordance with the expected crew composition and rotation schedule L without compromising exam integrity, and ensure that each applicant can be tested using at A least one new or significantly modified scenario, that no scenarios are duplicated from the T applicants audit test(s), and that scenarios will not be repeated on subsequent days.

c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative and quantitative criteria specified on Form ES-301-4 and described in Appendix D.
3. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:

(1) the outline(s) contain(s) the required number of control room and in-plant tasks distributed W among the safety functions as specified on the form A (2) task repetition from the last two NRC examinations is within the limits specified on the form L (3) no tasks are duplicated from the applicants audit test(s)

K (4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on T the form.

H R b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:

, (1) the tasks are distributed among the topics as specified on the form U (2) at least one task is new or significantly modified G (3) no more than one task is repeated from the last two NRC Ii H

c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.
4. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections.

G E b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.

c. Ensure that K/A importance ratings (except for R d. Check for duplication and overlap among exam sections.

L e. Check the entire exam for balance of coverage.

f. Assess whether the exam fits the appropriate job level (RD or SRO).
a. Author O(4/5
b. Facility Reviewer (*) 4
c. NRC Chief Examiner (#) 3 i c tT- 9L/23/_?iJ
d. NRC Supervisor .(fl C

/ /

4 1 JVc, Note: # Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

Not applicable for NRC-prepared examination outlines.

ES-201 Examination Outline Quality Checklist Form ES-201-2 (Rev_O1 2316)

Facility: Robinson Date of Examination: 2/2016 Initials Item Task Description h i

1. a. Verify that the outline(s) fit(s) the appropriate model per ES-401 or ES-401 N. C
b. Assess whether the outhne was systematicaily and randomiy prepared in accordance with W Section D.1 of ES-401 or ES-401N and whether au KJA categories are appropriateiy R sampied.

.- c. Assess whether the outhne over-emphasizes any systems, evoiutions, or generic topics. c.

T d. Assess whether the justifications for deselected or rejected K/A statements are E appropriate.

N

2. a. Using Form ES-301 -5, verify that the proposed scenario sets cover the required number of normai evoiutions, instrument and component faiiures, technical specifications, and major transients.

s i b. Assess whether there are enough scenario sets (and spares) to test the projected number M and mix of applicants in accordance with the expected crew composition and rotation scheduie without compromising exam integrity; and ensure that each applicant can be U tested using at least one new or significantly modified scenario, that no scenarios are L duplicated from the appiicants audit test(s), and scenarios wiil not be repeated on A subsequent days.

T c. To the extent possibie, assess whether the outline(s) conform(s) with the quattative and 0 quantitative criteria specified on Form ES-301-4 and described in Appendix D.

R

3. a. Verify that systems waik-through outtne meets the criteria specified on Form ES-301 -2:

(1) the outhne(s) contain(s) the required number of controi room and in-plant tasks, W distributed among the safety functions as specified on the form A

(2) task repetition from the last two NRC examinations is within the hmits specified on L the form, K

(3) no tasks are duplicated from the apptcants audit test(s)

T H (4) the number of new or modified tasks meets or exceeds the minimums specified on the form R

0 (5) the number of aiternate path, iow-power, emergency and RCA tasks meet the criteria on the form.

G b. Verifythatthe administrative outiine meets the criteria specified on Form ES-301-1:

H (1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantiy modified (3) no more than one task is repeated from the last two NRC licensing examinations

c. Determine if there are enough different outhnes to test the projected number and mix of apphcants and ensure that no items are duphcated on subsequent days.
4. a. Assess whether plant-specific priorities (inciuding PRA and iPE insights) are covered in the appropriate exam section.

G b. Assess whether the 10CFR 55.41/43 and 55.45 sampiing is appropriate. L.

c. Ensure that K/A importance ratings (except for piant-specific priorities) are at least 2.5.

E d. Check for duplication and overiap among exam sections.

R

e. Check the entire exam for balance of coverage.

L f. Assess whether the exam fits the appropriate job ievei (RD or SRO).

Printed Name / Signature Date

a. Author i- i/zc ,4
b. Facuiity Reviewer(*)
c. NRC Chief Examiner f#) Da.v ic. /,k7) i
d. NRC Supervisor C NOTE: # independent NRC reviewer initial items in Coiumn c, chief examiner concurrence required.

Not applicabie for NRC-prepared examination outlines NUREG-1021, Revision 10

ES-301 Administrative Topics Outline Form ES-301-1 (Rev_011016)

Facility: HB Robinson Date of Examination: 2/2016 Examination Level: RO Operating Test Number: N16-1 Administrative Topic Type Code* Describe activity to be performed (see Note) 2.1.7 (4.4) Ability to evaluate plant performance Conduct of Operations and make operational judgments based on operating characteristics, D, R reactor behavior, and instrument interpretation.

JPM: Calculate QPTR 2.1.4 (3.3) Knowledge of individual licensed operator Conduct of Operations responsibilities related to shift staffing, such as medical requirements, no-solo N, R operation, maintenance of active license status, 10CFR55, etc.

JPM: Determine License Status 2.2.41 (3.5) Ability to obtain and interpret station Equipment Control electrical and mechanical drawings.

D, P, R JPM: Determine Proper Equipment Boundaries 2.3.7 (3.5) Ability to comply with radiation work Radiation Control permit requirements during normal or abnormal conditions.

N, R JPM: Evaluate Stay Time with Lowered SFP Level NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when 5 are required.

  • Type Codes & Criteria: (C)ontrol room, (0) (S)imulator, (0) or Class(R)oom (4)

(D)irect from bank ( 3 for ROs; 4 for SROs & RO retakes) (2)

(N)ew or (M)odified from bank (> 1) (2)

(P)revious 2 exams ( 1; randomly selected) (1)

NUREG-1021, Revision 10

ES-301 Administrative Topics Outline Form ES-301-1 (Rev_011016)

RO Admin JPM Summary A1a This is a modified Bank JPM. The operator will be told that the plant is operating at 60%

power and that ERFIS is OOS. The operator will be provided with Power Range Excore Nuclear Instrumentation indicated and normalizing detector currents, and directed to manually calculate Quadrant Power Tilt Ratio, and identify whether or not any limitations have been exceeded. The operator will be expected to calculate QPTR in accordance with FMP-007, Quadrant Power Tilt, and identify that Technical Specification LCO 3.2.4, Quadrant Power Tilt Ratio (QPTR), is NOT met.

A1b This is a new JPM. The operator will be told that they are a Licensed Reactor Operator who was assigned to the day shift staff for a special project, and not routinely standing watch in the Control Room. They will be provided with a work history and various qualification dates, and then directed to identify any requirements that must be met prior to the end of the quarter that are required to maintain their license ACTIVE; and any additional requirements that are required to maintain their qualification to stand watch in the Control Room. The operator will be expected to evaluate their work history and identify that four 12-hour shifts must be completed as either the RO or the BOP prior to the end of the quarter to maintain their license ACTIVE, and that an SCBA quantitative and qualitative fit test must be completed prior to standing watch in the Control Room again.

A2 This is a Bank JPM. The operator will be told that the plant is in Mode 1 at 100%,

Charging Pump A suction relief valve CVC-2080 has failed open, and that the operating crew has entered AOP-016, Excessive Primary Plant Leakage, to control the plant. The operator will be provided with the EDPs, and the P&IDs, and directed to use all available resources to identify the pump boundary valves needed to be closed to isolate the leak, and identify the motor breaker to electrically isolate the pump motor.

The operator will be expected to identify that the leak can be isolated by closing three valves; CVC-270, CVC-290 and CVC-291, and that the pump motor can be electrically isolated by opening Breaker 52/34B. This JPM was previously used on the 2014 NRC Exam, randomly selected for use on the 2016 Exam.

A3 This is a new JPM. The operator will be told that a station wide accident has occurred due to an Earthquake, that the plant is in Mode 6 with a full core off-load, that the Spent Fuel Pool level has lowered to 10 feet above the top of the fuel, and has stabilized at this level, and that the crew is implementing AOP-036 (SFP Events). The operator will be provided with an R-5 reading, a dose limit of 25 mrem, and the assignment of a repetitive task within AOP-036 which will require entry into the Spent Fuel Building for 3 minutes, before exiting; and will be directed to estimate how many times the operator can perform this repetitive task before they must be replaced by another operator. The operator will be expected to determine that the dose rate around the Spent Fuel Pool area is 193 mrem/hour and based on this the operator will determine that the repetitive task can be performed 2 times before another operator will need to perform the task.

NUREG-1021, Revision 10

ES-301 Administrative Topics Outline Form ES-301-1 (Rev_011016)

Facility: H B Robinson Date of Examination: 2/2016 Examination Level: SRO Operating Test Number: N16-1 Administrative Topic Type Describe activity to be performed (see Note) Code*

2.1.7 (4.7) Ability to evaluate plant performance and Conduct of Operations make operational judgments based on operating characteristics, reactor D, R behavior, and instrument interpretation.

JPM: Calculate QPTR 2.1.4 (3.8) Knowledge of individual licensed operator Conduct of Operations responsibilities related to shift staffing, such as medical requirements, no-solo N, R operation, maintenance of active license status, 10CFR55, etc.

JPM: Determine License Status 2.2.38 (4.5) Knowledge of conditions and limitations in Equipment Control the facility license.

D, R JPM: Determine if Mode Change is Permissible 2.3.8 (3.7) Ability to approve release permits.

Radiation Control N, R JPM: Approve a Waste Gas Release Permit 2.4.41 (4.4) Knowledge of the emergency action level Emergency Plan thresholds and classifications.

D, R JPM: Emergency Classification NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when 5 are required.

  • Type Codes & Criteria: (C)ontrol room, (0) (S)imulator, (0) or Class(R)oom (5)

(D)irect from bank ( 3 for ROs; 4 for SROs & RO retakes) (3)

(N)ew or (M)odified from bank (> 1) (2)

(P)revious 2 exams ( 1; randomly selected) (0)

NUREG-1021, Revision 10

ES-301 Administrative Topics Outline Form ES-301-1 (Rev_011016)

SRO Admin JPM Summary A1a This is a modified Bank JPM. The operator will be told that the plant is operating at 100% power and that ERFIS is OOS. The operator will be provided with Power Range Excore Nuclear Instrumentation indicated and normalized detector currents, and directed to calculate Quadrant Power Tilt Ratio, identify whether or not any limitations have been exceeded, and if so, what, if any ACTION, is required. The operator will be expected to calculate QPTR in accordance with FMP-007, Quadrant Power Tilt, identify that Technical Specification LCO 3.2.4, Quadrant Power Tilt Ratio (QPTR), is NOT met, and identify that all six ACTIONs (A.1-A.6) must be taken for Condition A of LCO 3.2.4, including the maximum permitted power level of 91.3%.

A1b This is a new JPM. The operator will be told that they are a Licensed Senior Reactor Operator who was assigned to the day shift staff for a special project, and not routinely standing watch in the Control Room. They will be provided with a work history and various qualification dates, and then directed to identify any requirements that must be met prior to the end of the quarter that are required to maintain their license ACTIVE; and any additional requirements that are required to maintain their qualification to stand watch in the Control Room. The operator will be expected to evaluate their work history and identify that four 12-hour shifts must be completed as either the SM, CRS, RO or the BOP prior to the end of the quarter to maintain their license ACTIVE, and that an SCBA quantitative and qualitative fit test must be completed prior to standing watch in the Control Room again.

A2 This is a Bank JPM. The operator will be told that the plant is in Mode 5, returning from a refueling outage, that the RCS temperature is 165°F and there is a bubble in the PZR, and that RHR Loop A is maintaining RCS temperature. The operator will be provided with an Inoperable Equipment List and directed to complete the attached OMM-001-12, MINIMUM EQUIPMENT LIST AND SHIFT RELIEF, Attachment 2, 200°F to 350°F (MODE 4) MEL, that was started on the previous shift and to determine if any Mode 4 restrictions exists. The operator will be expected to complete Attachment 2 and determine that the Mode change cannot occur with current plant conditions, per the attached KEY.

A3 This is a new JPM. The operator will be told that the plant is in Mode 1 at 100% power, and that a Waste Gas Release Permit for the A WGDT has been presented to the Shift Manager for review and approval. The operator will be provided with a WGDT Release Permit and directed to review and approve the Waste Gas Release Permit, or to identify all issues found which would prevent approval. The operator will be expected to review the WGDT Release Permit and identify that it cannot be approved because (1) it has been written for the wrong WGDT and (2) the R14C setpoint is less conservative than required.

A4 This is a Bank JPM. The operator will be given an initial set of plant conditions. The operator will be directed to classify the event in accordance with the Robinson Nuclear Plant Emergency Action Level Matrix. The operator will be expected to declare an ALERT based on HA4.1, Confirmed Security event in a plant Protected Area or notification of either an airborne attack threat or hostile threat within the Owner Controlled Area, within 15 minutes. Then, the operator must prepare an Emergency NUREG-1021, Revision 10

ES-301 Administrative Topics Outline Form ES-301-1 (Rev_011016)

Notification Form for this event in accordance with EPCLA-01 (Emergency Control), also within 15 minutes.

NUREG-1021, Revision 10

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 (REV_011116)

Facility: H B Robinson Date of Examination: 2/2016 Exam Level (circle one): RO (only) / SRO(I) / SRO (U) Operating Test No.: N16-1 Control Room Systems (8 for RO; 7 for SRO-I; 2 or 3 for SRO-U)

Type Code* Safety System / JPM Title Function A. 062 AC Electrical Distribution System [062 A2.08 (3.6/3.4)]

S, P, D, A 6 Operation With High Switchyard Voltage B. 059 Main Feedwater System [059 A4.08 (3.2/2.9)]

S, M, A 4S Transfer From the FRV Bypass Valves to the FRVs C. 007 Pzr Relief Tank/Quench Tank System [007 A1.01 (2.9/3.1)]

S, D, A 5 Restore PRT to Normal Operating Conditions D. 001 Control Rod Drive System [001 A1.06 (4.1/4.4)]

S, N, A, L 1 Reactor Startup with Ejected Control Rod E. 011 Large Break LOCA [EPE 011 EA1.11 (4.2/4.2)]

S, D, A, EN 3 Transfer to Long Term Recirculation F. 006 Emergency Core Cooling System [006 A4.02 (4.0/3.8)]

S, P, D, EN 2 Fill a Safety Injection Accumulator G. 015 Nuclear Instrumentation System [015 A4.03 (3.8/3.9)]

S, D, L 7 Remove Source Range Channel N-31 From Service H. 003 Reactor Coolant Pump System [003 A4.03 (2.8/2.5)]

S, D, L 4P Start a Reactor Coolant Pump In-Plant Systems@ (3 for RO; 3 for SRO-I; 3 or 2 for SRO-U)

I. APE 055 Loss of Offsite and Onsite Power [EPE 055 EA2.01 (3.4/3.7)]

D, P, E 6 Locally Establish AFW Flow from the SDAFW Pump and Control S/G Levels and Pressures J. 065 Loss of Instrument Air [065 AA1.04 (3.5/3.4)]

D, R, E 8 Respond to a Loss of Instrument Air K. APE 062 Loss of Service Water [APE 062 AA2.01 (2.9/3.5)]

D, R, E 4S Loss of North SW Header in the Auxiliary Building NUREG-1021, Revision 10

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 (REV_011116)

@ All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

  • Type Codes Criteria for RO / SRO-I / SRO-U (A)lternate path 4-6 (5) /4-6 (5) / 2-3 (3)

(C)ontrol room (D)irect from bank 9 (9) / 8 (8) / 4 (4)

(E)mergency or abnormal in-plant 1 (3) / 1 (3) / 1 (2)

(EN)gineered Safety Feature 1 (2) / 1 (2)/ 1 (2) (Control Room System)

(L)ow-Power / Shutdown 1 (3) / 1 (2) / 1 (1)

(N)ew or (M)odified from bank including 1(A) 2 (2) / 2 (2) / 1 (1)

(P)revious 2 exams 3 (3) / 3 (3)/ 2 (2) (Randomly Selected)

(R)CA 1 (2 )/ 1 (2) / 1 (1)

(S)imulator JPM Summary JPM A This is a Bank JPM. The operator will be told that the plant is at 100% power, that due to abnormal conditions on the Grid, 480V Bus E-2 currently has exceeded 505 volts, that AOP-031, Operation with High Switchyard Voltage, has been completed up to step 21, and other preliminary information. The operator will be directed to continue with AOP-031 until 480V Bus E-2 voltage is restored to less than 505 Volts. The operator will be expected to transfer 4KV Bus 4 & 5 from the UAT to the SUT (via 4KV Bus 3) in an effort to lower Switchyard Voltage; and when Breaker 50/20 fails to automatically OPEN (Alternate Path), the operator will manually open it per AOP-31. This JPM was previously used on the 2013 NRC Exam, randomly selected for use on the 2016 Exam.

JPM B This is a modified Bank JPM. The operator will be told that a plant startup is in progress with reactor power approximately 18%, that the A and B S/G levels are being controlled with the Feedwater Regulating Valves operating in AUTO, and that the C S/G level is being controlled on the Feedwater Regulating Bypass Valve. The operator will be directed to transfer the C S/G level control to the Main Feedwater Regulating Valve in accordance with Step 6.4.12 of GP-005, Power Operation. The operator will be expected to place the C Feed Reg Valve in AUTO, and then take manual control of the B Feed Reg Valve and stabilize the B S/G level (Alternate Path) when it is determined that the B Feed Reg Valve has failed to control the B S/G level in AUTO.

JPM C This is a Bank JPM The operator will be told that the plant is at 100% power, that APP-003-D3, PRT HI/LO LEVEL, has alarmed, that the cause of the low level is known leakage from the PRT to the RCDT, and that the PRT level is stable at 67%. The operator will be directed to restore PRT level to normal IAW OP-103, Pressurizer Relief Tank Control System. The operator will be expected to refill the PRT in accordance with Section 8.2.2 of OP-103; and then diagnose and relieve the hydraulic lock on RC-519B (Alternate Path) in accordance with Section 8.4.1 of OP-103.

JPM D This is a New JPM. The operator will be told that the plant is stabilized at 2% power, that the RCS is at normal operating temperature and pressure, and that a plant startup is in progress IAW GP-003, Normal Plant Startup From Hot Shutdown to Critical, and complete through Step 8.4.7. They will also be told that they are the OATC, and that the NUREG-1021, Revision 10

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 (REV_011116)

BOP is temporarily outside the Control Room. The operator will be directed to pull control rods to stabilize reactor power between 3-5% by continuing with Step 8.4.8 of GP-003. The operator will start to raise reactor power to 3-5%. Then, the operator will manually trip the reactor, attempt to manually actuate Safety Injection and manually start SI Pumps in response to an ejected rod (Alternate Path).

JPM E This is a Bank JPM. The operator will be told that a large break LOCA has occurred, and that the plant is currently on Cold Leg Recirculation IAW EOP-ES-1.3, Transfer to Cold Leg Recirculation. The operator will be directed to transfer to Long Term Recirculation IAW EOP-ES-1.4, Transfer to Long Term Recirculation. The operator will be expected to align for Long Term Recirculation per EOP-ES-1.4, and align only the B RHR Pump for operation when it is determined that SI-863A has failed to OPEN (Alternate Path).

JPM F This is a Bank JPM. The operator will be told that the plant is at 100% power, that the SI ACCUM C HI/LO LVL (APP-002-E4) alarm has been received and actions have been reviewed by the RO, that OP-202, Section 5.2.1.1 Initial Conditions have been completed, and other preliminary information. The operator will be directed to fill SI Accumulator C to reset the low level alarm IAW OP-202, Section 5.2.1. The operator will be expected to refill SI Accumulator C to reset the low level alarm without exceeding specified limits. This was previously used on the 2013 NRC Exam, randomly selected for use on the 2016 Exam.

JPM G This is a Bank JPM. The operator will be told that the plant is shutdown 36 hours4.166667e-4 days <br />0.01 hours <br />5.952381e-5 weeks <br />1.3698e-5 months <br /> after a trip from 100% power, and that SR Channel N-31 has just failed low. The operator will be directed to remove SR Channel N-31 from service IAW OWP-011, Nuclear Instrumentation. The operator will be expected to remove SR Channel N-31 from service IAW NI-5 of OWP-011.

JPM H This is a Bank JPM. The operator will be told that the plant is shutdown at normal operating temperature and pressure, that the B RCP was stopped 7 hours8.101852e-5 days <br />0.00194 hours <br />1.157407e-5 weeks <br />2.6635e-6 months <br /> earlier for motor inspection, that Section 8.1 of OP-101, Reactor Coolant System and Reactor Coolant Pump Startup and Operation, has been completed through Step 8.1.1.2.y in preparation for starting the Reactor Coolant Pump, and that it is intended to bypass the Degraded Grid Protection prior to the RCP start and return it to service after the RCP is started per OP-101, and an AO is standing by to assist in this process. The operator will be directed to start the B Reactor Coolant Pump by continuing with Step 8.1.1.2.z of OP-101. The operator will be expected to start the B RCP IAW OP-101.

JPM I This is a Bank JPM. The operator will be told that the Plant has experienced a loss of onsite and offsite power, that EOP-ECA-0.0, Loss of All AC Power, has been implemented, that Wide Range levels in all three SGs are 55%, that Steam Generator pressures are 1075 psig, and that the SDAFW Pump has just been started. The operator will be directed to locally perform Attachment 4, Local Control Of S/G Level And Pressure, of EOP-ECA-0.0. The operator will be expected to control AFW flow to the Steam Generators and align the Nitrogen System to the SG PORVs IAW Attachment 4 of EOP-ECA-0.0. This was previously used on the 2014 NRC Exam, randomly selected for use on the 2016 Exam.

JPM J This is a Bank JPM. The operator will be told that the IA Header Pressure is 75 PSIG and lowering, that AOP-017, Loss Of Instrument Air, has been entered, that the Station NUREG-1021, Revision 10

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 (REV_011116)

Air Compressor is under clearance and disassembled, and that the Station Air Receiver is depressurized and vented. The operator will be directed to perform AOP-017 Step 8.

The operator will be expected to start IA Compressors A and B and align their discharge to supply air to the Instrument Air Header in accordance with Step 8 of AOP-017.

JPM K This is a Bank JPM. The operator will be told that the plant is at 100% power, that the North SW header has ruptured inside the Auxiliary Building, and that the Control Room has implemented AOP-022 (Loss of Service Water) for a leak in the North header. The operator will be directed to perform the local subsequent actions IAW Attachment 6 of AOP-022. The operator will be expected to isolate the intact SW header from the ruptured header, isolate the leak, and align cooling water to critical loads IAW Attachment 6 of AP-022.

NUREG-1021, Revision 10

ES-301 Operating Test Quality Checklist Form ES-301 -3 (Rev_O1 2316)

Facility: Robinson Date of 2/2016 Operating Test Number: N 16-1 Examination:

nftials

1. GENERALCRITERIA b*

a c#

a. The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g. 10 CFR 55.45, operational importance, safety function distribution).
b. There is no day-to-day repetition between this and other operating tests to be administered during this examination. .
c. The operating test shall not duplicate items from the applicants audit test(s) (see Section D.1.a).
d. Overlap with the written examination and between different parts of the operating test is within acceptable limits.
e. It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license level.
2. WALK-THROUGH CRITERIA - -
a. Each JPM includes the following, as applicable:

initial conditions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee /

C operationally important specific performance criteria that include:

- detailed expected actions with exact criteria and nomenclature

- system response and other examiner cues

- statements describing important observations to be made by the applicant

- criteria for successful completion of the task

- identification of critical steps and their associated performance standards

- restrictions on the sequence of steps, if applicable

b. Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301 -1 and 2) have not caused the test to deviate from t._

any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2. =

3. SIMULATOR CRITERIA - -

The associated simulator operating tests (scenario sets) have been reviewed in accordance ç with Form ES-301 -4 and a copy is attached.

Printed Name I Signature Date

a. Author ifi /iC
b. Facility Reviewer f*)
c. NRC Chief Examiner (#) ) roj e? tL.... i/ Z711 c U. NRC Supervisor

(

NOTE:

  • The facility signature is not applicable for NRC-developed tests.
  1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

NUREG-1021, Revision 10

4 ES-301 Simulator Scenario Quality Checklist Form ES-301 -4 (Rev_O1 2316) 2/2016 Scenario Numbers: 1, 2,3 Operating Test No.: N16-1 Facility: Robinson Date of Exam:

Initials QUALITATIVE ATTRIBUTES a b* c#

1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events. t_-
2. The scenarios consist mostly of related events. a.
3. Each event description consists of

. the point in the scenario when it is to be initiated

. the malfunction(s) or conditions that are entered to initiate the event

. the symptoms/cues that will be visible to the crew

. the expected operator actions (by shift position)

. the event termination point (if applicable)

4. The events are valid with regard to physics and thermodynamics. C.
5. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.
6. If time compression techniques are used, the scenario summary clearly so indicates. Operators have sufficient time to carry out expected activities without undue time constraints. Cues are t.. \

given.

7. The simulator modeling is not altered.
8. The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure t that functional fidelity is maintained while running the planned scenarios.
9. Every operator will be evaluated using at least one new or significantly modified scenario. All other scenarios have been altered in accordance with Section D.5 of ES-301.
10. All individual operator competencies can be evaluated, as verified using Form ES-301 -6 (submit ttL the form along with the simulator scenarios).
11. The scenario set provides the opportunity for each applicant to be evaluated in each of the applicable rating factors. (Competency Rating factors as described on forms ES-303-1 and ES-303-3.)
12. Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).

L

13. The level of difficulty is appropriate to support licensing decisions for each crew position.

Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes -

1 2 3

1. Malfunctions after EOP entry (1-2) 1 2 2
2. Abnormal events (2-4) 4 4 5
3. Major transients (1-2) 1 1 1
4. EOPs entered/requiring substantive actions (1-2) 2 2 1
5. EOP contingencies requiring substantive actions (0-2) 0 1 1
6. Critical tasks (2-3) 3 3 2 NOTE:
  • The facility signature is not applicable for NRC-developed tests.
  1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

NUREG-1021, Revision 10

ES-301 Simulator Scenario Quality Checklist Form ES-301-4 (Rev_012316)

Robinson Date of Exam: 2/2016 Scenario Numbers: 4, 5,6 Operating Test No.: N16-1 Facility:

Initials QUALITATIVE ATTRIBUTES a b* c#

1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events. t (j
2. The scenarios consist mostly of related events. c...
3. Each event description consists of

. the point in the scenario when it is to be initiated

. the malfunction(s) or conditions that are entered to initiate the event

. the symptoms/cues that will be visible to the crew ct.

. the expected operator actions (by shift position)

. the event termination point (if applicable)

4. The events are valid with regard to physics and thermodynamics. _
5. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.
6. If time compression techniques are used, the scenario summary clearly so indicates. Operators have sufficient time to carry out expected activities without undue time constraints. Cues are given. cO
7. The simulator modeling is not altered. L..
8. The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios. U
9. Every operator will be evaluated using at least one new or significantly modified scenario. All other scenarios have been altered in accordance with Section D.5 of ES-301.
10. All individual operator competencies can be evaluated, as verified using Form ES-301 -6 (submit the form along with the simulator scenarios).

1 1. The scenario set provides the opportunity for each applicant to be evaluated in each of the applicable rating factors. (Competency Rating factors as described on forms ES-303-1 and ES- .

303-3.)

12. Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301 -5 (submit the form with the simulator scenarios).
13. The level of difficulty is appropriate to support licensing decisions for each crew position.

Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes - -

4 5 6

1. Malfunctions after EOP entry (1-2) 1 1 3
2. Abnormal events (2-4) 4 3 4
3. Major transients (1-2) 2 1 1
4. EOPs entered/requiring substantive actions (1-2) 2 2 2
5. EOP contingencies requiring substantive actions (0-2) 1 1 7
6. Critical tasks (2-3) 2 2 2 NOTE:
  • The facility signature is not applicable for NRC-developed tests.
  1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

NUREG-1021, Revision 10

ES-301 Transient and Event Checklist Form ES-301-5 (Rev_Of 2516)

Facility: Robinson Date of Exam: 2/2016 Operating Test No.: N16-1 A E Scenarios P V N16-1-1 N16-1-2 N16-1-3 N16-1-6 T M P F 0 I L N T N CREW CREW CREW CREW I T POSITION POSITION POSITION A I POSITION C L M A I u N Y T P S A B S A B S A B S A B R I U E R T 0 R T 0 R T 0 R T 0 0 C P 0 C P 0 C P 0 C P RX 1 1 1 0 2

NOR 2 1 1 1 1,2, 1,4, 1,3, 17 4 4 2 SROI-l I/C 5 6 6 6 MA] 3 2 2 1 1,2 TS 2 0 2 2 2

RX 7 1 1 0 1,3 1 NOR 3 1 1 1 2,4, 2,3, 4,5 9 4 4 2 SROI-3 I/C 6 6 6 MA] 3 2 2 1 TS 2 0 2 2 1

RX 1 1 1 0 3 2 NOR 2 1 1 1 2,4, 1,2, 1,3, 12 4 4 2 SROI-5 I/C 8,9 4,5 7,9 6 6 6 MA] 2 2 1 1,5 TS 2 0 2 2 2

RX 1 1 1 0 1 3 NOR 2 1 1 1 3,5 1,2, 4 4 2 SROI-6 I/C 8 6 6 6 MA] 3 2 2 1 1,5 TS 2 0 2 2 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers tor each event type; TS are not applicable for RO applicants. ROs must service in both the at-the-controls (ATC) and balance-ot-plant (BOP) positions; Instant SROs (SRO-l) must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one malor transient, in the ATC position. If an Instant SRO-l additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix 0. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.
3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

For licensees that use the ATC operator pnmahly for monitoring plant parameters, the chief examiner may place SRO-l applicants in either the ATC or

  • BOP position to best evaluate the SRO-l in manipulating plant controls.

NUREG 1021 Revision 10

ES-301 Transient and Event Checklist Form ES-301-5 (Rev_O1 2516)

Facility: Robinson Date of Exam: 2/2016 Operating Test No.: N16-7 A E Scenarios P V N16-1-1 N16-1-2 N16-l-3 N16-1-6 T M P E 0 L N T N CREW CREW CREW CREW T POSITION POSITION A I POSITION POSITION C L M A T U N Y T P S A B S A B S A B S A B R I U E R T 0 R T 0 R T 0 R T 0 0 C P 0 C P 0 CPO C P RX 2 1 1 1 0 1

NOR 2 1 1 1 3,5 1,2, SROI-7 I/C 8 4 4 2 MAJ 6 6 6 3 2 2 1 1,5 TS 2 0 2 2 RX 1 1 1 0 1,3 2 NOR 3 1 1 1 2,4, 1,4, 1,3, SROI-8 I/C 4,5 10 4 4 2 6 6 6 MAJ 3 2 2 1 IS 2 0 2 2 RX 7 1 1 0 1,3 2 NOR 3 1 1 1 2,4, 1,4, 1,3, SROI-9 I/C 10 4 4 2 6 6 6 MAJ 3 2 2 1 Is 2 0 2 2 RX 1 1 1 0 NOR 1 1 1 1 1,4, 1,2, RO-1 4 4 2 I/C 6 6 6 MAJ 2 2 2 1 TS 0 0 2 2 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must service in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SRO5 (SRO-l) must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO-l additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. () Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.
3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

For licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-l applicants in either the ATC or GOP position to best evaluate the SRO-l in manipulating plant controls.

NUREG 1021 Revision 10

ES-301 Transient and Event Checklist Form ES-301 -5 (Rev_O1 2576)

Facility: Robinson Date of Exam: 2/2016 Operating Test No.: N16-1 A E Scenarios P V N16-f-1 N16-1-2 N16-l-3 N16-l-6 T M P E 0 I L N CREW T N CREW CREW CREW I T POSITION POSITION POSITION POSITION A I C L M A I u N Y T P 5 A B S A B S A B S A B R I U E A 1 0 A 1 0 R 1 0 R 1 0 0 C P 0 C P 0 C P 0 C P 1 1 1 1 0 RX NOR 1 1 1 1 2.4, 1,2, 7 4 4 2 8, 9 7 RO-2 I/C 6 6 2 2 2 1 MAJ TS 0 0 2 2 1 1 1 1 0 RX NOR 1 1 1 24, 1,2, 2 7 4 4

8. 9 7 RO-3 I/C 6 6 2 2 2 1 MAJ Is 0 0 2 2 RX 1 1 1 0 1 1 1 1 1 NOR 1,5 4 4 4 2 RO-4 I/C 6 6 2 2 2 1 MA]

TS 0 0 2 2 RX 0 1 1 0 2 2 1 1 1 NOR 1,2, 1,3, 4 4 2 SROU-1 I/C 4.5 8 6 6 2 2 2 1 MAJ 1,2 4 0 2 2 TS Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must service in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SRO5 (SAC-I) must serve in both the SAC and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position, If an Instant SRO-l additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. () Reactivity snd normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.
3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

For licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-l applicants in either the ATC or SOP position to best evaluate the SAC-I in manipulating plant controls.

NUREG 1021 Revision 10

ES-3d Transient and Event Checklist Form ES-301-5 (Rev_012516)

Facility: Robinson Date of Exam: 2/207 6 Operating Test No.: N16-1 A F Scenarios P V N16-1-1 N16-1-2 N16-1-6 N16-1-5 I M P F 0 I L N T N CREW CREW CREW CREW I T POSITION POSITION POSITION POSITION A C L M A T u N Y T P S A B S A B S A B S A B A I U E R T 0 R T 0 R T 0 A T 0 0 C P 0 C P 0 C P 0 C P AX 0 1 1 0 1

NOR 2 1 1 1 1,2, 2,3, 4.5 8 4 4 2 SROU-2 I/C 45 6 6 2 2 2 1 MAJ 1,2 4 2 TS 0 2 RX 7 1 1 0 1 1 NOR 2 1 1 7 1,5 2,3, 2,3 8 4 4 2 SROI-2 I/C 45 6 6 6 1 MAJ 3 2 2 TS 2 0 2 2 1

RX 7 1 1 0 1 2 NOR 2 1 1 7 2,3, 1,3, 4,5, 4,5 7,9 7 4 4 2 SROI-4 I/C 6 6 6 3 2 1 MA] 2 TS 2 0 2 2 RX 1 1 0 NOR 1 1 1 4 4 2 I/C MAJ 2 2 1 TS 0 2 2 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable tor RO applicants. ROs must service in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SROs (SRO-l) must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO-l additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. () Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-I basis.

3 Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

For licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-I applicants in either the ATC or BOP position to best evaluate the SRO-l in manipulating plant controls.

NUREG 1021 Revision 10

ES-3D 1 Competencies Checklist Form ES-3D 1-6 (Rev_Of 2376)

Facility: Robinson Date of Examination: 2/2016 Operating Test No.: N16-1 APPLICANTS SRO (U/I) RO/ATC BOP Competencies SCENARIO SCENARIO SCENARIO 1 2 3 4 1 2 3 4 1 2 3 4 I nterpret/Diag nose Events and 1-7 1-9 1-8 1-9 1-7 1-9 1-8 1-9 1-7 1-9 1-8 1-9 Conditions Comply With and Use 1-7 1-9 1-8 1-7 1-7 1-9 1-8 1-9 1-7 1-9 1-8 1-9 Procedures (1)

Operate Control 2,4, 1 2 1 3 1 2 1 2 1 2 Boards (2) NA NA NA NA 4,6, 4:5: 3:7: 3,4, 3:6:

6 7 8,9 6 9 6,7 Communicate and 1-7 1-9 1-8 1-9 1-7 1-9 1-8 1-9 1-7 1-9 1-8 1-9 Interact Demonstrate Supervisory Ability 1-7 1-9 1-8 1-9 NA NA NA NA NA NA NA NA (3)

Comply With and Use 1-2 3-4 1,5 4-5 NA NA NA NA NA NA NA NA Tech. Specs. (3)

Notes:

(1) Includes Technical Specification compliance for RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant. (This includes all rating factors for each competency.) (Competency Rating factors as described on forms ES-303-1 and ES-303-3.)

NUREG-1021, Revision 10

ES-301 Competencies Checklist Form ES-301 -6 (Rev 012316)

Facility: Robinson Date of Examination: 2/2016 Operating Test No.: N16-1 APPLICANTS SRO (U/I) RO/ATC BOP Competencies SCENARIO SCENARIO SCENARIO 5 6 5 6 5 6 Interpret/Diagnose Events and 1-7 1-9 1-7 1-9 1-7 1-9 Conditions Comply With and Use 1-7 1-9 1-7 1-9 1-7 1-9 Procedures (1)

Operate Control 1,4, 1,2, 24 12 Boards (2) NA NA 5,6, 3,6, 56 36 Communicate and 1-7 1-9 1-7 1-9 1-7 1-9 Interact Demonstrate Supervisory Ability 1-7 1-9 NA NA NA NA (3)

Comply With and Use NA NA NA NA 3,5 3-4 Tech. Specs. (3)

Notes:

(1) Includes Technical Specification compliance for RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant. (This includes all rating factors for each competency.) (Competency Rating factors as described on forms ES-303-1 and ES-303-3.)

NUREG-1021, Revision 10

ES-401 PWR Examination Outline Form ES-401-2 Facility: ROBNSON Date of Exam: FEBRUARY 2016 ROK/ACatpoPah-its SRO-Only_Points Tier Group KKKKKKAAAAG A2 G* Total 1 2 3 4 5 6 1 2 3 4

  • Total
1. 1 3 3 3 3 3 3 18 3 3 6 Emergency &

Abnormal 2 .1 .2_ N/A 1 2 N/A 1 9 2 2 4 Evolutions Tier Totals 4 5 5 4 5 4 27 5 5 10 1 33223223332 28 3 2 5 2.

Plant 2 111111110 ii 10 0 2 1 3 Systems Tier Totals 4 4 3 3 4 3 3 4 3 4 3 38 5 3 8

3. Generic Knowledge and AbUities Categories 1L2]3J 4] io [N 1 2 3 j 4 7 3 2 2 3 ftl 2 2 2 Note: 1. Ensure that at least two topics from every applicable K/A category are sampled within each tier of the RO and SRO-only outlines (i.e., except for one category in Tier 3 of the SRO-only outline, the Tier Totals in each K/A category shall not be less than two). (One Tier 3 Radiation Control K/A is allowed if the K/A is replaced by a K/A from another Tier 3 Category).
2. The point total for each group and tier in the proposed outline must match that specified in the table. The final point total for each group and tier may deviate by +/-1 from that specified in the table based on NRC revisions. The final RO exam must total 75 points and the SRO-only exam must total 25 points.
3. Systems/evolutions within each group are identified on the associated outline; systems or evolutions that do not apply at the facility should be deleted with justification; operationally important, site-specific systems/evolutions that are not included on the outline should be added. Refer to Section D.1 .b of ES-401 for guidance regarding the elimination of inappropriate K/A statements.
4. Select topics from as many systems and evolutions as possible; sample every system or evolution in the group before selecting a second topic for any system or evolution.
5. Absent a plant-specific priority, only those K/As having an importance rating (IR) of 2.5 or higher shall be selected. Use the RO and SRO ratings for the RO and SRO-only portions, respectively.
6. Select SRO topics for Tiers 1 and 2 from the shaded systems and K/A categories.
7. The generic (G) K/As in Tiers I and 2 shall be selected from Section 2 of the K/A Catalog, but the topics must be relevant to the applicable evolution or system. Refer to Section D.1 .b of ES-401 for the applicable K/As.
8. On the following pages, enter the K/A numbers, a brief description of each topic, the topics importance ratings (IRs) for the applicable license level, and the point totals (#) for each system and category. Enter the group and tier totals for each category in the table above; if fuel handling equipment is sampled in a category other than Category A2 or G on the SRO-only exam, enter it on the left side of Column A2 for Tier 2, Group 2 (Note #1 does not apply). Use duplicate pages for RO and SRO-only exams.
9. For Tier 3, select topics from Section 2 of the K/A catalog, and enter the K/A numbers, descriptions, IRs, and point totals f#) on Form ES4OI-3. Limit SRO selections to K/As that are linked to 10 CFR 55.43.

G* Generic K/As

ES-401, REV 9 TIGI PWR EXAMINATION OUTLINE FORM ES-40f-2 KA NAME I SAFETY FUNCTION: IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 007EK2.02 Reactor Trip Stabilization Recovery 2.6 2.8 fl j 1J fl Breakers, relays and disconnects

/1 008AG2. 1.30 Pressurizer Vapor Space Accident / 3 4.4 4.0 DEDüLLJ Ability to locate and operate components, including local controls.

OO9EA1 .10 Small Break LOCA/ 3 3.8 3.9 LELDEL] Safety parameter display system 01 1EK3.15 Large Break LOCA /3 4.3 4.4 LEDE1L1EDDD Criteria for shifting to recirculation mode 022AA2.03 Loss of Rx Coolant Makeup 1 2 3.1 3.6 L]DCEÜEIfl ic1L1L Failures of flow control valve or controller 025AG2.4.47 Loss of RHR System /4 4.2 4.2 Ability to diagnose and recognize trends in an accurate and timely manner utilizing the appropriate control room reference material.

027AK2.03 Pressurizer Pressure Control System 2.6 2.8 ELüDLDE1 Controllers and positioners Malfunction / 3 029EK2.06 ATWS/1 2.9 3.1 Breakers, relays, and disconnects.

038EK1 .04 Steam Gen. Tube Rupture I 3 3.1 3.3 Reflux boiling 040AK1 .05 -

Steam Line Rupture Excessive Heat 4.1 Reactivity effects of cooldown LE1DLJL1EELi Transfer I 4 054AA1 .03 Loss of Main Feedwater / 4 3.5 3.7 AFW auxiliaries, including oil cooling water supply Page 1 of 2 06/22/2015 9:28 AM

ES-401, REV 9 If GI PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION: IR Kl 1(2 K3 1(4 1(5 1(6 Al A2 A3 A4 G TOPIC:

RD SRO 055EK3.02 Station Blackout / 6 4.3 4.6 Actions contained in EOP far loss of offsite and onsite El El 1] El El El El El El El El power 056AA2.1 1 Loss of Off-site Power I 6 2.9 2.9 Operational status of service water booster pump ElEEElElEElElDEl 057AA2fr Loss of Vital AC Inst. Bus / 6 fflVer-&aIteete aur Th 3*7 Y*I P o. C. o4 ot2cfrttCJ Tko.1 . I 058M1 .02 Loss of DC Power / 6 3.1 3.1 Static inverter dc input breaker, ftequency meter, ac CElDElElEElD[1L output breaker and ground fault detector weO4EG2.4.% LOCA Outside Containment /3 4.2 4.2 Ability to verify that the alarms are consistent with the ElElElEElElDLiDEH plant conditions.

WEO5EK3.4 -

Inadequate Heat Transfer Loss of 3.7 3.9 RO ai SRO function within the control room team as EElElDDDElDEEl appropriate to the assigned position, in such a way that Secondary Heat Sink / 4 procedures ate adhered to and the limitations in the facilities license and amendments are not violated.

WE11EK1,1 LossofEmergencyCoolantRecirc.I4 3.7 4.0 El El El El El El El El El El Components, capacity, and function of emergency Systems.

Page 2 of 2 06/22/2015 9:28 AM

ES-401, REV 9 TIG2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION: IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 005AK2.02 lnoperablelstuck Control Rod /1 2.5 2.6 2] 2] 2] 2] 2] 2] 2] 2] 2)) 2] Breakers, relays, disconnects and control room switches 028AK1 .01 Pressurizer Level Malfunction I 2 2.8 3.1 ]J 2] 2] 2] 2] 2] 2] 2] 2] [2] 2] PZR reference leak abnormalities 032AA2.02 Loss of Source Range NI I 7 3.6 3.9 2] 2] 2] 2] 2] 2] 2] 2] 2] 2] Expected change in source range count rate when rods are moved 033AK3.01 Loss of Intermediate Range NI / 7 3.2 3.6 2] 2] [2] 2] 2] 2] 2] [2] 2] 2] Termination of startup following loss of intermediate-range instrumentation 060AK2.01 Accidental Gaseous Radwaste Rel. I 9 2.6 2.9 2] 2] 2] 2] 2] 2] 2] 2] 2] 2] ARM system, including the normal radiation-level indIcations and the operability status 067AA1 .09 Plant Fire On-site / 8 3 3.3 2] 2] 2] 2] 2] [2] [j 2] 2] 12] 2] Plant fire zone panel (including detector location) 068AK3. 12 Control Room Evac. /8 4.1 4,5 2] 2] 2] 2] 2] 2] 2] 2] 2] 2] Required sequence of actions for emergency evacuation of control room 076AA2.04 High Reactor Coolant Activity /9 2.6 3 2)) 2)) 2] 2)) 2] 2] 2] J 2)) [2] 2] Process effluent radiation chart recorder we09EG2. 1.20 Natural Circ. / 4 4.6 4.6 [1. Ability to execute procedure steps.

2] 2] 2] 2] 2] 2] 2] 2] 2] [j Page 1 of 1 06/22/2015 9:28 AM

ES-401, REV 9 T2GI PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION: IR Ki K2 K3 1<4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 003A3.01 Reactor Coolant Pump 3.3 3.2 fl ?1 [] Seal injection flow 003K4.07 Reactor Coolant Pump 3.2 3.4 fl fl [J fl EJ J Minimizing RCS leakage (mechanical seals) 004K2.06 Chemical and Volume Control 2.6 2.7 [] (i)] (J [] [] fl fl [] U U U Control instrumentation 005A2.02 Residual Heat Removal 3,5 3.7 tJ U U Pressure transient protection during cold shutdown 005K6.03 Residual Heat Removal 2.5 2.6 U U U U EJ RHR heat exchanger 006A1.13 Emergency Core Cooling 3.5 3.7 U U Li rj U Accumulator pressure (level. boron concentration) 0061<5.01 Emergency Core Cooling 2.8 3.3 U U U [] Effects of temperatures on water level indications 007K3.O1 Pressurizer Relief/Quench Tank 3.3 3.6 U U U U U Li Li Li U Containment 0O8A4e. Component Cooling Water -26L Li tt1gg of-thg CGN-pu,..p dJiorgo :ale fM 33 3,) c.cbJ i4,c&t,b6 o.J o-faU 0101<6.04 Pressurizer Pressure Control 2.9 3.2 U Li Li [1 Li U U U U U PRT 012A3.06 Reactor Protection 3.7 3.7 U Li Li U [1 U Li Li Trip logic fl Page 1 of 3 06/22)2015 9:28 AM

ES-401, REV9 T2GI PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 012K1.05 Reactor Protection 3.8 3.9 ESFAS Li 013K5.02 Engineered Safety Features Actuation 2.9 3.3 LLiI{DLEL Safely system logic and reliability 022A4.04 Containment Cooling 3.1 3.2 Valves in the CCS 026A2.08 Containment Spray 3.2 3.7 Safe securing of containment spray when it can be done)

ELE1L 039A1 .10 Main and Reheat Steam 2.9 3.0 Air ejector PRM 059K4.02 Main Feedwater 3.3 3.5 Automatic turbine/reactor trip runback 061 1(5.01 AuxiliarylEmergency Feedwater 3.6 3.9 Relationship between AFW flow and RCS heat transfer DLLJL1D[1DEüi 062K1 .04 AC Electrical Distribution 3.7 4.2 LDDflLiEE1!ZDE Off-site power sources 062K2.01 AC Electrical Distribution 3.3 Major system loads DDüEiD1 063A3.01 DC Electrical Distribution 2.7 3.1 Meters, annunciators, dials, recorders and indicating lights 064A2.18 Emergency Diesel Generator 2.6 2.7 Consequences of premature opening of breaker under load Page 2 of 3 06122/2015 9:28 AM

ES-401, REV 9 12G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 064K2.02 Emergency Diesel Generator 2.8 3.1 H H .

U H Fuel oil pumps 073A4.O1 Process Radiation Monitoring 3.9 3.9 U H Effluent release 073G2.4.9 Process Radiation Monitoring 3.8 4.2 H LI U Li LI LI H Li Knowledge of low power / shutdown implications in accident (e.g. LOCA or loss of RHR) mitigation strategies.

076K1.15 Service Water 2.5 2.6 j H Li LI LI [J Li LI [1 FPS H LI 078K3.03 Instrument Air 3.0 3.4 Li Ej U] LI LI [J LI LI Cross-fled units 103G2.l.7 Containment 4.4 4.7 Ability to evaluate plant performance and make

[J 4J ] U] U] U] [] U] U] ] operational judgments based on operating characteristics, reactor behavior and instrument interpretation.

Page 3 of 3 06/22)2015 9:28 AM

ES-401, REV 9 T2G2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION: IR KI K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 001K6.13 Control Rod Drive 3.6 3.7 Li Li Li Li LI Li Li LI Li Li Location and operation of RPIS 002K4.0J Reactor Coolant 2.7 3.0 Fl LI Li l Li Li [I Li Li El Li Filling and draining the RCS O1IAI.02 Pressurizer Level Control 3.3 3.5 Li El LI El Li Li LI Li LI LI Charging and letdown flows 014K5.0l Rod Position Indication 2.7 3.0 fl Li J Li Li LI El Li Reasons for differences between RPIS and step counter 017A4.0l In-core Temperature Monitor 3.8 4.1 LI Li Li LI Li [1 Li Li Actual in-core temperatures 027K2.0f Containment Iodine Removal 3.1 3.4 Li [) Li Li E] LI El El Li LI LI Fans 029G2.l.23 Containment Purge 4.3 4.4 Li Li LI Li Li LI Li Li LI El Ability to perform specific system and integrated plant procedures during all modes of plant operation.

033K3.02 Spent Fuel Pool Cooling 2.8 3.2 Li Li J Li Li; LI Li Li LI Li Li Area and ventilation radiation monitoring systems 035A2.05 Steam Generator 3.2 3.4 Li Li Li Li Li Li Li i Li Li Li Unbalanced flows to the 5/Gs 068K1 .07 Liquid Radwaste 2.7 2.9 LI Li LI Li El Li Li LI Li LI Sources of liquid wastes fo LRS Page 1 of 1 06/22)2015 9:28 AM

ES-401, REV 9 T3 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION: IR Ki K2 K3 K4 1(5 1(6 Al A2 A3 A4 G TOPIC:

RO SRO G2.l .29 Conduct of operations 4.1 4.0 LiD LiD [I [I Knowledge of how to conduct system lineups, such as

[I [I [I valves, breakers, switches, etc.

G2.l .36 Conduct of operations 3.0 4.1 Knowledge of procedures and limitations involved in core LiD LiD LI LI Li Li Li [I alterations G2.1.45 Conduct of operations 4.3 4.3 Ability to identity and interpret diverse indications to LiD Li Li F] Li Li Li validate the response of another indication G2.2.38 Equipment Control 3.6 4.5 [IF] LiLi Li Li Li Li LI [I J Knowledge of conditions and limitations in the facility license.

G2.2.39 Equipment Control 3.9 4.5 Knowledge of less than one hour technical specification LiLi ED Li LI Li EJ Li Li j action statements for systems.

G2.3.1 3 Radiation Control 3.4 3.8 Knowledge of radiological safety procedures pertaining to LiE Li Li F] Li [I Li ]

licensed operator duties G2.3.4 Radiation Control 3.2 3.7 Knowledge of radiation exposure limits under normal and LiE LiD Li Li Li Li Li Li emergency conditions G2.4.1 1 Emergency Procedures/Plans 4.0 4.2 Knowledge of abnormal condition procedures.

ELi F] F] LI Li Li Li G2.4.25 Emergency Procedures/Plans 3.3 3.7 LiLi LiE F] F] Knowledge of fire protection procedures.

Li fl [I [I G2.4.31 Emergency Procedures/Plans 4.2 4.1 Knowledge of annunciators alarms, indications or

[I F] Li Li F] Li Li Li Li F] [

response procedures Page 1 of 1 06/22/201 5 9:52 AM

ES-401, REV 9 SRO TIGI PWR EXAMINATION OUTLINE FORM ES4OI-2 KA NAME I SAFETY FUNCTION: IR 1<1 1(2 K3 K4 1(5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 029EA2.06 ATWS / 1 3.8 3.9 j Main turbine trip switch position indication -

038EG2.4.47 Steam Gen. Tube Rupture I 3 4.2 4.2 [] Ability to diagnose and recognize trends in an accurate J []

and timely manner utilizing the appropriate control room reference material.

054AG2.4.9 Loss of Main Feedwater I 4 3.8 4.2 Knowledge of low power! shutdown implications in fl []

accident (e.g. LOCA or loss of RHR) mitigation strategies.

055EA2.06 Station Blackout! 6 3.7 4.1 Faults and lockouts that must be cleared prior to re energizing buses 058AG2.2.22 Loss of DC Power /6 4.0 4.7 L [J J Knowledge of limiting conditions for operations and D fl J safety limits.

077AA2.03 Generator Voltage and Electric Grid 3.5 3.6 Generator current outside the generator capability curve Disturbances / 6

[ [J Page 1 of 1 06/22/2015 9:28 AM

ES-401, REV 9 SRO TIG2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION: IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO OO1AA2.02 Continuous Rod Withdrawal Il 4.2 4.2 U U U U U LI LI Position of emergency boration valve 051AG2.4.35 Loss of Condenser Vacuum /4 3.8 4.0 LI LI fl LI LI H LI LI LI LI Knowledge of local auxiliary operator tasks during emergency and the resultant operational effects 061AA2.03 ARM System Alarms /7 3 3.3 LI LI LI LI LI fl LI LI LI LI Setpoints for alert and high alarms weO6EG2.l.23 Degraded Core Cooling / 4 4.3 4.4 LI LI LI LI [] LI LI LI LI {] Ability to perform specific system and integrated plant procedures during all modes of plant operation.

Page 1 of 1 06/22/2015 9:28 AM

ES-401, REV9 SRO T2GI PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION: IR Kl 1(2 K3 1(4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 01 2A2d.- Reactor Protection IM1VtP.-....

E 2O5 yI 7:- F H) or o ddor.

& &lC.t)e cJo 039A203 Main and Reheat Steam Indications and alarms for main steam and area radiation monitors (during SGTR) 076G2.1.7 Service Water 4.4 4.7 Ability to evaluate plant performance and make EflDEJL1E operational judgments based on operating characteristics, reactor behavior and instrument interpretation.

078A2.01 Instrument Air 2.4 2.9 Air dryer and filter malfunctions 1 03G2.4.35 Containment 3.8 4.0 Knowledge of local auxiliary operator tasks during flD1ELEDD emergency and the resultant operational effects Page 1 of I 06(2212015 9:28 AM

ES-401, REV9 SRO T2G2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION: IR Kl K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 015A2.04 Nuclear Instrumentation 3.3 3.8 Effects au axial flux density of control rod alignment and sequencing, xenon production and decay, and boron vs.

control rod reactivity changes 068A2.02 Liquid Radwaste 2.7 2.8 EDD L]EEfl Lack of tank recirculation pnor to release 071 G2.4.21 Waste Gas Disposal 4.0 4.6 Knowledge of the parameters and logic used to assess the status of safety functions Page 1 of I 06/22)2015 9:28AM

ES4OI, REV9 SRO T3 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION: IR K1 K2 K3 1<4 K5 K6 Al A2 A3 A4 G Topic:

RO SRO G2.l.45 Conductof operations 4.3 4.3 El El El El El El El El El El i Ability to identify and interpret diverse indications to validate the response of another indication G2.2.21 Equipment Control 2.9 4.1 Knowledge of pre- and post-maintenance operability ElElLElElElElElLEl requirements.

G2.2.36 Equipment Control 3.1 4.2 Ability to analyze the effect of maintenance activities.

ElElElElEElElElElE[

such as degraded power sources, on the status of limiting conditions of operations G2.3.12 Radiation Control 3.2 3.7 Knowledge of radiological safety principles pertaining to ElElDElElElElElElEl licensed operator duties G2.3.14 Radiation Control 3.4 3.8 Knowledge of radiation or contamination hazards that EElElUElDElElElEl may arise during normal, abnormal, or emergency conditions or activities G2.4.30 Emergency Procedures/Plans 2.7 4.1 Knowledge of events related to system operations/status L1ElDElElL]EiElElEl that must be reported to internal orginizations or outside agencies.

G2.4.46 Emergency Procedures/Plans 4.2 4.2 Ability to verify that the alarms are consistent with the E1ElEElDDEElElEl plant conditions.

Page 1 of 1 06/22/2015 9:28 AM

ES-401 Record of Rejected K/A's Form ES-401-4 Randomly Selected Tier / Group Reason for Rejection KA Facility rarely throttles the CCW Pump discharge valves, and when this does occur (During Testing) indications of the action are in the field. Best effort was made to construct question, but it RO 2/1 008 A4.03 did NOT result in a psychometrically sound question (No Plausible Distractors). Replaced with 008 A4.01, randomly chosen by the Chief Examiner.

The AC instrument busses at the facility have no associated alarms in the Control Room, NOR does the alternate power source for those AC instrument busses. The best effort was RO 1/1 057 AA2.06 made to construct a question but it was determined we could not hit this KA. Replaced with 057 AA2.15, randomly chosen by the Chief Examiner.

The incorrect bypassing of a channel at RNP results in a plant trip in most cases. Trying to find an instrument that could be incorrectly bypassed, but not cause a trip, and then write a question to an SRO only level (most of these error scenarios SRO 2/1 012 A2.03 would be RO knowledge) was very difficult and in the attempt that was made, could be tied back to a less than one hour tech spec, and thereby removing the SRO only plausibility. Replaced with 012 A2.05, randomly chosen by the Chief Examiner.

ES4OI Written Examination Quality Checklist Form ES4OI-6 fadifty: Robinson Nudear Plant Date of Exam: 2/1/2016 Exam Level; RD SRO C Initial Item Description a b*

1. Questions and answers are technically accurate and applicable to the faciflty. t-
2. a. NRC K/As are referenced for all questions.
b. Facility learning objectives are referenced as available.
3. SRO questions are appropriate in accordance with Section D.2,d of ES-401
4. The sampling process was random and systematic (If more than 4 RD or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR DL program office).
5. Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item that applies) and appears appropriate:

the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or the examinations were developed independently; or c the ficensee certifies that there is no duplication; or other (explain)

6. Bank use meets limits (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the rest -

new or modified); enter the actual RD I SRQ-only question distribution(s) at right. 1$ / - 5 / 52 / -

7. Between 50 and 60 percent of the questions on the RD Memory C/A exam are written at the comprehension! analysis level; the SRO exam may exceed 60 percent if the randomly L...

selected K/As support the higher cognitive levels; enter the actual RD I SRO question distribution(s) at righi 32 I - 43 / -

8. RelerencesThandouts provided do not give away answers , £_.

or aid in the elimination of distractors.

9. Question content conforms with specific K/A statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; (. ft deviations are justified.
10. Question psychometric quality and format meet the guidelines in ES Appendix B.
11. The exam contains the required number of one-point, multiple choice Items; the total is correct and agrees with the value on the cover sheet.

Printed Name I Signature Date

a. Author Ci(A sSmf,.(
b. Facility Reviewer f)
c. NRC Chief Examiner(#) Doi i). .,d , 2// t6 U. NRCRegionalSupervisor lQi..p&a c

Note:

  • The facility reviewers initials/signature are not applicable br NRC-developed examinations.
  1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

ES4OI Written Examination Quality Checklist Form ES4OI-6 Fadilty: Robinson Nuclear Plant Date of Exam: 2/1/2016 Exam Level: RO SRO ]

Initial Item Description a b* c

1. Questions and answers are technically accurate and applicable to the facility. C- .,,. j,
2. a. NRC K/As are referenced for all questions.
b. Facility learning objectives are referenced as available.
3. SRO questions are appropriate in accordance with Section D.2.d of ES-401 C,.
4. The sampling process was random and systematic (II mote than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR OL program office). c. --
5. Question duplication from the license screenlng!audit exam was controlled as Indicated below (check the Item that applies) and appears appropriate:

-the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or the examinations were developed Independently; or the licensee certifies that there Is no duplication; or other (explain)

6. Bank use meets limits (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the test new or modified); enter the actual RO I SRO-only C question distribution(s) at right. 1$ / 4 5 / 5 52 1 16
7. Between 50 and 60 percent of the questions on the RO Memory C/A exam are written at the comprehension! analysis level; the SRO exam may exceed 60 percent If the randomly 1__.

selected K/As support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at right.

32 / 4 43 / 21

8. References/handouts provided do not give away answers t._

or aid In the elimination of distractors.

9. Question content conforms with specific K/A statements in the previously approved examination outline and Is appropriate for the tier to which they are assigned; deviations are justified.
10. Question psychometric quality and format meet the guidelines in ES Appendix B. ii
11. The exam contains the required number of one.point, multiple choice items:

the total Is correct and agrees with the value on the cover sheet.

Printed Name / Signature Date

a. Author Cnçe,,ptjt,< M4,jt4 Z]3/It
b. Facility Reviewer () . ..xrrt.e.
c. NRC Chief Examlnerf#) [) r4 n. iJ*6i
d. NRC Regional Supervisor \ 24

( s.

Note: The facility reviewers Initials/signature are not applicable for NRC-developed examinations.

  1. independent NRC reviewer Initial Items in Column c; chief examiner concurrence required.

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A EPE007 EK2.02 1 F 2 X B U Choices A and C are not plausible distractors.

Question is Unsatisfactory due to two implausible distractors.

1/4/2016 - Revised question is Satisfactory.

K/A APE008 2.1.30 2 H 2  ? N E The first part question is too much overlap with Scenario 3 Event 5.

They are the same immediate actions. Also, closing RC-535 is in all 4 answer choices.

Is knowledge of this power supply minutia? You have used that argument for one of the early submittal questions.

1/4/2016 - Revised question is Satisfactory.

K/A EPE009 EA1.10 3 H 2 X N E Knowledge of entry conditions for yellow paths is generally considered SRO knowledge. Following the procedure for a yellow path is based on the discretion of the SRO. You can test red and orange.

1/4/2016 - Operations Management approves testing safety Yellow CSFST identification. They have valid objectives and ROs monitor the status of safety functions. This is not procedure selection. (John Little)

K/A EPE011 EK3.15 4 F 2 X N E Do not believe that the reason for choices C and D are plausible.

Recommend asking what the maximum RWST level is that requires shifting to ECCS sump recirculation (19% or 27%) and giving times in the initial condition to choose between hot or cold leg recirculation. The reason for picking between hot or cold leg would be the time being greater or less than 11 hours1.273148e-4 days <br />0.00306 hours <br />1.818783e-5 weeks <br />4.1855e-6 months <br />.

1/25/2016 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A APE 022 AA2.03 5 H 2 X N E Need to address timing and equipment in AUTO.

1/4/2016 - Revised question is Satisfactory.

K/A APE025 2.4.47 6 H 2 X X N U Given that RCS flow is 3000 gallons per minute, the bypass valve demand is 60%, and RCS pressure is being controlled, choices B(1) and D(1) are not plausible.

This is also a very good cue that there has not been a loss of RHR flow.

Question is Unsatisfactory due to two implausible distractors.

1/4/2016 - Revised question is Satisfactory.

K/A APE027 AK2.03 7 H 2 X X B E The picture provided for question #2 provides a clue to one of the questions.

The question and given conditions could be reworded and split into two parts that would make it less error likely for the applicants.

1/4/2016 - Revised question is Satisfactory.

K/A EPE029 EK2.06 8 H 2 X N E The question needs to be reworded some because FRP-S.1 gives you a list of 4 different sets of breakers and tells you to open all of them. It could be argued that there is no correct answer.

1/4/2016 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A EPE038 EK1.04 9 H 3 X N E With a saturated system, both choices A and D could be argued to be correct. Also, cooling is based on a difference in temperature.

Unable to write a operationally valid question to this K/A.

K/A EPE038 EK1.01 1/25/2016 - Revised question is Satisfactory.

K/A APE 040 AK1.05 10 H 2 X M E The first part question does not test the K/A and is more of a systems (tier 2) question. The second part of the question is a GFES question, but is related to the K/A. Recommend asking something about how to add the Boron or how much Boron to add (ECA-2.1).

We can discuss.

1/4/2016 - Revised question is Satisfactory.

K/A APE054 AA1.03 11 F 2 X B E Choice D is not plausible because it is cooled by Service Water. Is there another option?

1/4/2016 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A EPE055 EK3.02 12 F 2 X X N U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.

Distractor B does not appear to be plausible. When starting at a required pressurizer level of only greater than 14% and probable RCP seal leakage, it does not seem reasonable that pressurizer level greater than 7% can be ensured. Also, Distractors A and B are essentially the same thing. Distractor D is not plausible due to not being able to reach a red path if the cooldown rate limit is followed.

The stem question statement is not totally correct. The procedure caution statement only says that pressure should not be lowered less than 190 psig, it does not say to stop before.

Question is Unsatisfactory due to two non-plausible distractors.

Recommendations:

  • Remove unnecessary information from current initial conditions. We can discuss specifics.
  • Give two times (30 minutes apart) with S/G pressure and pressurizer level. For the first time, have pressurizer level less than 14%. For the second time, have S/G pressure at 190 psig and pressurizer level going off scale low.
  • Ask: IAW ECA-0.0, what is the earliest time that the S/G depressurization is required to be stopped AND the reason for stopping the depressurization (preventing injection of accumulator nitrogen into the RCS or ensuring that no Reactor Vessel upper head voiding will occur).

12/3/2015- Question has been modified as recommended above.

Request that you add something to the effect of In accordance with EOP-ECA-0.0 to the question statement. Otherwise, the question is now Satisfactory.

1/4/2016 - Revised question is Satisfactory.

K/A APE056 AA2.11 13 H 3 B S Question is Satisfactory.

K/A APE057 AA2.15 14 H 3 N S Question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A APE058 AA1.02 15 F 2 X N E Choices B(2) and D(2) are not plausible. Do you have any examples of a case where the electrical output breaker is closed prior to the input breaker when placing a component in service?

There are several other possibilities for this K/A.

1/25/2016 - Revised question is Satisfactory.

K/A WE04 G2.4.46 16 H 3 X X X N U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.

The second part question appears to be asking procedure transition criteria, which is SRO knowledge.

Question is Unsatisfactory due to license level mismatch.

I am not sure that a leak in this location would always cause an APP-036-D7 alarm. The FSAR states that an alarm in this location would most likely be VCT or RWST water because there are so many check valves downstream. The R-4 alarm setpoint is 50 millirem per hour. Did or can you validate on the simulator?

Why ask or mention D8, since it is given in all four answer choices?

12/3/2015- Revised question was submitted. Choices A and D of the revised question are not plausible. How could you have a LOCA outside containment and not have a process monitor high rad alarm.

Also, you could remove all of the only from the choices by adding ALL of the to the question stem.

1/4/2016 - Revised question is Satisfactory.

K/A WE05 EK3.4 17 H 2 X X M E Stating that a red condition exists for Heat Sink in the initial conditions makes choice A(2) not plausible. Also, should not state that the red condition exists when steam generator levels and AFW flow are given. The applicant should be able to figure that out.

This also is more of an SRO question with procedure direction.

1/4/2016 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A WE11 EK1.1 18 H 2 X N E By my calculations, over 4 hours4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br />, the RWST level will lower for about 2.7 hours8.101852e-5 days <br />0.00194 hours <br />1.157407e-5 weeks <br />2.6635e-6 months <br /> until the SI pump is shut off at 9% and then rise for the remainder. I do agree that overall the level will be lower. Need to work on the wording of the second part of the question in order for there to be a fully correct answer.

Request and IAW statement be added to the stem question.

1/4/2016 - Revised question is Satisfactory.

K/A APE005 AK2.02 19 F 1.5 B S Question is Satisfactory.

K/A APE028 AK1.01 20 H 2 X B U Choices B and C are not plausible. If the controlling channel increases or decreases, how could other channels remain the same?

Question is Unsatisfactory due to two non-plausible distractors.

1/4/2016 - Revised question is Satisfactory.

K/A APE032 AA2.02 21 H 2 X B E This question does not appear to work IAW GP-003. You could go critical on any one of the steps for doubling and the procedure has you go to section 8.3 for critical operations. Is there really a minimum number of doublings?

1/4/2016 - Revised question is Satisfactory.

K/A APE033 AK3.01 22 H 3 X B U Do you expect the ROs to know where 120 cps on the Source Range equates to the Immediate Range for this case?

This does not match the K/A. It tests the cause of the loss of the IR instrument, not the reason for termination of the startup.

Tier 1 should normally test procedure/evolution requirements vice systems knowledge, unless otherwise specified by the specific K/A.

Question is Unsatisfactory due to not meeting the K/A.

1/25/2016 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A APE060 AK2.01 23 F 2 N S Question is Satisfactory.

K/A APE067 AA1.09 24 H 2 X X N E Picture of Fire Alarm Console not provided.

Reviewed picture in SRO exam.

The picture is somewhat blurry on the computer. Need to ensure that the picture is clear and readable on the exams. Also need to ensure that the picture is provided for the RO exam.

Given that both trains are actuated, this makes choices C(1) and D(1) not plausible. It would be OK to give only one train in alarm and test the other way.

Need to correct # of alarms on pictured.

1/25/2016 - Revised question is Satisfactory.

K/A APE068 AK3.12 25 H 3 N S Question is Satisfactory.

K/A APE076 AA2.04 26 H 2 X M E Choices B(1) and D(1) are not plausible.

1/25/2016 - Revised question is Satisfactory.

K/A WE09 2.1.20 27 H 2 X M E With step 9 being a continuous actions step, how are there not two correct answers?

1/25/2016 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A SYS003 A3.01 28 H 2 X N U The picture seems too hard to read.

Since all of the parameters shown return to their original values, outright failures do not seem to be plausible.

Question is Unsatisfactory due to two non-plausible distractors.

1/25/2016 - Revised question is Satisfactory.

K/A SYS003 K4.07 29 H 3 B S Question is Satisfactory.

K/A SYS004 K2.06 30 F 3 X N U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.

The question does not meet the K/A. It does not test knowledge of power supplies to the instrumentation, it gives a power supply that is lost and tests knowledge of how the instruments will fail upon a loss of power. That would be more of a K6 K/A.

Question is Unsatisfactory due to K/A mismatch.

12/7/15- Question is Satisfactory.

K/A SYS005 A2.02 31 H 2 X X B U Choices C and D are not plausible.

Question is Unsatisfactory due to two non-plausible distractors.

1/25/2016 - Revised question is Satisfactory.

K/A SYS005 K6.03 32 H 3 X X B E Choice C is not plausible.

Licensee explained how choice C could be plausible.

K/A SYS006 A1.13 33 F 3 N S Question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A SYS006 K5.01 34 F 2 X M E The second part question needs to be a little more specific concerning temperature (higher, lower, increased, decreased).

1/25/2016 - Revised question is Satisfactory.

K/A SYS007 K3.01 35 H 2 N S Question is Satisfactory.

K/A SYS008 A4.01 36 H 2 X X B E Choice D is not plausible.

The question stem does not exactly match the choices.

1/25/2016 - Revised question is Satisfactory.

K/A SYS010 K6.04 37 H 1 X N U Choices A, B, and D are not plausible. LOD = 1.

Question is Unsatisfactory due three non-plausible distractors and LOD = 1.

1/25/2016 - Revised question is Satisfactory.

K/A SYS012 A3.06 38 H 2 B S Question is Satisfactory.

K/A SYS012 K1.05 39 F 2 X  ? N E Choice D is not plausible.

Need to discuss K/A match.

1/25/2016 - Revised question is Satisfactory.

K/A SYS013 K5.02 40 F 2 N S Question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A SYS022 A4.04 41 H 2 X N E Choice D is not plausible. Choice A is likely not plausible.

1/25/2016 - Revised question is Satisfactory.

K/A SYS026 A2.08 42 H 2 N S Question is Satisfactory.

K/A SYS039 A1.10 43 F 2 X N E Choice A is not plausible.

1/25/2016 - Revised question is Satisfactory.

K/A SYS059 K4.02 44 F 2 N S Question is Satisfactory.

K/A SYS061 K5.01 45 H 2 X N U Choices A and D are not plausible.

There is no correct answer (must be > 600 gpm).

Question is Unsatisfactory due to two non-plausible distractors.

1/25/2016 - Revised question is Satisfactory.

K/A SYS062 K1.04 46 H 2 B S Question is Satisfactory.

K/A SYS062 K2.01 47 F 2 B S Question is Satisfactory.

K/A SYS063 A3.01 48 H 2 X N U Choices A and C are not plausible.

Question is Unsatisfactory due to two non-plausible distractors.

1/25/2016 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A SYS064 A2.18 49 F 2 X N U Choices C and D are not plausible.

Question is Unsatisfactory due to two non-plausible distractors.

1/25/2016 - Revised question is Satisfactory.

K/A SYS064 K2.02 50 F 2  ? B E Can you give any examples where there are A and B components that the B component is powered from the lower numbered MCC?

1/25/2016 - Question is Satisfactory.

K/A SYS073 A4.01 51 H 2 B S Question is Satisfactory.

K/A SYS073 2.4.9 52 F 3 X X M U Question seems to be more related SRO procedure direction than mitigation strategy. It also does not seem to meet the K/A because it does not seem to test the PRM system.

Selected K/A SYS073 2.4.11 1/26/16-New question is Satisfactory.

K/A SYS076 K1.15 53 F 3 N S Question is Satisfactory.

K/A SYS078 K3.03 54 F 2 N S Question is Satisfactory.

K/A SYS103 G2.1.7 55 H 2 X N E Is a spray pump running? Does the number of HVH units running matter concerning the CSFST? Need to discuss plausibility of choice C.

1/25/2016 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A SYS001 K6.13 56 H 2 X N E The given conditions picture is not included on anything that was submitted. Unable to review fully. It seems that operation or interpretation of RPI would be more relevant than location of cabinets that I&C personnel need to go to. If there is no IRPI rack in the Hagan room, then it is not plausible.

1/25/2016 - Revised question is Satisfactory.

K/A SYS002 K4.01 57 F 2 X N U Question does not appear to test design features or interlocks.

Question is Unsatisfactory due to not meeting the K/A.

1/25/2016 - Revised question is Satisfactory.

K/A SYS011 A1.02 58 F 2 X N E Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.

Need to state (in the question stem) what procedure these values are in accordance with.

1/25/2016 - Revised question is Satisfactory.

K/A SYS014 K5.01 59 H 2 X B U Choices A and B are not plausible.

Question is Unsatisfactory due to two non-plausible distractors.

1/25/2016 - Revised question is Satisfactory.

K/A SYS017 A4.01 60 F 2 X B U Choices A and B are not plausible.

Question is Unsatisfactory due to two non-plausible distractors.

1/28/2016 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A SYS027 K2.01 61 F 2 B S Question is Satisfactory.

K/A SYS029 G2.1.23 62 F 2 X N E Need to show where this information is located in OP-921. I could not find it.

Licensee is breaking stem into two separate questions.

1/28/2016 - Revised question is Satisfactory.

K/A SYS033 K3.02 63 F 2 X X N E Choices C(1) and D(1) are not plausible. They are process monitors.

1/26/16 - Revised question is Satisfactory.

K/A SYS035 A2.05 64 H 2 X X N E The choices for the second part question provide a direct cue to answer the first part question.

1/26/16 - Revised question is Satisfactory.

K/A SYS068 K1.07 65 F 2 X B E Choice A should probably be in all capital letters to match other choices.

1/26/16 - Revised question is Satisfactory.

K/A G2.1.29 66 F 2 N S Question is Satisfactory.

K/A G2.1.36 67 F 2 X B E Need nomenclature for NI-51 and NI-52.

1/26/16 - Revised question is Satisfactory.

K/A G2.1.45 68 H 2 X N E Choice A is not plausible. Is it fair to have the applicant evaluate T and MW without a reference? Need to discuss.

1/28/2016 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A G2.2.38 69 H 4 M E It seems that this question requires the applicant to know greater than one hour actions from memory.

Operations (John Little) determined that this is RO required knowledge because it relates directly to licensed power level and the RO is responsible for monitoring.

K/A G2.2.39 70 F 2 N S Question is Satisfactory.

K/A G2.3.13 71 F 1 B U It does not seem plausible that you would not evacuate the containment vessel or initiate closure after a fuel assembly has been dropped and is causing the noble gas radiation monitor to increase.

LOD = 1 Question is Unsatisfactory due to more than one non-plausible distractor and LOD = 1.

1/26/16 - Revised question is Satisfactory.

K/A G2.3.4 72 H 2 B S Question is Satisfactory.

K/A 2.4.11 73 H 3 X N E The second part question could be reworded to read easier.

1/26/16 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A G2.4.25 74 H 2 X N E Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.

In the question stem, need to state what procedure the action(s) are in accordance with.

Recommend stating in the initial conditions that either the block valves have been closed or the switches have been placed in the ISOLATED Position, then asking if the other action is or is not required.

For plausibility, are there any other time critical actions that are 15 minutes?

12/16/15 - Question is Satisfactory.

K/A G2.4.31 75 F 1 N U This has overlap with the operating test. Every BOP will perform this during the operating test.

Question is Unsatisfactory due to LOD = 1.

1/26/16 - Revised question is Satisfactory.

K/A EPE029 EA2.06 76 H 2 X N E With operation of the steam dumps following turbine trip, do not believe that choices A(2) and D(2) are plausible. Could possibly change the second part question to an is or is not question.

1/26/16 - Revised question is Satisfactory.

K/A EPE 038 2.4.47 77 H 1 X X X N U The first part question is direct lookup. This question can be answered using RO knowledge only.

The question is Unsatisfactory due to LOD = 1 and not being SRO only.

1/26/16 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A APE054 2.4.9 78 H 2 X X B U/E Knowledge of when to initiate bleed and feed is probably RO knowledge and is listed in the continuous action summary for FRP-H.1. This is also an objective in your lesson plan. The RO would be required to inform the SRO when conditions are met for bleed and feed.

It is acceptable for one part of a two part question to be RO knowledge, however both parts should not be able to be answered using RO knowledge.

ROs should also know that PORVs are opened for bleed and feed.

We need to discuss this situation for steps on the foldout page.

Also, since all of the choices listed in the second part question are done in the procedure, need to ask what should be done first.

Question may be Unsatisfactory due to not being SRO only.

1/29/2016 - Revised question is Satisfactory K/A EPE055 EA2.06 79 H 3 X  ? B E Is the first part of the question minutia? Does this lockout need to be cleared prior to re-energizing the buses? Does this meet the K/A?

Please explain.

1/28/2016 - Revised question is Satisfactory.

K/A APE058 2.2.22 80 H 2 X B E Per the TS 3.8 Bases, the selected answer for the second part question may not be correct.

1/26/16 -Licensee explained Bases, Question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A APE077 AA2.03 81 H 1 X M U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.

The last bullet provides a direct cue that the qualified offsite circuit is INOPERABLE (inadequate voltage for a design basis event). This makes LOD = 1.

Question is Unsatisfactory due to LOD = 1.

12/22/15- Revised question reviewed. Is there any place in AOP-26 that the EDGs are aligned by the operators to E-1 and E-2 independently? If not, choices C(2) and D(2) are not plausible. The question still needs some enhancement.

1/26/16 - Revised question is Satisfactory.

K/A APE001 AA2.02 82 H 2 N S Question is Satisfactory.

K/A APE051 G2.4.35 83 H 2 X X X N U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.

The question is not SRO only. SRO only knowledge should not be claimed for major mitigative strategy or AOP entry conditions. See Attachment 2 of ES-401.

Also, based on the wording of step 12 of AOP-012, the note prior to step 12, and the AOP-038 entry conditions, it appears that the SRO could perform a rapid power reduction if desired.

With no indication of condenser backpressure value or trend, how is going to a rapid power reduction plausible?

The question is Unsatisfactory because it is not SRO only.

Based on a review of your procedures, this could be a very hard K/A to satisfy at the SRO only level. We can discuss randomly selecting another K/A.

12/22/15 - Reviewed revised question. Question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A APE061 AA2.03 84 H 2 X N E The applicable answer choices do not include that a Portable Area Radiation Monitor in the CV area is also required in accordance with GP-010.

1/26/16 - Revised question is Satisfactory.

K/A WE06 2.1.23 85 H 2 X M E Choice C needs to be worded more clearly.

1/26/16 - Revised question is Satisfactory.

K/A SYS012 A2.05 86 H 2 X X N U Providing LCO 3.3.1 gives clues to the correct answer or gives the correct answer for several other questions on this exam. (Question 1 for example, and also questions that hinge on the set points of Reactor Protection System interlocks)

Question does not meet the K/A due to not predicting the impacts on the RPS.

Question is Unsatisfactory due to K/A mismatch.

1/26/16 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A SYS039 A2.03 87 H 2 X X B E Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.

Please explain why it is required to secure feeding the A steam generator as stated in the first part question stem.

Discussing transitioning to E-2 in the second part question stem provides a cue to the first part question and does not affect the answer. Indications of the faulted steam generator are provided in the initial conditions. Should just ask IAW the given conditions and E-3.

12/22/15 - Reviewed the revised question.

Based on the given conditions, it appears that the Secondary Integrity Criteria on the foldout page for E-3 are met. This would require a transfer to E-2. Since this is not one of the listed choices, there is no correct answer choice for this question.

1/28/2016 - Revised question is Satisfactory.

K/A SYS076 2.1.7 88 M 2 N S Question is Satisfactory.

K/A SYS078 A2.01 89 H 2 X X N U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.

Need to remove the information in the bullet that states causing IA Header pressure to slowly lower. The applicants should know that a clogged air dryer will cause pressure to lower.

The question does not really appear to be operational valid. We need to discuss the normal lineup of the instrument air system and how we would get in the situation proposed by the question.

The question does not really test the K/A, but can be pretty easily fixed. We can discuss.

Will need the appropriate IAW statement added to the question stem. Also, need to word question with regard to the fact that the use of attachment 2 or 3 is in a step that is based on order of preference.

12/22/15 - Reviewed the revised question.

Question is now Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A SYS103 G2.4.35 90 H 2 X X N U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.

This does not appear to meet the intent of the K/A. It seems to meet more of the RCP K/A than the type of topics listed for the Containment system.

This does not appear to be an SRO only question. It does not have procedure selection and could be answered with RO knowledge.

Based on a review of your procedures, this could be a very hard K/A to satisfy at the SRO only level. We can discuss randomly selecting another K/A.

K/A SYS103 2.4.41 Revised question is Unsatisfactory due to LOD = 1. The correct answer choice (both halves) is so strong and self-explanatory that it makes the question provide no discriminatory value.

1/26/16 - Revised question is Satisfactory.

K/A SYS015 A2.04 91 H 2 X N E The bullet in the initial conditions that states that the crew lowered reactor power IAW AOP-101 needs to be more specific as to what the current reactor power is. It could be argued that if the crew lowered power IAW AOP-001, then it would be less than or equal to 50% and no further reduction would be required.

It would probably be more clear just to ask whether the CRS is or is not required to direct a power reduction to less than or equal to 50%

in accordance with AOP-001 Attachment 1 for the second part question.

1/26/16 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A SYS068 A2.02 92 F 2 X M E Need a copy of EMP-006 to complete review of this question. Your lesson plan states that Chemistry does the sample and then provides the permit. Is determining whether or not the pH is acceptable an SRO job function?

Operations representative (John Little) states that this is SRO job function because the SRO/Shift Manager is required to review and approve the report.

1/28/2016 - Revised question is Satisfactory.

K/A SYS071 2.4.21 93 F 2 M E Need a copy of PLP-100 to complete review of this question. This procedure is not listed in the index provided.

1/28/2016 - Revised question is Satisfactory.

K/A G2.1.45 94 H 2 N S Question is Satisfactory.

K/A G2.2.21 95 H 2 X X N E Choices B(2) and C(2) are not plausible. It is not operationally valid to ask for greater than one hour TS completion times without a reference.

1/29/2016 - Revised question is Satisfactory K/A G2.2.36 96 H 2 X X N E Choices A(2) and C(2) are not plausible. It is not operationally valid to ask for greater than one hour TS completion times without a reference.

1/29/2016 - Revised question is Satisfactory.

K/A G2.3.12 97 H 2 X B E There may be two correct answers to this question. OMM-001-2 doesnt really state that the RC Supervisor cannot grant access during EOPs, it just describes how he will do it during normal operations.

1/28/2016 - Revised question is Satisfactory.

K/A G2.3.14 98 H 2 N S Question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A G2.4.30 99 H 2 X M E Need a copy of AP-030 to complete review of this question.

Licensee is changing leakrate and adding EAL reference.

2/3/16 - Revised question is Satisfactory K/A G2.4.46 100 H 2 X N E The bullet for Total calculated B RCP #1 seal leakoff flow: 6.5 gpm is misleading. We need to discuss this.

1/29/2016 - Revised question is Satisfactory Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
3. Check the appropriate box if a psychometric flaw is identified:
  • The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
  • The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
  • The answer choices are a collection of unrelated true/false statements.
  • The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
  • One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
4. Check the appropriate box if a job content error is identified:
  • The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
  • The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
  • The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
  • The question requires reverse logic or application compared to the job requirements.
5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
7. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
8. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).

ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Facility: Date of Exam: Exam Level: RD SRQ Item Description Initials a b c

1. Clean answer sheets copied before grading 1li &
2. Answer key changes and question deletions justified and documented
3. Applicants scores checked for addition errors U A (reviewers spot check> 25% of examinations) ,
4. Grading for all borderline cases (80 +/-2% overall and 70 or 80, All as applicable, +/-4% on the SRO-only) reviewed in detail %i 1.ifr
5. All other failing examinations checked to ensure that grades are justified z j
6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of 41 7/

questions missed by half or more of the applicants Printed Name/Signature Date

a. Grader
b. Facility Reviewer(*)
c. NRC Chief Examiner (*) *f .

03/i)!

d. NRC Supervisor (*) 3/Z2J!

(*) The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-403, Page 6 of 6

Examination Preparation Checklist Form ES-20J-J ES-207 Date of Examination: 2/01/2016 Facility: Robinson NRC /1 Operating Facility x NRC Developed by: Written: Facility x Target Task Description (Reference) Examiners Date Initials 8/5/2015

-180 1. Examination administration date confirmed (Cia; C.2.a and b) 9/4/2015

-lC 2. NRC examiners and facility contact assigned (C.1.d; C.2.e) 9/4/2015

-150 3. Facility contact briefed on security and other requirements (C.2.c) 9/4/2015

-150 4. Corporate notification letter sent (C.2.d)

N/A

[-i 5. Reference material due (C.1.e; C.3.c; Attachment 3)

ES-301 -1, 11/3/2015 f- 1 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-401N-3, ES-301-2, ES-301-5, ES-D-1, ES-401-1/2, ES-401N-i/2, ES-401-3, ES-401-4, and ES-401N-4, as applicable (C.1.e and f; C.3.d) facility licensee 11/8/2015

{-j 7. Examination outline(s) reviewed by NRC and feedback provided to (C.2.h; C.3.e) ios, as 1213/2015 f- .( 8. Proposed examinations (including written, walk-through JPMs, and scenar ES-301-4, ES applicable), supporting documentation (including Forms ES-301-3, ES-201-3, 301-5, ES-301-6, and ES-401-6, ES-401N-6, and any Form ES-201-2, f, and h; ES-301-1, or ES-301-2 updates), and reference materials due (C.1.e, g C.3.d) 12/18/2015

-45 9. Written exam and operating test reviews completed. (C.3.f)

ES-202) 1/2/2016

-30 1 . Preliminary license applications (NRC Form 398s) due (C.i.l; C.2.g; (C.2.h; C.3.f) 1/28/2016

-21 1 . Examination approved by NRC supervisor for facility licensee review 1/28/2016

-21 t. Examinations reviewed with facility licensee (Cli; C.2.f and h; C.3.g)

ES-202) 1/18/2016

-14 1. Final license applications due and Form ES-201-4 prepared (C.1 .1; C.2.i; isor (C.2.i; 2/11/2016

-14 1 . Written examinations and operating tests approved by NRC superv C.3.h) 1/28/16 on the 2/11/2016

-7 15. Facility licensee management queried regarding the licensees views examination. fC.2 j) 1/28/16 1/29/2016

-7 1 . Final applications reviewed; 1 or 2 (if >10) applications audited to confirm sent fC.2.i; qualifications / eligibility; and examination approval and waiver letters Attachments; ES-202, C.2.e; ES-204) facility licensee 2/11/2016

-7 17. Proctoring/written exam administration guidelines reviewed with (C.3.k) to NRC 1/28/2016

-7 1 . Approved scenarios, job performance measures, and questions distributed examiners (C.3.i) ations and are keyed to the examination date Target dates are generally based on facility-prepared examin ate notification letter. They are for plannin g purposes and may be adjusted on a case-by identified in the corpor case basis in coordination with the facility license e.

by the NRC.

[Applies only] {Does not apply) to examinations prepared

ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility: ROBINSON Date of Examination: FEBRUARY 2016 Item Initials Task Description

1. a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401 or ES-401 N.
b. Assess whether the outline was systematically and randomly prepared in accordance with Section D.1 of ES-401 or ES-401N and whether all KJA categories are appropriately sampled.

T /4 (

c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics. %1 N

%7

d. Assess whether the justifications for deselected or rejected K/A statements are appropriate.
2. a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, and major S transients.

M b. Assess whether there are enough scenario sets (and spares) to test the projected number and u mix of applicants in accordance with the expected crew composition and rotation schedule L without compromising exam integrity, and ensure that each applicant can be tested using at A least one new or significantly modified scenario, that no scenarios are duplicated from the T applicants audit test(s), and that scenarios will not be repeated on subsequent days.

c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative and quantitative criteria specified on Form ES-301-4 and described in Appendix D.
3. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:

(1) the outline(s) contain(s) the required number of control room and in-plant tasks distributed W among the safety functions as specified on the form A (2) task repetition from the last two NRC examinations is within the limits specified on the form L (3) no tasks are duplicated from the applicants audit test(s)

K (4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on T the form.

H R b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:

, (1) the tasks are distributed among the topics as specified on the form U (2) at least one task is new or significantly modified G (3) no more than one task is repeated from the last two NRC Ii H

c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.
4. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections.

G E b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.

c. Ensure that K/A importance ratings (except for R d. Check for duplication and overlap among exam sections.

L e. Check the entire exam for balance of coverage.

f. Assess whether the exam fits the appropriate job level (RD or SRO).
a. Author O(4/5
b. Facility Reviewer (*) 4
c. NRC Chief Examiner (#) 3 i c tT- 9L/23/_?iJ
d. NRC Supervisor .(fl C

/ /

4 1 JVc, Note: # Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

Not applicable for NRC-prepared examination outlines.

ES-201 Examination Outline Quality Checklist Form ES-201-2 (Rev_O1 2316)

Facility: Robinson Date of Examination: 2/2016 Initials Item Task Description h i

1. a. Verify that the outline(s) fit(s) the appropriate model per ES-401 or ES-401 N. C
b. Assess whether the outhne was systematicaily and randomiy prepared in accordance with W Section D.1 of ES-401 or ES-401N and whether au KJA categories are appropriateiy R sampied.

.- c. Assess whether the outhne over-emphasizes any systems, evoiutions, or generic topics. c.

T d. Assess whether the justifications for deselected or rejected K/A statements are E appropriate.

N

2. a. Using Form ES-301 -5, verify that the proposed scenario sets cover the required number of normai evoiutions, instrument and component faiiures, technical specifications, and major transients.

s i b. Assess whether there are enough scenario sets (and spares) to test the projected number M and mix of applicants in accordance with the expected crew composition and rotation scheduie without compromising exam integrity; and ensure that each applicant can be U tested using at least one new or significantly modified scenario, that no scenarios are L duplicated from the appiicants audit test(s), and scenarios wiil not be repeated on A subsequent days.

T c. To the extent possibie, assess whether the outline(s) conform(s) with the quattative and 0 quantitative criteria specified on Form ES-301-4 and described in Appendix D.

R

3. a. Verify that systems waik-through outtne meets the criteria specified on Form ES-301 -2:

(1) the outhne(s) contain(s) the required number of controi room and in-plant tasks, W distributed among the safety functions as specified on the form A

(2) task repetition from the last two NRC examinations is within the hmits specified on L the form, K

(3) no tasks are duplicated from the apptcants audit test(s)

T H (4) the number of new or modified tasks meets or exceeds the minimums specified on the form R

0 (5) the number of aiternate path, iow-power, emergency and RCA tasks meet the criteria on the form.

G b. Verifythatthe administrative outiine meets the criteria specified on Form ES-301-1:

H (1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantiy modified (3) no more than one task is repeated from the last two NRC licensing examinations

c. Determine if there are enough different outhnes to test the projected number and mix of apphcants and ensure that no items are duphcated on subsequent days.
4. a. Assess whether plant-specific priorities (inciuding PRA and iPE insights) are covered in the appropriate exam section.

G b. Assess whether the 10CFR 55.41/43 and 55.45 sampiing is appropriate. L.

c. Ensure that K/A importance ratings (except for piant-specific priorities) are at least 2.5.

E d. Check for duplication and overiap among exam sections.

R

e. Check the entire exam for balance of coverage.

L f. Assess whether the exam fits the appropriate job ievei (RD or SRO).

Printed Name / Signature Date

a. Author i- i/zc ,4
b. Facuiity Reviewer(*)
c. NRC Chief Examiner f#) Da.v ic. /,k7) i
d. NRC Supervisor C NOTE: # independent NRC reviewer initial items in Coiumn c, chief examiner concurrence required.

Not applicabie for NRC-prepared examination outlines NUREG-1021, Revision 10

ES-301 Administrative Topics Outline Form ES-301-1 (Rev_011016)

Facility: HB Robinson Date of Examination: 2/2016 Examination Level: RO Operating Test Number: N16-1 Administrative Topic Type Code* Describe activity to be performed (see Note) 2.1.7 (4.4) Ability to evaluate plant performance Conduct of Operations and make operational judgments based on operating characteristics, D, R reactor behavior, and instrument interpretation.

JPM: Calculate QPTR 2.1.4 (3.3) Knowledge of individual licensed operator Conduct of Operations responsibilities related to shift staffing, such as medical requirements, no-solo N, R operation, maintenance of active license status, 10CFR55, etc.

JPM: Determine License Status 2.2.41 (3.5) Ability to obtain and interpret station Equipment Control electrical and mechanical drawings.

D, P, R JPM: Determine Proper Equipment Boundaries 2.3.7 (3.5) Ability to comply with radiation work Radiation Control permit requirements during normal or abnormal conditions.

N, R JPM: Evaluate Stay Time with Lowered SFP Level NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when 5 are required.

  • Type Codes & Criteria: (C)ontrol room, (0) (S)imulator, (0) or Class(R)oom (4)

(D)irect from bank ( 3 for ROs; 4 for SROs & RO retakes) (2)

(N)ew or (M)odified from bank (> 1) (2)

(P)revious 2 exams ( 1; randomly selected) (1)

NUREG-1021, Revision 10

ES-301 Administrative Topics Outline Form ES-301-1 (Rev_011016)

RO Admin JPM Summary A1a This is a modified Bank JPM. The operator will be told that the plant is operating at 60%

power and that ERFIS is OOS. The operator will be provided with Power Range Excore Nuclear Instrumentation indicated and normalizing detector currents, and directed to manually calculate Quadrant Power Tilt Ratio, and identify whether or not any limitations have been exceeded. The operator will be expected to calculate QPTR in accordance with FMP-007, Quadrant Power Tilt, and identify that Technical Specification LCO 3.2.4, Quadrant Power Tilt Ratio (QPTR), is NOT met.

A1b This is a new JPM. The operator will be told that they are a Licensed Reactor Operator who was assigned to the day shift staff for a special project, and not routinely standing watch in the Control Room. They will be provided with a work history and various qualification dates, and then directed to identify any requirements that must be met prior to the end of the quarter that are required to maintain their license ACTIVE; and any additional requirements that are required to maintain their qualification to stand watch in the Control Room. The operator will be expected to evaluate their work history and identify that four 12-hour shifts must be completed as either the RO or the BOP prior to the end of the quarter to maintain their license ACTIVE, and that an SCBA quantitative and qualitative fit test must be completed prior to standing watch in the Control Room again.

A2 This is a Bank JPM. The operator will be told that the plant is in Mode 1 at 100%,

Charging Pump A suction relief valve CVC-2080 has failed open, and that the operating crew has entered AOP-016, Excessive Primary Plant Leakage, to control the plant. The operator will be provided with the EDPs, and the P&IDs, and directed to use all available resources to identify the pump boundary valves needed to be closed to isolate the leak, and identify the motor breaker to electrically isolate the pump motor.

The operator will be expected to identify that the leak can be isolated by closing three valves; CVC-270, CVC-290 and CVC-291, and that the pump motor can be electrically isolated by opening Breaker 52/34B. This JPM was previously used on the 2014 NRC Exam, randomly selected for use on the 2016 Exam.

A3 This is a new JPM. The operator will be told that a station wide accident has occurred due to an Earthquake, that the plant is in Mode 6 with a full core off-load, that the Spent Fuel Pool level has lowered to 10 feet above the top of the fuel, and has stabilized at this level, and that the crew is implementing AOP-036 (SFP Events). The operator will be provided with an R-5 reading, a dose limit of 25 mrem, and the assignment of a repetitive task within AOP-036 which will require entry into the Spent Fuel Building for 3 minutes, before exiting; and will be directed to estimate how many times the operator can perform this repetitive task before they must be replaced by another operator. The operator will be expected to determine that the dose rate around the Spent Fuel Pool area is 193 mrem/hour and based on this the operator will determine that the repetitive task can be performed 2 times before another operator will need to perform the task.

NUREG-1021, Revision 10

ES-301 Administrative Topics Outline Form ES-301-1 (Rev_011016)

Facility: H B Robinson Date of Examination: 2/2016 Examination Level: SRO Operating Test Number: N16-1 Administrative Topic Type Describe activity to be performed (see Note) Code*

2.1.7 (4.7) Ability to evaluate plant performance and Conduct of Operations make operational judgments based on operating characteristics, reactor D, R behavior, and instrument interpretation.

JPM: Calculate QPTR 2.1.4 (3.8) Knowledge of individual licensed operator Conduct of Operations responsibilities related to shift staffing, such as medical requirements, no-solo N, R operation, maintenance of active license status, 10CFR55, etc.

JPM: Determine License Status 2.2.38 (4.5) Knowledge of conditions and limitations in Equipment Control the facility license.

D, R JPM: Determine if Mode Change is Permissible 2.3.8 (3.7) Ability to approve release permits.

Radiation Control N, R JPM: Approve a Waste Gas Release Permit 2.4.41 (4.4) Knowledge of the emergency action level Emergency Plan thresholds and classifications.

D, R JPM: Emergency Classification NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when 5 are required.

  • Type Codes & Criteria: (C)ontrol room, (0) (S)imulator, (0) or Class(R)oom (5)

(D)irect from bank ( 3 for ROs; 4 for SROs & RO retakes) (3)

(N)ew or (M)odified from bank (> 1) (2)

(P)revious 2 exams ( 1; randomly selected) (0)

NUREG-1021, Revision 10

ES-301 Administrative Topics Outline Form ES-301-1 (Rev_011016)

SRO Admin JPM Summary A1a This is a modified Bank JPM. The operator will be told that the plant is operating at 100% power and that ERFIS is OOS. The operator will be provided with Power Range Excore Nuclear Instrumentation indicated and normalized detector currents, and directed to calculate Quadrant Power Tilt Ratio, identify whether or not any limitations have been exceeded, and if so, what, if any ACTION, is required. The operator will be expected to calculate QPTR in accordance with FMP-007, Quadrant Power Tilt, identify that Technical Specification LCO 3.2.4, Quadrant Power Tilt Ratio (QPTR), is NOT met, and identify that all six ACTIONs (A.1-A.6) must be taken for Condition A of LCO 3.2.4, including the maximum permitted power level of 91.3%.

A1b This is a new JPM. The operator will be told that they are a Licensed Senior Reactor Operator who was assigned to the day shift staff for a special project, and not routinely standing watch in the Control Room. They will be provided with a work history and various qualification dates, and then directed to identify any requirements that must be met prior to the end of the quarter that are required to maintain their license ACTIVE; and any additional requirements that are required to maintain their qualification to stand watch in the Control Room. The operator will be expected to evaluate their work history and identify that four 12-hour shifts must be completed as either the SM, CRS, RO or the BOP prior to the end of the quarter to maintain their license ACTIVE, and that an SCBA quantitative and qualitative fit test must be completed prior to standing watch in the Control Room again.

A2 This is a Bank JPM. The operator will be told that the plant is in Mode 5, returning from a refueling outage, that the RCS temperature is 165°F and there is a bubble in the PZR, and that RHR Loop A is maintaining RCS temperature. The operator will be provided with an Inoperable Equipment List and directed to complete the attached OMM-001-12, MINIMUM EQUIPMENT LIST AND SHIFT RELIEF, Attachment 2, 200°F to 350°F (MODE 4) MEL, that was started on the previous shift and to determine if any Mode 4 restrictions exists. The operator will be expected to complete Attachment 2 and determine that the Mode change cannot occur with current plant conditions, per the attached KEY.

A3 This is a new JPM. The operator will be told that the plant is in Mode 1 at 100% power, and that a Waste Gas Release Permit for the A WGDT has been presented to the Shift Manager for review and approval. The operator will be provided with a WGDT Release Permit and directed to review and approve the Waste Gas Release Permit, or to identify all issues found which would prevent approval. The operator will be expected to review the WGDT Release Permit and identify that it cannot be approved because (1) it has been written for the wrong WGDT and (2) the R14C setpoint is less conservative than required.

A4 This is a Bank JPM. The operator will be given an initial set of plant conditions. The operator will be directed to classify the event in accordance with the Robinson Nuclear Plant Emergency Action Level Matrix. The operator will be expected to declare an ALERT based on HA4.1, Confirmed Security event in a plant Protected Area or notification of either an airborne attack threat or hostile threat within the Owner Controlled Area, within 15 minutes. Then, the operator must prepare an Emergency NUREG-1021, Revision 10

ES-301 Administrative Topics Outline Form ES-301-1 (Rev_011016)

Notification Form for this event in accordance with EPCLA-01 (Emergency Control), also within 15 minutes.

NUREG-1021, Revision 10

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 (REV_011116)

Facility: H B Robinson Date of Examination: 2/2016 Exam Level (circle one): RO (only) / SRO(I) / SRO (U) Operating Test No.: N16-1 Control Room Systems (8 for RO; 7 for SRO-I; 2 or 3 for SRO-U)

Type Code* Safety System / JPM Title Function A. 062 AC Electrical Distribution System [062 A2.08 (3.6/3.4)]

S, P, D, A 6 Operation With High Switchyard Voltage B. 059 Main Feedwater System [059 A4.08 (3.2/2.9)]

S, M, A 4S Transfer From the FRV Bypass Valves to the FRVs C. 007 Pzr Relief Tank/Quench Tank System [007 A1.01 (2.9/3.1)]

S, D, A 5 Restore PRT to Normal Operating Conditions D. 001 Control Rod Drive System [001 A1.06 (4.1/4.4)]

S, N, A, L 1 Reactor Startup with Ejected Control Rod E. 011 Large Break LOCA [EPE 011 EA1.11 (4.2/4.2)]

S, D, A, EN 3 Transfer to Long Term Recirculation F. 006 Emergency Core Cooling System [006 A4.02 (4.0/3.8)]

S, P, D, EN 2 Fill a Safety Injection Accumulator G. 015 Nuclear Instrumentation System [015 A4.03 (3.8/3.9)]

S, D, L 7 Remove Source Range Channel N-31 From Service H. 003 Reactor Coolant Pump System [003 A4.03 (2.8/2.5)]

S, D, L 4P Start a Reactor Coolant Pump In-Plant Systems@ (3 for RO; 3 for SRO-I; 3 or 2 for SRO-U)

I. APE 055 Loss of Offsite and Onsite Power [EPE 055 EA2.01 (3.4/3.7)]

D, P, E 6 Locally Establish AFW Flow from the SDAFW Pump and Control S/G Levels and Pressures J. 065 Loss of Instrument Air [065 AA1.04 (3.5/3.4)]

D, R, E 8 Respond to a Loss of Instrument Air K. APE 062 Loss of Service Water [APE 062 AA2.01 (2.9/3.5)]

D, R, E 4S Loss of North SW Header in the Auxiliary Building NUREG-1021, Revision 10

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 (REV_011116)

@ All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

  • Type Codes Criteria for RO / SRO-I / SRO-U (A)lternate path 4-6 (5) /4-6 (5) / 2-3 (3)

(C)ontrol room (D)irect from bank 9 (9) / 8 (8) / 4 (4)

(E)mergency or abnormal in-plant 1 (3) / 1 (3) / 1 (2)

(EN)gineered Safety Feature 1 (2) / 1 (2)/ 1 (2) (Control Room System)

(L)ow-Power / Shutdown 1 (3) / 1 (2) / 1 (1)

(N)ew or (M)odified from bank including 1(A) 2 (2) / 2 (2) / 1 (1)

(P)revious 2 exams 3 (3) / 3 (3)/ 2 (2) (Randomly Selected)

(R)CA 1 (2 )/ 1 (2) / 1 (1)

(S)imulator JPM Summary JPM A This is a Bank JPM. The operator will be told that the plant is at 100% power, that due to abnormal conditions on the Grid, 480V Bus E-2 currently has exceeded 505 volts, that AOP-031, Operation with High Switchyard Voltage, has been completed up to step 21, and other preliminary information. The operator will be directed to continue with AOP-031 until 480V Bus E-2 voltage is restored to less than 505 Volts. The operator will be expected to transfer 4KV Bus 4 & 5 from the UAT to the SUT (via 4KV Bus 3) in an effort to lower Switchyard Voltage; and when Breaker 50/20 fails to automatically OPEN (Alternate Path), the operator will manually open it per AOP-31. This JPM was previously used on the 2013 NRC Exam, randomly selected for use on the 2016 Exam.

JPM B This is a modified Bank JPM. The operator will be told that a plant startup is in progress with reactor power approximately 18%, that the A and B S/G levels are being controlled with the Feedwater Regulating Valves operating in AUTO, and that the C S/G level is being controlled on the Feedwater Regulating Bypass Valve. The operator will be directed to transfer the C S/G level control to the Main Feedwater Regulating Valve in accordance with Step 6.4.12 of GP-005, Power Operation. The operator will be expected to place the C Feed Reg Valve in AUTO, and then take manual control of the B Feed Reg Valve and stabilize the B S/G level (Alternate Path) when it is determined that the B Feed Reg Valve has failed to control the B S/G level in AUTO.

JPM C This is a Bank JPM The operator will be told that the plant is at 100% power, that APP-003-D3, PRT HI/LO LEVEL, has alarmed, that the cause of the low level is known leakage from the PRT to the RCDT, and that the PRT level is stable at 67%. The operator will be directed to restore PRT level to normal IAW OP-103, Pressurizer Relief Tank Control System. The operator will be expected to refill the PRT in accordance with Section 8.2.2 of OP-103; and then diagnose and relieve the hydraulic lock on RC-519B (Alternate Path) in accordance with Section 8.4.1 of OP-103.

JPM D This is a New JPM. The operator will be told that the plant is stabilized at 2% power, that the RCS is at normal operating temperature and pressure, and that a plant startup is in progress IAW GP-003, Normal Plant Startup From Hot Shutdown to Critical, and complete through Step 8.4.7. They will also be told that they are the OATC, and that the NUREG-1021, Revision 10

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 (REV_011116)

BOP is temporarily outside the Control Room. The operator will be directed to pull control rods to stabilize reactor power between 3-5% by continuing with Step 8.4.8 of GP-003. The operator will start to raise reactor power to 3-5%. Then, the operator will manually trip the reactor, attempt to manually actuate Safety Injection and manually start SI Pumps in response to an ejected rod (Alternate Path).

JPM E This is a Bank JPM. The operator will be told that a large break LOCA has occurred, and that the plant is currently on Cold Leg Recirculation IAW EOP-ES-1.3, Transfer to Cold Leg Recirculation. The operator will be directed to transfer to Long Term Recirculation IAW EOP-ES-1.4, Transfer to Long Term Recirculation. The operator will be expected to align for Long Term Recirculation per EOP-ES-1.4, and align only the B RHR Pump for operation when it is determined that SI-863A has failed to OPEN (Alternate Path).

JPM F This is a Bank JPM. The operator will be told that the plant is at 100% power, that the SI ACCUM C HI/LO LVL (APP-002-E4) alarm has been received and actions have been reviewed by the RO, that OP-202, Section 5.2.1.1 Initial Conditions have been completed, and other preliminary information. The operator will be directed to fill SI Accumulator C to reset the low level alarm IAW OP-202, Section 5.2.1. The operator will be expected to refill SI Accumulator C to reset the low level alarm without exceeding specified limits. This was previously used on the 2013 NRC Exam, randomly selected for use on the 2016 Exam.

JPM G This is a Bank JPM. The operator will be told that the plant is shutdown 36 hours4.166667e-4 days <br />0.01 hours <br />5.952381e-5 weeks <br />1.3698e-5 months <br /> after a trip from 100% power, and that SR Channel N-31 has just failed low. The operator will be directed to remove SR Channel N-31 from service IAW OWP-011, Nuclear Instrumentation. The operator will be expected to remove SR Channel N-31 from service IAW NI-5 of OWP-011.

JPM H This is a Bank JPM. The operator will be told that the plant is shutdown at normal operating temperature and pressure, that the B RCP was stopped 7 hours8.101852e-5 days <br />0.00194 hours <br />1.157407e-5 weeks <br />2.6635e-6 months <br /> earlier for motor inspection, that Section 8.1 of OP-101, Reactor Coolant System and Reactor Coolant Pump Startup and Operation, has been completed through Step 8.1.1.2.y in preparation for starting the Reactor Coolant Pump, and that it is intended to bypass the Degraded Grid Protection prior to the RCP start and return it to service after the RCP is started per OP-101, and an AO is standing by to assist in this process. The operator will be directed to start the B Reactor Coolant Pump by continuing with Step 8.1.1.2.z of OP-101. The operator will be expected to start the B RCP IAW OP-101.

JPM I This is a Bank JPM. The operator will be told that the Plant has experienced a loss of onsite and offsite power, that EOP-ECA-0.0, Loss of All AC Power, has been implemented, that Wide Range levels in all three SGs are 55%, that Steam Generator pressures are 1075 psig, and that the SDAFW Pump has just been started. The operator will be directed to locally perform Attachment 4, Local Control Of S/G Level And Pressure, of EOP-ECA-0.0. The operator will be expected to control AFW flow to the Steam Generators and align the Nitrogen System to the SG PORVs IAW Attachment 4 of EOP-ECA-0.0. This was previously used on the 2014 NRC Exam, randomly selected for use on the 2016 Exam.

JPM J This is a Bank JPM. The operator will be told that the IA Header Pressure is 75 PSIG and lowering, that AOP-017, Loss Of Instrument Air, has been entered, that the Station NUREG-1021, Revision 10

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 (REV_011116)

Air Compressor is under clearance and disassembled, and that the Station Air Receiver is depressurized and vented. The operator will be directed to perform AOP-017 Step 8.

The operator will be expected to start IA Compressors A and B and align their discharge to supply air to the Instrument Air Header in accordance with Step 8 of AOP-017.

JPM K This is a Bank JPM. The operator will be told that the plant is at 100% power, that the North SW header has ruptured inside the Auxiliary Building, and that the Control Room has implemented AOP-022 (Loss of Service Water) for a leak in the North header. The operator will be directed to perform the local subsequent actions IAW Attachment 6 of AOP-022. The operator will be expected to isolate the intact SW header from the ruptured header, isolate the leak, and align cooling water to critical loads IAW Attachment 6 of AP-022.

NUREG-1021, Revision 10

ES-301 Operating Test Quality Checklist Form ES-301 -3 (Rev_O1 2316)

Facility: Robinson Date of 2/2016 Operating Test Number: N 16-1 Examination:

nftials

1. GENERALCRITERIA b*

a c#

a. The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g. 10 CFR 55.45, operational importance, safety function distribution).
b. There is no day-to-day repetition between this and other operating tests to be administered during this examination. .
c. The operating test shall not duplicate items from the applicants audit test(s) (see Section D.1.a).
d. Overlap with the written examination and between different parts of the operating test is within acceptable limits.
e. It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license level.
2. WALK-THROUGH CRITERIA - -
a. Each JPM includes the following, as applicable:

initial conditions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee /

C operationally important specific performance criteria that include:

- detailed expected actions with exact criteria and nomenclature

- system response and other examiner cues

- statements describing important observations to be made by the applicant

- criteria for successful completion of the task

- identification of critical steps and their associated performance standards

- restrictions on the sequence of steps, if applicable

b. Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301 -1 and 2) have not caused the test to deviate from t._

any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2. =

3. SIMULATOR CRITERIA - -

The associated simulator operating tests (scenario sets) have been reviewed in accordance ç with Form ES-301 -4 and a copy is attached.

Printed Name I Signature Date

a. Author ifi /iC
b. Facility Reviewer f*)
c. NRC Chief Examiner (#) ) roj e? tL.... i/ Z711 c U. NRC Supervisor

(

NOTE:

  • The facility signature is not applicable for NRC-developed tests.
  1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

NUREG-1021, Revision 10

4 ES-301 Simulator Scenario Quality Checklist Form ES-301 -4 (Rev_O1 2316) 2/2016 Scenario Numbers: 1, 2,3 Operating Test No.: N16-1 Facility: Robinson Date of Exam:

Initials QUALITATIVE ATTRIBUTES a b* c#

1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events. t_-
2. The scenarios consist mostly of related events. a.
3. Each event description consists of

. the point in the scenario when it is to be initiated

. the malfunction(s) or conditions that are entered to initiate the event

. the symptoms/cues that will be visible to the crew

. the expected operator actions (by shift position)

. the event termination point (if applicable)

4. The events are valid with regard to physics and thermodynamics. C.
5. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.
6. If time compression techniques are used, the scenario summary clearly so indicates. Operators have sufficient time to carry out expected activities without undue time constraints. Cues are t.. \

given.

7. The simulator modeling is not altered.
8. The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure t that functional fidelity is maintained while running the planned scenarios.
9. Every operator will be evaluated using at least one new or significantly modified scenario. All other scenarios have been altered in accordance with Section D.5 of ES-301.
10. All individual operator competencies can be evaluated, as verified using Form ES-301 -6 (submit ttL the form along with the simulator scenarios).
11. The scenario set provides the opportunity for each applicant to be evaluated in each of the applicable rating factors. (Competency Rating factors as described on forms ES-303-1 and ES-303-3.)
12. Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).

L

13. The level of difficulty is appropriate to support licensing decisions for each crew position.

Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes -

1 2 3

1. Malfunctions after EOP entry (1-2) 1 2 2
2. Abnormal events (2-4) 4 4 5
3. Major transients (1-2) 1 1 1
4. EOPs entered/requiring substantive actions (1-2) 2 2 1
5. EOP contingencies requiring substantive actions (0-2) 0 1 1
6. Critical tasks (2-3) 3 3 2 NOTE:
  • The facility signature is not applicable for NRC-developed tests.
  1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

NUREG-1021, Revision 10

ES-301 Simulator Scenario Quality Checklist Form ES-301-4 (Rev_012316)

Robinson Date of Exam: 2/2016 Scenario Numbers: 4, 5,6 Operating Test No.: N16-1 Facility:

Initials QUALITATIVE ATTRIBUTES a b* c#

1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events. t (j
2. The scenarios consist mostly of related events. c...
3. Each event description consists of

. the point in the scenario when it is to be initiated

. the malfunction(s) or conditions that are entered to initiate the event

. the symptoms/cues that will be visible to the crew ct.

. the expected operator actions (by shift position)

. the event termination point (if applicable)

4. The events are valid with regard to physics and thermodynamics. _
5. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.
6. If time compression techniques are used, the scenario summary clearly so indicates. Operators have sufficient time to carry out expected activities without undue time constraints. Cues are given. cO
7. The simulator modeling is not altered. L..
8. The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios. U
9. Every operator will be evaluated using at least one new or significantly modified scenario. All other scenarios have been altered in accordance with Section D.5 of ES-301.
10. All individual operator competencies can be evaluated, as verified using Form ES-301 -6 (submit the form along with the simulator scenarios).

1 1. The scenario set provides the opportunity for each applicant to be evaluated in each of the applicable rating factors. (Competency Rating factors as described on forms ES-303-1 and ES- .

303-3.)

12. Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301 -5 (submit the form with the simulator scenarios).
13. The level of difficulty is appropriate to support licensing decisions for each crew position.

Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes - -

4 5 6

1. Malfunctions after EOP entry (1-2) 1 1 3
2. Abnormal events (2-4) 4 3 4
3. Major transients (1-2) 2 1 1
4. EOPs entered/requiring substantive actions (1-2) 2 2 2
5. EOP contingencies requiring substantive actions (0-2) 1 1 7
6. Critical tasks (2-3) 2 2 2 NOTE:
  • The facility signature is not applicable for NRC-developed tests.
  1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

NUREG-1021, Revision 10

ES-301 Transient and Event Checklist Form ES-301-5 (Rev_Of 2516)

Facility: Robinson Date of Exam: 2/2016 Operating Test No.: N16-1 A E Scenarios P V N16-1-1 N16-1-2 N16-1-3 N16-1-6 T M P F 0 I L N T N CREW CREW CREW CREW I T POSITION POSITION POSITION A I POSITION C L M A I u N Y T P S A B S A B S A B S A B R I U E R T 0 R T 0 R T 0 R T 0 0 C P 0 C P 0 C P 0 C P RX 1 1 1 0 2

NOR 2 1 1 1 1,2, 1,4, 1,3, 17 4 4 2 SROI-l I/C 5 6 6 6 MA] 3 2 2 1 1,2 TS 2 0 2 2 2

RX 7 1 1 0 1,3 1 NOR 3 1 1 1 2,4, 2,3, 4,5 9 4 4 2 SROI-3 I/C 6 6 6 MA] 3 2 2 1 TS 2 0 2 2 1

RX 1 1 1 0 3 2 NOR 2 1 1 1 2,4, 1,2, 1,3, 12 4 4 2 SROI-5 I/C 8,9 4,5 7,9 6 6 6 MA] 2 2 1 1,5 TS 2 0 2 2 2

RX 1 1 1 0 1 3 NOR 2 1 1 1 3,5 1,2, 4 4 2 SROI-6 I/C 8 6 6 6 MA] 3 2 2 1 1,5 TS 2 0 2 2 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers tor each event type; TS are not applicable for RO applicants. ROs must service in both the at-the-controls (ATC) and balance-ot-plant (BOP) positions; Instant SROs (SRO-l) must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one malor transient, in the ATC position. If an Instant SRO-l additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix 0. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.
3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

For licensees that use the ATC operator pnmahly for monitoring plant parameters, the chief examiner may place SRO-l applicants in either the ATC or

  • BOP position to best evaluate the SRO-l in manipulating plant controls.

NUREG 1021 Revision 10

ES-301 Transient and Event Checklist Form ES-301-5 (Rev_O1 2516)

Facility: Robinson Date of Exam: 2/2016 Operating Test No.: N16-7 A E Scenarios P V N16-1-1 N16-1-2 N16-l-3 N16-1-6 T M P E 0 L N T N CREW CREW CREW CREW T POSITION POSITION A I POSITION POSITION C L M A T U N Y T P S A B S A B S A B S A B R I U E R T 0 R T 0 R T 0 R T 0 0 C P 0 C P 0 CPO C P RX 2 1 1 1 0 1

NOR 2 1 1 1 3,5 1,2, SROI-7 I/C 8 4 4 2 MAJ 6 6 6 3 2 2 1 1,5 TS 2 0 2 2 RX 1 1 1 0 1,3 2 NOR 3 1 1 1 2,4, 1,4, 1,3, SROI-8 I/C 4,5 10 4 4 2 6 6 6 MAJ 3 2 2 1 IS 2 0 2 2 RX 7 1 1 0 1,3 2 NOR 3 1 1 1 2,4, 1,4, 1,3, SROI-9 I/C 10 4 4 2 6 6 6 MAJ 3 2 2 1 Is 2 0 2 2 RX 1 1 1 0 NOR 1 1 1 1 1,4, 1,2, RO-1 4 4 2 I/C 6 6 6 MAJ 2 2 2 1 TS 0 0 2 2 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must service in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SRO5 (SRO-l) must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO-l additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. () Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.
3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

For licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-l applicants in either the ATC or GOP position to best evaluate the SRO-l in manipulating plant controls.

NUREG 1021 Revision 10

ES-301 Transient and Event Checklist Form ES-301 -5 (Rev_O1 2576)

Facility: Robinson Date of Exam: 2/2016 Operating Test No.: N16-1 A E Scenarios P V N16-f-1 N16-1-2 N16-l-3 N16-l-6 T M P E 0 I L N CREW T N CREW CREW CREW I T POSITION POSITION POSITION POSITION A I C L M A I u N Y T P 5 A B S A B S A B S A B R I U E A 1 0 A 1 0 R 1 0 R 1 0 0 C P 0 C P 0 C P 0 C P 1 1 1 1 0 RX NOR 1 1 1 1 2.4, 1,2, 7 4 4 2 8, 9 7 RO-2 I/C 6 6 2 2 2 1 MAJ TS 0 0 2 2 1 1 1 1 0 RX NOR 1 1 1 24, 1,2, 2 7 4 4

8. 9 7 RO-3 I/C 6 6 2 2 2 1 MAJ Is 0 0 2 2 RX 1 1 1 0 1 1 1 1 1 NOR 1,5 4 4 4 2 RO-4 I/C 6 6 2 2 2 1 MA]

TS 0 0 2 2 RX 0 1 1 0 2 2 1 1 1 NOR 1,2, 1,3, 4 4 2 SROU-1 I/C 4.5 8 6 6 2 2 2 1 MAJ 1,2 4 0 2 2 TS Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must service in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SRO5 (SAC-I) must serve in both the SAC and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position, If an Instant SRO-l additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. () Reactivity snd normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.
3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

For licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-l applicants in either the ATC or SOP position to best evaluate the SAC-I in manipulating plant controls.

NUREG 1021 Revision 10

ES-3d Transient and Event Checklist Form ES-301-5 (Rev_012516)

Facility: Robinson Date of Exam: 2/207 6 Operating Test No.: N16-1 A F Scenarios P V N16-1-1 N16-1-2 N16-1-6 N16-1-5 I M P F 0 I L N T N CREW CREW CREW CREW I T POSITION POSITION POSITION POSITION A C L M A T u N Y T P S A B S A B S A B S A B A I U E R T 0 R T 0 R T 0 A T 0 0 C P 0 C P 0 C P 0 C P AX 0 1 1 0 1

NOR 2 1 1 1 1,2, 2,3, 4.5 8 4 4 2 SROU-2 I/C 45 6 6 2 2 2 1 MAJ 1,2 4 2 TS 0 2 RX 7 1 1 0 1 1 NOR 2 1 1 7 1,5 2,3, 2,3 8 4 4 2 SROI-2 I/C 45 6 6 6 1 MAJ 3 2 2 TS 2 0 2 2 1

RX 7 1 1 0 1 2 NOR 2 1 1 7 2,3, 1,3, 4,5, 4,5 7,9 7 4 4 2 SROI-4 I/C 6 6 6 3 2 1 MA] 2 TS 2 0 2 2 RX 1 1 0 NOR 1 1 1 4 4 2 I/C MAJ 2 2 1 TS 0 2 2 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable tor RO applicants. ROs must service in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SROs (SRO-l) must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO-l additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. () Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-I basis.

3 Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

For licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-I applicants in either the ATC or BOP position to best evaluate the SRO-l in manipulating plant controls.

NUREG 1021 Revision 10

ES-3D 1 Competencies Checklist Form ES-3D 1-6 (Rev_Of 2376)

Facility: Robinson Date of Examination: 2/2016 Operating Test No.: N16-1 APPLICANTS SRO (U/I) RO/ATC BOP Competencies SCENARIO SCENARIO SCENARIO 1 2 3 4 1 2 3 4 1 2 3 4 I nterpret/Diag nose Events and 1-7 1-9 1-8 1-9 1-7 1-9 1-8 1-9 1-7 1-9 1-8 1-9 Conditions Comply With and Use 1-7 1-9 1-8 1-7 1-7 1-9 1-8 1-9 1-7 1-9 1-8 1-9 Procedures (1)

Operate Control 2,4, 1 2 1 3 1 2 1 2 1 2 Boards (2) NA NA NA NA 4,6, 4:5: 3:7: 3,4, 3:6:

6 7 8,9 6 9 6,7 Communicate and 1-7 1-9 1-8 1-9 1-7 1-9 1-8 1-9 1-7 1-9 1-8 1-9 Interact Demonstrate Supervisory Ability 1-7 1-9 1-8 1-9 NA NA NA NA NA NA NA NA (3)

Comply With and Use 1-2 3-4 1,5 4-5 NA NA NA NA NA NA NA NA Tech. Specs. (3)

Notes:

(1) Includes Technical Specification compliance for RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant. (This includes all rating factors for each competency.) (Competency Rating factors as described on forms ES-303-1 and ES-303-3.)

NUREG-1021, Revision 10

ES-301 Competencies Checklist Form ES-301 -6 (Rev 012316)

Facility: Robinson Date of Examination: 2/2016 Operating Test No.: N16-1 APPLICANTS SRO (U/I) RO/ATC BOP Competencies SCENARIO SCENARIO SCENARIO 5 6 5 6 5 6 Interpret/Diagnose Events and 1-7 1-9 1-7 1-9 1-7 1-9 Conditions Comply With and Use 1-7 1-9 1-7 1-9 1-7 1-9 Procedures (1)

Operate Control 1,4, 1,2, 24 12 Boards (2) NA NA 5,6, 3,6, 56 36 Communicate and 1-7 1-9 1-7 1-9 1-7 1-9 Interact Demonstrate Supervisory Ability 1-7 1-9 NA NA NA NA (3)

Comply With and Use NA NA NA NA 3,5 3-4 Tech. Specs. (3)

Notes:

(1) Includes Technical Specification compliance for RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant. (This includes all rating factors for each competency.) (Competency Rating factors as described on forms ES-303-1 and ES-303-3.)

NUREG-1021, Revision 10

ES-401 PWR Examination Outline Form ES-401-2 Facility: ROBNSON Date of Exam: FEBRUARY 2016 ROK/ACatpoPah-its SRO-Only_Points Tier Group KKKKKKAAAAG A2 G* Total 1 2 3 4 5 6 1 2 3 4

  • Total
1. 1 3 3 3 3 3 3 18 3 3 6 Emergency &

Abnormal 2 .1 .2_ N/A 1 2 N/A 1 9 2 2 4 Evolutions Tier Totals 4 5 5 4 5 4 27 5 5 10 1 33223223332 28 3 2 5 2.

Plant 2 111111110 ii 10 0 2 1 3 Systems Tier Totals 4 4 3 3 4 3 3 4 3 4 3 38 5 3 8

3. Generic Knowledge and AbUities Categories 1L2]3J 4] io [N 1 2 3 j 4 7 3 2 2 3 ftl 2 2 2 Note: 1. Ensure that at least two topics from every applicable K/A category are sampled within each tier of the RO and SRO-only outlines (i.e., except for one category in Tier 3 of the SRO-only outline, the Tier Totals in each K/A category shall not be less than two). (One Tier 3 Radiation Control K/A is allowed if the K/A is replaced by a K/A from another Tier 3 Category).
2. The point total for each group and tier in the proposed outline must match that specified in the table. The final point total for each group and tier may deviate by +/-1 from that specified in the table based on NRC revisions. The final RO exam must total 75 points and the SRO-only exam must total 25 points.
3. Systems/evolutions within each group are identified on the associated outline; systems or evolutions that do not apply at the facility should be deleted with justification; operationally important, site-specific systems/evolutions that are not included on the outline should be added. Refer to Section D.1 .b of ES-401 for guidance regarding the elimination of inappropriate K/A statements.
4. Select topics from as many systems and evolutions as possible; sample every system or evolution in the group before selecting a second topic for any system or evolution.
5. Absent a plant-specific priority, only those K/As having an importance rating (IR) of 2.5 or higher shall be selected. Use the RO and SRO ratings for the RO and SRO-only portions, respectively.
6. Select SRO topics for Tiers 1 and 2 from the shaded systems and K/A categories.
7. The generic (G) K/As in Tiers I and 2 shall be selected from Section 2 of the K/A Catalog, but the topics must be relevant to the applicable evolution or system. Refer to Section D.1 .b of ES-401 for the applicable K/As.
8. On the following pages, enter the K/A numbers, a brief description of each topic, the topics importance ratings (IRs) for the applicable license level, and the point totals (#) for each system and category. Enter the group and tier totals for each category in the table above; if fuel handling equipment is sampled in a category other than Category A2 or G on the SRO-only exam, enter it on the left side of Column A2 for Tier 2, Group 2 (Note #1 does not apply). Use duplicate pages for RO and SRO-only exams.
9. For Tier 3, select topics from Section 2 of the K/A catalog, and enter the K/A numbers, descriptions, IRs, and point totals f#) on Form ES4OI-3. Limit SRO selections to K/As that are linked to 10 CFR 55.43.

G* Generic K/As

ES-401, REV 9 TIGI PWR EXAMINATION OUTLINE FORM ES-40f-2 KA NAME I SAFETY FUNCTION: IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 007EK2.02 Reactor Trip Stabilization Recovery 2.6 2.8 fl j 1J fl Breakers, relays and disconnects

/1 008AG2. 1.30 Pressurizer Vapor Space Accident / 3 4.4 4.0 DEDüLLJ Ability to locate and operate components, including local controls.

OO9EA1 .10 Small Break LOCA/ 3 3.8 3.9 LELDEL] Safety parameter display system 01 1EK3.15 Large Break LOCA /3 4.3 4.4 LEDE1L1EDDD Criteria for shifting to recirculation mode 022AA2.03 Loss of Rx Coolant Makeup 1 2 3.1 3.6 L]DCEÜEIfl ic1L1L Failures of flow control valve or controller 025AG2.4.47 Loss of RHR System /4 4.2 4.2 Ability to diagnose and recognize trends in an accurate and timely manner utilizing the appropriate control room reference material.

027AK2.03 Pressurizer Pressure Control System 2.6 2.8 ELüDLDE1 Controllers and positioners Malfunction / 3 029EK2.06 ATWS/1 2.9 3.1 Breakers, relays, and disconnects.

038EK1 .04 Steam Gen. Tube Rupture I 3 3.1 3.3 Reflux boiling 040AK1 .05 -

Steam Line Rupture Excessive Heat 4.1 Reactivity effects of cooldown LE1DLJL1EELi Transfer I 4 054AA1 .03 Loss of Main Feedwater / 4 3.5 3.7 AFW auxiliaries, including oil cooling water supply Page 1 of 2 06/22/2015 9:28 AM

ES-401, REV 9 If GI PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION: IR Kl 1(2 K3 1(4 1(5 1(6 Al A2 A3 A4 G TOPIC:

RD SRO 055EK3.02 Station Blackout / 6 4.3 4.6 Actions contained in EOP far loss of offsite and onsite El El 1] El El El El El El El El power 056AA2.1 1 Loss of Off-site Power I 6 2.9 2.9 Operational status of service water booster pump ElEEElElEElElDEl 057AA2fr Loss of Vital AC Inst. Bus / 6 fflVer-&aIteete aur Th 3*7 Y*I P o. C. o4 ot2cfrttCJ Tko.1 . I 058M1 .02 Loss of DC Power / 6 3.1 3.1 Static inverter dc input breaker, ftequency meter, ac CElDElElEElD[1L output breaker and ground fault detector weO4EG2.4.% LOCA Outside Containment /3 4.2 4.2 Ability to verify that the alarms are consistent with the ElElElEElElDLiDEH plant conditions.

WEO5EK3.4 -

Inadequate Heat Transfer Loss of 3.7 3.9 RO ai SRO function within the control room team as EElElDDDElDEEl appropriate to the assigned position, in such a way that Secondary Heat Sink / 4 procedures ate adhered to and the limitations in the facilities license and amendments are not violated.

WE11EK1,1 LossofEmergencyCoolantRecirc.I4 3.7 4.0 El El El El El El El El El El Components, capacity, and function of emergency Systems.

Page 2 of 2 06/22/2015 9:28 AM

ES-401, REV 9 TIG2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION: IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 005AK2.02 lnoperablelstuck Control Rod /1 2.5 2.6 2] 2] 2] 2] 2] 2] 2] 2] 2)) 2] Breakers, relays, disconnects and control room switches 028AK1 .01 Pressurizer Level Malfunction I 2 2.8 3.1 ]J 2] 2] 2] 2] 2] 2] 2] 2] [2] 2] PZR reference leak abnormalities 032AA2.02 Loss of Source Range NI I 7 3.6 3.9 2] 2] 2] 2] 2] 2] 2] 2] 2] 2] Expected change in source range count rate when rods are moved 033AK3.01 Loss of Intermediate Range NI / 7 3.2 3.6 2] 2] [2] 2] 2] 2] 2] [2] 2] 2] Termination of startup following loss of intermediate-range instrumentation 060AK2.01 Accidental Gaseous Radwaste Rel. I 9 2.6 2.9 2] 2] 2] 2] 2] 2] 2] 2] 2] 2] ARM system, including the normal radiation-level indIcations and the operability status 067AA1 .09 Plant Fire On-site / 8 3 3.3 2] 2] 2] 2] 2] [2] [j 2] 2] 12] 2] Plant fire zone panel (including detector location) 068AK3. 12 Control Room Evac. /8 4.1 4,5 2] 2] 2] 2] 2] 2] 2] 2] 2] 2] Required sequence of actions for emergency evacuation of control room 076AA2.04 High Reactor Coolant Activity /9 2.6 3 2)) 2)) 2] 2)) 2] 2] 2] J 2)) [2] 2] Process effluent radiation chart recorder we09EG2. 1.20 Natural Circ. / 4 4.6 4.6 [1. Ability to execute procedure steps.

2] 2] 2] 2] 2] 2] 2] 2] 2] [j Page 1 of 1 06/22/2015 9:28 AM

ES-401, REV 9 T2GI PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION: IR Ki K2 K3 1<4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 003A3.01 Reactor Coolant Pump 3.3 3.2 fl ?1 [] Seal injection flow 003K4.07 Reactor Coolant Pump 3.2 3.4 fl fl [J fl EJ J Minimizing RCS leakage (mechanical seals) 004K2.06 Chemical and Volume Control 2.6 2.7 [] (i)] (J [] [] fl fl [] U U U Control instrumentation 005A2.02 Residual Heat Removal 3,5 3.7 tJ U U Pressure transient protection during cold shutdown 005K6.03 Residual Heat Removal 2.5 2.6 U U U U EJ RHR heat exchanger 006A1.13 Emergency Core Cooling 3.5 3.7 U U Li rj U Accumulator pressure (level. boron concentration) 0061<5.01 Emergency Core Cooling 2.8 3.3 U U U [] Effects of temperatures on water level indications 007K3.O1 Pressurizer Relief/Quench Tank 3.3 3.6 U U U U U Li Li Li U Containment 0O8A4e. Component Cooling Water -26L Li tt1gg of-thg CGN-pu,..p dJiorgo :ale fM 33 3,) c.cbJ i4,c&t,b6 o.J o-faU 0101<6.04 Pressurizer Pressure Control 2.9 3.2 U Li Li [1 Li U U U U U PRT 012A3.06 Reactor Protection 3.7 3.7 U Li Li U [1 U Li Li Trip logic fl Page 1 of 3 06/22)2015 9:28 AM

ES-401, REV9 T2GI PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 012K1.05 Reactor Protection 3.8 3.9 ESFAS Li 013K5.02 Engineered Safety Features Actuation 2.9 3.3 LLiI{DLEL Safely system logic and reliability 022A4.04 Containment Cooling 3.1 3.2 Valves in the CCS 026A2.08 Containment Spray 3.2 3.7 Safe securing of containment spray when it can be done)

ELE1L 039A1 .10 Main and Reheat Steam 2.9 3.0 Air ejector PRM 059K4.02 Main Feedwater 3.3 3.5 Automatic turbine/reactor trip runback 061 1(5.01 AuxiliarylEmergency Feedwater 3.6 3.9 Relationship between AFW flow and RCS heat transfer DLLJL1D[1DEüi 062K1 .04 AC Electrical Distribution 3.7 4.2 LDDflLiEE1!ZDE Off-site power sources 062K2.01 AC Electrical Distribution 3.3 Major system loads DDüEiD1 063A3.01 DC Electrical Distribution 2.7 3.1 Meters, annunciators, dials, recorders and indicating lights 064A2.18 Emergency Diesel Generator 2.6 2.7 Consequences of premature opening of breaker under load Page 2 of 3 06122/2015 9:28 AM

ES-401, REV 9 12G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 064K2.02 Emergency Diesel Generator 2.8 3.1 H H .

U H Fuel oil pumps 073A4.O1 Process Radiation Monitoring 3.9 3.9 U H Effluent release 073G2.4.9 Process Radiation Monitoring 3.8 4.2 H LI U Li LI LI H Li Knowledge of low power / shutdown implications in accident (e.g. LOCA or loss of RHR) mitigation strategies.

076K1.15 Service Water 2.5 2.6 j H Li LI LI [J Li LI [1 FPS H LI 078K3.03 Instrument Air 3.0 3.4 Li Ej U] LI LI [J LI LI Cross-fled units 103G2.l.7 Containment 4.4 4.7 Ability to evaluate plant performance and make

[J 4J ] U] U] U] [] U] U] ] operational judgments based on operating characteristics, reactor behavior and instrument interpretation.

Page 3 of 3 06/22)2015 9:28 AM

ES-401, REV 9 T2G2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION: IR KI K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 001K6.13 Control Rod Drive 3.6 3.7 Li Li Li Li LI Li Li LI Li Li Location and operation of RPIS 002K4.0J Reactor Coolant 2.7 3.0 Fl LI Li l Li Li [I Li Li El Li Filling and draining the RCS O1IAI.02 Pressurizer Level Control 3.3 3.5 Li El LI El Li Li LI Li LI LI Charging and letdown flows 014K5.0l Rod Position Indication 2.7 3.0 fl Li J Li Li LI El Li Reasons for differences between RPIS and step counter 017A4.0l In-core Temperature Monitor 3.8 4.1 LI Li Li LI Li [1 Li Li Actual in-core temperatures 027K2.0f Containment Iodine Removal 3.1 3.4 Li [) Li Li E] LI El El Li LI LI Fans 029G2.l.23 Containment Purge 4.3 4.4 Li Li LI Li Li LI Li Li LI El Ability to perform specific system and integrated plant procedures during all modes of plant operation.

033K3.02 Spent Fuel Pool Cooling 2.8 3.2 Li Li J Li Li; LI Li Li LI Li Li Area and ventilation radiation monitoring systems 035A2.05 Steam Generator 3.2 3.4 Li Li Li Li Li Li Li i Li Li Li Unbalanced flows to the 5/Gs 068K1 .07 Liquid Radwaste 2.7 2.9 LI Li LI Li El Li Li LI Li LI Sources of liquid wastes fo LRS Page 1 of 1 06/22)2015 9:28 AM

ES-401, REV 9 T3 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION: IR Ki K2 K3 K4 1(5 1(6 Al A2 A3 A4 G TOPIC:

RO SRO G2.l .29 Conduct of operations 4.1 4.0 LiD LiD [I [I Knowledge of how to conduct system lineups, such as

[I [I [I valves, breakers, switches, etc.

G2.l .36 Conduct of operations 3.0 4.1 Knowledge of procedures and limitations involved in core LiD LiD LI LI Li Li Li [I alterations G2.1.45 Conduct of operations 4.3 4.3 Ability to identity and interpret diverse indications to LiD Li Li F] Li Li Li validate the response of another indication G2.2.38 Equipment Control 3.6 4.5 [IF] LiLi Li Li Li Li LI [I J Knowledge of conditions and limitations in the facility license.

G2.2.39 Equipment Control 3.9 4.5 Knowledge of less than one hour technical specification LiLi ED Li LI Li EJ Li Li j action statements for systems.

G2.3.1 3 Radiation Control 3.4 3.8 Knowledge of radiological safety procedures pertaining to LiE Li Li F] Li [I Li ]

licensed operator duties G2.3.4 Radiation Control 3.2 3.7 Knowledge of radiation exposure limits under normal and LiE LiD Li Li Li Li Li Li emergency conditions G2.4.1 1 Emergency Procedures/Plans 4.0 4.2 Knowledge of abnormal condition procedures.

ELi F] F] LI Li Li Li G2.4.25 Emergency Procedures/Plans 3.3 3.7 LiLi LiE F] F] Knowledge of fire protection procedures.

Li fl [I [I G2.4.31 Emergency Procedures/Plans 4.2 4.1 Knowledge of annunciators alarms, indications or

[I F] Li Li F] Li Li Li Li F] [

response procedures Page 1 of 1 06/22/201 5 9:52 AM

ES-401, REV 9 SRO TIGI PWR EXAMINATION OUTLINE FORM ES4OI-2 KA NAME I SAFETY FUNCTION: IR 1<1 1(2 K3 K4 1(5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 029EA2.06 ATWS / 1 3.8 3.9 j Main turbine trip switch position indication -

038EG2.4.47 Steam Gen. Tube Rupture I 3 4.2 4.2 [] Ability to diagnose and recognize trends in an accurate J []

and timely manner utilizing the appropriate control room reference material.

054AG2.4.9 Loss of Main Feedwater I 4 3.8 4.2 Knowledge of low power! shutdown implications in fl []

accident (e.g. LOCA or loss of RHR) mitigation strategies.

055EA2.06 Station Blackout! 6 3.7 4.1 Faults and lockouts that must be cleared prior to re energizing buses 058AG2.2.22 Loss of DC Power /6 4.0 4.7 L [J J Knowledge of limiting conditions for operations and D fl J safety limits.

077AA2.03 Generator Voltage and Electric Grid 3.5 3.6 Generator current outside the generator capability curve Disturbances / 6

[ [J Page 1 of 1 06/22/2015 9:28 AM

ES-401, REV 9 SRO TIG2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION: IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO OO1AA2.02 Continuous Rod Withdrawal Il 4.2 4.2 U U U U U LI LI Position of emergency boration valve 051AG2.4.35 Loss of Condenser Vacuum /4 3.8 4.0 LI LI fl LI LI H LI LI LI LI Knowledge of local auxiliary operator tasks during emergency and the resultant operational effects 061AA2.03 ARM System Alarms /7 3 3.3 LI LI LI LI LI fl LI LI LI LI Setpoints for alert and high alarms weO6EG2.l.23 Degraded Core Cooling / 4 4.3 4.4 LI LI LI LI [] LI LI LI LI {] Ability to perform specific system and integrated plant procedures during all modes of plant operation.

Page 1 of 1 06/22/2015 9:28 AM

ES-401, REV9 SRO T2GI PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION: IR Kl 1(2 K3 1(4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 01 2A2d.- Reactor Protection IM1VtP.-....

E 2O5 yI 7:- F H) or o ddor.

& &lC.t)e cJo 039A203 Main and Reheat Steam Indications and alarms for main steam and area radiation monitors (during SGTR) 076G2.1.7 Service Water 4.4 4.7 Ability to evaluate plant performance and make EflDEJL1E operational judgments based on operating characteristics, reactor behavior and instrument interpretation.

078A2.01 Instrument Air 2.4 2.9 Air dryer and filter malfunctions 1 03G2.4.35 Containment 3.8 4.0 Knowledge of local auxiliary operator tasks during flD1ELEDD emergency and the resultant operational effects Page 1 of I 06(2212015 9:28 AM

ES-401, REV9 SRO T2G2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION: IR Kl K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:

RO SRO 015A2.04 Nuclear Instrumentation 3.3 3.8 Effects au axial flux density of control rod alignment and sequencing, xenon production and decay, and boron vs.

control rod reactivity changes 068A2.02 Liquid Radwaste 2.7 2.8 EDD L]EEfl Lack of tank recirculation pnor to release 071 G2.4.21 Waste Gas Disposal 4.0 4.6 Knowledge of the parameters and logic used to assess the status of safety functions Page 1 of I 06/22)2015 9:28AM

ES4OI, REV9 SRO T3 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME I SAFETY FUNCTION: IR K1 K2 K3 1<4 K5 K6 Al A2 A3 A4 G Topic:

RO SRO G2.l.45 Conductof operations 4.3 4.3 El El El El El El El El El El i Ability to identify and interpret diverse indications to validate the response of another indication G2.2.21 Equipment Control 2.9 4.1 Knowledge of pre- and post-maintenance operability ElElLElElElElElLEl requirements.

G2.2.36 Equipment Control 3.1 4.2 Ability to analyze the effect of maintenance activities.

ElElElElEElElElElE[

such as degraded power sources, on the status of limiting conditions of operations G2.3.12 Radiation Control 3.2 3.7 Knowledge of radiological safety principles pertaining to ElElDElElElElElElEl licensed operator duties G2.3.14 Radiation Control 3.4 3.8 Knowledge of radiation or contamination hazards that EElElUElDElElElEl may arise during normal, abnormal, or emergency conditions or activities G2.4.30 Emergency Procedures/Plans 2.7 4.1 Knowledge of events related to system operations/status L1ElDElElL]EiElElEl that must be reported to internal orginizations or outside agencies.

G2.4.46 Emergency Procedures/Plans 4.2 4.2 Ability to verify that the alarms are consistent with the E1ElEElDDEElElEl plant conditions.

Page 1 of 1 06/22/2015 9:28 AM

ES-401 Record of Rejected K/A's Form ES-401-4 Randomly Selected Tier / Group Reason for Rejection KA Facility rarely throttles the CCW Pump discharge valves, and when this does occur (During Testing) indications of the action are in the field. Best effort was made to construct question, but it RO 2/1 008 A4.03 did NOT result in a psychometrically sound question (No Plausible Distractors). Replaced with 008 A4.01, randomly chosen by the Chief Examiner.

The AC instrument busses at the facility have no associated alarms in the Control Room, NOR does the alternate power source for those AC instrument busses. The best effort was RO 1/1 057 AA2.06 made to construct a question but it was determined we could not hit this KA. Replaced with 057 AA2.15, randomly chosen by the Chief Examiner.

The incorrect bypassing of a channel at RNP results in a plant trip in most cases. Trying to find an instrument that could be incorrectly bypassed, but not cause a trip, and then write a question to an SRO only level (most of these error scenarios SRO 2/1 012 A2.03 would be RO knowledge) was very difficult and in the attempt that was made, could be tied back to a less than one hour tech spec, and thereby removing the SRO only plausibility. Replaced with 012 A2.05, randomly chosen by the Chief Examiner.

ES4OI Written Examination Quality Checklist Form ES4OI-6 fadifty: Robinson Nudear Plant Date of Exam: 2/1/2016 Exam Level; RD SRO C Initial Item Description a b*

1. Questions and answers are technically accurate and applicable to the faciflty. t-
2. a. NRC K/As are referenced for all questions.
b. Facility learning objectives are referenced as available.
3. SRO questions are appropriate in accordance with Section D.2,d of ES-401
4. The sampling process was random and systematic (If more than 4 RD or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR DL program office).
5. Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item that applies) and appears appropriate:

the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or the examinations were developed independently; or c the ficensee certifies that there is no duplication; or other (explain)

6. Bank use meets limits (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the rest -

new or modified); enter the actual RD I SRQ-only question distribution(s) at right. 1$ / - 5 / 52 / -

7. Between 50 and 60 percent of the questions on the RD Memory C/A exam are written at the comprehension! analysis level; the SRO exam may exceed 60 percent if the randomly L...

selected K/As support the higher cognitive levels; enter the actual RD I SRO question distribution(s) at righi 32 I - 43 / -

8. RelerencesThandouts provided do not give away answers , £_.

or aid in the elimination of distractors.

9. Question content conforms with specific K/A statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; (. ft deviations are justified.
10. Question psychometric quality and format meet the guidelines in ES Appendix B.
11. The exam contains the required number of one-point, multiple choice Items; the total is correct and agrees with the value on the cover sheet.

Printed Name I Signature Date

a. Author Ci(A sSmf,.(
b. Facility Reviewer f)
c. NRC Chief Examiner(#) Doi i). .,d , 2// t6 U. NRCRegionalSupervisor lQi..p&a c

Note:

  • The facility reviewers initials/signature are not applicable br NRC-developed examinations.
  1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

ES4OI Written Examination Quality Checklist Form ES4OI-6 Fadilty: Robinson Nuclear Plant Date of Exam: 2/1/2016 Exam Level: RO SRO ]

Initial Item Description a b* c

1. Questions and answers are technically accurate and applicable to the facility. C- .,,. j,
2. a. NRC K/As are referenced for all questions.
b. Facility learning objectives are referenced as available.
3. SRO questions are appropriate in accordance with Section D.2.d of ES-401 C,.
4. The sampling process was random and systematic (II mote than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR OL program office). c. --
5. Question duplication from the license screenlng!audit exam was controlled as Indicated below (check the Item that applies) and appears appropriate:

-the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or the examinations were developed Independently; or the licensee certifies that there Is no duplication; or other (explain)

6. Bank use meets limits (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the test new or modified); enter the actual RO I SRO-only C question distribution(s) at right. 1$ / 4 5 / 5 52 1 16
7. Between 50 and 60 percent of the questions on the RO Memory C/A exam are written at the comprehension! analysis level; the SRO exam may exceed 60 percent If the randomly 1__.

selected K/As support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at right.

32 / 4 43 / 21

8. References/handouts provided do not give away answers t._

or aid In the elimination of distractors.

9. Question content conforms with specific K/A statements in the previously approved examination outline and Is appropriate for the tier to which they are assigned; deviations are justified.
10. Question psychometric quality and format meet the guidelines in ES Appendix B. ii
11. The exam contains the required number of one.point, multiple choice items:

the total Is correct and agrees with the value on the cover sheet.

Printed Name / Signature Date

a. Author Cnçe,,ptjt,< M4,jt4 Z]3/It
b. Facility Reviewer () . ..xrrt.e.
c. NRC Chief Examlnerf#) [) r4 n. iJ*6i
d. NRC Regional Supervisor \ 24

( s.

Note: The facility reviewers Initials/signature are not applicable for NRC-developed examinations.

  1. independent NRC reviewer Initial Items in Column c; chief examiner concurrence required.

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A EPE007 EK2.02 1 F 2 X B U Choices A and C are not plausible distractors.

Question is Unsatisfactory due to two implausible distractors.

1/4/2016 - Revised question is Satisfactory.

K/A APE008 2.1.30 2 H 2  ? N E The first part question is too much overlap with Scenario 3 Event 5.

They are the same immediate actions. Also, closing RC-535 is in all 4 answer choices.

Is knowledge of this power supply minutia? You have used that argument for one of the early submittal questions.

1/4/2016 - Revised question is Satisfactory.

K/A EPE009 EA1.10 3 H 2 X N E Knowledge of entry conditions for yellow paths is generally considered SRO knowledge. Following the procedure for a yellow path is based on the discretion of the SRO. You can test red and orange.

1/4/2016 - Operations Management approves testing safety Yellow CSFST identification. They have valid objectives and ROs monitor the status of safety functions. This is not procedure selection. (John Little)

K/A EPE011 EK3.15 4 F 2 X N E Do not believe that the reason for choices C and D are plausible.

Recommend asking what the maximum RWST level is that requires shifting to ECCS sump recirculation (19% or 27%) and giving times in the initial condition to choose between hot or cold leg recirculation. The reason for picking between hot or cold leg would be the time being greater or less than 11 hours1.273148e-4 days <br />0.00306 hours <br />1.818783e-5 weeks <br />4.1855e-6 months <br />.

1/25/2016 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A APE 022 AA2.03 5 H 2 X N E Need to address timing and equipment in AUTO.

1/4/2016 - Revised question is Satisfactory.

K/A APE025 2.4.47 6 H 2 X X N U Given that RCS flow is 3000 gallons per minute, the bypass valve demand is 60%, and RCS pressure is being controlled, choices B(1) and D(1) are not plausible.

This is also a very good cue that there has not been a loss of RHR flow.

Question is Unsatisfactory due to two implausible distractors.

1/4/2016 - Revised question is Satisfactory.

K/A APE027 AK2.03 7 H 2 X X B E The picture provided for question #2 provides a clue to one of the questions.

The question and given conditions could be reworded and split into two parts that would make it less error likely for the applicants.

1/4/2016 - Revised question is Satisfactory.

K/A EPE029 EK2.06 8 H 2 X N E The question needs to be reworded some because FRP-S.1 gives you a list of 4 different sets of breakers and tells you to open all of them. It could be argued that there is no correct answer.

1/4/2016 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A EPE038 EK1.04 9 H 3 X N E With a saturated system, both choices A and D could be argued to be correct. Also, cooling is based on a difference in temperature.

Unable to write a operationally valid question to this K/A.

K/A EPE038 EK1.01 1/25/2016 - Revised question is Satisfactory.

K/A APE 040 AK1.05 10 H 2 X M E The first part question does not test the K/A and is more of a systems (tier 2) question. The second part of the question is a GFES question, but is related to the K/A. Recommend asking something about how to add the Boron or how much Boron to add (ECA-2.1).

We can discuss.

1/4/2016 - Revised question is Satisfactory.

K/A APE054 AA1.03 11 F 2 X B E Choice D is not plausible because it is cooled by Service Water. Is there another option?

1/4/2016 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A EPE055 EK3.02 12 F 2 X X N U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.

Distractor B does not appear to be plausible. When starting at a required pressurizer level of only greater than 14% and probable RCP seal leakage, it does not seem reasonable that pressurizer level greater than 7% can be ensured. Also, Distractors A and B are essentially the same thing. Distractor D is not plausible due to not being able to reach a red path if the cooldown rate limit is followed.

The stem question statement is not totally correct. The procedure caution statement only says that pressure should not be lowered less than 190 psig, it does not say to stop before.

Question is Unsatisfactory due to two non-plausible distractors.

Recommendations:

  • Remove unnecessary information from current initial conditions. We can discuss specifics.
  • Give two times (30 minutes apart) with S/G pressure and pressurizer level. For the first time, have pressurizer level less than 14%. For the second time, have S/G pressure at 190 psig and pressurizer level going off scale low.
  • Ask: IAW ECA-0.0, what is the earliest time that the S/G depressurization is required to be stopped AND the reason for stopping the depressurization (preventing injection of accumulator nitrogen into the RCS or ensuring that no Reactor Vessel upper head voiding will occur).

12/3/2015- Question has been modified as recommended above.

Request that you add something to the effect of In accordance with EOP-ECA-0.0 to the question statement. Otherwise, the question is now Satisfactory.

1/4/2016 - Revised question is Satisfactory.

K/A APE056 AA2.11 13 H 3 B S Question is Satisfactory.

K/A APE057 AA2.15 14 H 3 N S Question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A APE058 AA1.02 15 F 2 X N E Choices B(2) and D(2) are not plausible. Do you have any examples of a case where the electrical output breaker is closed prior to the input breaker when placing a component in service?

There are several other possibilities for this K/A.

1/25/2016 - Revised question is Satisfactory.

K/A WE04 G2.4.46 16 H 3 X X X N U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.

The second part question appears to be asking procedure transition criteria, which is SRO knowledge.

Question is Unsatisfactory due to license level mismatch.

I am not sure that a leak in this location would always cause an APP-036-D7 alarm. The FSAR states that an alarm in this location would most likely be VCT or RWST water because there are so many check valves downstream. The R-4 alarm setpoint is 50 millirem per hour. Did or can you validate on the simulator?

Why ask or mention D8, since it is given in all four answer choices?

12/3/2015- Revised question was submitted. Choices A and D of the revised question are not plausible. How could you have a LOCA outside containment and not have a process monitor high rad alarm.

Also, you could remove all of the only from the choices by adding ALL of the to the question stem.

1/4/2016 - Revised question is Satisfactory.

K/A WE05 EK3.4 17 H 2 X X M E Stating that a red condition exists for Heat Sink in the initial conditions makes choice A(2) not plausible. Also, should not state that the red condition exists when steam generator levels and AFW flow are given. The applicant should be able to figure that out.

This also is more of an SRO question with procedure direction.

1/4/2016 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A WE11 EK1.1 18 H 2 X N E By my calculations, over 4 hours4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br />, the RWST level will lower for about 2.7 hours8.101852e-5 days <br />0.00194 hours <br />1.157407e-5 weeks <br />2.6635e-6 months <br /> until the SI pump is shut off at 9% and then rise for the remainder. I do agree that overall the level will be lower. Need to work on the wording of the second part of the question in order for there to be a fully correct answer.

Request and IAW statement be added to the stem question.

1/4/2016 - Revised question is Satisfactory.

K/A APE005 AK2.02 19 F 1.5 B S Question is Satisfactory.

K/A APE028 AK1.01 20 H 2 X B U Choices B and C are not plausible. If the controlling channel increases or decreases, how could other channels remain the same?

Question is Unsatisfactory due to two non-plausible distractors.

1/4/2016 - Revised question is Satisfactory.

K/A APE032 AA2.02 21 H 2 X B E This question does not appear to work IAW GP-003. You could go critical on any one of the steps for doubling and the procedure has you go to section 8.3 for critical operations. Is there really a minimum number of doublings?

1/4/2016 - Revised question is Satisfactory.

K/A APE033 AK3.01 22 H 3 X B U Do you expect the ROs to know where 120 cps on the Source Range equates to the Immediate Range for this case?

This does not match the K/A. It tests the cause of the loss of the IR instrument, not the reason for termination of the startup.

Tier 1 should normally test procedure/evolution requirements vice systems knowledge, unless otherwise specified by the specific K/A.

Question is Unsatisfactory due to not meeting the K/A.

1/25/2016 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A APE060 AK2.01 23 F 2 N S Question is Satisfactory.

K/A APE067 AA1.09 24 H 2 X X N E Picture of Fire Alarm Console not provided.

Reviewed picture in SRO exam.

The picture is somewhat blurry on the computer. Need to ensure that the picture is clear and readable on the exams. Also need to ensure that the picture is provided for the RO exam.

Given that both trains are actuated, this makes choices C(1) and D(1) not plausible. It would be OK to give only one train in alarm and test the other way.

Need to correct # of alarms on pictured.

1/25/2016 - Revised question is Satisfactory.

K/A APE068 AK3.12 25 H 3 N S Question is Satisfactory.

K/A APE076 AA2.04 26 H 2 X M E Choices B(1) and D(1) are not plausible.

1/25/2016 - Revised question is Satisfactory.

K/A WE09 2.1.20 27 H 2 X M E With step 9 being a continuous actions step, how are there not two correct answers?

1/25/2016 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A SYS003 A3.01 28 H 2 X N U The picture seems too hard to read.

Since all of the parameters shown return to their original values, outright failures do not seem to be plausible.

Question is Unsatisfactory due to two non-plausible distractors.

1/25/2016 - Revised question is Satisfactory.

K/A SYS003 K4.07 29 H 3 B S Question is Satisfactory.

K/A SYS004 K2.06 30 F 3 X N U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.

The question does not meet the K/A. It does not test knowledge of power supplies to the instrumentation, it gives a power supply that is lost and tests knowledge of how the instruments will fail upon a loss of power. That would be more of a K6 K/A.

Question is Unsatisfactory due to K/A mismatch.

12/7/15- Question is Satisfactory.

K/A SYS005 A2.02 31 H 2 X X B U Choices C and D are not plausible.

Question is Unsatisfactory due to two non-plausible distractors.

1/25/2016 - Revised question is Satisfactory.

K/A SYS005 K6.03 32 H 3 X X B E Choice C is not plausible.

Licensee explained how choice C could be plausible.

K/A SYS006 A1.13 33 F 3 N S Question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A SYS006 K5.01 34 F 2 X M E The second part question needs to be a little more specific concerning temperature (higher, lower, increased, decreased).

1/25/2016 - Revised question is Satisfactory.

K/A SYS007 K3.01 35 H 2 N S Question is Satisfactory.

K/A SYS008 A4.01 36 H 2 X X B E Choice D is not plausible.

The question stem does not exactly match the choices.

1/25/2016 - Revised question is Satisfactory.

K/A SYS010 K6.04 37 H 1 X N U Choices A, B, and D are not plausible. LOD = 1.

Question is Unsatisfactory due three non-plausible distractors and LOD = 1.

1/25/2016 - Revised question is Satisfactory.

K/A SYS012 A3.06 38 H 2 B S Question is Satisfactory.

K/A SYS012 K1.05 39 F 2 X  ? N E Choice D is not plausible.

Need to discuss K/A match.

1/25/2016 - Revised question is Satisfactory.

K/A SYS013 K5.02 40 F 2 N S Question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A SYS022 A4.04 41 H 2 X N E Choice D is not plausible. Choice A is likely not plausible.

1/25/2016 - Revised question is Satisfactory.

K/A SYS026 A2.08 42 H 2 N S Question is Satisfactory.

K/A SYS039 A1.10 43 F 2 X N E Choice A is not plausible.

1/25/2016 - Revised question is Satisfactory.

K/A SYS059 K4.02 44 F 2 N S Question is Satisfactory.

K/A SYS061 K5.01 45 H 2 X N U Choices A and D are not plausible.

There is no correct answer (must be > 600 gpm).

Question is Unsatisfactory due to two non-plausible distractors.

1/25/2016 - Revised question is Satisfactory.

K/A SYS062 K1.04 46 H 2 B S Question is Satisfactory.

K/A SYS062 K2.01 47 F 2 B S Question is Satisfactory.

K/A SYS063 A3.01 48 H 2 X N U Choices A and C are not plausible.

Question is Unsatisfactory due to two non-plausible distractors.

1/25/2016 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A SYS064 A2.18 49 F 2 X N U Choices C and D are not plausible.

Question is Unsatisfactory due to two non-plausible distractors.

1/25/2016 - Revised question is Satisfactory.

K/A SYS064 K2.02 50 F 2  ? B E Can you give any examples where there are A and B components that the B component is powered from the lower numbered MCC?

1/25/2016 - Question is Satisfactory.

K/A SYS073 A4.01 51 H 2 B S Question is Satisfactory.

K/A SYS073 2.4.9 52 F 3 X X M U Question seems to be more related SRO procedure direction than mitigation strategy. It also does not seem to meet the K/A because it does not seem to test the PRM system.

Selected K/A SYS073 2.4.11 1/26/16-New question is Satisfactory.

K/A SYS076 K1.15 53 F 3 N S Question is Satisfactory.

K/A SYS078 K3.03 54 F 2 N S Question is Satisfactory.

K/A SYS103 G2.1.7 55 H 2 X N E Is a spray pump running? Does the number of HVH units running matter concerning the CSFST? Need to discuss plausibility of choice C.

1/25/2016 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A SYS001 K6.13 56 H 2 X N E The given conditions picture is not included on anything that was submitted. Unable to review fully. It seems that operation or interpretation of RPI would be more relevant than location of cabinets that I&C personnel need to go to. If there is no IRPI rack in the Hagan room, then it is not plausible.

1/25/2016 - Revised question is Satisfactory.

K/A SYS002 K4.01 57 F 2 X N U Question does not appear to test design features or interlocks.

Question is Unsatisfactory due to not meeting the K/A.

1/25/2016 - Revised question is Satisfactory.

K/A SYS011 A1.02 58 F 2 X N E Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.

Need to state (in the question stem) what procedure these values are in accordance with.

1/25/2016 - Revised question is Satisfactory.

K/A SYS014 K5.01 59 H 2 X B U Choices A and B are not plausible.

Question is Unsatisfactory due to two non-plausible distractors.

1/25/2016 - Revised question is Satisfactory.

K/A SYS017 A4.01 60 F 2 X B U Choices A and B are not plausible.

Question is Unsatisfactory due to two non-plausible distractors.

1/28/2016 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A SYS027 K2.01 61 F 2 B S Question is Satisfactory.

K/A SYS029 G2.1.23 62 F 2 X N E Need to show where this information is located in OP-921. I could not find it.

Licensee is breaking stem into two separate questions.

1/28/2016 - Revised question is Satisfactory.

K/A SYS033 K3.02 63 F 2 X X N E Choices C(1) and D(1) are not plausible. They are process monitors.

1/26/16 - Revised question is Satisfactory.

K/A SYS035 A2.05 64 H 2 X X N E The choices for the second part question provide a direct cue to answer the first part question.

1/26/16 - Revised question is Satisfactory.

K/A SYS068 K1.07 65 F 2 X B E Choice A should probably be in all capital letters to match other choices.

1/26/16 - Revised question is Satisfactory.

K/A G2.1.29 66 F 2 N S Question is Satisfactory.

K/A G2.1.36 67 F 2 X B E Need nomenclature for NI-51 and NI-52.

1/26/16 - Revised question is Satisfactory.

K/A G2.1.45 68 H 2 X N E Choice A is not plausible. Is it fair to have the applicant evaluate T and MW without a reference? Need to discuss.

1/28/2016 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A G2.2.38 69 H 4 M E It seems that this question requires the applicant to know greater than one hour actions from memory.

Operations (John Little) determined that this is RO required knowledge because it relates directly to licensed power level and the RO is responsible for monitoring.

K/A G2.2.39 70 F 2 N S Question is Satisfactory.

K/A G2.3.13 71 F 1 B U It does not seem plausible that you would not evacuate the containment vessel or initiate closure after a fuel assembly has been dropped and is causing the noble gas radiation monitor to increase.

LOD = 1 Question is Unsatisfactory due to more than one non-plausible distractor and LOD = 1.

1/26/16 - Revised question is Satisfactory.

K/A G2.3.4 72 H 2 B S Question is Satisfactory.

K/A 2.4.11 73 H 3 X N E The second part question could be reworded to read easier.

1/26/16 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A G2.4.25 74 H 2 X N E Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.

In the question stem, need to state what procedure the action(s) are in accordance with.

Recommend stating in the initial conditions that either the block valves have been closed or the switches have been placed in the ISOLATED Position, then asking if the other action is or is not required.

For plausibility, are there any other time critical actions that are 15 minutes?

12/16/15 - Question is Satisfactory.

K/A G2.4.31 75 F 1 N U This has overlap with the operating test. Every BOP will perform this during the operating test.

Question is Unsatisfactory due to LOD = 1.

1/26/16 - Revised question is Satisfactory.

K/A EPE029 EA2.06 76 H 2 X N E With operation of the steam dumps following turbine trip, do not believe that choices A(2) and D(2) are plausible. Could possibly change the second part question to an is or is not question.

1/26/16 - Revised question is Satisfactory.

K/A EPE 038 2.4.47 77 H 1 X X X N U The first part question is direct lookup. This question can be answered using RO knowledge only.

The question is Unsatisfactory due to LOD = 1 and not being SRO only.

1/26/16 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A APE054 2.4.9 78 H 2 X X B U/E Knowledge of when to initiate bleed and feed is probably RO knowledge and is listed in the continuous action summary for FRP-H.1. This is also an objective in your lesson plan. The RO would be required to inform the SRO when conditions are met for bleed and feed.

It is acceptable for one part of a two part question to be RO knowledge, however both parts should not be able to be answered using RO knowledge.

ROs should also know that PORVs are opened for bleed and feed.

We need to discuss this situation for steps on the foldout page.

Also, since all of the choices listed in the second part question are done in the procedure, need to ask what should be done first.

Question may be Unsatisfactory due to not being SRO only.

1/29/2016 - Revised question is Satisfactory K/A EPE055 EA2.06 79 H 3 X  ? B E Is the first part of the question minutia? Does this lockout need to be cleared prior to re-energizing the buses? Does this meet the K/A?

Please explain.

1/28/2016 - Revised question is Satisfactory.

K/A APE058 2.2.22 80 H 2 X B E Per the TS 3.8 Bases, the selected answer for the second part question may not be correct.

1/26/16 -Licensee explained Bases, Question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A APE077 AA2.03 81 H 1 X M U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.

The last bullet provides a direct cue that the qualified offsite circuit is INOPERABLE (inadequate voltage for a design basis event). This makes LOD = 1.

Question is Unsatisfactory due to LOD = 1.

12/22/15- Revised question reviewed. Is there any place in AOP-26 that the EDGs are aligned by the operators to E-1 and E-2 independently? If not, choices C(2) and D(2) are not plausible. The question still needs some enhancement.

1/26/16 - Revised question is Satisfactory.

K/A APE001 AA2.02 82 H 2 N S Question is Satisfactory.

K/A APE051 G2.4.35 83 H 2 X X X N U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.

The question is not SRO only. SRO only knowledge should not be claimed for major mitigative strategy or AOP entry conditions. See Attachment 2 of ES-401.

Also, based on the wording of step 12 of AOP-012, the note prior to step 12, and the AOP-038 entry conditions, it appears that the SRO could perform a rapid power reduction if desired.

With no indication of condenser backpressure value or trend, how is going to a rapid power reduction plausible?

The question is Unsatisfactory because it is not SRO only.

Based on a review of your procedures, this could be a very hard K/A to satisfy at the SRO only level. We can discuss randomly selecting another K/A.

12/22/15 - Reviewed revised question. Question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A APE061 AA2.03 84 H 2 X N E The applicable answer choices do not include that a Portable Area Radiation Monitor in the CV area is also required in accordance with GP-010.

1/26/16 - Revised question is Satisfactory.

K/A WE06 2.1.23 85 H 2 X M E Choice C needs to be worded more clearly.

1/26/16 - Revised question is Satisfactory.

K/A SYS012 A2.05 86 H 2 X X N U Providing LCO 3.3.1 gives clues to the correct answer or gives the correct answer for several other questions on this exam. (Question 1 for example, and also questions that hinge on the set points of Reactor Protection System interlocks)

Question does not meet the K/A due to not predicting the impacts on the RPS.

Question is Unsatisfactory due to K/A mismatch.

1/26/16 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A SYS039 A2.03 87 H 2 X X B E Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.

Please explain why it is required to secure feeding the A steam generator as stated in the first part question stem.

Discussing transitioning to E-2 in the second part question stem provides a cue to the first part question and does not affect the answer. Indications of the faulted steam generator are provided in the initial conditions. Should just ask IAW the given conditions and E-3.

12/22/15 - Reviewed the revised question.

Based on the given conditions, it appears that the Secondary Integrity Criteria on the foldout page for E-3 are met. This would require a transfer to E-2. Since this is not one of the listed choices, there is no correct answer choice for this question.

1/28/2016 - Revised question is Satisfactory.

K/A SYS076 2.1.7 88 M 2 N S Question is Satisfactory.

K/A SYS078 A2.01 89 H 2 X X N U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.

Need to remove the information in the bullet that states causing IA Header pressure to slowly lower. The applicants should know that a clogged air dryer will cause pressure to lower.

The question does not really appear to be operational valid. We need to discuss the normal lineup of the instrument air system and how we would get in the situation proposed by the question.

The question does not really test the K/A, but can be pretty easily fixed. We can discuss.

Will need the appropriate IAW statement added to the question stem. Also, need to word question with regard to the fact that the use of attachment 2 or 3 is in a step that is based on order of preference.

12/22/15 - Reviewed the revised question.

Question is now Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A SYS103 G2.4.35 90 H 2 X X N U Question submitted for preliminary review and comment IAW ES-201 paragraph C.2.c.

This does not appear to meet the intent of the K/A. It seems to meet more of the RCP K/A than the type of topics listed for the Containment system.

This does not appear to be an SRO only question. It does not have procedure selection and could be answered with RO knowledge.

Based on a review of your procedures, this could be a very hard K/A to satisfy at the SRO only level. We can discuss randomly selecting another K/A.

K/A SYS103 2.4.41 Revised question is Unsatisfactory due to LOD = 1. The correct answer choice (both halves) is so strong and self-explanatory that it makes the question provide no discriminatory value.

1/26/16 - Revised question is Satisfactory.

K/A SYS015 A2.04 91 H 2 X N E The bullet in the initial conditions that states that the crew lowered reactor power IAW AOP-101 needs to be more specific as to what the current reactor power is. It could be argued that if the crew lowered power IAW AOP-001, then it would be less than or equal to 50% and no further reduction would be required.

It would probably be more clear just to ask whether the CRS is or is not required to direct a power reduction to less than or equal to 50%

in accordance with AOP-001 Attachment 1 for the second part question.

1/26/16 - Revised question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A SYS068 A2.02 92 F 2 X M E Need a copy of EMP-006 to complete review of this question. Your lesson plan states that Chemistry does the sample and then provides the permit. Is determining whether or not the pH is acceptable an SRO job function?

Operations representative (John Little) states that this is SRO job function because the SRO/Shift Manager is required to review and approve the report.

1/28/2016 - Revised question is Satisfactory.

K/A SYS071 2.4.21 93 F 2 M E Need a copy of PLP-100 to complete review of this question. This procedure is not listed in the index provided.

1/28/2016 - Revised question is Satisfactory.

K/A G2.1.45 94 H 2 N S Question is Satisfactory.

K/A G2.2.21 95 H 2 X X N E Choices B(2) and C(2) are not plausible. It is not operationally valid to ask for greater than one hour TS completion times without a reference.

1/29/2016 - Revised question is Satisfactory K/A G2.2.36 96 H 2 X X N E Choices A(2) and C(2) are not plausible. It is not operationally valid to ask for greater than one hour TS completion times without a reference.

1/29/2016 - Revised question is Satisfactory.

K/A G2.3.12 97 H 2 X B E There may be two correct answers to this question. OMM-001-2 doesnt really state that the RC Supervisor cannot grant access during EOPs, it just describes how he will do it during normal operations.

1/28/2016 - Revised question is Satisfactory.

K/A G2.3.14 98 H 2 N S Question is Satisfactory.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A G2.4.30 99 H 2 X M E Need a copy of AP-030 to complete review of this question.

Licensee is changing leakrate and adding EAL reference.

2/3/16 - Revised question is Satisfactory K/A G2.4.46 100 H 2 X N E The bullet for Total calculated B RCP #1 seal leakoff flow: 6.5 gpm is misleading. We need to discuss this.

1/29/2016 - Revised question is Satisfactory Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
3. Check the appropriate box if a psychometric flaw is identified:
  • The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
  • The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
  • The answer choices are a collection of unrelated true/false statements.
  • The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
  • One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
4. Check the appropriate box if a job content error is identified:
  • The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
  • The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
  • The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
  • The question requires reverse logic or application compared to the job requirements.
5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
7. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
8. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).

ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Facility: Date of Exam: Exam Level: RD SRQ Item Description Initials a b c

1. Clean answer sheets copied before grading 1li &
2. Answer key changes and question deletions justified and documented
3. Applicants scores checked for addition errors U A (reviewers spot check> 25% of examinations) ,
4. Grading for all borderline cases (80 +/-2% overall and 70 or 80, All as applicable, +/-4% on the SRO-only) reviewed in detail %i 1.ifr
5. All other failing examinations checked to ensure that grades are justified z j
6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of 41 7/

questions missed by half or more of the applicants Printed Name/Signature Date

a. Grader
b. Facility Reviewer(*)
c. NRC Chief Examiner (*) *f .

03/i)!

d. NRC Supervisor (*) 3/Z2J!

(*) The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-403, Page 6 of 6

Retrieved from "https://kanterella.com/w/index.php?title=ML16124B059&oldid=2628962"