ML21350A050
| ML21350A050 | |
| Person / Time | |
|---|---|
| Site: | Surry  |
| Issue date: | 12/16/2021 |
| From: | Virginia Electric & Power Co (VEPCO) |
| To: | NRC/RGN-II |
| References | |
| Download: ML21350A050 (156) | |
Text
ML21350A050 ES-301 Administrative Topics Outline Form ES-301-1 Facility: Surry__________________________ Date of Examination: 8/23/2021 Examination Level: RO SRO Operating Test Number: SR2021-301 Administrative Topic (see Note) Type Describe activity to be performed Code*
R,M Perform manual Calorimetric Conduct of Operations (1-OPT-RX-003, Sections 6.1 and 6.2 and Attachment 3)
R,N Determine Core Crew Requirements Conduct of Operations (OP-AA-100, Attachment 2)
R,D Determine Tagout Boundaries Equipment Control (OP-AA-200, 11448-FE-1K, 11448-FM-124A SH2) (Bank JPM from Surry 2010 exam)
R,M Verify RWP adequate Radiation Control (Rad Work Permit, VPAP-2101 Section 6.3)
(Modified JPM from Surry 2009 exam)
Emergency Plan NOTE: All items (five total) are required for SROs. RO applicants require only four items unless they are retaking only the administrative topics (which would require all five items).
- Type Codes and Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank ( 3 for ROs; 4 for SROs and RO retakes)
(N)ew or (M)odified from bank ( 1)
(P)revious 2 exams ( 1, randomly selected)
ES-301, Page 22 of 33
ES-301 Administrative Topics Outline Form ES-301-1 Facility: Surry___________________________ Date of Examination: 8/23/2021 Examination Level: RO SRO Operating Test Number: SR2021-301 Administrative Topic (see Note) Type Describe activity to be performed Code*
Review CC PT Conduct of Operations R,N (1-PT-41.1)
Authorize Fuel Movement per OSP-ZZ-004 Conduct of Operations S,M (1-OSP-ZZ-004, Step 6.1.8, ATT 8)
(Modified JPM from Surry 2014 exam)
Calculate Partial pressure and make TS call Equipment Control R,M (ARP 1B-A6, Attachment 2 and Tech Spec 3.8)
Perform Containment Entry Checklist Radiation Control R,N (VPAP-0106 Attachment 1)
Determine PAR Emergency Plan R,D (EPIP-1.06)
NOTE: All items (five total) are required for SROs. RO applicants require only four items unless they are retaking only the administrative topics (which would require all five items).
- Type Codes and Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank ( 3 for ROs; 4 for SROs and RO retakes)
(N)ew or (M)odified from bank ( 1)
(P)revious 2 exams ( 1, randomly selected)
ES-301, Page 23 of 33
ES-301 Administrative Topics Outline Form ES-301-1 Facility: Surry__________________________ Date of Examination: 10/04/2021 Examination Level: RO SRO Operating Test Number: SR2021-301 Administrative Topic (see Note) Type Describe activity to be performed Code*
Perform a Quadrant Power Tilt Calculation R,M Conduct of Operations (al)
(0-AP-1.00, Attachment 6, Steps 1 - 9)
R,N Determine Core Crew Requirements Conduct of Operations (m) (Completed 8/24/21)
R,M Equipment Control (an)
Review 1-OPT-CH-001, A Charging pump PT R,M Verify RWP adequate Radiation Control (o)
(Rad Work Permit, VPAP-2101 Section 6.3)
(Completed 8/23/21)
Emergency Plan NOTE: All items (five total) are required for SROs. RO applicants require only four items unless they are retaking only the administrative topics (which would require all five items).
- Type Codes and Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank ( 3 for ROs; 4 for SROs and RO retakes)
(N)ew or (M)odified from bank ( 1)
(P)revious 2 exams ( 1, randomly selected)
ES-301, Page 22 of 33
ES-301 Administrative Topics Outline Form ES-301-1 Surry RO Makeup JPM Summary A.1.a This JPM is modified from the bank JPM performed on the 2017 NRC exam and 2019 Audit exam. A control rod had fully dropped in the core.
The crew has enteed 0-AP-1.00, ROD CONTROL MALFUNCTION. The applicant is to determine the Quadrant Power Tilt Ratio (QPTR) by performing 0-AP-1.00 Attachment 6, CALCULATION OF EXCORE QUADRANT POWER TILT RATIOS. The critical tasks include: recording the correct normalized detector current from the NI/Rad Monitor info page, calculating the correct upper and lower detector flux tilt ratios, and converting the ratios to percent flux tilt values. With a different dropped rod, all detector values will modified from the bank JPM; the final value for QPTR will also be modified.
A.1.b. This JPM was administered on 8/24/21.
A.2 This JPM is modified from the bank JPM performed on the 2017 Audit exam (The bank JPM was for the B Charging Pump). This JPM involves review of a completed performance test of the 1A Charging Pump. The critical tasks include identifying the following: an SQC stopwatch used for the PT was out of calibration, a vibration point is in the inoperable range limit, and one MOV exceeds its open stroke time limit. The applicant must also to determine that the A CH pump does NOT result in a Tech Spec LCO clock.
A.3 This JPM was administered on 8/23/21.
ES-301, Page 23 of 33
ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 Facility: Surry ________________________ Date of Examination: 08/23/2021__
Exam Level: RO SRO-I SRO-U Operating Test No.: SR 2021-301___
Control Room Systems:* 8 for RO, 7 for SRO-I, and 2 or 3 for SRO-U System/JPM Title Type Code* Safety Function
- a. Perform AP-3.00 to Emergency Borate the RCS During ES-0.1 M/S/A/L 1 (Faulted) [ 024AA1.17 (3.9/3.9)] (1-AP-3.00)
- b. Transfer the SI System to Cold Leg Recirc [006A3.08 (4.2/4.3)] (1- 2 M/EN/A/L/S ES-1.3 Steps 1-5)
- d. Respond to a Loss of Decay Heat Removal [005A2.03 (2.9/3.1)] (1- 4P M/A/L/S AP-27.00, focus on Steps 4 - 13)
- e. Place Containment H2 Analyzer in service [028A4.03 (3.1/3.3)] (1-E- D/S/L 5 1 Attachment 2)
- f. Respond to a #3 EDG Start Failure [064A4.06 (3.9/3.9)] (0-AP-17.05 D/S/A/EN 6 Steps 1-15, Attachments 2 and 3)
- g. Adjust the PRNIs IAW 1-OPT-RX-001 [015A1.01 (3.5/3.8)] (1-OPT- D/S 7 RX-001 Attachment 1)
In-Plant Systems:* 3 for RO, 3 for SRO-I, and 3 or 2 for SRO-U
- i. Locally Isolate U2 TDAFW pump. [EPE038G2.1.30 (4.4/4.0)] (2-E-3, 4S D,L,E,R Step 3)
- j. Locally Start an EDG [068AA1.31 (3.9/4.0)] (0-FCA-12.00, Step 31, D/E/A/L/EN 6 then back to steps 9-20)
- k. MCR Pressure Bndry Verification in AP-22.00 036G2.1.44 (3.9/3.8)] N/E/L 8 (0-AP-22.00, Attachment 1 Step 3)
- All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions, all five SRO-U systems must serve different safety functions, and in-plant systems and functions may overlap those tested in the control room.
- Type Codes Criteria for R /SRO-I/SRO-U
(A)lternate path 5 (4-6)
(C)ontrol room (D)irect from bank 6 ( 9)
(E)mergency or abnormal in-plant 3 ( 1)
(EN)gineered safety feature 3 ( 1 control room system)
(L)ow-Power/Shutdown 8 ( 1)
(N)ew or (M)odified from bank including 1(A) 5 ( 2)
(P)revious 2 exams 0 ( 3) (randomly selected)
(R)CA 1 ( 1)
(S)imulator
ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 Facility: Surry ________________________ Date of Examination: 08/23/2021__
Control Room Systems:* 8 for RO, 7 for SRO-I, and 2 or 3 for SRO-U System/JPM Title Type Code* Safety Function
- a. Perform AP-3.00 to Emergency Borate the RCS During ES-0.1 M/S/A/L 1 (Faulted) [ 024AA1.17 (3.9/3.9)] (1-AP-3.00)
- b. Transfer the SI System to Cold Leg Recirc [006A3.08 (4.2/4.3)] (1- 2 M/EN/A/L/S ES-1.3 Steps 1-5)
- d. Respond to a Loss of Decay Heat Removal [005A2.03 (2.9/3.1)] (1- 4P M/A/L/S AP-27.00, focus on Steps 4 - 13)
- e. Place Containment H2 Analyzer in service [028A4.03 (3.1/3.3)] (1-E- D/S/L 5 1 Attachment 2)
- f. Respond to a #3 EDG Start Failure [064A4.06 (3.9/3.9)] (0-AP-17.05 D/S/A/EN 6 Steps 1-15, Attachments 2 and 3)
- g. Adjust the PRNIs IAW 1-OPT-RX-001 [015A1.01 (3.5/3.8)] (1-OPT- D/S 7 RX-001 Attachment 1)
In-Plant Systems:* 3 for RO, 3 for SRO-I, and 3 or 2 for SRO-U
- i. Locally Isolate U2 TDAFW pump. [EPE038G2.1.30 (4.4/4.0)] (2-E-3, 4S D,L,E,R Step 3)
- j. Locally Start an EDG [068AA1.31 (3.9/4.0)] (0-FCA-12.00, Step 31, D/E/A/L/EN 6 then back to steps 9-20)
- k. MCR Pressure Bndry Verification in AP-22.00 036G2.1.44 (3.9/3.8)] N/E/L 8 (0-AP-22.00, Step 11 and Attachment 1 Steps 1-3)
- All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions, all five SRO-U systems must serve different safety functions, and in-plant systems and functions may overlap those tested in the control room.
- Type Codes Criteria for R /SRO-I/SRO-U
(A)lternate path 5 (4-6)
(C)ontrol room (D)irect from bank 6 ( 8)
(E)mergency or abnormal in-plant 3 ( 1)
(EN)gineered safety feature 3 ( 1 control room system)
(L)ow-Power/Shutdown 8 ( 1)
(N)ew or (M)odified from bank including 1(A) 4 ( 2)
(P)revious 2 exams 0 ( 3) (randomly selected)
(R)CA 1 ( 1)
(S)imulator
ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 Facility: Surry ________________________ Date of Examination: 8/23/2021__
Exam Level: RO SRO-I SRO-U Operating Test No.: SR 2021-301___
Control Room Systems:* 8 for RO, 7 for SRO-I, and 2 or 3 for SRO-U System/JPM Title Type Code* Safety Function
- a. Perform AP-3.00 to Emergency Borate the RCS During ES-0.1 M/S/A/L 1 (Faulted) [ 024AA1.17 (3.9/3.9)] (1-AP-3.00)
- b. Transfer the SI System to Cold Leg Recirc [006A3.08 (4.2/4.3)] (1- 2 M/EN/A/L/S ES-1.3 Steps 1-5)
In-Plant Systems:* 3 for RO, 3 for SRO-I, and 3 or 2 for SRO-U
- i. Locally Isolate U2 TDAFW pump. [EPE038G2.1.30 (4.4/4.0)] (2-E-3, 4S D,L,E,R Step 3)
- j. Locally Start an EDG [068AA1.31 (3.9/4.0)] (0-FCA-12.00, Step 31, D/E/A/L/EN 6 then back to steps 9-20)
- All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions, all five SRO-U systems must serve different safety functions, and in-plant systems and functions may overlap those tested in the control room.
- Type Codes Criteria for R /SRO-I/SRO-U (A)lternate path 3 (2-3)
(C)ontrol room (D)irect from bank 3 ( 4)
(E)mergency or abnormal in-plant 2 ( 1)
(EN)gineered safety feature 2 ( 1 control room system)
(L)ow-Power/Shutdown 5 ( 1)
(N)ew or (M)odified from bank including 1(A) 2 ( 1)
(P)revious 2 exams 0 ( 2) (randomly selected)
(R)CA 1 ( 1)
(S)imulator
ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 Facility: Surry ________________________ Date of Examination: 10/04/2021__
Exam Level: RO SRO-I SRO-U Operating Test No.: SR 2021-301___
Control Room Systems:* 8 for RO, 7 for SRO-I, and 2 or 3 for SRO-U System/JPM Title Type Code* Safety Function
- a. Recover a dropped control rod. [APE003 AA1.02 (3.6,3.4)] (0-AP- 1 1.01, steps 14-23), M/S
- c. Re-establish Normal Letdown following SI [E02.EK3.3 (3.9,3.9)] M/A/L/S 3 (1-ES-1.1, step 15)
- d. Condensate pump flr with ATWS [056A2.04, (2.6,2.8)] [029EA1.09, 4S N/A/S (4.0, 3.6); EA1.13 (4.1,3.9)] (1-OP-CN-001, 5.4.5) (1-FR-S.1, steps 1 - 3)
- e. Perform E-0 Attachment 4 [WE14 EA1.3 (3.3/3.8)] (1-E-0, Att 4) M/L/EN/S 5
- f. Load AAC EDG onto 1J bus. [056A3.02 (4.4,4.7)] (0-AP-17.06, D/L/S 6 steps 1-6)
- g. Transfer A SF/FF Channels to BLUE following corrective maint. N/A/S 7
[016A2.01, (3.0,3.1)]. (1-OP-RP-001, Step 5.4.5, AP-53.00)
- h. Realign MCR Ventilation in AP-22.00 [036G2.1.44 (3.9/3.8)] (0-AP- N/S 8 22.00 Steps 1-10) Completed 8/23/21 In-Plant Systems:* 3 for RO, 3 for SRO-I, and 3 or 2 for SRO-U
- i. Locally align SW to a Recirc Spray HX [EPE011EA1.11 (4.2, 4.2)] 3 N/L/E/R/EN (1-ECA-1.1 step 8c RNO)
- j. Transfer Semi-vital bus power supply [APE056AA2.44 94.3/4.4)] (2- D/E 6 AP-10.05, step 11)
- k. Initiate #2 EDG Cardox [086A2.04, (3.3,3.9)] (0-OP-FP-006, 5.1) N/A/E 8
- All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions, all five SRO-U systems must serve different safety functions, and in-plant systems and functions may overlap those tested in the control room.
- Type Codes Criteria for R /SRO-I/SRO-U
(A)lternate path 5 (4-6)
(C)ontrol room 0 (D)irect from bank 3/ ( 9)
(E)mergency or abnormal in-plant 3 ( 1)
(EN)gineered safety feature 2 ( 1 control room system)
(L)ow-Power/Shutdown 4 ( 1)
(N)ew or (M)odified from bank including 1(A) 8 ( 2)
(P)revious 2 exams 0 ( 3) (randomly selected)
(R)CA 1 (S)imulator 8 ( 1)
- a. This is a Modified bank JPM from LORP. A rod is dropped and the applicant will need to recover the rod to the Bank height.
- b. This is a bank, alternate-path, JPM that was last performed on the 2020 Op Eval. This JPM starts by having the applicant perform actions per 1-AP-9.00, RCP ABNORMAL CONDITIONS, for a failed RCP Seal. During performance of this procedure (step 7) a second RCP Seal will fail resulting in Delta P across one stage exceeding 2000 psid. Per Step 5 (Continuous action step) the applicant will be required to trip the reactor and perform 1-E-0.
- c. This is a bank, alternate-path, JPM that was last performed on the 2014 NRC Exam. The non-alternate path version of this JPM was last performed on the 2021 audit. This version will fail to establish normal letdown, requiring excess letdown to be put in service per 1-OP-CH-006.
- d. Condensate pump failure with ATWS. This is a new, alternate-path JPM. The applicant will pre-brief 1-OP-CN-001 for swapping Condensate pumps. The standby Condensate pump is first started followed by securing the designated Condensate pump. The secured pumps discharge check valve sticks open resulting in a total loss of Condensate flow. The applicant will recognize the loss of feedwater and perform AP-21.00 which will direct a reactor trip. The reactor will fail to trip requiring FR-S.1 immediate actions to be performed.
Rods will be initially in MAN. At FR-S.1 step 2 the applicant will trip the Turbine. The JPM ends after the applicant performs the immediate actions.
- e. The JPM was last performed on the 2016 NRC exam. A large break LOCA had just occurred, and the applicant will check Phase II and Phase III containment isolation valves have closed. The applicant will identify that 1-RM-TV-100B, 1-CC-TV-105C, and 1-IA-TV-101A did not close as required and will close them.
Also the applicant identifies that 1-SW-P-5D,SW pump did not start as specified and will start the pump. And finally the applicant will identify that 1-CW-MOV-106C should have closed and closes this valve.
- f. The JPM was last performed on the 2015 Audit exam. A loss of all emergency bus power has occurred on Unit 1. The applicant is given a 10 minute time critical action to load the AAC on the 1J Emergency bus using 0-AP-17.06.
The applicant will perform a switch alignment for the 1J Bus, including various components across the control room benchboard, EDG #3 control panel, and
the Vertical board. AMSAC will need to be reset in order to open the B MDAFW breaker. Breaker 15J8 will need to be closed within the 10 minutes to meet the time critical action. DRP-0049
- g. This is a new Alternate Path JPM, which will be pre-briefed. It begins with the A S/G SGWLCS channels aligned to Channel 4 (all other SGWLCS channels are aligned to Channel 3). Repairs were just completed on an A S/G SGWLCS instrument, and the applicant is to align A S/G instrumentation to Channel 3 using 1-OP-RP-001. The A MFRV will be placed in manual and the associated Steam and Feed flow selector switches will be aligned to Channel 3. When the A MFRV is placed back in AUTO, a SGWLCS failure will occur (FF fails high), requiring the applicant to perform the Immediate Actions of 0-AP-53.00 to stabilize A S/G Level.
- h. This JPM was administered on 8/23/21.
- i. This is a new JPM. A Large break LOCA has occurred but Recirc Spray SW MOVs did not open as required. This JPM will require the applicant to manually open Recirc Spray MOVs inside the RCA to restore SW to the Recirc Spray Heat Exchangers.
- j. This JPM was last performed on the 2019 Audit exam. A loss of Semi-Vital bus (SVB) occurred on Unit 2 and the team is performing 2-AP-10.05. The applicant will perform step 11 of 2-AP-10.05 to open the 1H feeder breaker, operate the manual SVB throw over switch, then close the 1J feeder breaker to reenergize the SVB.
- k. This is a new JPM. The applicant is responding to a fire in #2 EDG room, with a failure of LP CO2 manual actuation from the Main Control Room. The applicant will perform 0-OP-FP-006 to attempt Manual initiation outside the EDG room using the pushbutton. The applicant must recognize CO2 actuation did not occur, and manually operate the override lever both at the EDG room and by the LP CO2 tank.
ES-301 Transient and Event Checklist Form ES-301-5 Facility: Surry Date of Exam: 08/23/21 Operating Test No.: SR2021-301 A E Scenarios P V 3 4 3 4 T M P E O I L N CREW POSITION CREW CREW CREW T N I T POSITION POSITION POSITION I
C A S A B S A B S A B S A B M A T L R T O R T O R T O R T O U N Y O C P O C P O C P O C P M(*)
T P E R I U RO RX 1 1 2 1 1 0 NOR 5 1 1 1 1 SRO-I1,2 I/C 2,3,4,5 3,5,6 7 4 4 2 SRO-U MAJ 6,7 7,8 4 2 2 1 TS 2,4 2 0 2 2 RO1,3,4 RX 1 1 1 1 0 NOR 1 2 1 1 1 SRO-I I/C 4,5 2,4 6 4 4 2 SRO-U MAJ 6,7 7,8 4 2 2 1 TS 0 0 2 2 RO2 RX 1 1 1 1 0 NOR 1,5 1 1 1 1 SRO-I I/C 2,3,5 3,5,6 4 4 4 2 SRO-U1 MAJ 6,7 7,8 4 2 2 1 TS 0 0 2 2 RO RX 1 1 2 1 1 0 NOR 5 1 2 1 1 1 SRO-I I/C 2,3,4,5 2,3,4, 9 4 4 2 5,6 SRO-U1 MAJ 6,7 7,8 4 2 2 1 TS 2,4 2,5 4 0 2 2 RO RX 1 1 1 1 0 NOR 1,5 1 2 1 1 1 SRO-I I/C 2,3,5 2,3,4, 6 4 4 2 5,6 SRO-U2, U3 MAJ 6,7 7,8 4 2 2 1 TS 2,5 2 0 2 2
Instructions:
- 1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions. Instant SROs (SRO-I) must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an SRO-I additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
- 2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional I/C malfunctions on a one-for-one basis.
- 3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.
- 4. For new reactor facility licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-I applicants in either the ATC or BOP position to best evaluate the SRO-I in manipulating plant controls.
ES-301 Competencies Checklist Form ES-301-6 Facility: SURRY Date of Examination: 08/23/2021 Operating Test No.: 2021-301 APPLICANTS RO RO (1,3,4) RO (2) RO SRO-I (1,2) SRO-I SRO-I SRO-I SRO-U SRO-U SRO-U SRO-U (1)
Competencies SCENARIO SCENARIO SCENARIO SCENARIO 3 4 3 4 3 4 3 4 Interpret/Diagnose Events 2,3,4, 2,3,4,5, 2,3,4, 2,3,4,5, 2,3,4, 2,3,4,5, 2,3,4, 2,3,4,5, and Conditions 5,6,7 6,7,8 5,6,7 6,7,8 5,6,7 6,7,8 5,6,7 6,7,8 Comply with and ALL ALL ALL ALL ALL ALL ALL ALL Use Procedures (1)
Operate Control ALL ALL ALL ALL ALL Boards (2)
Communicate ALL ALL ALL ALL ALL ALL ALL ALL and Interact Demonstrate ALL ALL ALL Supervisory Ability (3)
Comply with and 2,5 2,4 2,5 Use TS (3)
Notes:
(1) Includes TS compliance for an RO.
(2) Optional for an SRO-U.
(3) Only applicable to SROs.
Instructions:
Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant. (This includes all rating factors for each competency.) (Forms ES-303-1 and ES-303-3 describe the competency rating factors.)
ES-301 Competencies Checklist Form ES-301-6 Facility: SURRY Date of Examination: 08/23/2021 Operating Test No.: 2021-301 APPLICANTS RO RO RO RO SRO-I SRO-I SRO-I SRO-I SRO-U(2,3) SRO-U SRO-U SRO-U Competencies SCENARIO SCENARIO SCENARIO SCENARIO 3 4 Interpret/Diagnose Events 2,3,4,5, 2,3,4,5 and Conditions 6,7 ,6,7,8 Comply with and ALL ALL Use Procedures (1)
Operate Control ALL Boards (2)
Communicate ALL ALL and Interact Demonstrate ALL Supervisory Ability (3)
Comply with and 2,4 Use TS (3)
Notes:
(1) Includes TS compliance for an RO.
(2) Optional for an SRO-U.
(3) Only applicable to SROs.
Instructions:
Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant. (This includes all rating factors for each competency.) (Forms ES-303-1 and ES-303-3 describe the competency rating factors.)
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Surry Exam Date: August 2021 1 2 3 4 5 6 Attributes Job Content ADMIN Topic LOD Admin JPMs U/E/S Explanation and K/A (1-5) I/C Critical Scope Perf. Job Cues Overlap Key Minutia Focus Steps (N/B) Std. Link RO-COO-1 G2.1.19 3 S RO-COO-2 G2.1.5 3 E See attached RO-EC G2.2.13 3 x x E See attached RO-RC G2.3.7 3 S SRO-COO-1 G2.2.12 2 x E See attached SRO-COO-2 G2.1.40 3 x x E See attached SRO-EC G2.1.20 2 x E See attached SRO-RC G2.3.13 2 x x E See attached SRO-EP G2.4.41/44 1 U See attached 1
Simulator/In-Plant Safety Function JPMs and K/A A 1/ 024AA1.17 3 S B 2/ 013A4.01 3 x E See attached C 3/ 038EA1.04 3 E See attached D 4P/ 005A2.03 3 x E See attached E 5/ 028A4.03 2 S F 6/ 064.A4.06 3 x x E See attached G 7/ 015A1.01 2 S H 8/ 036AA1.01 2 x x E See attached 4S/ 038 I G2.1.30 2 x E See attached 6/
J APE068AA1.31 2 x E See attached 8/
K 1 x x E See attached 036G2.1.44
ES-301 2 Form ES-301-7 Instructions for Completing This Table:
Check or mark any item(s) requiring a comment and explain the issue in the space provided using the guide below.
- 1. Check each JPM for appropriate administrative topic requirements (COO, EC, Rad, and EP) or safety function requirements and corresponding K/A. Mark in column 1.
(ES-301, D.3 and D.4)
- 2. Determine the level of difficulty (LOD) using an established 1-5 rating scale. Levels 1 and 5 represent an inappropriate (low or high) discriminatory level for the license that is being tested. Mark in column 2 (Appendix D, C.1.f)
- 3. In column 3, Attributes, check the appropriate box when an attribute is not met:
The initial conditions and/or initiating cue is clear to ensure the operator understands the task and how to begin. (Appendix C, B.4)
The JPM contains appropriate cues that clearly indicate when they should be provided to the examinee. Cues are objective and not leading. (Appendix C, D.1)
All critical steps (elements) are properly identified.
The scope of the task is not too narrow (N) or too broad (B).
Excessive overlap does not occur with other parts of the operating test or written examination. (ES-301, D.1.a, and ES-301, D.2.a)
The task performance standard clearly describes the expected outcome (i.e., end state). Each performance step identifies a standard for successful completion of the step.
A valid marked up key was provided (e.g., graph interpretation, initialed steps for handouts).
- 4. For column 4, Job Content, check the appropriate box if the job content flaw does not meet the following elements:
Topics are linked to the job content (e.g., not a disguised task, task required in real job).
The JPM has meaningful performance requirements that will provide a legitimate basis for evaluating the applicant's understanding and ability to safely operate the plant. (ES-301, D.2.c)
- 5. Based on the reviewers judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)nhancement, or (S)atisfactory? Mark the answer in column 5.
- 6. In column 6, provide a brief description of any (U)nacceptable or (E)nhancement rating from column 5.
Save initial review comments and detail subsequent comment resolution so that each exam-bound JPM is marked by a (S)atisfactory resolution on this form.
ES-301 3 Form ES-301-7 Facility: Surry Scenario: ONE Exam Date: August 2021 1 2 3 4 5 6 7 8 9 10 Required Verifiable Scen.
Event Realism/Cred. LOD TS CTs U/E/S Explanation Actions actions Overlap 1 S 2 x E See attached 3 S 4 S 5 S 6 S 7 S
ES-301 4 Form ES-301-7 Facility: Surry Scenario: THREE Exam Date: August 2021 1 2 3 4 5 6 7 8 9 10 Scen.
Required Verifiable Event Realism/Cred. LOD TS CTs Overlap U/E/S Explanation Actions actions 1
1 S 2 S 3 S 4 S 5 S 6 S
ES-301 5 Form ES-301-7 Facility: Surry Scenario: FOUR Exam Date: August 2021 1 2 3 4 5 6 7 8 9 10 Required Verifiable Scen.
Event Realism/Cred. LOD TS CTs U/E/S Explanation Actions actions Overlap 1 S 2 S 3 S 4 S 5 X E See Attached 6 S 7 S 8 S
ES-301 6 Form ES-301-7 Facility: Surry Scenario: FIVE Exam Date: August 2021 1 2 3 4 5 6 7 8 9 10 Required Verifiable Scen.
Event Realism/Cred. LOD TS CTs U/E/S Explanation Actions actions Overlap 1 X E See Attached 2 S 3 X E See Attached 4 S 5 S 6 X X E See Attached 7 S Facility: Exam Date:
1 2 3 4 5 6 7 8 11 Scenario % Unsat. Explanation Event Events TS TS CT CT Scenario U/E/S Totals Unsat. Total Unsat. Total Unsat.
Elements
ES-301 7 Form ES-301-7 Instructions for Completing This Table:
Check or mark any item(s) requiring comment and explain the issue in the space provided.
1, 3, 5 For each simulator scenario, enter the total number of events (column 1), TS entries/actions (column 3), and CTs (column 5).
This number should match the respective scenario from the event-based scenario tables (the sum from columns 1, 6, and 7, respectively).
2, 4, 6 For each simulator scenario, evaluate each event, TS, and CT as (S)atisfactory, (E)nhance, or (U)nsatisfactory based on the following criteria:
- a. Events. Each event is described on a Form ES-D-2, including all switch manipulations, pertinent alarms, and verifiable actions. Event actions are balanced between at-the-controls and balance-of-plant applicants during the scenario. All event-related attributes on Form ES-301-4 are met. Enter the total number of unsatisfactory events in column 2.
- b. TS. A scenario includes at least two TS entries/actions across at least two different events. TS entries and actions are detailed on Form ES-D-2. Enter the total number of unsatisfactory TS entries/actions in column 4. (ES-301, D.5d)
- c. CT. Check that a scenario includes at least two preidentified CTs. This criterion is a target quantitative attribute, not an absolute minimum requirement. Check that each CT is explicitly bounded on Form ES-D-2 with measurable performance standards (see Appendix D). Enter the total number of unsatisfactory CTs in column 6.
2+4+6 7 In column 7, calculate the percentage of unsatisfactory scenario elements: 100%
1+3+5 8 If the value in column 7 is > 20%, mark the scenario as (U)nsatisfactory in column 8. If column 7 is 20%, annotate with (E)nhancement or (S)atisfactory.
9 In column 9, explain each unsatisfactory event, TS, and CT. Editorial comments can also be added here.
Save initial review comments and detail subsequent comment resolution so that each exam-bound scenario is marked by a (S)atisfactory resolution on this form.
ES-301 8 Form ES-301-7 Site name: SURRY Exam Date: August 2021 OPERATING TEST TOTALS Total Total Total %
Total Explanation Unsat. Edits Sat. Unsat.
Admin.
9 1 7 1 JPMs Sim./In-Plant 11 0 8 3 JPMs Scenarios 4 0 5 1 Op. Test 24 1 20 5 4%
Totals:
Instructions for Completing This Table:
Update data for this table from quality reviews and totals in the previous tables and then calculate the percentage of total items that are unsatisfactory and give an explanation in the space provided.
- 1. Enter the total number of items submitted for the operating test in the Total column. For example, if nine administrative JPMs were submitted, enter 9 in the Total items column for administrative JPMs.
For scenarios, enter the total number of simulator scenarios.
Enter the total number of (U)nsatisfactory JPMs and scenarios from the two JPMs column 5 and 2.
simulator scenarios column 8 in the previous tables. Provide an explanation in the space provided.
Enter totals for (E)nhancements needed and (S)atisfactory JPMs and scenarios from the previous 3.
tables. This task is for tracking only.
- 4. Total each column and enter the amounts in the Op. Test Totals row.
Calculate the percentage of the operating test that is (U)nsatisfactory (Op. Test Total Unsat.)/(Op. Test 5.
Total) and place this value in the bolded % Unsat. cell.
Refer to ES-501, E.3.a, to rate the overall operating test as follows:
- satisfactory, if the Op. Test Total % Unsat. is 20%
- unsatisfactory, if Op. Test Total % Unsat. is > 20%
Update this table and the tables above with post-exam changes if the as-administered operating test 6.
required content changes, including the following:
- The JPM performance standards were incorrect.
- The administrative JPM tasks/keys were incorrect.
- CTs were incorrect in the scenarios (not including postscenario critical tasks defined in Appendix D).
- The EOP strategy was incorrect in a scenario(s).
- TS entries/actions were determined to be incorrect in a scenario(s).
Surry August 2021 Draft Op Test Comments JPM Comments For ADMIN JPMS:
During PREP week (July 19-23), can you prepare a classroom with laptops loaded with plant reference disks so we can administer the JPMs to the validators in the same place/setting that well be administering during exam week?
SECURE EXAM MATERIAL Page 1 of 27
Surry August 2021 Draft Op Test Comments ADMIN JPM Comments RO CONDUCT OF OPS (RO-COO-1): Perform Manual Calorimetric 1-OPT-RX-003, Reactor Power Calorimetric Using Feed Flow and PCS Computer Points (Manual), Section 6.1, Data Collection, and Section 6.2, Calculating Reactor Power Using Manual Method, and Attachment 3, Calorimetric Data Sheet The JPM is acceptable.
SECURE EXAM MATERIAL Page 2 of 27
Surry August 2021 Draft Op Test Comments ADMIN JPM Comments RO CONDUCT OF OPS (RO-COO-2): Determine Shift Core Crew Composition OP-AA-100, Conduct of Operations The JPM is acceptable.
SECURE EXAM MATERIAL Page 3 of 27
Surry August 2021 Draft Op Test Comments RO EQUIPMENT CONTROL (RO-EC): Determine Tagging Boundaries OP-AA-200, Equipment Clearance 11448-FM-124A, Sheet 2 11448-FE-1K Critical Steps: Why isnt there some aspect of the tagging SEQUENCE thats critical?
I/C Focus: Does the initiating cue sheet need to include the statement 1-RT-S-1B will not be removed from the system?
7-8-21: Three broad categories for sequence (Breaker-ISV-Vent/Drains). Will include statement on 1-RT-S-1B.
SECURE EXAM MATERIAL Page 4 of 27
Surry August 2021 Draft Op Test Comments ADMIN JPM Comments RO RADIATION CONTROL (RO-RC): Verify RWP Adequate VPAP-2101, Radiation Protection Program, Section 6.3, External Radiation Exposure Control Rad Work Permit The JPM is acceptable.
SECURE EXAM MATERIAL Page 5 of 27
Surry August 2021 Draft Op Test Comments ADMIN JPM Comments SRO CONDUCT OF OPS (SRO-COO-1): Review Component Cooling (CC) Water PT 1-PT-41.1, Component Cooling Water Pumps Performance Test Perf Std: In the overall task standard, and in JPM Step 7, the word clock can be enhanced with the detail of the required action. For example:
Applicant determines that Specification 3.13.B requires restoring three CCW Pumps to operable within 24 hours2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br />. If three pumps cannot be restored to operable within 24 hours2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br />, then the reactor must be placed in hot shutdown within the next 6 hours6.944444e-5 days <br />0.00167 hours <br />9.920635e-6 weeks <br />2.283e-6 months <br />.
7-8-21: Will incorporate.
SECURE EXAM MATERIAL Page 6 of 27
Surry August 2021 Draft Op Test Comments ADMIN JPM Comments SRO CONDUCT OF OPS (SRO-COO-2): Authorize Fuel Movement 1-OSP-ZZ-004, U1 Safety Systems Status List For Cold Shutdown/Refueling Conditions, Attachment 8, Refueling Operations Requirements (Proposed setting for JPM topic is static simulator.)
Cue: The title/number of 1-OSP-ZZ-004 probably isnt needed on the task sheet provided to the applicants; this is part of the knowledge the Admin JPM should be testing. Its more operationally valid to ask the SRO applicants to verify plant conditions will / will not support fuel movement (without providing title/number of procedure) because this is the way it would be said to the applicant in the actual plant. Testing the applicants knowledge of the procedure to reference can be part of this JPM.
Suggest deleting the 2nd sentence in the first bullet on the cue sheet, and modify the Initiating Cue Statement as follows:
You are to verify plant conditions support fuel movement (core offload).
If conditions do NOT allow Refueling Operations to begin, then list ALL issues that must be resolved to allow fuel movement to commence.
If existing plant conditions support fuel movement then notify the examiner that fuel movement may begin.
Cue: Why does the initial conditions provided to the applicant tell them that 0-RMA-D6, VENT STACK #2 PART ALERT/HI has just alarmed? Wont they be able to see the failed rad monitor while performing Attachment 8?
Perf Std: JPM Step 12 should include the number/title of Tech Spec 3.10-4.
Perf Std: The overall task standard should specify that ONLY the two conditions must be identified; in the overall task standard say that identification of any other conditions constitutes unsatisfactory performance.
7-8-21: Pre-shift checklist would include this procedure; when taking the watch procedure will be at the watch for off-going SRO. Cue will be deleted. Perf Stds corrected.
SECURE EXAM MATERIAL Page 7 of 27
Surry August 2021 Draft Op Test Comments ADMIN JPM Comments SRO EQUIPMENT CONTROL (SRO-EC): Calculate Partial Pressure & Make TS Call ARP 1B-A6, CTMT PART PRESS -0.1 PSI CH1, Attachment 2, Calculation of CTMT Air Partial Pressure Tech Spec 3.8.D, Containment - Internal Pressure Perf Std: The last bullet in the overall task standard, and the standard for JPM Step 7, should be more specific with respect to the Tech Spec determination. For example:
Determines that Tech Spec 3.8.d.1.a is required; restore air partial pressure to within acceptable limits within 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> or be in at least Hot Shutdown within the next 6 hours6.944444e-5 days <br />0.00167 hours <br />9.920635e-6 weeks <br />2.283e-6 months <br />.
Ensure that Tech Spec Figure 3.8-1 is NOT provided to the applicants as part of their initiating cue task sheet package.
7-8-21: Incorporated both comments.
SECURE EXAM MATERIAL Page 8 of 27
Surry August 2021 Draft Op Test Comments ADMIN JPM Comments SRO RADIATION CONTROL (SRO-RC): Perform Containment Entry Checklist VPAP-0106, Subatmospheric Containment Entry, Attachment 1, Containment Entry Checklist Perf Std: To ensure the Tech Spec piece will be hit on this JPM (the only real SRO piece),
we should modify the initiating cue to the applicants (on their task cue sheet), the overall task standard, and the standard for JPM Step 2, to somehow require the applicants to identify that Tech Spec 3.8.B.1.b will be exceeded if the containment entry were performed.
LOD: An applicant can know right away that containment entry isnt allowed solely because of flux mapping going on (radiation danger). To fix this, in the initial conditions, the sentence Unit 2 flux mapping has just commenced to satisfy a Tech Spec requirement could be more specific with respect to the surveillance procedures number/title. Suggest only including the name/number of the surveillance procedure being performed instead of saying flux mapping. Test the applicants knowledge that a specific surveillance content involves flux mapping instead of straight out telling them flux mapping is in progress.
Cues: Suggest removing the name/number of VPAP-0106 on the examinee handout, i.e.,
part of what the JPM could evaluate is whether the applicants know where to go to perform the containment entry. Its okay that part of the applicant handout contains the VPAP-0106 reference, but all other items like the following can be removed from the cue sheet:
Initiating Cues
- A new VPAP-0106 Attachment 1, Containment Entry Checklist has been initiated.
- You have been direct to assume the roles of Responsible Supervisor/Shift Manager for the next Unit 2 Containment entry.
- Your task is to determine whether or not Unit 2 Containment Entry is permitted. If you identify that containment entry cannot be performed, provide the reason(s) and/or applicable Tech Spec requirements that prohibit entry.
Cues: The attachment to the cue sheet may not be needed for this JPM; it may provide a cue that there are conflicts to entering the containment.
7-8-21: Perf Std comment incorporated.
SECURE EXAM MATERIAL Page 9 of 27
Surry August 2021 Draft Op Test Comments ADMIN JPM Comments SRO EMERGENCY PLAN (SRO-EP): Classify GE and Determine PAR EPIP-1.01, Emergency Manager Controlling Procedure, Steps 1 - 3 EAL Matrices EPIP-1.06, Protective Action Recommendations LOD: There needs to be a plausible distracter where the applicant would conceivably NOT classify the correct event; need to ensure the initial conditions, etc. dont point the applicant to the exact classification. The proposed JPM has no plausible distracter; similar to direct lookup.
The JPM should be re-worked such that all applicants receive both parts of the JPM; we want to avoid a situation where an applicant doesnt get to take both parts of the JPM and situations involving two separate rooms. The 1st part of the JPM should only be classifying the event (GE, Site, Alert, NOUE) and the applicants must immediately raise their hand so the examiner can log their completion time and provide them with the Emergency Notification Form. The 2nd part of the JPM should be completing the ENF Form, including PAR if applicable.
6-15-21: Revised to make 1st part classification, 2nd part is PAR only. Both parts time critical. Changed to add initial conditions indications of excessive high RCS activity, U1 ramping off-line. SGTR + SG Safety Valve opens (three fission product barriers).
The plausible distracter added is Vent Stack #2 7x107 (Site Emergency only). KI determination also required.
SECURE EXAM MATERIAL Page 10 of 27
Surry August 2021 Draft Op Test Comments Simulator JPMs JPM A: Emerg Borate RCS per 1-AP-3.00 (SF1: Reactivity Control) (ALT PATH) 1-AP-3.00, Emergency Boration The JPM is acceptable.
Ensure no overlap with any of the scenarios; do any of the scenarios deal with the boration flow path not working? Audit Exam?
SECURE EXAM MATERIAL Page 11 of 27
Surry August 2021 Draft Op Test Comments Simulator JPMs JPM B: Transfer SI to Cold Leg Recirc (SF2: Inventory Control) (ALT PATH) 1-ES-1.3, Transfer to Cold Leg Recirculation, Steps 1 - 5 Perf Std: For JPM Steps 14 and 15, add a note to the examiner for why its critical to CLOSE one valve only after the other valve is FULL open.
Ensure no overlap with LBLOCA Scenario and Audit exam.
7-8-21: Added basis note to examiner.
SECURE EXAM MATERIAL Page 12 of 27
Surry August 2021 Draft Op Test Comments Simulator JPMs JPM C: Depressurize RCS to minimize SGTR break flow (SF3: Pressure Control) 1-E-3, SGTR, Step 19 The K/A link is incorrect.
7-8-21: Still need to fix.
SECURE EXAM MATERIAL Page 13 of 27
Surry August 2021 Draft Op Test Comments Simulator JPMs JPM D: Respond to Loss Decay Heat Removal (SF4P: Heat Removal Primary) (ALT PATH) 1-OP-ZZ-002, Maintenance of Plant Operations, Section 5.16, Adjusting RHR Temperature 1-AP-27.00, Loss of Decay Heat Removal Capability Critical Steps: Part of what the JPM must evaluate is the applicants ability to adjust RHR temperature in Section 5.16. JPM Step 1 should have a critical aspect; the examiner should verify that the RCS temperature trend begins to stabilize before continuing with the alternate path portion of the JPM. Can we make Step 1 critical to at least cause RCS temperature trend to go in the right direction?
Perf Std: The initiating cue directs the applicants to stop the lowering RCS trend; however, the standard in JPM Step 1 says the applicant should OPEN the RHR HXS FLOW further.
Wont this cause the RCS lowering temperature trend to continue?
7-8-21: Re-snap JPM so that temp is stable and first task is to start lowering temperature (critical).
Up to examiner how long he waits. New cue will be to lower RCS temperature to a band, then stabilize. JPM Step 1 corrected.
SECURE EXAM MATERIAL Page 14 of 27
Surry August 2021 Draft Op Test Comments Simulator JPMs JPM E: Place Containment H2 Analyzer Inservice (SF5: Containment) 1-E-1, Loss of Reactor or Secondary Coolant, Attachment 2, Hydrogen Analyzer Operation The JPM is acceptable.
SECURE EXAM MATERIAL Page 15 of 27
Surry August 2021 Draft Op Test Comments Simulator JPMs JPM F: Respond to #3 EDG Start Failure & Load 1J 4160V Bus (SF6: Electrical) (ALT PATH) 0-AP-17.05, EDG 3 - Emergency Operations, Steps 1-15, Attachment 2, Auto Start Failure of EDG3 - Contingency Actions Overlap: Does this JPM overlap with In-Plant JPM J?
I/C Focus: Do you think the applicants will misinterpret their initiating cue statement to mean theyre only responsible for Attachment 2? Will they also understand that they have responsibility for implementing 0-AP-17.05? (The JPM is designed for the applicant to start in Attachment 2 and then go to the body of 0-AP-17.05.)
At procedure Step 15.c, to raise incoming voltage to 120 volts, If an applicant continues on in the procedure, can the #3 EDG be loaded? We may need to discuss how the EDG will be damaged if the applicant doesnt recognize that incoming voltage cant be raised greater than 113 volts.
7-8-21: Procedure Step 15.c comment: Breaker can still be closed, but the current is significantly higher. Failure criteria added so that applicant fails JPM if they continue.
SECURE EXAM MATERIAL Page 16 of 27
Surry August 2021 Draft Op Test Comments Simulator JPMs JPM G: Adjust PRNIs (SF7: Instrumentation) 1-OPT-RX-001, Reactor Power Calorimetric Using PCS Computer Program, Section 6.2, Adjusting NI Channels, , NI Calibration JPM is acceptable.
SECURE EXAM MATERIAL Page 17 of 27
Surry August 2021 Draft Op Test Comments Simulator JPMs JPM H: MCR pressure boundary verification using AP-22.00 (SF8: Plant Service Systems) 0-AP-22.00, Fuel Handling Abnormal Conditions, Steps 1 - 10 TIME CRITICAL JPM The K/A assigned to this JPM topic is APE 036, Fuel Handling Incidents, AA1.01, Ability to operate and/or monitor Reactor Building Containment Purge Ventilation System as it applies to Fuel Handling Incidents. Form ES-401-2 (T1G2) identifies APE 036 as SF8 (Plant Service Systems). However, the following two issues exist:
o In the JPM, the applicants dont operate the Reactor Building Containment Purge Ventilation System; instead, they are tasked with operating the MCR HVAC equipment.
o In the BWR K/A Catalog, the Control Room HVAC System is listed under SF9, Radioactivity Release. [Note: The PWR K/A Catalog is missing the Control Room HVAC topic, as previously identified in OL Feedback Item 401.51.]
Suggest re-linking the APE 036 topic to Generic K/A G2.1.44: Knowledge of RO duties in the control room during fuel handling, such as responding to alarms from the fuel handling area, communication with the fuel storage facility, systems operated from the control room in support of fueling operations, and supporting instrumentation..
By relinking the APE 036 topic to Generic K/A G2.1.44, I think it makes the JPM task a better fit for Safety Function 8.
Critical Steps: Why is the JPM TIME CRITICAL? Is this a typo? IF the JPM is time critical, then the applicants initiating cue sheet must inform them its time critical, and the overall task standard must be revised.
Overlap: Does this JPM overlap with In-Plant JPM k?
7-8-21: Time critical portion deleted. Re-linked.
SECURE EXAM MATERIAL Page 18 of 27
Surry August 2021 Draft Op Test Comments IN-PLANT JPMS JPM i: Locally Isolate U2 S/G PORV & TDAFW Pump (SF4S: Secondary Heat Removal) (ALT PATH) 2-E-3, SGTR, Step 3 Scope: The JPM is alternate path even though its cover sheet is not labeled as an alternate path. IF you desire to use this as an alternate path JPM, THEN we will have too many alternate path JPMs (i.e., well have 6, which makes us vulnerable). I didnt think this JPM was supposed to be alternate path?
If you make JPM Step 2 work (see below), itll fix the alternate path issue; however, the JPM will only have two steps in it. Is there something else we could add to it?
7-8-21: Alternate path deleted; chain valve will work. Will add an additional SG to use chain valves to close.
SECURE EXAM MATERIAL Page 19 of 27
Surry August 2021 Draft Op Test Comments IN-PLANT JPMS JPM J: Locally Start EDG (SF6: Electrical) (ALT PATH) 0-FCA-12.00, Fire Contingency Action - EDG Operation, Step 31, then back to Steps 9 - 20 Overlap: Does this JPM overlap with Sim JPM F?
SECURE EXAM MATERIAL Page 20 of 27
Surry August 2021 Draft Op Test Comments IN-PLANT JPMS JPM K: MCR Pressure Boundary Verification (SF8: Plant Service System) 0-AP-22.00, Fuel Handling Abnormal Conditions, Step 11 and Attachment 1, MCR Pressure Boundary Verification, Steps 1-3 LOD: Does the JPM only involve opening the breakers in Step 3? At least everything isnt at the same location and involves different voltages. If this isnt true let me know.
Critical Steps: The critical steps are missing the CRITICAL STEP identifier at the beginning of each JPM step.
JPM Step 1: We need to be consistent with ALL evaluators for the following guidance, i.e., the phrase At the evaluators discretion.. should be eliminated. IF we decide to use the screen shots of the 8 listed P indications, then they are missing from the JPM.
Any breaker panels have to be opened for Ckt 1 & 2 in 1-EP-DB-HVAC and 2-EP-DB-HVAC?
We could provide pictures on the panel internals if necessary to avoid opening panel doors during administration of the in-plant JPM.
Overlap: Does this JPM overlap with Sim JPM H?
SECURE EXAM MATERIAL Page 21 of 27
Surry August 2021 Draft Op Test Comments 7-8-21: On Unit 1 & 2 there are four breakers; applicant has to do eight breakers. For Unit 1, there are two different locations, and breakers are 220V and 480V breakers. We should have pictures.
SECURE EXAM MATERIAL Page 22 of 27
Surry August 2021 Draft Op Test Comments Scenario Comments SECURE EXAM MATERIAL Page 23 of 27
Surry August 2021 Draft Op Test Comments NRC Scenario 1: SBLOCA (79% power)
Event 1 - Raise Power (R-RO/N-BOP)
Event 2 - Turb 1st Stage PT fails low (BOP + TS SRO)
[CT: Place rods in manual before 1G-H8 alarms (Rod insertion limit extra low]
We dont need another CT for this scenario; reaching LO-LO Insertion Limit may not be critical task.
Appears that credit should be only for RO; will BOP indeed have to place FRVs in MAN?
- Event 3 - NRHX Outlet TT TE-1144 fails low (RO)
Event 4 - Loss of the 1G Screenwell Bus (BOP)
[CT: Restart CW pumps before auto or manual reactor trip]
Event 5 - PZR PT-1444 fails high (RO + TS SRO)
[CT: Control PZR pressure to prevent auto OR manual reactor trip]
- Event 6 - MAJOR EVENT #1: Main Feed Pump Trip + ATWS
[CT: Reduce load OR close MSTVs before PZR Safety Valve Lifts]
How long will it take for safety valve to lift with no operator action? Include in scenario.
- Event 7 - MAJOR EVENT #2: SBLOCA
[CT: Restore HHSI flow prior to RCP Trip Criteria (30°F subcooling)]
- Malfunction after EOP entry - SI Relay S13A Failure (SI-1867C f-t-o, #1 EDG f-t-s, Trip Vlvs f-t-c, FW-P-3B f-t-s)
- Malfunction after EOP entry - 1C Charging Pump trip
- RO: 1 reactivity, 2 I/Cs
- BOP: 1 normal, 2 I/Cs
- SRO: 2 TS
- Manual control of auto-function: E3, E5
- Instrument/component malfunctions after EOP entry = two
- EOPs entered = one (E1)
- EOP contingencies = one (FR-S.1)
- *Scenario is significantly modified from 2017 and 2019 exams, IAW ES-301 pg 15, Appendix D pg D-7, and OL Feedback Item 301.20; Events 3, 6, & 7 are new.
SECURE EXAM MATERIAL Page 24 of 27
Surry August 2021 Draft Op Test Comments NRC Scenario #3: MSL Header Break & Faulted SG (100%)
Event 1 - Lower Power (R-RO/N-BOP)
Typo in scenario guide; still has N44 - - do find-and-replace throughout scenario.
Event 3 - Condensate Pump A Trip; Standby f-t-s (BOP)
[CT: Start standby pump before auto or manual reactor trip]
Event 4 - PZR Master Controller Fails Low (pressure rises) (RO + SRO TS)
[CT: Start one MDAFW Pump before SG WR Level @ 12% (Feed & Bleed Criteria)]
[CT: Minimize AFW flow rate (but not less than 60 gpm to each SG) if RCS cooldown rate is >100F/hr before FR-P.1 entry is required]
- Malfunction after EOP entry CH-MOV-1381 & VS-MOD-103B f-t-c
- RO: 1 reactivity + 2 I/Cs
- BOP: 1 normal + 3 I/Cs
- SRO: 2 TS
- Manual control of auto-function: E4
- Instrument/component malfunctions after EOP entry = three
- EOPs entered = one (E2)
- EOP contingencies = two (FR-H.1, ECA-2.1)
- *Scenario is significantly modified from 2017 and 2019 exams, IAW ES-301 pg 15, Appendix D pg D-7, and OL Feedback Item 301.20.
SECURE EXAM MATERIAL Page 25 of 27
Surry August 2021 Draft Op Test Comments NRC Scenario #4: SBLOCA, LBLOCA (5%)
Event 1 - Synchronize Generator (R-RO/N-BOP)
[Surrogate operator controlling FRVs in manual]
Pre-brief can help with saving time on this event; need to make sure applicants have ample pre-brief.
Event 2 - CC Rad Monitor Fails; CC-100 vent f-t-c (BOP + SRO TS)
Event 3 - Charging Flow Controller Fails Hi (RO)
Event 4 - EH Pump Trip; Standby f-t-s (BOP)
[CT: Start Standby EH Pump before auto turbine/reactor trip]
Event 5 - CH SW Pump A Trip; Standby f-t-s (RO + SRO TS)
[CT: Start Standby CH SW Pump before 185F bearing temperature, to prevent loss of pump for LBLOCA]
We dont need another CT; losing the SI pump may not be CT
- Event 6 - Dropped Rod requires manual reactor trip (RO)
- Event 7 - MAJOR EVENT #1: SBLOCA
- Malfunction after EOP entry - LHSI Pumps f-t-s
[CT: Start one LHSI Pump before FR-C.1 entry required]
Event 8 - MAJOR EVENT #2: LBLOCA
[CT: Start one CS Pump within 15 minutes after containment pressure reaches 23 psia-EAL escalation]
- RO: 1 reactivity + 2 I/Cs
- BOP: 1 normal + 2 I/Cs
- SRO: 2 TS
- Manual control of auto-function: E3
- Instrument/component malfunctions after EOP entry = two
- EOPs entered = one (E1)
- EOP contingencies = one (FR-Z.1)
- *Scenario is significantly modified from 2017 and 2019 exams, IAW ES-301 pg 15, Appendix D pg D-7, and OL Feedback Item 301.20.
SECURE EXAM MATERIAL Page 26 of 27
Surry August 2021 Draft Op Test Comments NRC Scenario #5: SGTR (100%)
Event 1 - PORV Test; Block Valve Breaker Trip (N-RO + SRO TS)
Typo, the event description says the BOP will perform; revise to say RO is performing.
Event 2 - PZR LT Fails Low (RO + SRO TS)
Event 3 - B SG FRV Controller Fails Low (BOP)
[CT: Control SG level before auto or manual reactor trip]
Typo, the event description is missing the critical task information Event 4 - SG B PORV Fails Open (BOP)
- Event 5 - Isophase Bus Duct Hi Temp- Lower Power (R-RO + N-BOP)
Event 6 - SGTL- 20 gpm + failure of Air Ejector Rad Monitor auto-swap (RO + BOP)
[CT: Align Air Ejector discharge to containment before SGTR occurs; prevent release to environment]
This may not be a CT unless the NOUE release rate is reached with no operator action during subsequent SGTR Will there be a Tech Spec call for the tube leak?
Event 7 - MAJOR EVENT: SGTR - 600 gpm
[CT: Isolate FW Flow to SG before NR level reaches 100%; loading on MS lines]
- RO: 1 normal + 2 I/Cs + 1 normal
- BOP: 2 I/Cs + 1 normal
- SRO: 2 TS
- Manual control of auto-function: E2
- Instrument/component malfunctions after EOP entry = one
- EOPs entered = one (E3)
- EOP contingencies = one (ECA-3.3)
- *Scenario is significantly modified from 2017 and 2019 exams, IAW ES-301 pg 15, Appendix D pg D-7, and OL Feedback Item 301.20.
SECURE EXAM MATERIAL Page 27 of 27
ES-401, Rev. 11 PWR Examination Outline Form ES-401-2 Facility: SURRY Date of Exam: 2021 RO K/A Category Points SRO-Only Points Tier Group K K K K K K A A A A G A2 G* Total 1 2 3 4 5 6 1 2 3 4
- Total
- 1. 1 3 3 3 3 3 3 18 18 3 3 6 6
Emergency &
2 1 2 1 1 2 2 99 2 2 4 4
Abnormal Plant N/A N/A Evolutions Tier Totals 4 5 4 4 5 5 27 27 5 5 10 10 1 1 3 2 3 3 2 3 3 2 3 3 28 28 3 2 5
- 2. 2 2 1 1 0 1 1 1 1 1 1 1 1 10 10 1 3 Plant Systems Tier Totals 2 4 2 4 4 3 4 4 3 4 4 38 38 3 8
- 3. Generic Knowledge and Abilities 1 2 3 4 10 1 2 3 4 7 Categories 2 2 3 3 1 2 2 2 Note:
- 1. Ensure that at least two topics from every applicable K/A category are sampled within each tier of the RO and SRO-only outline sections (i.e., except for one category in Tier 3 of the SRO-only section, the Tier Totals in each K/A category shall not be less than two). (One Tier 3 radiation control K/A is allowed if it is replaced by a K/A from another Tier 3 category.)
- 2. The point total for each group and tier in the proposed outline must match that specified in the table. The final point total for each group and tier may deviate by +/-1 from that specified in the table based on NRC revisions. The final RO exam must total 75 points, and the SRO-only exam must total 25 points.
- 3. Systems/evolutions within each group are identified on the outline. Systems or evolutions that do not apply at the facility should be deleted with justification.
Operationally important, site-specific systems/evolutions that are not included on the outline should be added. Refer to Section D.1.b of ES-401 for guidance regarding the elimination of inappropriate K/A statements.
- 4. Select topics from as many systems and evolutions as possible. Sample every system or evolution in the group before selecting a second topic for any system or evolution.
- 5. Absent a plant-specific priority, only those K/As having an importance rating (IR) of 2.5 or higher shall be selected. Use the RO and SRO ratings for the RO and SRO-only portions, respectively.
- 6. Select SRO topics for Tiers 1 and 2 from the shaded systems and K/A categories.
- 7. The generic (G) K/As in Tiers 1 and 2 shall be selected from Section 2 of the K/A catalog, but the topics must be relevant to the applicable evolution or system. Refer to Section D.1.b of ES-401 for the applicable K/As.
- 8. On the following pages, enter the K/A numbers, a brief description of each topic, the topics IRs for the applicable license level, and the point totals (#) for each system and category. Enter the group and tier totals for each category in the table above. If fuel-handling equipment is sampled in a category other than Category A2 or G* on the SRO-only exam, enter it on the left side of Column A2 for Tier 2, Group 2. (Note 1 does not apply). Use duplicate pages for RO and SRO-only exams.
- 9. For Tier 3, select topics from Section 2 of the K/A catalog and enter the K/A numbers, descriptions, IRs, and point totals (#) on Form ES-401-3. Limit SRO selections to K/As that are linked to 10 CFR 55.43.
G* Generic K/As
- These systems/evolutions must be included as part of the sample (as applicable to the facility) when Revision 3 of the K/A catalog is used to develop the sample plan. They are not required to be included when using earlier revisions of the K/A catalog.
- These systems/evolutions may be eliminated from the sample (as applicable to the facility) when Revision 3 of the K/A catalog is used to develop the sample plan.
ES-401, REV 11 T1G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:
RO SRO 007EK2.03 Reactor Trip - Stabilization - Recovery 3.5 3.6 Reactor trip status panel
/1 SEE LIST OF REJECTED K/As Form ES-401-4 008AA1.02 Pressurizer Vapor Space Accident / 3 4.1 3.9 HPI pump to control PZR level/pressure 009EK3.15 Small Break LOCA / 3 3.2 3.2 Closing of RCP thermal barrier outlet valves 011EG2.4.31 Large Break LOCA / 3 4.2 4.1 Knowledge of annunciators alarms, indications or response procedures 022AA2.01 Loss of Rx Coolant Makeup / 2 3.2 3.8 Whether charging line leak exists 025AA1.18 Loss of RHR System / 4 2.6 2.8 LPI header cross-connect valve controller and indicators SEE LIST OF REJECTED K/As Form ES-401-4 027AK2.03 Pressurizer Pressure Control System 2.6 2.8 Controllers and positioners Malfunction / 3 029EK2.06 ATWS / 1 2.9 3.1 Breakers, relays, and disconnects.
038EK1.02 Steam Gen. Tube Rupture / 3 3.2 3.5 Leak rate vs. pressure drop 054AK3.02 Loss of Main Feedwater / 4 3.4 3.7 Matching of feedwater and steam flows 055EG2.1.19 Station Blackout / 6 3.9 3.8 Ability to use plant computer to evaluate system or component status.
Page 1 of 2 8/13/2020 1:59 PM
ES-401, REV 11 T1G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:
RO SRO 057AA2.04 Loss of Vital AC Inst. Bus / 6 3.7 4 ESF system panel alarm annunciators and channel status indicators 058AK3.01 Loss of DC Power / 6 3.4 3.7 Use of dc control power by D/Gs 077AA2.04 Generator Voltage and Electric Grid 3.6 3.6 VARs outside the capability curve Disturbances / 6 WE04EA1.3 LOCA Outside Containment / 3 3.8 4.0 Desired operating results during abnormal and emergency situations.
WE05EG2.2.37 Inadequate Heat Transfer - Loss of 3.6 4.6 Ability to determine operability and/or availability of safety Secondary Heat Sink / 4 related equipment WE11EK1.3 Loss of Emergency Coolant Recirc. / 4 3.6 4.0 Annunciators and conditions indicating signals, and remedial actions associated with the (Loss of Emergency Coolant Recir).
WE12EK1.3 Steam Line Rupture - Excessive Heat 3.4 3.7 Annunciators and conditions indicating signals, and Transfer / 4 remedial actions associated with the (Uncontrolled Depressurization of all Steam Generators).
Page 2 of 2 8/13/2020 1:59 PM
ES-401, REV 11 T1G2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:
RO SRO 005AA2.03 Inoperable/Stuck Control Rod / 1 3.5 4.4 Required actions if more than one rod is stuck or inoperable 028AK2.03 Pressurizer Level Malfunction / 2 2.6 2.9 Controllers and positioners 032AG2.2.37 Loss of Source Range NI / 7 3.6 4.6 Ability to determine operability and/or availability of safety related equipment 033AK3.02 Loss of Intermediate Range NI / 7 3.6 3.9 Guidance contained in EOP for loss of intermediate-range instrumentation 060AA2.03 Accidental Gaseous Radwaste Rel. / 9 3.2 3.9 The steps necessary to isolate a given radioactive-gas leak, using P&IDs 061AK2.01 ARM System Alarms / 7 2.5 2.6 Detectors at each ARM system location 067AA1.09 Plant Fire On-site / 8 3 3.3 Plant fire zone panel (including detector location) 076AG2.2.12 High Reactor Coolant Activity / 9 3.7 4.1 Knowledge of surveillance procedures.
WE09EK1.2 Natural Circ. / 4 3.3 3.7 Normal, abnormal and emergency operating procedures associated with (Natural Circulation Operations).
Page 1 of 1 8/13/2020 2:07 PM
ES-401, REV 11 T2G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:
RO SRO 003A2.02 Reactor Coolant Pump 3.7 3.9 Conditions which exist for an abnormal shutdown of an RCP in comparison to a normal shutdown of an RCP 003K5.03 Reactor Coolant Pump 3.1 3.5 Effects of RCP shutdown on T-ave., including the reason for the unreliability of T-ave. in the shutdown loop 004K4.16 Chemical and Volume Control 2.6 3.0 Temperature at which the temperature control valve automatically diverts flow from the demineralizer to the VCT; reason for this diversion 005A1.05 Residual Heat Removal 3.3 3.3 Detection of and response to presence of water in RHR emergency sump 006K5.02 Emergency Core Cooling 2.8 2.9 Relationship between accumulator volume and pressure 007A1.03 Pressurizer Relief/Quench Tank 2.6 2.7 Monitoring quench tank temperature 008G2.4.6 Component Cooling Water 3.7 4.7 Knowledge symptom based EOP mitigation strategies.
010K5.01 Pressurizer Pressure Control 3.5 4.0 Determination of condition of fluid in PZR, using steam tables 012A2.03 Reactor Protection 3.4 3.7 Incorrect channel bypassing 013K2.01 Engineered Safety Features Actuation 3.6 3.8 ESFAS/safeguards equipment control 022A2.01 Containment Cooling 2.5 2.7 Fan motor over-current Page 1 of 3 8/12/2020 11:46 AM
ES-401, REV 11 T2G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:
RO SRO 022K2.01 Containment Cooling 3.0 3.1 Containment cooling fans 026A4.01 Containment Spray 4.5 4.3 CSS controls 039K1.02 Main and Reheat Steam 3.3 3.3 Atmospheric relief dump valves 059G2.1.32 Main Feedwater 3.8 4.0 Ability to explain and apply all system limits and precautions.
059G2.4.1 Main Feedwater 4.6 4.8 Knowledge of EOP entry conditions and immediate action steps.
061A1.02 Auxiliary/Emergency Feedwater 3.3 3.6 S/G pressure 061K6.01 Auxiliary/Emergency Feedwater 2.5 2.8 Controllers and positioners 062K3.01 AC Electrical Distribution 3.5 3.9 Major system loads 063A4.01 DC Electrical Distribution 2.8 3.1 Major breakers and control power fuses 063K3.02 DC Electrical Distribution 3.5 3.7 Components using DC control power 064K6.07 Emergency Diesel Generator 2.7 2.9 Air receivers Page 2 of 3 8/12/2020 11:46 AM
ES-401, REV 11 T2G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:
RO SRO 073K4.01 Process Radiation Monitoring 4.0 4.3 Release termination when radiation exceeds setpoint 073K4.02 Process Radiation Monitoring 3.3 3.9 Letdown isolation on high-RCS activity SEE LIST OF REJECTED K/As Form ES-401-4 076A3.02 Service Water 3.7 3.7 Emergency heat loads 076K2.01 Service Water 2.7 2.7 Service water 078A4.01 Instrument Air 3.1 3.1 Pressure gauges 103A3.01 Containment 3.9 4.2 Containment isolation Page 3 of 3 8/12/2020 11:46 AM
ES-401, REV 11 T2G2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:
RO SRO 001A1.08 Control Rod Drive 2.6 3.0 Verification that CRDS temperatures are within limits before starting 002K4.10 Reactor Coolant 4.2 4.4 Overpressure protection 011K2.02 Pressurizer Level Control 3.1 3.2 PZR heaters 017A2.02 In-core Temperature Monitor 3.6 4.1 Core damage 041K6.03 Steam Dump/Turbine Bypass Control 2.7 2.9 Controller and positioners, including ICS, S/G, CRDS 045A4.01 Main Turbine Generator 3.1 2.9 Turbine valve indicators (throttle, governor, control, stop, intercept), alarms and annunciators 055G2.2.44 Condenser Air Removal 4.2 4.4 Ability to interpret control room indications to verify the status and operation of a system, and understand how operator actions and directives affect plant and system conditions 056K1.03 Condensate 2.6 2.6 MFW 068K5.04 Liquid Radwaste 3.2 3.5 Biological hazards of radiation and the resulting goal of ALARA 072A3.01 Area Radiation Monitoring 2.9 3.1 Changes in ventilation alignment Page 1 of 1 8/13/2020 2:22 PM
ES-401, REV 11 T3 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:
RO SRO G2.1.14 Conduct of operations 3.1 3.1 Knowledge of criteria or conditions that require plant-wide announcements, such as pump starts, reactor trip, mode changes, etc.
G2.1.20 Conduct of operations 4.6 4.6 Ability to execute procedure steps.
G2.2.18 Equipment Control 2.6 3.8 Knowledge of the process for managing maintenance activities during shutdown operations.
G2.2.44 Equipment Control 4.2 4.4 Ability to interpret control room indications to verify the status and operation of a system, and understand how operator actions and directives affect plant and system conditions G2.3.11 Radiation Control 3.8 4.3 Ability to control radiation releases.
G2.3.5 Radiation Control 2.9 2.9 Ability to use radiation monitoring systems G2.3.7 Radiation Control 3.5 3.6 Ability to comply with radiation work permit requirements during normal or abnormal conditions G2.4.1 Emergency Procedures/Plans 4.6 4.8 Knowledge of EOP entry conditions and immediate action steps.
G2.4.32 Emergency Procedures/Plans 3.6 4.0 Knowledge of operator response to loss of all annunciators.
G2.4.4 Emergency Procedures/Plans 4.5 4.7 Ability to recognize abnormal indications for system operating parameters which are entry-level conditions for emergency and abnormal operating procedures.
Page 1 of 1 8/12/2020 11:46 AM
ES-401, REV 11 SRO T1G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:
RO SRO 015AA2.01 RCP Malfunctions / 4 3 3.5 Cause of RCP failure 026AG2.4.11 Loss of Component Cooling Water / 8 4.0 4.2 Knowledge of abnormal condition procedures.
040AG2.4.18 Steam Line Rupture - Excessive Heat 3.3 4.0 Knowledge of the specific bases for EOPs.
Transfer / 4 056AG2.4.41 Loss of Off-site Power / 6 2.9 4.6 Knowledge of the emergency action level thresholds and classifications.
062AA2.06 Loss of Nuclear Svc Water / 4 2.8 3.1 The length of time after the loss of SWS flow to a component before that component may be damaged 065AA2.03 Loss of Instrument Air / 8 2.6 2.9 Location and isolation of leaks Page 1 of 1 8/13/2020 9:44 AM
ES-401, REV 11 SRO T1G2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:
RO SRO 003AG2.4.21 Dropped Control Rod / 1 4.0 4.6 Knowledge of the parameters and logic used to assess the status of safety functions 036AA2.03 Fuel Handling Accident / 8 3.1 4.2 Magnitude of potential radioactive release 037AG2.4.6 Steam Generator Tube Leak / 3 3.7 4.7 Knowledge symptom based EOP mitigation strategies.
068AA2.04 Control Room Evac. / 8 3.7 4 S/G pressure Page 1 of 1 8/12/2020 11:47 AM
ES-401, REV 11 SRO T2G1 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:
RO SRO 004G2.4.11 Chemical and Volume Control 4.0 4.2 Knowledge of abnormal condition procedures.
006G2.4.50 Emergency Core Cooling 4.2 4.0 Ability to verify system alarm setpoints and operate controls identified in the alarm response manual.
012A2.02 Reactor Protection 3.6 3.9 Loss of instrument power 059A2.12 Main Feedwater 3.1 3.4 Failure of feedwater regulating valves 064A2.21 Emergency Diesel Generator 2.6 2.9 Significance and interpretation of opening of ring bus during test Page 1 of 1 8/13/2020 10:04 AM
ES-401, REV 11 SRO T2G2 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:
RO SRO 035G2.4.31 Steam Generator 4.2 4.1 Knowledge of annunciators alarms, indications or response procedures SEE LIST OF REJECTED K/As Form ES-401-4 071A2.05 Waste Gas Disposal 2.5 2.6 Power failure to the ARM and PRM Systems 086A2.04 Fire Protection 3.3 3.9 Failure to actuate the FPS when required, resulting in fire damage Page 1 of 1 8/13/2020 2:39 PM
ES-401, REV 11 SRO T3 PWR EXAMINATION OUTLINE FORM ES-401-2 KA NAME / SAFETY FUNCTION: IR K1 K2 K3 K4 K5 K6 A1 A2 A3 A4 G TOPIC:
RO SRO G2.1.2 Conduct of operations 4.1 4.4 Knowledge of operator responsibilities during all modes of plant operation.
G2.2.1 Equipment Control 4.5 4.4 Ability to perform pre-startup procedures for the facility, including operating those controls associated with plant equipment that could affect reactivity.
G2.2.13 Equipment Control 4.1 4.3 Knowledge of tagging and clearance procedures.
G2.3.12 Radiation Control 3.2 3.7 Knowledge of radiological safety principles pertaining to licensed operator duties G2.3.13 Radiation Control 3.4 3.8 Knowledge of radiological safety procedures pertaining to licensed operator duties G2.4.20 Emergency Procedures/Plans 3.8 4.3 Knowledge of operational implications of EOP warnings, cautions and notes.
G2.4.5 Emergency Procedures/Plans 3.7 4.3 Knowledge of the organization of the operating procedures network for normal, abnormal and emergency evolutions.
Page 1 of 1 8/13/2020 10:26 AM
ES-401 Record of Rejected K/As Form ES-401-4 Tier / Randomly Reason for Rejection Group Selected KA 1/1 EPE007 EK2.02 Q(1) K/A EPE007 EK2.03 rejected. E-0 AND ES-0.1 do not contain any Reactor trip status panel actions other than Reactor trip and Bypass breaker verification. Therefore, a descriminating question cannot be written.
1/1 APE025 AA1.10 Q(6) K/A APE025 AA1.18 rejected. RHR and LHSI systems are different pumps and piping systems. There is no cross connection valve between the two systems.
2/1 SYS073 K1.01 Q(51) K/A SYS073 K4.02 rejected. No Letdown auto isolation exists for hi RCS activity.
2/2 SYS014 2.2.22 Q(91) K/A SYS035 2.4.31 rejected. Closed book for this K/A (SG ARP, AND TS) could not be written at the SRO level.
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only Thank you for the detailed references for each question.
RO Exam Preliminary Results: 11/75 Unsat = 14.6%
- Cred Dist: 19, 21, 22, 31, 33, 48, 63, 66
- Q=K/A: 12, 16, 64 SRO Exam Preliminary Results: 3/25 Unsat = 12%
- Cred Dist: 97
- SRO-only: 87, 94 Generic Comment: For questions that refer to Tech Specs, include the number/title of the Tech Spec in the fill-in-the-blank statements to the extent possible.
Generic Comment: The phrase TS Clock or LCO Clock may be too vague and/or slang; suggest re-wording the stem questions to eliminate the word clock.
Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts:
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question a 1 (easy) to 5 (difficult); questions with a difficulty between 2 and 4 are acceptable.
- 3. Check the appropriate box if a psychometric flaw is identified:
- Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
- Cues: The stem or distractors contain cues (e.g., clues, specific determiners, phrasing, length).
- T/F: The answer choices are a collection of unrelated true/false statements.
- Cred. Dist.: The distractors are not credible; single implausible distractors should be repaired, and more than one is unacceptable.
- Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by the stem).
- 4. Check the appropriate box if a job content flaw is identified:
- Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
- Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory).
- #/Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
- Backward: The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved K/A and those K/As that are designated SRO-only. (K/A and license-level mismatches are unacceptable.)
- 6. Enter questions source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet the criteria of Form ES-401, Section D.2.f.
- 7. Based on the reviewers judgment, is the question, as written, (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8. At a minimum, explain any U status ratings (e.g., how the Appendix B psychometric attributes are not being met).
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 1 H 2 x x N E T1G1 007 (Reactor Trip, Stabilization, Recovery) EK2.03:
Interrelations between Rx Trip and reactor trip status panel S
8-21-20: K/A Changed to EK2.02: Interrelations between Rx Trip and breakers, relays, disconnects
- 1. Cue: The list of annunciators in the stem is not necessary to elicit the correct response. Suggest changing the 4th bullet in the Initial Conditions stem section to only say:
I&C has placed the associated bistables for A Loop Tave and T in Trip.
That way, the applicants knowledge of procedures is tested.
- 2. Overlap: N44 is the same instrument that fails in Scenario 3; N44 has no input to OTDT in both test items. Suggest changing Scenario 3 to be a N43 failure instead of N44.
- 3. Stem Focus: In the Current Conditions section, the 1st bullet is vague; the way its written kind of implies that reactor power is 0%, which is not the case. Suggest changing to say:
Power Range NI N-44 failed low to 0%.
- 4. Stem Focus: The word correctly in the stem question is never needed. Also, the phrase below statements can be clearer as statements below.
6-14-21: All comments incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 2 H 2 x x x B E T1G1 008 (PZR Vapor Space Accident - Relief Stuck Open),
AA1.02: operate/monitor HPI pump to control PZR level/pressure as S
it applies to procedure.
2006 NRC Retake, Q#12
- 1. Cred Dist: Only two of the choices contain reasons, which could make them not plausible.
- 2. Partial: The correct answer A may not align with the Continuous Action Page requirement (CA page says as necessary); therefore, an applicant could say there is no correct answer.
To remedy both comments, suggest re-wording the four choices as:
A. Start charging pump(s) and align HHSI flow.
B. Start one RCP C. Manually initiate SI D. Turn on PZR heaters
- 3. Stem Focus: The 1st and 6th bullets in the Initial Conditions section should be past tense grammar, i.e., The crew performed.., and RCS subcooling was..
- 4. Stem Focus: Generic comment, for the stem questions, its better to ask which one of the following is the required action in accordance with 1-ES-1.2. (instead of asking what action will be taken).
6-14-21: Comments incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 3 F 2 x x x N E T1G1 009 (SBLOCA), EK3.15: reasons for closing RCP thermal barrier outlet valves as they apply to the procedure S
- 1. Partial: What document/reference says that the reason for closing TV-120A is to contain the break within the RCS pressure boundary? I couldnt find in references.
An applicant could successfully argue theres no correct answer to the 2nd part of the question if theres no document stating that the reason for closing TV-120A is to contain the break within the RCS pressure boundary.
One way to repair this flaw may be to change the 2nd fill-in-the-blank statement to be:
Closing 1-CC-TV-120A, RCP THERMAL BARRIER CCW SYSTEM, ________ ensure the minimum required containment isolation boundary is met. [will vs will NOT]
Its not necessary to straight out ask for the reason in the stem question to meet the K/A. For example, since the applicant must know the reason why TV-120A doesnt satisfy the containment isolation boundary, this would meet the intent of the K3 topic.
- 2. Stem Focus and/or Q=K/A: Can we add to the stem that PZR level/pressure are lowering? This could enhance our stance that the SBLOCA topic is being hit.
6-23-21: To ensure plausibility of A1/C1, suggest changing 2nd stem bullet to 57 gpm (not offscale high) and deleting the 3rd bullet about PZR level. Then re-word the 1st fill-in-the-blank statement as:
In accordance with ARPs 1C-A2 and 1C-A3 __________ is/are required to be closed.
6-30-21: Comment incorporated; question is SAT.
7-15-21: After validation, added word manually right before closed.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 4 H 2 x x M E/U T1G1 011 (LBLOCA), EG2.4.31: knowledge of alarms, indications, or response procedures S
- 1. Job-Link (RO): The 1st part of the question is procedure selection, which is SRO knowledge. Therefore, a RO applicant could successfully argue that the question tested beyond RO knowledge requirements.
Suggest testing a required action, or overall mitigation strategy in E-1 or other subsequent E-1 procedures, instead of testing procedure transition/selection.
- 2. Stem Focus: The titles of FR-Z.1 and ES-1.3 are missing.
6-23-21: Question revised to eliminate procedure selection. In revised question, suggest modifying the 2nd bullet to say: The crew has reached Step 16 in 1-E-1, Loss of Reactor or Secondary Coolant, but has not performed Step 16 yet. Step 16 is CHECK IF EDGS CAN BE STOPPED.
Also suggest modifying the 1st stem question to be: Which action is required to be performed FIRST?
[Place SI in CL Recirc vs Check if EDGs can be stopped]
6-30-21: Comment incorporated; question is SAT.
5 H 2 x x N E T1G1 022 (Loss of Rx Coolant M/U), AA2.01, determine/interpret whether charging line leak exists as it applies to the procedure S
- 1. Partial: The 2nd fill-in-the-blank statement should refer to 1-AP-8.00; otherwise, an applicant could successfully argue that Choice D is also correct. For example:
In accordance with 1-AP-8.00, Loss of Normal Charging Flow, a manual reactor trip _______ required.
[is vs is NOT]
- 2. Stem Focus: Why is the underlined word immediate necessary in the 2nd fill-in-the-blank statement? If the only time AP-8.00 requires a manual reactor trip is loss of CCW, then the word immediate may not be required.
- 3. Stem Focus: The words seal injection are missing in the 1st part of Choices A and C.
6-14-21: Comments incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 6 H 2 x x N E SAMPLE QUESTION RECD 10-7-2020 T1G1 025 (Loss of RHR) AA1.18 (operate/monitor LPI header x-connect valve controller & indicators) 8-21-2020: Replaced K/A because RHR/LHSI Pumps are different piping/pumps and no x-connect exists. New K/A:
T1G1 025 (Loss of RHR) AA1.10 (operate/monitor LPI pump suction valve & discharge indicators as applies to Loss of RHR)
- 1. Stem Focus: From the stem conditions, its unclear how Attachment 6 was reached in AP-27. Was Attachment 6 required by reaching Step 27? The sentence in Current Conditions (The RHR system was heavily damaged and is unable to provide cooling) is vague and may preclude using Attachment 6. Was there also a RCS inventory issue; stem doesnt say? Need to trace out how Attachment 6 was arrived at in AP-27, then include stem conditions to match.
- 2. Cues: The RCS pressure provided in the stem (below LSHI shutoff head), as well as the question layout for testing the same flow path required during an SI auto-actuation may provide cues that preclude testing the procedure required actions. In order to ensure overall RO written exam balance of coverage, for Tier 1 test items, ensure the test item tests required actions in the abnormal/emergency procedure or abnormal alarm procedure;
- 3. Three column format is not needed; the 1st and 2nd columns could be combined to solely test whether 1862A or 1115B/D is required. In general, three-column format is not useful in four-choice questions.
To resolve Comments #1, #2, and #3 above, consider the following slimmed down version:
WOOTF completes both statements in accordance with 1-AP-27.00, Loss of Decay Heat Removal, Attachment 6, Forced Feed Cooling?
The _____ leg is the preferred injection path. [hot vs cold]
LSHI Pump flow is required to be limited to less than ______
gpm. [3000 vs 440].
This slimmed down version hits the K/A because the pump flow is monitored on a discharge indicator; the suction valve piece is indirectly being tested via the injection path. All the cues are gone, just testing the procedure requirements.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 6 H 2 N S T1G1 025 (Loss of RHR) AA1.10 (operate/monitor LPI pump suction valve & discharge indicators as applies to Loss of RHR) 7 H 3 x N E T1G1 027 (PZR PCS Malfunction) AK2.03: interrelations between the malfunction and controllers/positioners.
S
- 1. Stem Focus: Both of the stem questions should include the procedure/TS reference to ensure no post exam appeals.
- 2. Stem Focus: The word correctly isnt necessary in the stem question.
See the suggestion below to remedy both comments WOOTF completes both statements?
In accordance with 0-AP-53.00, Loss of Vital Instrumentation/Controls, the next required action that will stabilize RCS pressure is to close the associated _______.
[Spray Valve Remote Close SOVs vs. Block MOV]
For the inoperable PORV, Tech Spec 3.1.A.6, RCS - Relief Valves, ________ de-energizing the associated Block MOV
[requires vs does NOT require]
- 3. Ensure no overlap with Scenario 2 or 5.
6-14-21: Comments incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 8 H 2 x B E/U T1G1 029 (ATWS), EK2.06 (interrelations between ATWS procedure and breakers, relays, and disconnects)
S
- 1. Job-Link (RO): The question is procedure selection, which is SRO knowledge/ability. Therefore, a RO applicant could successfully argue that the question tested beyond RO knowledge requirements.
Suggest testing a required action, or overall mitigation strategy in FR-S.1, associated with any breaker, relay, or disconnect, instead of testing procedure transition/selection.
For example:
Is it somehow possible to test the applicants knowledge that the Unit 1 Cable Tray Room is the location of the reactor trip breakers? MG set? Or the location for locally tripping the turbine?
6-14-21: Cred Dist: The 1st part of Choices A/C (crew can exit FR-S.1 as soon as RTBs are open) is not plausible because RTBs open may (or may not) mean rods on bottom - nuclear flux checks always best.
6-23-21: Changed to ask whether crew must remain in FR-S.1 until emergency boration is complete vs PRNI < 5%. Question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 9 H 3 x N E T1G1 038 (SGTR), EK1.02 (operational implication of leak rate vs pressure drop as it applies to procedure)
S
- 1. It seems more operationally valid to ask the applicants what the leak rate is, instead of whether the leak rate is more or less than double the 620 psig value. Asking for whether the leak rate is more or less than double seems like minutia. Suggest giving them the initial leak rate and ask them to predict the 520 psig leak rate.
- 2. Stem Focus: The 1st fill-in-the-blank statement is confusing because 1) the phrase At this time is subjective and 2) the phrase rate expected for the planned depressurization is confusing.
Suggest moving all of the bullets listed in the Current Conditions up to the Initial Conditions section, and delete the bullet about the field operator difficulty. Then, the only bullet in the Current Conditions could be:
- The A S/G pressure was inadvertently lowered to 520 psig, instead of 620 psig,,and is continuing lower due to difficulty reclosing the MSTV bypass valve.
Then re-word the stem question and 1st fill-in-the-blank statement as:
WOOTF completes both statements?
With the A S/G pressure at 520 psig the primary-to-secondary leak rate though the ruptured U-tubes is
_______ . [correct value vs plausible incorrect value]
- 3. Stem Focus: The word correctly isnt necessary in the stem question.
6-14-21: Comments incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 10 H 2 x x x N E T1G1 054 (Loss of MFW), AK3.02 (reasons for matching of FW &
SF as they apply to the procedure)
S
- 1. Minutia: It seems like were testing simulator minutia; i.e., just starting the condensate pump wont be enough to turn SG levels exactly at 79% power - - requires lowering turbine load.
Testing the 79% reactor power response, which is just 1%
below the 80% reactor trip threshold, could yield post-exam appeal from an applicant who successfully argued that the question was testing minutia.
- 2. Partial: An applicant could successfully argue that Choice D is also correct as far as conservative decision making goes, since SG NR levels are 32% and lowering, and reactor power is just 1% below the 80% trip threshold.
- 3. Overlap: Scenario 1 (79% power) also has MFP Sheared Shaft, which probably overlaps this question from a control board indication and procedural implementation perspective.
- 4. Stem Focus: The stem question is missing the title/number of 1-AP-21.00, Loss of Main Feedwater Flow.
- 5. Stem Focus: The font size of the last stem bullet is larger than the previous stem bullets.
6-23-21: Re-worked question into 2 x 2; changed Scenario 1 to trip feedpump versus sheared shaft.
Suggest removing the phrase immediate actions in the 1st fill-in-the-blank statement and re-word to say: Per 1-AP-21.00, Loss of Main Feedwater Flow, a condensate pump is ______ be started before lowering turbine load.
[not required to vs required]
6-30-21: Comment incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 11 H 2 x N E SAMPLE QUESTION RECD 10-7-2020 T1G1 055 (Station Blackout) G2.1.19 (use plant computer to evaluate system or component status)
- 1. Cues: Its not necessary to tell the applicants its been 55 minutes in the stem; it would better for hitting the K/A to let the applicants use the PCS Trend Graph (x-axis) to identify whether 45 minutes has expired from the initial loss of power.
minutes.
- 2. Cues: It would be better to include in accordance with 1-ECA-0.0 in the stem question, instead of underlining the word states in the 1st fill-in-the-blank statement. For example, A loss of all AC Emergency power has occurred on Unit 1.
1-ECA-0.0, Loss of All AC Power is being performed.
WOOTF completes both statements IAW 1-ECA-0.0 using the attached PCS Trend?
Declaration of an Extended Loss of AC Power (ELAP)
________ required. (is / is NOT).
The soonest time that a loss of a DC Bus is expected is
__________ . (20-30 minutes vs 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />)
(REFERENCE PROVIDED)
- 3. Form ES-401-5 should identify the references provided to the applicants for this question, i.e., missing the PCS Trend.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 11 H 2 N S T1G1 055 (Station Blackout) G2.1.19 (use plant computer to evaluate system or component status) 12 H 2 x x N U T1G1 057 (Loss of Vital AC Electrical Instrument Bus) AA2.04 (determine/interpret ESF system panel annunciators & channel S
status indicators as they apply to procedure)
- 1. Cue and/or Q=K/A: The Initial Conditions tell the applicant which Vital Bus was lost. For the K/A match, the stem should require the applicant to identify which Vital Bus was lost and then test some aspect of 1-AP-10.03 (required action, etc.)
Since this question is a Tier 1 question, it should test the applicants ability of how to safely operate the plant (instead of testing the applicants ability to predict how the plant is designed to operate.) See OL Feedback Item 401.55.
Suggest re-working the question to provide the annunciators which alarmed and test the applicants ability to identify which bus was lost and whether a manual reactor trip is / is NOT required. This way, the 2nd part of the question is testing the procedure, i.e., how to safely operate the equipment/plant.
6-23-21: Question re-worked to incorporate suggestions. Suggest deleting the 3rd and 4th stem bullets and re-word the fill-in-the-blank statements as:
A loss of Vital Bus _____ has occurred.
The abnormal procedure for this Vital Bus _________ a step to trip the reactor.
[includes vs does NOT include]
6-30-21: Comment incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only T1G1 058 (Loss of DC Power), AK3.01 (reasons for use of DC 13 H 3 x x x N E control power by D/Gs as they apply to procedure)
S
- 1. Partial: An applicant may contend that there is no correct answer to the 2nd part of the question because the premise of no electrical faults existing, even though both sets of control power fuses are blown, may be flawed. What type of failure could cause both sets of control power fuses to blow? Is it conceivable that actuation of the Aux Trip Relay would also happen when both sets of control power fuses blew?
- 2. Cred Dist: The plausibility of the 1st part of Choices A/C (put switch in automatic) is questionable because having a switch in automatic could mean that the system will immediately try to actuate as soon as the blown fuses are replaced.
Suggest changing the 1st fill-in-the-blank statement to be:
0-AP-17.04 ________ the operator to place the Breaker 15H3 control switch in the Pull-to-Lock position before the control power fuses are replaced. [requires vs does NOT require]
- 3. Cue: In the 4th bullet Current Conditions, instead of telling the applicants that Electricians report no electrical faults were identified, suggest conveying that no Aux Trip Relay electrical faults exist by saying:
The amber light on the Diesel Isolation Panel in the ESGR is NOT LIT.
6-14-21: Comment #3 not incorporated; Comment #1 still applies.
Also, it seems like operating test has similar procedures for EDG, may be too close to JPMs.
6-23-21: Is there another switch position besides Auto-after-Stop?
Can we change the 1st part of A/C to be another position besides Auto? The plausibility of putting something in automatic while people have their hands in the cabinet is lacking.
6-30-21: Changed to Stop (Green Flag); question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 14 H 3 x x N E T1G1 077 (Generator Voltage & Electric Grid Disturbances), AA2.04 (determine/interpret VARs outside capability curve as it applies to S
procedure)
- 1. Cue: The 2nd bullet in the Initial Conditions shouldnt say pressure is lower than normal, because that part of the bullet isnt necessary to elicit the correct response.
- 2. Stem Focus: The font size of the last part of the 2nd fill-in-the-blank statement is bigger than the first part.
6-14-21: Comments incorporated; question is SAT.
T1G1 WE04 (LOCA Outside Cnmt), EA1.3 (operate/monitor desired 15 F 2 M E operating results during abnormal/emergency situations as they S apply to procedure)
- 1. The original version of the modified question was not available.
Suggest changing the 2nd part of A/B to PZR level rising.
6-14-21: Original version added to references; comment incorporated; question is SAT.
16 H 2 x N U T1G1 WE05 (Loss Secondary Heat Sink), G2.2.37 (determine operability and/or availability of safety related equipment)
S
- 1. Q=K/A: The proposed question is not testing the Westinghouse vendor-specific Inadequate Heat Transfer / FR-H.1 or FR-H.2 topic. The proposed question tests the impact of grid instability on AFW, which is a secondary heat sink system; however, the Tier 1 K/A topic requires testing the Westinghouse vendor-specific emergency evolution/procedure. The generic K/A assignment probably is what caused the confusion; the 2nd part of the generic K/A assignment (availability of safety related equipment) can still apply to testing aspects of FR-H.1 or FR-H.2.
6-23-21: Good replacement question.
To align better with the procedure, and to ensure plausibility of B2/D2, suggest changing the 1st stem sentence to be: The crew is performing FR-H.1, Loss of Heat Sink, and is attempting to establish feed flow from the condensate system. Safety Injection has initiated.
6-30-21: Comment incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 17 H 2 x B E T1G1 WE11 (Loss of Emergency Recirc), EK1.3 (operational implications of annunciators and conditions indicating signals, and N S remedial actions as they apply to procedure)
- 1. Job-Link (RO): The 1st part of the question is procedure selection, (or transition) which is SRO knowledge/ability.
Therefore, a RO applicant could successfully argue that the question tested beyond RO knowledge requirements.
If the transition from E-1 to ECA-1.1 were a fold-out page item, then this question would be something to look at for ROs; however, there is no foldout page criteria for going to loss of emergency recirc.
Suggest testing a required action, or overall mitigation strategy in ECA-1.1.
For example:
Keep the 2nd part of the question (make it 1st), and then test the the ROs knowledge of how to lineup the charging system to refill the RCS during the loss of emergency recirc, in accordance with ECA-1.1, Attachment 2, Establishing Charging Pump Crosstie.
6-23-21: Replacement question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 18 H 2 x x B E T1G1 WE12 (Uncontrolled Depress of all SGs), EK1.3 (operational implications of annunciators and conditions indicating signals, and S
remedial actions as they apply to procedure)
- 1. Cred Dist: Choice C (raise AFW flow even though cooldown rate is 105F) is not plausible because this would compromise subcriticality.
- 2. Stem Focus: The stem question is different from other EOP questions; i.e., per the station EOP network is too broad.
Suggest re-wording the stem question and Choices C and D as follows:
WOOTF choices identifies the required action, if any, in accordance with 2-ECA-2.1?
A. Throttle AFW flow to each SG to a minimum of 60 gpm B. Throttle AFW flow to each SG to a minimum of 100 gpm C. Throttle TOTAL AFW flow to 350 gpm D. No action for AFW flow is required at this time
- 3. Stem Focus: All the information about the earthquake and other items in the Initial Conditions may not be necessary if we simply tell the applicants that 2-ECA-2.1 is being implemented due to all Unit 2 SGs being faulted inside containment.
- 4. Stem Focus: Is there any annunciator that alarms when containment pressure is adverse? This may be another way to provide the containment pressure instead of providing it directly to the applicants. If not, then we should probably provide RCS pressure as another bullet, to be parallel with containment and RCS pressures.
6-14-21: Comments incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 19 F 2 x x N U T1G2 005 (Inoperable/Stuck Rod), AA2.03 (determine/interpret required actions if more than one rod is stuck/inop, as it applies to S
procedure)
- 1. Cred Dist: The 2nd part of Choices B & C (2nd dropped rod doesnt require manual scram) is not plausible because of the high potential for clad failure (flux peaking, etc.) with no manual scram.
Suggest re-writing the 2nd part of the question to test if Control Rod C-7 subsequently dropped fully (0 steps), would a manual reactor trip be required.
- 2. Stem Focus: The TS Section number/name is missing from the 1st bullet in the Current Conditions, and/or from the 1st fill-in-the-blank statement. Which TS Section is applicable to the stem?
TS 3.12, Control Rod Assemblies & Power Distribution Limits A. Control Bank Insertion Limits B. Power Distribution Limits C. Control Rod Assemblies D. QPTR E. RPIS & Bank Demand Position Indication System F. DNB Parameters G. SDM 6-14-21: Comments incorporated; question is SAT.
20 H 2 x E T1G1 028 (PZR LC Malfunction), AK2.03 (interrelations between PZR LC Malfunction and controllers/positioners)
S
- 1. Scenario 4 has charging flow control valve (only) failing high, which is different than this written test item. Scenario 5 has PZR LT failing low, which is similar to this test item (same procedure, but different direction). Lets discuss overlap.
- 2. Cue: The pictures in the stem are not necessary to elicit the correct response. Suggest including only the unid#/noun name to the stem of the question and deleting the pictures. Part of what the test item should be testing is the reverse acting feature of FC-1122.
6-14-21: No overlap; comment incorporated - Question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 21 H 2 x N U T1G2 032 (Loss of SRNI), G2.2.37 (determine operability and/or availability of safety related equipment)
S
- 1. Cred Dist: The 1st part of Choices A/B (core alterations may continue) is not plausible because one SRNI is broken AND the audible count rate is also broken. Conservative decision-making alone can be used to deduce the correct answer.
To remedy, suggest re-working the two fill-in-the-blank statements as follows:
1-AP-4.00 ______ contain steps for the operator to restore the audible count rate in containment without I&C support. [does vs does NOT]
IF the audible count rate in containment is subsequently restored, THEN refueling _______ .
[is still NOT allowed vs may continue]
6-23-21: Comments incorporated; question is SAT.
22 H 2 x B U T1G2 033 (Loss of IRNI), AK3.02 (reasons for guidance in EOP for loss of IRNI as it applies to procedure)
S
- 1. Cred Dist: The 1st part of Choices B/D (trip reactor with just one IRNI broken) is not plausible because nothing in the stem can be misconstrued to imply both IRNIs are broken, and because RPS and Tech Specs are designed to allow one instrument failure/maintenance without requiring an automatic/manual reactor trip.
Suggest changing the 1st part of the question to be:
In accordance with 1-AP-4.00, Attachment 2, IR Failure, the N-35 LEVEL TRIP switch ______ required to be placed in the BYPASS position.
6-23-21: Re-worked question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 23 H 3 x x N E SAMPLE QUESTION RECD 10-7-2020 T1G2 060 (Accidental Gaseous RW Release) AA2.03 (determine steps necessary to isolate radioactive gas leak using P&IDs)
- 1. Partial: An applicant can successfully contend that Choice C is also correct because 0-AP-5.2, Step 2 directs HP to determine affected area and/or perform surveys. The Step 2 guidance can be successfully argued as the same thing as sampling for iodine and particulates.
- 2. Partial: An applicant can successfully contend that there is no correct answer to the 1st part of the question because Step 10 (CHECK SOURCE OF VENTILATION VENT ACTIVITY-AREA KNOWN?) can be answered as YES, since the stem is too strong with respect to 1-GW-RV-111A relief valve; Step 10 RNO would not be entered. Suggest removing all reference to 1-GW-RV-111A from the stem and only include 1-GW-RV-111A in the 2nd fill-in-the-blank statement.
- 3. Stem Focus: Initial power is missing (needed to answer Step 3 RNO for Cnmt Recirc Fan operation)
- 4. Stem Focus: The Current Conditions should say that the MGPI 131 (High LED) and/or 133 (recorder) are in high alarm (needed to answer Step Step 1)
- 5. Stem Focus: the word VENTILATION is misspelled in the 2nd bullet of Current Conditions.
- 6. Form ES-401-5 should identify the references provided to the applicants for this question, i.e., missing the print numbers.
23 H 3 x N E T1G2 060 (Accidental Gaseous RW Release) AA2.03 (determine steps necessary to isolate radioactive gas leak using P&IDs)
S
- 1. Stem Focus: Suggest using the word identify (instead of verify) in the 1st fill-in-the-blank statement, because we want to imply that the leak location is not initially known.
- 2. Stem Focus: To ensure the question is clear that the leak location is not initially known, suggest using the words subsequently identified (instead of is verified).
- 3. Ensure no overlap with Q#50 6-14-21: No overlap with Q#50; comments incorporated - Question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 24 ? 2 x x N E T1G2 061 (ARM System Alarms), AK2.01 (interrelations between the ARM system alarms and detectors at each ARM system location)
S
- 1. Cues: A lot of the stem information is unnecessary. Also, the entry to the AP-22.0 in the 1st fill-in-the-blank is not necessary.
Suggest re-writing the stem and questions as:
While a fuel shuffle was being performed in the Spent Fuel Pool, the following annunciators alarmed and were determined to be valid, i.e., not an instrument failure:
- 0-RM-C3, FUEL PIT BRDG ALERT/FAILURE
- 0-RM-D3, 1-RM-RI-153 HIGH Spent fuel pool level is stable/normal and no other abnormalities were observed or noted.
WOOTF completes both statements?
In accordance with 0-RM-C3 and -D3, the Fuel Building
________ required to be immediately evacuated. [is vs is NOT]
The fuel pit bridge radiation detector is a/an _________
detector.
[ion chamber vs geiger mueller]
- 2. Cred Dist: The plausibility of the 2nd part of Choices B/D (scintillation detector monitoring flow) is questionable because there is no process flow stream. Also, the phrase that monitors xyz in each choice is not necessary. Suggest changing to only ion chamber or geiger mueller.
- 3. LOK: If the question is modified as described above, then it may become lower cog/fundamental level of knowledge.
- 4. The distracter analysis incorrectly identified this K/A as T1G1 (instead of T1G2) 6-14-21: Comments incorporated; question is SAT.
6-30-21: The last stem bullet shouldnt be a bullet; just a stand-alone statement, because stem statement says the following annunciators..
7-1-21: Comment incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 25 F 2 x N E T1G2 067 (Plant Fire on Site), AA1.09 (operate/monitor plant fire zone panel, including detector location, as it applies to procedure)
S
- 1. The proposed question solely tests the applicants knowledge of the design features of the fire detection system, i.e., the re-enable and reset location features. It is not testing a Plant Fire On Site procedure. Since this question is a Tier 1 question, it should test the applicants ability of how to safely operate the plant; see OL Feedback Item 401.55.
What administrative, abnormal, or emergency procedure allows the containment fire detection system to be disabled, under what circumstances? Where does it say that the fire detectors can be disabled during adverse containment conditions? These may be ways to test the Plant Fire on Site procedure allowance/requirement.
Another way to test the abnormal procedure aspect is to test the annunciator procedure guidance for a fire annunciator alarm, if it includes guidance for operating/monitoring the plant fire zone panel(s). Does AP-48 have guidance for monitoring the plant fire zone panel?
- 2. Stem Focus: The stem question says WOOTF answers the questions below, even though there are no questions below (only fill-in-the-blank statements).
6-30-21: Stem question refers to statements even though there are only questions. Also, the word correctly in the stem question is not necessary because it is implied as part of the exam.
7-1-21: Comment incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 26 F 2 x x N E T1G2 076 (High Rx Coolant Activity), G2.2.12 (knowledge of surveillance procedures)
S
- 1. Partial: To ensure that Choice C is incorrect, include the words earliest time in the 1st fill-in-the-blank statement, e.g.,
The earliest time that chemistry is required to be notified to sample the RCS for Dose Equivalent I-131 is when power is lowered to _______ . [70% vs 85%]
- 2. Stem Focus: The 2nd fill-in-the-blank statement should include the Tech Spec number and name, e.g.,
Per Tech spec 3.1.D, RCS Specific Activity, .
- 3. The stem question says there are questions below, even though there are only fill-in-the-blank statements.
6-14-21: Comments incorporated; question is SAT.
27 F 2 x x N E T1G2 WE09 (Natural Circulation), EK1.2 (operational implications of normal, abnormal, and emergency operating procedures as they S
apply to procedure)
- 1. Cues and/or Stem Focus: The 2nd bullet in the Initial Conditions (Power not available to RCPs) is not necessary to elicit the correct response. Perhaps the very 1st bullet could be more specific about the LOOP origin? What transformer/switchyard portion was lost? Maybe it was such that Unit 2 was not affected.
- 2. Stem Focus: The stem question doesnt include in accordance with 1-ES-0.2, and also, the word correct isnt necessary. It seems better to ask WOOTF completes both statements IAW 1-ES-0.2?
6-14-21: Comments incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 28 H 2 x x x N E T2G1 003 (RCPs), A2.02 (predict impacts of conditions which exist for an abnormal shutdown of an RCP in comparison to a normal S
shutdown of an RCS and use procedures to correct, control, mitigate)
- 1. Cred Dist: The plausibility of the 1st part of Choices A/B (Lower Thrust Bearing @ 155F) is questionable because the shaft vibration is so high at this time (18.5 mils). Suggest raising the initial and current Lower Thrust Bearing temperature values, but keep the 3.5F/minute rise. Whats normal running value for lower thrust bearing at 100%?
- 2. Stem Focus: One of the AP-9.00 entry conditions is when bearing temperature reached the alarm setpoint of 175F; however, the stem current condition is only 155F. The Initial Condition bullet says the crew entered AP-9.00, but based on what? Should the stem say that the crew entered AP-9.00 based on the 1C-G5 (15 mils) Alert annunciator?
- 3. Partial: The phrase most limiting parameter in the 1st fill-in-the-blank statement may be too vague and/or subjective; suggest re-wording the fill-in-the-blank statement as:
Based on these trends, and assuming the trends continue at the same rate, the first parameter that will require the pump to be shutdown is the ________ . [Lower Thrust Bearing vs RCP Shaft Vibration]
Also, based on the rewording of the 1st fill-in-the-blank statement, suggest the 2nd fill-in-the-blank statement be worded as:
In accordance with the annunciator procedures and AP-9.00, at this power level, a manual reactor trip _____ required before the RCP is shutdown. [is vs is NOT]
- 4. The distracter analysis incorrectly identified this K/A as T1G1 (instead of T2G1) 6-14-21: Comments incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 29 ? 2 x x x N E T2G1 003 (RCPs), K5.03 (operational implications of the effects of RCP shutdown on Tavg, including the reason for the unreliability of H S Tavg in the shutdown loop)
- 1. Cues: The 4th sub-bullet (Steam Dumps are throttled open at 4% demand) is not necessary to elicit the correct response.
- 2. Partial: Suggest re-wording the 1st fill-in-the-blank to avoid the word expected, because an applicant could contend that he/she did expect, but was wrong to expect. For example, re-word as:
Steam dumps ______ be throttled open. [will vs will not be]
Similarly, re-word the 2nd fill-in-the-blank statement to avoid the word expected, for example:
At ES-0.1, Step 1, Steam Dump Control will be in the _______
mode. [Steam Pressure vs Tavg]
- 3. Cred Dist: The plausibility of the 1st part of Choices A/D (steam dumps wont be open) is questionable because the unit tripped from 100%, and steam dumps are likely to be open. Suggest lowering initial power to 60%.
- 4. LOK: The distracter analysis indicated memory level (fundamental); it may be higher cog though. Well keep track of it.
6-14-21: Comments incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 30 F 2 x x B E T2G1 004 (CVCS), K4.16 (knowledge of CVCS design features/interlocks which provide for temperature at which the TCV S
auto-diverts flow from demin to VCT; reason for diversion)
- 1. Partial: By adding the word setpoint and auto to the 1st stem question, it may become more bullet-proof; suggest re-wording as:
What is the temperature setpoint at which the Letdown divert valve, 1-CH-TCV-1143, will auto-divert to the VCT?
- 2. Partial: An applicant can successfully argue that Choice B is also correct because boron release is also prevented by the auto-divert feature. Whats the basis document (not a lesson plan) that identifies the reason for the auto-divert design? Can we modify the 2nd fill-in-the-blank statement to something like:
In accordance with document XYZ, what is the reason the plant was designed with this auto-divert feature?
6-14-21: Plausibility issue with 2nd part of Choices B/D; fill-in-the-blank statement tells applicants high temperature. Comment #2 (above) didnt include phrase high temperature; still concerned about no correct answer. Also, the 1st fill-in-the-blank statement is a question even though the 2nd fill-in-the-blank statement is a statement.
6-23-21: Re-worked to test the setpoint and location of diversion; question is SAT. Probably should spell out VCT and PDT because in Q#33, the PDT is spelled out.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 31 H 2 x x N U T2G1 005 (RHR) A1.05 (predict/monitor changes, including detection of and response to presence of water in RHR emergency S
sump, associated with operating the RHRS controls)
- 1. Cred Dist: The 2nd part of Choices B/C (raising flow with amps oscillating) is not plausible because 1) the stem says RCS temperature is stable and 2) anytime pump amps begin oscillating its never a good idea to raise demand on the motors.
Suggest keeping the 1st part of the question and re-working the question to eliminate the oscillating amp bullet, and re-work the 2nd part to test whether the pump is / is NOT required to be immediately stopped per the applicable procedure.
- 2. Stem Focus: The word correct is not necessary in the stem question; consider: WOOTF completes the following statement?
6-14-21: Comments incorporated; question is SAT.
32 M 2 x B E/U T2G1 006 (ECCS) K5.02 (operational implication of the relationship between accumulator volume/pressure as it applies to ECCS)
S
- 1. Cred Dist: The plausibility of Choices A/B (prevent/minimize level/inventory loss) is questionable because these two Choices are the same thing: i.e., prevent/minimize level/inventory loss.
An applicant can successfully eliminate Choices A/B solely because of this reason.
This test item doesnt necessarily have to test procedures, although testing the reason for Step 24 is a good way to hit the systems aspect of the K/A.
6-14-21: Changed Choice B; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 33 H 2 x N U T2G1 007 (PZR Relief Tank/Quench Tank) A1.03 (predict/monitor changes in parameters, including monitoring quench tank S
temperature, to prevent exceeding design limits associated with operating the PRTS controls)
- 1. Cred Dist: The 1st part of Choices A/D (193F) is not plausible because an applicant can eliminate these Choices solely because of the stem question wording. 193F is less than 228F, i.e., the stem question asks for gross leak by, and 228F is more gross than 193F.
- 2. Cred Dist: The 2nd part of Choices A/C (tailpipe temp never rapidly lowers) is not plausible because the relief tank is designed with a rupture disc.
Suggest writing a question to test the setpoint for 1C-E7, PZR RELIEF TK HI TEMP, and the required actions per 1-RC-OP-11.
If testing the setpoint value is viewed as minutia, then instead we could test the normal allowable temperature band at 100%
power, etc.
Alternatively, suggest replacing the question with an item that tests 1-RC-OP-11 limits/parameters for the PZR Relief Tank operation after annunciator 1C-E7 has alarmed.
- 3. The distracter analysis was missing the Tier/Group.
6-23-21: Reworked question to test temperature of PORV leakby in PRT and where PRT contents routed when draining. The plausibility of the containment sump is questionable; is there any OP that directs operators to drain anything to the containment sump? Can we pick another distracter for Choices A2/C2?
6-30-21: Comment incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 34 F 2 x N E T2G1 008 (CCW) G2.4.6 (Knowledge of EOP mitigation strategies)
S 1. Partial: An applicant can successfully argue there is no correct answer to the question because the CAUTION in AP-15.00 doesnt say that AP-27.00 is the priority; the CAUTION only says that AP-27.00 should be implemented. Unless there is an Ops directive that says Unit 2 will implement AP-15 and Unit 1 will implement AP-27, or some other conduct of ops procedure, then this question is vulnerable to appeals. Maybe Im missing something, but Im not seeing the prioritization requirement.
Suggest testing the overall mitigative strategy of AP-15.00, i.e.,
establishing an alternate letdown path, and/or how containment pneumatics are not interrupted, etc.
- 2. Partial: An applicant could successfully argue that Choice C (AP-27.00 is priority because U2 will implement AP-15.00) is also a correct answer if U2 did implement AP-15.00.
6-23-21: The two parts of the replacement question may be disjointed; the answer to the 1st part is do not enter AP-15.00, whereas the 2nd part of the question assumes that AP-15.00 has been entered. Also the 1st part is vulnerable to post-exam appeals because one entry condition listed in AP-15.00 is lowering head tank level due to non-isolable leak.
6-30-21: Where is the leak? Is it isolable? 3rd bullet implies only an attempt is being made; therefore, entry condition may be met. Also same comment above about disjointed parts 1 & 2.
7-1-21: Proposed fix has issues with interplay between the 1st and 2nd parts; 2nd part says if reactor is tripped, which cues answer to 1st part.
Suggest:
An immediate manual reactor trip _____ required. [is vs is NOT]
When implementing AP-15.00, ____________ will be performed first.
[Crosstie Containment IA Turbine Building vs Establish Alternate Letdown]
7-8-21: Comments incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only T2G1 010 (PZR PCS) K5.01 (operational implication of determining 35 H 2 x x N E of condition of fluid in PZR using steam tables, as it applies to PZR S PCS)
- 1. Stem Focus: The Current Conditions 1st and 2nd bullets dont align with the team remaining in 1-ES-1.1. The guidance for forming the bubble lies in 1-GOP-1.1, Step 5.5.17. Suggest moving the 1st bullet up to the Initial Conditions Section, and then revising the 2nd bullet to say the team is in 1-GOP-1.1 and preparing to draw a bubble in the pressurizer.
- 2. Cred Dist: The plausibility of the 2nd part of Choices A/D (first PZR response is bubble forms) is questionable because there is no PZR bubble indicator. Suggest revising the 2nd stem statement and the 2nd part of Choices A/D to be:
If the team lowers Charging flow below Letdown flow, how will pressurizer pressure respond?
A.2/D.2 Pressure will not change 6-14-21: Comments incorporated; stem question should say WOOTF answers both questions? Question is SAT.
7-15-21: Changed bullet to say terminated SI per ES-1.1 instead of saying currently in ES-1.1.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 36 H 2 x N E T2G1 012 (RPS) A2.03 (predict impacts of incorrect channel bypassing on RPS and use procedures to correct, control, mitigate)
S
- 1. Cred Dist: The plausibility of Choices B/D (Tech Spec actions) is questionable because RO applicants know that they arent responsible for knowing Tech Spec required actions.
It may be better to re-work the question to say that PI-1475 fails as indicated and tell the applicants that ALL required actions in 0-AP-53.00 have been taken. (This means that the yellow instrument has been selected.) THEN, test the applicants knowledge of what channel is required to be selected as the controlling (Yellow or White) channel, and what will occur IF the a technician subsequently inadvertently de-energizes the PI-1474 channel (reactor will/ will not immediately trip).
- 2. IF the recommendation above is used, how will it not overlap the scenarios if the applicants always select the Yellow channel after a failed instrument?
6-23-21: Comments incorporated; question is SAT.
37 F 2 x x M E T2G1 013 (ESFAS) K2.01 (knowledge of bus power supplies to ESFAS/Safeguards equipment control)
S 2014 NRC Exam Q#17
- 1. Stem Focus: Suggest re-wording the stem question to specify the 1A DC Bus, for example:
WOOTF identifies the reason that 1-AP-10.06, LOSS OF DC POWER, requires using Attachment 5, Suggested Sequence of Loading DC Buses 1A and 1-1, to restore power?
- 2. Cred Dist: Suggest replacing Choice B with: To prevent overloading the Battery Chargers.
6-14-21: Comments incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 38 H 2 x x N U SAMPLE QUESTION RECD 10-7-2020 T2G1 002 (Containment Cooling) A2.01 (predict impacts of fan motor over-current on CCS and use procedures to correct, control, mitigate)
- 1. Q=K/A: The 1st part of the question tests the applicants knowledge of the power supply logic for the 1C Containment Air Recirc Fan following a Hi Hi CIS signal. Its the same logic that exists at all times (i.e., C Fan remains on a Hi Hi ClS signal because its not powered from a safety bus). The 1st part of the question is not testing the impact of a fan motor over-current on the plant or CCS.
Suggest running the desktop simulator to see how the plant is affected (from 100% power) following a trip of the 1A, 1B, or 1C Fan, and re-work the 1st part of the question to test that effect.
IF you choose to test only one fan tripping, THEN the 2nd part could be revised to ask whether H2 sample is / is NOT required.
- 2. Stem Focus: The 2nd bullet is vague; suggest telling the applicants which 480 V 1H breaker is turned OFF (instead of saying breaker maintenance is being performed).
- 3. Stem Focus: The 4th bullet is not necessary to elicit the correct response (Maintenance troubleshooting).
38 F 2 N S T2G1 022 (Containment Cooling) A2.01 (predict impacts of fan motor over-current on CCS and use procedures to correct, control, mitigate) 39 F 2 N S T2G1 022 (Containment Cooling) K2.01 (power supplies to containment cooling fans)
- 1. The distracter analysis has a typo for the Tier & Group; should be T2G1 (instead of T1G1).
40 F 2 x N S T2G1 026 (Containment Spray) A4.01 (ability to manually operate/monitor CSS controls in the control room)
- 1. Stem Focus: The noun name for 1-CS-P-1A is missing in the 1st stem question.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 41 H 2 x x N E T2G1 039 (Main & Reheat Steam) K1.02 (physical connections and/or cause-effect relationship between MRSS and atmospheric S
relief dump valves)
- 1. Partial: An applicant could successfully argue that there is no correct answer to the 2nd part of the question because the 2nd stem question asks for where the manual isolation valve is located for the SG PORV.
Suggest re-wording the 2nd stem question to say:
Where is the SG PORV EMERG CLOSE SW is located?
- 2. Stem Focus: The stem question is missing a question mark.
6-14-21: Comments incorporated; question is SAT.
42 ? 2 N S T2G1 059 (MFW) G2.1.32 (explain and apply system limits and precautions)
F
- 1. LOK: It appears both parts of the question are memory level T2G1 059 (MFW) G2.4.1 (EOP entry conditions and immediate 43 H 2 x x N E action steps)
S
- 1. Cue: Choice C is the only Choice that involves the B feedpump.
Suggest revising Choice C to say:
The sensing line to the 1A MFW pump lube oil pressure switches completely ruptures at 75% power.
- 2. Stem Focus: In Choice B, Suggest replacing the word at with on, and underlining the word inboard.
- 3. Stem Focus: Suggest making the power level in Choice D the same as Choice C, i.e., 75% power.
6-14-21: Comments incorporated; question is SAT.
44 F 2 N S T2G1 061 (AFW) A1.02 (predict/monitor changes in SG pressure to prevent exceeding design limits associated with operating the AFW controls)
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 45 F 2 x x N E T2G1 061 (AFW) K6.01 (knowledge of the effect of a loss or malfunction of controllers and positioners will have on AFW S
components)
- 1. Partial: An applicant could successfully argue that there is no correct answer to the 1st part of the question since the position of 1-FW-MOV-151E is undetermined. The phrase as soon as the .. in the 3rd bullet is vague.
To remedy, can we delete the phrase as soon as the.. and modify the 1st stem question to say:
Assuming the 1-FW-MOV-151E is at 90% open, what is the approximate AFW Flow to the A S/G?
- 2. Stem Focus: The word Indication in the 1st stem question is not necessary.
- 3. Stem Focus: The 2nd stem question should specify Attachment 5 (instead of 1-ES-0.1).
6-14-21: Comments incorporated; question is SAT.
46 H 2 B S T2G1 062 (AC Electrical Distribution) K3.01 (knowledge of the effect that a loss or malfunction of the AC Distribution system will have on major system loads)
- 1. The references used to develop the question are missing from the references file; it appears that the references for Q#45 were duplicated for Q#46.
6-14-21: Reference added to file.
47 F 2 N S T2G1 063 (DC Electrical Distribution) A4.01 (ability to manually operate/monitor major breakers and control power fuses in the main control room)
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 48 F 2 x x M U T2G1 063 (DC Electrical Distribution) K3.02 (knowledge of effect that loss or malfunction of the DC electrical system will have on S
components using DC control power)
- 1. Cred Dist: The 2nd part of Choices B/D (breaker wont trip if only closing fuses blown) is not plausible because the stem tells the applicant that the open fuses remain intact.
- 2. Q=K/A: The proposed test item tests how the motor driven AFW pump is affected when its control power fuse is blown; however, it may be better to say that a loss of a specific DC panel occurred and then ask how the specific motor driven AFW pump on an AC bus is affected by the loss of control power to the AC bus.
Suggest re-working the question to specify a DC bus (or panel) is lost and then ask the applicant how the A AFW pump indications are affected. For example, ask the applicant for the status of the white light above the 1FW-P-3A switch (illuminated vs not illuminated) and whether the main control board red/green running indication lights are available vs not available.
By using this suggestion, the plausibility will be fixed because the applicant will have to know whether or not the specific DC bus (or panel) affects the AC board that the motor driven pump is powered from.
6-14-21: Re-worked question contains cue that tells applicants the electrical loads; lets discuss.
6-23-21: Replaced question; question is SAT.
6-30-21: Conflict with Q#47 discovered during validation. We discussed making this question to be 25% power.
7-1-21: Made 25% power; question is SAT.
7-15-21: Station Service Bus is power to RCPs; therefore, some overlap with Q#47. Changed 1st part of this question to test whether the #2 EDG will / will not automatically load onto the 2H Bus.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 49 F 2 x x N E T2G1 064 (EDG) K6.07 (knowledge of the effect of a loss or malfunction of air receivers will have on the EDG system)
S
- 1. Cred Dist: The plausibility of the 1st part of Choices B/C (Bank 1 not sufficient for auto-start) is questionable because the stem bullet says Bank 1 pressure is stable (unaffected) at 190 psig.
One train of air is always enough to accomplish the EDG start.
To remedy, suggest re-working the 1st stem question to test whether Bank 2 is sufficient for auto-start IF its pressure is 160 psig and STABLE. This would test the CAUTION in 1C-F6:
- 2. Partial: An applicant can successfully contend that Choice D is also correct, even though the word immediately is in the 2nd stem question, because 1C-F6 guidance for air pressure includes a step that says Use Lister Diesel as necessary.
It may be better to move the word immediately to the Choices instead of having it in the 2nd stem question. Suggest re-writing the 2nd stem question as:
To restore Bank 2 starting air, the field operator can _____ .
Change the 2nd part of Choices B2/D2 to:
immediately start the Lister diesel 6-30-21: Comment #2 incorporated. Why is only Bank 2 underlined and capitalized in the stem? This may cue the applicant to the answer because Bank 1 is not underlined and capitalized. Suggest making both Bank 1 and Bank 2 the same, i.e., no underline and no capital.
7-1-21: Comment incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 50 H 2 x x B E T2G1 073 (Process Rad Monitoring) K4.01 (knowledge of PRM design features/interlocks that provide for release termination when S
radiation exceeds setpoint)
- 1. Cred Dist: The plausibility of the 2nd part of Choices B/C (detector saturation) is questionable because the 2nd stem question asks for a detector failure. An applicant can eliminate Choices B/C solely since large rise in pulses is not a detector failure.
To remedy, suggest changing the 2nd stem question to say:
What condition could cause the indications shown?
And modify the 2nd part of Choices B/C to only say:
Detector saturation (instead of Large rise in pulses..)
- 2. Stem Focus: The 1st question is a fill-in-the-blank statement; the 2nd question is a question. The stem question should be WOOTF completes both statements?
- 3. Stem Focus: The picture is too small to read; the applicants will probably have difficulty reading.
- 4. Ensure no overlap with Q#23.
6-14-21: Comments incorporated; question is SAT.
51 F 2 x N E T2G1 073 (Process Rad Monitoring) K1.01 (knowledge of the physical connections and/or cause-effect relationships between the S
PRM system and those systems served by PRMs)
- 1. Stem Focus: To ensure the applicants are clear on the first stem question, suggest including the word sample, and specifying the time delay as:
The 120 second time delay for the Rad Monitor Sample Pumps auto-start feature begins ____ .
6-14-21: Comment incorporated (60 second time delay); question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 52 F 2 x x B E T2G1 076 (Service Water) A3.02 (monitor auto operation of the SWS including emergency heat loads)
S
- 1. Partial and/or Stem Focus: The word immediately and the phrase as a result of the LOCA could make this question vulnerable to post-exam appeals. The setpoint for the Hi Hi CLS signal is 23 psia. An applicant could say that none of the answers are correct if the LOCA started and it took time to reach 23 psia, because of the word immediately.
Suggest deleting the second bullet (44.5 psia, not necessary) and re-wording the stem question as:
WOOTF components will have their supporting Service Water cooling components immediately reposition from the original position, when a Hi Hi CLS signal occurs?
6-14-21: Comment incorporated; question is SAT.
53 F 2 N S T2G1 076 (Service Water) K2.01 (knowledge of bus power supplies to service water) 7-15-21: Added RSSW to 1st part. For 2nd part, validators said 1J Bus re-energization was moot point. Shortened to to say The 480V J Bus ABT ______ energize the remaining RSSW MOVs.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 54 H 2 x x x B E T2G1 078 (Instrument Air System) A4.01 (operate/monitor pressure gauges in the control room)
S
- 1. Q=K/A and/or Stem Focus and/or Partial: To maintain the focus on the Instrument Air topic, and ensure only one correct answer, suggest the following items:
- Delete the bullet in the Current Conditions associated with the RCP CC flow and temperature indications.
- Re-word the stem question (see below)
- Convert the 1st question to test the applicants knowledge of whether the S/G PORVs will/ will NOT continue to control in AUTO.
- Clarify the stem question with respect to 1-AP-10.05 requirements for alternate monitoring method.
For example, to remedy all comments:
WOOTF completes both statements regarding the impact to pneumatics in accordance with 1-AP-10.05, Loss of Semi-Vital Bus?
S/G PORVs ______ continue to control in AUTO for 25 minutes.
[will vs will NOT]
The Plant Computer System (PCS) ______ an alternate monitoring method for Instrument Air/Service Air pressure.
[is vs. is NOT]
6-14-21: 1-AP-10.05 says SG PORVs will remain energized by an UPS in MB-8 for approximately 30 minutes. The reason I suggested 25 minutes was to avoid post-exam challenges due to the word approximately. The proposed 1st fill-in-the-blank statement was only asking whether the SG PORVs will continue to control for 25 minutes, which the answer is always going to be yes. Maybe Im missing something; lets discuss.
6-23-21: Went back to 25 minutes with clarification from the time bus was lost. Question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 55 F 2 x x N E T2G1 103 (Containment System) A3.01 (monitor auto operation of the containment system including containment isolation)
S
- 1. Partial: The 1st and second bullets in the Current Conditions (i.e., RCS and Containment pressures) should be replaced with and stable, to ensure no post-exam appeals.
- 2. Stem Focus: The 3rd bullet in the Current Conditions can be eliminated by including the valve unid/noun names after the stem question. In other words, the stuff about BOP performing E-0, Attachment 1, etc. is more reading burden.
- 3. The distracter analysis is missing the Tier/Group.
6-14-21: Comments incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 56 ? 2 x x N E T2G2 001 (CRDS) A1.08 (predict/monitor changes in verification that CRDS temps are within limits before starting - to prevent exceeding S
design limits - associated with operating the CRDS controls)
- 1. Q=K/A: The 1st part of the question is not related to the K/A.
For 2-part questions, one of the parts should directly hit the K//A, and the other part should be related to the K/A. In the proposed test item, the 1st part of the question doesnt seem related to the K/A.
- 2. Cred Dist: The plausibility of the 2nd part of Choices B/D (erratic rod movement could occur) is questionable because the 2nd stem question says that the rod will be moved, with limits. IF erratic rod movement could occur, THEN there would be no allowable rod motion.
To remedy both comments, suggest the following:
WOOTF completes the following statement in accordance with 1-AP-25.00, Loss of CTMT Air Cooling, if less than one CRDM Fan is running in each duct?
At 48 steps per minute, limit rod motion to _______
minutes of continuous stepping following by ______
minutes of holding.
[10 vs 5] AND [20 vs 25]
- 3. LOK: It appears that both parts of the proposed test item are lower cog/fundamental knowledge items.
- 4. The distractor analysis has typo, this test item should be T2G2 (instead of T2G1).
6-23-21: Question revised to rod motion limits; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 57 F 2 x N E T2G2 002 (RCS) K4.10 (design features/interlocks with provide for overpressure protection)
S
- 1. Cue: The 2nd part of Choices A/C can be eliminated solely based on the stem bullet that says OPMS is in service. The correct answer is Place the OPMS keyswitch in DISABLE.
To remedy, suggest modifying the 2nd part of the question to ask:
Placing the PORV control switch to the CLOSE position ______
close the affected PORV.
[will vs will NOT]
6-14-21: Suggest converting both parts of the question into fill-in-the-blank statements, instead of having one part a question and the other a fill-in-the-blank statement.
6-23-21: Still not changed as 6-14-21 suggestion. Also, stem question missing question mark.
6-30-21: Comment incorporated; question is SAT.
58 F 2 B S T2G2 011 (PZR LCS) K2.02 (bus power supplies to PZR heaters)
- 1. The distracter analysis has a typo; the question is T2G2 (instead of T2G1).
6-14-21: Distracter analysis corrected.
59 F 2 x N E T2G2 017 (In-Core Temp Monitor System) A2.02 (predict impacts of core damage on the ITM system and use procedures to correct, S
control, mitigate)
- 1. Cred Dist: To ensure plausibility of the 2nd part of Choices B/D, suggest:
- including the title of E-0, Attachment 2 (Checking SI Valve Alignment) in the last stem bullet and
- revising the 2nd fill-in-the-blank statement, and the 2nd part of each Choice. For example:
For the Current Conditions, IF an ORANGE path is entered, crew performance of Attachment 2 __________ .
[is required in parallel with performing the ORANGE path procedure vs must be suspended]
6-14-21: Comments incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 60 H 2 x x N E T2G2 041 (Steam Dump/Turbine Byp Control) K6.03 (effect of loss or malfunction of controller and positioners - including ICS, S/G, S
CRDS - will have on the SDS)
- 1. Stem Focus: It seems like the 1st two bullets in the Current Conditions (AP-53.00 actions completed, Power at 100%) can be consolidated to the Initial Conditions.
- 2. Cue: The initial and current Tave/Tref values are not necessary to elicit the correct response.
- 3. The distracter analysis has a typo; the question is T2G2 (instead of T2G1).
6-14-21: During the consolidation process, did we miss including information that Pimp Ch 4 is now selected?
6-23-21: Comments incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 61 F 3 x N E T2G2 045 (Main Turb/Gen System) A4.01 (manually operate/monitor turbine valve indicators (throttle, governor, control, S
stop, intercept), alarms, and annunciators in the control room)
- 1. Stem Focus: It may not be clear to the applicants that the operator is still holding down the LATCH pushbutton. It seems that both fill-in-the-blank statements are testing plant response AFTER the button is released.
Suggest re-working the stem bullets and stem question as follows:
Given the following:
- Unit 1 is performing a 1-OP-TM-001, TURBINE-GENERATOR STARTUP TO 20% - 25% TURBINE POWER, Section 5.3, Latching the Turbine.
- At Step 5.3.7, the operator depressed and held the LATCH pushbutton.
o The LATCH pushbutton is backlit o Annunciator 1G-A5, VAC TRIP LATCH ACTUATED, is LIT o The operator is still depressing the LATCH pushbutton.
WOOTF completes both statements AFTER the operator releases the LATCH pushbutton?
- 2. Stem Focus: Each of the Choices includes Governor valves; therefore, the 1st fill-in-the-blank statement is only testing how the Intercept valves respond, so the statement can be streamlined to say:
The Intercept valves _______ be closed. [will vs will NOT]
6-14-21: Since we included underlined piece in stem question, does 2nd fill-in-the-blank statement need to repeat After the LATCH pb is released?
6-23-21: Same comment as 6-14-21; the stem question already has everything underlined, etc. No need for repeated in 2nd fill-in-the-blank statement?
6-30-21: Comment incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 62 H 2 x x N E T2G2 055 (Condenser Air Removal) G2.2.44 (interpret control room indications to verify the status and operation of a system, and S
understand how operator actions and directives affect plant and system conditions)
- 1. Partial: The 1st stem question should ideally test whether placing the hoggers in service is/ is NOT required per AP-14.00.
Use of the word should could lead to post-exam appeals.
Does the procedure Step *require* placing the hoggers in service?
Suggest re-wording the 1st fill-in-the-blank statement to be:
For the Current Conditions, the Condenser Hoggers are _____
to be placed in service.
[required vs not required]
It seems that the 1st stem question is vulnerable to post-exam appeals given the wording of the procedure Step.
- 2. Partial: The word worsening in the Initial Conditions 3rd bullet is different than the phrase slowly lowering in the Current Conditions 1st sub-bullet. Is this meant to imply a different slope or trend?
- 3. Stem Focus: The word correct is never needed in the stem question, and both fill-in-the-blank statements pertain to AP-14.00. Suggest re-wording the stem question as:
WOOTF completes both statements in accordance with 1-AP-14.00?
6-14-21: In the current conditions, why is the word worsening underlined? Because its not underlined in the initial conditions.
6-23-21: The 6-14-21 comment wasnt clear - my question was: Is it necessary to have underlines? Seems to be cueing because none of the other trend statuses for Gen MW, waterbox temp are underlined.
Does Surry procedures use the term degrading for vacuum?
6-30-21: Comment incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 63 H 2 x x x x N U T2G2 056 (Condensate) K1.03 (physical connections and/or cause-effect relationship between Condensate system and MFW)
S
- 1. Cred Dist: The 1st part of Choices B/C (suction pressure rises when the rinse initiated) is not plausible because service rinse effectively siphons off part of the flow going to the suction of the feed pumps.
- 2. Cue: The 3rd stem bullet is not necessary to elicit the correct response.
- 3. Partial: The stem bullets and stem question never say that the polisher was actually placed in service. An applicant could successfully argue that there is no correct answer because the extended service rinse never actually was performed - only the pre-brief was performed.
- 4. Stem Focus: The stem question phrase to verify the correct evolution was performed on Unit 1 may be confusing. Not sure what the phrase is supposed to mean, or if its necessary.
6-23-21: Replaced question with another new question; question is SAT.
64 H 3 x U T2G2 068 (Liquid Radwaste System) K5.04 (operational implication of bio hazards of radiation and goal of ALARA as they apply to the S
LRS)
- 1. Q=K/A: The proposed test item doesnt test the Liquid Radwaste System; it only tests the VPAP-2101 admin limits, etc.
The proposed test item is like an Admin JPM for the Rad Control topic.
One way to test the LRS may include testing the applicants knowledge of which plant area rad levels are affected during resin transfers, etc., in accordance with a precaution or limitation in the LRS operating procedure.
Another way to test the LRS topic may be associated with where a certain colored plant drain is routed; i.e., how the liquid is processed/routed such that ALARA is maintained or the spread of contamination is precluded.
- 2. The distracter analysis has a typo; the question should be listed as T2G2 (instead of T3).
6-14-21: Replaced question with a new question that tests both recommended concepts; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 65 F 2 x x x N E T2G2 072 (Area Radiation Monitoring) A3.01 (monitor auto operation of the ARM system, including changes in ventilation alignment)
S
- 1. Cred Dist: The plausibility of the 1st part of Choices A/C (purge fans tripped on low suction pressure) is questionable because a high radiation condition exists in containment; plants are designed such that hi rad conditions are a direct trip to purge fans - not low suction pressure during high rad conditions.
Although 1-VS-F-58A Filtered Exhaust fan trips on low suction pressure, the 1st fill-in-the-blank statement asks about the purge fans - not the Filtered Exhaust fan.
To remedy, suggest re-working the 1st question to test whether 1-VS-F-58A remains running vs. automatically trips.
- 2. Stem Focus: Suggest streamlining the 2nd fill-in-the-blank statement to eliminate all the verification actions for 1-IA-TV-101A / B and simply re-word as:
1-IA-AOV-102 _______automatically open.
[will / will NOT]
- 3. Partial: Experience has shown that use of the word direct or directly can be subject to post-exam appeals. (1st fill-in-the-blank statement)
- 4. Stem Focus: The underlined phrase all automatic actions occur as designed is not necessary; our Appendix E brief with the applicants clarifies that questions are to be answered based on how the plant is designed.
6-14-21: Re-worked question still may have same direct - indirect issue as Comment #3 above; i.e., the high rad condition caused the eventual trip of 1-VS-F-58A (due to subsequent low suction pressure). Choice D can also be argued as correct.
6-23-21: Question revised to a different fan; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 66 F 2 x x N U T3 G2.1.14 (criteria or conditions that require plant-wide announcements, such as pump starts, reactor trips, mode changes, S
etc.)
- 1. Cred Dist: The 2nd part of Choices A/B (no announcement required for radiography) is not plausible because conservative decision making would always warrant a plant announcement prior to commencing radiography. Even though the affected area was cleared/posted, plant staff that arent in the area still need to be aware of radiography.
- 2. Partial: An applicant could contest that since the service water pump is a 480 Volt load, a plant announcement is required. Is the charging service water pump started from the control room?
- 3. Partial: The stem question doesnt include the procedure (OP-AA-100), i.e., in accordance with OP-AA-100). This may lead to post-exam appeals.
6-23-21: Re-worked question to test fan thats specifically exempted from plant announcements and a resin transfer instead of radiography; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 67 F 2 x N E T3 G2.1.20 (interpret/execute procedure steps)
S 1. Partial: Suggest adding Unit 1 is at 25% power as the Initial Condition, to ensure admin control is required during performance of 1-OP-SI-002.
- 2. Partial: To ensure no post-exam appeals, suggest mirroring the 1-SI-002 P&L 4.10 wording; i.e., instead of the 2nd fill-in-the-blank statement having the underlined word permitted, use the word acceptable.
WOOTF completes both statements in accordance with SUADM-O-26, ADMINISTRATIVE CONTROL OF OPERATIONAL COMPONENTS, and 1-OP-SI-002?
One operator _____ permitted to be responsible for administrative control of both valves.
It _____ acceptable for an operator assigned to the Fire Team to also have an administrative control function.
[is vs is NOT]
- 3. Stem Focus: The word administrative is misspelled in the 2nd fill-in-the-blank statement, in the title of SUADM-O-26.
6-14-21: In the 1st fill-in-the-blank statement, the word admin should become administrative, like all the other words in the question.
6-23-21: Comments incorporated; however, the underlined word acceptable seems to be not necessary.
6-30-21: Comment incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 68 ? 2 x x N E/U T3 G2.2.18 (process for managing maintenance activities during shutdown operations, such as risk assessments, work prioritization, S
etc.)
- 1. Job-Link: The proposed RO test item is vulnerable to post-exam appeals because operability determinations are an SRO knowledge/ability/responsibility. Both fill-in-the-blank statements test the RO applicants knowledge of MDAFW pump operability requirements, which is SRO knowledge.
One RO knowledge item may be to test the administrative requirements for disabling an annunciator (due to maintenance activity) during outage conditions. However, if there is no differences between outage and online administrative requirements for annunciator disabling/tracking, then this idea may not work.
Another idea is to test the ROs knowledge of some outage tracking and/or logbook requirement.
Another idea is to test an RO knowledge/ability/responsibility associated with the Clearance procedure (SU-PROCSU-ADM-OP-AA-200 allowances during an outage.
Another idea may be associated with system alignment checklists while outage maintenance still ongoing within the system boundary.
- 2. Stem Focus: Both stem questions are similar, and may be testing the same concept: the pump can only be operable after the PMT is performed, which means that the PMT has to be performed before entering the mode of applicability.
- 3. LOK: The distracter analysis indicated LOK= higher cog/comprehension even though both parts of the question appear to be memory/fundamental/log cog.
6-23-21: The plausibility of B1/D1 (maint mgr maintains PHYSICAL control of the log) is questionable because SUPERVISION is a better choice.
The 1st part of the question asks about physical control of the log even though 1-OP-CT-002 only specifies control.
Suggest the following:
WOOTF completes both statements in accordance with 1-OP-CT-002, Containment Penetration Breach Log?
_________ shall maintain control of the Containment Penetration Breach Log. [what does shift supervison mean (what person?) vs Maintenance Manager]
The names of the containment closure team ________ required to be recorded in the Unit Narrative Log. [ are vs are not]
6-30-21: Comment incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 69 x U SAMPLE QUESTION RECD 10-7-2020 T3 G2.2.44 (interpret control room indications to verify status and operation of a system, and understand how operator actions &
directives affect plant and system conditions)
- 1. Q=K/A: The proposed test item doesnt directly or indirectly test a generic plant-wide topic - the test item seems to be specific to the P-8 logic only.
ES-401, Section D.2.a states: Ensure that the questions selected for Tier 3 maintain their focus on plantwide generic K/As and do not become an extension of Tier 2.
Is there a generic equipment control aspect thats being tested in the proposed P-8 test item?
Suggest replacing question with a test item that tests a generic aspect from one of the following administrative procedures:
- Conduct of Ops (SU-PROCSU-ADM-OP-AA-100)
- Equipment Clearance (SU-PROCSU-ADM-OP-AA-200)
- Verification Practices (SU-PROCSU-ADM-PI-AA-500)
- Admin Ctl Oper Comps (SU-PROC-000-SUADM-O-26)
One operationally valid way to test the K/A at a generic level may be to test a situation where valve/electrical lineups are being performed at the control room panel that is associated with a caution/clearance tag, etc.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 69 H 2 x x N E T3 G2.2.44 (interpret control room indications to verify status and operation of a system, and understand how operator actions &
S directives affect plant and system conditions)
- 1. Cred Dist and/or Cue: The plausibility of the 1st part of Choices A/C (not permissible even with SM permission) is questionable because the stem question contains the phrase with SM permission. (Its always ok to do something with SM permission.) The reason why the stem question contains the phrase is because of the OP-AA-100, Attachment 3, Section 1.3, Peer Checking, wording:
One way to remedy, could be to re-word the fill-in-the-blank statements as:
OP-AA-100, Conduct of Operations ________ contain an allowance to perform a control room component manipulation without a peer check during normal or routine operations activities.
[does vs does NOT]
IF the transfer was performed incorrectly by opening Station Service Norm Sup Bkr 15C2 prior to closing Reserve Sup Bkr 15C1, the reactor _______ required to be manually tripped for this plant condition.
6-14-21: Adding the phrase If a peer check cannot be made available to the beginning of the 1st fill-in-the-blank statement cues the applicant to the correct answer. The last stem bullet already says no other licensed operators are available for a peer check.
6-23-21: The 2nd fill-in-the-blank statement has a typo; the phrase prior to closing is duplicated. Also, the question seems to have two different font sizes.
7-1-21: Comment incorporated; question is SAT.
7-15-21: deleted human performance tool and added phrase from another reactor operator to ensure no partially correct answers.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 70 H 2 x x M E T3 G2.3.11 (control radiation releases)
S 1. Cue: The correct choice is a permit (piece of paper) whereas the incorrect choice is a parameter; max release rate information is always listed on some type of permit. Therefore, the wording of the 1st fill-in-the-blank statement (i.e., based on the) could lead the applicants to the correct answer (i.e.,
release permit), because the Number/TITLE/Section of the procedure that contains the release permit form is not used.
Suggest changing the 1st stem question to say Indicated release flow from B WGDT is limited based on
[Number/TITLE/Section of Procedure that has the Release Permit Form vs. OP-23.2.4, Attachment 4, MAXIMUM INDICATED WGDT FLOW RATE BASED ON H2 CONCENTRATION]
- 2. Partial: To ensure 2nd part of question is precise, include in accordance with Tech Spec 3.11.B, Gas Storage Tanks 6-23-21: Suggestion for 1st fill-in-the-blank statement not used; however replacement for it is sat. Comment #2 incorporated; question is SAT.
7-15-21: Validators said 1st part was minutia. Replaced 1st part with whether tank can be released with 1.65% O2 and 8.1% H2.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 71 H 2 x x x N E T3 G2.3.5 (use rad monitoring systems, such as fixed rad monitors and alarms, portable survey instruments, personnel monitoring S
equipment, etc.)
- 1. Q=K/A: From a plant-wide generic aspect, what is this test item testing? Since this is a Tier 3 topic, the test item should include some generic aspect. IF there is a generic aspect to the test item, then we should capture it on the distracter analysis.
In the 2nd fill-in-the-blank statement, is there a possibility to test the requirements for requesting a survey near radiation monitors?
Alternatively, is there an admin requirement for calibration due dates for plant installed rad monitor equipment?
Is there a generic aspect to Area Rad Monitors that we could test? We may have to keep this question if theres nothing else.
- 2. Partial: An applicant can successfully contend that theres no answer to the 2nd part of the question because 1-AP-24.00, Minor SG Tube Leak, contains no requirement to dispatch Health Physics to survey the Main Steam Rad Monitors.
- 3. Partial: The 4th stem bullet uses the word affected rad monitors, can we say : The team has dispatched Health Physics (HP) to locally survey rad levels by the appropriate rad monitors. IF the N-16 rad monitors are affected in ANY way, then an applicant could contend that there are two correct answers to the 2nd part of the question.
6-23-21: Generic aspect of when main steam & N16 rad monitors are used, including location. Re-worked question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 72 F 2 x B E T3 G2.3.7 (comply with RWP during normal or abnormal conditions)
S 1. Partial: An applicant can successfully argue that any of the Choices is the proper response because the mechanic may be in a bad situation, etc. The proposed test item is vulnerable to post-exam appeals..
Consider the following:
WOOTF completes both statements in accordance with VPAP-2101, Radiation Protection Program?
The Operations RWP is a __________ RWP.
[General vs Specific]
The maximum allowable exposure per individual entry to a radiation control area when using a General RWP is _______ .
[50 mrem vs 100 mrem]
- 3. RP-AA-274, Radiation Work Permits, was not included in the Box references; it may have testable information for operators.
6-23-21: Re-worked question is SAT. The stem question is missing a question mark.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 73 F 2 x x N E T3 G2.4.1 (EOP entry conditions and immediate action steps)
S 1. Q=K/A: From a generic aspect, what is this test item testing?
Since this is a Tier 3 topic, the test item should include some generic aspect associated with the EOPs. IF there is a generic aspect to the test item, then we should capture it on the distracter analysis.
One way to remedy Comment #1 above, i.e., test a generic T3 aspect, may be the following:
Unit 2 is in Cold Shutdown A spurious SI occurs.
WOOTF completes both statements?
1 / 2 E-0, Reactor Trip or Safety Injection, is applicable when RCS temperature is greater than or equal to _______ .
[200F vs 350F]
IF the proposed test item isnt testing a generic aspect to EOPs and/or immediate action steps, then suggest replacing the test item with something that tests entry conditions for FRPs, or something from OP-AP-104, Emergency & AOPs.
- 2. Partial: The stem doesnt specify that the SI was spurious; therefore, the proposed test item is vulnerable to post-exam appeals.
6-14-21: In response to Comment #1 above, I now can see what generic aspect the original (Draft) version of the question was testing
- - the generic aspect of AOP/EOP usage for spurious SI when RCS temperature is < 350°F. I also understand why my recommendation was vulnerable to post exam appeals (i.e., because E-0 is an allowable option at 200°F or 350°F in the step-by-step evaluation mode).
In the revised version, Choices A & C are both correct. To remedy, The earliest time that an Abnormal Procedure is allowed to be used in lieu of 1-E-0 for this event is when RCS temperature first reaches 6-23-21: The plausibility of the 2nd part of Choices B/D (will backup the spurious SI) is weak, and the phrase backing up may be slang.
To remedy suggest revising the 2nd fill-in-the-blank statement to say:
This Abnormal Procedure ________ direct [replace with what backing up means, i.e., depressing switch xyz, or turning switch xyz].
6-30-21: What is the noun name of the switch? Why is the word initiation underlined? Suggest using the noun name on the board.
7-1-21: Comment incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only T2 G2.4.32 (operator response to loss of all annunciators) 74 F 2 x x M E S 1. Partial and/or Stem Focus: To ensure the 2nd fill-in-the-blank statement is not vulnerable to post-exam appeals, suggest re-wording as the statement more precisely. For example:
The example of an annunciator functional check listed in 0-AP-10.13 for Unit 2 ___________ local action outside the MCR.
[requires vs does NOT require]
Unit 1 functional check examples:
Unit 2 functional check example:
6-14-21: Comment incorporated; question is SAT.
75 H 2 x B S T3 G2.4.4 (recognize abnormal indications for system operating parameters that are entry-level conditions for emergency and abnormal operating procedures)
- 1. Q=K/A: Suggest documenting on the distracter analysis basis for K/A match that this test item tests a broad approach to diagnosis of parameters that are entry level conditions to AOPs.
This will document the basis for the Tier 3 generic aspect.
6-14-21: Distracter analysis updated.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 76 H 2 x B E T1G1 015 (RCP Malfunctions) AA2.01 (determine/interpret cause of RCP failure as it applies to procedure)
S
- 1. The operational validity of the Initial Conditions is questionable; the crew is diluting the RCS to make the reactor critical even though TS 3.1.A.1, Reactor Coolant Pumps, requires three RCPs in operation when the reactor is critical. The stem says the A RCP is stopped; therefore, why would the crew be trying to make the reactor critical at this time? Doesnt seem operational valid.
Along the same thought process, the 2nd fill-in-the-blank statement may (incorrectly?) imply that the reactor can be taken critical by diluting with only one RCP? Perhaps the 2nd part of the question could be re-worked to test which GOP Series procedure selection would be required, etc.?
- 2. Stem Focus: The number/title of TS 3.1.A.1, Reactor Coolant Pumps, is missing from the 2nd fill-in-the-blank statement.
- 3. Stem Focus: The status of the C RCP is missing from the stem.
- 4. Stem Focus: The 3rd bullet in the Initial Conditions should include the procedure the crew is implementing to dilute RCS boron concentration; is it GOP-1.4? 1-OP-RX-009?
6-14-21: Comments incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 77 F 2 x x N E T1G1 026 (Loss of CCW) G2.4.11 (knowledge of AOPs)
S 1. Partial: An applicant could successfully argue that Choice C is also correct because the underlined phrase Short term may is vague, and because excess letdown is a short term fix for level control.
Suggest re-wording the 1st fill-in-the-blank to mirror the NOTE before Step 12 For example, re-word as:
In accordance with 1-AP-15.00, Loss of Component Cooling,
________ may be required to maintain PRZR level until a letdown flow path is established.
[Throttling Seal Injection Flow vs RCS cooldown]
- 2. Stem Focus: In the 2nd fill-in-the-blank statement, the phrase If CC cannot be restored is not needed since the 1st stem bullet says there is an unisolable CC rupture.
Suggest re-wording the 2nd fill-in-the-blank statement as:
In accordance with FCA-1.00, Limiting MCR Fire, Attachment 7, Establishing Alternate Letdown, 0-FCA-16.00, Local Operation of Air Operated Valves ________ required.
[is vs is NOT]
6-23-21: Comments addressed; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 78 F 2 x x N E/U T1G1 040 (Steam Line Rupture) G2.4.18 (knowledge of specific bases for EOPs)
S
- 1. Q=K/A: The 2nd fill-in-the-blank statement may not be related to the ECA-2.1 event in progress; whats the specific DBA being referred to in TS 3.4? Is it a LBCLOCA? IF the TS isnt referring to the Steam Line Rupture event, then the 2nd part of the question may not be related to the K/A topic. Typically, the ECAs are beyond design basis events, so the 2nd fill-in-the-blank statement may not be linked to TS 3.4 basis for the DBA.
ECA2.1 could be used for this question, as long as the test item tests the basis for an ECA-2.1 action, etc. Similarly, E-2 could be tested as long as the test item tests the basis for an E-2 action. One testable E2 concept could be the bases for why AFW is controlled differently than other EOPs.
- 2. Stem Focus: The number/title of Tech Spec 3.4, Spray Systems, is missing from the 2nd fill-in-the-blank statement.
6-23-21: Question re-worked to test ECA-2.1 required action and the basis for the action per background document. Question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 79 H 2 x x x N E T1G1 056 (LOOP) G2.4.41 (knowledge of EALs/thresholds)
S 1. Partial: To ensure no potential subset issues, included the word required in the 1st fill-in-the-blank statement, i.e., The highest required EAL classification is ______ .
- 2. Stem Focus: To ensure the applicants are aware of the Current Conditions with respect to the #1 EDG, suggest modifying the Initial Conditions last bullet to say:
- 1 EDG failed to start and is not available
- 3. Q=K/A: For two-part questions, one of the parts must be a direct hit on the K/A (like the 1st fill-in-the-blank statement is),
and the other part must be related to the K/A. The DEENs notification part of the question doesnt seem to be related to knowledge of EALs/thresholds.
Suggest deleting the 2nd part of the question and make the four choices into UE, Alert, Site, General, and include something in the stem that could be misconstrued to mean that only a UE was the highest required classification, or justify in the distracter analysis why only a UE is plausible.
6-23-21: The word required is missing in the stem question. Also, the last bullet in the Initial Conditions is missing the phrase and is not available.
6-30-21: Comments incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only T1G1 062 (Loss of Nuclear SW) AA2.06 (determine/interpret the 80 H 2 x x B E length of time after the loss of SWS flow to a component before that S component may be damaged, as it applies to procedure) 2009 Surry NRC Exam, Q#92
- 1. Partial and/or Stem Focus: The 1st part of the question should test the earliest time at which the operating charging pump is required to be shifted. This will mirror the procedure and eliminate the potential for sub-set issues with the correct answer. For example:
In accordance with 0-AP-12.00, the earliest time the operating charging pump is required to be shifted is _____ .
- 2. Stem Focus: Since there is no direct Tech Spec for SERVICE WATER pumps, suggest modifying the last stem bullet to say:
- 15:00: All Unit 1 Charging Pumps are declared inoperable.
The 2nd fill-in-the-blank statement could then be worded more simply as:
The latest time Unit 1 is required to be in Cold Shutdown is
- 3. Stem Focus: Stem question should refer applicants to Current conditions (instead of Based on the above conditions.
6-14-21: Comments incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 81 F 2 x x x E SAMPLE QUESTION RECD 10-7-2020 T1G1 065 (Loss Instrument Air) AA2.03 (determine and interpret location and isolation of leaks as it applies to LOIA)
- 1. Partial: There is no answer to the 2nd part of the question because TV-100 (automatic CIV) will not close; therefore, TS 3.8.C is not met and a containment integrity clock for IA-446 &
IA-447 is no longer relevant since the line can no longer be isolated. See comment #4 for suggestion.
- 2. Partial and/or SRO-only: The intent of the question was likely to test the requirements for establishing administrative control over 446/447 (IAW SU-PROC-000-SU-ADM-O26, Administrative Components, or 1-OP-IA-005, Admin Control of 446/447), which is a good idea, i.e., the intent was to test the word immediately which implied no briefing was accomplished yet (but is subjective - applicant can argue briefing was performed). The way the question is written allows RO knowledge (that LCO TS 3.8.C is not met when IA-446/447 are opened) to answer the 2nd part of the question, so the SRO hit is weak.
Suggest revising the 2nd part of the question to free it from RO knowledge, for example, test the time setting on the TS clock, i.e., test the 4-hour procedure requirement. Also, does SU-AM-026 have requirements that can be tested at the SRO level?
- 3. Partial: The air pressure is 70 and continuing to lower; Letdown isolation valves begin to drift closed at 65 psig, which could make the question more complicated for the applicants. See comment #4 for suggestion or suggest changing the 2nd bullet to 70 and stable.
- 4. Stem Focus: The whole stem could be stream-lined to say that U1 was at 100% power when 1B-F6 was entered and IA-446/447 are required to be opened. The fill-in-the-blank statements would still work with the stream-lined version.
- 5. Stem Focus: The initial plant status is missing from the stem.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 81 F 2 x x x N E T1G1 065 (Loss Instrument Air) AA2.03 (determine and interpret location and isolation of leaks as it applies to LOIA)
S
- 1. SRO-only: Comment #2 from the SAMPLE QUESTION (see above, RO knowledge that LCO TS 3.8.C is not met when IA-446/447 open) not incorporated.
Is it possible to modify the 2nd fill-in-the-blank statement as below in Comment #3?
- 2. Partial: To ensure only one correct answer, the stem should include a bullet that says:
Administrative Control of IA-446/IA-447 has NOT been assigned.
- 3. Stem Focus: The 2nd fill-in-the-blank statement is missing the TS 3.8.C, CIVs, number/title. For example:
In accordance with ARP 1B-F6, a _________ required action exists for TS 3.8.C, Containment Isolation Valves.
[1 hour vs 4 hour]
6-23-21: Comments incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 82 H 2 x x x N E SAMPLE QUESTION RECD 10-7-2020 T1G2 003 (Dropped Control Rod) AG2.4.21 (parameters & logic used to assess status of safety functions, such as reactivity control, core cooling and heat removal, RCS integrity, cnmt conditions, rad release control, etc.)
- 1. Cues: Because the stem does not include a timeline, and because the 2nd fill-in-the-blank statement ends with within 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />, the applicants can deduce that 1-OP-RX-001 is not required within 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />, i.e., SDM can be verified without performing 1-OP-RX-001.
- 2. Stem Focus: The Initial Conditions should all be in the past tense (since theyve already happened).
- 3. SRO-only: Suggest wording the 2nd fill-in-the-blank statement to eliminate the within 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> phrase, since that leads to RO knowledge. For example, re-word the 2nd fil-in-the-blank statement as:
1-OP-RX-001, Shutdown Margin (Calculated At Power),
___________ required to be performed for the initial shutdown margin verification required by TS 3.12, Control Rod Assemblies and Power Distribution Limits.
[is vs is NOT]
- 4. Stem Focus: In the 1st fill-in-the-blank statement, the term limiting core reactivity effect should be replaced with limiting power distribution limit.
82 H 2 N E T1G2 003 (Dropped Control Rod) AG2.4.21 (parameters & logic used to assess status of safety functions, such as reactivity control, S
core cooling and heat removal, RCS integrity, cnmt conditions, rad release control, etc.
- 1. Stem Focus: The 2nd fill-in-the-blank statement is missing the number/title of TS 3.12, Control Rod Assemblies and Power Distribution Limits. Suggest replacing to comply with Technical Specifications 6-14-21: Comment incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 83 F 2 x N E T1G2 036 (Fuel Handling Incidents) AA2.03 (determine/interpret magnitude of potential rad release is it applies to procedure)
S
- 1. Partial: To ensure theres a correct answer, suggest rewording the 2nd fill-in-the-blank statement to mirror the TS Bases, for example:
In accordance with the bases for Tech Spec 3.10, Refueling, the fuel handling accident analysis assumes 100% release of the assembly gap activity after a ______ decay period following operation at 2605 MWth.
[100-hour vs 48-hour]
6-14-21: Comment incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only T1G2 037 (SG Tube Leak) G2.4.6 (knowledge of EOP mitigation 84 H 2 x x N E strategies)
S
- 1. Stem Focus and/or Partial: 1) In the 1st stem question, the phrase using the procedures below is confusing/unnecessary.
- 2) The 1st stem question should refer the applicants to the Current Conditions. 3) The reference to immediate actions in the 1st stem question may not be necessary. 4) Typically, the numbers/names of procedures are included as a NOTE to the applicant, after all the stem questions.
To remedy Comment #1, suggest:
For the Current Conditions, which one of the following identifies the procedure/step that will be implemented first, after 2-E-0?
- 2. Stem Focus: The 2nd stem question has a phrase Assuming the SG leakage does not exceed 90 gpm.., which can be eliminated by saying For the Current Conditions.
- 3. Stem Focus: The Initial Conditions in the stem should be past tense.
- 4. Stem Focus: The phrase controllable rate in Choices B/C may not be necessary if these Choices are worded similar to Choices A/C. For example B.2/C.2: RCS cooldown at < 100°F/hour.
6-14-21: Comments incorporated; question is SAT.
85 H 2 x x N E T1G2 068 (CR Evacuation) AA2.04 (determine/interpret SG pressure as it applies to the procedure)
S
- 1. Q=K/A: The 2nd part of the question (SRO EAL classification) may not be associated with the K/A topic. To remedy, suggest making the EAL Choices to be Site Area Emergency vs Alert.
This way, the applicant has to determine whether the inadequate SG level/pressure is associated with the RCS heat removal key safety function for the HS6 designator.
- 2. Partial: To ensure no potential subset issues, include the word required in the 2nd fill-in-the-blank statement, i.e., The highest required EAL classification is ______ .
6-23-21: Comments incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 86 H 2 x x N E T2G1 004 (CVCS) G2.4.11 (knowledge of AOPs)
S 1. Cred Dist: The plausibility of the 1st part of Choices A/D (only 1C Charging Pump is inoperable) is questionable because the VCT is ruptured; therefore, all the pumps are essentially gas bound. The applicants dont need to know that AP-8.00 requires placing all the pumps in the P-T-L position.
Suggest re-working the question to have Unit 1 AND Unit 2 at 100% power. Have the crew to be evaluating AP-8.00, Step 3.a (Charging Pump cross-connect REQUIRED). Replace the 1st part of the question with the following fill-in-the-blank statement:
In accordance with AP-8.00, for the given conditions, Unit 2
_______ be manually tripped.
[will vs will NOT] The x-tie cant be used because Unit 1 charging system is not intact.
- 2. Stem Focus: The 6th stem bullet (RO reports Charging pump discharge pressure, flow, amps, .) should specify 1C Charging Pump.
- 3. Stem Focus: The 2nd fill-in-the-blank statement is missing the number/title of TS 3.2, CVCS. Suggest re-writing 2nd fill-in-the-blank statement as:
In accordance with the bases for TS 3.2, CVCS, the Charging Cross tie permits the opposite units charging pump to be used to bring the disabled unit to ________ shutdown conditions.
[Hot vs Cold]
6-23-21: Comment incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 87 F 2 x N U T2G1 006 (ECCS) G2.4.50 (verify system alarm setpoints and operate controls identified in the alarm response manual)
S
- 1. SRO-only: The proposed test item doesnt require the SRO applicants to select an appropriate procedure
[10CFR55.43(b)(5)]. The 2nd part of the proposed test item requires the applicants to know that ES-1.3 previously required swapping the LHSI pumps to the sump; this is a questionable SRO-only knowledge because it doesnt involve procedure selection.
Suggest testing an ECCS related annunciator procedure that directs another procedure to be implemented; this way, the procedure selection piece of the SRO topic could be tested.
Is there an ECCS related annunciator procedure that has a Tech Spec instrumentation item? Perhaps 10CFR55.43(b)(2)
{Tech Specs} may be an option.
6-30-21: Tough K/A. 2nd part: An applicant can argue that 1862A is full open and SI Train A is operable because the field operator says the valve is fully open.. Also, plausibility of Choices C1/D1 is questionable because 1862A is normally open and alarm should be designed as soon as off open seat. Suggest testing whether 1A-D4 will (vs will not) alarm. For 2nd part, suggest testing the required action per TS. The ARP references TS 3.3, so it would meet the intent of the K/A. The BEST way to test this K/A is to test an ECCS alarm window thats required to meet a TS surveillance (if any),
including the required compensatory measure when the alarm window (surveillance) isnt available.
7-1-21: Question changed to test whether TS Clock can be exited if valve locally opened and danger tagged off. Question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 88 H 2 x x N E T2G1 012 (RPS) A2.02 (predict the impacts of loss of instrument power on RPS and use procedures to correct, control, or mitigate)
S
- 1. Partial: For the 1st fill-in-the-blank statement, its not clear which point in time the applicants are being asked about the 1E-H5 annunciator. Are they being asked to assess the annunciator status in the Initial Conditions or the Current Conditions?
Suggest consolidating and be more precise instead of saying with this type of failure. For example:
Unit 1 is at 100% power
- The Control Power fuses for Power Range NIS Channel 4 (N44) have blown.
- The Instrument fuses are intact.
WOOTF completes both statements?
Annunciator 1E-H5, NIS PWR RNG HI STPT CH4 ________ be lit. [will vs will NOT]
Per TS Table3.7-1, Reactor Trip Instrument Operating Conditions, the N44 Channel may be bypassed for up to ______
hours for surveillance testing of the redundant channels.
[2 vs 12]
- 2. Stem Focus: The 2nd fill-in-the-blank statement is missing the number/title of TS. Suggest re-writing 2nd fill-in-the-blank statement as indicated above.
- 3. Overlap: Scenario 3 includes PR Channel N44 fails high; AP-4.00 actions will be performed during the scenario. It appears this written test item may be okay from an overlap perspective; it doesnt test the AP-4.00 actions.
6-14-21: Scenario revised to have N41 failure and different fuses.
Comments incorporated; question is SAT. The 2nd stem bullet has typo - - should say have blown (instead of has)
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 89 F 2 x x N E T2G1 059 (MFW) A2.12 (predict the impacts of failure of FRVs on the MFW system and use procedures to correct, control, mitigate)
S
- 1. Partial: The 4th bullet in the Initial Conditions is vague; what does alternate means mean? This alternate means could result in post-exam appeals for the 2nd fill-in-the-blank statement. Suggest specifying what action the operator took.
- 2. Partial/Stem Focus: The stem should specify that the MRFV has been placed on the jack (instead of saying the SRO has determined the need). Also, the 1st fill-in-the-blank statement should simply be:
The NRC Resident Inspector _______ required to be notified.
[is vs is NOT]
- 3. Stem Focus: Suggest swapping the order of the fill-in-the-blank statements, i.e., have the UFM first, then the NRC. This seems more logical and flows better with the K/A.
- 4. Stem Focus: The protocol for capitalizing the word not in the 1st part of each Choice should be consistent with the rest of the exam. For example:
[is vs is NOT]
6-23-21: Comments incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 90 H x N E SAMPLE QUESTION RECD 10-7-2020 T2G1 064 (EDG) A2.21 (predict impacts of opening of ring bus during test on EDG system and use procedures to correct, control, mitigate)
- 1. LOD=5: An applicant could contend that the 2nd part of the question requires memorizing TS 3.16 action statements because it requires knowledge of an 8-hour action. On the other hand, IF TS 3.16 was provided as a reference for this test item, the 2nd part of the question is a direct look-up.
- 2. The 1st part of the question indirectly test the applicants ability to predict the impact, i.e., Breaker 252 opening requires lowering speed droop because the EDG speeds up, which is, in a sense, predicting the impact of the malfunction. However, with Comment #1, there is no SRO part of the question because the speed droop effect is RO knowledge.
Consider changing the fill-in-the-blank statements to:
WOOTF completes both statements?
Attachment 6, EDG Contingency Actions, _________ required to be performed. [is vs is NOT]
TS 3.16, Emergency Power System, Specification A ________
met. [is vs is NOT]
For the 2nd fill-in-the-blank statement, the SRO-only aspect is met because TS 3.16 Specification A does not provide the meaning of the primary and dependable alternate supply terms. The applicant must have knowledge of the TS BASES to know that the RSST is the primary, which is no longer available.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 90 H 2 x x N E T2G1 064 (EDG) A2.21 (predict impacts of opening of ring bus during test on EDG system and use procedures to correct, control, S
mitigate)
- 1. Stem Focus/Partial: Try to avoid using the word clock in questions pertaining to TS because the word is vague and/or slang. See SAMPLE QUESTION suggestion above for re-wording the 2nd fill-in-the-blank statement.
- 2. Stem Focus: The title of TS 3.16 is missing in the 2nd fill-in-the-blank statement.
- 3. Stem Focus: The 2nd fill-in-the-blank statement phrase Based on current offsite power availability is not necessary.
6-14-21: I now understand how Surry uses the term clock to mean that the LCO is not met and a required action exists. However, the proposed reword of the 2nd fill-in-the-blank statement seems to only be asking for whether the LCO is applicable instead of asking whether a required action exists. Can we re-word as:
Based on current offsite power availability, a TS 3.16.A, Emergency Power System, required action clock _______
[exists vs does not exist]
6-23-21: Comments incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 91 H 2 N E/U T2G2 035 (Steam Generator System) G2.4.31 (knowledge of annunciator alarms, indications, or response procedures)
B S
- 1. Overlap:
- Scenario 1, SG C LT Fails Low;
- Scenario 3, SG A SF Fails high;
These scenario events overlap the 2nd part of the proposed test item because Tech Spec RPS/ESFAS will also be involved or assessed. The proposed test item is too close to the scenario events.
- 2. SRO-only: The SRO-only knowledge for the 2nd part of the question is questionable RO knowledge; ROs are required to know that a component is / is NOT Tech Spec related.
- 3. Stem Focus: The first portion of the 2nd fill-in-the-blank statement (Assuming the team performs 0-AP-53.00..) is not necessary.
6-23-21: All of op test events deleted from op test. Second part of question changed to test 72 vs 24 required action time; however, reference not provided. Testing SROs memory of required action time without a reference may be LOD=5 during post-exam appeal.
On the other hand, providing the reference may be a direct-lookup.
6-30-21: Same comment. Tech Specs is a response procedure.
So suggest testing some aspect of TS 3.1 (RCS), A.2 (SGs).
7-1-21: The plausibility of Choices B1/D1 (only primary side) is weak. The 2nd fill-in-the-blank statement tests applicants knowledge of LCO requirement (not required action), which is RO knowledge.
Suggest testing applicants knowledge of whose approval is required per VSP-F1 to defeat the alarming channel (SRO vs SM) and Suggest providing the applicants with TS 3.1 (minus the bases) and ask whether T.S. 3.0.1 is / is not applicable.
7-8-21: Randomly selected 014 (RPIS) G2.2.22 (LCOs and safety limits) because a closed book question couldnt be developed at the SRO level for SG ARPs or associated Tech Specs . Replaced with Bank Question #78 on NRC 2016 Exam.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only T2G2 071 (Waste Gas Disposal System) A2.05 (predict the impacts 92 ? 2 x x x B E/U of power failure to the ARM/PRM Systems to the WGDS and use S procedures to correct, control, mitigate)
- 1. Q=K/A: The 2nd part of the question may not test the applicants ability to use procedures to correct, control, or mitigate to loss of power to RI-130A. For example, explore the possibility of providing the ODCM (VPAP-2103S) to the applicants so they can identify required actions for the failed rad monitor.
- 2. Cue: The 1st fill-in-the-blank statement tells the applicant that closure of 1-GW-FCV-101 is an automatic action. Suggest re-working the 1st part of the question to test the applicants knowledge of whether the CTMT Vacuum Pumps remain running vs automatically trip.
- 3. Stem Focus: The Stem bullets should tell the applicants that a loss of power to RI-130A has occurred; if the green Operate light extinguished means loss of power, then stem may be okay.
However, if other things can cause the green Operate light to be extinguished, then we should clarify the loss of power in the stem.
- 4. LOK: The distracter analysis indicated the proposed test item was higher cog/comprehension; however, both parts of the question seem to be lower cog/memory.
6-14-21: The re-worked 2nd part of the question became a direct lookup. Maybe we could ask whether the minimum number of operable Process Vent System channels is / is not met IAW ODCM Attachment 5. (without providing ODCM as reference) 6-30-21: Reworked 2nd part to test ODCM required action for flow meter. Question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 93 H 1.5 N E/U SAMPLE QUESTION RECD 10-7-2020 T2G2 086 (Fire Protection) A2.04 (predict impacts of failure to actuate the FPS when required, resulting in fire damage, on the FPS, and use procedures to correct, control, mitigate.)
- 1. Cues and/or Cred Dist: The underlined phrase electrical control system in the 1st fill-in-the-blank statement hurts the plausibility of Choices A1 and B1 (remote actuation still possible from Turbine Building); some form of power is required to remotely actuate anything.
- 2. Form ES-401-5 identified that the TRM was the reference being provided to the applicants. Assuming that TR 3.7.5, Halon System, (pp 3.7.5-1 through -2) are being provided, then the 2nd part of the question is a direct look-up.
One idea to remedy may include testing the applicants knowledge of the bases for TR 3.7.5. For example, the functionality of the Halon System depends on the door between U1 and U2 ESGRs latching, and depends on the dampers on 0-FP-FACP-14. If you choose this route, ensure that the test item has something that keeps it plausible that functionality would still somehow remain intact even when a damper wouldnt fully close or the door wouldnt latch, etc.
Another idea could include testing the applicants knowledge of 0-AP-48.00, Attachment 3, Appendix R Safe Shutdown Functions, for any area, including the ESGR. For example, when a safe shutdown function is threatened, then entry to ( )-
FCA-4.00 is required, which may include testable knowledge.
Also, VPAP-2802, Notification and Reports, could be provided to the applicants and ask them to identify the reporting time requirement for the fire. Reporting is part of using procedures to correct, control, or mitigate.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 93 H 2 x N E/U T2G2 086 (Fire Protection) A2.04 (predict impacts of failure to actuate the FPS when required, resulting in fire damage, on the FPS, S
and use procedures to correct, control, mitigate.)
- 1. Cred Dist: The 2nd part of Choices B/D (sliding door not required for halon functionality) is not plausible because nothing in the stem could be misconstrued as to why the door isnt required for functionality. (See SAMPLE QUESTION suggestion and comment above).
Suggest deleting the stem bullet about the crew entering 0-AP-48.00. Then modify the 2nd part of the question as:
0-AP-48.00, Attachment 3, Appendix R Safe Shutdown Functions, _______ required to be performed.
[is vs is NOT]
6-14-21: Comment incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only T3 G2.1.2 (knowledge of operator responsibilities during all modes of 94 H 2 x N U plant operation)
S
- 1. SRO-only: The proposed test item is like an RO Admin JPM; the proposed test item tests reactor operator (RO) work hour limitations, which is RO knowledge. Each individual is responsible for managing work hours to ensure 10 CFR 26 limits arent exceeded.
Suggest something else, for example:
WOOTF completes both statements regarding a WAIVER of 10 CFR 26 limits in accordance with SU-PROCSU-ADM-LI-AA-700, Fatigue Management and Work Hour Limits for Covered Workers?
The Supervisor Face-to-Face Fatigue Assessment is required to be completed no more than _______ hours before exceeding 10 CFR 26 limits.
The Operations Shift Manager __________ requisite signature authority to sign Section 4 - Approval to Exceed 10 CFR 26 Limits - on Attachment 2, 10 CFR 26 Limits Waiver.
[has vs does NOT have]
6-23-21: Second part of recommendation incorporated; 1st part changed to test weekly average allowed work hours. Question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 95 F 2 x x N E/U T2 G2.2.1 (ability to perform pre-startup procedures for the facility, including operating those controls associated with plant equipment S
that could affect reactivity)
- 1. Cred Dist: The plausibility of the 2nd part of Choices B/D (Reactivity SRO not allowed to peer check RO) is questionable because the stem says the SROs purpose is for reactivity.
Suggest modifying the 2nd part of the question.
- 2. Stem Focus: The 1st stem bullet is vague; is the reactor critical?
Suggest clarifying plant conditions, including the controlling GOP procedure in progress.
- 3. Stem Focus: The number/name of the low power physics test is missing from the 2nd bullet.
- 4. Stem Focus: The title of TS 3.12 is missing from the 1st fill-in-the-blank statement.
- 5. OP-AP-300, Reactivity Management, was not included in the BOX references.
6-23-21: Comments incorporated; suggest changing the 2nd part of Choices B2/D2 to be: the additional RO [instead of a Reactor Operator]
6-30-21: Comment incorporated; question is SAT.
96 F 2 x B E T3 G2.2.13 (knowledge of tagging and clearance procedures)
S 1. Stem Focus and/or Cues: The 1st fill-in-the-blank statement should be the lowest level approval allowed for using relief valves.
6-14-21: Comment incorporated; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only SAMPLE QUESTION RECD 10-7-2020 97 F 2 x x x N E T3 G2.3.12 (radiological safety principles pertaining to LO duties, such as cnmt entry reqts, FH responsibilities, access to LHRA, aligning filters, etc.)
- 1. Partial: The premise of the question is a condition that causes a LHRA to temporarily exist. Temporary situations could lead to post-exam appeals if the situations arent clearly defined in the administrative procedures. Is the resin shot temporary LHRA (i.e., the whole Decon Bldg lower level) specifically defined in any administrative procedure, e.g., CO-PROC-000-VPAP-2101, or others? If not, then suggest deleting the two stem bullets, i.e., just test a normal LHRA, such as a room, etc.
- 2. Cred Dist: The plausibility of the 2nd part of Choices C and D (got to have a key to leave the LHRA) is questionable because if you lose a key inside a LHRA, you could become over-exposed since your exit would be delayed until someone could arrive and let you out. I didnt grade this question as U because I think you intended the plausibility to be that the whole Decon Bldg lower level floor was involved; however, the plausibility flaw still remains; applicants can eliminate Choices C and D solely based on having a key to leave a dangerous area doesnt seem logical.
- 3. Stem Focus and /or Partial: To ensure the question is bullet-proof to post exam appeals, the 1st fill-in-the-blank statement should be re-worded to speak of the keys, because thats what TS 6.4.B.2 says should be administratively controlled. For example, suggest the following:
IAW TS 6.4, Unit Operating Procedures and Programs, Specification B.2, the Shift Manager ________ allowed to control the key to a plant LHRA.
[is vs is NOT]
Other ideas for this question could include testing the applicants knowledge of why VPAP-2101 requires that the SM be notified before anyone enters a VHRA under vessel/incore guide tube area. What does SM do with that information?
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only T3 G2.3.12 (radiological safety principles pertaining to LO duties, 97 F 2 x x N U such as cnmt entry reqts, FH responsibilities, access to LHRA, S aligning filters, etc.)
- 1. Cred Dist: The 2nd part of Choices C/D (SM has to be notified of every LHRA entry) is not plausible because every plant LHRA entry would become a distraction to the SM duties and because the RadCon folks are primarily responsible.
- 2. Partial and/or Operational Validity: Choice A (SM is not allowed to give LHRA key to I&C Techs) can also be successfully argued as correct because I&C Techs will likely get the key from RadCon, not the SM. The operational validity of the SM giving the Operations LHRA key to a different department worker is questionable. Suggest using the comment in the SAMPLE QUESTION, see above.
- 3. Ensure no overlap with Q#98. The K/A is amenable to many other SRO duties/responsibilities, such as fuel handling and/or containment entry, etc.
6-23-21: Replaced with different question that tests whether FH Bldg supervisor is required to be an SRO and whether Containment SRO is allowed to authorize the overload bypass switch. Question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only T2 G2.3.13 (knowledge of rad safety procedures pertaining to 98 H 2 x x x N E/U licensed operator duties, such as response to rad monitor alarms, S containment entry requirements, fuel handling responsibilities, access to LHRAs, aligning filters, etc.)
- 1. Partial and/or Cred Dist: Choice C can be successfully argued as correct because 1) the first aid/ambulance personnel could notify the news agencies and/or 2) nothing in the stem indicates whether a news release will occur.
The plausibility of the 2nd part of Choices C/D (4 hour4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br /> report) is not plausible because the stem doesnt contain anything that could be misconstrued as a news release.
- 2. Stem Focus and/or Partial: The 1st part of the question can be steamlined as below, to be more specific and minimize the possibility of other keys needed to access the plant, etc:
The Auxiliary Building area ________ a locked high radiation area. [is vs is NOT]
To remedy Comment #1 above, consider the following replacement test item, which may altogether eliminate the need to provide VPAP-2802 as a reference.
WOOTF completes both statements in accordance with VPAP-0106, Subatmospheric Containment Entry?
IF containment pressure is greater than or equal to 9.0 psia and less than 12.0 psia, THEN SCBA with _________ percent oxygen by volume shall be used.
[33 to 37 vs 35 to 65]
Exemption to the above requirement is allowed, in part, if permission for the exemption has been obtained from the_________ . .
[Plant Manager vs Radiation Protection Supervisor]
6-23-21: The 2nd part of the question doesnt have anything to do with the K/A. The 1st part of the question does hit the K/A; however, it hits the K/A at the RO level. IF the 2nd part of the question is the SRO piece, then it needs to hit the K/A. Also, concerned that notifying Sheriff department can still be argued as notifying a government agency, etc.
6-30-21: Same comment as 6-23-21; how is the 2nd part hitting the K/A? Also, the 2nd fill-in-the-blank question (if used) needs to say the earliest time that a NRC notification is required is 7-1-21: VPAP 2802 piece is contamination; therefore K/A being met.
Question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only T3 G2.4.20 (knowledge of operational implications of EOP warning, 99 H 2 x N E cautions, and notes)
S
- 1. Partial: IF the only thing that proves the correct answer is the lesson plan (ND-95.3-LP-3), THEN the proposed test item is vulnerable to post-exam appeals because the SROs required direction for the Assistant RO is subjective. OP-AP-104, Emergency and AOPs, doesnt contain any of the requirements for pre-emptive action attachments. Is there a site-specific guidance document for the Assistant RO?
- 2. Partial: We need to ensure that the 2nd bullet in the Current Conditions is 100% bullet-proof to mean that all SGs are faulted.
If theres a way for all SG pressures to be 800 psig and lowering at the same rate due to a single fault, then the proposed test item may be vulnerable to appeals.
6-23-21: Question replaced.
In the Initial Conditions and in the Current Conditions, suggest replacing due to a LOCA outside containment with the detail of what broke/is leaking [instead of saying LOCA outside containment].
Suggest modifying the 1st bullet in the Current Conditions to say:
The SRO incorrectly transitioned from E-0 to E-1.
Suggest revising the 1st portion of the 1st fill-in-the-blank to be more clear: After the SRO exited E-0, Suggest changing the 2nd fill-in-the-blank statement to test whether 1-ES-0.0 is / is not required to be entered. If its a judgement call, then we may have partially correct answer.
6-30-21: Need you to walk me through the procedure that says ReDiagnosis is required to be entered.
7-1-21: Re-worked 2nd piece of question; question is SAT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 100 H 2 B S T3 G2.4.5 (knowledge of the organization of the operating procedures network for normal, abnormal, and emergency evolutions) 2015 SQN NRC Exam, Q#100
- 1. Please note in the K/A Match portion of the distracter analysis that although the proposed test item appears to be an extension of Tier 1, the generic aspect that is being tested is the requirement for the implementation of FRPs in the EOPs.
6-14-21: Distracter analysis updated.