ML21216A102

File 2A3 Exam Administrative Items

ML21216A102
Person / Time
Site:	Farley
Issue date:	08/04/2021
From:	Southern Nuclear Operating Co
To:	NRC/RGN-II
References
Download: ML21216A102 (71)

Text

ML21216A102 ES-301 Administrative Topics Outline Form ES-301-1 Facility: Farley Date of Examination: 06/10/19 Examination Level: RO SRO Operating Test Number: FA2019-301 Administrative Topic (see Note) Type Describe activity to be performed Code*

A.1.a R, D

Title:

Determine the required quantity of Boric Acid and Reactor Makeup water to restore Conduct of Operations RWST level at the current Boric Acid Concentration, and correctly determine the setting of the Reactor Makeup system integrators and the potentiometer setting for the Boric Acid Flow controller.

G2.1.23 - 4.3/4.4 G2.1.25 - 3.9/4.2 G2.1.20 - 4.6/4.6 A.1.b R, D

Title:

Perform a Shutdown Margin Calculation in modes 1 & 2 (STP-29.5).

Conduct of Operations G2.1.20 - 4.6 / 4.6 G2.1.23 - 4.3 / 4.4 G2.1.25 - 3.9 / 4.2 A.2

Title:

RCP seal injection leakage test.

This will be a task to determine / calculate RCP Equipment Control R, D SI leakage and evaluate Acceptance Criteria per STP-8.0, RCP Seal Injection Leakage Test.

G2.2.12 - 3.7/4.1 A.3

Title:

Determine Access Personnel Exposure.

Radiation Control R, M This will require applicant to determine lowest dose route and then decide if they can perform the job without exceeding normal dose limits.

G2.3.4 - 3.2/3.7 A.4 None selected Emergency Plan NOTE: All items (five total) are required for SROs. RO applicants require only four items unless they are retaking only the administrative topics (which would require all five items).

• Type Codes and Criteria: (C)ontrol room, (S)imulator, or Class(R)oom 4 (D)irect from bank ( 3 for ROs; 4 for SROs and RO retakes) 3 (N)ew or (M)odified from bank ( 1) 1 (P)revious 2 exams ( 1, randomly selected) 0

ES-301 Administrative Topics Outline Form ES-301-1 Facility: Farley Date of Examination: 06/10/19 Examination Level: RO SRO Operating Test Number: FA2019-301 Administrative Topic (see Note) Type Describe activity to be performed Code*

A.1.a Determine while completing a mode change Conduct of Operations R, D checklist that Mode 4 entry is prohibited through review of STPs and Tech Specs G2.1.2 - 4.1/4.2 G2.1.23 - 4.3/4.4 A.1.b Verification of Initial Conditions Prior to Core Conduct of Operations R, D Alterations G2.1.36 - 3.0/4.1 G2.1.40 - 2.8/3.9 A.2

Title:

RCP seal injection leakage test.

Equipment Control R, D This will be a task to determine calculate RCP SI leakage and evaluate Acceptance Criteria per STP-8.0, RCP Seal Injection Leakage Test and then evaluate Tech Specs.

G2.2.12 - 3.7/4.1 A.3 Determine emergency dose rate and determine Radiation Control R, M if tasks can be completed.

G2.3.4 - 3.2/3.7 A.4 Classify an emergency event.

Emergency Plan R, D G2.4.40 - 2.7/4.5 G2.4.41 - 2.9/4.6 NOTE: All items (five total) are required for SROs. RO applicants require only four items unless they are retaking only the administrative topics (which would require all five items).

• Type Codes and Criteria: (C)ontrol room, (S)imulator, or Class(R)oom 5 (D)irect from bank ( 3 for ROs; 4 for SROs and RO retakes) 4 (N)ew or (M)odified from bank ( 1) 1 (P)revious 2 exams ( 1, randomly selected) 0

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 Facility: FARLEY Date of Examination: 06/10/19 Exam Level: RO SRO-I SRO-U Operating Test Number: FA2019-301 Control Room Systems:* 8 for RO, 7 for SRO-I, and 2 or 3 for SRO-U System/JPM Title Type Code* Safety Function

a. CRO-065B: Perform An Emergency Boration. Will require A, D, L, S 1 aligning the emergency boration flow path.

024AA2.01 - 3.8/4.1 024AA2.02 3.9/4.1

b. CRO-343J: Place Normal Charging In Service And Control A, D, EN, L, S 3 Pressurizer Level As Required In Response To A Safety Injection. (SRO-U)

Will require re-aligning HHSI due to SB LOCA 009EA2.04 3.8/4.0 009EA2.13 3.4/3.6

c. CRO-336B: Check Feedwater status in response to a Reactor A, EN, L, M, 4S trip and Safety Injection. Will require starting MDAFW pumps and S (SRO-U) securing EH pumps.

059A3.04 - 2.5 / 2.6 059A4.08 - 3.0 / 2.9 059A3.06 - 3.2 / 3.3 061A3.01 - 4.2 / 4.2

d. CRO-346: Align The Containment Spray System For The Post- D, EN, L, S 5 Accident Recirculation Phase Of Operation. (SRO-U) 026A4.01 - 4.5/4.3

e. CRO-066A: Perform The Required Actions To Prepare The D, L, S 4P Residual Heat Removal System For RCS Cooldown 005A4.01 - 3.6/3.4 005A4.02 - 3.4/31

f. CRO-336D: Energize Pressurizer Heaters As Required In L, M, S 6 Response To A Reactor Trip. Will energize 1B Pressurizer Heaters 062A4.01 3.3/3.1 056AA1.26 2.5/2.6 056AA1.31 3.3/3.3

g. CRO-328B: Restore Instrument Air after an LOSP - 1C Air A, D, L, S 8 compressor will not start and alignment of power to 1A Air compressor is necessary. Additionally, Air valves will be operated.

065AA1.03 2.9/3.1

h. CRO-077: Reduce Pressure in the 1A SIS Accumulator. D, EN, S 2 006A1.13 3.5/3.7 (RO Only) 006A4.02 4.1/3.9 In-Plant Systems:* 3 for RO, 3 for SRO-I, and 3 or 2 for SRO-U

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2

i. SO-449B: Supply Emergency Air To Steam Generator D, E, L 8 Atmospheric Relief Valves From Emergency Air Compressors (SRO-U)

Without DC Power Available on Unit 1[2].

065AA1.04 - 3.5/3.4

j. SO-344: Place 1[2]A Instrument Inverter in Service D 6 62A2.03 2.9/3.4 057AA 1.01 3.7/.37

k. SO-372D - Release #2 WMT to the environment. Will require A, D, R 9 manual actions to stop release when radiation monitor exceeds (SRO-U) setpoint and automatic actions fail to work 059 AA1.01 3.5/3.5 059 AA2.05 3.6/3.9

• All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions, all five SRO-U systems must serve different safety functions, and in-plant systems and functions may overlap those tested in the control room.

• Type Codes Criteria for RO/SRO-I/SRO-U (A)lternate path 4-6/4-6 /2-3 5/5/3 (C)ontrol room 0/0/0 (D)irect from bank 9/ 8/ 4 9/84 (E)mergency or abnormal in-plant 1/ 1/ 1 1/1/1 (EN)gineered safety feature 1/ 1/ 1 (control room system) 4/3/3 (L)ow-Power/Shutdown 1/ 1/ 1 8/8/4 (N)ew or (M)odified from bank including 1(A) 2/ 2/ 1 2/2/1 (P)revious 2 exams 3/ 3/ 2 (randomly selected) 0/0/0 (R)CA 1/ 1/ 1 1/1/1 (S)imulator 8/7/3

ES-301 Transient and Event Checklist Form ES-301-5 Facility: FARLEY Date of Exam: 06/10/2019 Operating Test No.: FA2019-301 A E Scenarios P V 2 3 5 T M P E O I L N CREW CREW POSITION CREW POSITION T N I T POSITION I

C A S A B S A B S A B M A T L R T O R T O R T O U N Y O C P O C P O C P M(*)

T P E R I U Slone RX 1 1 1 1 0 SRO-I NOR 0 1 1 1 X I/C 236 345 134 14 4 4 2 7 6 567 MAJ 67 6 7 4 2 2 1 TS 35 13 4 0 2 2 RX 1 1 1 1 0 McShane NOR 0 1 1 1 SRO-I I/C 236 345 134 14 4 4 2 X 7 6 567 MAJ 67 6 7 4 2 2 1 TS 35 13 4 0 2 2 Phillips RX 1 1 1 1 0 SRO-I NOR 0 1 1 1 X I/C 236 345 134 14 4 4 2 7 6 567 MAJ 67 6 7 4 2 2 1 TS 35 13 4 0 2 2 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions. Instant SROs (SRO-I) must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an SRO-I additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.

2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional I/C malfunctions on a one-for-one basis.

3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

4. For new reactor facility licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-I applicants in either the ATC or BOP position to best evaluate the SRO-I in manipulating plant controls.

ES-301 Transient and Event Checklist Form ES-301-5 Facility: FARLEY Date of Exam: 06/10/2019 Operating Test No.: FA2019-301 A E Scenarios P V 2 3 6 T M P E O I L N CREW CREW POSITION CREW POSITION T N I T POSITION I

C A S A B S A B S A B M A T L R T O R T O R T O U N Y O C P O C P O C P M(*)

T P E R I U RX 2 1 1 1 0 Hasselbring NOR 0 1 1 1 SRO-I I/C 234 14 8 4 4 2 X 567 MAJ 67 6 3 2 2 1 TS 25 2 0 2 2 RX 2 1 1 1 0 NOR 0 1 1 1 Contreras I/C 234 14 345 15 4 4 2 567 67 SRO-I 7* 8 X

MAJ 67 6 8 4 2 2 1 TS 25 26 4 0 2 2 RX 2 1 1 1 0 Burke NOR 0 1 1 1 SRO-I I/C 234 14 345 15 4 4 2 X 567 67 7* 8 MAJ 67 6 8 4 2 2 1 TS 25 26 4 0 2 2 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions. Instant SROs (SRO-I) must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an SRO-I additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.

2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional I/C malfunctions on a one-for-one basis.

3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

4. For new reactor facility licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-I applicants in either the ATC or BOP position to best evaluate the SRO-I in manipulating plant controls.

• Scenario 6 event 7 has one RO and one BOP Component failure

ES-301 Transient and Event Checklist Form ES-301-5 Facility: FARLEY Date of Exam: 06/10/2019 Operating Test No.: FA2019-301 A E Scenarios P V 3 5 6 T M P E O I L N CREW CREW POSITION CREW POSITION T N I T POSITION I

C A S A B S A B S A B M A T L R T O R T O R T O U N Y O C P O C P O C P M(*)

T P E R I U RX 2 1 1 1 0 Williams NOR 2 1 2 1 1 1 RO I/C 35 13 467 11 4 4 2 X 6 67 8 MAJ 6 7 8 3 2 2 1 TS 0 0 2 2 RX 2 1 1 1 0 Watts NOR 2 1 2 1 1 1 RO I/C 35 13 467 11 4 4 2 X 6 67 8 MAJ 6 7 8 3 2 2 1 TS 0 0 2 2 RX 2 1 1 1 0 Turner NOR 2 1 2 1 1 1 RO I/C 35 13 467 11 4 4 2 X 6 67 8 MAJ 6 7 8 3 2 2 1 TS 0 0 2 2 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions. Instant SROs (SRO-I) must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an SRO-I additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.

2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional I/C malfunctions on a one-for-one basis.

3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

4. For new reactor facility licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-I applicants in either the ATC or BOP position to best evaluate the SRO-I in manipulating plant controls.

ES-301 Transient and Event Checklist Form ES-301-5 Facility: FARLEY Date of Exam: 06/10/2109 Operating Test No.: FA2019-301 A E Scenarios P V 2 5 6 T M P E O I L N CREW CREW POSITION CREW POSITION T N I T POSITION I

C A S A B S A B S A B M A T L R T O R T O R T O U N Y O C P O C P O C P M(*)

T P E R I U RX 1 1 1 1 0 Tran NOR 1 2 2 1 1 1 RO I/C 45 457 357 8 4 4 2 X MAJ 67 7 8 4 2 2 1 TS 0 0 2 2 RX 1 1 1 1 0 Hutchinson NOR 1 2 2 1 1 1 RO I/C 45 457 357 8 4 4 2 X MAJ 67 7 8 4 2 2 1 TS 0 0 2 2 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions. Instant SROs (SRO-I) must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an SRO-I additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.

2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional I/C malfunctions on a one-for-one basis.

3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

4. For new reactor facility licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-I applicants in either the ATC or BOP position to best evaluate the SRO-I in manipulating plant controls.

ES-301 Transient and Event Checklist Form ES-301-5 Facility: FARLEY Date of Exam: 06/10/2019 Operating Test No.: FA2019-301 A E Scenarios P V 1 2 5 6 T M P E O I L N CREW CREW POSITION CREW POSITION CREW POSITION T N I T POSITION I

C A S A B S A B S A B S A B M A T L R T O R T O R T O R T O U N Y O C P O C P O C P O C P M(*)

T P E R I U Delong RX 1 1 1 1 0 RO NOR 2 1 1 1 1 X I/C 356 457 6 4 4 2 MAJ 6 7 2 2 2 1 TS 0 0 2 2 RX 1 1 1 1 0 Hill NOR 12 1 3 1 1 1 I/C 24 45 357 8 4 4 2 RO 6

X MAJ 6 67 8 4 2 2 1 TS 0 0 2 2 Smith RX 0 1 1 0 SRO-U NOR 0 1 1 1 X I/C 234 345 12 4 4 2 56 67 7* 8 MAJ 6 8 2 2 2 1 TS 125 26 5 0 2 2 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions. Instant SROs (SRO-I) must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an SRO-I additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.

2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional I/C malfunctions on a one-for-one basis.

3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

4. For new reactor facility licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-I applicants in either the ATC or BOP position to best evaluate the SRO-I in manipulating plant controls.

• Scenario 6, Event 7 has one ATC and one BOP component failure.

ES-301 Competencies Checklist Form ES-301-6 Facility: FARLEY Date of Examination: 06/10/2019 Operating Test No.:FA2019-301 APPLICANTS Slone McShane Phillips Hasselbring SRO-I X SRO-I X SRO-I X SRO-I X Competencies SCENARIO SCENARIO SCENARIO SCENARIO 2 3 5 2 3 5 2 3 5 2 3 Interpret/Diagnose Events 23 23 13 23 23 13 23 23 13 23 14 and Conditions 67 45 45 67 45 45 67 45 45 45 6 67 67 67 67 67 67 67 Comply with and 12 24 13 12 24 13 12 24 13 23 12 Use Procedures (1) 36 56 56 36 56 56 36 56 56 45 46 7 7 7 7 7 7 7 7 7 67 Operate Control 12 12 12 12 Boards (2) 36 36 36 46 7 7 7 Communicate 12 12 12 12 12 12 12 12 12 12 12 and Interact 36 34 34 36 34 34 36 34 34 34 46 7 56 56 7 56 56 7 56 56 56 7 7 7 7 7 7 7 Demonstrate Supervisory 12 12 12 12 12 12 12 Ability (3) 34 34 34 34 34 34 34 56 56 56 56 56 56 56 7 7 7 7 7 7 7 Comply with and 35 13 35 13 35 13 25 Use TS (3)

Notes:

(1) Includes TS compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant. (This includes all rating factors for each competency.) (Forms ES 303 1 and ES 303 3 describe the competency rating factors.)

ES-301 Competencies Checklist Form ES-301-6 Facility: FARLEY Date of Examination: 06/10/2019 Operating Test No.:FA2019-301 APPLICANTS Contreras Burke Smith Delong SRO-I X SRO-I X SRO-U X RO X Competencies SCENARIO SCENARIO SCENARIO SCENARIO 2 3 6 2 3 6 1 6 1 5 Interpret/Diagnose Events 23 14 23 23 14 23 23 23 356 12 and Conditions 45 6 45 45 6 45 45 45 45 67 67 67 67 6 67 67 8 8 8 Comply with and 23 12 23 23 12 23 23 23 135 12 Use Procedures (1) 45 36 56 45 36 56 45 56 6 45 67 78 67 78 6 78 67 Operate Control 12 12 135 12 Boards (2) 46 46 6 45 67 Communicate 12 12 12 12 12 12 12 12 123 12 and Interact 34 46 34 34 46 34 34 34 56 34 56 56 56 56 56 56 56 7 78 7 78 78 7 Demonstrate Supervisory 12 12 12 12 12 12 Ability (3) 34 34 34 34 34 34 56 56 56 56 56 56 7 78 7 78 78 Comply with and 25 26 25 26 25 26 Use TS (3)

Notes:

(1) Includes TS compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant. (This includes all rating factors for each competency.) (Forms ES 303 1 and ES 303 3 describe the competency rating factors.)

ES-301 Competencies Checklist Form ES-301-6 Facility: FARLEY Date of Examination: 06/10/2019 Operating Test No.:FA2019-301 APPLICANTS Williams Watts Turner Hill RO X RO X RO X RO X Competencies SCENARIO SCENARIO SCENARIO SCENARIO 3 5 6 3 5 6 3 5 6 1 2 6 Interpret/Diagnose Events 35 13 46 35 13 46 35 13 46 24 456 23 and Conditions 6 67 78 6 67 78 6 67 78 56 7 57 8

Comply with and 23 12 14 23 12 14 23 12 14 12 145 13 Use Procedures (1) 56 35 67 56 35 67 56 35 67 45 67 57 67 8 67 8 67 8 6 8 Operate Control 23 12 14 23 12 14 23 12 14 12 145 13 Boards (2) 56 35 67 56 35 67 56 35 67 45 67 57 67 8 67 8 67 8 6 8 Communicate 23 12 14 23 12 14 23 12 14 12 124 12 and Interact 56 34 67 56 34 67 56 34 67 46 567 35 57 8 57 8 57 8 78 Demonstrate Supervisory Ability (3)

Comply with and Use TS (3)

Notes:

(1) Includes TS compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant. (This includes all rating factors for each competency.) (Forms ES 303 1 and ES 303 3 describe the competency rating factors.)

ES-301 Competencies Checklist Form ES-301-6 Facility: FARLEY Date of Examination: 06/10/2019 Operating Test No.:FA2019-301 APPLICANTS Tran Hutchinson RO X RO X Competencies SCENARIO SCENARIO 2 5 6 2 5 6 Interpret/Diagnose Events 45 13 23 45 13 23 and Conditions 67 45 57 67 45 57 67 8 67 8 Comply with and 14 12 13 14 12 13 Use Procedures (1) 56 45 57 56 45 57 7 67 8 7 67 8 Operate Control 14 12 13 14 12 13 Boards (2) 56 45 57 56 45 57 7 67 8 7 67 8 Communicate 12 12 12 12 12 12 and Interact 45 34 35 45 34 35 67 56 78 67 56 78 7 7 Demonstrate Supervisory Ability (3)

Comply with and Use TS (3)

Notes:

(1) Includes TS compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant. (This includes all rating factors for each competency.) (Forms ES 303 1 and ES 303 3 describe the competency rating factors.)

ES-401 Record of Rejected K/As Form ES-401-4 Tier / Randomly Reason for Rejection Group Selected K/A RO T2/G1 006K6.11 K/A IR < 2.5 replaced with 064K6.07 RO T2/G1 059K1.02 Replaced for balance of exam with 004K1.15 RO T2/G1 059K3.02 Replaced for balance of exam with 003K3.02 RO T2/G2 075K3.07 Item not applicable at Farley replaced with 015K3.06 RO T2/G2 071A2.08 Item not applicable at Farley replaced with 071A2.09 RO T2/G2 086K4.07 Item not applicable at Farley replaced with 086K4.03 RO T1/G1 008AG2.4.41 Item can only be tested at SRO level replaced with 008AG2.4.47 RO T1/G1 015AA1.08 Replaced for balance of exam with 015AA1.21 SRO T1G1 026AA2.05 Item not applicable at Farley replaced with 026AA2.03 SRO T1/G1 056AA2.77 Replaced for balance of exam with 056AA2.14 SRO T1/G2 W/E08EG2.4.18 Could not write discriminatory question at the SRO level SRO T1/G2 074EA2.07 Could not write discriminatory question at the SRO level

2019 Farley Initial Licensed Operator Exam (2019-301)

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only All K/A 001K2.01 1 F 2 X Y N M S/E Q=K/A, Q=RO

1. Very minor typographical fix: distractor D (correct answer) needs to be Centers, the same as all other choices.

W/above tweak, Q appears S at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/22/19.

K/A 003K3.02 2 H 2 X Y N N S Q=K/A, Q=RO

1. Based on difficult previous experience with this type of initial trends following transient Q (where on appeal the simulator parameters actually trended in a different fashion than everyone thought it would during Q development), please provide simulator trace to validate/ensure technical accuracy of correct answer and distractors.

From psychometric aspects, Q appears S at this time.

Facility licensee verified correct answer based on simulator data. No additional changes needed. Q ready to be administered on exam. MKM 05/22/19.

K/A 003K4.03 3 F 2 X Y N B E Q=K/A, Q=RO

1. Recommend adding Associated RCP at beginning of distractors A, B, and C for parallelism/clarity.

Q evaluated as E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/22/19.

Page 1 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 004A4.13 4 H 3 X Y N M E Q=K/A, Q=RO

1. Think we need to add some form of no operator actions statement to WOOTF for clarity. Also ensure 1st part Q is stated as compared to given conditions. Finally, splitting Q statement into two sentences may read better

(?). For example:

With no operator actions taken, which one of the following completes the statement below?

Initially, VCT pressure will ___(1)___ as compared with the given conditions.

The VCT level change ___(2)___ result in an automatic rollover of charging pump suctions to the RWST.

Q evaluated as E at this time.

Licensee training staff assured NRC that the use of based on given conditions was not needed due to applicant training to always use given information to analyze the various questions. Facility licensee made other changes as requested by NRC. Q ready to be administered on exam. MKM 05/22/19.

K/A 004K1.15 5 F 1 X X Y N B U Q=K/A, Q=RO

1. Stem focus: Q stem is not specific enough to provide applicants with complete picture of where in the process the plant conditions are; for example, what is RWST level? should the operators be shifting to recirc at this time?

what is the ECCS alignment (RHR providing suction to charging?) etc.

2. LOD=1/multiple non-plausible (NP) distractors: it is common knowledge that RWST is the source of water during a Safety Injection actuation; previous Q even alluded to the fact that there is an auto swap-over of charging pump suctions to RWST. Based on the logical construction of the 2nd part distractors, it is a logical true that the charging pumps are injecting, so the only evaluation that is needed is the following: will RHR pumps be injecting with RCS pressure of 1500 psig, or not? All procedural steps will be checking for RHR flow rates at much lower pressures - e.g., E-0 and E-1 setpoints at Farley 275 psig (non adverse).

Q is evaluated as U due to LOD=1 and multiple NP distractors.

Facility licensee made extensive changes to this Q as a result of NRC feedback, including changing RCS pressure value to 450 psig and completely changing/re-writing the first part Q statement. Modified Q now ready to be administered on exam. MKM 05/22/19.

Page 2 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 005A2.04 6 H 2 X Y N B E Q=K/A, Q=RO

1. Recommend adding some sort of with no operator actions statement to first part Q.

2. Unsure about technical accuracy of 2nd part answer choices: procedure AOP-12.0 step 3.1 RNO only requires operators to reduce RHR flow rate to eliminate cavitation, is that the same as fully closing the discharge valve?

Recommend that the Q statement add word throttle to Q statement, as in: is crew required to throttle closed or throttle open -603A?

Q evaluated as E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/22/19.

K/A 005AA1.01 7 F 2 X Y N N E Q=K/A, Q=RO

1. Distractors C(1) and D(1) are weakly plausible as submitted/with given conditions. Recommend adding statement Reactor Engineering has certified nuclear fuel has been preconditioned at power levels greater than 90% (step 8 from AOP) to initial block of conditions to improve plausibility of not lowering power from 90%. This statement may be potentially used in place of core is at MOL, these statements are meant to be essentially equivalent but fuel preconditioned is a stronger head fake for plausibility.

Q evaluated as E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/22/19.

Page 3 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 006A4.10 8 H 2 X X Y N N E Q=K/A, Q=RO

1. For clarity to applicants, for Containment-pressures-not-adverse-statements recommend using a construct peak pressure was or in this case, Peak Containment Pressure was 3.2 PSIG and slowly lowering or equivalent.

2. With RED or ORANGE path FRP on CORE COOLING and 0.0 gpm of any high head ECCS flow, why would anyone think that crew was not required to start all available charging pumps? C(2), D(2) distractors are very weakly plausible as submitted. Unsure what to do with 2nd part Q without straying into minutia territory for RO procedure knowledgecan we test something related to overall mitigating strategy/major action categories here?

Q evaluated as E at this time.

Facility licensee made extensive changes as requested by NRC, including development of new 1st and 2nd part Qs. New Q ready to be administered on exam. MKM 05/22/19.

Page 4 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 006K6.01 9 F 3 X Y Y? B E?

Q=K/A.

1. Q as submitted may or may not have major issues based on the following discussion:

(i) It could be argued that the Q is requiring RO applicants to make an operability determination, which is normally an SRO-only function, therefore the Q could be argued as license-level mismatch and therefore not suitable/appropriate for testing on the RO level.

(ii) Is there a training objective specific to the RO position that requires knowledge of surveillance requirements related to TS/TRM CONDITIONS that are greater than 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />? (Potential argument that Q is testing minutia that is not required knowledge at memory-level). In other words, LCO completion times for this Q are either 7 days or 8 hours9.259259e-5 days <br />0.00222 hours <br />1.322751e-5 weeks <br />3.044e-6 months <br />, which would provide adequate time in any case for verification of specifications using references (i.e. no need for short-timeframe knowledge space)

2. Lets discuss this Q in more detailif there is a clear learning objective/expectation at Farley that ROs are required to know the operability parameters to this level of detail, the Q may be o.k.; otherwise we may need to move in another direction entirely.

Q appears E at this time under assumption that this Q is testing required knowledge for ROs at Farley.

Training staff from licensee insisted that this Q was required knowledge of ROs at Farley due to the 1-hr TS requirement on RWST levelso CE agreed that Q is at RO level. Staff further assured NRC that Q type was known to applicants.

Based on these considerations, NRC accepts the Q concept as submitted.

Minor editorial changes made to all Qs with tables for consistent formatting on all tabular-data questions. Reference provided not needed for Qs with tables (different from embedded pictures in that they are simply presentations of textural information, not visual cueing.) Q ready to be administered on exam.

MKM 05/22/19.

Page 5 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 007A3.01 10 F 2 X X Y N M E Q=K/A, Q=RO

1. Technical accuracy of the 2nd part Q statement construct: how is applicant supposed to know what the maximum PRT pressure will be reachedwith no additional information provided, wouldnt the relief valve re-seat once blowdown pressure reached? Q intent/is really asking what the PRT rupture disc setpoint is, and in this case 150 psig is weakly plausible. Reviewer believes that initial source Q concept may work better here (when PRT ruptures, gage will be reading 100 or 115 psig?)

Q evaluated as E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/22/19.

K/A 007EK3.01 11 F 2 X X X Y N B U Q=K/A, Q=RO

1. It is common knowledge that E-0 immediate actions do not contain requirements for emergency boration (distractors A(1), C(1)). Recommend just re-write these for parallelism with other choice, in other words when directed by EEP-0

2. Second part Q choices are all technically correct: the boration will at the same time ensure shutdown margin (due to stuck rods) as well as counter the reactivity change due to RCS cooldown.

Q evaluated as U due to multiple correct answers.

Facility licensee made changes as requested by NRC, including a complete re-write of 2nd part Q statement to resolve the multiple correct answer issue. Q ready to be administered on exam. MKM 05/22/19.

2 K/A 008G2.4.47 12 H Y Y N U Q=K/A, Q=SRO-only

1. License level mismatch: analysis of conditions and evaluation of procedural transitions within EOP network (i.e. after entry conditions) is an SRO-only function. Therefore, second part Q is testing knowledge that is inappropriate for the RO exam.

Q as submitted is U due to license-level mismatch.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/22/19.

Page 6 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 008K1.02 13 H 3 Y N M S Q=K/A, Q=RO level.

1. WOOTF is NOT construct Qs are allowed when used sparingly on the written exam. (ref. NUREG-1021 Appendix B p. B-10)

Q appears S at this time.

Facility licensee made minor change based on validator comment: Q statement modified to ask WOOTF lost CCW cooling. Q ready to be administered on exam. MKM 05/22/19.

K/A 009EK1.02 14 H 2 X Y N N E Q=K/A, Q=RO level

1. Provided learning objective references procedure ES-1.1, which is not related to submitted Q.

2. Recommend containment pressure peaked at 3.5 psig and slowly lowering.

3. Can bold/underline earliest word in Q statement for editorial enhancement/readability if desired.

Q appears E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/22/19.

K/A 010A2.01 15 H 3 Y N B S Q=K/A, Q=RO level.

Q appears S at this time.

No changes needed to draft Q. Q ready to be administered on exam. MKM 05/22/19.

011EA1.17 16 H 2 Y N N S Q=K/A, Q=RO

1. Q appears S at this time.

Facility licensee made changes to second part Q per validation, now asking between CONTAINMENT and SUBCRITICALITY. These changes alleviated previously unrecognized overlap with SRO Q73. Modified Q ready to be administered on exam. MKM 05/22/19.

Page 7 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 011K6.05 17 H 3 X Y N N E Q=K/A, Q=RO

1. Reviewer is worried about the operational validitiy/potential minutia aspect of the 2nd part Q. Is it really necessary to know from memory the impact (or lack thereof) of an internal failure of a transmitter on the Pzr level indication on the Hot Shutdown Panel? Agree that it is systems knowledge, so that makes it RO not SRO-only. In other words, wouldnt such a failure be self-revealing upon inspection (indication failed upscale or downscale)? Recommend we look at another aspect of HSP Lpzr - would it be more operationally valid to test whether or not the HSP Lpzr is hot cal or cold cal instrument? If were sure that submitted Q is testing required knowledge of ROs covered by a training objective, it may be o.k., but lets discuss.

Q as submitted evaluated as E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/22/19.

012K5.02 18 F 2 Y N B S Q=K/A, Q=RO

1. Q appears S at this time.

No changes needed to draft submitted Q. Q ready to be administered on exam.

MKM 05/22/19.

013G2.1.19 19 H 2 X X Y N M E Q=K/A, Q=RO

1. Need to ensure it is clear to applicants that first part Q is asking whether or not an SI signal is/is NOT required, and that second part Q is asking whether or not SI actions have/have NOT occurred. Unsure if the current language is adequate clarity or if we can/should revise.

2. Its a relatively big cue that the only parameter that needs to be evaluated for second part Q is the FE-122 parameter and value. What were validation comments on this Q? Operators in the control room would have other computer screen indications available, is this second part Q an appropriate way to test this K/A, or should we look at an alternate way?

Q as submitted evaluated as E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/22/19.

Page 8 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 015AA1.21 20 H 2 X Y N N E Q=K/A, Q=RO

1. Need to move title of ESP-0.1 to second bullet, from Q statement.

2. For technical accuracy on 1st part Q, believe we need to add additional parameters to ensure a full evaluation of natural circulation is possible per ESP-0.1: for example, RNO step 16.3.5 required Tcolds at Tsat for SG pressure.

3. Learning objective provided with this Q references AOP-4.0 and does not seem to match ESP-0.1.

Q as submitted evaluated as E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/22/19.

015K3.06 21 H 3 X X Y N B E Q=K/A, Q=RO

1. In Q statement, language Assuming no operator action or reactor trip occurs, is a big cue that helps make distractor D non-plausible. Specifically, when evaluated a choice of rods do nothing against three other choices where rods do something is logically weak, especially given the warning in the Q statement that under some other circumstances this failure might even cause a Rx trip. Recommend something like rods step out until they stop moving at maximum rod height (and do NOT step back in) for this distractor?

Q as submitted evaluated as E at this time due to one non-plausible distractor.

Facility licensee demonstrated that rods not moving was plausible due to potential for it to be a correct answer if rods were above the auto rod motion position In other words, there is a high rod position rod stop interlock at Farley.

CE agreed with licensee argument and will grant plausibility of distractor D as submitted. Q ready to be administered on exam. MKM 05/22/19.

017A1.01 22 H 2 Y N M S Q=K/A, Q=RO

1. Q appears S at this time.

No additional changes were made to this Q. Q ready to be administered on exam. MKM 05/22/19.

Page 9 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 022A3.01 23 H 2 X Y N M E Q=K/A, Q=RO

1. Based on distractor analysis and provided lesson material, the electrical alignment is a determining factor in correctly evaluating the conditions and arriving at the appropriate answer. Recommend we provide a specific set of electrical power conditions to stem conditions for technical accuracy.

2. Consider if adding with no operator actions to Q statement would be an enhancement.

Q evaluated as E at this time.

Facility licensee stated that the lack of additional information concerning the electrical alignment was adequate to ensure that an applicant would understand the correct system response (Appendix E brief to avoid making unstated assumptions). Additional editorial change made to eliminate a subset issue. Q is ready for administration. MKM 05/22/19 022AK3.05 24 H 2 Y N N S Q=K/A, Q=RO

1. One of the free or pre-submitted Qs.

2. There is some small overlap between this Q and Q4 on automatic swapover to RWST for charging pump suction. I think were fine, but please evaluate and check w/validators to be sure.

Q appears S at this time.

Facility licensee and NRC discussed overlap between this Q and Q4, both sides agreed that the questions were testing different concepts and no excessive overlap was present. Q is ready to be administered on the exam. MKM 05/22/19.

022G2.4.8 25 F 2 Y N N S Q=K/A, Q=RO

1. One of the free or pre-submitted Qs.

2. Upon initial inspection, may believe that Q is SRO-only due to evaluation of conditions and procedure assessment; however, Q is actually RO-level due to the procedure selection aspect contained in immediate actions of E-0.

Q appears S at this time.

No additional changes were made to this Q. Q ready to be administered on exam. MKM 05/22/19.

Page 10 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 025AA2.01 26 H 2 Y N N S Q=K/A, Q=RO

1. One of the free or pre-submitted Qs.

Q appears S at this time.

No additional changes made to this Q. Q ready to be administered on exam.

MKM 05/22/19.

026AA2.02 27 H 3 Y N M S Q=K/A, Q=RO

1. Q appears S at this time.

No additional changes made to this Q. Q ready to be administered on exam.

MKM 05/22/19.

026K2.02 28 F 2 Y N N S Q=K/A, Q=RO

1. Q appears S at this time.

No additional changes made to this Q. Q ready to be administered on exam.

MKM 05/22/19.

027AK1.02 29 H 3 Y N B S Q=K/A, Q=RO

1. Q appears S at this time.

Facility licensee bolded word DEMAND in second part Q. No other changes needed. Q ready to be administered on exam. MKM 05/22/19.

Page 11 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 028AK3.03 30 H 3 X X Y N B E Q=K/A, Q=RO

1. Distractor B is non-plausible: there is no cause/effect relationship between a PZR level transmitter failure and the PORV opening; also, distractor B is the only distractor that does not continue with a which statement explaining the integrated plant response.

2. Big cue given in Q stem pointed at correct answer D with the procedure title of ESP-0.4. Could we simply change the procedure were in to ESP-0.2 and still have a technically accurate/operationally valid Q? If ESP-0.2 does not work, maybe put applicants in ESP-0.0, and add conditions that ensures natural circulation has been occurring for some time (just dont want procedural title to be the cue to the correct answer independent of assessment of other conditions).

3. Q appears to have been modified somewhat w/distractors as compared to BANK Q from Turkey Point.

Q as submitted evaluated as E at this time due to one non-plausible distractor.

Facility licensee made changes as requested by NRC. Distractor A re-written due to differences between Turkey Point (low head Westinghouse) and Farley (high head W plant) which affected the plausibility/technical accuracy of this distractor. With these changes, Q ready to be administered on exam. MKM 05/22/19.

Page 12 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 028K5.04 31 H 3 X Y Y? B E Q=K/A, Q=SRO?

1. Concerned that this Q is going beyond RO-level procedural knowledge on first part Q, which is very close to SRO-only on assessing plant conditions and then selecting appropriate procedures to handle the abnormal or emergency conditions provided. For example, the referenced procedure step in E-1 (RNO 6.5) directs the operators to Attachment 3 for Post-LOCA H2 Recombiner Operation. On the other hand, one can also argue that the first part Q is relying on knowledge of the CAUTION statement before step 6.4, and CAUTION statements are RO-level knowledge; agree with this as well. I would prefer we test the CAUTION statement more directly to ensure we are solidly on RO-level ground.

2. For clarity, I would also tweak the 2nd part Q statement to ensure it says something like independent of containment pressurization and vent system operation Recommend deleting all bulleted conditions as unnecessary, then use the following as the entire proposed Q:

Which one of the following completes the statements below?

A CAUTION in EEP-1, Loss of Reactor or Secondary Coolant, states that fire or explosion may occur if post LOCA hydrogen recombiners are placed in service when containment hydrogen concentration is greater than [3.0%/4.0%].

A single post LOCA hydrogen recombiner (independent of the Containment Pressurization and Vent system) [does/does NOT] have the capacity to prevent Containment hydrogen concentration from exceeding the lower flammability limit.

Q as submitted evaluated as E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/22/19.

K/A 029A4.04 32 H 2 Y N N S Q=K/A, Q=RO

1. Q appears S at this time.

No additional changes needed for this Q. Q ready to be administered on exam.

MKM 05/22/19.

Page 13 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 029EK2.06 33 H 3 Y N B S Q=K/A, Q=RO

1. Q was on last two previous NRC exams (ES-401-6 item).

Q appears S at this time.

No additional changes needed for this Q. Q ready to be administered on exam.

MKM 05/22/19.

K/A 032G2.4.50 34 H 2 Y N N E Q=K/A, Q=RO-level

1. Q was one of initial free pre-submitted Qs.

2. Recommend bolding and/or underlining the word earliest for emphasis.

3. Need to add REFERENCE PROVIDED due to the pictures and new program office policy for counting references.

Q evaluated as E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/22/19.

K/A 033AK1.01 35 H 3 X Y N M E Q=K/A, Q=RO

1. Due to the inter-relationships between first and second part Q, recommend that the second part Q ask whether or not a re-energization signal to automatically energize the SRNIs when N-36 reaches the applicable setpoint value. In this fashion, the question of whether or not the SRNIs are already energized is not part of the required evaluation.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/22/19.

K/A 038EA2.13 36 H 3 Y N N S Q=K/A, Q=RO

1. Q appears S at this time.

No additional changes needed for this Q. Q ready to be administered on exam.

MKM 05/22/19.

Page 14 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 039K3.06 37 H 2 Y N M S Q=K/A, Q=RO

1. Q appears S at this time.

No additional changes needed for this Q. Q ready to be administered on exam.

MKM 05/22/19.

K /A 040AK2.02 38 F 2 X N N N U Q does not meet K/A, Q=RO

1. K/A match on this Q is suspect; applicant can arrive at correct answer via procedure knowledge of E-0 foldout criteria and basic location knowledge of MS safety valvestherefore no knowledge of sensors and detectors is exercised.

2. It is common knowledge based on plant component locations (non-licensed operator level of training) that main steam safety valves are located outside of containmenttherefore why would anyone think that adverse containment criteria would be needed for this steam line rupture condition? Distractors A(2),

C(2) are not plausible.

Q evaluated as U at this time due to K/A match issue and multiple non plausible distractors.

Facility licensee agreed with NRC comments on the draft submitted Q, and proposed entirely new Q to meet same K/A. New Q was evaluated as S by CE.

New Q is ready to be administered on exam. MKM 05/23/19.

K/A 041K1.02 39 H 3 Y N B S Q=K/A, Q=RO

1. Q appears S at this time.

No additional changes made to the Q. Q ready to be administered on exam.

MKM 05/23/19.

Page 15 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 054AK1.02 40 F 3 X Y N N E Q=K/A, Q=RO

1. Editorial enhancement, we can bold and/or underline wide range in Q stem for clarity if desired.

2. Submitted Q is close to SRO-only based on assessment of plant conditions and decision over maximum flow rate to hot/dry S/G during bleed and feed in FR-H.1. (similar to comment for Q31 above). Lots of things to evaluate here; it could be argued that feed flow rate limit setpoint here is beyond major mitigating strategy for ROs. Alternate argument is that required information is contained in the NOTE statement, which is generally RO level knowledge. As a potential fix, recommend asking specifically whether or not there is a limit on the feed flow rate, for parallelism with language in the NOTE and to ensure we are safely in RO-level space.

Q appears E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/23/19.

K/A 056AA1.10 41 H 2 X X Y N B E Q=K/A, Q=RO

1. Minor typo: believe there should be word step in last bullet.

2. In order for applicant to completely evaluate conditions, recommend we add information that SI sequencers are complete before the LOSP occurs, also add a bullet to specify that SI was NOT reset.

3. 1A MDAFWP running (distractor B) is non plausible due to the 1-2A DG failure to start --- another cue to this is that 1A MDAFWP only appears in one distractor (logical imbalance). Potential fix for B is to add an if any clause to the Q statement, then have B read no AFWP running or similar.

Q appears E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/23/19.

Page 16 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 058AK3.01 42 F 2 X Y N B E Q=K/A, Q=RO

1. Partial: could it be argued that B is technically correct because the 2C D/G does have an air start solenoid? Concern is over the specificity of the term Emergency air start solenoid vs. regular air start solenoid? In other words, is it clear enough that by specifying emergency air start solenoid it is meant manual override on the air start solenoid allowing an emergency start like the 2B does (from distractor analysis). Would it be better to tighten up the 2nd part Q statement somewhat by something like the component that allows the Diesel Generator above to supply power to Unit 2 B ESF busses under these conditions is its ___ (?) Or, were things clear enough to validators? We can discuss.

Q appears E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/23/19.

K/A 060AA1.01 43 F 3 Y N B S Q=K/A, Q=RO

1. Minor typo: WOOTF completes the statements below?

Q appears S at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/23/19.

K/A 061AK3.02 44 F 2 Y N M S Q=K/A, Q=RO

1. Does R-1A appear in TRM or any other specification document? If so, would anyone confuse Technical Specifications as meaning any specification? Final check: is R-1A part of the Control Room Envelope program (TS 5.5.18)?

Q appears S at this time w/allowance for above fact-checks.

Facility licensee verified to NRC that Q is specifically aimed at Technical Specifications, and that R-1A is not part of LCO 5.5.18. Q ready to be administered on exam. MKM 05/23/19.

Page 17 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 061K5.01 45 H 2 X Y N B E Q=K/A, Q=RO

1. Distractor B appears non plausible when compared to conditions in stem and other possible choices. Discussion: Operator actions in distractors A, C, and D will result in relatively rapid plant effects; however, beginning an emergency boration does not have the same short-term effect (from timing aspect) as the other choices. Also, given conditions in the Q stem do not support a need for emergency boration as a first concern. Relatively easy fix, recommend adding two+ rods stuck full out when the Rx tripped, should increase plausibility for distractor B.

Q as submitted appears E at this time due to one non-plausible distractor.

Facility licensee made changes as requested by NRC, including development of new distractor B of restore pressurizer level. Q ready to be administered on exam. MKM 05/23/19.

K/A 061K6.02 46 H 2 X Y N M E Q=K/A, Q=RO

1. Distractor A non plausible. When evaluating this potential answer, because both SGFPs are shown as running, the applicants only reason for thinking that a MDAFWP auto start would be required is the S/G levels.

However, the S/G levels at time 1000 are too normal for concern. S/G levels at time 1000 (and subsequent times) need to be set lower for distractor A to work.

Q as submitted E at this time due to one non-plausible distractor.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/23/19.

K/A 062A4.07 47 F 2 Y N M S Q=K/A, Q=RO

1. Q appears S at this time.

No additional changes needed for this Q. Q ready to be administered on exam.

MKM 05/23/19.

Page 18 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 063K4.04 48 H 2 Y N M S Q=K/A, Q=RO

1. Q appears S at this time.

No additional changes made to this Q from draft submittal. Q ready to be administered on exam. MKM 05/23/19.

K/A 064K2.02 49 F 2 Y N B S Q=K/A, Q=RO

1. Q appears S at this time.

No additional changes needed for this Q. Q ready to be administered on exam.

MKM 05/23/19.

K/A 064K6.07 50 H 2 X Y N M E Q=K/A, Q=RO

1. Plausibility of 1C DG not starting at all is weak; single-failure design criteria ensures that a single failure of the A air receiver will not prevent the B air receiver from doing its job; furthermore, 250 psig is approximately normal pressure for the receiver. Recommend increasing the plausibility of second part Q distractors by adding automatically to the Q statement.

Q is evaluated as E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/23/19.

Page 19 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 067AA2.15 51 F 3 X X X Y N N U Q=K/A, Q weakly on RO level, see below discussion.

1. Minutia: first part Q apparently minutia without reference. Thought process:

applicant is required to know/recognize from memory whether or not a given plant area (Circulating Water Pumps, in this case) is in the Farley list of designated welding area. Is there a specific training objective that requires knowledge of these areas closed book?

2. Distractors A(2) and C(2) are not plausible. First, there is a cue in the second part Q statement (when welding is complete) that relates to the first part Q; moreover, the use of the phrase unless otherwise noted does not work with the choice of may immediately secure, but it does logically work with the requirement of 30 minutes inspection, unless otherwise relaxed (presumably by special authorization).

3. Unsure about the license level here; we are testing administrative requirements that seem to fit better with SRO responsibilities for overall operations department oversight of hot work and fire watch responsibilities. Are there requirements specific to the RO position in the NMP-ES-035-003 procedure? The problem is, it is hard to write this Q as reference provided (e.g.

give the applicants the entire procedure) without making it direct look-up. So, given that, are there requirements in the procedure that are operationally valid to test for ROs? After review of the full procedure, a few thoughts that may not be any better:

-can one fire watch monitor more than one hot work site, given line of sight, etc..?

-fire watches are/are not allowed to use permanently installed portable fire extinguishers as primary means of fire suppression?

-fire watches are/are not allowed to take dry chemical fire extinguishers into Containment?

-fire watches are required to notify Operations before [covering a ventilation opening with a fire blanket/shielding cable trays underneath the work are with non-combustible material]

Alternately, if we dont think we can find operationally valid non-minutia for ROs with this K/A, we may need to change out this K/A for another.

Q as submitted evaluated as U at this time due to more than one non-plausible distractor.

Based on NRC comments, facility licensee developed new Q using some of the NRC recommendations above. New Q evaluated as S at this time and ready for administration on the written exam. MKM 05/23/19 Page 20 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 071A2.09 52 H 4 Y N M S Q=K/A, Q=RO

1. Train the Chief Examiner time: what is ARDA? Ensure this acronym is obvious to the applicant without providing its full nomenclature.

Q appears S at this time, given above consideration.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/23/19.

K/A 072A3.01 53 F 3 X Y N M E Q=K/A, Q=RO level

1. Q as submitted appears psychometrically correct; however, there is an overlap concern with SRO Q96. Could an applicant make an argument that there is double jeopardy with the associations between these two Qs? Lets evaluate and discuss; may need to adjust one of these Qs to resolve.

Q as submitted evaluated as E at this time due to overlap concern discussed above.

After discussion with facility licensee training staff, NRC and facility licensee agree that overlap concern is not an issue and that the two questions require different knowledge to answer correctly. No additional changes needed to draft submittal Q. Q ready to be administered on exam. MKM 05/23/19.

K/A 073A1.01 54 F 3 X Y N N E Q=K/A, Q=RO

1. Readability and clarity: recommend moving final bulleted information into the first part Q statement, maybe something like this: After the operator takes the R-18 OPERATION SELECTOR handswitch to the CHECK SOURCE position, the R-18 meter indication ___(1)___ rise.

2. Typographical: need to add a comma after word release in 2nd part Q statement, please provide nomenclature for valve RCV-18.

Q as submitted evaluated as E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/23/19.

Page 21 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 073K3.01 55 H 3 Y N M S Q=K/A, Q=RO

1. Q appears S at this time.

No additional changes needed for this Q. Q ready to be administered on exam.

MKM 05/23/19.

K/A 076A1.02 56 H 4 Y N M S Q=K/A, Q=RO

1. Q appears S at this time.

No additional changes needed for this Q. Q ready to be administered on exam.

MKM 05/23/19.

Page 22 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 076G2.1.23 57 H 2 X Y N M U Q=K/A, Q=RO

1. Distractors C(1), D(1) are not plausible. Given conditions are at full power, GFFD is reading really really high, and chemistry has confirmed that its failed fuelwhy would anyone choose an open-ended statement that power reduction would not be required?

Potential fix/recommendation:

Initial conditions on Unit 1:

-Unit is at 50% power

-FG5 in alarm (same as second bullet)

-R-50 indicates (same as third bullet)

Current conditions:

-Chemistry reports that RCS samples have confirmed that the RCS activity is due to failed fuel.

WOOTF.

Based on the initial conditions (before RCS sample results), a power reduction

[is/is NOT] required.

Based on the current conditions (after RCS sample results), the operators

[are/are NOT] required to place the standby mixed bed demineralizer on service.

Q as submitted is U due to multiple non plausible distractors.

Facility licensee made changes as requested by NRC in accordance with the above recommended fix. Q ready to be administered on exam. MKM 05/23/19.

K/A 076K1.09 58 F 2 Y N N S Q=K/A, Q=RO

1. Q appears S at this time.

No additional changes need to be made to this Q. Q ready to be administered on exam. MKM 05/23/19.

Page 23 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 078A3.01 59 F 2 Y N N S Q=K/A, Q=RO

1. Q appears S at this time.

No additional changes need to be made to this Q. Q ready to be administered on exam. MKM 05/23/19.

K/A 086K4.03 60 F 2 X X Y N N E Q=K/A, Q=RO

1. Provided distractor analysis writeup does not support plausibility of C(1),

D(1) distractorswe dont know why would someone think MH4 would not alarm.

2. No technical reference was provided for Siemens Firefinder XLS system.

The MH4 page from the alarm response implies that the Siemens Firefinder XLS is the system that generates the MH4 alarmif so, we need a different approach to this Q.

Q initially rated as E at this time - need more technical information to better evaluate.

Facility licensee provided additional technical information, including during prep week, to validate the technical accuracy of the draft submittal Q. Q ready to be administered on exam. MKM 05/23/19.

K/A 103A1.01 61 H 3 Y N B S Q=K/A, Q=RO

1. Q appears S at this time.

No additional changes were needed for this Q. Q ready to be administered on exam. MKM 05/23/19.

K/A G2.1.19 62 F 2 X Y N N E Q=K/A, Q=RO

1. Please add REFERENCE PROVIDED, included photo counts as reference per program office interpretation.

Q is E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/23/19.

Page 24 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A G 2.1.40 63 F 2 X X Y Y? N U Q=K/A, Q=RO

1. Plausibility of not conducting IPTE brief before Rx head removal, and plausibility of not establishing FME exclusion are after Rx head is off is weak.

2. However, bigger issue is link to RO job requirements/SRO only. The administrative responsibility to ensure IPTE is conducted and FME established is likely more of an SRO function than an RO function. Unsure that we would be on solid ground requiring closed book retention of IPTE and FME requirements of ROs due to these concerns.

3. Recommendation: can we attack this Q with things the RO would be directly responsible for? For example, continuous monitoring of SRNIs is required when.; continuous communication between ROs and refueling bridge is required when; or maybe ask something related to control room RO staffing requirements during refueling.

Q evaluated as U at this time due to license-level mismatch.

Facility licensee agreed with NRC comments and proposed entirely new Q that is focused on RO-level requirements during refueling. New Q evaluated as S at this time and ready to be administered on exam. MKM 05/23/19.

Page 25 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A G 2.2.1 64 F 2 N Y B E K/A match is weak; Q=SRO-only. See below discussion

1. K/A match: Technically, the answers to this Q all relate to when a Reactivity SRO is secured/suspended, which happens at power, therefore the ability to perform pre-startup procedures is not demonstrated. Benefit-of-doubt given here because I evidently authorized something like this in a verbal communication.

2. Q is also technically SRO-only on level of authorization to secure Reactivity Management SROthis is a classic SRO-only Q topic and not an RO job function.

A few ideas that might (?) help, trying to push us back into solid RO level space:

-per procedure , MODE 2 entry is declared when .

-per procedure , if unexpected Rx power doubling occurs while pulling shutdown rod banks, RO is required to .

-per NMP-OS-001, Reactivity Management SRO is required to be stationed before .

-per NMP-OS-001, Reactivity Management SRO can be secured with the permission of the Shift Manager, once the Reactor is stable in MODE 1 with

[one/both] main feed pumps in service.

Q evaluated as E at this time with benefit-of-doubt given based on possible miscommunication from CE to facility.

Facility licensee made changes as requested by NRC, and developed entirely new Q focusing on requirements during Rx S/U evolution. New Q evaluated as S at this time, and Q ready to be administered on exam. MKM 05/23/19.

K/A G2.2.36 65 H 4 Y N M S Q=K/A, Q=RO

1. It would be o.k. to provide a reference similar to the switchyard schematic, or authorized equivalent plant P/ID for this Q, if desired.

Q as submitted appears S at this time.

Facility licensee made changes as requested by NRC, schematic will be provided to applicants as reference for this Q. Q ready to be administered on exam. MKM 05/23/19.

Page 26 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A G 2.2.38 66 F 2 Y N M S Q=K/A, Q=RO

1. Q appears S at this time.

No additional changes required for this Q. Q ready to be administered on exam. MKM 05/23/19.

K/A G 2.3.12 67 F 3 X Y N M E Q=K/A, Q=RO

1. For clarity, recommend adding non emergency to the second bullet conditions as follows: (LHRA) to perform non-emergency outage work.

Q appears E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/23/19.

K/A G 2.3.13 68 F 2 Y N B S Q=K/A, Q=RO

1. Q appears S at this time.

No additional changes needed for this Q. Q ready to be administered on exam.

MKM 05/23/19.

K/A G 2.3.4 69 F 2 X Y N B E Q=K/A, Q=RO

1. Distractor D is non plausible; it is common knowledge that administrative limits are less than (higher) federal limits in the CFR.

Q evaluated as E at this time due to one non-plausible distractor.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/23/19.

K/A G 2.4.37 70 F 2 Y N B S Q=K/A, Q=RO

1. Q appears S at this time.

No additional changes needed for this Q. Q ready to be administered on exam.

MKM 05/23/19.

Page 27 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A G 2.4.9 71 H 4 Y N B S Q=K/A, Q=RO

1. Q appears S at this time.

No further changes made to this Q from the draft submittal. Q ready to be administered on exam. MKM 05/23/19.

K/A W/E04EG2.1.28 72 F 2 Y N N S Q=K/A, Q=RO

1. Q appears S at this time.

No additional changes needed for this Q. Q ready to be administered on exam.

MKM 05/23/19.

K/A W/E05EG2.4.1 73 F 2 X Y N N U Q=K/A, Q=RO

1. Distractors C(1) and D(1) are non plausible; given that the Q statement specified that no emergency bus has electrical power, it is not plausible that operators would continue performing immediate operator actions of E-0 beyond verify power to ESF to check SI status. Further problem is that first part Q specifies that operating crew must take the following Immediate Actions; however, if an operating team were to begin E-0 immediate actions, attempt to restore electrical power, and then transition to ECA-0.0, this would be acceptable performance and this option is not presented.

2. Distractors A(2) and C(2) are non plausible: there is never any case when FR-H.1 is performed immediately after immediate operator actions are performed, neither in E-0 nor in ECA-0.0. For example, there are directed transitions to FR-H.1 in subsequent steps of E-0, or in general CSFSTs are monitored as directed by procedure or on procedural transition out of E-0; however, there is no case where FR-H.1 would ever be performed immediately after immediate operator actions.

Q as submitted evaluated as U due to multiple non-plausible distractors.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/23/19.

Page 28 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A W/E10EK2.1 74 H 2 X Y N B E Q=K/A, Q=RO

1. Plausibility of SI required in 2nd part Q is weak based on given conditions, recommend tweaking subcooling and Lpzr values to make closer to foldout page.

Q evaluated as E at this time.

Facility licensee made changes as requested by NRCparameters are now listed as lowering i.e. getting worse instead of stable or rising (getting better).

Q ready to be administered on exam. MKM 05/23/19.

Page 29 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A W/E11EK2.2 75 H 2 X X Y N M U Q=K/A, Q=RO

1. Distractors A(1), C(1) are non plausible: from systems knowledge, applicants know that containment spray flow rates are not throttled; how would it be possible to maximize the rate of CS flow when by implication both pumps are running because there is nothing in the stem to imply otherwise? Classic way to ask Q on ECA-1.1 is to provide CS table from step 10, given parameters somewhere in middle-of-range, and ask how many spray pumps must be secured.

2. Unsure about job-link with the second part Q; with a LBLOCA underway, de-pressurization of S/Gs is a step that is meaningless because the primary and secondary systems are no longer coupled. Believe that we can test a more operationally valid procedural requirement here, but willing to discuss.

Q as submitted evaluated as U due to multiple non plausible distractors.

Facility licensee made changes as requested by NRC: first part Q now uses table in ECA-1.1 with spray pump combination per NRC recommendation, also per NRC recommendation (not listed above), second part Q is newly developed and tests whether or not containment spray system is allowed to be placed in recirculation mode per the ECA-1.1 procedure. New Q evaluated as S at this time, Q is ready to be administered on exam. MKM 05/23/19.

SRO-Only Exam Questions Page 30 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 001A2.17 76 H 3 X Y Y M E Q=K/A, Q=SRO-only.

1. Plausibility of 2nd part Q distractors are weakened when comparing dropped vs misaligned condition, especially given that misaligned is the correct procedure section (in other words, if dropped rod procedure was the correct answer, the misaligned rod procedure distractor would be strongly plausible).

Recommend changing the 2nd part Q to asking whether one of the provided procedure sections is/is NOT the correct procedure for the given conditions.

For example:

Based on the given conditions, AOP-19.0, Malfunction of Rod Control, Section 1.2 Misaligned Rods in MODE 1, ___[is/is NOT]___ the correct procedure section to mitigate the conditions above.

Q appears E at this time.

Facility licensee made changes as requested by NRC, misaligned rod is now more steps out such that correct answer is dropped rods section of AOP, this makes misaligned rods section of AOP plausible. Q ready to be administered on exam. MKM 05/23/19.

K/A 005G2.1.32 77 H 2 X Y Y M E Q=K/A, Q=SRO-only

1. Need to add Which one of the following. statement.

2. Recommend modifying the 2nd part Q statements for enhanced readability, also underlining or bolding the key words suction and discharge for emphasis. For example:

The reason for the RHR operability temperature limit is because the RHR pump ________(2)________ if an ECCS actuation were to occur.

(2) suction piping may be susceptible to flashing (2) discharge piping may be susceptible to thermal transients Q appears E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/23/19.

Page 31 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 007EG2.4.18 78 H 2 X X X Y N B U Q=K/A, Q does not meet SRO-only requirements.

1. Minor typo in Q statement: operatng

2. Distractors C(2), D(2) are non-plausible for the following reasons:

(i) based on the language of the distractor, it provides a cue that natural circulation is occurring (or should be established at some point based upon the conditions provided in the Q stem)

(ii) Q statement specifies that the intent of the procedure step is to check RCS temperature response, not to check natural circulation established. The higher-level procedure step language corresponds exactly with the correct choices (A(2), B(2))

3. Q is not SRO-only in that RO-level knowledge of integrated plant response can be used to elicit the correct answer. Note that the source Q was an RO question in 2008. EOP Basis information is not needed to obtain the correct answer of the second part Q due to the cueing in the stem.

Q evaluated as U at this time due to license-level mismatch and multiple non-plausible distractors.

Potential recommendation, maybe something like this could work:

Following an automatic Reactor Trip and Safety Injection, operators verified electrical buses were powered, and are working through the subsequent steps of E-0.

Which one of the following completes the below statement?

After the immediate operator actions, the first (earliest) possible transition out of E-0 is to _______ .

(1) E-1 due to stuck open PORV and PORV block valve (2) E-1 due to abnormal conditions inside Containment (3) E-2 due to uncontrolled depressurization of steam generator(s)

(4) E-3 due to abnormal secondary radiation readings or steam generator level rising in uncontrolled manner.

[match language after due to to exactly parallel the Farley EOP statements]

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/24/19.

Page 32 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 008G2.4.50 79 H 2 X Y Y M S/E Q=K/A, Q=SRO-only

1. Very slight editorial recommendation: in first part Q statement change isolations to isolation(s) or isolation/s (whatever is your preference).

Q appears S at this time.

No additional changes need to be made to the Q. Q ready to be administered on exam. MKM 05/24/19.

K/A 009EG2.4.21 80 H 3 X Y Y M E Q=K/A, Q=SRO-only

1. Can remove first bullet large SBLOCA, does not provide any needed information.

2. Under 1030 time conditions, please add:

(i) cold leg recirculation still not available (ii) no other RED or ORANGE path indications

3. Change first part distractors for parallelism with ECP-1.1 procedure steps:

(1) Stop all safeguards pumps taking suction from the RWST (2) Establish one train of ECCS equipment Q appears E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/24/19.

Page 33 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 011EG2.4.41 81 H 2 X X Y Y N E Q=K/A, Q=SRO-only

1. Need to add statement such as do not use Emergency Director judgement as basis for classification

2. How could we get a RED path CORE COOLING so soon, then ORANGE path CORE COOLING 10 minutes later? Concerned with operational validity/physics and thermodynamic technical accuracy here. If we kept CORE COOLING as ORANGE throughout the Q, would it still be accurate? Lets discuss.

3. In order to completely evaluate the provided reference, Q statement needs to provide values for containment parameters of pressure and radiation (RE-27?)

4. Plausibility of C(2), D(2) is very weakthey need to be some function of +15 minutes from one of the provided times. Giving some benefit of doubt here due to ease of correction. Recommend C(2) and D(2) change to 1015, keep A(2) and B(2) as 1025.

Q appears E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/24/19.

K/A 026A2.03 82 H 2 X X Y Y M E Q=K/A, Q=SRO-only

1. Distractor D is non plausible due to provided referencewhy would anyone believe that CONDITION E, which is titled One Containment Pressure channel inoperable is NOT required?

2. Provided reference gives away far too many cues to other potential Qs on this examwe cant provide entire LCO 3.3.2 plus table giving every single ESFAS functional unit signal, TS setpoint, etc.

3. Q as submitted is technically E due to one non-plausible distractor, but may need a different approach/major re-work due to issues above with the references.

Q is evaluated as E at this time.

Facility licensee made changes as requested by NRC. TS reference provided to the applicants will be redacted of non-required information. Q ready to be administered on exam. MKM 05/24/19.

Page 34 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 026AA2.03 83 H 2 X Y Y B E Q=K/A, Q=SRO-only Note: on previous two exams

1. Recommend slight editorial tweak to first part Q for readability: move isolate CCW to from all distractors to the first part Q statement.

Q appears E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/24/19.

056AA2.14 84 H 3 X X Y Y M E Q=K/A, Q=SRO-only

1. Recommend adding no operator actions for first part Q statement.

2. Add the title of CONDITION B to the second part Q statement, and no reference will be requiredthe 2nd part Q is essentially an operability determination; in other words, the ACTIONS/COMPLETION TIMEs of LCO 3.8.1 are not needed to elicit the correct answer.

Q appears E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/24/19.

062A2.09 85 H 3 X Y Y B E Q=K/A, Q=SRO-only

1. A(2) and B(2) distractors are partially correct depending on the timing of the response - in other words, it is logically true that the operators will continue power operation and monitor grid conditions while preparing to do the down-power to MODE 3. Easy fix: the operating crew [is/is NOT] required to place the Unit in MODE 3 in the next 6 hours6.944444e-5 days <br />0.00167 hours <br />9.920635e-6 weeks <br />2.283e-6 months <br />.

Q appears E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/24/19.

Page 35 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 062AA2.05 86 H 3 X Y Y N E Q=K/A, Q=SRO-only

1. Recommend adding based on the given conditions to WOOTF statement (for both part Q statements).

2. Recommend splitting 1st, 2nd, part Q statements into two sentences.

3. Modify 2nd part Q statement as follows: Per the BASIS of LCO 3.6.6, Containment Spray and Cooling Systems, the current containment cooler alignment and service water flow rate ___[does/does NOT]___ provide sufficient cooling capacity to meet post accident heat removal requirements.

Q appears E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/24/19.

K/A 064A2.21 87 H 2 X X X Y Y M U Q=K/A, Q=SRO-only

1. Unclear from the given stem conditions what the initial charging pump lineup is. We state that the B train is on service, but then the 1A charging pump trips.

Was the 1A charging pump aligned to the B train?

2. Recommend adding some sort of with no operator actions statement to first part Q.

3. Second part distractors A(2), C(2) are not plausible for the following reasons:

(i) grammatically and logically, the second part Q statement is always true when you substitute the IS verbin other words, you are always required to follow the actions of LCO not met within the time specified, independently of any conditions given in the Q stem.

(ii) with the provided reference, both return-to-service times (40 and 70 hours8.101852e-4 days <br />0.0194 hours <br />1.157407e-4 weeks <br />2.6635e-5 months <br />) are well outside the TS required action completion times, therefore there would be no reason to think that the SSC would be fixed before the TS time ran out.

Q as submitted is U due to multiple non plausible distractors.

Potential fix for second part Q:

-change charging pump return-to-service time within possible TS completion times

-need to make 2nd part Q statement much more specific, for example: Based on the given conditions, the 1B charging pump [is/is NOT] required to be declared inoperable at the appropriate time as specified in LCO 3.8.1 Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/24/19.

Page 36 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 072A2.03 88 H 2 X Y N N U Q=K/A, Q does not meet SRO-only

1. Immediate TS actions are required to be known from memory by RO-level applicants (as well as SROs); one could eliminate A(2) and C(2) because they are not on SRO-only. Furthermore, the reference provided makes A(2) and C(2) non plausible because the only time those actions appear in the LCO is after a 30-day action or after a 7 day action (2 channels inop).

Q as submitted is evaluated as U due to license-level mismatch and multiple non plausible distractors.

Potential recommendation for fix: test application of LCO 3.0.4. For example:

Operators are conducting heatup following refueling outage, RCS T=320 degrees F when R-27A fuse blows. Operators stop heat-up at T=340 degrees F.

First part Q the same as submitted.

(2) After performance of a risk assessment and establishing appropriate risk management actions, the operators [can/can NOT] continue the RCS heatup to T=400 degrees.

Facility licensee explained how Q does not involve RO-level knowledge of immediate TS actions. NRC agreed that Q is ready to be administered on exam. MKM 05/24/19.

K/A 074EA2.07 89 H 2 X X Y Y M E Q=K/A, Q=SRO-only

1. Recommend omit phrase in stem or LHSI, consider just provide RCS pressure (presumably much higher than LHSI shutoff head). Also state that operating crew was performing ESP-1.2.

2. First part Q needs to ask next required action based on the given conditions, otherwise potential argument that starting RCP would at some point in future be correct.

3. Is phrasing once core cooling is restored clear enough for what we want, or would it be better to just state that operators are at last step of procedure?

Lets discuss.

Q appears E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/24/19.

Page 37 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A 076AG2.2.38 90 H 2 X X Y Y N U Q=K/A, Q=SRO-only

1. Two faces of same coin related to A (1), B (1) distractors. Potential argument that A (1), B (1) is a correct actionif power is reduced to at least 72% then the LCO is met and the required action is arguably no longer required.

2. A(1), B(1) distractors could also be argued non plausible, if an applicant were to believe that first part Q specifically asking what is the appropriate REQUIRED ACTION per LCO 3.4.16, the TS does not specify reducing power as an optiontherefore, given the reference, why would anyone select A(1)/B(1)?

3. Unsure what to do to fix this Q.

Q as submitted is U due to multiple non plausible distractors.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/24/19.

K/A 086G2.4.31 91 H 3 Y Y B S Q=K/A, Q=SRO-only

1. Q appears S at this time.

No additional changes needed to be made to this Q. Q ready to be administered on exam. MKM 05/24/19.

E K/A G2.1.13 92 F 3 X X Y Y M Q=K/A, Q=SRO-only

1. Recommend slight modification to first part Q statement to better parallel the procedure statement, for example: Per STP-34.1, after evaluating impacts to plant safety, the Shift Supervisor [can/can NOT] grant permission to conduct a RAPID ENTRY.

2. Unsure about the technical accuracy of the second part Q. Specifically, STP-34.1 step 3.0.2 seems to imply that the minimum requirement for MIDS is to direct Reactor Engineering to ensure the detectors are positioned in a safe location (no mention made of locking device). Lets discuss.

Q appears E at this time.

Facility licensee made changes as requested by NRC. Q modified such that locking device on MIDS is technically accurate correct answer. Q ready to be administered on exam. MKM 05/24/19.

Page 38 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A G2.1.36 93 F 2 X Y Y B E/U Q=K/A, Q=SRO-only

1. Plausibility of C(1), D(1) very weak in comparison with SRO in charge of refuelingreactor engineer will not be a licensed operator. Unlatching a fuel assembly in the reactor vessel is changing the reactivity of the core.

2. Plausibility of A(2), C(2) very weak in comparison with SRO in charge of refuelingat Farley, when will Shift Manager ever be the required authorization for a refueling manipulator crane switch operation? From another point of view, is the Shift Manager ever in Containment during refueling (potential to miss E-plan call?)?

3. Allowing big benefit of doubt here based on ease of correction:

(1) The Control Room refueling station Engineer [can/can NOT] give the final permission for unlatching a fuel assembly in the reactor vessel.

(2) The SRO in charge of refueling [is/is NOT] the lowest level of authorization allowed to grant permission for bypass switch operation of the manipulator crane.

Q evaluated as E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/24/19.

K/A G2.2.13 94 F 2 X Y Y B E Q=K/A, Q=SRO-only

1. Distractor B uses term Clearance Boundary (capitalized) vs. other distractors use boundary point. Is there a difference? Can we change this distractor to match the others?

2. Answer D uses term primary boundary point. Same questions as above.

Q is evaluated as E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/24/19.

Page 39 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A G2.2.18 95 H 3 X Y Y M E Q=K/A, Q=SRO-only

1. Distractor A is non plausible due to the logical connections between first and second part Qs (word all in first part Qif all approved work already in the field may continue, then why would anyone believe that 500kV switchyard work is not allowed?).

2. Unsure about technical accuracy of 2nd part Q. Procedure NMP-OS-010 appears to contain a contradiction: First, p. 27 stated do not perform any work on any systems that have the potential to affect off site power sources (or) vital power supplies. Then, p. 27 also stated later that approved mid-loop Green sheets are required for ALL in plant work activities during mid-loop. This includes both units and the switchyard [emphasis added by me]. How is any switchyard work allowed? We cant have a question based on a self-contradictory procedure. Lets discuss.

3. Recommend modifying C(1) and D(1) answers to include reference to Green Sheets.

Q is E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/24/19.

K/A G2.3.14 96 H 2 X Y Y B S/E Q=K/A, Q=SRO-only

1. Recommend adding Based on Given Conditions to second part Q statement.

Q appears S at this time.

No additional changes needed to be made to this Q. Q ready to be administered on exam. MKM 05/24/19.

Page 40 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A G2.4.4 97 H 2 X X Y Y B E Q=K/A, Q=SRO-only

1. Need to move away from will transition to construction of the Q statement.

Please re-write in a based on the given conditions, the NEXT required procedure transition is to _____ format.

2. Distractor C is not plausible because you never transition to ECP-3.2 directly from E-3. Recommend the following new distractor and re-order of answer choices as below: [include procedure titles]

A. ESP-3.1 B. ESP-3.3 C. ECP-3.1 D. ECP-3.3 And now C is the correct answer.

Q as submitted is E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/24/19.

K/A G2.4.50 98 H 3 X Y Y N E Q=K/A, Q=SRO only.

1. First part Q statement is confusing/difficult to understand. Is breaker FU-Z2 closed, or is it better to state that an operator takes the switch to open?

2. Picture embedded in a Q is a provided reference, please put REFERENCE PROVIDED in this Q.

3. Ensure 2nd part Q statement has parallelism with TS BASES; for example, MOV_8808A must be fully open. Recommend putting bolded statement in parentheses after 2nd part Q statement.

Q as submitted is E at this time.

Facility licensee made changes as requested by NRC; Q statements modified to remove concern over operation of the switch mentioned above. Q ready to be administered on exam. MKM 05/24/19.

Page 41 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only K/A W/E03EA2.1 99 H 3 X X X Y Y B E Q=K/A, Q=SRO-only

1. Question statement needs to be re-worded due to potential that distractor C be correct some short time in the future based on RWST level lowering. Maybe something like this would work to resolve the above concern: Based on the given conditions, procedure EEP-1 requires operators to _______ as the NEXT action.

2. Recommend re-ordering distractors C and D so they line up by number.

Q is evaluated as E at this time.

Facility licensee made changes as requested by NRC, normal convention for facility licensee is to align the distractors short length to longer length of readibility. Q ready to be administered on exam. MKM 05/24/19.

K/A W/E08EG2.4.18 100 F 3 X X X X Y Y M E Q=K/A, Q=SRO-only

1. Second part Q statement provides a cue (If FRP-P.1 is performed) which relates to the first part Q statement.

2. Second part distractors B(2) and D(2) are technically correct (subset issue) as submitted based on the logical/grammatical structure of the 2nd part Q statement. Giving benefit-of-doubt here again due to ease of correction.

Recommend re-writing in a procedure states that format to fix this concern, maybe something like the following:

FRP-P.1 states that: WHEN RCS soak is complete, IF cooldown required, THEN maintain RCS cold leg cooldown rate less than ___(2)___ in any 60 minute period.

3. With the above correction to eliminate the subset issue, distractors of 100 degrees F per hour, which is the normal cooldown rate limit, are very weakly plausible. We have just performed an RCS soak because we are worried about fracturing the vessel, it is common sense that the cooldown rate must be something less than normal maximum. Recommend using distractors of 25 degrees per hour and 50 degrees per hour.

Q is evaluated as E at this time.

Facility licensee made changes as requested by NRC. Q ready to be administered on exam. MKM 05/24/19.

Page 42 of 43

2019 Farley Initial Licensed Operator Exam (2019-301)

Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

• The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

• The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

• The answer choices are a collection of unrelated true/false statements.

• The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

• One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

• The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

• The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

• The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

• The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).

Page 43 of 43