ML20225A029

File 2A-3 Exam Administrative Items (Delayed Release)

ML20225A029
Person / Time
Site:	Sequoyah
Issue date:	08/12/2020
From:	NRC/RGN-II
To:	Tennessee Valley Authority
References
Download: ML20225A029 (152)

Text

ML20225A029 ES-301 Administrative Topics Outline Form ES-301-1 Facility: Sequoyah Nuclear Plant Date of Examination: 3-2-2020 Examination Level: RO X SRO Operating Test Number: 2020-301 Administrative Topic (see Note) Type Describe activity to be performed Code*

Determine QPTR M, R Conduct of Operations (Modified from March 2015 NRC Exam)

Determine Electrical Safety Requirements N, R Conduct of Operations D, R Perform RCS Leakage Calculation Equipment Control Pre Job Brief for Work in the RCA; Determine D, R Radiation Control worker Dose using survey maps N/A Emergency Plan NOTE: All items (five total) are required for SROs. RO applicants require only four items unless they are retaking only the administrative topics (which would require all five items).

• Type Codes & Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from EDQN IRU52VIRU652V 52UHWDNHV (N)ew or (M)odified from EDQN 

3 UHYLRXVH[DPV UDQGRPO\VHOHFWHG

ES-301 Administrative Topics Outline Form ES-301-1 Facility: Sequoyah Nuclear Plant Date of Examination: 3-2-2020 Examination Level: RO SRO X Operating Test Number: 2020-301 Administrative Topic (see Note) Type Describe activity to be performed Code*

D, R Conduct of Operations Determine the Operability of a BAT D, R Conduct of Operations Determine MODE change requirements D, R Perform RCS Leakage Calculation and Identify Tech Equipment Control Spec Requirements D, R Determine Reporting Requirements for a Radiation Control Contaminated and Injured Worker N, R Classify the Event and Determine Protective Action Emergency Plan Recommendations NOTE: All items (five total) are required for SROs. RO applicants require only four items unless they are retaking only the administrative topics (which would require all five items).

• Type Codes & Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from EDQN IRU52VIRU652V 52UHWDNHV (N)ew or (M)odified from EDQN 

3 UHYLRXVH[DPV UDQGRPO\VHOHFWHG

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 Facility: Sequoyah Nuclear Plant Date of Examination: 3-2-2020 Exam Level: RO X SRO-I SRO-U Operating Test No.: 2020-301 Control Room Systems:* 8 for RO; 7 for SRO-I; 2 or 3 for SRO-U System / JPM Title Type Code* Safety Function A. Recover a misaligned rod A, N 1 B. Terminate SI and reestablish charging flow A, EN, M 2 C. E-3 Steam Generator Tube Rupture, Depressurize RCS A, N 3 D. Start a RCP D, L, P 4P E. Sync Main Generator to the Grid L, M 4S F. Complete Phase A Containment Isolation A, N 5 G. 6.9KV Bus transfer A, D 6 H. Operate the Feedwater Regulating Valves (Restore a DCS channel) D, P 7 In-Plant Systems* (3 for RO); (3 for SRO-I); (3 or 2 for SRO-U)

I. Uncontrolled Boron Dilution isolation D, E, R 1 J. Station Blackout Inverter restoration D, E 6 K. Respond to Loss of Control Air System D, E 8

• All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all five SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

• Type Codes Criteria for RO / SRO-I / SRO-U ACTUAL (A)lternate path 4-6 / 4-6 / 2-3 5 (C)ontrol room (D)irect from bank  6 (E)mergency or abnormal in-plant  3 (EN)gineered safety feature  FRQWUROURRPV\VWHP 1 (L)ow-Power / Shutdown  2 (N)ew or (M)odified from bank including 1(A)  5 (P)revious 2 exams  UDQGRPO\VHOHFWHG  2 (R)CA  1 (S)imulator

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 Facility: Sequoyah Nuclear Plant Date of Examination: 3-2-2020 Exam Level: RO SRO-I X SRO-U Operating Test No.: 2020-301 Control Room Systems:* 8 for RO; 7 for SRO-I; 2 or 3 for SRO-U System / JPM Title Type Code* Safety Function A. Recover a misaligned rod A, N 1 B. Terminate SI and reestablish charging flow A, EN, M 2 C. E-3 Steam Generator Tube Rupture, Depressurize RCS A, N 3 D. Start a RCP D, L, P 4P E. Sync Main Generator to the Grid L, M 4S F. Complete Phase A Containment Isolation A, N 5 G. 6.9KV Bus transfer A, D 6 In-Plant Systems* (3 for RO); (3 for SRO-I); (3 or 2 for SRO-U)

I. Uncontrolled Boron Dilution isolation D, E, R 1 J. Station Blackout Inverter restoration D, E 6 K. Respond to Loss of Control Air System D, E 8

• All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all five SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

• Type Codes Criteria for RO / SRO-I / SRO-U ACTUAL (A)lternate path 4-6 / 4-6 / 2-3 5 (C)ontrol room (D)irect from bank  6 (E)mergency or abnormal in-plant  3 (EN)gineered safety feature  FRQWUROURRPV\VWHP 1 (L)ow-Power / Shutdown  2 (N)ew or (M)odified from bank including 1(A)  5 (P)revious 2 exams  UDQGRPO\VHOHFWHG  1 (R)CA  1 (S)imulator

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 Facility: Sequoyah Nuclear Plant Date of Examination: 3-2-2020 Exam Level: RO SRO-I SRO-U X Operating Test No.: 2020-301 Control Room Systems:* 8 for RO; 7 for SRO-I; 2 or 3 for SRO-U System / JPM Title Type Code* Safety Function B. Terminate SI and reestablish charging flow A, EN, M 2 C. E-3 Steam Generator Tube Rupture, Depressurize RCS A, N 3 D. Start a RCP D, L, P 4P In-Plant Systems* (3 for RO); (3 for SRO-I); (3 or 2 for SRO-U)

I. Uncontrolled Boron Dilution isolation D, E, R 1 K. Respond to Loss of Control Air System D, E 8

• All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all five SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

• Type Codes Criteria for RO / SRO-I / SRO-U ACTUAL (A)lternate path 4-6 / 4-6 / 2-3 2 (C)ontrol room (D)irect from bank  3 (E)mergency or abnormal in-plant  2 (EN)gineered safety feature  FRQWUROURRPV\VWHP 1 (L)ow-Power / Shutdown  1 (N)ew or (M)odified from bank including 1(A)  2 (P)revious 2 exams  UDQGRPO\VHOHFWHG  1 (R)CA  1 (S)imulator

(6 5HFRUGRI5HMHFWHG.$V )RUP(6



7LHU 5DQGRPO\ 5HDVRQIRU5HMHFWLRQ

• URXS 6HOHFWHG.$

PXOWLXQLWOLFHQVH $ELOLW\WRH[SODLQWKHYDULDWLRQVLQFRQWURO

7*652 $* ERDUGFRQWUROURRP_OD\RXWVV\VWHPVLQVWUXPHQWDWLRQDQGSURFHGXUDO

 DFWLRQVEHWZHHQXQLWVDWD_IDFLOLW\



 >.$UHSODFHGEHFDXVHWKHUHLVQRV\VWHPRUSURFHGXUDOGLIIHUHQFHEHWZHHQ

8QLWDQG@FKDQJHPDGHE\&KLHI([DPLQHU





$* $ELOLW\WRDQDO\]HWKHHIIHFWRIPDLQWHQDQFHDFWLYLWLHVVXFKDVGHJUDGHG

SRZHUVRXUFHVRQWKHVWDWXVRIOLPLWLQJFRQGLWLRQVIRURSHUDWLRQV

,QWHUSUHWDWLRQRIFRPSXWHULQFRUH7&PDSIRUGURSSHG

7*2652 $$ URGORFDWLRQ

 

>.$UHSODFHGEHFDXVHXQDEOHWRZULWHDGLVFULPLQDWLQJTXHVWLRQRQ7&

 EHFDXVHWHPSHUDWXUHVDOZD\VJRGRZQIRUDGURSSHGURG@FKDQJHPDGHE\

&KLHI([DPLQHU





$$ 5HTXLUHGDFWLRQVLIPRUHWKDQRQHURGLVVWXFNRU

LQRSHUDEOH

7*52 . &RQWUROOHUIRU3=5VSUD\

 

>.$UHSODFHGEHFDXVHZLWKPXOWLSOH'&6UDFNVDQGSRZHUVXSSOLHV

 NQRZOHGJHLVPLQXWLDDQGQRWRSHUDWLRQYDOLGWRNQRZIURPPHPRU\@

 FKDQJHPDGHE\&KLHI([DPLQHU

 

. ,QGLFDWRUIRU3259SRVLWLRQ

$ELOLW\WR D SUHGLFWWKHLPSDFWVRIWKHIROORZLQJ

7*52 $ PDOIXQFWLRQVRURSHUDWLRQVRQWKHFRQWDLQPHQWV\VWHPDQG

 E EDVHGRQWKRVHSUHGLFWLRQVXVHSURFHGXUHVWR

FRUUHFWFRQWURORUPLWLJDWHWKHFRQVHTXHQFHVRIWKRVH

 PDOIXQFWLRQVRURSHUDWLRQV(PHUJHQF\FRQWDLQPHQWHQWU\





>.$UHSODFHGEHFDXVHWKHUHDUH21/<652DGPLQLVWUDWLYHUHVSRQVLELOLWLHV

 IRUWKLVFRQGLWLRQ@&KDQJHPDGHE\&KLHI([DPLQHU



$ $ELOLW\WR D SUHGLFWWKHLPSDFWVRIWKHIROORZLQJ

PDOIXQFWLRQVRURSHUDWLRQVRQWKHFRQWDLQPHQWV\VWHPDQG

E EDVHGRQWKRVHSUHGLFWLRQVXVHSURFHGXUHVWR

FRUUHFWFRQWURORUPLWLJDWHWKHFRQVHTXHQFHVRIWKRVH

PDOIXQFWLRQVRURSHUDWLRQV&RQWDLQPHQWHYDFXDWLRQ LQFOXGLQJ

UHFRJQLWLRQRIWKHDODUP 

$ELOLW\WRDQDO\]HWKHHIIHFWRIPDLQWHQDQFHDFWLYLWLHVVXFKDV

 * GHJUDGHGSRZHUVRXUFHVRQWKHVWDWXVRIOLPLWLQJFRQGLWLRQVIRU

T3

 RSHUDWLRQV



 >.$UHSODFHGEHFDXVHSODQWZLGHJHQHULFLVDSSOLFDEOHWR/&2

ZKLFKLV65221/<@&KDQJHPDGHE\&KLHI([DPLQHU





•  .QRZOHGJHRIOLPLWLQJFRQGLWLRQVIRURSHUDWLRQVDQGVDIHW\OLPLWV



(6 5HFRUGRI5HMHFWHG.$V )RUP(6

 LQWHUUHODWLRQVEHWZHHQWKHSURFHGXUHDQGIDFLOLW\FRQGLWLRQVDQG

  :( 5HGLDJQRVLV  VHOHFWLRQRIDSSURSULDWHSURFHGXUHVGXULQJDEQRUPDODQGHPHUJHQF\

T1G2 ($ RSHUDWLRQV 

 

>.$UHSODFHG,PSOHPHQWDWLRQRI(6LVDOZD\VDMXGJHPHQWFDOO

 WKHUHIRUHQRGLVFULPLQDWRU\TXHVWLRQFDQEHZULWWHQ@&KDQJHPDGHE\

&KLHI([DPLQHU





$$ 

5HTXLUHPHQWVIRUHVWDEOLVKLQJDILUHZDWFK

  

  

  

  

  

  



ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only RO Exam Preliminary Results: 14/75 Unsat = 18.6%

Cred Dist: 3, 4, 20, 21, 23, 29, 41, 63, 69, 72, 75 Q=K/A: 23, 29, 32, 73 LOD=1: 68, 73 SRO Exam Preliminary Results: 5/25 Unsat = 20%

Cred Dist: 99 Q=K/A: 87 SRO-only: 79, 84, 94

Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts:

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question a 1 (easy) to 5 (difficult); questions with a difficulty between 2 and 4 are acceptable.

3. Check the appropriate box if a psychometric flaw is identified:

• Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

• Cues: The stem or distractors contain cues (e.g., clues, specific determiners, phrasing, length).

• T/F: The answer choices are a collection of unrelated true/false statements.

• Cred. Dist.: The distractors are not credible; single implausible distractors should be repaired, and more than one is unacceptable.

• Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by the stem).

4. Check the appropriate box if a job content flaw is identified:

• Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

• Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory).

• #/Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

• Backward: The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those K/As that are designated SRO-only. (K/A and license-level mismatches are unacceptable.)

6. Enter questions source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet the criteria of Form ES-401, Section D.2.f.

7. Based on the reviewers judgment, is the question, as written, (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any U status ratings (e.g., how the Appendix B psychometric attributes are not being met).

ES-401 2 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 1 H 2 x x N E T1G1 007 (Rx Trip) EA1.02 operate/monitor MFW System as it applies to procedure)

S

1. In order to ensure overall RO written exam balance of coverage, Tier 1 test items should, when relevant, test abnormal/emergency evolutions or procedures (refer to ML#

18117A079). The proposed test item tests the P-4 interlock (Rx Trip + Low Tavg 550°F) impact on MFPs and the C-9 Condenser Interlock for steam dumps; no Rx Trip procedure guidance for operating MFW is being tested.

2. Q=K/A: The 1st part of the proposed test item hits the monitor MFW piece of the K/A; however, the second part of the test item (steam dumps) may not be related to the K/A.

To address Comment #1 and #2, consider writing a test item where ES-0.1 was entered.

At Step 5 RNO the crew entered EA-2-2, Establishing Secondary Heat Sink Using Feedwater or Condensate System.

EA-2-2, Section 4.4, Establishing MFW Flow to SGs, contains guidance for:

how to adjust MFPT speed using the master controller and how much feedwater flow approximately corresponds to 440 gpm.

(2 x 2 question)

ES-0.1 is a major part of the Rx Trip procedure.

3. Stem Focus: The 4th stem bullet is not clear with respect to how Tave got stable - - is AFW controlling Tave?

4. Stem Focus: The stem of the question says the crew manually tripped the reactor - - did this guidance come from AOP-S.02, Loss of Condenser Vacuum? Consider adding to stem to give the whole picture of how manual scram occurred.

2-4-2020: Comment #1, #2, and #3 not addressed.

2-18-2020: Final tally of test items that test AOPs/EOPs ~ 30 (throughout all tiers); therefore, this test item is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 2 H 2 M E T1G1 008 (PZR Vapor Space Accident-Relief Valve Stuck Open)

AK2.01 (interrelations between PZR Vapor Space Accident and S

valves)

1. Q=K/A: The 2nd part of the question may not be related to the K/A.

Suggest replacing the 2nd part to test whether SI termination criteria is / is not met at E-1, Step 7, for the given stem conditions.

For example, for the safety valve failure, the crew entered E-0 and exited E-0 at Step 9 to go to E-1. When they reached E-1, Step 7 (Check SI Termination Criteria), they had to monitor RCS pressure stable or rising - Answer is No.

2. Overlap: The RCP Termination Criteria will likely be observed in several scenarios; the 2nd part of the question probably overlaps the scenario major events.

2-4-2020: Comments #1 and #2 addressed; however, the stem should include where the crew is in the EOPs. Suggest adding a final bullet that says: The crew entered E-1 and is performing Step 7, CHECK SI Termination Criteria.

2-13-2020: Comment incorporated; question is SAT

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 3 H 2 x x B U T1G1 011 (LBLOCA) EK2.02 (interrelations between pumps and procedure)

S

1. Cred Dist: The 2nd part of Choices B/D (realign back to RWST) is not plausible because:

1) the stem says ES-1.3 was entered - - ES-1.3 entry conditions are all LOW RWST level conditions;

2) ES-1.3 contains no guidance to transfer back to the RWST.

3) The stem does not include anything that could be misconstrued to mean that something was wrong with the containment sump or that the RWST was replenished.

Consider adding a bullet to the stem that says EA-63-8 (Monitoring for Containment Sump Blockage) and EA-63-2 (Refilling the RWST) are both in progress. This would make the 2nd part of Choices B/D (realign back to RWST) plausible.

2. Stem Focus: The 1st fill-in-the-blank statement is missing a unit/dimension at the end, i.e., gpm.

2-4-2020: Comment #1 and #2 incorporated (EA-63-8 not included due to creating partially correct answer; however, EA-63-2 WAS included in the stem). Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 4 H 2 x B U T1G1 015 (RCP Malfunctions) AA1.15 (operate/monitor high-power/low-flow reactor trip block status lights as they apply to S

procedure) 2013 SQN NRC Exam, Q#?

1. Cred Dist: The 1st part of Choices A/B (P-7 interlock still accurate) is not plausible because the stem says the sensor is STUCK at pressure equivalent to 50% even though reactor power is 25%--- - The applicants can correctly eliminate Choices A/B solely based on the stem says the P-7 sensor source is STUCK.

2. In order to ensure overall RO written exam balance of coverage, Tier 1 test items should, when relevant, test abnormal/emergency evolutions or procedures (refer to ML#

18117A079). The proposed test item tests the P-7 interlock (10% power) and the P-8 interlock (35% power makes RCP RPS trip go from 1/4 to 2/4); no RCP Malfunction procedure guidance is being tested.

To remedy Comment #1 and #2 above, suggest writing a question something like:

Plant in Mode 1 at 15%

AOP-R04 entered due to lower bearing and/or seal water temperatures on 1A RCP slowly rising.

Test the applicants knowledge of whether M-4A, WC5 (P-8 LOW POWER LOW FLOW TRIP BLOCKED) is / is not illuminated and whether the reactor is / is not required to be manually scrammed before the RCP 1A is manually tripped IAW AOP-R.04.

3. Overlap: The knowledge P-8 overlaps with Q#28; ensure no overlap with final resolution.

2-4-2020: Comment #1 and #2 addressed; however, Comment #3 may not be addressed (P-8 knowledge may still overlap with Choice A in Q#28-why is 9% in Q28 make this okay?), and the word on in the 1st fill-in-the-blank statement should be replaced with the word annunciator.

2-13-2020: Changed Choice A in Q#28; comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 5 H 2 x x B E T1G1 022 (Loss of Rx Coolant M/U) AK1.02 (operational implication of relationship of charging flow to P between charging and RCS as S

it applies to procedure)

1. Stem Focus: For the sake of the K/A, suggest replacing the 2nd bullet (AOP-R.05) with The crew entered AOP-M.09, Loss of Charging. AOP-M.09 is the Loss of Rx Coolant M/U procedure.

Like AOP-R.05 does, AOP-M.09 also requires isolating letdown and also directs the crew to use EA-62-5 to re-establish charging flow; seems like a clearer tie to the Loss of Rx Coolant M/U topic.

2. Partial: To ensure bullet proof to post-exam appeals, include the name/number of the Section in EA-62-5 being implemented, i.e., Section 4.2, Establishing Charging Flow.

2-4-2020: Comment#1 not addressed, only Comment #2 was addressed.

2-13-2020: Comment #1 incorporated; question is SAT.

6 H 2 M E T1G1 026 (Loss of CCW) AA2.02 (determine/interpret cause of possible CCW loss is it applies to procedure)

S

1. Stem Focus: The grammar in the 2nd part of the stem question doesnt flow with the 2nd part of each choice.

2. Stem Focus: In the 1st stem item, the loss of CCS can be more clearly stated as a condition that will cause CCS Train B flow/pressure to lower.

Suggest re-wording the stem question like:

WOOTF identifies (1) a condition that will cause CCS Train B flow/pressure to lower on BOTH units AND (2) whether a Unit 2 manual reactor trip is required in accordance with AOP-M.03 if the Train B flow/pressure cannot be restored 2-4-2020: Comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 7  ? 1 x x B E T1G1 029 (ATWS) EK1.01 (operational implication of reactor nucleonics and thermo-hydraulics behavior as they apply to H S procedure)

1. LOD=1: This test item will not have any discriminatory value on the exam. The first part of the question is GFE knowledge.

2. Cred Dist/Partial: Where does it say preferred in FR-S.1; i.e.,

where does FR-S.1 say emergency boration is the preferred method of adding negative reactivity? The plausibility of the 2nd part of Choices A/C (preferred method is to wait and let reactor heat up) is questionable.

3. The Cog Level Field on Form ES-401-5 is missing.

Suggest testing the basis for the FR-S.1 caution to not trip RCPs, or something like that.

2-4-2020: Bank replacement question used to address Comment #1,

1. 2; Comment #3 addressed. However, the following enhancements are needed.

4th bullet: The original 5% power level was changed to 45%;

suggest compromise with 20% to play on misconstruing P-8, etc..

6th bullet: the word occurred is misspelled.

1st fill-in-the-blank statement: To get away from predicting what the crew will or will not do, suggest rewording the fill-in-the-blank and 1st part of all four choices to test what is required or not required, e.g., In accordance with FR-S.1, the RCPs

______ required to be secured immediately.

[are vs are NOT]

2nd part of Choice B: to mirror the basis document, suggest changing to because it could result in reduced heat removal and challenge fuel integrity.

2nd part of Choice C: to ensure this choice is not an SRO type choice, suggest changing to because of the positive reactivity addition from the RCP core cooling. This will allow Choice C to mirror the other three choices and puts eliminates the possibility of the RO applicants eliminating this choice solely because RO applicants arent responsible for DBA analyses.

2-13-2020: Comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 8 H 2 x x x x N E T1G1 040 (SL Rupture) AA1.03 (operate/monitor isolation of one steam line from header as it applies to procedure)

S

1. Cred Dist: The plausibility of the 1st part of Choices A/B (valve position still available after all 125v control power fuses removed) is questionable because the whole circuit is dead after fuses are pulled.

Suggest changing out the 1st part of the question to test whether the valve position remains / does NOT remain available after the MSIV transfer control switches are placed in the AUX position.

2. Cue: The word all in the 3rd bullet is not necessary to elicit the correct response.

3. Partial: Choice D is also correct because the 2nd fill-in-the-blank does not mirror the foldout page transition wording, and because the phrase based on ___(2)___ is subjective. For example, Choice D can be successfully contested because if the EA-1-1 actions are successful, the MSIVs will close and S/G pressure will begin rising. Sort of a direct (SG pressure rising) and indirect (MSIV closes and SG pressure rises) argument.

4. Stem Focus: Suggest clarifying the word faulted in the 1st bullet; for example, say that a main steam line break downstream of the MSIV occurred on #3 S/G. The way the 1st bullet reads is almost slang.

2-4-2020: Comment #1, #2, and #4 addressed; however, 1st fill-in-the-blank statement: the phrase in the MCR should be replaced with on 6K/6L Panels at 1-M-6. We dont want the 1st fill-in-the-blank statement to be tricky; therefore, specify panel unid/location.

2nd part of Choices B/D: Comment #3 was addressed by including the word indication; however, these two choices are not plausible because reestablishment of the secondary pressure boundary would not ever solely be based on the valve indication being green.

2-13-2020: Comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 9 H 2 x x B E T1G1 054 (Loss of MFW) AA1.03 (operate/monitor AFW auxiliaries, including oil cooler water supply, as it applies to procedure)

S

1. Partial: An applicant may contend there is no correct answer to the 2nd part of the question because the normal source of cooling to the TDAFW Pump bearings is OIL. Suggest re-wording the 2nd part of the stem question to be more specific regarding the cooling water used to cool bearing OIL.

2. Cue: The word immediately is not necessary. Suggest re-wording the 1st part of the stem question to say the earliest time that the TDAFW Pump will auto-start and change the correct choice to be at the time the 1A MFP tripped and the distracter to be at the time when SG level lowered to the auto-start setpoint.

2-4-2020: Comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 10 F 2 x x B E T1G1 056 (LOOP) AK1.01 (operational implication of natural convection cooling as it applies to the procedure)

S

1. Stem Focus: The stem should refer to EA-68-6, Monitoring Natural Circulation Conditions, because ES-0.1, RNO Step 13.b (4) direct EA-68-6.

2. Partial: The words in the choices dont mirror the EA-68-6, Step

[1] indications, which could make the question vulnerable to post-exam appeals. For example, the phrase and both parameters stable in Choice D could be used to contest that the Choice was not specific for incore t/cs higher than Tcold.

Suggest re-wording the choices to have a list, for example, Choice D could be re-worded as:

D. Incore CETs stable and higher than Tcold Tcold at saturation temp for S/G Pressure Also suggest using the term CETs instead of incore T/Cs because thats what the procedure uses.

3. Partial: Suggest adding the phrase IAW EA-68-6 to the stem question. The grammar in the stem question can make this test item vulnerable to post-exam appeals.

2-4-2020: Comment #1 incorporated; however, the correct Choice D doesnt mirror RNO Step 13.b(4). Suggest revising each Choice to:

A. Core exit T/Cs equal to Tcold. Incore T/Cs at saturation temperature for the S/G pressure.

B. Core exit T/Cs equal to Tcold. Tcold at saturation temperature for the S/G pressure.

C. Core exit T/Cs stable. Incore T/Cs at saturation temperature for the S/G pressure.

D. Core exit T/Cs stable. Tcold at saturation temperature for the S/G pressure.

2-13-2020: Comment incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 11  ? 2 x x N SAMPLE QUESTION RECD 11/7/19 T1G1 055 (SBO) EA2.03 (determine/interpret actions necessary to restore power as they apply to procedure)

1. Cue: The Unit 2 designation in the 2nd stem bullet is not necessary to elicit the correct response since the SBO affects the entire site. Since Unit 2 is connected to the 161Kv switchyard, the 2nd stem bullet could cue an applicant to eliminate the Hiwassee choices solely based on switchyard voltage instead of knowing the pre-designated black start line.

2. Stem Focus: Suggest clarifying in the stem that the entire site has lost offsite power, no EDG is available on either unit, and BOTH units have entered ECA-0.0, Loss of All AC Power.

3. LOK: The Cognitive Level field on Form ES-401-5, Question Worksheet, indicates this item is Higher Cog even though it solely tests the pre-designated black start line and its voltage.

11 S T1G1 055 (SBO) EA2.03 (determine/interpret actions necessary to restore power as they apply to procedure)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 12  ? 2 x B E T1G1 058 (Loss of DC) AK3.01 (reason for use of DC control power by D/Gs)

S 2017 SQN NRC Exam, Q#?

1. Cue: The 3rd bullet should not be included because it is what should be tested to hit the K/A.

Suggest re-working the test item to be:

WOOTF completes both statements?

_____ Diesel Generator(s) will auto-start.

[One vs All four]

IAW AOP-P.02, Diesel Generator 2B-B _________.

[cannot be stopped from the MCR vs. engine trips will not function]

By re-working the second part of the question this way, the applicants cannot solely use the following power supply scheme to eliminate Choices A/C.

2. LOK: The Form ES-401-5 Cog Level Field indicated this was higher cog even though appears to be memory level.

2-4-2020: The 3rd bullet was removed; however, the suggested 2nd part of the question wasnt incorporated. The proposed 2nd part of the question is 2B-B EDG can only be shutdown using CR switch or Local Switch. The plausibility would be better if the 2nd part of the question asked the 2B-B EDG can/ can NOT be shutdown using (pick just one of the two switches.)

2-13-2020: Comment incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 13 H 2 N E T1G1 062 (Loss of Nuc SW) G2.4.21 (parameters/logic used to assess status of safety functions such as rx ctl, core clg & heat S

removal, RCS integrity, containment conditions, rad release ctl, etc.)

1. In order to ensure overall RO written exam balance of coverage, Tier 1 test items should, when relevant, test abnormal/emergency evolutions or procedures (refer to ML#

18117A079). Both parts of the proposed test item test the loads supplied by the 2A ERCW supply header; no knowledge of AOP-M.01 is being tested.

Suggest replacing the 1st fill-in-the-blank statement as follows, to test the K/A in terms of AOP-M.01 knowledge. The 2nd part of the question could remain; however, it should mirror the procedure more closely:

WOOTF completes both statements IAW AOP-M.01, Loss of ERCW?

Unit 2 Train A CCP and SI Pump may experience bearing failure

____ minutes after loss of ERCW cooling.

[10 vs 15]

The REACTOR COOLANT PUMPS MOTOR THRUST BEARING TEMP HIGH annunciator is required to be monitored

[on both units vs only on Unit 2]

2-10-2020: Comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 14 F 2 B E T1G1 065 (Loss of Instrument Air) AK3.04 (reason for cross-over to backup air supply as it applies to procedure)

S

1. In order to ensure overall RO written exam balance of coverage, Tier 1 test items should, when relevant, test abnormal/emergency evolutions or procedures (refer to ML#

18117A079). The proposed test item tests the 0-FCV-32-82 auto-closure setpoint and purpose of isolation; no required action/caution in AOP-M.02, or low air pressure annunciator procedure is being tested.

2-10-2020: No change to original question. The following items should be addressed:

Partial/Plausiblity: (Partial) What is technical basis document for the answer to the 2nd part of A/C? Provide technical basis document in the ES-401-5, is it a lesson plan? (Plausiblity)

Since the stem doesnt contain background information of how EA-32-2 was entered, the plausibility of the 2nd part of Choices B/D is questionable. Suggest adding something to the stem about what event caused EA-32-2 entry and then change the 2nd part of Choices B/D to:

prevent combustible hydrogen/oxygen concentration following a design basis accident.

Stem Focus/Partial: The Section 4.4, Aligning Control and Service Air to Supply Auxiliary Air, is where EA-32-2 contains the information for FCV-32-82 and 85 - - the Section should be included in the stem. However the procedure identifies a pressure BAND (66.5 to 71.5 psig) - not just a single number setpoint. The 1st part of each Choice should be a band, in order to mirror the procedure.

2-18-2020: Technical basis listed in ES-401-5 as FSAR. Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 15 H 2 x x N E T1G1 077 (Generator Voltage & Grid Disturbance) Ak3.01 (reason for reactor and turbine trip criteria as it applies to procedure)

S

1. Partial: The answer to the 2nd part of the question does not mirror Appendix B, Abnormal Grid Frequency Trigger Values; therefore, this question is vulnerable to post-exam appeals.

Suggest moving the title/number of the procedure to the stem question since it applies to both parts of the question, and also refer to Appendix B.

2. Stem Focus: The questions should be written to test what is / is not required (instead of testing will vs will not).

3. Partial: The 2nd bullet should mirror Step 6.b in the procedure.

Unit 1 is at 75%

Grid frequency lowered and stabilized at 59.6 Hz and cannot be restored to a higher value at this time.

WOOTF completes both choices in accordance with AOP-P.07, Degraded Grid or Abnormal Voltage Conditions, and Appendix B, Abnormal Grid Frequency Trigger Values?

The 6.9 KV SDBDs ______ required to be transferred to the DGs at this time.

[are vs are NOT]

The basis for the 58 Hz frequency trigger value that requires a manual reactor trip is ______.

[imminent automatic underfrequency trip vs. 25% of lifetime limit for off-frequency operation of LP turbine]

2-10-2020: Comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 16 H 2 x x x B E T1G1 W/E04 (LOCA outside containment) EK1.1 (operational implications of components, capacity, and function of emergency systems as they apply to procedure)

1. Q=K/A: The proposed test item solely tests ECA-1.1 (Loss of Recirc Capability - overlap with Q#18 topic) - ECA-1.1 Step 17 limits SI to only one train regardless of whether LOCA outside containment or not. The ECA-1.2 topic is not being tested.

2. Cred Dist: Choice C (reason limited to one ECCS train to reduce cooldown rate) is not plausible because the stem does not include and of the FR-0 items associated with FR-P.1 entry.

3. Partial and/or Cred Dist: Is this choice trying to say to allow TIME for aligning blended makeup to the RWST?

IF so, then it may also be a correct answer. (TIME =

delays RWST depletion)

IF not, then plausibility is questionable.

4. Partial: To ensure no post-exam appeals, suggest including IAW EPM-3-ECA-1.1, Basis Document for ECA-1.1 in the stem question.

5. Stem Focus: Suggest splitting out the 4th bullet into two separate line items.

2-10-2020: Question re-written to test whether FCV-62-69 auto-isolates and which RHR injection path is required to be isolated.

However, Partial: Choice C is also correct because ECA-1.2, Step 1.b requires operator to CHECK hot leg injection valve 63-172 closed - - the way the 2nd fill-in-the-blank statement is worded could allow an applicant to say that Choice C is also correct.

Suggest adding stem bullets to say that the crew has completed Step 1 to CHECK proper valve alignment, and the crew is performing Step 2 to attempt to isolate the break from the RCS.

Then re-word the fill-in-the-blank statement to say:

FCV-63-93 is / is NOT the first valve closure directed by the procedure in Step 2.

Stem Focus: Suggest adding the term auto-close in the 1st fill-in-the-blank statement (instead of just close.)

Generic Comment: In this question there are two formats: The 3rd bullet uses both a comma and a quotation mark, whereas the 2nd fill-in-the-blank statement only has a quotation mark around the name of the procedure. Need to be consistent throughout exam whichever format is chosen.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 17 H 3 B S T1G1 W/E05 (Loss of Secondary Heat Sink) EK2.2 (interrelations between FR-H.1 and facilitys heat removal systems, including primary coolant, emergency coolant, decay heat removal systems, and relations between the proper operation of these systems to the operation of the facility.)

18 H 2 x N E T1G1 WE11 (Loss of Emergency Coolant Recirc) EK2.1 (interrelations between procedure and components, and functions of S

control and safety systems, including instrumentation, signals, interlocks, failure modes, and automatic and manual features.)

1. Stem Focus: The bullet sequencing is confusing - the stem should be laid out in chronological order, use sub-bullets if necessary, and should tell the story of how we got here, Unit?,

etc.

Suggest the following:

Unit 2 was operating at 100% power when a LOCA occurred.

The crew completed ES-1.3, Transfer to RHR Containment Sump.

ECA-1.3, Containment Sump Blockage, was subsequently entered.

B Train pumps are in P-T-L A train CCP, SI, RHR, and Containment Spray pumps remain running and all pumps indicate cavitation.

IAW ECA-1.3, WOOTF is an allowable sequence for stopping the A train pumps?

2-10-2020: Comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 19 H 2 x x N SAMPLE QUESTION RECD 11/7/19 T1G2 001 (Continuous Rod Withdrawal) AA2.04 (determine/interpret rx power and trend as it applies to procedure)

1. Cred Dist: The 2nd part of Choices B/D (MWe will remain the same) is not plausible because nothing exists in the stem that could be misconstrued to keep MWe stable. Consider adding the status of a turbine-generator control system parameter (e.g.,

MW-in, MW-out, Imp-in, Imp-out) or an associated power cabinet status to the stem.

2. Partial: For the sake of making the test item bullet-proof to post exam appeals, suggest replacing will/ will not in the 1st part of the Choices with is required/ is not required. We want to test what is required or not required in all written exam test items instead of trying to predict what the crew/OATC will do.

3. Stem Focus: Suggest clarifying which rod/banks are continuously withdrawing in the stem with rod control in manual.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 19 H 2 x x N E T1G2 001 (Continuous Rod Withdrawal) AA2.04 (determine/interpret rx power and trend as it applies to procedure)

S Sample question comment addressed by changing out the 2nd part of question; however, new flaw exists.

1. Cred Dist: The plausibility of the 2nd part of choices A/C (power remains at 98%) is questionable because of the effects of xenon, etc. See proposed fix below:

2. Stem Focus: The wording of the 2nd fill-in-the-blank statement is confusing; when rod motion stopped makes me think that going to AUTO worked or something, which is not the case.

Suggest the following to remedy Comments #1 and #2:

IF rod motion subsequently stops when reactor power reaches 98%, THEN power _____ return to 85%, with no operator action.

[will vs will NOT]

2-10-2020: Suggestion partially incorporated. Comment#1 was associated with plausibility of remaining at 98% power- proposed fix still has the issue. (Partial): An applicant could say that Choice D is also correct because the 2nd fill-in-the-blank statement does not have a time element. How long does it take to return to 85%? Suggest:

IF rod motion subsequently stopped when reactor power reached 98%, THEN power _____ return to ~85%, with no operator action over the next X minutes.

[will vs will NOT]

2-13-2020: Comment addressed by asking where power will stabilize; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 20 H 2 x x B U T1G1 028 (PZRLC Malfunction) Ak3.03 (reasons for false indications of PZR level when PORV or spray valve is open and RCS saturated, as it applies to procedure)

1. Cred Dist: Choices B and C are not plausible because of the interplay between the 1st and 2nd fill-in-the-blank statements.

Choice B says level indication IS accurate when a bubble is formed in the vessel head.

Choice C says level indication is NOT accurate when its rising due to SI actuation.

2. Stem Focus: The subsequent condition (RCS pressure at 800 psig and stable) doesnt make sense with a failed open PORV; pressure would not stabilize?

3. Stem Focus: The 1st fill-in-the-blank statement refers to current pzr level, which may confuse the applicants - - i.e.,

does current mean the subsequent plant condition when level is at 70% and rising rapidly? Or does current imply some future pzr level at 100%?

Suggest writing a question to test the PZR just on span vulnerability at E-1, Step 7 (See WOG ERGs for discussion) during the PORV stuck open event. i.e., test the sequence of the Step 7 checks for evaluating whether SI termination is/ is not allowed. Subcooling checked FIRST before PZR level is checked to ensure the saturated condition isnt making PZR level false/misleading. By testing the sequence you would be indirectly testing the reason to hit the K/A.

2-10-2020: The interplay issue was solved by replacing the 1st fill-in-the-blank statement; however, Stem Focus: The 3rd stem bullet procedure step doesnt align with current version of ES-0.2. My version has Step 11 to REDUCE RCS pressure (time 1800) and Step 14 is MONITOR RCS Cooldown.

Stem Focus: For the 2nd bullet, the phrase a plant cooldown in accordance with is not necessary - just say The crew is performing ES-0.2, Natural Circulation Cooldown.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 21 H 2 x x x N U T1G2 051 (Loss of Condenser Vacuum) AA1.04 (operate/monitor rod position as it applies to the procedure)

S

1. Cred Dist: The 2nd part of Choices A/C (use Tref even though turbine is tripped) is not plausible because Tref (1st stage turbine pressure) is not available when the turbine is tripped.

What is the basis for stabilizing power at 13-15%? Suggest changing the 2nd part of Choices A/C to be the power range equivalent to AFW 440 gpm as the distracter.

2. Cue: The word rising in the 3rd stem bullet is not necessary to elicit the correct response - it cues the applicants that the 1st part of Choices C/D are incorrect because if vacuum is rising, then for sure the 3rd pump WILL auto-start. Suggest revising to say condenser vacuum is 2.5 psia and stable, OR revise the stem to include a timeline and design the first fill-in-the-blank statement to ask about the specific time when vacuum is equal to 2.5 psia.

3. Stem Focus: Instead of using the language will be in the 2nd fill-in-the-blank statement, suggest using control rods are required to be.. Also consider inserting the word subsequently in the 2nd fill-in-the-blank statement so the applicants know were talking about IF a turbine trip subsequently occurs.

4. This question provides the title of AOP-S.06, which is only partly provided in Q#61. These two test items deal with the same AOP-S.06.

2-10-2020: Eliminated Tref, comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 22 H 2 x x B E T1G2 060 (Accidental Gaseous RW Release) AA1.01 (operate/monitor area rad monitors as they apply to procedure)

S

1. In order to ensure overall RO written exam balance of coverage, Tier 1 test items should, when relevant, test abnormal/emergency evolutions or procedures (refer to ML#

18117A079). The proposed test item tests the cause of two radiation monitor alarms; no subsequent required action/caution in the associated annunciator procedures, AOP, etc. is being tested.

2. Partial: The stem question wording (i.e., a potential cause) may make the test item vulnerable to post-exam appeals.

Suggest making the stem question WOOTF is the cause of the alarms?

3. Cue: The phrase high radiation in the 2nd stem bullet is not necessary to elicit the correct response.

2-10-2020:

Partial: Where is the Gas Decay Tank located? 0-M-12A, A-7 lists 7 or 8 specific areas; 0-M-12B, B-1 lists fewer areas. There may be no correct answer to the 1st part of the question if the Gas Decay Tank isnt located in one of the areas listed in these ARPs.

LOD=5 and/or plausibility: The 2nd part of the question seems like an SRO-only knowledge of what the procedure steps are/

are not contained in M-12B, B-1 annunciator procedure.

Whats the alarm procedure that indicates a release rate beyond limits? Browns Ferry has an annunciator that alarms when the allowable limit is exceeded.

Overlap: This question overlaps with Q#64.

2-13-2020: WGT located in CVCS BD area, which is listed in ARM ARP. Q#64 will be replaced. Licensee says that Aux Bldg Vent Monitor has auto-actions and ARPs verify auto-actions. Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 23 F 2 x x N U T1G2 068 (CR Evacuation) AK3.12 (reason for required sequence of actions for emergency evacuation of control room as it applies to S

procedure)

1. Cred Dist and/or Q=K/A: The 1st part of Choices C/D (two people have to complete CR actions prior to leaving) is not plausible because there is a significant fire that requires evacuating the main control room. The K/A requires testing the sequence of AOP-C.04 actions, etc. Neither part of the question tests a sequence of events that must be performed.

2-10-2020: Comment not addressed.

2-13-2020: Question replaced; SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 24 F 2 x x N E T1G2 076 (High Rx Coolant Activity) G2.4.4 (recognize abnormal indications for system operating parameters that are entry level conditions for emergency and abnormal operating procedures)

1. Cred Dist: The plausibility of the 1st part of Choices A/B (High RCS Activity is entered based on containment rad monitors) is questionable because of the way the 3rd stem bullet is worded (Chemistry says RCS Iodine greater than admin limits) - Rad monitors in containment are never as accurate as a confirmed sample from Chemistry for RCS Activity.

2. Partial: The way the 1st fill-in-the-blank statement is worded makes this question vulnerable to post-exam appeals because Choice A is also correct. The 1st fill-in-the-blank statement doesnt ask what the entry conditions are - - its wording is based on, which makes the question vulnerable to Choice A also being correct because rad monitors could potentially be part of the basis for entering the AOP.

Suggest not providing the 2nd and 3rd stem bullets and write a question to test the Section 3.2 entry conditions (DE I131 &

Gross Activity Admin Limits -see below).

Alternatively, explore using Q#67 for this K/A to test the applicants knowledge of Tech Spec LCO 3.4.16 (above-the-line) activity values since Tech Specs is an abnormal operating procedure when the LCO is not met. Ensure no overlap w/

Q#67.

2-10-2020: Proposed solution did not test the I-131 or Gross Activity numerical values for administrative or AOP entry conditions. NOT entering the AOP (Choices C/D) can be correctly eliminated solely based on conservatism when RCS I-131 exceeded the limit. I propose that we use the former Q#67 for this K/A. Alternatively, test the applicants knowledge of the numerical values listed in AOP-R.06.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 25 F 2 x x x x x N E T1G2 W/E08 (PTS) EK1.1 (operational implications of components, capacity, and functions of emergency systems as they apply to S

procedure)

1. Partial: An applicant can successfully contend there is no correct answer because the stem of the question says there is a SL Rupture; therefore, Choice D is not totally correct since an overpressure condition at low temperature wouldnt apply to the SL Rupture.

2. Partial: The stem question does not include a phrase in accordance with XYZ, which makes the test item vulnerable to post-exam appeals.

3. Q=K/A: It seems like the question is more targeted towards the EK3 statements (reason for operating characteristics during transient, reason for having procedure) vs the EK1 statements (emergency systems used in FR-P.1).

4. Cred Dist: The plausibility of the first part pf Choices A/B (PZR is the major component) is questionable because the stem question and Header title is Major Component (instead of something like most limiting component.)

5. Cue: The stem question includes the last term brittle failure, which is not necessary to elicit the correct response.

6. Stem Focus: The Header of the second column may be clearer as Stress Issue, or something like that instead of Reason for Concern.

2-10-2020: Comment#1 invalid because of SI actuation. Comment

1. 2 and #5 incorporated.

Suggest editorial comment: Delete the phrase increased stresses resulting from a.. in the 2nd part of each choice. Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 26 F 2 x x x N E T1G2 W/E10 (Natural Circ w/ Steam Void in Vessel With/without RVLIS) EA2.1 (determine/interpret facility conditions and selection of S

appropriate procedures during abnormal and emergency conditions as they pertain to procedure)

1. Partial: An applicant can successfully contend there is no correct answer because the 1st fill-in-the-blank statement does not include the words less than , i.e. RCS cooldown rate is limited to less than _____.

2. Stem Focus: It looks like the order of the fill-in-the-blank statements should be reversed - the first thing the procedure does is try to start RCP, then, afterwards, it limits cooldown rate to less than 100F/hr.

3. Cred Dist: Suggest re-working the 2nd part of each Choice to become are required vs are not allowed. For example, The operators ________ to attempt a RCP start.

2-10-2020: Comment #3 not incorporated for plausibility.

Suggest making the 1st part of the Choices to be are required vs are NOT allowed.

Stem doesnt contain a question; for the sake of exam consistency suggest:

WOOTF completes both statements iaw ES-0.3, Natural Circulation Cooldown with Stem Void in Vessel (With RVLIS)?

2-13-2020: Comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 27 F 2 x x x x B E T1G2 W/E15 (Containment Flooding) EK3.1 (reason for facility operating characteristics during transient conditions, including S

coolant chemistry and the effects of temperature, pressure, and reactivity changes and operating limitations and reasons for these operating characteristics as they apply to procedure)

1. Cred Dist: The plausibility of the 2nd part of Choices B/D (concerned with thermal shock and vessel failure) is questionable because the large break LOCA has already occurred in the stem, which means the vessel is depressurized.

Suggest changing the 2nd part to something else.

2. Cue: The first part of the correct answer contains a multi-faceted approach (identify-isolate-sample) whereas the first part of the incorrect choice only includes one action (pump water out). Suggest revising the 1st part of Choices C/D to only say:

isolate source of excess water. This will make all four choices consistent.

3. Partial: To make the question bullet-proof to post exam appeals, include the phrase IAW EPM-3-FR-Z.2, Basis Document for FR.Z.2 at the end of the 2nd stem question part.

4. Partial: To mirror EPM-3-FR-Z.2, change the word needed to necessary in the 2nd part of Choices A/C.

5. Stem Focus: None of the information above the stem question is necessary.

2-10-2020:

Comment #1 not addressed.

Suggest deleting the words using spray pump from the 1st part of Choices A/B. Just say: Transfer water from containment sump to the RWST.

In the 1st part of Choices A/B, the capitalized words Containment Sump are not necessary - - doesnt mirror stem bullet #3. Make lower case to match stem.

2-13-2020: Comment#1 is not applicable because thermal shock can still occur with vessel depressurized; other comments incorporated -

Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 28 H 2 x x x B E T2G1 003 (RCP) K5.04 (operational implications of effects of RCP shutdown on secondary parameters, such as steam pressure, steam S

flow, and feed flow)

1. Overlap: The P-8 knowledge (Choice A) overlaps with Q#4; ensure no overlap with final resolution.

2. Cred Dist: Choice D is not plausible because RCP trip will not cause T to go up; steam flow in affected SG will not rise.

Suggest modifying Choices C/D to only include the unaffected SGs, for example:

C. #2, #3, and #4 SG steam flows will rise D. #2, #3, and #4 SG steam flows will lower

3. Partial: The word overall in the stem question could potentially make the question subjective.

4. Stem Focus: The wording/sequence of the 3rd and 4th bullets (has just tripped, etc.) could confuse the applicants. Suggest combining the last two stem bullets into the stem question as below:

WOOTF predicts the plant response if the Loop 1 RCP were to subsequently trip and no operator actions are taken?

2-10-2020: Comments #2, #3, and #4 incorporated; need to discuss Comment #1: Why did changing power from 32% to 9%

remove P-8 overlap concerns with Q#4?

2-18-2020: Choice A changed to eliminate P-8 knowledge overlap with Q#4. Question is SAT. Indentation off.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 29 H 2 x x B U T2G1 004 (CVCS) A1.04 (predict/monitor PZR pressure and level (to prevent exceeding design limits) associated with operating CVCS S

controls)

1. Q=K/A: The K/A topic requires operating CVCS controls; the proposed test item doesnt involve control operation - the proposed test item tests the system response to a relief valve malfunction. The proposed test item seems more appropriate for other K/A topics such as 004 K6.03, etc.

2. Cred Dist: The 1st part of Choices A/B (PZR level lower one hour later) is not plausible because nothing in the stem exists that could be misconstrued to mean level control was not in automatic.

3. #/units: The annunciator window doesnt include the same identifiers that the other test items include for annunciators; where is annunciator located?

2-10-2020: Comment #1, #2 addressed.

Is Choice C the correct answer? The answer key says Choice D is the correct answer even though PRT level will rise.

The first part of the 2nd fill-in-the-blank statement isnt necessary - - Just say: PRT level will ____.

2-18-2020: Answer key changed to make Choice C the correct answer; comments incorporated - question is SAT.

30 H 3 B S T2G1 004 (CVCS) K5.26 (operational implication of relationship between VCT pressure and NPSH for charging pumps as they apply to system)

1. The K/A Field on Form ES-401-5 incorrectly identifies this test item as RHR, i.e., it says 005 topic instead of 004 topic.

2. Request that distracter analysis be updated to include the failure position of all four valves.

2-10-2020: Comments #1 and #2 not incorporated to ES-401-5.

2-13-2020: Question is SAT.

31 F 3 N S T2G1 005 (RHR) K2.03 (bus power supplies to RCS pressure boundary MOVs)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 32 H 2 x B U T2G1 006 (ECCS) A2.08 (predict impacts of electric power loss on valve position and use procedures to correct, control, mitigate)

S

1. Q=K/A: The proposed test item doesnt test the second part of the A2 coupled ability item; the proposed test item doesnt test the applicants ability to use procedures to correct, control, mitigate.

The K/A Match Field on Form ES-401-5 indicated that the REASON the second part of the A2 K/A was not tested was because it was not the higher cog part of the coupled K/A.

ES-401, Section D.2.a states: when selecting or writing questions for K/As that test coupled K/As (e.g., A2) try to test both aspects. If that is not possible without expending an inordinate amount of resources, limit scope to test the aspect of the K/A statement requiring the highest cognitive level.

The second part of this coupled K/A is the higher cognitive part because the applicant cannot use the procedure correctly if he/she doesnt know that the Train A valve actuations occurred normally.

2-10-2020: Re-worked question to test both parts of A2 K/A. Is there a way an applicant can argue a direct/indirect effect causes Choice D to be correct? Suggest putting a VCT level instrument unid# to absolutely making Choice D incorrect.

2-13-2020: Separation Relays are for Appendix R fire concerns; no direct/indirect affect on VCT level instruments. Question is SAT.

33 F 2 x x N E T2G1 006 (ECCS) A3.08 (monitor auto-operation of auto-transfer of ECCS flowpaths)

S

1. Cred Dist: Choice A (CCP suction from RWST opens) is not plausible because the stem says that a switchover to the sump occurred after a LB LOCA.

2. Stem Focus: The stem question is vague because it asks for an automatic action during switchover to sump; switchover to sump could be manual or automatic. Suggest re-working stem question to ask WOOTF MOVs will receive an auto-initiation signal when RWST level reaches X%.

2-10-2020: Comment #1 and #2 addressed; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 34 H 2 x N SAMPLE QUESTION RECD 11/7/19 T2G1 007 (PRT/Quench Tank) K4.01 (design features/interlocks that provide for quench tank cooling)

1. Q=K/A: The proposed test item tests the SO-68-5 procedure requirements for PRT parameter bands and the required procedure action when temperature and level are both outside the band at the same time; it does not test a PRT design feature (or interlock) that provides for PRT cooling.

34 H 2 x x N E Sample question comment addressed by adding the 2nd part of the question for the design feature for cooling water to enter at the top of S

the PRT; however,

1. Partial: To ensure the 1st part of the question is bullet-proof to post- exam appeals, suggest re-wording the first fill-in-the-blank statement as:

In accordance with the precautions and limitations in 2-SO 5, Pressurizer Relief Tank, PRT temperature and __(1)___ are outside the recommended band.

2. Cue: The source of cooling water, i.e., the word primary is not necessary to elicit the correct response. Suggest rewording the 2nd fill-in-the-blank statement as:

Cooling water for the PRT enters the tank via _____.

3. Cue: The grammar of the 2nd fill-in-the-blank statement does not work with the 2nd part of the incorrect choices; i.e., enters the tank via sparger at bottom. It seems like the 2nd part of Choices A/C should be:

a sparger at the bottom of the tank.

2-10-2020: Comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 35 H 2 B E T2G1 008 (CCWS) G2.1.23 (perform specific system and integrated plant procedures during all modes of plant operation)

S

1. Cred Dist: The 1st part of Choices A/B (cant allow RHR HX A Outlet Temp Hi to alarm when placing SDC in service) is not plausible because this is an expected condition when SDC is in service - - or being placed in service - - of course it is allowed.

This flaw graded as E because the 1st part is easily repaired using the ARP referenced in the stem as follows:

RHR HX outlet temperature shall NOT exceed _____ .

[145F vs another plausible lower temperature]

2-10-2020: Comment incorporated; question is SAT.

36  ? 2 x . x N E T1G2 010 (PZRPCS) K2.02 (bus power supplies to controller for PZR spray valve) 10-28-19 Replaced K/A because with multiple DCS racks and power supplies knowledge is minutia and not operationally valid to know from memory. Replaced with K2.03.

SAMPLE QUESTION RECD 11/7/19 T2G1 010 (PZRPCS) K2.03 (bus power supplies to PORV position indicator)

1. Partial: Choice B is also correct because the term alternate indication is vague; an applicant can successfully argue that there is no alternate red/green PORV light indication in the main control room. Consider making this a 4 part question where each power supply is plausible, or re-working the 2nd part of the question to test which instrument triggers the PORV position alarm in the main control room, etc.

2. Stem Focus: The first two bullets in the stem are not necessary.

3. LOK: The Cognitive Level field on Form ES-401-5, Question Worksheet, indicates this item is Higher Cog even though it solely tests the power supply and acoustic/tail pipe temperature availability.

36 F 3 N S T2G1 010 (PZRPCS) K2.03 (bus power supplies to indicator for PORV position)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 37 H 3 B S T2G1 012 (RPS) A1.01 (predict/monitor changes in trip setpoint adjustment (to prevent exceeding design limits) associated with operating the RPS controls) 38 F 2 x N E T2G1 013 (ESFAS) K3.01 (effect that a loss/malfunction of ESFAS will have on fuel)

S

1. Stem Focus: The 2nd bullet is not necessary for the 1st fill-in-the-blank statement because the 1st fill-in-the-blank statement is only asking whether LCO 3.5.2 is applicable in Mode 3.

Suggest re-wording as follows, to address Comment #1 and to enhance the stem in other ways.:

Unit 1 is in MODE 3 preparing for a startup.

WOOTF completes both statements?

Tech Spec LCO 3.5.2, ECCS-Operating, _______ applicable for this plant condition.

LCO 3.5.2 helps to ensure that the highest fuel cladding temperature following a LOCA will not exceed ______ . .

2-10-2020: Comment incorporated; question is SAT.

39 H 3 B S T2G1 022 (Containment Clg System) A1.03 (predict/monitor changes in containment humidity - to prevent exceeding design limits- associated with operating the CCS controls)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 40 H 2 x N E T2G1 022 (Containment Clg Sys) G2.1.25 (interpret reference S materials such as graphs, curves, tables, etc.)

1. Stem Focus: Suggest providing ECA-1.1, Step 9 (whole page 7 of 71) as a REFRENCE for this test item, instead of having only the chart pasted in the stem. It is a Reference. Suggest modifying the stem to include [REFERENCE PROVIDED].

2. Stem Focus: The last bullet in the stem is vague (step to secure containment spray pump is being evaluation); suggest re-writing this bullet to say:

The crew is implementing Step 9:

3. Stem Focus: the 2nd bullet should be modified to include the word automatically, i.e.,

Phase B automatically actuated.

4. Stem Focus: The fill-in-the-blank statement should be changed from will be to are required to be.

5. Stem Focus: The annunciator locations are missing from the stem; we should be consistent with the other test items. For example, STM GEN LEVEL ADVERSE SETPOINT should include M3-C, E-2.

2-10-2020: Comments incorporated; question is SAT. However, ES-401-5 not updated to specify exactly what reference is going to be in the applicant reference packet - - needs to be specific as to procedure, page, etc. (ECA-1.1, Step 9 (whole page 7 of 71) 2-13-2020: ES-401-5 updated.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 41 F 2 x x B U T2G1 025 (Ice Condenser) K6.01 (effect of a loss or malfunction of the upper and lower doors will have on the ice condenser system)

S

1. Cred Dist: The stem deals with normal operations; therefore, Choices A and C are not plausible for the following reasons.

Choice A (inlet doors closed to prevent overcooling lower containment during normal ops) is not plausible because the containment is not in jeopardy of being too cool during normal operations. The containment has to be cooled during normal operations.

Choice C (inlet doors closed to prevent freezing of melted ice on the floor) is not plausible because the containment floor doesnt have ice on it during normal ops.

2. Partial: Choice D is also correct; this test item vulnerable to post-exam appeals because the TS Bases says that air leakage is one reason doors maintained closed during normal ops:

3. Partial: To ensure test item is bullet-proof to post-exam appeals, include the phrase IAW the bases for TS 3.6.13, Ice Condenser Door In the stem question.

2-10-2020: Changes not incorporated.

2-13-2020: Received re-worked question with different distracters; question is SAT.

42 H 2 x B E T2G1 026 (Containment Spray System) A4.01 (manually operate and/or monitor CSS controls in the control room).

S

1. Partial: The proposed test item is vulnerable to post-exam appeals because the stem is not constrained to ES-1.3, Transfer to RHR Containment Sump. Suggest including a bullet in the stem and also including the phrase in accordance with ES-1.3 at the end of the stem question.

2-10-2020: Comment incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 43 H 3 x x x B E T2G1 039 (Main & Reheat Steam) A3.02 (monitor auto-operation of the MRSS including isolation of the MRSS)

S

1. Stem Focus/Partial: The fill-in-the-blank statements refer to a past-tense (i.e., occurred) point in the stem, which could confuse the applicants. Suggest incorporating a timeline in the stem and ask the applicants At Time XYZ, an auto SI or MSLI has/ has not occurred.

2. Cue: The 4th bullet phrase all required actions have been taken for the cooldown is not necessary to elicit the correct response. Suggest modifying the first bullet to say:

A plant cooldown is in progress on Unit 2 IAW 0-GO-7, Unit Shutdown From Hot Standby to Cold Shutdown.

The following conditions existed at 08:00 while performing Step 11 to initiate the RCS pressure reduction..

RCS Pressure 1850 psig RCS Temperature 505F Subsequently, an event occurred and the following conditions currently exist at Time 08:15

3. The initial plant condition with RCS temperature at 505F and RCS Pressure at 1850 psig may not align with 0-GO-7 Steps [8]

and [11]. Suggest modifying the RCS Temperature to be ~

455F.

2-10-2020: Comments #2 and #3 incorporated; however, Comment

1. 1 not incorporated.

Partial: Which time (08:00 or 08:15) are the fill-in-the-blank statements referring to? Suggest asking at Time XYZ, an auto SI or MSLI has/not occurred.

Partial: An applicant can contend that Choice A is also correct answer because at 08:00 the crew is only performing Step 11, which implies that Step 12 (Block SI and SL Pressure Isol/SI) has not yet been performed. Suggest modifying the 08:00 bullet to say:

At 08:00 the following conditions were achieved in accordance with 0-GO-7:

2-13-2020: Comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 44 H 2 x x N E T2G1 059 (MFW) A4.08 (design features/interlocks that provide for FRV operation - on basis of SF/FF mismatch )

S

1. Cred Dist: The plausibility of the 2nd part of Choices A/C (an annunciator alarm is a consequence) is questionable because an annunciator alarm is not a consequence with any impact -

annunciators alarm all the time, the consequence is always the plant response - not an alarm.

See suggested revision below.

2. Stem Focus: The 1st fill-in-the-blank statement contains slang, i.e., will be done first. See suggested revision below.

To remedy both Comments, suggest the following:

WOOTF choices completes the statement for how the controllers are required to be transferred from MANUAL to AUTO, in accordance with 1-SO-98-1, DCS?

The ________ Controller is required to be transferred first; otherwise SG level will ______.

[MFW Reg Valve vs MFW Bypass Valve

[Rise vs Lower]

2-10-2020: Comments incorporated; however, Stem Focus: All of the bullets in the original version should be included. Im sorry if I confused you by only providing the stem question portion in the recommendation above.

Power level is necessary for the caution to be applicable.

Valve positions are good too.

2-13-2020: Comment incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 45 H 2 x B E T2G1 059 (MFW) G2.4.47 (diagnose and recognize trends in an accurate and timely manner utilizing the appropriate control room S

reference material)

1. Verify on a print that one sensing line feeds THREE transmitters. This test item may not be operationally valid.

2. Why doesnt DCS transfer the MFWP Controllers to Manual?

This test item may not be operationally valid.

3. Stem Focus: For the sake of exam consistency, insert the phrase the operator is required to.. into the 2nd fill-in-the-blank statement.

2-10-2020: Comment #3 not incorporated yet.

2-13-2020: Comment incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 46 H 2 x x B E T2G1 061 (AFW) K5.01 (operational implication of relationship between AFW flow and RCS heat transfer as it applies to AFW)

S

1. Partial: Choice C is also correct.

2. Stem Focus and/or Partial: The cause of the reactor trip is unknown - which could mislead or confuse the applicants.

Suggest saying that an I&C surveillance test caused an inadvertent reactor trip.

3. Stem Focus and/or Partial: The 2nd stem bullet could potentially confuse the applicants (just entered is subjective as to which step the crew is on); suggest telling the applicants that the crew has performed Step 2, CHECK Generator Circuit Bkr (GCB)

OPEN [M-1].

4. Stem Focus: The word approximately in the 6th bullet is not necessary - just say S/G pressures are 990 psig and slowly lowering.

5. Stem Focus: The last stem bullet may confuse the applicants - -

did the crew take any action since the reactor trip occurred?

2-10-2020: Comment#1 addressed by adding the word FIRST at the end of the stem question; however, suggest capitalizing and underlining the word FIRST.

Suggest revising the 2nd bullet to say The crew entered ES-0.1, Reactor Trip Response, and is performing Step 1.

2-13-2020: Comments#2 no longer applicable. All other comments addressed; question is SAT.

47 H 2 B S T2G1 061 (AFW) K6.02 (effect of a loss or malfunction of pumps will have on the AFW components)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 48 F 2 x x N E T2G1 062 (AC Elect Dist) K1.02 (physical connections and/or cause effect relationships between the AC Distribution System and EDGs)

S

1. #/units: The 1st part of Choices A/B should be 1D (not 1B) because only 1C and 1D Unit Boards feed the 1B-B SD Bd.

Typo? (Plausibility of 1B Unit Board is questionable).

2. Stem Focus: The last fill-in-the-blank statement ends with a question mark instead of a period. Suggest splitting out the fill-in-the-blank statements into two separate sentences. The 2nd fill-in-the-blank statement represents a subsequent event and should be worded as:

IF the Overcurrent 50 Relay actuates while the EDG is tied to the SD Board, THEN.xyz.

3. Stem Focus: The word for in the 1st fill-in-the-blank statement should be from, i.e.,

The 1B-B DG will be paralleled with the supply from 6.9 KV Unit Board ____ .

2-10-2020: Comments #2 and #3 addressed; however, Comment#1 not addressed; Generic Comment: In this question the format is different from the rest of the exam: The 1st stem item uses a comma to separate the procedure number and title (no quotation mark like rest of exam), and doesnt include a comma for the title of Section 8.3. Need to be consistent throughout exam whichever format is chosen.

2-13-2020: Comment #1 incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 49 H 2 x x B E T2G1 063 (DC Electrical Distribution) K1.03 (physical connections and/or cause effect relationship between DC Electrical Distribution S

System and battery charger and battery)

1. Cue: In Choice D, the word vital isnt capitalized like all the other choices, AND the phrase powered from an operating diesel is not necessary to elicit the correct response.

2. Stem Focus: In the 2nd stem bullet, suggest clarifying that ALL offsite power is lost to both units.

3. Stem Focus: The stem question can be worded more clearly as WOOTF identifies the status of the 125V Vital Boards?

2-10-2020: Comments incorporated; question is SAT.

50 F 2 B S T2G1 064 (EDG) K4.02 (EDG system design features and/or interlocks that provide for trips while operating - normal or emergency)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 51 F 2 x x B E T2G1 073 (Process Rad Monitor System) A2.02 (predict impacts of detector failure on the PRM System and use procedures to correct, S

control, mitigate)

1. Cues: The phrase less than 1 gpm in the 2nd stem bullet is not necessary to elicit the correct response. Suggest only saying due to low sample flow.

2. Stem Focus: It seems to flow better if the order of the fill-in-the-blank statements were swapped, e.g.,

Normally _______ of the rad monitors that provide input to this annunciator is/ are in service.

[only one vs both]

In accordance with the ARP, the operator is required to ______ .

[dispatch an operator to adjust sample flow vs ensure FCV-15-44 is closed]

3. Stem Focus: The plausibility of Choices C/D can be enhanced by included the #/unid of the isolation valve that could be misconstrued as having isolated, i.e., FCV-15-44. Also, suggest adding a 3rd stem bullet that says FCV-15-44 remained open.

4. Stem Focus: The 2nd fill-in-the-blank statement can be clearer (see above); i.e., the phrase associated with this alarm may be vague. Suggest saying that provide input to this annunicator.

2-10-2020: Comments incorporated; question is SAT.

52 H 2 S T2G1 076 (SWS) K2.04 (Bus power supplies to RBCCW)

1. There is a typo in the 2nd stem bullet, i.e., the word site is doubled.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 53 H 2 x x N E T2G1 076 (SWS) K3.07 (effect that a loss or malfunction of SWS will have on ESF loads)

S

1. Cred Dist: Choices A/B are subsets of each other (lack of cooling to EDG would cause bearing and jacket water temperatures to rise); therefore, an applicant can eliminate BOTH choices solely because there cant be two correct answers.

Suggest testing the applicants knowledge of; EDG 1B-B ________ have cooling.

[will vs will NOT]

[And add another element to the question associated with any of the SI actuations that occurred with ERCW.]

2. Stem Focus: The 2nd bullet contains the phrase not selected, which may be better described as ERCW Pump L-B Control Switch is in the XYZ position, etc.

3. Stem Focus: The 3rd bullet should mirror the unid title in the 2nd bullet; i.e., the 3rd bullet should be ERCW Pump M-B failed to auto-start. (instead of M-B Pump failed) 2-10-2020: Question re-worked to eliminate subset issue (Comment#1), Comments #2 and #3 incorporated; however, Choice A is the only choice that the EDG trips, which can be fixed by modifying Choices A and B to say:

A. 1B-B D/G will not auto-start.

B. 1-B-B D/G is required to be immediately stopped.

By changing Choice A, the phrase assuming NO operator action is taken has to be deleted. Suggest changing the stem question to say:

WOOTF describes the impact of this ERCW condition (if any) on 1B-B D/G?

2-13-2020: Comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 54 F 2 x B E T2G1 078 (Instrument Air) K4.03 (design features/interlocks that provide for securing of Service Air upon loss of cooling water)

S

1. Q=K/A: The proposed test item doesnt test the interlock for isolating service air. Lets discuss this K/A applicability to SQN.

PCV 33-4 auto-isolates SA header from CAS header on low Control Air pressure @ 88 psig. The loss of cooling water piece of the K/A is confusing. We may be able to test the cooling water supply to the service air compressors and the PCV-33-4 auto-isolation setpoint - which may be a closer hit on the K/A.

IF the proposed test item is used, then the following comments apply:

2. Stem Focus: The 2nd fill-in-the-blank statement is vague because it doesnt say cooling water to air compressor xyz, etc.

Suggest re-wording as:

The cooling water supply to the Auxiliary Air Compressor is

3. #/units: The annunciator location (M15-B, x-y) is missing.

2-10-2020: Comment #1 not applicable. Comments #2 and #3 incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 55 F 3 x x x N E T2G1 103 (Containment) A2.05 (predict impacts of emergency containment entry on the containment system and use procedures to S

correct, control, or mitigate the consequences of this operation)

1. Job-Link: An RO applicant can successfully contend that this question (whose authorization is required to waive Admin Level 1 protocol) is SRO knowledge.

2. Partial: There may be no correct answer to the proposed test item because an entry for a suspected small electrical fire is not a normally scheduled entry. P&L 3.1.A says only normally scheduled entries will be tracked as FME Level 1. Therefore, since a fire entry is not a normally scheduled entry, the containment is only a Level 2 FME Zone and NO ones permission is required.

In Modes 1-4, containment is a level 2 FME zone, but items will be tracked using NPG-SPP-06.5, Foreign Material Control as a level 1 FME zone during normally scheduled containment entries.[C.5]

3. Stem Focus: There is a typo in the stem question - whos vs whose.

4. Ensure no overlap with Q#72.

1/22/2020: K/A Changed to 103 (Containment) A2.04 (predict impacts of containment evacuation and use procedures to correct, control, or mitigate the consequences.

2-10-2020: See suggested enhancements below to remedy A2 K/A and Partial issues.

Given the following:

Unit 1 in Mode 6 Inadvertent dilution in progress Source Range count rate is rising.

WOOTF completes the statements below in accordance with SOURCE RANGE HIGH FLUX LEVEL AT SHUTDOWN (1-AR-M4-B)?

The EARLIEST time that containment evacuation is required is when SR counts first reach ______ times above background.

An audible alarm inside containment ______ occur when the annunciator alarms. [will vs will NOT]

2-18-2020: Comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 56 F 2 x x N E T2G2 001 (CRDS) A1.06 (predict and/or monitor changes in reactor power - to prevent exceeding design limits- associated with S

operating the CRDS controls)

1. Stem Focus: None of the information above the stem question is needed. For example, re-word the stem question as:

The UNIT 2 Power Range High Flux Rod Stop is _____ % on

________ power range channels.

[103 vs 105]

[1 / 4 vs 2 / 4]

2. Cred Dist: The plausibility of the 1st part of Choices A/B can be enhanced by using 105% instead of 100% - - Unit 1 Rod Stop is 105%.

2-10-2020: Comment #2 not addressed.

2-13-2020: 100% was plausible; licensee wanted to use the 103 vs 105 percent for future unit differences K/A. Added the word setpoint to the fill-in-the-blank statement. Question is SAT.

57 F 1.5 x B E T2G2 011 (PZRLC) K2.01 (bus power supplies to charging pumps)

S 1. LOD=1.5: The charging pumps are powered from 6.9 KV Shutdown Boards. The proposed test item will have no discriminatory value on the exam. Similar to Q#52.

2. Cred Dist: Choice A is not plausible because it is the only Choice not backed by a EDG.

2-10-2020: Comments addressed by testing control power to charging pump breakers. Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 58 x x N SAMPLE QUESTION RECD 11/7/19 T2G2 017 (In-Core Temp Monitor Sys) A2.02 (predict impacts of core damage and use procedures to correct, control, mitigate)

1. Cred Dist: The 2nd part of Choices B/D (Red Path entry requirement is 2200F) is not plausible because the 2200F value for CET temperature is not used in anywhere in the EOPs.

Consider re-working the question to test what CET temperatures/plant conditions at Step 21 indicate likely core damage, beyond which SAMGs would take over.

2. Cue: The fill-in-the-blank statement only includes the singular T/C, which cues an applicant that the answer is one. Suggest spelling out the word thermocouple(s).

58 F 2 N E T2G2 017 (In-Core Temp Monitor Sys) A2.02 (predict impacts of core damage and use procedures to correct, control, mitigate)

S Sample Question Comments resolved by replacing 2200F with 700F. However,

1. Suggest replacing the 1st part of the question with the following:

A RED PATH in Core Cooling requires at least ______

thermocouples greater than ______ F.

[four vs five]

[700 F vs 1200 F]

2-10-2020: Comment incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 59 H 2 x x N E T2G2 041 (Steam Dump/Turbine Bypass Control) K6.03 (effect of a loss or malfunction of controller and positioners, including ICS, SG, S

CRDS, will have on the steam dump system)

1. Cred Dist: Choice A (transfer to rx trip controller but valves dont open) is not plausible because this is the only choice where the steam dump valves dont open. Suggest making the question choices more uniform, for example:

WOOTF describes the Steam Dump System response?

Control of the steam dumps will ___________ .

A. Transfer to the Rx Trip Controller; however, the steam dump valves will NOT open.

B. Transfer to the Rx Trip Controller and the steam dump valves will open.

C. Remain on the Load Reject Controller; however, the steam dump valves will NOT open.

D. Remain on the Load Reject Controller and the steam dump valves will open.

2. Stem Focus: The 2nd stem bullet is clearer to the applicants if it says:

A Rx Trip Breaker failed to open (remains closed)

3. Stem Focus: The 3rd and 4th stem bullets are not necessary.

2-10-2020: Comments incorporated; question is SAT.

60 H 2 B S T2G2 045 (Main Turb Gen) A4.02 (manually operate and/or monitor TG controls, including breakers, in the control room)

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 61 H 2 x x B E T2G2 055 (Condenser Air Removal System) G2.4.1 (EOP entry conditions and immediate action steps)

S

1. Partial: This test item is vulnerable to post-exam appeals because Choice D is not 100% technically correct since AOP-S.02, Step 1.b RNO says to continue implementation of AOP-S.02; it does not say to GO TO.

Partial: Choice C is the only correct answer because AOP-S.02, Step 1.b RNO says to continue to implement AOP-S.02.

2. Overlap: Q#21 provides the title of AOP-S.06, which is only partly provided in this question (Choice D). These two test items deal with the same AOP-S.06. The entire title must be provided in Choice D.

3. Stem Focus: If Comments #1 and #2 are resolved, and this test item is used on the exam, then each of the Choices could potentially be refined as:

A. Enter AOP-C03, Rapid Shutdown or Load Reduction B. GO TO E-0, Reactor Trip or Safety Injection C. Remain in AOP-S.02 D. GO TO AOP-S.06, Turbine Trip Below P-9 (50% Power)

4. The Tier Field on Form ES-401-5 says this test item is Tier 1 even though it is Tier 2. (typo)

5. Stem Focus: The word correct in the stem question should be required.

2-11-2020: Question re-worked to 2x2 to test which vacuum instrument required to be monitored (per AOP-S02) and whether a manual turbine trip is/ is NOT require; however, Cred Dist: The plausibility of using the lower reading instrument is questionable; conservative decision making can solely be used to eliminate Choices A/B because the WR value is lower that the NR value. Suggest the following:

WOOTF completes the following statements IAW AOP-S.02?

When turbine load is less than 30%, the EARLIEST time a manual turbine trip is required is when condenser pressure first rises to ______.

When turbine load is greater than 30%, the EARLIEST time a manual reactor trip is required is when condenser pressure first rises to _____ .

Stem Focus: The re-worked 2x2 question doesnt include unid#s for the condenser vacuum instruments (WR & NR).

2-13-2020: Comment incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 62 F x x N E T2G2 056 (Condensate) K1.03 (physical connections and/or cause-effect relationships between Condensate and MFW)

S

1. Partial: The proposed test item is vulnerable to post-exam appeals because it does not include the word setpoint and because the word sustained is subjective.

The MFW Pump auto-trip setpoint for seal water is low _______

that lasts for 28 seconds.

2. Stem Focus: The stem does not include a question.

2-11-2020: Comment incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 63 F 2 x x x U T2G2 068 (Liquid RW) K5.04 (operational implication of bio hazards or radiation and the resulting goal of ALARA as they apply to Liquid S

RW System)

1. Cred Dist: The 2nd part of Choices B/D (no isolation occurs when hi rad alarm setpoint is reached) is not plausible because the system would never be designed to be non-conservative for liquid radioactive releases.

2. Partial: An applicant can successfully contend there is no correct answer because the fill-in-the-blank statement says at least 2 CCW Pumps are required even though 0-SO-77-1, P&L 3.1.a states that 2 CCW pumps is MORE than the minimum.

3. Stem Focus: The stem is missing a question.

Suggest the following to remedy all Comments above.

WOOTF completes the following statements IAW 0-SO-77-1, Waste Disposal System (Liquid)?

The minimum required dilution flow for radioactive liquid releases is _________ gpm.

[10,000 vs 17,000]

IF a total of two CCW Pumps are running at the site, THEN the minimum required dilution flow for radioactive liquid releases

____ met.

[is vs is NOT]

2-11-2020: Comments incorporated; question is SAT. The stem question should be plural with respect to TWO fill-in-the-blank statements (typo).

2-13-2020: Comment incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 64 H 3 B S T2G2 072 (Area Rad Monitoring) A3.01 (monitor auto-operation of the ARM system, including changes in ventilation alignment)

E 2-11-2020: Overlap with Q#22.

2-18-2020: Cred Dist: 2nd part of Choices B/D (negative pressure) is not plausible because radiation would be drawn into control room.

Suggest re-working question to test whether 0-RE-90-205 and -206 auto-initiate a control room isolation signal.

65 F 2 x N E T2G2 086 (Fire Protection) K3.01 (effect that a loss or malfunction of the Fire Protection System will have on shutdown capability with S

redundant equipment)

1. The K/A Match Field on Form ES-401-5 is blank; there needs to be an explanation of how the test item is hitting the K/A. The proposed test item is written to test the applicants knowledge of which component is required to be aligned to HPFP water for its cooling, which may be another way of saying if HPFP is lost, then cooling to which component is lost.

2. Stem Focus: Suggest re-wording the stem as:

In accordance with an appendix in AOP-M.01, Loss of ERCW, guidance is provided to align High Pressure Fire Protection water to a __________ for its cooling.

2-11-2020; Comment incorporated; question is SAT. K/A Match Field on Form ES-401-5 is blank; there needs to be an explanation of how the item is hitting the K/A.

2-13-2020: SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 66 F 2 x x N E T3 G2.1.29 (how to conduct system lineups, such as valves, breakers, switches, etc.)

S

1. Partial: Choices B & C can also be correct if the containment raceway and west valve vault room are high rad or highly contaminated areas.

2. Stem Focus: Suggest re-wording the question as:

WOOTF is an allowable reason to waive the required periodic verification of a locked valve IAW OPDP-6, Locked Valve/Breaker Program?

A. Valve is inside a clearance boundary and the systems status control is NOT being maintained.

B. Partially correct, see Comment #1 C. Partially correct, see Comment #1, suggest eliminating the name of the room and just say a heat stress area where stay time is < 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />.

D. Valve is located inside a locked area and access to the area has not occurred since the last verification.

2-11-2020: The proposed stem question uses the word acceptable, and Choice D doesnt include the word last. Also need to delete the phrase West Valve Vault Room in Choice B. Suggest the following:

WOOTF identifies when a required periodic verification of a locked valve may be waived in accordance with OPDP-6, Locked Valve/Breaker Program?

A. Valve located in containment raceway during normal operations.

B. Valve located in an area where the heat stress stay time is

< 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />.

C. Valve inside a clearance boundary and the systems status control is NOT being maintained.

D. Valve located within a locked area and access to the area has not occurred since the last verification 2-18-2020: Comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 67 F 3 x N E T3 G2.1.34 (primary and secondary chemistry limits)

S 1. Stem Focus: The stem question should include the Tech Spec

1. and title, for example:

IAW Tech Spec 3.4.16, RCS Specific Activity, WOOTF

2. Ensure no overlap with Q#24.

2-11-2020: Comment incorporated, question is SAT.

68 F 1 x B U T3 G2.1.37 (procedures, guidelines, or limitations associated with reactivity management)

S

1. LOD=1: This test item will provide no discriminatory value on the exam. Choice A is ALWAYs the right answer for a reactor operator.

Suggest writing a question to test requirements for exceeding core thermal power limits during steady state operation, startup procedure requirements for control room staffing during a startup, guidance when approaching the ECC/ECP window limit, etc.

2. Cred Dist: Choice B is not plausible because of the word personally. Choice C is not plausible because a Unit Operator is not responsible for reviewing Reactor Engineering work.

2-11-2020:

Stem Focus: Wording of the proposed replacement question needs improvement; the Choices are not parallel - - e.g.,

Choices C/D say the same thing and Choices A/B say the same thing; and the word license needs to be licensed. .

Partial: Concerned that the 1st part of Choices A/B is also correct because OPDP-1 says secondary-side oscillations are unintentional and do not result in a violation of the license thermal power limit during steady-state conditions.

Need to see the daily surveillance procedure words (not provided in ES-401-5) that that says where licensed thermal power limit is based on 8 hour9.259259e-5 days <br />0.00222 hours <br />1.322751e-5 weeks <br />3.044e-6 months <br /> average.

2-18-2020: Question wording re-worked to test whether average thermal power limit can / can NOT be exceeded due to secondary side valve oscillations.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 69 F 2 x B U T3 G2.2.20 (process for managing troubleshooting)

S 1. Cred Dist: Choice A (SM can authorize a totally different fuse) is not plausible because this is a plant modification that could be dangerous. In the context of OPDP-7, Fuse Control, this would never be a correct answer.

2. Cred Dist: Choice B (Ops can replace 2FCV-1-25 blown fuse) is not plausible because a work request will be initiated - Ops wouldnt try to go replace a blown fuse without generating a work request. Maintenance would be involved with the fuse replacement.

Troubleshooting includes MOV operating/starting limitations and resetting tripped breakers; suggest replacing this question with a bank question that tests either one (or both) of these troubleshooting topics.

2-11-2020: Comments not incorporated.

2-13-2020: Replaced K/A because RO involvement in managing troubleshooting activities is limited such that a discriminatory question cannot be written. Randomly selected G2.2.2 (Ability to manipulate the console controls as required to operate the facility between shutdown and designated power levels.

2-18-2020: Bank question used to test generic requirement for squirrel cage induction motor start limitations. Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 70 F 2 x N E T3 G2.2.26 (analyze the effect of maintenance activities, such as degraded power sources, on the status of LCOs)

S

1. Q=K/A: The proposed test item doesnt seem to directly or indirectly test a generic plant-wide topic - the test item seems to be specific to the PZR PORV LCO only.

ES-401, Section D.2.a states: Ensure that the questions selected for Tier 3 maintain their focus on plantwide generic K/As and do not become an extension of Tier 2.

Is there a generic aspect thats being tested in the proposed test item?

One of the ways to test the effect of maintenance activities involving degraded power sources on LCOs could be to test LCO 3.0.6; however, I would not be comfortable testing an RO on LCO 3.0.6. We may need to replace this K/A.

Date: K/A replaced with G2.2.32, Knowledge of LCOs and safety limits.

2-11-2020: New question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 71 H 2 B E T3 G2.3.11 (Rad Control - Ability to control rad releases)

S 1. Overlap: This test item overlaps with S3E7 - - the crew will get a SGTR and see that the 90-99/119 monitor is the first rad monitor to alarm, and also will initiate SI.

Consider something like testing how many designated points are there at the site where radioactivity can be released to the atmosphere in gaseous discharges, or testing the ODCM limit for noble gas release rates at or beyond the site boundary.

2-11-2020:

Partial: Re-word stem question to also include number/name of the specific procedure section being tested, e.g.,

In accordance with 0-SO-77-1, Waste Disposal System, Section 6.2, Monitor Tank Recirculation and Release, what is the minimum required recirculation time?

Generic Comment: In this question the format is different from the rest of the exam: The stem question doesnt include a comma or a quotation mark to separate the procedure number and title Need to be consistent throughout exam whichever format is chosen.

2-13-2020: Comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 72 F 2 x N U T3 G2.3.12 (radiological safety principles pertaining to licensed operator duties, such as containment entry requirements, fuel S

handling responsibilities, access to locked-high radiation areas, aligning filters, etc.)

1. Cred Dist: The 2nd part of Choices A/C (incore flux detector tagout is for equipment safety) is not plausible because the stem says a containment entry is being performed and radiation is always the personnel concern during containment entries.

2. Ensure no overlap with Q#55.

2-11-2020: 2nd part of question replaced with whether the breach annunciator is/ is NOT an expected alarm for the lower containment entry.

Stem Focus and/or Partial: The 2nd fill-in-the-blank statement refers to a normal containment entry, which may or may not align with the premise in the stem of the question. Suggest including a reason (normal reason) in the 1st bullet and delete the phrase during a normal containment entry from the 2nd fill-in-the-blank statement.

Cue: The last part of the 2nd bullet (and the system is TAGGED) leads the applicant that 10 feet of the bottom of the core must indeed be an approved storage location; otherwise it would never be an approved place to TAG something. Suggest deleting the phrase from the 2nd bullet and revising the 1st fill-in-the-blank statement to say:

The incore flux detectors ____ in an approved storage location to be tagged.

2-13-2020: Comment incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 73 F 1 B U T3 G2.4.17 (knowledge of EOP terms and definitions)

S 1. Q=K/A: The proposed test item doesnt test any generic EOP terms or definitions; the proposed test item seems to be testing G2.4.8, Knowledge of how AOPs are used in conjunction with EOPs even though this question is assigned to G2.4.17.

2. LOD=1: This test item will provide no discriminatory value on the exam.

3. Cred Dist: Choice A (AOPs can never be used when EOPs are implemented) is not plausible because there will always be situations like a loss of instrument air, service water, etc. that require an AOP to be implemented concurrently with an EOP.

4. Cue: Q#77 cues the applicant that EOPs and AOPs are used concurrently.

2-11-2020:

Cred Dist: The plausibility of the 1st part of Choices C/D is weak. Suggest changing the 1st part of the question to be:

One of the verbs used to visually identify a Continuous Action Step is ________ . [MONITOR vs ENSURE]

To mirror the glossary definition of CHECK, suggest changing the 2nd fill-in-the-blank statement and choices to be:

Equipment or control devices _____ be manipulated when performing at step with the word CHECK.

[must vs should NOT]

2-13-2020: Comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 74 H 2 x x B E T3 G2.4.22 (knowledge of bases for prioritizing safety functions during abnormal/emergency operations)

1. Cred Dist: The interplay between the 1st and 2nd part of Choice C (Heat Sink lower priority than PTS because heat sink must exist before PTS can occur) makes Choice C not plausible.

2. Cred Dist: The plausibility of Choice B (Heat Sink higher priority than PTS because heat sink must exist before PTS can occur) is questionable because PTS can occur with high reactor pressure and low temperature due to a steam line break.

3. Partial: This question is vulnerable to post-exam appeals because the basis documents dont contain the reasons by one CSF is prioritized higher than PTS. Also, the basis document is missing from the stem question - it may be EPM-3-FR-0, Basis Document for FR-0.

Suggest the following:

WOOTF completes both statements in accordance with EPM-4, Users Guide?

If a RED or ORANGE priority condition comes in and clears, the FRG ________ . performed.

[does not need to be vs must be]

FR-C.2, Degraded Core Cooling, includes steps for depressurizing intact S/Gs which may cause a red path on the Pressurized Thermal Shock status tree. In this case _______

has priority.

[FR-C.2 vs FR-P.1]

2-11-2020: Comment incorporated; to test what question is asking, a sentence is needed at the beginning of the question that says:

The crew has reached a point in the EOPs where FRPs are being monitored and implemented when required.

This provides necessary focus on the first part of the question.

Also, there is a typo in the stem question (should be which one, not which on).

2-13-2020: Comment incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 75 F 2 x N U T3 G2.4.49 (perform without reference to procedures those actions that require immediate operation of system components and S

controls.)

1. Cred Dist: The 1st part of Choices A/B (prudent actions can be done before immediate actions) is not plausible because the word immediate is more important than the word prudent.

Suggest something like this:

WOOTF procedures contains an immediate operator action?

A. AOP-M.02, Loss of Control Air B. ECA-0.0, Loss of All AC Power C. AOP-C.02, Uncontrolled RCS Boron Concentration Changes D. FR-C.1, Inadequate Core Cooling 2-11-2020: Comment incorporated; question is SAT.

76  ? 3 x N SAMPLE QUESTION RECD 11/7/19 T1G1 009 (SBLOCA) EA2.11 (determine/interpret cnmt temp, press, and humidity as they apply to procedure)

1. Stem Focus: Suggest clarifications to the fill-in-the-blank statement as follows:

Tech Spec LCO 3.6.4, Containment Pressure, ____ applicable.

In accordance with LCO 3.6.4 Bases, a ________ is the bounding event for the peak containment pressure.

[SLB vs LOCA]

2. LOK: The Cognitive Level field on Form ES-401-5, Question Worksheet, is missing.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 76 F 2 x N E Sample question comments partially incorporated.

S T1G1 009 (SBLOCA) EA2.11 (determine/interpret cnmt temp, press, and humidity as they apply to procedure)

1. Partial: In order to make the test item bullet proof to post exam appeals, the wording of the 2nd fill-in-the-blank statement should more closely mirror the Tech Spec Bases wording. The proposed wording is missing important words like DBA, worst case, bounds, etc. See below.

To make the question bullet-proof to post exam appeals, suggest keeping my suggestion for the 2nd fill-in-the-blank statement wording:

In accordance with LCO 3.6.4 Bases, a ________ is the bounding event for the peak containment pressure.

[SLB vs LOCA]

2-12-2020: Comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 77 H 2 x x M E T1G1 022 (Loss of Reactor Coolant Makeup) AA2.01 (determine/interpret whether charging line leak exists as it applies to S

procedure)

1. Cue: The first fill-in-the-blank statement tells the applicants a LEAK exists, which is also the correct answer to the 2nd part of the question.

2. Stem Focus: The stem is missing what procedure the crew entered to control/stabilize PZR level, align CCP to RWST, and the reason why the manual reactor trip was initiated.

To remedy both Comments, suggest re-working the question to tell the applicants in the stem that the crew adjusted charging flow to stabilize PZR level AND also aligned CCP to RWST in accordance with AOP-R.05.

Tell the applicants the reason why the reactor was manually scrammed was because of the inability to stop the boration, which aligns with AOP-R.05, Step 4 RNO, and provides plausibility for whether AOP-C.02 is/ is NOT required to be implemented concurrently with ES-0.1.

For example, Subsequently, The crew entered AOP-R.05, RCS Leak and performed the following actions:

Adjusted charging flow to stabilize PZR level (Step 2)

Aligned CCP suction to the RWST to maintain VCT level (Step 4)

Manually tripped the reactor due to the inability to stop the boration (Step 4 RNO)

WOOTF completes both statements?

Leak is located ______.........

IAW AOP-R.05, the Unit SRO _______ required to implement AOP-C.02, Uncontrolled RCS Boron Concentration Changes, concurrently with ES-0.1, Reactor Trip Response.

[is vs is NOT]

3. Cue: This question cues the applicants to RO Q#73 - that AOPs are used concurrently with EOPs.

2-12-2020: Comments incorporated, no overlap with different RO Q#73; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 78 H 2 x x N E T1G1 025 (Loss of RHR) AG2.1.19 (use plant computer to evaluate system or component status)

1. Q=K/A: The 2nd part of the question is the SRO part, which is not associated with the K/A (use of computer). The SRO part of the question should be somehow related to the computer screenshot. If you cover the picture up with your hand, the 2nd part of the question can be answered solely based on a total loss of CCS to A and B RHR HXs.

2. Partial: Choice C is also correct because the AOP-R.03 Step 6 RNO says REFER TO AOP-M.03; an applicant can argue that AOP-R.03 Step 6 RNO is directing them to GO TO AOP-M.03 (i.e., Choice C). Its too close.

3. IF we end up using this screenshot, we need to provide the entire computer screenshot, not just one portion of the screen, as a REFERENCE for the question.

2-18-2020: ES-401-5 doesnt identify the reference being provided to the applicants. Other minor enhancements to question needed.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 79 H 2 x N U T1G1 027 (PZRPC Malfunction) AA2.17 (determine/interpret allowable RCS temperature difference vs. reactor power as it applies to procedure)

1. SRO-only: The proposed test item tests the OPT trip setpoint and the basis for the OPT RPS Trip Function, which are both RO knowledges.

Suggest replacing this question with another question that tests whether AOP-I.04, Attachment 5 (Removing Channel I PZR Press Inst Loop P-68-340 From Service - Without OTT Impact) is vs is NOT required, and/or a Tech Spec required action.

2-12-2020: Looks good. The 1st part of the question was changed to test whether AOP-I.04, Attachment 1 is/ is not required to be implemented; however, S1E2 has same instrument failure, suggest using a different PZR instrument.

Editorial only: The 1st fill-in-the-blank statement choices should be is/ is NOT required to.

The Unit Supervisor ____ required to perform Attachment 1, Removing Channel I Pzr Press Instrument P-68-340 from Service (Including Channel I OTT Bistables).

[is vs is NOT]

Editorial only: The 2nd fill-in-the-blank statement can be worded more clearly about referring to the Bases, and Generic Comment: In this question the format is different from the rest of the exam: The 2nd fill-in-the-blank statement doesnt include commas or quotation marks to separate the Tech Spec number and title Need to be consistent throughout exam whichever format is chosen.

For Example:

In accordance with the Basis for Tech Spec 3.3.1, Reactor Trip Instrumentation, the Overtemperature (OT) T trip Function ensures the _____ .

2-18-2020: We may have drifted away from the K/A; or need to update ES-401-5 for why K/A is met (not just why SRO-only).

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 80 H 2 x x x B E T1G1 038 (SGTR) EG2.4.6 (EOP mitigation strategies)

S 1. Cue and/or SRO-only: The 5th bullet (bolded, underlined, use of the words quickest possible and management) wording is not necessary to elicit the correct response. The 5th bullet may also put the question into the realm of RO systems knowledge with respect to cooldown capacities of blowdown vs steam dumps, etc.

Suggest deleting the 5th bullet and revising the stem question as:

Given these conditions, WOOTF identifies the procedure which is required to perform the post-SGTR cooldown/depressurization, and will allow RHR conditions to be established in the least amount of time?

2. Stem Focus: The 1st stem bullet can be better worded as:

A tube rupture has occurred in SG#1.

2-12-2020: Comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 81 H 2 x x B E T1G1 057 (Loss of Vital AC Instrument Bus) AA2.04 (determine/interpret ESF System Panel alarm annunciators and S

channel status indicators as they apply to procedure)

1. Partial: This test item is vulnerable to post-exam appeals because an applicant can successfully contend there is no correct answer to the 2nd part of the question since Mode 3 entry IS NOT required. The premise of the 2nd part of the question appeared to be that IF (for some reason?) Required Action B.1 was not completed within 8 hours9.259259e-5 days <br />0.00222 hours <br />1.322751e-5 weeks <br />3.044e-6 months <br />, THEN when would Unit 1 be required to enter Mode 3; however, the stem and stem question do not include the premise. Therefore, the test item is vulnerable to post-exam appeals.

2. Stem Focus: The 2nd fill-in-the-blank statement should include the Tech Spec number and title.

3. Direct-Lookup: The 2nd part of the question is a direct lookup because the applicant will be provided T.S. 3.8.9 and only be required to add the times between Action B.1 (8 hours9.259259e-5 days <br />0.00222 hours <br />1.322751e-5 weeks <br />3.044e-6 months <br />) and Action G (6 hours6.944444e-5 days <br />0.00167 hours <br />9.920635e-6 weeks <br />2.283e-6 months <br />) to reach the correct answer - little mental activity.

Suggest including something else in the stem (besides the Unit 2 event) that could be misconstrued as requiring T.S. 3.0.3 entry on Unit 1 and change the 2nd part of the question to test whether T.S. 3.0.3 is / is not required to be entered on Unit 1.

4. Stem Focus: The stem layout may confuse the applicants because the 0800 and 1000 items could be misinterpreted as being somehow related - these two events are unrelated, and dont matter for the answer to the 2nd fill-in-the-blank statement.

5. The Form ES-401-5 Distracter Analysis for Choice A is wrong -

it says that Action A is required even though Action B.1 is required.

2-12-2020: Suggest modifying the 2nd fill-in-the-blank statement (to address Comment#1 above) as:

IF no repairs are completed, THEN the EARLIEST time Unit 1 is required to be in Mode 3 is ____ .

2-18-2020: Comment incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 82 H 2 x N E T1G2 005 (Inop/Stuck Rod) AA2.04 (interpret core TC map for dropped rod location) 10-28-19 Replaced K/A because unable to write discriminating question on TC because temperatures always go down in dropped rod quadrant.

SAMPLE QUESTION RECD 11/7/19 T1G2 005 (Inop/Stuck Rod) AA2.03 (determine/interpret required actions if more than one rod is stuck or inop as it applies to procedure)

1. Partial: An applicant can successfully argue that Choice D (Rods D4 & D12 not operable) is also correct because the stem doesnt include information related to whether the rods are stuck control rod, i.e., not trippable. This test item is vulnerable to post-exam appeals.

Consider re-working the question to test the earliest time that the unit must be placed in Mode 3 and whether Appendix C, Reactor Shutdown Following Dropped or Misaligned Rod, is/ is NOT allowed to be used to perform the shutdown.

According to Appendix C, the only time the appendix is allowed to be used is when AFW is supplying the SGs, which is about less than or equal to 3% power.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 82 H 2 x N E Sample question comment not addressed because 1st part of proposed test item is still vulnerable to post-exam appeals; see Comment #1 below.

T1G2 005 (Inop/Stuck Rod) AA2.03 (determine/interpret required actions if more than one rod is stuck or inop as it applies to procedure)

1. Partial: An applicant can successfully argue that Choice D (Rods D4 & D12 not trippable) is also correct because the stem doesnt include information related to why the rods stopped moving inward. Therefore, an applicant can successfully contest that the rods are not trippable, i.e., an applicant can successfully contest the rods are STUCK. This test item is vulnerable to post-exam appeals.

See Suggested remedy above in Sample Question response row.

2. Stem Focus: The 1st fill-in-the-blank statement contains the word basis in a confusing location (after the title of LCO 3.1.4).

Consider re-wording the 1st fill-in-the-blank statement to include commas around the title and move the word bases, for example:

IAW the bases for LCO 3.1.4, Rod Group Alignment, control rods 2-18-2020: Need to discuss distracter analysis.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 83 H 2 x x N E T1G2 033 (Loss of IRNI) AG2.2.4 (multi-unit license - ability to explain variations in control board layout, systems, between units S

at a facility) 3-11-19: Replaced K/A because no system or procedural difference between U1 and U2.

T1G2 033 (Loss of IRNI) AG2.2.36 (analyze effect of maintenance activities, such as degraded power sources, on the status of LCOs)

1. The Proposed References Field on Form ES-401-5 did not indicate which pages of Tech Spec 3.3.1 are being provided to the applicants, and whether the setpoints/allowable values are being removed/redacted, etc.

2. Partial: Choice D (2 hours2.314815e-5 days <br />5.555556e-4 hours <br />3.306878e-6 weeks <br />7.61e-7 months <br /> after N-36 failed) can also be argued as correct because the stem question does not specify the EARLIEST time Unit 1 is required to have thermal power < P-6.

3. Stem Focus: The phrase to perform repairs is not necessary in the 0800 Oct 29 entry.

2-12-2020: Comments #2 and #3 incorporated; question is SAT.

However, Comment#1 not addressed because Form ES-401-5 does not include the page numbers of Tech Spec 3.3.1 being provided to the applicants.

Also, the list of Rejected K/As has a typo. This K/A is T1G2 and the Form ES-401-4 says T1G1.

2-18-2020: Comments incorporated, ES-401-4 repaired; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 84 H 2 x N U T1G2 WE01 (Rediagnosis) EA2.1 (interrelations between the procedure and facility conditions and selection of appropriate procedures during abnormal and emergency operations)

1. SRO-only: RO knowledge of PLANT parameters that require direct entry into major EOPs can be used to determine the correct answer, i.e., all S/G pressures lowering uncontrollably and MSIVs open requires entry to E-2, Faulted SG.

ES-401, Attachment 2, Section E states that SRO-only knowledge should not be claimed for questions that can be answered solely using fundamental knowledge of plant parameters that require direct entry into major EOPs (e.g., major Westinghouse EOPs are E0, E1, E2, E3, and Red/Orange FRPs).

Suggest testing whether or not ES-0.0 Rediagnosis is allowed to be used if no SI has occurred, including the basis IAW EPM-?.

Another item to consider is testing one of the other procedures (not major EOPs) directed from ES-0.0.

2. Stem Focus: For the sake of exam consistency, replace the word will transition to with is required to in the fill-in-the-blank statement.

1-22-2020: KA replaced with 067 (Plant Fire OnSite) AA2.15 Requirements for Establishing Fire Watches 2-12-2020:

The stem question asks for the REASON for establishing a continuous fire watch even though the Choices identify the time requirements.

Choice D is not plausible because it is the only choice w/o a time requirement.

The words to patrol the area are not necessary in each choice.

The phrase allowing early detection and reporting of a fire in Choices B/C are not necessary.

Suggest the following:

WOOTF completes the following statement IAW the SQN Fire Protection Report Part II - Fire Protection Plan?

A continuous fire watch requires that a trained individual be in the specified area at _______, and that each compartment in the specified area be patrolled at least once ________.

A. all times; every 15 minutes B. least every 15 minutes; every 5 minutes C. all times; every 5 minutes D. least every 30 minutes; every 15 minutes 2-18-2020: Correct answer should be Choice B.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 85 F 2 x x x B E T1G2 WE07 (Saturated Core Cooling) EG2.1.32 (explain and apply system limits and precautions)

S

1. Cred Dist: Choice A (re-enter FR-C.3) is not plausible because the stem says FR-C.3, Step 2.a is already in effect - an applicant can successfully eliminate Choice A solely based on this choice not making sense because re-entering would be a waste of time since already in procedure.

2. Cred Dist: The plausibility of Choice D (stay in FR-C.3) is questionable because it is virtually the same action as Choice A

- an applicant can successfully eliminate Choice D because it is a subset of Choice and there can only be one correct answer to each question.

3. Stem Focus; The first part of each Choice should be clear with respect to whether FR-C.3 is exited or implementation continues without exiting.

4. Partial: The phrase in accordance with EPM-X should be included in the stem question to preclude post-exam appeals.

Suggest the following to remedy all three comments:

WOOTF completes both statements in accordance with EPM 3-FR-C.3, Basis Document for FR-C.3?

FR-C.3 ___________ if ECA-3.2, SGTR With Loss of Reactor Coolant- Saturated Recovery Desired, is in progress.

[must be performed first vs is not allowed to be used]

FR-C.3, Step 5: CHECK RCS Inventory Loss Paths _________

leaving one block valve open.

[allows vs does not allow leaving one block valve open]

2-12-2020: The stem focus is weak and disjointed for the applicants; suggest the following:

WOOTF completes both statements in accordance with FR-C.3, Saturated Core Cooling?

IF ECA-3.2, SGTR With Loss of Reactor Coolant-Saturated Recovery Desired, is in progress, THEN FR-C.3 ________ be performed.

[must vs. is not required]

At FR-C.3, Step 5 (CHECK RCS Inventory Loss Paths) ________

[all block valves are required to be closed vs. at least one block valve is required to be open]

2-18-2020: Comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 86 F 2 x x N SAMPLE QUESTION RECD 11/7/19 T2G1 003 (RCPs) G2.4.18 (specific bases for EOPs)

1. SRO-only: Both parts of the proposed test item are associated with RO knowledge of the overall mitigative strategy of the procedure. Form ES-401-5, Written Exam Worksheet, did not identify which 10CFR55.43 (b) item the proposed question is linked to.

Three additional Chief Examiner opinions obtained and they thought question was SRO knowledge for testing bases knowledge and 10CFR55.43(b) (5) procedure selection was involved regarding future use aspect of stopping the RCPs.

2. Partial: Choice B may also be correct because the fill-in-the-blank statement does not include in accordance with EPM FR-C.2, Basis Document for FR-C.2.

86 F 2 N S T2G1 003 (RCPs) G2.4.18 (specific bases for EOPs)

Comment #2 incorporated.

87 H 2 x B U T2G1 012 (RPS) A2.07 (predict impacts of loss of DC control power on RPS and use procedures to correct, control, mitigate)

S

1. Q=K/A: The proposed test item does not test the RPS topic because it only tests 6900V SD BD control power loss on ECCS.

Since Tech Spec 3.3.1 may be provided as a reference for Question #83, suggest using a test item that tests Function 17 or 18 when the DC is lost to a Rx. Trip Breaker, etc.

2-12-2020: Question replaced with bank question to test Tech Spec 3.3.1 Function 17/18 for reactor trip assembly operability. However,

1. /units: In the 1st fill-in-the-blank statement, the acronym RTA should be spelled out first before the acronym, and the control board panel # and light indication name should be included.

In the 2nd fill-in-the blank statement, the 2nd part of Choices A/D should be REMAINS.

2-18-2020: Comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 88  ? 2 x  ? SAMPLE QUESTION RECD 11/7/19 T2G1 013 (ESFAS) A2.03 (predict impacts of rapid depressurization on ESFAS and use procedures to correct, control, mitigate)

1. Stem Focus: The 1st fill-in-the-blank statement may confuse the applicants; suggest modifying the 1st fill-in-the-blank statement to straight out ask Given these conditions the MSIVs _______ auto-close.

[will vs will not]

2. Stem Focus: Suggest inserting the word manually in the 2nd bullet, i.e., RX was manually tripped.

3. Stem Focus: Suggest adding the word Steps in the 5th stem bullet, i.e., After IOA Steps are completed, the OATC reports:

(misspelled acronym).

4. Source: The Question Source field on Form ES-401-5, Question Worksheet, indicates this test item is new 2003.

What does new 2003 mean?

5. LOK: The Cognitive Level field on Form ES-401-5, Question Worksheet, is missing.

88 H 2 x N E T2G1 013 (ESFAS) A2.03 (predict impacts of rapid depressurization on ESFAS and use procedures to correct, control, mitigate)

S Sample question comments all incorporated; however,

1. Cue: The last stem bullet is now underlined even though it was not underlined in the sample question review; the underline is not necessary to elicit the correct response. Why is it underlined?

2-12-2020: Also underlined upstream of the MSIV in the stem so two things are underlined; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 89 F 2 x x x N E T2G1 039 (Main & Reheat Steam) A2.04 (predict impacts of malfunctioning steam dump on the M&RSS and use procedures to S

correct, control, mitigate)

1. Cred Dist and/or SRO-only: The plausibility for the 2nd part of Choices B/D (AOP-I.08 doesnt contain any guidance for placing steam dumps in pressure mode) is questionable because the AOP would directly or indirectly provide some type of guidance regarding the steam dumps since DCS uses turbine impulse pressure channels to ARM steam dumps. An RO may be able to deduce using systems knowledge that the AOP has to contain something for placing steam dumps in steam pressure mode.

Suggest replacing the 2nd part of the question with:

AOP-I.08, Appendix A, Placing Steam Dumps in Pressure Mode, _______ required to be performed.

This will make the question more applicable to SROs, because the SRO applicants knowledge that at least two instruments failed are required for Appendix A to be performed.

2. Stem Focus: The 1st fill-in-the-blank statement contains a typo, and should spell out auto.

Another preferred way to word the 1st fill-in-the-blank statement is:

_________ is the instrument that feeds C-5, Auto Rod Withdrawal Block 2-12-2020: Comment#1 incorporated and Comment #2 addressed by spelling out the word auto; however, the 1st fill-in-the-blank statement contains a typo (withdrawl).

2-19-2020: Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 90 H 2 x x x N E T2G1 062 (AC Elect Distribution) G2.1.30 (locate/operate components, including local controls)

S

1. Cue: The second part of the 1st bullet (all 6.9KV UBs in Auto, aligned to USSTs) is not necessary because this is the normal at-power UB configuration.

2. Cue: The 2nd fill-in-the-blank statement wording could lead an applicant to the correct answer to the operable/not operable part of the question. For example, since the 2nd fill-in-the-blank statement implies RETURNING the switches to AUTO is needed, THEN the applicant could deduce that operability was affected. Suggest swapping the order of the fill-in-the-blank statements and re-wording the switch fill-in-the-blank statement to be:

1-HS-241-107 and -108 are located ________ .

[at Panel 1-M-1 vs on Electrical Control Board XYZ]

3. Stem Focus: The term offsite power in the 1st fill-in-the-blank statement may be slang; the term offsite power is not used in LCO 3.8.1 - LCO 3.8.1 uses the phrase Two qualified circuits between the offsite transmission network and the onsite Class 1E AC Electrical Power Distribution System.

Suggest replacing the TS fill-in-the-blank statement with:

LCO 3.8.1, AC Sources - Operating, ______ met.

[is vs is NOT]

4. Partial: Choice D could be argued as correct because the phrase Electrical Control Board could be justified as being Panel 1-M-1. Suggest including the Electrical Control Board unid/#.

2-12-2020: Comment #4 not addressed. Comment#1 not applicable and Comment#2 and #3 incorporated.

2-19-2020: Comment #4 addressed; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 91 H 2 x x B E T2G2 002 (RCS) A2.02 (predict impacts of loss of coolant pressure on the RCS and use procedures to correct, control, mitigate)

S

1. Overlap: This test item is a subset of S5E3 (PORV fails open mechanically, block valve closed, enter AOP-I.04); during the scenario, the crews will first attempt to use the control switch to CLOSE, enter AOP-I.04, and address the same LCO. Too close to S5E3.

2. Cred Dist: The plausibility of the 1st part of Choices A/B (enter AOP R.05) is questionable because the root cause of the event is not a RCS leak, and the stem says the PORV was closed so no leak exists anymore.

3. #/units: The title of AOP-R.05 is RCS Leak. The 1st part of Choices A/B dont match the title.

2-12-2020: Replaced question with PZR Heater Question for T.S.

LCO 3.4.9. The 1st fill-in-the-blank statement should say is/are (not just are).

2-19-2020: Comment addressed; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 92 F 2 x x x N E T2G2 015 (Nuclear Instrumentation) G2.4.3 (identify post-accident instrumentation)

S

1. Partial: The 2nd part of the proposed test item is vulnerable to post-exam appeals because none of the choices match the Tech Spec 3.3.3 Bases for Function 17 (Neutron Flux), which says that the purpose of SR Instruments is to 1) monitor reactivity control, 2) determine if plant is subcritical, and 3) to diagnose positive reactivity insertion. An applicant could successfully argue that 2nd part of the question was supposed to apply to the SR Instruments, and the bases doesnt match the Function 17 bases.

The 2nd fill-in-the-blank statement begins with Part of the TS basis is to..; the phrase part of is insufficient to preclude an applicant from contending no correct answer based on the bases provided not match the bases for Function 17. The applicant would contend that the 2nd fill-in-the-blank statement was supposed to be associated with the bases for the SR Instruments.

2. Cue: IF the answer to the 1st part of the question was SR Instruments ARE NOT identified in PAM TS, THEN there would be no reason to ask about the PAM TS in the 2nd fill-in-the-blank statement; therefore, the answer to the 1st part of the question must be ARE.

3. Stem Focus: No stem question exists.

2-12-2020: Cred Dist: 1st part of Choices A/B not plausible because Tech Specs has RPS Section for trip setpoints. Suggest the following:

WOOTF completes both statements for Tech Spec 3.3.3, Post Accident Monitoring Instrumentation?

In Table 3.3.-1 (PAM Instrumentation), for Function 17-Neutron Flux,

_________ are required to be operable.

[ONLY the Source Range Instruments vs BOTH the Source Range and Intermediate Range Instruments]

In accordance with the Basis for Function 17 - Neutron Flux these instrument(s) _______ required for diagnosing positive reactivity insertion. [are vs are NOT]

2-19-2020: Comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 93 F 2 x x N E T2G2 029 (Containment Purge System) A2.01 (predict impacts of maintenance or other activity taking place inside containment and S

use procedures to correct, control, mitigate)

1. The proposed test item may not be operationally valid for two reasons:

The stem says the Unit is operating at 100% power and NONE of the sections in 0-SO-30-03 Table of Contents allow A Train Lower Containment Purge operation in Mode 1.

None of the sections in 0-SO-30-03 Table of Contents match A Train Lower Containment Purge.

You could verify with Ops Rep that the Unit must be in Mode 5 to operate containment purge, and that Section 8.6, Simultaneous A Train Purging of Lower Containment and Upper Containment (MODES 5, 6, or Defueled ONLY), is the correct section of the procedure to be in for 1FCV-30-56 operation (Step [19]).

However, IF the Unit is in Mode 5 (Cold Shutdown), the 2nd part of the question may no longer work because getting Plant Manager permission is not plausible in Mode 5.

2. Is 1-FCV-30-56 located in the #1 Accumulator Room? Is the #1 Accumulator Room located inside the Polar Crane Wall?

3. Stem Focus: IF the proposed test item is used, THEN the last part of the 1st fill-in-the-blank statement (expected to be LIT due to the failure of 1-0FCV-30-56) is not necessary - - it can be replaced with will/ will NOT alarm.

4. Partial: IF the proposed test item is used, THEN the 2nd fill-in-the-blank statement should include the phrase in accordance with procedure xyz 2-12-2020: Comments #3 and #4 incorporated; need to discuss Comment#1 and #2.

2-19-2020: 0-SO-30-03 does have allowance for purge at 100%

power. 2nd fill-in-the-blank statement modified to say access to #1 accumulator room. Question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 94 F 2 x x B U T3 G2.1.1 (conduct of ops requirements)

S 1. SRO-only: The proposed test item tests the same OPDP-10 requirements that ROs must adhere to when re-activating.

2. Partial: Choice D may be correct because there was no OPDP-10 requirement to submit door logs.

2-12-2020: Question replaced with another Bank item; however, Partial: An applicant can contend no correct answer to the 1st part of the question because the caveats for not having SRO oversight of the dilution are not included in the stem (page 13 of 71).

The two fill-in-the-blank statements are unrelated.

Cred Dist: The plausibility of the 2nd part of Choices B/D is questionable for classifying an emergency.

Consider the following:

A Work Control Center (WCC) SRO has previously held a SRO license at SQN, but does not currently hold a SRO license.

This WCC SRO _______ authorize switchyard access.

[can vs can NOT]

This WCC SRO ____ be the incident commander.

[can vs can NOT]

2-19-2020: Suggestion accepted; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 95 H 2 x x N E T3 G2.1.25 (interpret reference materials, such as graphs, curves, tables, etc.)

S

1. Cred Dist: The plausibility of the 1st part of Choices C/D (Oct 27

@ 2030 = 29.5F) was not included in the distracter analysis.

The incorrect temperature should be based on something.

2. Stem Focus: The initial plant is missing from the plant initial conditions.

2-12-2020: The 1st part of Choices C/D was changed to reflect time/date when ice bed temp rose to 32F. Question is SAT.

Suggest the following editorial enhancements to the fill-in-the-blank statements:

In accordance with LCO 3.6.12 Ice Bed, IF the current temperature rising trend continues, THEN the EARLIEST time/date the Ice Bed will become INOPERABLE is _____.

In accordance with SR 3.0.2, to comply with the 12-hour surveillance frequency, the ice bed temperatures are required to be taken a maximum of _____ from the previous logged reading.

2-19-2020: Comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 96  ? 2 x x N SAMPLE QUESTION RECD 11/7/19 SRO T3 G2.2.13 (clearance and tagging procedures)

1. Stem Focus: The phrase qualified but NOT proficient is subjective and can be interpreted many ways.

2. Partial: To make the question bullet-proof to post-exam appeals, consider the following re-word, which eliminates the two stem bullets and seems more straight forwards as to what were trying to test:

WOOTF completes both statements in accordance with NPG-SPP-10.2, Clearance Procedure to Safely Control Energy?

Local Control Pushbuttons/Handswitches ______ be used as an energy isolating device for a clearance.

[can vs can NOT]

A licensed SRO who is inactive _______ allowed to approve a clearance for placement or release.

[is vs is NOT]

3. LOK: The Cognitive Level field on Form ES-401-5, Question Worksheet, is missing.

96 N E T3 G2.2.13 (clearance and tagging procedures)

S Comments from Sample Question incorporated EXCEPTthe 2nd fill-in-the-blank statement wording was slightly modified, which

1. Stem Focus: The phrase currently licensed SRO may cause applicants to miss the question because of the word currently.

If the reason why you didnt use my Sample Question suggestion was because the applicants may not know what the word inactive means, then suggest using the following as the 2nd fill-in-the-blank statement:

A licensed SRO who has not stood watch in the control room SRO for 6 months (i.e, an inactive SRO) _______ allowed to approve a clearance for placement or release.

2-12-2020: Comment incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 97 F 2 x x B E T3 G2.2.18 (process for managing maintenance activities during shutdown operations, such as risk assessments, work prioritization, S

etc.)

2017 SQN NRC Exam, Q#?

1. Partial: The proposed question puts the applicants into a gray area for the 2nd part of the question - the equipment failure may be something that required emergent maintenance that would force the plant to enter the RED Condition- the proposed question is vulnerable to post-exam appeals because an applicant could contend there is no correct answer to the 2nd part of the question if the site had no choice but to do the emergent maintenance.

It is better to delete the 1st two bullets entirely and make the 2nd fill-in-the-blank statement:

A planned entry into a red condition ___________ ..

[is not allowed vs. requires Plant Manager authorization]

2. Partial: Suggest the following for the 1st fill-in-the-blank and choices:

At a minimum, the DID Checklist is required to be completed

[each shift vs every 24 hour2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br />s]

3. Stem Focus: The two fill-in-the-blank statements may confuse the applicants if they think the statements are somehow related to each other - each statement should be a stand-alone fill-in-the-blank statement.

2-12-2020: Comments incorporated; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 98 F 2 x x N E T3 G2.3.14 (radiation or contamination hazards that may arise during normal, abnormal, or emergency conditions or activities)

S

1. Partial: The 2nd fill-in-the-blank statement should mirror whats in the Tech Spec Bases, without any paraphrasing.

Suggest the following change:

The minimum water level in the spent fuel pool __________ .

[meets the assumptions of iodine decontamination factors following a fuel handling accident vs. provides long term cooling following a core unload.]

2. Stem Focus: The 1st fill-in-the-blank statement may be better with replacing the word alarm with annunciator.

2-12-2020: Comment #1 not applicable; Comment #2 not addressed, lets discuss what the 1st fill-in-the-blank statement means for Unit 1 only - - I think the annunciator is only available on Unit 1.

2-19-2020: Changed the word to annunciator; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 99 F 2 x B U T3 G2.4 (procedures related to a security event)

S 1. Cred Dist: The 1st part of Choices A/B (Anytime Personnel Accountability/Evacuation is performed the 2 person rule applies) is not plausible because there are all sorts of emergency classifications that require Personnel Evacuation.

2. Cred Dist: The 2nd part of Choice B/D (2 person rule doesnt apply to Cable Spread) is not plausible because Cable Spread is a critical (vital) plant area.

2-12-2020: Job-Link and/or Partial: The 1st part of the question uses the term ANY, which may not meet the intent of NUREG-1021, Appendix B, page B-14, i.e., use of the words always or never, which suggest Choices C/D.

The 1st and 2nd parts of the question seem disjointed or unrelated.

Suggest the following:

WOOTF completes the following statement IAW EPIP-8, Personnel Accountability and Evacuation?

The decision to utilize the Assembly and Accountability System to invoke the Two Person Line of sight Rule will be made by the

_______ based upon the recommendation of the _________ .

A. Nuclear Security Response Team Leader; Shift Manager or SED B. Shift Manager or SED; Nuclear Security Response Team Leader C. Operations Support Center; Nuclear Security Response Team Leader D. Nuclear Security Response Team Leader; Operations Support Center 2-19-2020: Recommendation accepted; question is SAT.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Source Status (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 100 F 5 B E T3 G2.4.30 (events related to system operation/status that must be reported to internal organizations or external agencies, such as the S

State, the NRC, or the transmission system operator)

1. LOD=5: The test item is vulnerable to post-exam appeals because it requires an applicant to memorize NPG-SPP-03.5, Regulatory Reporting Requirements. The Proposed References to be Provided Field on Form ES-401-5 indicates none.

2-12-2020:

Choice C is not plausible because the ERO is never activated unless an emergency is declared.

Choices A/B are subsets of one another; therefore, an applicant can correctly eliminate these choices solely based on psychometrics.

Suggest the following:

WOOTF completes the following statement IAW EPIP-1, Emergency Plant Classification Matrix?

IF a condition is discovered that met an EAL threshold but no emergency was declared, and the basis for the emergency no longer exists at the time of discovery, THEN the emergency condition A. Shall NOT be declared, but must be reported to the NRC within 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />.

B. Shall NOT be declared, but must be reported to the NRC within 4 hours4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br />.

C. MUST be declared and reported to the NRC within 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />.

D. MUST be declared and reported to the NRC within 4 hours4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br />.

2-19-2020: Recommendation accepted; question is SAT.