ML20010D143

2019-11-DRAFT Written Examination Comments

ML20010D143
Person / Time
Site:	River Bend
Issue date:	11/26/2019
From:	Greg Werner Operations Branch IV
To:	Entergy Operations
References
Download: ML20010D143 (13)

Text

ES-401 Written Examination Review Worksheet Form ES-401-9

1. LOK 2. LOD 6

7 8

Q#

(F/H)

(1-5) stem focus cueing T/F cred dist partial job link minutia

1. /

units back-ward K/A SRO-only B/M/N U/E/S Explanation

1. LOK 2. LOD 6

7 8

Q#

(F/H)

(1-5) stem focus cueing T/F cred dist partial job link minutia

1. /

units back-ward K/A SRO-only B/M/N U/E/S Explanation 1

H 3

M E

S The fact that the question asks which components will be available means HPCS is not really plausible as a distractor, since there is nothing in the stem to indicate that HPCS is not available. I believe the intent of adding the drywell pressure is to ask which components are operating. If this is the case, modify the question to ask which components are operating. RBS-Added Division III Diesel Generator is tagged out to stem of the question, and changed the word available to operating.

If there is a LOOP and Div 3 EDG is tagged out, HPCS still is not plausible.

RBS-Removed Division III Diesel Generator is tagged out and added distractor D. LPCS and HPCS. Question now SAT.

2 H

3 B

E S

Since "arm and depress LPCI initiation" is in all four distractors, it is meaningless to the question. If part of the knowledge is realizing that LPCI had not initiated since level is still above -143 inches, you should take the arm and depress out of a couple of the distractors. RBS-Changed to RPV level from -120 to -150 in the stem.

This allowed removing Arm and Depress DIV I Initiation pushbutton from each distractor. Question now SAT.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

3. Psychometric Flaws

4. Job Content Flaws

5. Other Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.] 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 to 5 (easy to difficult) rating scale (questions in the 2 to 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

a. The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

b. The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

c. The answer choices are a collection of unrelated true/false statements.

d. The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

e. One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

a. The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

b. The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

c. The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

d. The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7. Based on the reviewer's judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any Unsat ratings (e.g., how the Appendix B psychometric attributes are not being met).

ES-401 2

Form ES-401-9

1. LOK 2. LOD 6

7 8

Q#

(F/H)

(1-5) stem focus cueing T/F cred dist partial job link minutia

1. /

units back-ward K/A SRO-only B/M/N U/E/S Explanation

3. Psychometric Flaws

4. Job Content Flaws

5. Other 3

F 2

N E

S The question is dangerously close to LOD 1. I would like the question a little better, and is more challenging, if you would have cominations of pumps and combinations of pressures. If however the question remains, the answer treads close to the subset, as at >= 145 psig, any answer is correct. I would request that you bold the word "requires" in the stem, to make sure it is eveident that the pressure must be. RBS-Removed the subset issue by asking for the minimum discharge pressure. Bolded the word requires in the stem. I am concerned that the question is still too close to LOD 1 because it does not seem plausible to me that the RHR pump discharge pressures would be different. RBS - RHR C discharge pressure is associated with DIV 2 not DIV 1. The question is asking DIV 1 ADS. Subset issue with distractors A and B. RBS - changed distractor A to above Drywell Pressure 1.68. Question now SAT.

4 H

3 X

M U

S REFERENCE PROVIDED. It is not plausible to think F004 would automatically open, when the stem specifically states that it has been overriden closed, eliminating distractors A and C. Override implies no automatic functions.

RBS-Removed E22-F004, HPCS Injection Valve, has been manually overridden closed from the stem of the question. Added picture of HPCS Level 8 light.

Question now SAT.

5 H

3 B

S REFERENCE PROVIDED. 2018 exam question 7. Past 2 exams.

6 F

2 N

E S

Stem is confusing. Request you reword it. RBS-Changed the stem of the question completely by adding a picture of the MODE switch. I think the changes make the question too easy. Go back to the original question and reword the stem, just a little. i.e., "Which of the following scram signals is dependent solely on Mode Switch position for the scram to be bypassed..."

Went back with original question stem as suggested.

Question now SAT.

7 H

3 B

E S

It is not plausible to think the 28/125 would bring in an upscale alarm, eliminating distractor A. RBS-Replaced Upscale alarm with downscale alarm. Question now SAT.

8 F

2 B

S 9

F 2

N E

S Distractor C seems too obvious to be plausible. RBS-Replaced Distractor Selecting Control Rods at H13-P680 with Downshifting Reactor Recirculation Pumps Question now SAT.

ES-401 3

Form ES-401-9

1. LOK 2. LOD 6

7 8

Q#

(F/H)

(1-5) stem focus cueing T/F cred dist partial job link minutia

1. /

units back-ward K/A SRO-only B/M/N U/E/S Explanation

3. Psychometric Flaws

4. Job Content Flaws

5. Other 10 H

3 N

E S

REFERENCE PROVIDED. Stem is asking the status of RCIC, not what will RCIC do. Distractors are also unbalanced. Three have the valve closing, and three have RCIC continuing to run. Additionally, one could argue no correct answer since there is not a time invloved. A potential correct answer is the valve stays open and RCIC trips. No way to tell the actual position of F031. If it is slightly off its front seat, F010 stays open,CST drains, RCIC trips.

RBS-Changed the stem of the question to directly ask the impact to the CST suction valve and RCIC turbine.

Added a time component after the alarm. Set the answer and distractors in a 2x2 format. How do you know in this configuration that the CST is vented to atmosphere? RBS-The CST is always vented to atomsphere. Quesyion now SAT.

11 F

2 B

E S

Is the distractor analysis for distractor B accurate. The analysis states, "Pushing the ADS LVL 3/TIMER RESET PUSHBUTTON would not close the SRVs under any condition." However, the STM states, "Depressing these pushbuttons (one for each channel) after ADS actuation, resets the logic and closes the ADS SRVs." RBS-Reworded the explanation to confirmed that ADS SRVs would go close if the ADS LVL 3/TIMER RESET PUSHBUTTON is depressed. Question now SAT.

12 H

3 N

E S

Would RWCU isolate if the the transmitters failed high?

Also, how many transmitters have to fail? RBS-Added logic drawing to the explanation. RWCU does not isolate on ANY Drywell Pressure signal, so Drywell Pressure transmitters can never cause an isolation of RWCU. Added the word directly to the stem. Does not directly address my concern. The stem does not discuss which way the reactor water level transmitter fails, it could be argued there is no correct answer. RBS - added high and low as failures direction for the transmitters.

Question now SAT.

13 F

2 M

S REFERENCE PROVIDED. I think this question is closer to Modified Bank (modified from March 2014 NRC Exam, question 42, or December 2014 NRC exam question 44).

RBS-Changed question source from New to Modified 14 H

3 B

E S

REFERENCE PROVIDED. Answer is cued. Since level signal deviation light is in all distractors, A must be right because there can't be more than one correct answer.

Change distractor A to Level Signal Deviation Light ONLY.

(Since the answer is cued, this would normally result in an UNSAT question. But since the correction is simple, it is marked as an EDIT.) RBS-Added the word ONLY to distractor A. Question now SAT.

ES-401 4

Form ES-401-9

1. LOK 2. LOD 6

7 8

Q#

(F/H)

(1-5) stem focus cueing T/F cred dist partial job link minutia

1. /

units back-ward K/A SRO-only B/M/N U/E/S Explanation

3. Psychometric Flaws

4. Job Content Flaws

5. Other 15 F

3 B

E S

Swap distractors C and D. Is the data on the question source accurate? I can not find this question in any NRC exam since 2007. RBS-Swapped distractors C and D.

Correct indentation on distractors C and D so they are like distractors A and B. Is the data on the question source accurate? I can not find this question in any NRC exam since 2007. RBS - Corrected formatting of distractors C and D. Corrected question source data. Question now SAT.

16 H

3 N

S 17 H

3 N

E S

REFERENCE PROVIDED. Distractor A not really plausible due to the way you set up distractors B, C, and D. Those distractors are of the type, "This alone, this alone, or both together." RBS-Added distractor A to distractor C to balance the distractors. Add ONLY to the end of distractors A and B. For distractors C and D, they are the exact same thing but in opposite order, yet the explanation just states that both manipulations must be made. Must the manipulations be made in a specific order, and if so, please add to the distractor analysis. RBS-Added ONLY to distractors A and B. Yes, those actions must be completed in a specific order. Added that to the distractor analysis. Question now SAT.

18 F

3 N

S 19 H

3 X

N U

S REFERENCE PROVIDED. It is not plausible to think lowering frequency is viable, particulary when it is so far below the green band. Also not plausible to think that voltage would need to be changed in either direction since it is so close to the band. RBS-Rewrote the question. 6 o'clock not plausible as the only mark on the syncroscope is at the 12 o'clock position, and it is common knowledge that you close at 12 o'clock. Perhaps part 2 can be written regarding the syncrosope moving in the FAST or SLOW direction?

RBS-Removed the synchroscope position as part of the answer and replaced it with direction. Question now SAT.

20 F

3 B

S 21 F

3 B

E S

Change distractor A to RWCU Pump, Drywell Equipment Drain Sump Cooler, CRD Pumps. This balances the distractors with each component used twice in the distractors. (I believe this still makes A incorrect.) I think the question source is 2015 exam, question 44. RBS-RWCU Pumps, Drywell Equipment Drain Sump Cooler, CRD Pumps. Question now SAT.

22 H

3 B

S 23 H

3 B

S

ES-401 5

Form ES-401-9

1. LOK 2. LOD 6

7 8

Q#

(F/H)

(1-5) stem focus cueing T/F cred dist partial job link minutia

1. /

units back-ward K/A SRO-only B/M/N U/E/S Explanation

3. Psychometric Flaws

4. Job Content Flaws

5. Other 24 H

3 N

E S

REFERENCE PROVIDED. Swap distractors A and B. Fail to see how distractor D is plausible. RBS-Swapped distractors A and B. Replaced distractor D with The Pump handswitches are disabled." Correct the distractor analysis. Swapped distractors A and B but did not swap the distractor analyses.

Swapped distractor analyses for A and B. Question now SAT.

25 F

3 N

S 26 H

3 N

E S

REFERENCE PROVIDED. Distractor D discussed safety related battery charges, but the distractor analysis discusses the non-safety related loads. RBS-Updated distractor analysis for distractor D. Question now SAT.

27 H

3 M

E S

Cross-reference table shows Tier 2 Group 1, but the question is Tier 2 Group 2. Provide the parent question.

Question states that a plant startup is in progress, but does not specify mode. Tech Spec 3.1.5 only applies in modes 1 and 2, so the tech spec might not apply. RBS-Corrected the Tier/Group number, Added MODE 2 to the stem of the question for clarification. Second paragraph of "Explanation section" states "...completion time commenced at 0615..." Should be 1615. RBS-Changed 0615 to 1615. Question now SAT.

28 H

3 X

N U

E S

REFERENCE PROVIDED. Cross-reference table shows Tier 2 Group 1, but the question is Tier 2 Group 2.

Distractors A and C easily eliminated since the lite annunciators have "TEMP" in them, cueing that the correct answer must be thermal and not caviation. RBS-Removed the two cavitation interlock annunciators and made the question focus solely on the thermal shock interlocks.

Removed to 2x2 format as well. Change distractor C to "Preventing a fast speed OR slow speed pump start" capitalizing OR. Question now EDIT. RBS-Changed distractor C to "Preventing a fast speed OR slow speed pump start" capitalizing OR. Question now SAT.

ES-401 6

Form ES-401-9

1. LOK 2. LOD 6

7 8

Q#

(F/H)

(1-5) stem focus cueing T/F cred dist partial job link minutia

1. /

units back-ward K/A SRO-only B/M/N U/E/S Explanation

3. Psychometric Flaws

4. Job Content Flaws

5. Other 29 H

3 X

N U

E S

Distractors A and B easily eliminated since the stem uses the word SUCTION strainer, cueing that suction head must be the correct answer, not shutoff. Is it possible to put some indications (gauges, etc) that don't cue the word suction into the stem? RBS-Completely rewrote the entire question to meet the K/A better. New question is LOD 1, as it is not plausible to think that inadequate discharge pressure would lead to pump cavitation. RBS-Removed "leading to pump cavitation" from the question stem. Since inadequate suction head could eventually lead to inadequate shutoff head, can argue two correct answers. Question now EDIT. RBS - Removed answer choices suction and discharge head.

Replaced with vortexing and cavitation. Question now SAT.

30 F

3 N

E S

Distractor A is the only distractor that is not of the "Entering the " Would like balance of the distractors. RBS-Revised the stem to include the words entering the.

Also, changed the distractors to make the question more plausible. Question now SAT.

31 H

3 N

E S

REFERENCE PROVIDED. I would like this question without the picture if you could find a decent distractor for MSIV solenoid power supplies other than RPS. The way the question is written now, you are meeting the K/A only by looking at a picture and knowing that C71-S003C is for RPS A. RBS-Rewrote the question to meet the K/A statement better. Question now SAT.

32 H

3 N

E S

Could you set this question up that somehow causes you to lose main steam to the turbine rather than just lowering flow due to a scram? I think it would meet the K/A better.

(i.e., some malfunction that would close the MSIVs?) RBS-Replaced Reactor Scram with an MSIV isolation in the question stem. Question now SAT.

33 F

3 B

E S

There is a subset issue here. If you have reached the alarm setpoint, you have also reached the alert setpoint.

Please word the stem in such a way as to eliminate the subset issue. RBS-Rewrote the question to eliminate the subset issue. Question now SAT.

34 F

2 B

S Swap distractors B and C, making C the correct answer.

(Answer choices short to long) RBS-Changed the order of distractors.

35 H

3 N

E S

Instead of stating "A Level 2 Reactor Water Level signal

" give an actual level. Both parts of the question in the stem indicate (2). First one should be (1). RBS-Added an actual Reactor water to stem and replaced the (2) with (1). Question now SAT.

ES-401 7

Form ES-401-9

1. LOK 2. LOD 6

7 8

Q#

(F/H)

(1-5) stem focus cueing T/F cred dist partial job link minutia

1. /

units back-ward K/A SRO-only B/M/N U/E/S Explanation

3. Psychometric Flaws

4. Job Content Flaws

5. Other 36 H

3 X

N U

S REFERENCE PROVIDED. Not plausible to think that a tripped supply fan would lead to high building pressure, eliminating distractors A and B. Not plausible to think that issues with fuel building would require entry into Primary Containment, eliminating distractors A and C. That leaves D as the only credible answer. RBS-Completely rewrote the entire question. Question now SAT.

37 F

3 N

E S

Reorder distractors B-C-D-A (short to long, also alphabetical), making A the correct answer. Is it necessary to include "Level 2 Reactor Water Level or High Drywell pressure" in the stem? Can't the question simply ask which has more than 2 isolation signals? RBS-Reordered the distractors and changed the wording in the stem to ask which has more than 2 isolation signals. Question now SAT.

38 F

3 N

S Reorder distractors D-C-B-A (short to long), making B the correct answer. RBS-Reordered the distractors 39 H

3 N

S REFERENCE PROVIDED.

40 H

3 N

E S

Swap distractors B and D. No change to correct answer.

Distractor analysis C, the word "om" should be "on". RBS-Reordered the distractors. Distractor analysis C, the word "om" should be "on". RBS-Distractor analysis C, changed the word "om" to "on". Question now SAT.

41 F

3 X

N U

S The answer is obviously C, as it is the only choice that includes 3.5.3. Try making the answer choices a combination of LCO's, i.e., 3.5.1 ONLY, 3.5.1 and 3.5.3, etc. RBS-Rewrote the question to meet the K/A better.

Question now SAT.

42 F

3 X

N U

E S

Does not meet the K/A. There is nothing in the question as to why the generator trips. RBS-Rewrote the question to meet the K/A better. Update the distractor analysis.

When the question was rewritten, it did not update the distractor analysis. Question now EDIT. RBS-Updated the distractor analyses. Question now SAT.

43 H

2 N

S Since this question is an immediate operator action of a SCRAM, LOD should be 2. RBS-Changed LOD from 3 to 2

44 F

3 N

E S

Reorder distractors C-A-B-D, making A the correct answer.

The first sentence in the stem is unnecessary. RBS-Removed the first sentence from the stem, and reordered the distractors.

45 H

4 N

S REFERENCE PROVIDED. Reorder distractors D-A-C-B, making B the correct answer. RBS-Reordered the distractors

ES-401 8

Form ES-401-9

1. LOK 2. LOD 6

7 8

Q#

(F/H)

(1-5) stem focus cueing T/F cred dist partial job link minutia

1. /

units back-ward K/A SRO-only B/M/N U/E/S Explanation

3. Psychometric Flaws

4. Job Content Flaws

5. Other 46 F

3 N

S Reorder distractors D-B-A-C, making D the correct answer.

RBS-Reordered distractors D-B-A-C, making D the correct answer.

47 H

3 N

E S

Does the Level 3 itself cause a loss of shutdown cooling?

If so, remove that from the stem. Having to diagnose that a loss of shutdown cooling has occurred is a much better fit to the K/A. Swap distractors A and D. No impact on correct answer. RBS-Removed that Shutdown Cooling was lost from the stem, and reordered the distractors.

Question now SAT.

48 F

3 N

E S

REFERENCE PROVIDED. I think that the answer is way too obvious. I suggest making this a 2 x 2 question with a couple of different entry conditions, with neutron count rate in the correct answer (to still meet the K/A). That should also change the question to a modified bank. 2008 exam question 10. RBS-Rewrote the question to meet the K/A. Negative period is not plausible for a inadvertent criticality event. RBS-Rewrote the question in a 2x2 format and added SRM indications. Capitalize the word AND in distractors B and D. RBS - Rewrote the question to a 2x2 with added SRM indications. Question now SAT.

49 F

3 B

E S

Swap distractors B and D making D the correct answer. Is the data on the question source accurate? I can not find this question in any NRC exam since 2007. RBS-Swapped distractors B and D making D the correct answer. Is the data on the question source accurate? I can not find this question in any NRC exam since 2007 RBS - Updated question source data to Audit examination. Question is now SAT.

50 H

3 N

E S

REFERENCE PROVIDED. Since the indications are dual, you need to clarify in the stem that you are talking about what reactor pressure results in a manual SCRAM. RBS-Enhanced the explanation statement to clarify the difference between the two indications. Question now SAT.

51 H

3 N

U E

S REFERENCE PROVIDED. Does not meet the K/A, it is backwards. Instead of determining level based on high temperature, you are determining temperature based on low level. RBS-Rewrote the question to better meet the K/A. Change suppression pool temperature to 132°F. I think it makes 17 feet a better distractor. Question now EDIT. RBS - Changed suppresion pool temperature to 132F. Question now SAT.

ES-401 9

Form ES-401-9

1. LOK 2. LOD 6

7 8

Q#

(F/H)

(1-5) stem focus cueing T/F cred dist partial job link minutia

1. /

units back-ward K/A SRO-only B/M/N U/E/S Explanation

3. Psychometric Flaws

4. Job Content Flaws

5. Other 52 H

3 N

E S

REFERENCE PROVIDED. Unbalance distractors with three temperature parameters and one pressure parameter. Might be better to have distractors as containment temperature and pressure, and suppression pool temperature and level. RBS-Removed Drywell temperature and replaced it with Suppression Pool level as a distractor. Question now SAT.

53 F

3 N

S 54 F

2 B

S LOD should be 2. RBS-Changed LOD from 3 to 2 55 H

3 B

S 56 H

3 N

S REFERENCE PROVIDED. Ensure the picture is legible. It is hard to read the individual RMS numbers 57 H

3 N

S 58 H

4 B

E S

Need to be more specific on what buses would be paralleled to in distractors A & B. Also, need to describe buses and breakers in the plural, since there is more than one safety bus. RBS-Cleaned up the distractors with grammatical changes for clarity. Question now SAT.

59 F

3 M

E S

Distractor C is of the type "Basically, nothing happens." It is also the only distractor that does not result in losing vacuum, thus it can easily be eliminated. As written, reorder distractors C-D-B-A, making A the correct answer.

RBS-Rewrote the stem and made the question a 2x2 type to eliminate distractor C. Question now SAT.

60 H

3 B

S Swap distractors C and D. No impact on correct answer.

2010 Exam question 23. RBS-Swapped distractors C and D.

61 H

3 N

S 62 H

4 B

S 63 F

3 N

S 64 H

3 B

E S

REFERENCE PROVIDED. 2018 exam question 63. Past 2 exams. Distractors A & D are easily eliminated since the Aux Bulding Alarm shows RCIC Equipment room in alarm, and there are no red indications in the RWCU room. The initital bank question had all four distractors associated with RCIC. RBS-Included RCIC steam supply drain pot valves have failed open as a distractor. Changed steam leak to gland seal compressor failure. Question now SAT.

65 H

4 N

S Second paragraph in stem has "HPSC" instead of "HPCS" RBS-changed HPSC to HPCS 66 F

2 N

S Reorder distractors B-C-D-A (short to long), making D the correct answer. RBS-Reordered the distractors making D the correct answer

ES-401 10 Form ES-401-9

1. LOK 2. LOD 6

7 8

Q#

(F/H)

(1-5) stem focus cueing T/F cred dist partial job link minutia

1. /

units back-ward K/A SRO-only B/M/N U/E/S Explanation

3. Psychometric Flaws

4. Job Content Flaws

5. Other 67 F

2 X

N U

E S

Not tier 3, system specific. Though it is multiple ECCS systems, it is still too specific to be considered Tier 3. RBS-Rewrote the question to meet the K/A better. Add ONLY to distractors B and C to eliminate possible subset issues. Capitalize "AND" in distractors B, C and D.

Question now EDIT. RBS: Added ONLY to distractors B and C. Changed and to AND in B, C, and D. Question now SAT.

68 F

3 B

E S

Swap distractors A and C, no change to correct answer.

Eliminate the first part of distractors that specify the risk.

Spelling out minimal, medium, higher, and unacceptable makes it too easy to order Green, Yellow, Orange, Red.

This better justifies LOD 3 as well. Is the bank from 2008 question 70 or 71? 2008 exam question 71. RBS-Changed the stem to ask about a RED risk instead of a YELLOW risk. Reordered the distractors from smallest to biggest. With RED risk, it is not plausible to think that normal work controls are plausible, eliminating distractor A.

RBS - Removed distractor A and used another ORANGE definition as disractor. Question now SAT.

69 F

3 N

S 70 F

2 B

S Swap distractors A and C, making A the correct answer.

2012 exam question 70. RBS-Reordered the distractors.

Made the correct answer A 71 F

3 B

E S

Eliminate part (3) of the question. Too obvious that you would be on the lowest scale to start. RBS-Eliminated part (3) of the question. Question now SAT.

72 H

2 N

E S

Change the part (2) distractors from A and C to 250. I think 50% is a better distractor than 100% for exiting.

When doing that, make sure the stem for part two eliminates a subset problem. (i.e., exit as soon as the SRD reaches (2) mrem, or something similar.) RBS-Changed the part (2) distractors from A and C to 250. Reworded the stem to remove the subset issue. Still a potential subset issue. Fort part 2 of the stem, add "... before reaching a MAXIMUM accumulated dose of..." Reorder distractors C-D-A-B making B the correct answer (shorter time first). RBS - Added MAXIMUM to part 2 and re-ordered answers. Question now SAT.

73 F

3 N

S Swap distractors A and B, making B the correct anwser.

RBS-Swapped distractors A and B, making B the correct anwser..

ES-401 11 Form ES-401-9

1. LOK 2. LOD 6

7 8

Q#

(F/H)

(1-5) stem focus cueing T/F cred dist partial job link minutia

1. /

units back-ward K/A SRO-only B/M/N U/E/S Explanation

3. Psychometric Flaws

4. Job Content Flaws

5. Other 74 F

3 N

E S

Is there a document number associated with Pre-Fire Strategies? Unbalanced distractors leaving the correct answer as the only one without a document number. RBS -

Added a procedure number to the answer. Question now SAT.

75 H

3 N

S 76 F

3 N

S Free Review Question.

77 H

3 N

S REFERENCE PROVIDED. Free Review Question.

78 H

3 N

E S

Reword distractor A to not include the words "Specified Frequency Missed." That is inherent in the stem, and I think it cues that it is incorrect. Something like, "It must be immediately declared inoperable" or something similar.

RBS-Changed distractor A to say Immediately.

Question now SAT.

79 H

4 N

E S

REFERENCE PROVIDED. The wording of the distractors (particularly A and B) are cumbersome in that they state the valve can fully function... but restore to operable. The first part makes it sound like the valves are operable, but the second part makes it sound like they aren't. RBS-Replaced the word OPERABLE with FUNCTIONAL in the stem to make it clear to ask about the ability of the valves to operate. Question now SAT.

80 H

4 X

N U

S REFERENCE PROVIDED. I think the question is cued with the reference provided. It is not plausible that one would chose 17 days without any indication that there was any restoration in the interim. That said, I believe the question is satisfactory without the reference provided.

RBS-Removed TS reference from question and attached the TS section to the examintion as a provided reference. This is to due to the TS call

>1hour not made from memory. Question now SAT, however, the question should indicate Revision 1 as the reference was removed from the body of the question.

RBS: Added Rev 1 to question and described revision changes. Added student handout for TS 3.8.1.

81 F

3 B

E S

Add to the stem, "According to the tech spec bases, what is the basis " Some concern that one could argue B as a correct answer without that clarification. Grand Gulf 2013 exam question 77. RBS-Added "According to the tech spec bases" to the stem. Question now SAT.

82 H

3 B

S March 2014 exam question 92.

83 H

3 N

E S

Part 1 in stem, instead of stem stating " (EBOP) IS/IS NOT operating" change to " (EBOP) operating" and leave part 1 distractors as/is. Free Review Question.

RBS-Removed IS/IS NOT from the stem. Question now SAT.

ES-401 12 Form ES-401-9

1. LOK 2. LOD 6

7 8

Q#

(F/H)

(1-5) stem focus cueing T/F cred dist partial job link minutia

1. /

units back-ward K/A SRO-only B/M/N U/E/S Explanation

3. Psychometric Flaws

4. Job Content Flaws

5. Other 84 H

3 N

E S

REFERENCE PROVIDED. For part 2 distractors A and C, add the word "ONLY" (all Caps). Free Review Question.

RBS-Added the word ONLY to answers A and C.

Question now SAT.

85 H

3 N

S REFERENCE PROVIDED. Swap distractors B and D, no change to correct answer. Free Review Question. RBS-Reordered distractors from smallest to biggest.

86 F

3 N

S I believe the question to be suficiently different from 2016 exam question 88 to be considered a new question, not a modified bank question. RBS-Rev 1 Changed question source from modified to new.

87 F

3 M

S Swap distractors A and B, and C and D, making D the correct answer. Modified from 2016 exam question 51.

Free Review Question. RBS-Reordered distractors from smallest to biggest.

88 H

3 N

S REFERENCE PROVIDED. Free Review Question.

89 H

3 N

S REFERENCE PROVIDED. Distractor analysis for distractor A has "ENSL" instead of "ENCL" RBS-fixed typo.

90 H

3 X

N U

E S

I don't believe asking power supplies qualifies as common mode electrical failure. RBS-Rewrote the question to better meet the K/A. Question still does not meet the K/A for whether the failure is due to COMMON MODE.

Resampled K/A to AA2.13. RBS - Rewrote the question to the new K/A. In the distractor analysis, please indicate that minutes is plausible because that is the time after scramming the reactor that the UO Operator will locally initiate a Reactor Scram and a full NSSSS Isolation at the RPS MG sets and EPA breakers at CB 116. Question now EDIT. RBS - Added note to distactor analysis.

Consider changing part one of question to time of inserting confirmatory scram signal to make question more discrimanatory. RBS - Changed part one of question to time to insert confirmatory scram signal and a full NSSSS Isolation. Question now SAT.

91 H

4 N

S 92 H

3 N

S REFERENCE PROVIDED.

93 H

3 N

S Free Review Question.

94 F

3 N

E S

Free Review Question. Add somewhere in the stem that you are specifying on-shift operators. Otherwise, distractor D loses plausibility in that it could be read that any operator, regardless if they were on shift or not. RBS-Added "on-shift" to the stem of the question. Question now SAT.

ES-401 13 Form ES-401-9

1. LOK 2. LOD 6

7 8

Q#

(F/H)

(1-5) stem focus cueing T/F cred dist partial job link minutia

1. /

units back-ward K/A SRO-only B/M/N U/E/S Explanation

3. Psychometric Flaws

4. Job Content Flaws

5. Other 95 F

2 B

E S

Change distractor A to the CRS. More plausible than any SRO. 2014 exam question 96. RBS-Changed distractor A to say The Control Room Supervisor. Question now SAT.

96 F

3 B

S 97 F

3 B

S 2010 exam question 98.

98 F

2 N

E S

I believe the question as written is very close to LOD 1.

Change part 2 in stem to authorize entries into Very High Radiation areas. Change part 1 distractors for C and D to RP Manager (or equivalent). This would change correct answer to B. RBS-Changed distractors C and D to Radiation Protection Manager. Changed the stem from HRAs to say VHRAs. The answer is now B. Question now SAT.

99 F

3 N

S 100 F

2 N

S Free Review Question.