ML22158A161

From kanterella
Jump to navigation Jump to search
Fer 2020 Ile ES-401-9 Written Exam Review Worksheet-Final
ML22158A161
Person / Time
Site: Fermi DTE Energy icon.png
Issue date: 02/05/2021
From: Randy Baker
NRC/RGN-III/DRS/OLB
To:
DTE Energy
Baker R
Shared Package
ML19128A199 List:
References
Download: ML22158A161 (24)


Text

ES-401 Written Examination Review Worksheet Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2. Enter the level of difficulty (LOD) of each question using a 1 (easy) to 5 (difficult); questions with a difficulty between 2 and 4 are acceptable.
3. Check the appropriate box if a psychometric flaw is identified:

Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

Cues: The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length).

T/F: The answer choices are a collection of unrelated true/false statements.

Cred. Dist.>: The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory).

  1. /Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

Backward: The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only. (K/A and license-level mismatches are unacceptable).
6. Enter question source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet criteria of ES-401 Section D.2.f.
7. Based on the reviewers judgment, is the question, as written, (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
8. At a minimum, explain any U status ratings (e.g., how the Appendix B psychometric attributes are not being met).

Page 1 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only General Comments NRC:

1.

Several of the Question Analysis Sheets list the questions as taken from previous NRC ILE Exams in the question header, but do not consistently list the exam under the NRC Exam Usage section.

Response

1.

Each discrepancy has been addressed individually as described for each applicable question below 1

F 2

X N

E S

NRC:

1.

Distractor D plausibility needs grammar corrected.

2.

Why is Distractor A plausible? (What misconception is demonstrated? Isnt feedwater inlet temperature before it enters the downcomer?)

Response

1.

Grammar corrected for Distractor D plausibility statement.

2.

Fermi believes the NRC is referring to Distractor C, not A, since it relates to feedwater inlet temperature. Distractor C changed to refer to core inlet

ES-401 2

Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 2 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only temperature, vice feedwater inlet temperature since, yes, feedwater inlet temperature refers to water temperature before it enters the downcomer.

Distractor C explanation has been enhanced to state This distractor is plausible because candidates are often confused with the term sub-cooling and forget how sub-cooling changes in relation to temperature. While half of the distractor is correct (reducing RPV water level WILL reduce core inlet sub-cooling) this is because core inlet temperature actually raises, not lowers. Note: An alternate version of Question 1 has been written with a new distractor C.

Question is now SAT.

2 F

2 X

B E

S NRC:

1.

Distractor C does not appear plausible, and, as written, Distractor A may be a partially correct subset.

2.

Correct the grammar in Distractor D;... running and the its governor...

FERMI 2018 NRC ILE (Q2)

Response

New version created to address the following:

1.

Distractor C changed.

2.

Distractor A changed to add that, after EDG shuts down, it will remain shut down

3.

Grammar corrected in Distractor D.

Question is now SAT.

3 F

2 N

S NRC: None Response: Question is SAT as written.

4 H

3 N

S NRC: None.

Response: Question is SAT as written.

5 F

2 X

N E

S NRC:

1.

Why is it expected that Reactor Pressure will reach a value of 1096 psig with the plant conditions given? Initial conditions must be reasonable or explained.

Response

1.

Fast closure of an MSIV from 100% power will most certainly cause a reactor scram. It is difficult to determine what causes the scram every time (high reactor pressure or APRM flux) but reactor pressure will certainly rise very close to 1096 psig before the scram occurs. This is why SOP 23.137 requires power to be reduced to 60% PRIOR TO isolating one steam line. The stem could be changed to make it clearer that the MSIV closed fast To clarify this point, the stem has been changed to The plant is operating at 100% power when the Inboard MSIV for one main steam line fast closes Question is now SAT.

ES-401 3

Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 3 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only 6

H 3

X B

E S

NRC:

1.

Need to specify what the initial Rx Power level was in order to determine the allowable pressure endpoint and ensure the 400 psig value is correct.

REFERENCE PROVIDED: 20.000.19 Attachment 1, page 1, Saturated Steam Tables

Response

1.

Fermi disagrees that this is necessary. The stem states that the Reactor Mode Switch was taken to Shutdown, due to the fire, and evacuation to the Remote Shutdown Panel has occurred. Once at the RSD, the initial pressure is given. It is the initial pressure value, prior to commencing the cooldown, that is important, not the initial reactor power. Adding initial reactor power adds unnecessary words to the stem of the question.

2.

Modified stem to state that a startup was in progress. Question is now SAT.

7 H

3 X

X B

U S

NRC:

1.

The stem correctly asks how the Station Air System will respond, but then the applicant is directed to only address the response of the Center SAC. Move the Center SAC response into the answers.

Response

1.

Moved Center SAC response into the answers as requested. Question is now SAT.

8 H

2 N

N U

S NRC:

1.

Fix the format of the two parts of the stem question.

2.

This is a poor K/A and Tier 1 match as it only deals with single system component (not actually Containment) that is not adversely impacted by the abnormal event.

3.

The 2nd part of the question does not strictly tie to this K/A

Response

New version of question has been written to address all NRC concerns.

Question is now SAT.

9 H

3 N

S NRC: None.

FREE SAMPLE Response: Question is SAT as written.

10 H

2 M

E S

NRC:

1.

Distractor A plausibility needs to be enhanced; if applicant memorized the Bank version, they would know that RBHVAC isolates.

PREVIOUS 2 NRC EXAMS (Not Direct from Bank) - FERMI 2018 & 2020 NRC RETAKE (Q10)

ES-401 4

Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 4 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only

Response

1.

Fermi 2 disagrees with this statement. Two versions of this question were presented during exam submittal. One version results in RBHVAC isolating, however, the second version results in no automatic isolations. This is why Distractor A is plausible, because the candidate could recall the 2018 version, in which no automatic isolation occurred, instead of reading the entirety of this version that does result in an automatic RBHVAC isolation. Perhaps the 2018 version was missed because both versions were included in one.pdf document.

Question is now SAT.

11 H

3 N

S NRC: None.

Response: Question is SAT as written.

12 H

3 N

S NRC: None.

Response: Question is SAT as written.

13 F

2 X

B E

S NRC:

1.

Why is Distractor A plausible? Does Torus water cool the HPCI Turbine oil cooler?

VERMONT YANKEE 2014 NRC ILE (Q41)

Response: Question is SAT as written.

1.

Added Bank Source: Vermont Yankee 2014 NRC ILE (Q41) to Answer Explanation (to address general comment at top).

2.

Yes, Torus water does cool the HPCI Turbine Oil Cooler as addressed by Caution 2 of the EOPs that states Operation of HPCI or RCIC turbines with suction temperatures above 140°F causes increased equipment wear, above 170°F may result in equipment damage. This information was added to support plausibility of Distractor A.

Question is now SAT.

14 H

3 N

S NRC: None.

Response: Question is SAT as written.

15 H

2 M

S NRC: None.

FERMI 2015 NRC ILE (Q15)

Response: Question is SAT as written.

16 H

3 N

S NRC: None.

Response: Question is SAT as written.

17 H

3 N

S NRC: None.

Response: Question is SAT as written.

ES-401 5

Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 5 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only 18 F

3 N

E NRC: Separate into three distinct items for first part of question.

Response

1.

Done. Question is now SAT.

19 F

3 N

S NRC:

FREE SAMPLE

Response

20 F

2 N

S NRC: None.

Response: Question is SAT as written.

21 F

3 B

S NRC: None.

GRAND GULF 2002 NRC ILE (Q15)

Response: Question is SAT as written.

Added Bank Source: Grand Gulf 2002 NRC ILE to Answer Explanation (to address general comment at top). Question is now SAT.

22 F

2 X

M B

E S

NRC:

1.

Although the stem wording has been changed, the basic stem question and correct answer remain the same. This may not be significantly modified.

2.

Is Distractor D actually plausible based on how Steam Flow is measured?

DAEC 2011 NRC ILE (Q65)

Response

Changed source from Modified to Bank Added Bank Source: DAEC 2011 NRC ILE to Answer Explanation (to address general comment at top). Question is now SAT.

23 F

2 N

S NRC: None.

Response: Question is SAT as written.

24 H

3 B

S NRC: None.

Response: Question is SAT as written.

25 F

2 N

S NRC: None.

Response: Question is SAT as written.

26 H

2 N

B U

S NRC:

1.

This question relates to Secondary Containment sumps/area water levels, but does not directly tie to interrelations associated with Radwaste => does not match the K/A.

FERMI 2018 NRC ILE (Q26)

ES-401 6

Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 6 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only

Response

A new question version has been written that requires knowledge of which RB sumps input into which Radwaste tanks, which is a direct tie to the K/A Changed source to NEW. Question is now SAT.

27 F

2 N

S NRC: None.

Response: Question is SAT as written.

28 F

2 B

S NRC: None.

FERMI 2012 NRC ILE (Q28)

Response: Question is SAT as written.

1.

Added Bank Source: Fermi 2012 NRC ILO Exam to NRC Exam Usage Cross Reference Table (to address general comment at top).

29 H

3 M

S NRC: None.

PREVIOUS 2 NRC EXAMS (Not Direct from Bank) - FERMI 2020 NRC RETAKE (Q30)

Response: Question is SAT as written.

30 H

3 N

S NRC: None.

Response: Question is SAT as written.

31 H

3 B

S NRC: None.

FERMI 2015 NRC ILE (Q31)

Response: Question is SAT as written.

32 H

3 B

S NRC: None.

FERMI 2015 NRC ILE (Q32)

Response: Question is SAT as written.

33 H

3 B

S NRC: None.

Response: Question is SAT as written.

34 H

2 N

S NRC: None.

Response: Question is SAT as written.

35 F

2 N

S NRC: None.

Response: Question is SAT as written.

36 H

3 B

S NRC: None.

FERMI 2010 NRC ILE (Q38)

Response: Question is SAT as written.

ES-401 7

Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 7 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only 37 F

2 M

S NRC:

1.

Although the stem nomenclature has been changed, the basic stem question and correct answer remain the same. This may not be significantly modified.

PREVIOUS 2 NRC EXAMS - FERMI 2020 NRC RETAKE (Q39)

Response

1.

Clarification added to answer explanation to make it clearer why this is a Modified version of the 2019 Retake Exam Question.

Chief Examiner stated that he will change this question from E to S (Sat) with the question written as-is.

Question is SAT as written and is significantly modified.

38 H

3 B

E S

NRC:

1.

Need to correct question K/A Statement reference to 218000 K3, not A4.

FERMI 2006 NRC ILE (Q49)

Response

1.

K/A link corrected. Removed link to A4 and added link to K3. Question is now SAT.

39 F

3 N

S NRC: None.

Response: Question is SAT as written.

40 H

3 B

S NRC: None.

CGS 2011 NRC ILE (Q40)

Response

Added Bank Source: 2011 CGS NRC Exam to Answer Explanation (to address general comment at top).

Question is SAT as written.

41 F

2 B

E S

NRC:

1.

Place quotation marks around the A and B elements in all Distractors for clarity.

Response

1.

Quotation marks added around the A and B elements in all Distractors AND the stem. Question is now SAT.

42 F

2 B

S NRC: None.

FERMI 2006 NRC ILE (Q56)

Response

ES-401 8

Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 8 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only Added Bank Source: ILO 2006 Exam to NRC Exam Usage Cross Reference Table (to address general comment at top).

Question is SAT as written.

43 H

3 N

S NRC: None.

Response: Question is SAT as written.

44 H

3 N

S NRC: None.

Response: Question is SAT as written.

45 F

3 N

S NRC: None.

Response: Question is SAT as written.

46 H

2 B

E S

NRC:

1.

Correct the grammar in the stem:... describes the LATEST TIME...

Response

1.

Grammar corrected in the stem. Question is now SAT.

47 H

3 B

S NRC: None.

Response: Question is SAT as written.

48 F

2 B

S NRC: None.

Response: Question is SAT as written.

49 H

3 X

N E

S NRC:

1.

Why would Distractor D be considered plausible given the initial conditions in the stem?

2.

Dose the IC - There is no requirement to maintain RCS temperature < or = to 200OF mean a Mode change is permitted?

FREE SAMPLE

Response

1.

Via phone conversation with Chief Examiner on11/3/2020, CE recommended specifying that Mode 4 was recently entered and adding that there are no restrictions that would prevent a MODE change in order to satisfy the two comments above. Both of these changes have been made to the stem of the question. Question is now SAT.

50 H

3 N

S NRC: None.

Response: Question is SAT as written.

51 H

3 B

S NRC: None.

FERMI 2015 NRC ILE (Q44)

ES-401 9

Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 9 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only Response: Question is SAT as written.

52 H

3 M

S NRC: None.

PREVIOUS 2 NRC EXAMS (Not Direct from Bank) - FERMI 2020 NRC RETAKE (Q49)

Response: Question is SAT as written.

53 H

2 N

S NRC: None.

Response: Question is SAT as written.

54 H

2 N

S NRC: None.

Response: Question is SAT as written.

55 H

2 N

S NRC: None.

Response: Question is SAT as written.

56 F

2 B

S NRC: None.

FERMI 2001 NRC RETAKE (Q84)

Response: Question is SAT as written.

57 H

3 X

N E

S NRC:

1.

What does RPB stand for - Rod Permissive Block?

2.

Are the operators required to know the RPB setpoints from memory?

Response

1.

RPB does stand for Rod Permissive Block. However, the distractor explanations were changed and RPB was replaced with Rod Block for consistency.

2.

Yes, Rod Block setpoints are required to be known, from memory. Learning Objective A011: Identify normal, alarm, and setpoint values for significant monitored parameters in the system. Question is now SAT.

58 H

3 N

S NRC: None.

Response: Question is SAT as written.

59 H

3 M

S NRC: None.

Response: Question is SAT as written.

60 H

2 N

S NRC: None.

Response: Question is SAT as written.

61 H

3 M

S NRC: None.

PREVIOUS 2 NRC EXAMS (Not Direct from Bank) - FERMI 2019 NRC ILE (Q61)

Response: Question is SAT as written.

ES-401 10 Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 10 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only 62 F

2 N

S NRC: None.

Response: Question is SAT as written.

63 F

2 X

N S

NRC:

1.

Question does not match K/A. The mechanical vacuum pump and GSE are not an integral part of the OG system and the OG system would not be in operation with the initial conditions specified. The changes in vacuum mentioned in the question are unrelated to the OG system.

FREE SAMPLE

Response

1.

The Fermi 2 Exam Team disagrees that this question does not match the K/A. If the correct answer was related to the GSEs, as mentioned above, then it is agreed that the question would not hit the K/A. However, the correct answer relates to operation of the MVP and its impact on condenser vacuum. At Fermi 2, the MVPs are considered part of the Offgas system, therefore, this is a K/A match at Fermi 2. Evidence of this can be seen as follows:

a.

23.712, Offgas System SOP, has Section 7.0 that is titled System Lineup to Support Mechanical Vacuum Pump, which is a configuration of the Offgas System specific to the MVPs only.

Although the full Offgas System would not yet be in operation, a portion of the system necessary to support and process MVP discharge would be in operation.

b.

At Fermi 2 the Offgas System can be seen on FOS M-2017-1. The MVP is located on this drawing at Grid B-6. Unlike the Gland Seal Exhausters, which are located on their own FOS and at enter the Offgas FOS at Grid B-6, the MVPs are an integral part of the Offgas system.

Question is SAT as written..

64 F

2 X

B E

S NRC:

1.

ADAMS review indicates that this question was not used on the 2009 exam.

(This question was on the 2008 NRC ILE (Q37) and the pedigree needs to be corrected.)

2.

The identified correct answer is C, however the explanation indicates that D is the correct answer.

3.

Are operators required to commit the power supply to all process rad monitors to memory?

FERMI 2008 NRC ILE (Q37)

Response

1.

Revised link from 2009 to 2008 Fermi 2 NRC Exam.

2.

Revised answer explanation to correctly reference C as the correct answer (and A, B and D as distractors)

ES-401 11 Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 11 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only

3.

Yes, Operators are required to know power supplies to process radiation monitors from memory. System Objective A009: Identify the normal and alternate power supplies to system components.. Question is now SAT.

65 F

2 X

N E

S NRC:

1.

Are operators expected to know from memory expected operator actions (other than immediate actions). (Is there a learning objective that states the operator must know these actions from memory? If a reference is provided, this will be a direct lookup.)

Verification of NIAS header pressure is unimportant to the event since the affected line is broke and isolated.

2.

2nd part may be SRO only. (7 day Completion Time for Condition A and 28 psig is given in the Subsequent Actions.)

FREE SAMPLE

Response

1.

New Question version written to attempt to address the comments above and make the question focused more on RO level of knowledge.

2.

The following objectives in LP-OP-315-0016, Containment Systems, are applicable to knowledge required by this question:

B004: Identify alarm response and surveillance procedures associated with the system.

A011: Identify normal, alarm, and setpoint values for significant monitored parameters in the system.

A010: Analyze the conditions for system status such as alarms, automatic actions and interlocks.. Question is now SAT.

ES-401 12 Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 12 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only 66 F

H 2

X N

B E

S NRC:

1.

Uniformly align the numeric values associated with the parameters.

2.

The question is more about identifying whether a safety/thermal limit has been exceeded, than about managing reactivity. Since the first part of the question is related to discrete limits, the corresponding mitigative actions are unnecessary to identify the correct answer. (The mitigative actions referenced are the strongest tie to the K/A, although only a very loose tie.) This is a tie to Tier 3.

3.

LOK should be H for the provided question requires the examinee to evaluate the provided information to determine whether any limits have been exceeded.

The Bank designation may be incorrect.

Response

1.

Numeric values have been better aligned in the stem.

2.

Discussion with the Chief Examiner on 11/3/2020 resulted in the CE determining that this question does match the K/A. At the request of the CE, the following statement was added to the answer explanation: This question matches the K/A because performance of the 24.000.02, Core Thermal Limit Verification, is an administrative procedure used by licensed operators to evaluate for proper reactivity management. The K/A statement is knowledge of procedures, guidelines or limitations associated with Reactivity Management. Administrative limits are only listed in MOP19. The candidate must have specific knowledge of this procedure to determine that conditions in the stem of the question indicate that a limitation associated with Reactivity Management has been exceeded

3.

Changed from F to H. This is a Bank question from the Fermi 2 Exam Bank.

However, it has not been previously used on an NRC Exam.

Question is now SAT.

ES-401 13 Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 13 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only 67 H

2 X

N E

S NRC:

1.

Tier 3 questions are intended to test plant-wide generic topics. The question references the communications associated with a specific EOP mitigation strategy. (Are there other EOP mitigation strategies that require this same type of communications?)

2.

The Reference to 29.100.01 Sheet 1 should be Sheet 1A (ATWS) or state that the transition has been completed.

3.

What is unique about 2D27 that requires an operator to know from memory the alarm setpoint or any expected operator actions. (Provide procedural guidance (ODE-10) for these specific communications requirements. Is this communication requirement only required because of entry into the EOPs?)

4.

Provide applicable Learning Objective for the Communications Requirement.

FREE SAMPLE

Response

1.

The reason why this communication was included as a Tier 3 question is because communication of 2D27 applies to ALL EOP mitigation strategies (ATWS or non-ATWS). Whenever 2D27 alarms, the operator must communicate the alarm and the status of Low Pressure systems due to the significance of this alarm and the fact that it is an indication of unwanted injection to the RPV by LP systems.

2.

Revised stem to clarify where the crew is in the EOPs.

3.

Attachment 1 of ODE-10 contains a list EOP Standardized Communications.

2D27 is significant because it is an indication that unwanted injection of LP systems may occur due to lowering RPV pressure, regardless of which EOP strategy is being implemented at the time. This is evidenced by the fact that ODE-10 provides modifiers to this standard communication depending upon the status of LP systems. ODE-10 states When 2D27 alarms or when reactor pressure is less than 461 psig, announce Reactor Pressure Low - Low Pressure systems are (are not) aligning for injection If Terminate and Prevent has occurred, this should be modified to Reactor Pressure Low - Low Pressure systems are terminated and prevented. The conditions in the stem of the question, although ATWS conditions, are necessary to ensure the candidate applies the correct modifier to this otherwise standard communication.

4.

OP-802-2001, Emergency/Abnormal Operating Procedure contains Objective 9, which states: Consistently apply operations expectations for Communications, et al.

Question is now SAT.

ES-401 14 Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 14 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only 68 F

2 B

E S

NRC:

1.

Answering the 2nd part of the question is immaterial, since once the first part is answered, the correct answer is selected with no need to answer the second part. (Possible combine 2nd part into 1st part if using as a direct from bank.)

2.

Question does meet the K/A, since only Ops and TS/TRM surveillances are treated in this manner but would be a better match if this was applicable to only surveillance procedures.

FERMI 2017 NRC ILE (Q68)

Response

1.

The question has been revised to combine the 2nd part of the question into the 1st part.

2.

As stated above, this question does meet the K/A since it does apply to TS/TRM surveillances.

Question is now SAT.

69 F

2 N

S NRC: None.

Response: Question is SAT as written.

ES-401 15 Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 15 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only 70 F

2 N

E S

NRC:

1.

The answer explanation indicates use of the electrical drawings. The pedigree states that the question is closed reference. Without having to obtain and interpret the drawing(s) the question does not match the K/A. Also, without the drawings, the question borders on minutia. Revise question to clear up use of references.

2.

Suggest focus on the 480V breaker drawing only.

3.

Remove the second paragraph. This will better test the applicants ability to interpret the drawing. Testing the obtain part of the K/A, during a written exam, seems unmanageable due to the numerous copies of references that would be necessary for the examinee select an appropriate drawing from a group of references.

FREE SAMPLE REFERENCE PROVIDED: SD-2548-03, SD-2548-04

Response

1.

Question pedigree corrected to reference provided.

The question was specifically written to ask about BOTH 480V and 4160V breaker operation to address the obtain portion of the K/A. By giving both drawings to the candidates, and asking questions from both drawings, the candidates are required to obtain the correct drawing to determine how (1) 480V breakers respond and (2) how 4160V breakers respond. The following NOTE was added to the explanation for this question: Drawings for both typical 4160V and 480V breakers are provided during this question to require the candidate to obtain the correct drawing to answer the 4160V portion and then obtain the correct drawing to answer the 480V portion of the question. If the candidate only refers to one drawing, and then assumes for example that this applies to both types of breakers, the candidate would answer the question incorrectly. This meets the K/A by requiring the candidate to obtain and interpret both drawings correctly.

2.

The reason for this comment is unclear. Why is it necessary to focus on only the 480V breaker drawing? The reason that both 4160V and 480V breaker drawings are included is to meet the first part of the K/A to obtain the correct reference to answer both parts. If the candidate uses only one drawing to answer both parts, the question will be answered incorrectly. If the candidate obtains the incorrect drawing, when answering either part, then the question will be answered incorrectly. The Fermi 2 exam team recommends maintaining both parts of the question.

3.

The second paragraph is necessary to set up conditions so that the candidate can interpret the drawing to correctly answer the question. Removing the second paragraph could result in questions during, or possible challenges to the question after, exam administration.

Question is now SAT.

ES-401 16 Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 16 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only 71 H

1 2 B

S NRC:

1.

LOD 1; No reference should be provided. Knowledge of emergency exposure limits is knowledge that all radworkers, especially operations personnel should have committed to memory. With the provided reference the question is LOD 1.

(Without reference this question would be a LOD 2)

REFERENCE PROVIDED: ALL of EP-201-03

Response

1.

The Fermi 2 Exam Team disagrees that this is direct lookup. The closest to a definition of direct lookup. ES-301 Page 20 paragraph 6 says Do not use direct lookup questions that only require the applicant to recall where to find the answer to the questionAny questions that do not require any analysis, synthesis, or application of information by the applicant should be answerable without the aid of reference materials. This question requires the candidate to both (1) find the correct table in the reference provided where the information is located, (2) find the correct information in the correct table, and (3) to apply that information, in an equation, to answer the question.

ES-602, Attachment 1, Page 13 of 27 states The key phrase here, direct lookup, conveys the meaning that little mental activity is involved other than simply copying an answer that is readily available in a reference (i.e., simple recall of where to find the information). As stated above, this question requires more than copying the answer that is readily available in the reference. It requires the candidate to apply the information found, to an equation, to come to the correct answer.

2.

The Fermi 2 Exam Team is concerned that removing the reference from the exam will open this question up for a challenge since it was included, with reference provided, on the Fermi 2 2017 NRC exam, which was written and approved under the same revision of NUREG-1021.

Due to previous use on NRC exam with reference, Question is SAT as written.

72 F

3 X

N E

S NRC:

1.

As written, Distractor B appears to be a subset of Distractor D. Distractor D could be enhanced with the following clarification: but your SRD must be retrieved and properly repositioned prior to...

Response

1.

Distractor B means that wearing an SRD in the MCR is not required, because it is a designated clean area. Distractor D means that the SRD may be removed, and placed on a desk, only because of the work being performed at a panel.

Distractor D was re-written as recommended above. Question is now SAT.

ES-401 17 Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 17 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only 73 F

2 X

X N

E S

NRC:

1.

Is there more than one type/classification of LNO in the Control Room?

2.

Provide panel numbers for the locations rather than front of MCR and back-panel.

3.

Distractor A is not semantically correct using the verb Announce vs Inform.

4.

Distractor D can easily be interpreted as second correct answer. The distinction between asking and directing is vague. The quote used as a CRS responsibility is taken out of context; the actual statement is The CRS

[emphasis added] should then prioritize and assign

Response

1.

Yes, per MOP01, the CRLNO has specific responsibilities that other LNOs (such as the P603, or ATC, Operator do not have.

2.

Panel numbers included for locations.

3.

Corrected Distractor A to read inform.

4.

The wording of Distractor D was changed to make a clearer distinction.

Question is now SAT.

74 F

2 N

E S

NRC:

1.

Answer explanation needs to explain why a Fire Protection Inspector is able to fill the vacancy.

2.

Given the responsibility of a Security Officer, the ability to eliminate Distractors A and B by simply guessing is pretty high.

3.

Recommend swapping Distractors B & C.

Response

1.

Added explanation as to why a Fire Protection Inspector is able to fill the vacancy.

2.

Security Officer is a plausible option because (1) they perform rounds throughout the plant, have access to all plant areas, and often fill roles to walkdown areas with inoperable fire detection/protection equipment (fire impairment), (2) it was previously acceptable for a Security Officer to serve on the Fire Brigade, so an examinee who is studying out of date exam questions or could plausibly choose this option.

3.

Distractors B and C have been swapped as recommended.

4.

Reworded second part to specifically state that the individuals are Fire Brigade Qualified.

Question is now SAT.

ES-401 18 Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 18 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only 75 H

2 B

E S

NRC:

1.

The first page of the question identifies the question as a BANK question from the 2018 NRC Exam. On the second page the question is identified as a Bank question, used on ILT 2020 exam. Explain and correct the discrepancy.

2.

K/A is knowledge of response to loss of ALL annunciators. Question is related to a partial loss of annunciators.

3.

LOD 1; With provided reference question is a direct lookup. (Without reference this question would be a LOD 3 or 4.) (100% pass rate on 2018 exam)

FERMI 2018 NRC ILE (Q75)

REFERENCE PROVIDED: ARP 3D19, Annunciator System Trouble

Response

1.

Updated question pedigree to include link to Fermi 2018 NRC Exam.

2.

This question was used, for the same randomly selected K/A statement, on the Fermi 2 2018 NRC Exam. For that exam, the question was submitted for early review because the Fermi 2 Exam Team acknowledged it did not exactly match the K/A statement. Discussion with the 2018 Chief Examiner resulted in the question being allowed to stay on the exam because, although it did not match the exact wording, it did match the intent of the K/A because conditions presented in the stem indicate that a loss of all annunciators will occur on several (P601 through P805) panels. It was also allowed to remain because no K/A exists for a partial loss of annunciators (Note: Rev 3 of NUREG 1123 revises the K/A statement of K/A 2.3.32 to say Knowledge of operator response to loss of annunciators perhaps because of this omission).

3.

The Fermi 2 Exam Team disagrees that this is direct lookup. ES-301 Page 20 paragraph 6 says Do not use direct lookup questions that only require the applicant to recall where to find the answer to the questionAny questions that do not require any analysis, synthesis, or application of information by the applicant should be answerable without the aid of reference materials. This question requires the candidate to utilize information in the stem of the question to navigate through 8 pages of an ARP. The ARP includes a flowchart on Page 6 that the candidate must refer to given the information provided in the stem of the question. Due to the VAS System Hardware Failed and the blackboard condition, the candidate should answer N to the question "have a number of false alarm windows turned on?" This should lead the candidate to review four different sets of tables to determine Data Acquisition Status. Given the failure of MUX A and C, the operator should review Action C, which is located on the next page (page 7). This page describes the impact of a loss of the redundant pair of MUX A&C. A failure of this pair (or any redundant pair, which includes A&C or B&D) will result in a loss of VAS functionality and loss of alarm windows on the P601 through P805 panels. Since the candidate must apply all of the information above to the ARP as described above to answer the question correctly, it does not meet the description of direct lookup in NUREG-1021.

Question is now SAT.

ES-401 19 Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 19 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only 76 F

2 N

S NRC: None.

Response: Question is SAT as written.

77 F

3 X

N E

S NRC:

1.

Distractors associated with trip of RFPs is not credible as this is not a reactor scram signal. Recommend high pressure scram on TCV/TSV closure.

FREE SAMPLE

Response

1.

Changed Distractors C and D to High Reactor Pressure as recommended above. Revised distractor explanations accordingly. Question is now SAT.

78 H

3 N

S NRC: None.

Response: Question is SAT as written.

79 H

3 N

M U

S NRC:

1.

Question is not a KA match. The KA asks for how suppression pool temperature relates to high drywell pressure. The question determines allowed RHR flow as it relates suppression pool temperature to suppression pool pressure and level and not drywell pressure.

LIMERICK 2017 NRC ILE (Q77) - Question is modified by changing the stem provided information and by changing the answer and distractors to focus on what actions should be taken based on the RHR flow curves.

REFERENCE PROVIDED: 29.100.01, Sheet 6, Curves, Cautions and Tables

Response

1.

A new question version has been written. This question is a prime example of starting off on the right track (using the Limerick 2017 question as a starting point) but then deviating too much from the original such that the target K/A was ultimately missed. This new question version more closely aligns to the original Limerick Bank question and, more importantly, therefore hits the K/A.

Why now only 1 pump available?

Question is now SAT.

80 H

3 X

B E

S NRC:

1.

Distractor B to vent the primary containment during a LOCA with drywell pressure only 6 psig is not a credible distractor.

Response

1.

New version created. This version changes correct answer to B (new Distractor is in position C). Still maintained Bank designation due to not meeting NUREG definition for significantly modified.

Question is now SAT.

ES-401 20 Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 20 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only 81 H

2 X

B E

S NRC:

1.

Distractor D is not a credible distractor. With a release in progress exacerbated by a fuel failure, there is no scenario where operators would isolate SBGT who sole purpose is to mitigate the effects of a release.

Response

1.

New version created. This version changes correct answer to C (new Distractor is in position B). Still maintained Bank designation due to not meeting NUREG definition for significantly modified.

2.

Added Bank Source: 2018 NRC Exam.

Question is now SAT.

82 H

2 M

S NRC: None.

COOPER 2017 NRC ILE (Q81) - Question is modified by changing initial conditions and asking different question resulting in a distractor becoming the correct answer for the modified question.

REFERENCE PROVIDED: EP-101, EAL Matrices Response: Question is SAT as written.

Added Bank Source: Cooper 2017 NRC ILE Exam to Answer Explanation section to help address general comment at top. Question is SAT as written.

83 F

2 B

S NRC:

1.

The answer to this question only requires knowledge of safety limits. This is RO level of knowledge (ES-401, Att. 2, Fig 2-1). It does not matter that the distractors may be associated with other TS actions associated with SRO knowledge. To correctly answer this question, you only need to know Safety Limits. (Look at safety limits in the TS. Are the required actions in the bases RO Knowledge?)

NMP2 2010 NRC ILE

Response

1.

The Fermi 2 Exam Team disagrees that this question only requires knowledge of Safety Limits. This question requires candidates to know the Safety Limits of TS Section 2.1, which we agree is RO Level of Knowledge. However, it also requires knowledge of TS Section 2.2, SL Violations, which is NOT RO Level of Knowledge at Fermi 2. There are no Objectives, at Fermi 2, that require ROs to know ANY TS Actions with greater than 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> Completion Times. Since actions for SL violations are >1 hour, at Fermi 2 this makes this knowledge SRO Only.

Agreed - Question is SAT as written.

ES-401 21 Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 21 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only 84 F

2 X

N E

S NRC:

1.

Distractors C and D are not plausible as they are narrow range instruments meant to report level under normal conditions not accident conditions, therefore it would not be plausible that they would be relied upon post-accident.

Recommend using a wide range or medium range instrument. (Agreed - Narrow Range Instrumentation is not routinely PAM instrumentation.)

FREE SAMPLE

Response

1.

New version of question written using, as recommended, wide range instruments. Since all WR instruments in the MCR are PAM instruments, this question version uses WR instruments at the Remote Shutdown Panel, that are relied upon in certain emergencies, and are required by Technical Specifications, but which are not considered PAM instruments.

Question is now SAT.

85 H

2 B

S NRC: None.

PERRY 2009 NRC ILE Response: Question is SAT as written.

Added Bank Source: Cooper 2017 NRC ILE Exam to Answer Explanation section to help address general comment at top. Added wording to the stem to help describe that the transition to Sheet 1A has taken place (to be consistent the Answer and Distractor choices).

Question is SAT as written.

86 F

3 N

S NRC: None.

FREE SAMPLE Response: Question is SAT as written.

87 H

2 N

S NRC: None.

Response: Question is SAT as written.

88 H

3 N

S NRC: None.

Response: Question is SAT as written.

89 H

3 X

N E

S NRC:

1.

Are applicants expected to know AOPs by alpha-numeric titles only and not also their noun name? AOPs in answer/distractors should include their procedure number and name.

Response

1.

Added noun AOP names to answer and distractors as recommended above.

Question is now SAT.

ES-401 22 Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 22 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only 90 F

2 N

S NRC: None.

Response: Question is SAT as written.

91 H

3 B

E S

NRC:

1.

Distractor analysis does not consider Distractor C (only 2 distractors are discussed).

FERMI 2018 NRC ILE (Q91)

Response

1.

Distractor explanations updated to ensure all Distractors are discussed.

2.

Added link in cross reference table to Fermi 2018 ILO Exam to address general comment at the top.

Question is now SAT.

92 H

2 N

S NRC: None.

Response: Question is SAT as written.

93 H

3 N

S NRC: None.

Response: Question is SAT as written.

94 F

2 B

S NRC: None.

FERMI 2017 NRC ILE (Q95)

Response: Question is SAT as written.

Verified link exists in cross reference table to Fermi 2017 ILO Exam to address general comment at the top.

95 F

2 B

S NRC: None.

FERMI 2017 NRC ILE (Q94)

Response: Question is SAT as written.

Added link in cross reference table to Fermi 2017 ILO Exam to address general comment at the top.

96 F

2 N

S NRC: None.

Response: Question is SAT as written.

97 F

2 X

N E

S NRC:

1.

There is effectively no difference between Distractors A and B. In both instances you have a system which would be inoperable, but you are not in the mode of applicability. Recommend replacing Distractor B.

Response

1.

New Distractor B, with distractor explanation, has been added to this question as recommended. Question is now SAT.

ES-401 23 Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 23 of 24 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only 98 H

3 N

S NRC: None.

Response: Question is SAT as written.

99 F

2 N

S NRC: None.

Response: Question is SAT as written.

100 H

2 M

S NRC: None.

ANO1 2017 NRC ILE (Q99) - Modified in that at ANO the security event takes place inside the PA where at Fermi the event is inside the OCA therefore changing the stem and making a Distractor on the original question the correct answer.

REFERENCE PROVIDED: EP-101, EAL Matrices Response: Question is SAT as written.

ES-401 Written Examination Review Worksheet Form ES-401-9 Facility: FERMI POWER PLANT, UNIT 2 Exam Date: DECEMBER 14, 2020 Page 24 of 24 RO TOTALS:

B= 26 F= 32 E= 22 Additional Notes:

M= 6 H= 43 U= 3 (4%)

N= 43 SRO TOTALS:

B= 7 F= 11 E= 5 Additional Notes:

M= 3 H= 14 U= 1 (4%)

N= 15

GENERAL COMMENT

S:

1. Question numbers highlighted as xx are sample test items the facility submitted for pre-review.
2.

Bank questions are indicated by B; Modified are indicated by M; New questions are indicated by N

3.

Questions from the previous 2 NRC Exams: __1__ (RO)/ __0__ (SRO)

4. Average difficulty is __2.48__ on the RO exam and __2.4__ on the SRO exam.
5.

The answer distribution is:

RO

/

SRO A = 17 (23%)

/

6 (24%)

B = 16 (21%)

/

10 (40%)

C = 24 (32%)

/

5 (20%)

D = 18 (24%)

/

4 (16%)

6.

There are __1__ (RO)/ __2__ (SRO) questions with references/attachments provided.