ML19156A493

Es 401-9

ML19156A493
Person / Time
Site:	Dresden
Issue date:	06/05/2019
From:	Exelon Generation Co
To:	NRC/RGN-III/DRS/OLB
Roach G
Shared Package
ML214A858	List: ML19156A493
References
Download: ML19156A493 (16)

Text

ES-401 Written Examination Review Worksheet Form ES-401-9 Facility: DRESDEN NUCLEAR POWER STATION Exam Date: April 18, 2019 Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 (easy) to 5 (difficult); questions with a difficulty between 2 and 4 are acceptable.

3. Check the appropriate box if a psychometric flaw is identified:

Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

Cues: The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length).

T/F: The answer choices are a collection of unrelated true/false statements.

Cred. Dist>: The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory).

1. /Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

Backward: The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SR-only. (K/A and license-level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet criteria of ES-401 Section D.2.f.

7. Based on the reviewers judgment, is the question, as written, (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any U status ratings (e.g., how the Appendix B psychometric attributes are not being met).

Page 1 of 16 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only 1

F 3

B S

2 F

2 B

S NRC Quad Cities 2002 and Dresden 2008 3

F 2

B E

S NRC: Consider replacing the word exit with evacuate. Done Pedigree sheet indicates question appeared on 2010 and 2015 NRC exams.

Question appeared on the 2011 NRC Exam. Fixed - Reflects only 2011 NRC NRC Dresden 2011 Reference in stem: Diagram of control board indication only 4

H 2

X N

S NRC: Applicant should immediately recognize that in Mode 4 (Cold Shutdown), there is no steam pressure for bypass valves or the isolation condenser to be effective at removing heat from the reactor. Therefore, distractors B and C are not credible.

ES-401 2

Form ES-401-9 Facility: DRESDEN NUCLEAR POWER STATION Exam Date: April 18, 2019 Page 2 of 16 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only Response: Question determined to be Satisfactory during on site validation. RX status and water temperature in Mode 4 demonstrate knowledge of a competent candidate. Changed vessel to RPV 5

H 3

X X

B U

S NRC: The stem lacks sufficient focus to elicit the correct answer in that distractor B could be correct. In addition, the applicants are given a RBV lineup that is not in accordance with DOP 5750-02 with two RB exhaust fans and one RB vent fan running.

Response: Changed lineup to make operationally valid stem. With a loss of one RB vent fan (3C) this will cause RB Differential Pressure to become greater.

6 F

3 B

E S

NRC: This question only requires recall of a lesson objective and does not require higher analysis to answer, therefore it should be coded as fundamental/memory.

Response: Now Memory 7

H 2

B E

S NRC: The LOD of the question could be enhanced with only one of the channels alarming. This also will result in an isolation of RBV and an auto start of SBGT.

NRC Dresden 2009 Reference in stem: Diagram of control board indication only Response: Could create double jeopardy with another question on the exam. Believe leaving as is would be appropriate.

8 H

2 B

S NRC Dresden 2015 9

H 3

B S

NRC Dresden 2017 10 F

2 X

N U

S NRC: FREE SAMPLE. Distractor B is a subset of distractor A in that if A were true then B would also require entering TS 3.8.1. In addition, distractor D is implausible; it is unreasonable that an applicant would have the misconception that a higher water level would be adverse to pump operation (and thus EDG operability) since such thinking would be inconsistent with a basic understanding of pump net positive suction head relationships (which is itself a generic fundamentals-level concept).

Response: Question revised to remove subset. Replaced distractor D. Updated pedigree for new distractors.

11 H

3 N

S 12 H

4 N

E S

NRC: Include 2-220-3 noun name in answer choices.

ES-401 3

Form ES-401-9 Facility: DRESDEN NUCLEAR POWER STATION Exam Date: April 18, 2019 Page 3 of 16 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only Response: Noun name added.

13 F

2 N

S 14 F

2 X

N S

NRC: This administrative requirement to notify the TSO is a subsequent operator action in DOA 6500-12 and does not appear to be necessary RO level knowledge.

Does a specific RO level learning objective exist for this?

Response: This is an RO objective.

15 H

3 X

N S

NRC: Fuel Zone level indication is designed to accurately reflect level when water level is below TAF, a condition which will occur after reactor recirculation pumps would have tripped due to ATWS-RPT logic (< -60inches). Therefore fuel zone level is expected to be accurate with no RR pumps running. As such, distractors B and D can be disregarded as this transient would not be expected to cause the difference in level indication to become larger with no RR pumps running.

Response: Question determined to be Satisfactory during on site validation.

Knowledge that the FZ level instruments are affected by the status of RR pumps demonstrates knowledge of a competent candidate. The stem indicates the RR pumps are tripped. FZ level instruments also reflect level prior to TAF.

16 F

2 X

N S

NRC: Distractor D is not credible for average air temperature in the Drywell under normal conditions when considering environmental quality of equipment in containment.

Response: Distractor determined to be credible during on site validation due to 281F being the design basis for the drywell. Blowdown is not required until 338F.

17 H

4 B

S NRC Dresden 2015 18 F

2 X

N U

S NRC: 1) Choices 2 and 3 (correct answers) can be related, and thereby choices 1 and 4 eliminated, without reading the question.

2) Question is a basic fundamentals question to recall indications of low NPSH (cavitation).

3) Recommend having applicants determine based off of given control board indications, for example.

Response: Changed answer and distractors to 3 of 4 format to eliminate concern with related distractors. Revised pedigree to reflect new answer/distractor format.

19 H

2 B

S NRC Dresden 2011 and 2015 Reference Provided in Stem (HCTL Curves)

ES-401 4

Form ES-401-9 Facility: DRESDEN NUCLEAR POWER STATION Exam Date: April 18, 2019 Page 4 of 16 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only 20 H

3 X

B E

S NRC: Distractor C is not credible and its explanation appears to be contrary to DOA 0600-01 in that if RPV level is set as follows when level is < -30; AFTER one (1) second, THEN: IF reactor water level is < -30 inches, THEN MASTER/Low Flow FWRV demand changes as necessary to maintain reactor water level at the setpoint setdown setpoint. Therefore, a more credible distractor would state after one second, they will position to maintain RPV level at -10 inches.

Justification for distractor B is an incomplete thought and needs to be made more clear.

Response: -10 is new distractor. Completed thought for B justification 21 H

2 N

E S

NRC: Spell out the word pumps in the stem.

Response: Revised stem as directed.

22 H

3 B

S NRC Dresden 2012 Reference in stem: Diagram of control board indication only 23 H

2 B

E S

NRC: Reword Bus 34-1 goes overcurrent (ex. Bus 34-1 experiences an overcurrent condition or An overcurrent condition occurs on Bus 34-1)

Response: Revised stem as suggested.

24 H

3 B

S FREE SAMPLE.

25 F

2 B

S NRC Dresden 2006 26 F

2 X

B E

S NRC: Distractor D is not credible as hot reactor water leaking into the IC shell or operation of the heat exchange process with a three valve leak would clearly heat up the shell water.

Response: Revised distractor D as agreed during on site validation.

27 H

3 X

B U

S NRC: If the applicant can determine the correct answer for Part 1 (only vortex limits are exceeded), then part 2 is irrelevant. The applicant only needs to know 1/2 of the question to determine the correct answer. A true 2x2 question would remedy this.

Distractor analysis indicates that if both NPSH and Vortex limits were exceeded the CS pump would have to be shutdown. This appears to be contrary to EOP DEOP-

ES-401 5

Form ES-401-9 Facility: DRESDEN NUCLEAR POWER STATION Exam Date: April 18, 2019 Page 5 of 16 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only TB, which states The NPSH and Vortex Limits are implemented as a caution rather than explicit operating limits to provide necessary event-specific flexibility and to avoid potential conflicts between concurrent parameter control paths:

• It is difficult to define in advance exactly when NPSH and Vortex Limits should be observed and when pumps should be operated irrespective of the limits.

Reference Provided attached to exam (DEOP 100 redacted)

Response: Revised part 1 of distractor A to Vortex limits ONLY. NPSH limits must be evaluated to determine correct answer. Flooding of containment would be required by the SAMGs if the pump was secured.

28 H

3 X

X B

U S

NRC: If the applicant can determine the correct answer for Part 1 (what is supplying the ESS Bus), then part 2 is irrelevant. The applicant only needs to know 1/2 of the question to determine the correct answer. A true 2x2 question would remedy this.

In Bullet 2, the word action should not be plural.

Response: Revised to 2x2 format. Revised bullet 2. Replaced its after ESS Bus with the.

29 H

2 B

S 30 H

2 N

S 31 F

4 B

S 32 H

2 X

X N

E S

NRC: Distractor D appears to cue that it is incorrect in that it states rod withdrawal and insert blocks to stop erroneous withdrawal of a control rod. Perhaps wording the distractor erroneous movement of a control rod would serve to eliminate cuing in this instance.

Withdrawal is spelled incorrectly in all answer choices.

Response: Corrected spelling errors. Revised distractor D as suggested.

33 F

2 N

S 34 H

2 X

N E

NRC: Need a comma after 902-4 C-22, for exam consistency.

ES-401 6

Form ES-401-9 Facility: DRESDEN NUCLEAR POWER STATION Exam Date: April 18, 2019 Page 6 of 16 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only S

Should simplify 2nd bullet - 902-3 panel, LI 2-1602-3, Torus Narrow Range Level, indicates +1.0 inches, for example.

K/A IR for the RO is incorrect in pedigree - RO 3.9 Response: Revised question as suggested. RO pedigree IR corrected.

35 H

2 X

X B

S NRC: Distractor D is not plausible in that a single IRM HI HI would affect both channels of RPS. In addition, if this were plausible, the question stem would require the condition of the mode switch to be included at the time of the startup.

Response: Applicant is required to deduce the position of the mode switch at this point. Which makes D plausible if the shorting links are not installed.

36 F

4 X

X X

N S

NRC: FREE SAMPLE. Knowing the panel designation where a particular indication within the control room is located represents a level of detail that is too specific for a closed-book written examination.

Will distractor D, 902-5, A-1 condition come in before IA header pressure reaches 55 psig? In addition the stem indicates that Division II bus 26 is OOS and then states that the 2B IAC tripped, should this be the 2A IAC?

Response: Question determined to be Satisfactory during on site validation.

Immediate Operator action from DOA. It is still possible for 902-5 A-1 to come in prior to 55 psig on the gauge however, this is subsequent actions of DOA and monitoring of actual IA pressure is on the 923-1 Panel. Aligned case assignment of the word Panel.

37 H

3 X

B S

NRC: Distractors A & B are not plausible as they are AC power supplies.

Enhancement as this was a previously approved NRC exam question.

NRC Dresden 2011 Response: Question determined to be Satisfactory during on site validation.

Distractors are plausible because they are power supplies directly related to ERVs.

38 F

2 X

B E

S NRC: Combine stem statements and reword to state: On a loss of off-site power (LOOP) concurrent with a loss of coolant accident (LOCA), loads are sequenced onto the Emergency Busses because the Distractors C and D need better explanations for why they are credible. The explanation provided centers around the EDG not having an emergency trip for

ES-401 7

Form ES-401-9 Facility: DRESDEN NUCLEAR POWER STATION Exam Date: April 18, 2019 Page 7 of 16 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only OVERLOAD. This is unrelated to LPCI/CS pump performance or LPCI Loop Select logic.

NRC Dresden 2010 Response: Revised distractor explanations for C and D. Revised stem as suggested.

39 H

2 X

N E

S NRC: Distractor A is not credible as the stem of the question indicates that a U2/3 DIESEL GEN TROUBLE alarm has been received. It is not credible that the applicant will believe that the U2 EDG is running without cooling water and the U2/3 EDG is running normally. Indicating that the 2/3 EDG is running without cooling water and the U2 EDG is running normally is more credible.

Response: Revised distractor A. Revised pedigree to align. Added title of DOS 6600-08 Attachment A to stem. Added the word pumps to choices B, C, and D.

40 H

2 X

X B

S NRC: The SBGT system is the only component listed that could be impacted by the fact that one of the Reactor Building Vent Rad Monitors is out of service. Since all the other components are not affected by the RB Vent Rad Monitors it is easy to conclude that there is more to the question than simply the loss of Bus 29.

Distractor B is not a credible distractor as this pump would not be running with the plant at rated conditions. While it would certainly lose power if bus 28 were lost.under these conditions, as a piece of equipment solely used during shutdown, it is not likely an applicant would be inclined to select this answer.

Response: Question determined to be Satisfactory during on site validation. A pump does not need to be running to lose power, in addition an RWCU isolation will occur due to HELB isolation on loss of Bus 29. No stem cueing occurred due to RB Vent Rad OOS. If the correct answer were a distractor this information would be included in the stem to make it plausible.

41 H

3 B

S 42 H

2 B

S NRC Dresden 2010 43 F

2 X

X N

E S

NRC: FREE SAMPLE. Distractor B is not plausible as there is no condition that the plant would be maintained critical with no reactor recirculation pumps running.

With only one active alarm, how is the ability, to prioritize, tested?

Response: Added two additional annunciators to stem. Changed distractor to address criticality with no recirculation pumps operating. Enhanced K/A justification.

ES-401 8

Form ES-401-9 Facility: DRESDEN NUCLEAR POWER STATION Exam Date: April 18, 2019 Page 8 of 16 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only 44 H

2 X

X N

S NRC: The question tests knowledge of the RPS trip set-point. The cause/effect is given in the stem and not required to answer the question.

Response: Question determined to be Satisfactory during on site validation. The question tests the candidate knowledge of the cause-effect based on system actuation.

45 F

2 B

S Response: Added word is to stem. Removed previous choice 3, moved 4 and 5 to 3 and 4 respectively and aligned answer and distractors to new numbering scheme.

46 F

2 B

S NRC: LOD 1. Does not adequately discriminate for operator competency. Effectively asking for three inputs of 3 element level control.

Response: Question determined to be Satisfactory during on site validation.

NRC: Question was reassessed as LOD=2.

47 H

2 N

S 48 F

4 N

S 49 F

4 X

N S

NRC: Some Extraction Steam AOVs will fail open and some will fail as is. Extraction steam non-return check valves have air operators, but will continue to operate normally until the turbine trips.

In the answer explanation (B) it states that the valves fail open to prevent a turbine trip. Explain Response: Turbine is designed to operate without feedwater heaters without undue stress on any part of the turbine. The valves fail open to prevent turbine trip based on feedwater heater level.

50 H

3 N

E S

NRC: Applicant has to assess plant conditions (number of on-service demineralizers vs. total number and then assess how to respond to a high differential pressure across the demineralizers.

Response: Changed to High. Replaced damaging with channeling for choices A and D.

51 F

2 B

S NRC Dresden 2012 52 F

2 N

S

ES-401 9

Form ES-401-9 Facility: DRESDEN NUCLEAR POWER STATION Exam Date: April 18, 2019 Page 9 of 16 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only 53 H

2 X

M S

NRC: If this is an electrical ATWS, why wouldnt control rods be inserting after ARI has been initiated?

This question was modified from a question on the 2010 NRC exam in that a significant condition in the stem changed (was not an ATWS in the original question) and therefore the answer changed.

NRC Dresden 2010 Response: Question determined to be Satisfactory during on site validation. This is possible because the failure of ARI to work does not mean the valves repositioned.

Given the information the candidate can definitively determine there is an electrical atws - Example: pulling of ATWS-ARI Fuses.

54 H

2 B

S NRC: FREE SAMPLE.

NRC Dresden 2010 55 F

3 X

B E

S NRC: Per ES 401, D.2.a Tier 3 questions should not be an extension of Tier 2 systems knowledge. In this instance, specific knowledge of the Nuclear Instrumentation Tech Spec is required. A question about the 3.0 (motherhood) TS would be acceptable in meeting the KA.

In addition, answering this question only required memory/fundamental knowledge.

Response: Question determined to only require an enhancement during on site validation. LOK revised. Question covers the generic Tech Spec concept of adding a 25% grace period to late surveillance criteria.

56 F

3 X

B E

S NRC: Per ES 401, D.2.a Tier 3 questions should not be an extension of Tier 2 systems knowledge. This KA specifically asks for a system based question. As a result, it will need to be replaced. Recommend replacing with randomly selected KA 2.2.12, Knowledge of surveillance procedures.

Response: Question determined to only require an enhancement during on site validation. Added stored to stem. Required shielding for irradiated fuel considered a generic topic of Technical Specification requirements.

57 F

3 X

X B

E S

NRC: Per ES 401, D.2.a Tier 3 questions should not be an extension of Tier 2 systems knowledge. In this instance, specific knowledge of the Torus water level Tech Spec is required. 3.0 TS are appropriate for a tier 3 question.

ES-401 10 Form ES-401-9 Facility: DRESDEN NUCLEAR POWER STATION Exam Date: April 18, 2019 Page 10 of 16 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only The stem has two 2) bullets. The Torus water level Technical Specification should be listed as 3)

Response: Question determined to only require an enhancement during on site validation. Corrected the bullet numbering error.

58 F

2 B

S NRC Dresden 2006 Response: Reworded stem to include being administered as part of their Annual Requal Exam 59 F

2 N

S Response: Reworded stem to include due to a loss of high pressure feed. Fixed typo in pedigree to reflect D as correct answer.

60 F

3 B

S NRC Dresden 2015 61 F

2 N

S 62 H

3 N

S 63 F

2 N

E S

NRC: No analysis or evaluation is required. This is an expected response for any Sec Ct area temperature above MAX NORMAL.

Second bullet is awkwardly worded.

Answer explanation for D should specifically include reference to OP-DR-103-102-1001 since this response is not required by the DEOP.

Response: Revised second bullet as suggested. Revised LOK. Added OP-DR reference. Reworded stem to replace to operate with of.

64 F

2 N

S 65 H

3 N

E S

NRC: Distractor explanations incorrectly indicate D instead of C as correct answer.

The first sentence of the stem needs to specify in which system the AHU is running; e.g., the sentence should start out with With regards to the Control Room HVAC system OR with the Control Room HVAC A AHU running.

Response: Added control room ventilation to stem for clarity. Revised answer explanations.

ES-401 11 Form ES-401-9 Facility: DRESDEN NUCLEAR POWER STATION Exam Date: April 18, 2019 Page 11 of 16 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only 66 F

4 X

N S

NRC: FREE SAMPLE. Knowing the panel designation where a particular indication within the control room is located represents a level of detail that is too specific for a closed-book written examination.

Response: Question determined to be Satisfactory during on site validation as this is a panel/component that a licensed RO would be expected to take regular logs on as a part of their licensed duties.

67 H

3 X

B S

NRC: As the operator will have to reset a half scram once the RPS bus is reenergized, the stem should indicate What is the initial required operator action?

NRC Dresden 2011 Response: Question determined to be Satisfactory during on site validation.

68 H

3 B

S Added note to explain operation of the 1402-24A/B valves and CS Logic description.

69 H

2 X

X N

S NRC: Distractor A is not credible with both APRM 1 and 6 having 11 out of tolerance inputs.

Response: Question not revised based on discussion during on site validation.

70 F

3 X

B S

NRC: Question indirectly addresses battery charging/discharging rates as it covers loss of a battery charger. Only requires fundamental knowledge of what power supply supports which battery charger.

NRC Dresden 2011 Response: Question determined to be Satisfactory during on site validation. Applicant must also understand that loss of charger will cause discharge and lowering voltage of battery affected. Corrected power supply in pedigree for 3B 250 VDC BOP Battery Charger.

71 F

2 X

N E

S NRC: Distractor A is not credible as HPCI is initially aligned to the CST as a suction source, and there would be no reason to separate NPSH concerns for HPCI as compared to the low pressure ECCS pumps in distractor B. Perhaps a distractor that focuses on water level providing seismic stability for the downcomers.

Response: Question determined to be Satisfactory during on site validation. The candidate must have knowledge of the normal HPCI lineup. HPCI can be lined up to Torus, although not the normal line up. Enhanced distractor B plausibility.

ES-401 12 Form ES-401-9 Facility: DRESDEN NUCLEAR POWER STATION Exam Date: April 18, 2019 Page 12 of 16 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only 72 H

4 N

S Response: Added EPNs for valves.

73 F

2 X

B E

S NRC: Per ES 401, D.2.a Tier 3 questions should not be an extension of Tier 2 systems knowledge. In this instance, specific knowledge of the HPCI Tech Spec is required. 3.0 TS are appropriate for a tier 3 question.

Change FRAGNET to work window or out of service period, something that will be clearly understood by the applicants.

NRC Dresden 2015 Response: Replaced with randomly generated K/A provided by NRC to meet Tier 3 criteria. Question has been replaced.

74 H

2 N

S 75 H

2 X

N U

S NRC: The stem clearly indicates a HPCI leak outside primary containment. There are no adverse primary containment conditions that exist in the stem, therefore distractors A and D are not credible for the applicant to believe that DEOP 200-1 entry conditions are met.

Response: Changed formatting of question to make candidates select from a series of DEOPs. Changed X-area temp and value to Drywell temp and a lower value.

Changed DEOP 300-1 rad levels to below max safe. Changed pedigree to match.

76 F

2 X

B E

S NRC: FREE SAMPLE. KA statement listed in pedigree does not match NUREG 1123 KA for generic 2.1.40, Knowledge of refueling administrative requirements.

Question is still considered a KA match.

NRC Dresden 2008 Response: Wording has been corrected in pedigree 77 F

2 X

B E

S NRC: FREE SAMPLE. Distractor D includes the actual requirement that the performed shift activities must be under the direction of an operator or senior operator and in the position to which the individual will be assigned. The correct answer does not include this requirement. The correct answer should include this requirement to be fully accurate and distinguishable from a distractor which includes it.

NRC Dresden 2008 Response: Revised correct answer to include requested information

ES-401 13 Form ES-401-9 Facility: DRESDEN NUCLEAR POWER STATION Exam Date: April 18, 2019 Page 13 of 16 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only 78 F

3 X

B E

S NRC: Recalling whose permission is required for a radioactive release under certain plant conditions is fundamental knowledge.

The justification for the SOS approval seems inadequate, as it is abnormal that the SOS would verify calculations associated with a release.

NRC Dresden 2015 Response: Question determined to be Satisfactory during on site validation. The SOS distractor has been enhanced. Revised LOK.

79 F

2 B

S NRC: The distractor analysis is confusing and seems to be inaccurate in that contrary to TS LCO Bases 3.8.1, it implies the U2 EDG is not required.

Response: Question determined to be Satisfactory during on site validation. The distractor analysis I taken directly from the TS LCO Bases.

80 H

2 X

B S

NRC: With DEOP 200-1 provided, it would only require RO knowledge of DEOP entry conditions to correctly answer the question. The flow chart provides all the other information the applicant would need making this also LOD 1.

NRC Dresden 2010 Reference Provided (DEOP 200-1 with entry conditions blanked out)

Response: Question determined to be left as is during on site validation. LOD 2.

Requires analysis, decision making and direction of DEOP action steps. SRO level knowledge.

81 F

2 X

X B

U S

NRC: FREE SAMPLE. This question is considered UNSAT as it does not meet SRO only criteria in that contrary to ES-401, Attachment 2, Figure 2-2, the question can be answered solely by knowing systems knowledge (how the system works, flowpath, logic, component location).

NRC Dresden 2015 NUREG-1021 ES-401, section D.2.a, states ensure that the questions selected for Tier 3 maintain their focus on plantwide generic K/As and do not become an extension of Tier 2. Tier 2 of the written exam outline consists of plant systems topics. Eliminating the distractors and selecting the correct answer for this question

ES-401 14 Form ES-401-9 Facility: DRESDEN NUCLEAR POWER STATION Exam Date: April 18, 2019 Page 14 of 16 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only appears to require the application of knowledge that is associated with Tier 2 topic 207000 (Isolation Condenser).

Response

Replaced with randomly generated K/A provided by NRC to meet Tier 3 critera.

Question has been replaced.

82 H

2 X

N S

NRC: Distractors A and B are not credible, as raising recirculation pump flow is not an initial action taken on a reactor power transient. In addition, with the plant initially at 100% power, 2B RR pump speed would already be near maximum demand.

Response: Question determined to be Satisfactory during on site validation.

Recovery with QNE concurrence is allowed to exit the BSP proximity region by increasing flow per Dresden Abnormal Operating Procedures. At full power RR pump speed is approximately 85%

83 H

2 N

E S

NRC: Extra spacing after 902-5 A-1 alarm and is received Response: Revised as suggested.

84 H

3 N

S Reference Provided (EP-AA-1004 Addendum 3) 85 H

3 N

S NRC: FREE SAMPLE. None.

86 H

2 N

E S

NRC: Answer choice C has the word control misspelled.

Response: Spelling error corrected.

87 H

3 N

S 88 H

2 X

N U

S NRC: Stem does not specifically ask what EOP entry criteria is met.

Question stem asks for EAL thresholds and classification, however, all distractors and answer only address EAL classification and do not address the threshold.

Reference:

Reference Provided (DEOP 300-1 and previously provided EP-AA-1004)

Response

Removed DEOP classification from stem. Changed one distractor to RU3. Changed references required to reflect EP-AA-1004 Addendum 3

ES-401 15 Form ES-401-9 Facility: DRESDEN NUCLEAR POWER STATION Exam Date: April 18, 2019 Page 15 of 16 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only 89 H

3 N

S Reference Provided (TS 3.3.1.1) 90 H

2 B

S NRC Dresden 2015 91 H

3 N

S 92 H

3 N

S 93 F

3 N

S 94 H

4 X

X N

S NRC: Distractor C could be correct as there is no indication in the stem with regards to whether any injection sources are operating. DEOP 100 would have the operator blowdown prior to reaching MSCWL if an injection source is running or enter DEOP 400-3 if none are running once TAF is reached.

Response: Question determined to be Satisfactory during on site validation.

Candidates are directed to assume plant functions as designed (Appendix E). The stem provides multiple parameters that would cause an ECCS initiation signal and none that would prevent available ECCS systems from operating. Only after making these determinations can the candidate make an informed decision and arrive at the correct answer.

95 H

2 N

S 96 H

2 X

N E

S NRC: The word the appears twice in the statement, Over the next 3 minutes Response: Stem revised as suggested.

97 H

3 X

N E

S NRC: Should the question indicate that the surveys have existed for over 60 minutes or are expected to exist for at least 60 minutes in order to trip the EAL threshold for a field survey?

Reference Provided (Site map and EP-AA-1004 Addendum 3)

Response: Revised stem to provide that the dose rates are as measured by a field survey which satisfies the requirement for EAL classification.

98 H

4 N

S 99 H

3 X

X B

U S

NRC: Is there any scenario when Automatic FWLC would by design lower RPV water level to -35 or - 55 inches? If not distractors A and C are not plausible.

Distractor D does not indicate in manual or automatic operation of the FWLC system, serving as a cue this is not a plausible distractor.

ES-401 16 Form ES-401-9 Facility: DRESDEN NUCLEAR POWER STATION Exam Date: April 18, 2019 Page 16 of 16 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only Response: Revised answers and distractors to 2x2 format and to align with operating procedures and EOP basis. Added bullet to stem to indicate immediate operator actions for an ATWS have been completed to for clarity of plant conditions..

100 H

2 N

S RO TOTALS:

B= 39 F=35 E= 22 Additional Notes: 6.7% of RO Questions assessed as unsatisfactory.

M= 1 H=40 U= 5 N= 35 N=18(HCL)

SRO TOTALS:

B= 8 F=6 E= 8 Additional Notes: 8% of SRO Questions assessed as unsatisfactory.

M= 0 H=19 U= 2 N= 17 N= 16 (HCL)

GENERAL COMMENT

S:

1. There are 5 (RO) / 5 (SRO) questions with references/attachments provided.

2.

Questions from the previous 2 NRC Exams: _1_ (RO) / _0_ (SRO)

3.

Average difficulty is __ 2.52_ on the RO exam and 2.56 on the SRO exam.