Text

April 2021 Initial License Exam Form ES-401-9
	ML22236A639
Person / Time
Site:	Dresden
Issue date:	05/14/2021
From:	Chuck Zoia; NRC/RGN-III/DRS/OLB
To:	; Exelon Generation Co
	Zoia C
Shared Package
ML20136A313	List: ML22236A330; ML22236A332; ML22236A333; ML22236A384; ML22236A637; ML22236A638; ML22236A639; ML22236A640;
References
	50-237/21-301, 50-249/21-301 50-237/OL-21, 50-249/OL-21
	Download: ML22236A639 (21)
	v • d • e

ES-401 Facility: Dresden - April 2021 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 1 F 2 B S 2011 Cert Exam 08-1 NRC Exam, 11-1 Cert Exam; 2X2 NRC: Please clarify in the pedigree; why is it that main condenser overpressurization could occur but is not the primary concern for this question?

Response

Revised the pedigree of the two distractors dealing with condenser overpressurization to state the following: Part two is plausible because 2 F 2 B E overpressurization of the main condenser is a concern at the plant, which is why the condenser has atmospheric relief diaphragms installed to protect it. If too much steam is supplied to the main condenser, it could result in an increase in Main Condenser pressure and cause these diaphragms to rupture. The steam from the extraction check valves, in the example given, is sent to the main condenser, after going through the turbine, but is too small to have a direct impact on main condenser pressure.

NRC: Updated question is SAT.

Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 (easy) to 5 (difficult); questions with a difficulty between 2 and 4 are acceptable.

3. Check the appropriate box if a psychometric flaw is identified:

$ Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

$ Cues: The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length).

$ T/F: The answer choices are a collection of unrelated true/false statements.

$ Cred. Dist>: The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

$ Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

$ Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

$ Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory).

$ #/Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

$ Backward: The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only. (K/A and license-level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet criteria of ES-401 Section D.2.f.

7. Based on the reviewers judgment, is the question, as written, (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any U status ratings (e.g., how the Appendix B psychometric attributes are not being met).

Page 1 of 21

ES-401 Facility: Dresden - April 2021 2 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 3 F 3 B S 10-1 and 18-1 NRC Exams; Embedded Reference 4 H 3 B S 18-1 NRC Exam 5 F 3 B S 2009 NRC Exam; 2X2 2X2 NRC: It is implausible to have pump cavitation occurring, as indicated by all possible answers, without vibration. As a 2X2 question, this results in 2 implausible distractors.

U 6 H 2 N Response:

S This question was validated by 6 operators and had a 66.7% validation rate.

Therefore, we believe that the original question is discriminating, and is not implausible. Revised question to a 1 x 4.

NRC: The revised question is SAT.

2017 NRC Exam; ~2X2 NRC: It is implausible that the Unit 2 Isolation Condenser would isolate upon a loss of 125 VDC Bus 3B-1 (versus 125 VDC Bus 2B-1). As a ~2X2 question, this results H

7 3 B E in 2 implausible distractors.

F

Response

Provided a new 1 x 4 question.

NRC: The updated question is F and SAT.

15-1 NRC Exam; 2X2 NRC: It is necessary to put together a couple pieces of information to answer the F question correctly - so why isnt this a higher cognitive level question?

8 3 B E H Response:

Changed to High Cognitive level.

NRC: The updated question is H and SAT.

9 F 3 B S 11-1 NRC Exam, 15-1 NRC Exam, 16-1 Cert Exam 2017 NRC Exam NRC: Include in the pedigree why this question is considered RO knowledge - does it apply to a learning objective? Please clarify.

10 F 2 B E

Response

Per the Fac Rep, ROs are expected to know the requirements for standing orders, including what they can be used for. The distractors address uses of standing orders for tasks which would not meet the procedural adherence or technical specification Page 2 of 21

ES-401 Facility: Dresden - April 2021 3 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only usage requirements, and would fall outside of allowable standing order allowable usage.

NRC: The updated question is SAT.

NRC: Bolding NO, and having it appear in two (correct or partially) distractors could be considered cueing. Consider using another incorrect value for distractor A and remove the bolding from the correct response.

Response

Removed the BOLD from NO in the answers A and B, but did not otherwise 11 H 3 ? N E change the answer for distractor A, since a review of the question shows that changing the value of boron being injected in part 1 of distractor A would invalidate part 2 of that answer. This is because the decision to inject with Alternate SBLC would only valid if boron is NOT injecting.

NRC: The updated question is SAT.

2X2 NRC: The Answer Explanation needs to specify how the question addresses the K/A for the operational implications of Secondary containment integrity, versus 12 F 3 ? N E validating the alarm and what the actual RB DP is.

Response

Provided a revised version of this question.

NRC: The revised question is SAT.

NRC: The pedigree for distractor A needs to specify that it would also be in for a Channel A, since it is already in for Channel B.

Response

13 F 2 B E Added to the pedigree for distractor A: For a successful SCRAM to occur, annunciator 902-5 D-10, CHANNEL A RX SCRAM annunciator would also be alarming.

NRC: The updated question is SAT.

NRC: Is the term degraded voltage significant in identifying the correct answer? If so, perhaps lower voltage should be used to describe the condition.

Response

14 H 3 ? B E Changed degraded voltage to low voltage in the question and pedigree. Revised stem of question to clarify that voltage just dropped to 3700 VAC, and that it remains at that level.

NRC: The updated question is SAT.

Page 3 of 21

ES-401 Facility: Dresden - April 2021 4 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 08-1 NRC Exam; 09-1 Cert Exam; 18-1 NRC Exam; Embedded Reference NRC: What is the advantage of expressing SBGT flow with the meter versus simply providing a value? Is an embedded reference beneficial?

Response

15 H 2 ? B E The intent of the meter was to make the question more operationally relevant, by not simply providing the value (the operator must read it). The question was enhanced by removing the embedded reference and adding the actual value of SCFM readings to the answer and distractors.

NRC: The updated question is SAT.

16 H 3 B S 2013 Cert Exam 17 H 3 B S 2010 NRC Exam 2010 NRC Exam, 2012 NRC Exam NRC: There are a couple of typos in the pedigree which need to be addressed, such as BYBASS and the the signal, for example.

18 F 2 B E

Response

Corrected the typos in the pedigree.

NRC: The updated question is SAT.

19 H 2 N S 2X2 20 F 2 B S 2013 Cert Exam; ILT 14-1 NRC Exam; 15-1 Cert Exam 21 H 3 B S 2017 NRC Exam 22 H 2 B S 2017 NRC Exam; 2X2 23 F 2 B S 2008 NRC Exam NRC: While this is an easier question for someone who was a former NLO, putting familiar actions into correct words is more discriminating. For clarity, I recommend labeling the parts of each distractor as 1) and 2) to clearly associate the parts of the given choices to their answers. Also, the pedigree should spell out how the question meets the K/A, citing methodology and procedure references, to address any possible questions.

24 F 2 ? N E

Response

Added 1) and 2) to the question, answer and the distractors to enhance clarity, as recommended.

Procedures OP-AA-109-101, PERSONNEL AND EQUIPMENT TAGOUT PROCESS, and HU-AA-101, HUMAN PERFORMANCE TOOLS AND VERIFICATION PRACTICES, define what type of verification will be used for placing or removing a Page 4 of 21

ES-401 Facility: Dresden - April 2021 5 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only clearance order. Finally, OP-AA-108-101-1001, COMPONENT POSITION DETERMINATION, specifies how the component will be verified. The operator performing the specified verification method (which in this case would be independent verification) must understand how the specified position verification will be performed.

Procedure references were added to the pedigree as a note. (Question ID 27828)

NRC: The updated question is SAT.

NRC: The pedigree and distractors should be modified, as required, to clearly indicate that there is only one correct answer, not a best choice among more than one possibility.

Response

25 H 3 B E Revised the last sentence of the question stem to state the following: Which ONE of the following actions should be taken to provide decay heat removal comparable to the amount lost due to the trip of the 2B SDC Pump? (Question ID 27722)

NRC: The updated question is SAT.

NRC: The pedigree and/or distractors should be modified, as required, to clearly indicate what the possible parameter of primary concern might be. Since no concerns is the correct response, why this is true must be supported

Response

Enhanced question by changing lake temperature to 70 oF, adding that the TBCCW controller was set at 80 oF, and added to the answer pedigree: Since Dresden lake 26 H 2 B E temperature is at 70oF, the TBCCW outlet temperature will not lower below 70oF, which is an allowable temperature per DOP 3800-01, Turbine Building Closed Cooling Water Operation. Therefore, with a failed open TCV, none of the listed equipment would be impacted, and there is no parameter of concern (Question ID 27707)

NRC: The updated question is SAT.

27 H 3 B S Free Look Question #1; 2017 NRC Exam NRC: The pedigree lacks detail of how each of the flow values were determined and/or an Answer Explanation summary to help provide support for the questions required attributes (LOD, distractor plausibility, K/A justification, etc.).

28 F 2 B E Response:

(Question ID 27698)

Updated the explanation to provide the reference for CS pump and LPCI pump nominal flow (TSG-2).

NRC: Updated question is SAT.

Page 5 of 21

ES-401 Facility: Dresden - April 2021 6 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 29 H 3 B S 2017 NRC Exam Free Look Question #2; 2009 NRC Exam NRC: Since this is a modified bank question, please provide the original bank question and/or a description of how it was modified for review as a significantly modified (versus bank) question. Also, the stem has

Response

30 H 3 B E (Question ID 27829) (The 2009 NRC exam question was Question ID 12933)

Original version of 2009 NRC exam question was provided.

Minor changes made to the ILT 20-1 NRC Exam question under new Question ID 27842 (provided). The changes were not enough to justify calling this Significantly Modified, so it was changed to bank.

NRC: Updated question is SAT.

31 F 2 B S 2X2 Licensee: The station changed the stem from 90 mr/hr to 105 mr/hr, changed procedure listed in stem to RP-AA-18, RADIOLOGICAL POSTING AND LABELING PROGRAM DESCRIPTION, and added RP-AA-18 to references. This was done due to discovery of a procedural conflict between NISP-RP-004, RADIOLOGICAL 32 F 2 N S POSTING AND LABELING and RP-AA-18, RADIOLOGICAL POSTING AND LABELING PROGRAM DESCRIPTION, which could have led to candidates challenging the answer. An Issue report will to be written following the completion of the exam to have this conflict addressed.

NRC: The question changes, as described, are acceptable. Updated question is SAT.

33 F 2 B S 34 H 3 B S 2012 NRC Exam; 2010 NRC Exam; 2X2 35 F 2 B S 36 H 2 B S NRC 2008 Exam 37 H 3 N S Free Look Question #3; 2012 NRC Exam; 2X2 38 H 3 B S (Question ID 27727)

Page 6 of 21

ES-401 Facility: Dresden - April 2021 7 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 2X2 NRC: The question would be clearer if repeated words were brought up into the stem.

Also, provide an explanation in the pedigree for why this is a memory-level question (F).

39 H 2 N E

Response

Enhanced question by bringing repeated words up into the stem. Reviewed question and changed to High Cognitive Level (H). (Question ID 27856)

NRC: Updated question is SAT.

40 H 3 B S 2007 NRC Exam Free Look Question #4; 3-1 NRC Exam; 2X2 NRC: Please specify when the 3-1 NRC exam occurred.

Response

41 H 3 M E (Question ID 27756) The original version of this question was on the NRC Exam given in 08/2004, where it was question 49. It was significantly modified from the original version. Original version of question was provided.

NRC: Updated question is SAT.

42 H 3 B S 2008 NRC Exam; Reference Provided 43 H 3 B S 2009 NRC Exam; 2X2 NRC: Provide an explanation in the pedigree for why this is considered a high-level question (H), since the question can be answered correctly by recalling that Unit 3 Pumpback air compressors are cooled by Unit 2 power.

44 F 2 B E

Response

Changed question to Low Cognitive level (F). (Question ID 27688)

NRC: Updated question is SAT.

2010 NRC Exam NRC: The question would be clearer if repeated words were brought up into the stem.

Response

The word To, which was at the beginning of all four answers, was brought into the stem of the question, and the question slightly rephrased to allow its use.

45 F 2 B E Since the question would become significantly more complex if the common phrase Torus or Torus water were brought in to the stem, due to the different answers being addressed (i.e.. temperature rise, adequate mixing, and maintaining within the normal operating band), they were left in the distractors. (Question ID 27694)

NRC: Updated question is SAT.

Page 7 of 21

ES-401 Facility: Dresden - April 2021 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 03-1 NRC Exam; 2X2 NRC: It is not plausible that the recorder reading would remain the same when the ranges are changed per answers B and D. Consider addressing whether the range needs to be changed at this point to help eliminate the need to repeat these recorder readings.

Response

At Dresden, changes to the IRM range switch cause a shift in both the displayed range and (for even to odd range switch position changes ONLY) a change in the displayed value of the reading. For change from an odd range switch position to an even range switch position, the value of the reading remains the same, but the indication range changes. For example, if the range switch were on range 1, with a 46 H 2 X B E value of 35 indicated, the displayed value would be shown on a 0-40 scale.

Changing the IRM range switch to position 2 would still result in 35 being indicated, but it would be displayed on a 0-125 scale. When the IRM switch was taken from range 2 (even position) to range 3 (odd position) the value of 35 would then change to 3.5 and would be indicated on a 0-40 indicated range.

Therefore, it is plausible that the indicated value of 70 in answer B and D could remain the same (the answer would be correct if the range switch were changing from an odd position to an even position. The wording in the first paragraph (above) was added to the pedigree section to enhance the explanation of the question.

(Question ID 27733)

NRC: Updated question is SAT.

47 H 3 B S Free Look Question #5; 3-1 NRC Exam NRC: 1) Please specify when the 3-1 NRC exam occurred. 2) Choice 4 is implausible and appears in all 3 incorrect answers. Consider modifying the question to ask for the purpose of the SBLC system.

Response

48 F 2 X M E 1) The NRC 3-1 exam occurred in 08/20 - (Question ID 0403-1 NRC-5853 was provided for comparison)

2) The original free look question (Question ID 27760) was revised to be a 2x2, with SBLC purpose added. (NOTE: The new Question ID is now 27851).

3) A K/A match justification was added for the modified question.

NRC: Updated question is SAT.

49 H 3 B S Page 8 of 21

ES-401 Facility: Dresden - April 2021 9 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 2X2 NRC: Is as required needed in all distractors? If so, please move it up into the stem for question clarity.

Response

50 H 3 N E Removed as required, from the answer and distractors, and added if required to the stem of the question.

Added 1 and 2 to the stem of the question, the answer and all distractors, to ensure clarity of which part of the question was being answered. (Question ID 27761)

NRC: Updated question is SAT.

51 H 3 N S 2X2 NRC:

1. Distractor A is implausible - it can be refuted by data review alone.

2. Remove may have and replace with was for the correct answer.

Response: (Question ID 27764) 52 H 2 B E

1. Replaced distractor A with a different distractor that cannot be refuted by data alone.

2. Changed the correct answer to remove may have and replaced it with was, as recommended.

NRC: Updated question is SAT.

53 H 3 N S 54 F 2 N S 2X2 Free Look Question #6; 2X2 NRC: Please explain in the pedigree what NF-AB-715 restrictions are and provide a copy of this reference.

Response

(Question ID 27769) 55 H 3 N E NF-AB-715 notch restrictions are the same as those listed in DGP 01-01. Replaced NF-AB-715 in the explanation, with DGP 01-01, which specifies the information addressed in the stem of the question. DGP 01-01 is already a supplied reference.

See DGP 01-01, Attachment A, step 5.a for this information.

NRC: Updated question is SAT.

2X2 56 H 2 N E NRC: For clarity, label the parts of each distractor as 1) and 2) to clearly associate the parts of the given choices to their appropriate stem questions.

Page 9 of 21

ES-401 Facility: Dresden - April 2021 10 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only

Response

Made the recommended change, used 1) and 2) for consistency with other questions. (Question ID 27832)

NRC: Updated question is SAT.

57 H 2 N S 2X2 NRC: For clarity, label the parts of each distractor as 1) and 2) to clearly associate the parts of the given choices to their appropriate stem questions.

58 H 2 N E Response:

Made the recommended change, used 1) and 2) for consistency with other questions. (Question ID 27774)

NRC: Updated question is SAT.

NRC: Please explain in the pedigree how the K/A is met by this question concerning the design feature(s) and/or interlocks provide for personnel access without breaching secondary containment.

59 F 3 ? N E Response:

See revised question. (Question ID 27775)

NRC: Updated question is SAT.

2010 NRC Exam; 2X2 NRC: Please explain in the pedigree how the K/A is met by this question concerning the physical connections and/or cause-effect relationships between FUEL POOL COOLING AND CLEAN-UP and the Shutdown cooling system. Is this cause-effect relationship addressed in the DOA?

Response

Added the following K/A Justification: The shutdown cooling system is designed to be able to line it up to the fuel pool in order to augment the fuel pool cooling system.

This requires installing a spool piece, and physically separating the SDC suction and 60 H 2 ? B E discharge of the SDC pump aligned to the fuel pool from the normal SDC flow path.

The operator must recognize that although 3B SDC pump is aligned and running to the fuel pool, the high recirc loop temperature condition listed in the stem will NOT cause a trip of the 3B SDC pump; and therefore there is no impact to the fuel pool.

The appropriate action, based on the stem of the question, is to address the loss of decay heat removal from the RPV using DOA 1000-01.

DOA 1001-01 does address potential actions regarding use of SDC pumps for fuel pool cooling. For example, it allows redirecting SDC pumps that are aligned to the fuel pool, to the RPV if needed. In this case, re-aligning the pump will not accomplish anything, since it would simply trip also. The cause effect relationship is not directly Page 10 of 21

ES-401 Facility: Dresden - April 2021 11 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only stated in the DOA, but the operator must understand the relationship in order to determine required actions. (Question ID 27776)

NRC: Updated question is SAT.

61 F 2 B S 19-1 Cert Exam 2006 NRC Exam; 2009 Cert Exam; 2X2 NRC: For clarity, label the parts of each distractor as a) and b) to clearly associate the parts of the given choices to their appropriate stem questions.

62 F 2 B E Response:

Made the recommended change, except used 1) and 2) for consistency with other questions. (Question ID 27781)

NRC: Updated question is SAT.

2017 NRC Exam NRC: Please explain in the pedigree how documenting in an IR is plausible -

perhaps another option should be used (i.e. work request?).

63 F 2 X B E Response:

Changed wording in distractors from IR to Work Request, as recommended.

Changed stem to say TEMPORARILY disabling the alarm, to avoid confusion over actual plant deficiencies, which would require a work request (Question ID 27782)

NRC: Updated question is SAT.

2X2 NRC: For clarity, label the parts of each distractor as 1) and 2) to clearly associate the parts of the given choices to their appropriate stem questions AND pull common words in each distractor up into the stem.

64 F 2 N E Response:

Made the recommended changes; used 1) and 2) for consistency with other questions. Moved the answer to position A due to psychometrics.

(Question ID 27785)

NRC: Updated question is SAT.

NRC: Please explain in the pedigree how the K/A is met by this question concerning the UNINTERRUPTABLE POWER SUPPLY relationship. Is the ESS considered to be a UPS??

65 F 2 ? N E Response:

Added the following K/A Justification to this question: Unit 2 ESS is an uninterruptable power supply that is fed from Bus 29, 250 VDC MCC #2, Bus 25 and MCC 28-2 via a rectifier, inverter, static switch and ABT. This question tests the Page 11 of 21

ES-401 Facility: Dresden - April 2021 12 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only knowledge of the impact to APRMs if ESS was lost. Also added DOP 6800-01, ESSENTIAL SERVICE SYSTEM, as a reference. (Question ID 27786)

NRC: Updated question is SAT.

66 F 2 B S 15-1 NRC Exam 2X2 NRC: 1) For clarity, label the parts of each distractor as 1) and 2) to clearly associate the parts of the given choices to their appropriate stem questions AND 2) Please explain in the pedigree WHY an opposite response in core thermal would be plausible - would core differential pressure indication be more plausible?

Response

67 F 2 X N E

1. Made the recommended change, except used 1) and 2) for consistency with other questions.

2. Added additional justification to the pedigree to explain why an opposite response in core thermal power would be plausible.

(Question ID 27853)

NRC: Updated question is SAT.

68 H 2 N S 2X2 69 H 3 N S 2X2 70 H 2 N S 2X2 71 H 2 N S 2X2 Free Look Question #7; 2X2 NRC: The question stem really asks for what order are the local actions performed in, since all listed actions are the same, but are listed in a different order. Statements 1 -

3 would be clearer if they read At 250 VDC MCC 2A, for example, versus splitting H the statement where it is currently divided.

72 2 X N E F Response:

The original free look Question ID was 27805. A new question was provided for the same K/A - (The new Question ID is 27857).

NRC: Updated question (F) is SAT.

2X2 73 H 3 X N E NRC: The question stem does not require any explanation, as provided in distractors A and C. These are different from distractors B and D and provide additional Page 12 of 21

ES-401 Facility: Dresden - April 2021 13 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only information which can be used to determine that they are incorrect. Thus, due to auto start of 2/3A SBGT should be omitted from distractors A and C.

Response

Made the recommended changes (Question ID is 27804).

NRC: Updated question is SAT.

2010 NRC Exam NRC: Distractor A should be revised to say RWCU system flow will be interrupted to match the wording of the other distractors.

74 H 3 B E

Response

Made the recommended changes (Question ID is 27806).

NRC: Updated question is SAT.

75 F 3 N S 2X2 14-1 NRC Exam, 18-1 NRC Exam, 19-1 CERT Exam (modified)

NRC: 1) The stem, as written, needs correction - additional of amount time should read additional time. 2) Spell out what TCCP means on it first use. 3) The Answer Explanation needs to be clarified to ensure that the correct answer is the only correct answer (there are exceptions given that must be considered). 4) SRO Only Criteria needs to be spelled out in the pedigree. 5) Explain why this question should be considered significantly modified - the correct answer is essentially the same.

Response

1. Changed that portion of the stem to say, Assuming the reactor remains at power, this jumper may remain installed a MAXIMUM of __________

additional days before a 10CFR50.59 review MUST be completed.

2. Spelled out TCCP in first use.

76 F 2 ? M E 3. Added to question that reactor remains at power. Added direct to bullet two, to clarify that is it is in direct support of maintenance. Since the jumper is listed as being in direct support of maintenance, and the reactor is at power, the maximum time it can remain installed is 90 days (15 days +

75 days = 90 days),

4. Pedigree contains SRO CRITERIA: 10CFR55.43(b)(3) - Facility licensee procedures required to obtain authority for design and operating changes in the facility.

5. NUREG 1021, Rev 11, ES-401, PREPARING INITIAL SITE-SPECIFIC WRITTEN EXAMINATIONS, page 9, Section D.2.f, bullet 4, states significantly modify each question by changing at least one pertinent condition in the stem and at least one distractor. Changing the conditions in the stem such that one of the three distractors in the original question becomes the correct answer would also be considered a Page 13 of 21

ES-401 Facility: Dresden - April 2021 14 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only significant modification. The intent or objective of the question does not necessarily have to be changed. Adding or deleting irrelevant information and making minor changes (e.g., the unit number, component train, or power level when it makes no difference) would not be considered a significant modification to the question.

This question was changed by changing the pertinent condition in the stem (i.e. how long the TCCP had already been installed) and changing the time listed in the answer and all distractors. This requires the student to recognize that they were in a 90-day time clock, know that the time begins at installation not discovery, and then calculate the time remaining until the 50.59 must be completed. (Question ID 27861)

NRC: Updated question is SAT.

Free Look Question #8; 2X2 NRC: 1) Please explain more fully in the pedigree why the question meets SRO-only criteria - what is Criteria 5? 2) Beyond the stem stating What action is the SRO required to direct what SRO-only knowledge is needed to answer this question (all procedural references are the same)?

Response

The original free look Question ID was 27718:

(1) Yes - it was SRO Only Criteria: 10CFR55.43(b)(5) - Assessment of facility 77 H 3 N E conditions and selection of appropriate procedures during normal, abnormal, and emergency situations. Now, 10CFR55.43(b)(2) - Facility operating limitations in the Technical Specifications and their bases, was added to the pedigree since the question was replaced.

(2) These are now based on two different procedural references. One is DOA 6800-01, LOSS OF POWER TO ESSENTIAL SERVICE SYSTEM BUS, used in distractors A and B. The second is DOP 6800-01, 6800-01, ESSENTIAL SERVICE SYSTEM, which is used for the answer and distractor D.

(3) A new question was provided for the same K/A - (Question ID 27843).

NRC: Updated question is SAT.

Free Look Question #9; 2X2 NRC: 1) There are several extra characters currently visible in the question stem

(<QQ 6394(1410)><<). 2) Please explain more fully in the pedigree why the question meets SRO-only criteria - what is Criteria 5?

78 H 3 N E

Response

The original free look Question ID was 27765.

(1) The characters are erroneous, due to translating between RTF and Word. This has been corrected.

Page 14 of 21

ES-401 Facility: Dresden - April 2021 15 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only (2) SRO Only Criteria: 10CFR55.43(b)(5) - Assessment of facility conditions and selection of appropriate procedures during normal, abnormal, and emergency situations. This has been added to the pedigree.

The question was revised under a new question ID (Question ID 27850 - provided).

NRC: Updated question is SAT.

2008 NRC Exam, 14-1 NRC Exam, 15-1 CERT Exam; Reference Provided NRC: Consider removing ONLY from distractor B - Drywell sprays are not permissible (per Figure K), other actions would be considered at this time, but the question asks what is needed NEXT.

79 H 3 ? B E

Response

Made recommended change. Reordered answers to address psychometrics.

(Question ID 27741)

NRC: Updated question is SAT.

Reference Provided; 2X2 NRC: SRO Only Criteria needs to be explained in the pedigree. Note that DEOP 400-5, FAILURE TO SCRAM, is the given selected procedure for all possible answers.

Response

SRO Justification: Per ES-401, Attachment 2, section II.E, 10CFR55.43(b)(5) includes the selection of a procedure or section of a procedure to mitigate or recover or which to proceed. In the associated question, the decision NOT to isolate the MSIVs that failed to close would be an SRO level decision. Normally, for a failure 80 H 3 ? N E of an isolation valve to close, the correct action would be to isolate the valves that failed to function. The SRO must recognize that the need to protect containment overrides the need to close an MSIV that failed to close spuriously, and which has no indication of a valid Group 1 isolation signal. In this case containment is threatened and the guidance in DEOP 0400-05 for bypassing the MSIV low level and Off Gas High Rad isolations would be the correct choice in order to maintain the condenser as a heat rejection path outside of containment. Additionally, at Dresden the SRO makes the decision whether to terminate and prevent to -35 inches or to TAF. This was added to the pedigree. (Question ID 27834)

NRC: Updated question is SAT.

81 H 2 N S Reference Provided 82 H 3 B S 2016 NRC Exam; Reference Provided 83 F 2 ? B E 2010 NRC Exam, 19-1 NRC Exam Page 15 of 21

ES-401 Facility: Dresden - April 2021 16 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only NRC: SRO Only Criteria needs to be explained in the pedigree. Note that OP-AA-106-101, SIGNIFICANT EVENT REPORTING, is given in the stem.

Response

SRO Justification: At Dresden, the responsibility for Significant Event Reporting falls on the Shift Manager, and the SRO's are also expected to be familiar with these reportability requirements. This is not an RO level function at Dresden.

(Question ID 27772)

NRC: Updated question is SAT.

Free Look Question #10 NRC: 1) There are several extra characters currently visible in the question stem

(<QQ 27783(1410)><<). 2) Please explain more fully in the pedigree why the question meets SRO-only criteria - what is Criteria 5? 3) Why is distractor A in blue font? 4) Stem bullets are currently question marks (?). 4) Several typographical errors in the pedigree should be corrected, such as Condensate/Feedwate, They DOA 0600-01 allows and cross tying CRD, for example.

Response

(Question ID 27783) 84 H 3 N E 1) The characters are erroneous, due to translating between RTF and Word.

This has been corrected.

2) SRO Only Criteria: 10CFR55.43(b)(5) - Assessment of facility conditions and selection of appropriate procedures during normal, abnormal, and emergency situations. This has been added to the pedigree.

Also, an SRO justification statement was added to the question.

3) Distractor A was changed to black font to match the other distractors.

4) Stem bullets have been fixed.

5) Corrected typographical errors Updated question provided.

NRC: Updated question is SAT.

85 H 2 B S 2012 NRC Exam, 2016 NRC Exam; 2X2 NRC: 1) The Site Vice President is a clear choice for unlimited access to the Control Room during normal and abnormal operations. Given that 2 of the 4 choices have this access, it results in 2 implausible distractors. 2) SRO Only Criteria needs to be explained in the pedigree. Note that OP-AA-103-101, CONTROL ROOM ACCESS U

86 F 2 X ? N CONTROL, is given in the stem.

S

Response

1. Revised question to address implausible distractor.

2. SRO Justification: At Dresden, the approval to enter the Main Control Room is given to the Unit Supervisors and Shift Managers only. The WEC Page 16 of 21

ES-401 Facility: Dresden - April 2021 17 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only supervisor may allow an individual to enter the MCR doorway, but they remain in the vestibule until allowed by either Unit Supervisor to enter the control room itself. This responsibility is not delegated to the RO license level. This was added to the pedigree. (Question ID 27789)

NRC: The revised question is SAT.

18-1 NRC Exam (modified)

NRC: With DEOP 0400-05 provided as a reference for Question 81, LOD =1 for the first part of this question (DLU), eliminating 2 distractors, and which is also the basis for the SRO-only justification. Note: Per DEOP 0400-05, recirc pumps are not tripped if power is less than 6%. Reactor power is below 6% with ALL 4 APRM downscales 1 U lit.

87 H X ? M Response:

2 S Removed Trip recirc pumps from the provided reference, DEOP 0400-05, block Q-

6. Removed 6% from the provided reference, DEOP 0400-05, block Q-5 and Q-6.

(Question ID 27859)

NRC: The question is SAT with the DEOP 0400-05 provided reference being revised as described.

2017 NRC Exam (modified); 2X2 NRC: This question is the same as the original question provided (B?).

Response

88 H 3 M E The original question provided was incorrect. The correct version of the original question from the 2017 NRC exam was provided with this document.

(Question ID 27821)

NRC: The question is SAT and was verified to be a MODIFIED question.

89 H 2 N S Reference Provided; 2X2 90 H 3 N S 2X2 NRC: SRO Only Criteria needs to be more fully explained in the pedigree since assessment of facility conditions is performed but selection of appropriate procedures is not required.

Response

91 F 3 B E SRO Justification: Per ES-401, Attachment 2, section II.E, 10CFR55.43(b)(5) includes the selection of a procedure or section of a procedure to mitigate or recover or which to proceed. In the associated question, the Unit Supervisor must identify the actions needed in order to mitigate the significant increase in iodine level in the reactor coolant. (Question ID 27751)

Page 17 of 21

ES-401 Facility: Dresden - April 2021 18 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only NRC: The updated question is SAT.

Reference Provided; 2X2 NRC: There is too much HPCI system (and TS) focus for the generic K/A in this question (Per ES-401, D.2.a, Ensure that the questions selected for Tier 3 maintain their focus on plantwide generic K/As and do not become an extension of Tier 2.)

92 F 2 N E

Response

Provided new question with less TS focus, to ensure the question is not an extension of Tier 2. Changed question to Low Cognitive (F) Level. (Question ID 27799)

NRC: The new question is SAT.

Reference Provided; 2X2 NRC: SRO Only Criteria needs to be more fully explained in the pedigree - include applicable learning objective wording and why 10CFR55.43(b)(5) is applicable.

Response

Added an SRO justification to the pedigree. Justification included the learning objective description.

SRO Justification: The first part of the question, assessing whether the Vortex or 93 H 3 N E NPSH curves are being exceeded, is an SRO ONLY Learning Objective: 29501LP02:

"Given a set of conditions for the containment and the ECCS systems, utilize the ECCS Vortex Limits and the ECCS NPSH Limits curves to determine if the curves are being violated (SRO ONLY)" The second part of the question is SRO Only Criteria: 10CFR55.43(b)(5). The conditions given require the SRO to assess the impact of exceeding the NPSH on the plant, and to determine which portion of the procedure they will use (maximum torus cooling, or reduced torus cooling).

(Question ID 27809)

NRC: The updated question is SAT.

2X2 NRC: Determining the AOPs and EOPs precedence in part 1) of this question is minimally discriminating - selecting all AOPs over all EOPs is too simplistic to be plausible. Consider including Technical Specifications and specific high-level AOPs 94 F 2 X N E to improve the plausibility of these distractors.

Response

Revised question to include Technical Specifications, to improve discrimination.

(Question ID 27801)

NRC: The revised question is SAT.

95 H 3 N S Reference Provided; 2X2 Page 18 of 21

ES-401 Facility: Dresden - April 2021 19 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 96 H 2 N S 2X2 2X2 NRC: 1) For clarity, label the parts of each distractor as 1) and 2) to clearly associate the parts of the given choices to their appropriate stem questions AND pull common words in each distractor up into the stem. 2) Explain why it was determined that the LOK for this question is H versus F.

97 F 3 N E Response:

1. Made recommended changes.

2. Changed LOK to F.

(Question ID 27841)

NRC: The updated question is SAT.

2X2 NRC: 1) For clarity, consider removing the words continue to from part (1) of distractors C and D. 2) Revise the bullets in the stem to avoid mixing tenses - was and is. Consider: SBLC Storage Tank level - 3800 gallons, for example. 3) Clean up the typos in the Answer Explanation and pedigree (the the etc.).

Response

1. Kept continue to in part 1 of distractors C and D to show this is an 98 H 3 N E ongoing action, since without them it might be argued that the unit supervisor recognizes an issue with SBLC and is only directing the NSO to perform an assessment of the SBLC system. By putting continuing to monitor, it removes this potential.

2. Brought the initial SBLC storage tank level up into the first part of the question to avoid mixing tenses.

3. Removed the typo the the from the pedigree.

(Question ID 27816)

NRC: The updated question is SAT.

99 H 2 N S 2X2 Reference Provided; 2X2 NRC: For clarity, clean up the typos in the pedigree (level level, at at,etc.),

rewording as required.

100 H 2 N E Response:

Cleaned up the typos in the pedigree (level level, at at,etc.),

(Question ID 27819)

NRC: The updated question is SAT.

Page 19 of 21

ES-401 Facility: Dresden - April 2021 20 Form ES-401-9 Page 20 of 21

ES-401 Facility: Dresden - April 2021 Written Examination Review Worksheet Form ES-401-9 B= 46 F= 32 E= 36 RO TOTALS: M= 2 H= 43 U= 1 Additional Notes: 2 extra F question > Minimum N= 27 B= 5 F= 7 E= 15 SRO TOTALS: M= 3 H= 18 U= 2 Additional Notes:

N= 17

GENERAL COMMENT

S:

1. Bank questions are indicated by B; Modified are indicated by M; New questions are indicated by N

2. There are (RO)/ (SRO) questions with references/attachments provided.