ML20072P464
| ML20072P464 | |
| Person / Time | |
|---|---|
| Site: | Davis Besse  |
| Issue date: | 02/27/2020 |
| From: | Gregory Roach FirstEnergy Nuclear Operating Co |
| To: | Operations Branch III |
| Roach G | |
| Shared Package | |
| ML19121A156 | List: |
| References | |
| Download: ML20072P464 (17) | |
Text
ES-401 Written Examination Review Worksheet Form ES-401-9 Facility: DAVIS BESSE NUCLEAR POWER STATION Exam Date: FEBRUARY 2020 Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 (easy) to 5 (difficult); questions with a difficulty between 2 and 4 are acceptable.
- 3. Check the appropriate box if a psychometric flaw is identified:
Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
Cues: The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length).
T/F: The answer choices are a collection of unrelated true/false statements.
Cred. Dist>: The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory).
- /Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
Backward: The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved K/A and those that are designated SR-only. (K/A and license-level mismatches are unacceptable).
- 6. Enter question source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7. Based on the reviewers judgment, is the question, as written, (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8. At a minimum, explain any U status ratings (e.g., how the Appendix B psychometric attributes are not being met).
Page 1 of 17 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 1
H 3
B S
NRC: None.
2 H
2 B
S NRC: None.
DB 2011 NRC Exam (Q4) 3 F
2 B
S NRC: None.
DB 2013 NRC Exam (Q4) 4 H
2 B
S NRC: None.
5 H
3 B
S NRC: None.
Previous 2 exams: DB 2018 NRC Exam (Q6) 6 H
4 N
S NRC: None.
ES-401 2
Form ES-401-9 Facility: DAVIS BESSE NUCLEAR POWER STATION Exam Date: FEBRUARY 2020 Page 2 of 17 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only Reference Provided: DB-PF-06705 Graph CC 15.16 7
H 3
B S
NRC: Is it reasonable to assume the applicant will be able to make a correct assessment based only which computer point number alarmed as to whether a safety or a relief valve partially opened? Are we expecting applicants to memorize minutia information to answer this question?
DB 2015 NRC Exam (Q2)
Response: The computer point is a key indication of the valve and is listed in the symptoms section of the procedure. Questions 34 and 76 are modified to address cueing concerns.
NRC: Question is satisfactory as written.
8 F
2 B
S NRC: None.
9 H
2 B
S NRC: None.
10 H
3 X
N E
S NRC: Per DB-OP-02000, Attachment 5 Section A. step d. feedwater should be established to the Steam Generators at less than 1000 gpm. Answer and distractors should all include a less than prior to the values of 1000 or 1200 respectively.
Response: Added the term less than to each of the four choices.
NRC: Question is satisfactory with changes made.
11 H
3 B
E S
NRC: This question is not considered modified in accordance with ES 401, D.2.f as it must also include a substantive change to a distractor in addition to the stem changes.
Response: Agree to classify as Bank question.
NRC: Question is satisfactory with changes made.
12 H
3 N
S NRC: None.
13 H
3 N
S NRC: None.
14 F
3 B
S NRC: None.
DB 2011 NRC Exam (Q15)
ES-401 3
Form ES-401-9 Facility: DAVIS BESSE NUCLEAR POWER STATION Exam Date: FEBRUARY 2020 Page 3 of 17 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 15 F
3 N
S NRC: None.
16 H
4 B
S NRC: None.
Reference Embedded: IA/SA Pressure Indicators DB 2015 NRC Exam (Q53) 17 H
2 N
S NRC: None.
18 F
2 B
S NRC: None.
19 H
2 B
S NRC: None.
DB 2011 NRC Exam (Q20) 20 H
2 B
S NRC: None.
DB 2015 NRC Exam (Q20) 21 H
3 N
S NRC: None.
22 F
2 B
S NRC: None.
DB 2013 NRC Exam (Q23) 23 F
2 B
S NRC: None.
Previous 2 exams: DB 2016 NRC Exam (Q25) 24 F
2 N
S NRC: None.
25 H
3 B
S NRC: None.
DB 2013 NRC Exam (Q25) 26 H
3 N
S NRC: None.
27 F
2 N
S NRC: None.
28 F
2 B
S NRC: None.
29 H
2 X
M U
S NRC: Distractors B and D are not credible as with 4 RCPs running at the start of the question (100% power), even if a single seal failure were to be a cause requiring a trip of the RCP, procedures would have the operator lower power below 72% and
ES-401 4
Form ES-401-9 Facility: DAVIS BESSE NUCLEAR POWER STATION Exam Date: FEBRUARY 2020 Page 4 of 17 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only then trip the RCP. A more credible part 2 of distractors B and D would be lower power below 72% and then stop RCP 1-2.
Response: Modified choices B and D to remove the words Trip the reactor, replaced with Lower Power to <72%.
NRC: Question is satisfactory with changes made.
30 F
2 B
S NRC: None.
FREE SAMPLE 31 H
2 N
S NRC: None.
Reference Provided: DB-PF-06703 Graphs CC6.3c and C6.3d 32 H
3 N
S NRC: None.
33 H
2 N
S NRC: None.
34 F
2 X
B U
S NRC: Question as written potentially cues the applicant on a portion of the correct answer for Question 7 which provides a computer point for the applicant to determine in a pressurizer safety or PORV is partially open. This question provides the computer point T773 and title which clearly show this point associated with the PORV.
Question tests fundamental knowledge. Applicant just needs to know definition of identified leakage. Assessed as low cognitive.
DB 2005 NRC Exam (Q30)
Response: Agree to change the question to low cognitive.
Removed the Computer point T773 wording, changed it to say RC2A, PORV downstream temperature indicates 306°F, to address cueing concern with Q7.
NRC: Question is satisfactory with changes made.
35 H
2 B
S NRC: None.
DB 2015 NRC Exam (Q34) 36 H
3 B
S NRC: None.
ES-401 5
Form ES-401-9 Facility: DAVIS BESSE NUCLEAR POWER STATION Exam Date: FEBRUARY 2020 Page 5 of 17 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only DB 2011 NRC Exam (Q35) 37 H
2 N
S NRC: None.
38 F
3 X
B E
S NRC: Add the word BOTH following exceeding in the stem as the High RCS Temperature RPS set point protects against exceeding the DNBR SL IAW the TS Bases. This ensures only one correct answer can be assessed.
Oconee 2015 NRC Exam (Q36)
Response: Added the word BOTH as suggested.
NRC: Question is satisfactory with changes made.
39 F
2 B
S NRC: None.
DB 2015 NRC Exam (Q40) 40 F
2 N
S NRC: None.
41 H
2 X
N E
S NRC: Give containment pressure in psig as would be indicated in the control room on the appropriate pressure instrument. Let the student determine that the ESFAS Level 4 should have occurred based on plant conditions as they would be indicated in the control room.
Response: The control room SFAS indicator for CNMT pressure is in psia, want to leave as is.
To address the comment on ESFAS determination, the stem statement would have to include a large number of items to determine that SFAS Levels 1-4 had actuated. A possible solution may be to list the status of the four components, with three of them in their correct lineup, but the CNMT Spray pumps not running.
NRC: Question is satisfactory with changes made. Status of components associated with containment cooling systems is listed in the stem with containment pressure.
Applicant then decides what needs to be done to address plant conditions.
42 F
3 B
S NRC: None.
43 H
2 B
S NRC: None.
DB 2013 NRC Exam (Q59)
ES-401 6
Form ES-401-9 Facility: DAVIS BESSE NUCLEAR POWER STATION Exam Date: FEBRUARY 2020 Page 6 of 17 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 44 F
2 N
S NRC: None.
45 H
2 B
S NRC: None.
46 F
2 B
S NRC: None.
47 F
3 X
N E
S NRC: What is the purpose for the information in the initial conditions with regards to the requirements/actions for starting an RCP? Specifically, the positions of HX01 and HX02.
The question only requires fundamental knowledge of the actions for starting an RCP. No assessment appears to be needed. Therefore, this question should be considered low cognitive.
Response: Agree to make the question low cognitive, however there is some assessment of the power supply alignment.
The purpose of the HX indications is for determining the power supply alignment.
This information strengthens the distractors and the correct answer. Request leaving this information in the question.
NRC: Question is satisfactory with changes made.
48 F
2 X
N E
S NRC: Add via YV1 to the end of answer choices A and B since Y1 is not directly energized from either. They are DC sources which must be converted to an AC source.
Response: Agree to add via YV1 to both A and B choices.
NRC: Question is satisfactory with changes made.
49 H
2 B
S NRC: None.
TMI 2011 NRC Exam (Q20) 50 F
2 N
S NRC: Place valve descriptions in a 2 column table or similar format to clearly indicate that they are not part of the initial conditions.
Response: Agree to add a table to the question with this information.
51 F
3 X
N E
NRC: The K/A is related to immediate actions which must be performed without reference. Specific Rules are implemented upon entering the SUPPLEMENTAL ACTIONS section of the EOPs. Are Specific Rules required to be performed from
ES-401 7
Form ES-401-9 Facility: DAVIS BESSE NUCLEAR POWER STATION Exam Date: FEBRUARY 2020 Page 7 of 17 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only S
memory without references? Is so please provide the reference document with requirement stated.
Response: Modified the stem statement to create a bus lockout condition. This would require an IOA action for the EDG. The Specific Rule Actions are not required to be performed from memory. The K/A statement is not specific to a procedure IOA action, we interpreted it as related to taken actions to preclude equipment damage.
NRC: Question is satisfactory with changes made.
52 H
3 B
S NRC: None.
53 F
3 N
S NRC: None.
54 F
2 N
S NRC: None.
55 H
3 X
X N
E S
NRC: FREE SAMPLE. Provide drawing detail showing which (how many) vacuum breakers are isolated by CV5090 and CV5091.
Response
The drawing will be provided with the 75 day submittal as a part of the reference material for the question.
NRC: According to drawing 0S-033F, it appears the isolation valves listed in the stem are incorrectly labelled as CV5090 and CV5091. Should they be CV5070 and CV5071?
The factoid upon which the answer selection is based, is buried within a footnote to the Daily Checks data sheet and a supporting paragraph within the procedure body, neither of which is required to be committed to memory. This knowledge is also found in TS Bases (reiterates information from the FSAR) which is not required to be committed to memory either.
Response: Modified valve numbers to be CV5070 and CV5071.
The knowledge is expected for operators, the daily surveillances check these indications in the body of the surveillance and this question is related to the system design and operation.
NRC: Question is satisfactory with changes made.
ES-401 8
Form ES-401-9 Facility: DAVIS BESSE NUCLEAR POWER STATION Exam Date: FEBRUARY 2020 Page 8 of 17 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 56 F
2 B
S NRC: Question is associated with the reactor trip breakers and not the CRDM and their relationship with the CRDS.
DB 2015 NRC Exam (Q7)
Response: The reactor trip breakers are between the CRDS and the CRDMs.
Possible fix could be to modify the stem statements to remove the trip breakers and state to deenergize the CRDMs.
NRC: Question is a KA match and is satisfactory.
57 F
3 N
S NRC: None.
58 F
2 N
S NRC: None.
FREE SAMPLE.
59 F
2 N
S NRC: None.
60 H
3 X
B E
S NRC: Words Unknown and First are appropriately capitalized in the question stem but should not be bolded in-order-to correspond with the remainder of the exam.
Recommend adding upon entering the loss of inventory section after Immediately in choice A.
Previous 2 Exams: DB 2018 NRC Exam (Q60)
Response: Un-bolded the words UNKNOWN and FIRST, added the suggested wording to choice A.
NRC: Question is satisfactory with changes made.
61 H
2 B
S NRC: None.
DB 2008 NRC Exam (Q34) 62 H
2 B
S NRC: None.
FREE SAMPLE.
Previous 2 Exams: DB 2018 NRC Exam (Q61)
ES-401 9
Form ES-401-9 Facility: DAVIS BESSE NUCLEAR POWER STATION Exam Date: FEBRUARY 2020 Page 9 of 17 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 63 H
3 X
N E
S NRC: The question can be answered solely on recognizing the impact (Part 1) and does not require the examinee to select or differentiate how to mitigate the transient.
Recommend rewording the question to eliminate the two-part format; for example:
Which of the following describes the action required to mitigate the impact of the given plant conditions?.
Add clarification to Answer Explanation C to indicate there are no automatic actuations on low tank level.
Response: Reformatted the question to eliminate the 2 parts, added wording to the plausibility statement as requested.
NRC: Question is satisfactory with changes made.
64 H
3 B
S NRC: None.
DB 2011 NRC Exam (Q54) 65 H
2 B
S NRC: None.
66 H
2 X
B E
S NRC: Answer choices A and C are subsets, the only difference being that C gives a reason.
Response: Added an incorrect reason to Distractor A to address the subset concern.
NRC: Removed bold and underlining. Change to distractor A is acceptable.
Question is satisfactory with changes made.
67 F
1 2
X N
U S
NRC: All three distractors indicating that the Site VP can be granted permission make it too easy to identify the correct answer. Recommend replacing distractor C with a distractor which denies ability for the Site VP to operate the Trip pushbutton due to not being a member of the shift operating crew. The remaining two distractors which indicate the SVP can be granted permission are plausible.
FREE SAMPLE.
Response
Agree with the recommended change to the distractor.
NRC: Change made, question is satisfactory.
ES-401 10 Form ES-401-9 Facility: DAVIS BESSE NUCLEAR POWER STATION Exam Date: FEBRUARY 2020 Page 10 of 17 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 68 F
3 B
S NRC: Answer choice D is a possible correct answer, since the answer does not specify how the components are to be manually actuated and performance of DB-OP-2530 Attachments 1 and 2 complete the isolation/actuation lineups. These attachments are to be performed as a part of the supplemental actions for responding to this event per the AOP.
Response: Choice D will align components, however more than what is required will realign. The signal also will place some FH flowpath components in the incorrect position for the given plant conditions. Added the word required to the stem statement.
NRC: Question is satisfactory as written.
69 F
3 B
S NRC: None.
70 F
2 B
S NRC: None.
FREE SAMPLE.
71 F
2 B
E S
NRC: The question only requires fundamental knowledge of exposure limits. No assessment appears to be needed. Therefore, this question should be considered low cognitive.
Response: Changed to low cognitive level.
NRC: Question is satisfactory with changes made.
72 F
2 B
S NRC: None.
73 F
2 X
B E
S NRC: Explain in more detail why choice B is not a correct answer. The SD provided states The Process Radiation Monitor System is designedthe level of radioactivity in certain processes and all effluent pathways.
FREE SAMPLE.
Response: Modified Choice B to add the words equipment used for maintenance. A monitor such as a SAM unit would be used for this action. The Process monitors are used in system flowpaths to detect radiation, they do not monitor equipment such as pumps or valves, they monitor the system rad levels, then indicate or have action to realign or terminate system flow.
NRC: Question is satisfactory with changes made.
ES-401 11 Form ES-401-9 Facility: DAVIS BESSE NUCLEAR POWER STATION Exam Date: FEBRUARY 2020 Page 11 of 17 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 74 F
2 N
S NRC: None.
75 F
2 B
S NRC: None.
DB 2011 NRC Exam (Q74) 76 H
3 X
X N
U S
NRC: Question is not a K/A match. K/A is associated with a Pressurizer Vapor Space Accident. Question relates to a leaking PORV. There is a distinct difference between the two.
Computer alarm T773 title information serves as cue for RO exam 7.
Reference to TS 3.4.11 action completion duplicates information that AOP actions have been taken.
Response: Removed the bullet for Computer point T773 to address the cueing concern with Q7.
Many bank questions associated with the PZR Vapor space break are associated with PORV and Safety valve operation. If not, then a vapor space break would be a piping or dome failure on top of the PZR. This K/A is related to the ability to diagnose a Vapor Space break and the impact on the PORV position indications. A question to match the K/A would have to address these indications. The stem of the question has an open PORV to address the Vapor Space Break. The AOP refers to the TS does not include all required actions.
NRC: Question is satisfactory with changes made. Vapor space accident includes a lifting/leaking PORV IAW NUREG 1122, Rev 2.
77 H
2 N
E S
NRC: Answer Explanation/Justification for distractors need to provide explanation as to why they are wrong.
Reference Provided: Steam Tables Response: Enhanced distractor justifications NRC: Question is satisfactory with changes made.
78 H
2 X
N E
S NRC: The stem of the question should read:, which of the following is the HIGHEST Emergency Action Level (EAL) threshold exceeded? Since answers are specific EALs.
ES-401 12 Form ES-401-9 Facility: DAVIS BESSE NUCLEAR POWER STATION Exam Date: FEBRUARY 2020 Page 12 of 17 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only Reference Provided: RA-EP-01500 Emergency Classification Response: Added wording as suggested.
NRC: Question is satisfactory with changes made.
79 H
2 B
S NRC: None.
DB 2013 NRC Exam (Q81) 80 F
3 N
S NRC: None.
Reference Provided: Technical Specifications Section 1.3.
81 H
3 X
X N
U S
NRC: Question does not match the K/A. Question does not test the applicant on local auxiliary operator actions during an inadequate heat transfer event.
Need to add the parent procedure for Attachment 5 to the stem.
Response: Added the title of the procedure prior to the Attachment.
The command SRO is directing the AEO actions in the question, which requires an understanding of the plant alignment changes. Added the words as a result of the equipment operator switching.
NRC: Attachment 5 are field performed actions addressing the K/A. Question is satisfactory with changes made.
82 H
3 X
X B
U S
NRC: No single correct answer. DB-OP-02516 limits thermal power to 33% with 3 RCPs. Stem does not specify per the Tech Specs.
Explain where the 75% limit came from in answer justification. TS simply limits max allowed power to < 80.6% RTP Reference Provided: Technical Specification 3.1.4.
Response: Add the words Technical Specification in front of ALLOWABLE.
Modified the justification to Distractor B to change the numbers to TS values The answer remains the same since the highest power listed that is below the limit is 45%.
N NRC: Question is satisfactory with changes made.
ES-401 13 Form ES-401-9 Facility: DAVIS BESSE NUCLEAR POWER STATION Exam Date: FEBRUARY 2020 Page 13 of 17 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 83 F
3 X
M U
S NRC: Create new logic scheme as answers C and D not plausible with flow and vent control valves only. This type of valve is not usually used for system isolation.
Provide explanation for why receiving treatment is not an OSHA reportable event.
DB 2013 NRC Exam (Q22) Modified to SRO question Reference Provided: NOP-OP-1015 Response: Per NOP-OP-1015, OSHA is required to be notified within 8 hours9.259259e-5 days <br />0.00222 hours <br />1.322751e-5 weeks <br />3.044e-6 months <br /> if the injured is admitted to the hospital, the time frame makes this choice correct.
There are Flow control valves that isolate system flow when setpoint are reached.
Modified to change the choice to 1&2 Only or 1,2 & 3, which includes the decay tank valve 1836. Removed Valve 1821 as a possible choice.
NRC: Question is satisfactory with changes made.
84 F
3 X
X N
E S
NRC: Per the procedure the Unit Supervisor (Command SRO) proceeds to the Aux Shutdown Panel when his Attach 2 actions are complete. Since the question does not provide any time reference, choice D could also be correct. Recommend adding the word initially to who will direct in part 1 of the question.
Tc is not listed as a post-accident indication in TS Table 3.3.17-1. Explain why this question remains a K/A match.
Response: Added the word initially to the stem statement.
Modified part to change to Electrical room versus Mechanical. Then modified Part 2 of B and D to Gammametrics versus TCold. Interpreted the K/A as instrumentation that is used post accident not specifically PAM equipment.
NRC: Change answer justification to Gammametrics and remove the redundant AND.
Response: Removed redundant AND and added justifications for Gammametrics.
NRC: Question is satisfactory with changes made.
85 H
2 N
S NRC: None.
86 H
3 X
X N
E NRC: As written the question does not fully require the examinee to prioritize significance. The AOP already determines the priority, add DB-OP-2515 to the question paragraph stating that it is also being implemented. Since both of these AOPs would be entered, the question should be written so that the applicant must determine what the priority action is between the two procedures.
ES-401 14 Form ES-401-9 Facility: DAVIS BESSE NUCLEAR POWER STATION Exam Date: FEBRUARY 2020 Page 14 of 17 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only S
Recommend moving alarm list to top of bulleted occurrences and moving the AOP procedure references to the paragraph with the question.
Recommended answers could be:
A.
Verify MUP Suction is aligned to the BWST, Vent MUP 1, and restore RCP Seal Injection Flow.
B.
Align HPI and LPI systems for Piggyback Operations, commence a Rapid Shutdown to Low Level Limits, then Trip the Reactor.
C.
Trip the Reactor and Stop all RCPs.
D.
Swap RCP Seal Injection Filters and restore RCP Seal Injection Flow.
Answer B is correct.
Response: Added the words to also enter DP-OP-2515 for the RCPs. Moved the Alarm bullets as suggested. Adopted a format similar to the suggested ones above.
NRC: Question is satisfactory with changes made.
87 H
3 B
S NRC: None.
DB 2013 NRC Exam (Q86)
Reference Provided: Steam Tables 88 H
3 B
S NRC: None.
Previous 2 exams: DB 2018 NRC Exam (Q79) 89 H
3 N
S NRC: None.
90 H
3 N
E S
NRC: Question considered high cog based on having to access plant conditions and then understand the impact of the AF599 valve on other components.
FREE SAMPLE.
Response
Agree updated the question to classify the cognitive level as high.
NRC: Question is satisfactory with changes made.
ES-401 15 Form ES-401-9 Facility: DAVIS BESSE NUCLEAR POWER STATION Exam Date: FEBRUARY 2020 Page 15 of 17 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 91 H
3 M
S NRC: Question considered significantly modified as DB specific guidance and nomenclature was incorporated.
Oconee 2010 NRC Exam (Q91) 92 H
3 B
S NRC: None.
DB 2011 NRC Exam (Q92) 93 F
3 N
S NRC: None.
94 F
2 B
S NRC: None.
DB 2015 NRC Exam (Q94) 95 F
4 X
N E
S NRC: Add the phrase, disengage the grapple to answer choice B after the word basket.
FREE SAMPLE.
Response: Added words as suggested NRC: Question is satisfactory with changes made.
96 F
3 B
S NRC: None.
DB 2015 NRC Exam (Q96) 97 H
2 M
S NRC: None.
Reference Provided: NG-DB-0017 and Form nop-op-1005-02 DB 2015 NRC Exam (Q97) 98 H
3 B
S NRC: This question is psychometrically satisfactory but has been used on two recent NRC exams. Do you possess another question which matches the K/A?
Reference Provided: ODCM Table 2-1 and 2-2 Previous 2 exams: DB 2018 NRC Exam (Q99)
Response: Request keeping this question on the exam. This K/A and topic is difficult to match and several system K/As have been selected for this exam. Could not find this question on the on the 2018 exam, it was used on the 2016 and 2013 exams.
There have been 4 exams since 2013, this question was used on 2 of 4.
ES-401 16 Form ES-401-9 Facility: DAVIS BESSE NUCLEAR POWER STATION Exam Date: FEBRUARY 2020 Page 16 of 17 Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only NRC: Question is satisfactory to use.
99 H
2 N
S NRC: There appears to be a typo in the RNO column of DB-OP-02527, Attachment 5, Step 4. Both the step and the RNO start with, If the RCS pressure boundary is intact.
FREE SAMPLE.
Response: The steps are correct as written, the wording is meant to say that the RCS is intact in both columns. The left column vents the system, the right column is used if the ability to vent is not available, but the RCS is intact.
100 F
2 N
S NRC: Is transient annunciator response permissible during events in which the EOPs have not been entered? If so, how does this question specifically, meet the K/A?
Response
The NOP is applicable in EOP, AOPs and during transients. The stem states that we are in the EOP, since the decision is Command SRO related this is aligned with the K/A Transient response could be difference for AOPs or other events as compared to the EOP, the applicant must evaluate for their use.
NRC: Question is satisfactory as written.
ES-401 Written Examination Review Worksheet Form ES-401-9 Facility: DAVIS BESSE NUCLEAR POWER STATION Exam Date: FEBRUARY 2020 Page 17 of 17 RO TOTALS:
B= 44 F= 37 E= 13 Additional Notes: 2.7% of RO Questions assessed as unsatisfactory.
M= 1 H= 38 (minimum permissible)
U= 2 N= 30 N= 13 (HCL)
SRO TOTALS:
B= 8 F= 8 E= 6 Additional Notes: 16% of SRO Questions assessed as unsatisfactory.
M= 3 H= 17 U= 4 N= 14 N= 9 (HCL)
GENERAL COMMENT
S:
The number of questions on the SRO section containing provided reference materials exceeds the FAQ 401.53 guideline of 5-6. Chief Examiner assessed the number of SRO questions with attached references as not adversely affecting the LOD of the exam or cueing other questions.
- 2.
Questions from the previous 2 NRC Exams: _4_ (RO) / _2_ (SRO)
- 3.
Average difficulty is _2.40 _ on the RO exam and 2.72 on the SRO exam.