ML21137A334
| ML21137A334 | |
| Person / Time | |
|---|---|
| Site: | Davis Besse  |
| Issue date: | 02/18/2021 |
| From: | Gregory Roach NRC/RGN-III/DRS/OLB |
| To: | FirstEnergy Nuclear Operating Co |
| Roach G | |
| Shared Package | |
| ML20136A260 | List: |
| References | |
| Download: ML21137A334 (6) | |
Text
Davis Besse 2021 Exam February 4, 2021
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only NRC: Provide more clear explanation as to why distractor D is incorrect.
- 1. Is it purely because the procedure called out was not what would be used in this instance?
- 2. It is a valid response for the low seal injection flow annunciator which could be a precursor to a seal LOCA.
- 3. Is the word NEXT in the stem the driving force to addressing a steam leak causing an overcooling event which is presently happening versus a low seal injection flow which could lead to an RCP seal LOCA?
Response
Updated the explanation as to why distractor D is incorrect.
Updated stem and question.
E - Abnormal Procedure usage during DB-OP-02000 is directed by step 4.19.
The STBY Makeup Pump would not be required in this scenario. It would be 1 H 2 X N started if pressurizer level is < 40 inches. Added Uncompensated Pressurizer Level is 75 inches and slowly lowering to the stem.
- Changed stem to clearly indicate Immediate Actions have been completed S and changed question to, which of the following actions is required to be completed next AND which procedure will be referred to? to clearly identify that no supplemental actions or routing have been completed yet.
- To eliminate the potential of a precursor to a seal LOCA, Changed stem from 6-5-C to 6-6-C, SEAL INJ TOTAL FLOW. This alarm will come in on hi flow or low flow. In this scenario it will be due to hi flow caused by the loss of NNI X AC.
- The word NEXT is used to ask the candidate which abnormal should be referred to first. Changed NEXT to next and added
- The indications given do not meet the requirements for routing to Overcooling NRC: Capitalize the word NEXT.
This question is now SAT.
NRC: It appears that based on plant conditions in the stem, the applicant could make the argument that distractor C could be also correct. There are no further annunciators that would come in between Lpzr 200 and 160 inches, therefore couldnt answer C be correct as well? The applicant would have to make an E assumption that level has gone below 160 inches, but we have not indicated in the 2 H 2 X X N stem that it didnt.
S
Response
Added pressurizer level is at 195 inches and lowering to the stem This question is now SAT.
NRC: None.
3 F 2 N S REFERENCE PROVIDED: EAL WALLBOARDS ATTACHED Page 1 of 6
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only NRC: The question is answered by recalling TS 3.7.5 Condition A entry conditions and required action time. This question is a fundamental knowledge question.
E 4 F 3 B
Response
S Changed to Fundamental This question is now SAT.
NRC: Explain why the conditions in the stem would drive the crew to use the MDRFP in MFW mode. DB-OP-02000 Attachment 5 indicates that the AFW header is the preferred option for feeding a dry steam generator with the MDRFP. Was this done to create separation from JPM S2, which has the MDRFP used in AFW mode to respond to a loss of AFW flow to a S/G?
Modified: Question was modified as the question stem part two asks about the location of the control board controls for operating the MFW and EFW pumps. The E original question asked about local operator field actions. This results in changes to part two answer/distractors.
5 H 3 X M FREE SAMPLE S
PREVIOUS 2 EXAMS: DAVIS-BESSE 2020 NRC ILE Q81
Response
MDFP is used in the Main Feedwater Mode at low power. The AFW Mode would not be used initially since a manual valve line-up in the plant would be required. This line-up takes approximately 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> to complete. The MDFP can be transferred from the MFW Mode to the AFW Mode after it is supplying feedwater flow IAW Attachment 5, Section A, Step 5.
This question is now SAT.
NRC: There is no indication provided in the question stem that an overcooling event is in progress. Why would applicant assess that there would need action to take U place to stop AFW vice controlling AFW flow to establish S/G level under SBO conditions?
6 H 4 X N S
Response
Changed distractor to a Steam Generator overfill event. This question is now SAT.
NRC: Stem has a typo with an extra 0 in the procedure number in part 2 of the E question.
7 H 2 X N Response:
S Fixed typo removed extra 0.
This question is now SAT.
NRC: Parenthetically Including that NI 3 and 4 are Intermediate Range Detectors E and NI 1 and 2 are Source Range Detectors in the stem is a cue to the answer as it should be obvious that the IRM has failed and thus the IRM TS is the one affected by 8 H 2 X B the loss of a required detector. Applicants should absolutely be able to identify which is an SRM vs. IRM by nomenclature.
S
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only FREE SAMPLE DAVIS-BESSE 2013 NRC ILE Q84 REFERENCE PROVIDED: Technical Specifications 3.3.9 and 3.3.10.
Response
Removed parenthesis from description of NIs and used proper description nomenclature. It is the standard method throughout the exam to use the Component ID Number and Description when used in a question. This was discussed and okd by the Lead Examiner during comment discussion phone conversation.
NRC: None.
9 F 2 N S
Response
NRC: None.
10 F 2 N S REFERENCE PROVIDED: Technical Specification 3.3.17 and TNC 8.3.7.
NRC: None.
11 H 2 B S PREVIOUS 2 EXAMS: DAVIS-BESSE 2020 NRC ILE Q87 REFERENCE PROVIDED: Steam Tables 12 F 3 N S NRC: None.
NRC: Please change question pedigree to indicate KA 059 A2.12 Failure of feedwater regulating valves. ES-401-2 has already been corrected.
Response
E Changed question pedigree to indicate KA 059 A2.12 Failure of feedwater regulating 13 H 2 X N valves.
S Validation Change:
Changed stem for part 2 of question to ask, and what action would the CSRO direct FIRST? To ensure that Distractor D was not a subset answer.
This question is now SAT.
NRC: Correct the answer and distractor analysis. Answer A is the correct answer because EAL CA2.1 is tripped for a loss of ALL onsite and offsite power for > 15 minutes with the reactor defueled. CA1 and CU1 are associated with RCS inventory not power. CA2 and CU2 are associated with electrical power events.
E REFERENCE PROVIDED: EAL WALLBOARDS ATTACHED 14 H 2 B
Response
S Changed distractor A Explanation from CA1 to CA2.1.
NRC: Correct Distractors B, C, and D justification for the correct EAL associated with Loss of Offsite and Onsite power.
This question is now SAT.
U NRC: This question doesnt meet this particular KA as the EDG will be overloaded 15 H 2 X B for a very brief time until the UV signal caused by the LOOP separates the non ESF from the ESF bus. This will not impact overload time restrictions on the EDG or S
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only cause the operator to take any actions to address this condition as it will be quickly and automatically rectified by the UV signal.
DAVIS-BESSE 2016 NRC ILE Q90
Response
Modified question to ask what the immediate operator action for a LOOP is when the EDG is tied to the grid. These actions are required when an overload condition is detected.
NRC: Reference NUREG 1021, Rev 11 in the SRO justification.
This question is now SAT.
NRC: None.
Modified: Question was modified as the question stem now asks about what required TS entry conditions are met versus the original question which addressed next AOP 16 H 3 M S procedural steps to perform and what RPS trip signal is credited in the accident analysis. As a result of the changes, the answer and distractors all were changed.
DAVIS-BESSE 2013 NRC ILE Q92 17 F 2 N S NRC: None.
18 F 2 N S NRC: None.
19 F 2 N S NRC: None.
NRC: No required pedigree information or distractor analysis was provided for the sample question.
Write procedure names using a consistent methodology. Specifically, DB-OP-02000 is written with all capital letters. The Conduct of Operations procedure title is written with only the first letter capitalized.
B U This question will be considered a bank question because it does not meet the 20 F 2 NUREG guidance on modified questions in that even though there is a substantive change in the stem, there is no change to any distractor and the change in the stem N S did not result in a distractor from the source question becoming the correct answer.
FREE SAMPLE PREVIOUS 2 EXAMS: DAVIS-BESSE 2020 NRC ILE Q100 Response: This question was replaced based on other questions being used from the previous 2 exams.
This question is now SAT.
NRC: None.
21 H 2 B S BEAVER VALLEY UNIT 2 2008 NRC ILE Q96 NRC: DB-OP-06411 requires a Maintenance Information tag be placed on the B U Annunciator Point Card in step 4.5.7. The original question did not include this card 22 F 3 X in answer choice, it called out a Temporary Modification Tag. Ensure change to question stem did not invalidate the correct answer.
M S PREVIOUS 2 EXAMS: DAVIS-BESSE 2020 NRC ILE Q96
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only
Response
Changed stem and answer choices. This could be considered a modified question.
Modified: Question stem and answer/distractors were changed to focus on procedure and tag used for dealing with a nuisance alarm.
This question is now SAT.
NRC: None.
23 H 3 B S DAVIS-BESSE 2016 NRC ILE Q99 REFERENCE PROVIDED: ODCM Tables 2-1 and 2-2 NRC: None.
24 H 2 B S THREE MILE ISLAND UNIT 1 2014 NRC ILE Q100 NRC: Capitalize the word NO in the bullet about hostile action.
Modified: Question stem was changed listing different accident conditions occurring E
onsite resulting in a distractor becoming the correct answer.
25 H 3 M DAVIS-BESSE 2013 NRC ILE Q100 REFERENCE PROVIDED: EAL WALLBOARDS AND RA-EP-02245 ATTACHED S
Response: Changed as requested.
This question is now SAT.
Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 (easy) to 5 (difficult); questions with a difficulty between 2 and 4 are acceptable.
- 3. Check the appropriate box if a psychometric flaw is identified:
- Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
- Cues: The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length).
- T/F: The answer choices are a collection of unrelated true/false statements.
- Cred. Dist>: The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
- Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
- Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
- Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory).
- #/Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
- Backward: The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only. (K/A and license-level mismatches are unacceptable).
- 6. Enter question source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7. Based on the reviewers judgment, is the question, as written, (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8. At a minimum, explain any U status ratings (e.g., how the Appendix B psychometric attributes are not being met).
B= 9 F= 10 E= 9 SRO TOTALS: M= 3 H= 15 U= 3 Additional Notes: SATISFACTORY SUBMITTAL N= 13 (5 are High Cog)
GENERAL COMMENT
S:
- 1. Question numbers highlighted as FREE SAMPLE are sample test items the facility submitted for pre-review.
- 2. Bank questions are indicated by B; Modified are indicated by M; New questions are indicated by N
- 3. Questions from the previous 2 NRC Exams: __3*__ (SRO)
- 2 questions were significantly modified.
- 4. Average difficulty is _2.52_ on the SRO exam.
- 5. The 10CFR55.41/43 distribution is:
41.1 = 41.8 = 43.1 =
41.2 = 41.9 = 43.2 = 7 41.3 = 41.10 = 11 43.3 =
41.4 = 41.11 = 43.4 = 1 41.5 = 6 41.12 = 1 43.5 = 14 41.6 = 41.13 = 1 43.6 =
41.7 = 1 41.14 = 43.7 =
- 6. The answer distribution is:
SRO A = 6 (24%)
B = 7 (28%)
C = 7 (28%)
D = 5 (20%)
- 7. There are __7__ (SRO) questions with references/attachments provided.