ML22144A027
| ML22144A027 | |
| Person / Time | |
|---|---|
| Site: | Palo Verde  |
| Issue date: | 05/12/2022 |
| From: | Heather Gepford NRC/RGN-IV/DORS/OB |
| To: | Arizona Public Service Co |
| References | |
| Download: ML22144A027 (8) | |
Text
Form 2.3-5 Written Examination Review Worksheet (PV-2022-05)
Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. K/A Use Flaws
- 6. Source (B/M/N)
- 7. Status (U/E/S)
- 8. Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job Link Minutia
- /Units Logic Q-K/A License Level 1
H 2
N S
Why is this not an overlap of Sim JPM S-4? While JPM S-4 does cover the same general situation, the JPM does not address either of the items being asked in the question. The JPM requires actions including attempting to re-open Containment Isolation Valves, then tripping the Reactor and isolating bleedoff. The written question asks what will automatically secure the NC-EW cross-tie and the reason for stopping the RCPs. Similar situation, but the knowledge items do not overlap.
2 H
3 N
S 3
F 3
N E S Part 2 not plausible in distractors B and D. Not plausible that turbine still rotating after 60 minutes.
Changed part 2 for B and D. Question now SAT.
4 H
3 X
N U S Does not meet the K/A. The correct answer is to maintain; thus, it is not a less than 1-hour tech spec. Reworded distractors to be active.
Question now SAT.
5 H
3 N
S 6
F 3
B E S Not a tier 1 question. System level knowledge.
Rewrote question. Question now SAT.
7 H
3 N
E S Remove "in order to ensure negative reactivity is inserted into the core." Kind of cues emergency boration. Removed. Question now SAT.
8 F
2 B
E S 2021 Exam. As written, this is not a tier 1 question (the bank question originated from a tier 2 question). Added procedure tie-in. Changed B &
D part 2 to 2.6 minutes. Question now SAT.
9 H
3 N
S 10 H
3 B
S 2016 Exam. Reworded distractors.
11 H
2 M
S Reference provided 12 H
3 N
S Is it possible that all tailpipe temperatures come to equilibrium, thus not being able to discern which valve is leaking? Added time frame to question.
13 H
3 N
E S I wonder if trip all RCPs would be a better distractor than both loop 1 RCPs. Can't think of an instance where you would trip both in 1 loop.
Form 2.3-5 Written Examination Review Worksheet (PV-2022-05)
Changed to tripping all 4 RCPs, and made a true 2x2 question. Question now SAT.
14 F
3 N
S 15 H
3 N
S 16 H
3 N
S 17 H
3 X
N U S It is not plausible to believe a loss of all 3 charging pumps would not force use of HPSI, therefore B and D are not credible. Changed item 1 and reordered. Question now SAT.
18 H
3 N
S Reference provided 19 H
3 B
S 2016 Exam.
20 H
3 N
E S Not a tier 1 question. System level knowledge.
Swapped parts 1 and 2. Made new part 2 procedure driven. Question now SAT.
21 H
3 N
E S Not a tier 1 question. If you ask a tier 1 question with no operator action, there needs to be event diagnosis. Rewrote question. Question now SAT..
22 F
3 N
S 23 H
3 N
E S Not a tier 1 question. If you ask a tier 1 question with no operator action, there needs to be event diagnosis. Rearranged the question to ask what happened and ask about the event in progress.
Question now SAT.
24 F
2 X
B U S Does not meet the K/A. Nothing to do with firefighting methods. Also, not a tier 1 question.
Memorization of location of components. Rewrote question. Question now SAT.
25 H
3 N
E I think it would be cleaner to state how many fans are running instead of all five NOT running. Is it necessary to add trend on vacuum? It does not appear to me that the entry conditions are met for 40AO-9ZZ07. Changed stem to state 11 of 16 fans running. Question now SAT.
26 F
3 B
S 2021 Exam 27 H
3 B
S 28 H
3 N
S
Form 2.3-5 Written Examination Review Worksheet (PV-2022-05) 29 H
3 N
E S Both parts of distractor D are of the "none of the above" type and should not be used. Changed question construction. Question now SAT.
30 H
3 N
S 31 F
4 N
E S Stem level should be 109 feet. Please provide better distractor analysis on how reactor vessel vortexing is plausible. Modified the distractor analysis. Question now SAT.
32 F
3 N
S 33 H
3 N
S 34 H
2 X
N U S Does not meet the K/A. The question talks about the relationship between CCW and ESF, not ECCS. Rewrote question. Question now SAT.
35 F
3 N
S 36 F
2 N
S 37 F
2 N
E S Can you use the four individual power supplies to make a 1x4 question with just one feeder breaker, to cut down on 2x2 questions? Changed to a 1x4 question with 4 individual power supplies.
Question now SAT.
38 F
3 B
S 2018 Exam.
39 H
3 X
N U S Does not meet the K/A. Not asking about purpose or function. Rewrote question. Question now SAT.
40 F
2 M
S 41 H
3 M
S 42 H
2 N
S 43 H
3 N
E S Would like to eliminate part 1 and make this a 1x4 question. Still meets the K/A since you need to know that valve fails open (part a) and how to correct (part b). Changed to a 1x4 question.
Question now SAT.
44 H
3 N
S 45 H
2 N
S
Form 2.3-5 Written Examination Review Worksheet (PV-2022-05) 46 H
3 M
S 47 H
3 B
S 2019 Exam.
48 F
3 B
S 2019 Exam.
49 F
4 N
S 50 F
2 N
E S Despite the comment in the distractor analysis, I don't find it plausible an AHU would be 4160 V. Is it possible to come up with two 480 V class and non-class load centers as distractors? Changed to four individual power supplies. Question now SAT.
51 H
3 N
S 52 H
3 B
S 2019 Exam.
53 H
3 N
S 54 H
3 N
E S C and D distractor analysis says " the isolation valves only start " Should be " the isolation valves only open " Fixed. Question now SAT.
55 H
3 N
E S Change item 1 from "S/U Aux Feed Pump " to "AFN-P01 " to be consistent with items 2 and 3.
Changed. Question now SAT.
56 H
4 N
E S Could argue no correct answer. 78OP-9FX01 says CONSIDER lowering upender to horizontal position. It is not a requirement. Restructured question. Question now SAT.
57 F
3 N
S 58 H
3 N
S 59 F
3 N
S 60 H
3 N
S Reference provided 61 F
3 N
S 62 F
3 N
S 63 F
3 N
S
Form 2.3-5 Written Examination Review Worksheet (PV-2022-05) 64 F
3 B
S This should be a fundamental knowledge question, not comprehensive. Changed.
65 F
3 N
E S Use a real procedure, not a fictional one. Based on the question, it is still a tier 3 question.
Changed question to use procedure 40OP-9CH01, CVCS Normal Operations. Question now SAT, 66 F
2 N
S 67 F
3 B
S 2018 Exam.
68 H
2 B
S 2021 Exam.
69 F
2 N
S 70 F
3 M
S 71 F
3 N
S 72 H
3 M
E S Change Reactor power will INITIALLY to after Reactor power stabilizes. Changed. Question now SAT, 73 F
3 B
S 74 H
3 N
S 75 H
3 B
S 76 H
3 N
S 77 H
4 B
S 2016 Exam.
78 H
3 N
S 79 H
3 N
S 80 H
3 B
S 2016 Exam.
81 H
3 N
S 82 H
3 N
S Is this minutia. Mainly asking the applicant to require setpoints in the COLR. Although the ASI limits are formally contained in the COLR, the
Form 2.3-5 Written Examination Review Worksheet (PV-2022-05) limits for ASI are also in 40AO-9ZZ11, CEA Malfunctions (step 31). The power level at which ASI limits change is trained during CEA Malfunction training and this seems like fair game for an SRO applicant.
83 F
3 N
S 84 H
3 N
S 85 F
3 M
S 86 H
3 N
S 87 F
3 N
S This should be a fundamental knowledge question, not comprehensive. Changed.
88 H
3 N
S Reference Provided. Is this operationally relevant? If they declare at 1010, they have yet to exceed the 15-minute criteria required by either EAL. The Note 1 on each of the EALs says to not delay the call if the condition is likely to exceed the allotted time, and during a LOOP, it is not possible to restore within 15 minutes.
89 F
4 N
E S I like 4 hours4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br /> as a distractor rather than 24 hours2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br />.
That seems too long to me. There are some containment isolation actions statements that are 4 hours4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br /> to add some plausibility. Question changed as requested. Answer changed from C to D.
Question now SAT.
90 F
3 B
E 2021 Exam.
91 H
3 N
E S Fail to see the plausibility of 3.8.1. Changed to 3.7.12. Question now SAT.
92 H
3 X
N U S Appreciate trying to meet the spirit of the K/A, but this should be suppressed at Palo Verde. Won't count as unsat since the K/A should have been rejected. Resample to A2.04. Wrote new question to new K/A. Question now SAT, 93 H
3 B
S 2019 Exam.
94 F
3 N
S 95 F
3 B
S 2019 Exam.
96 F
3 B
S 2018 Exam.
Form 2.3-5 Written Examination Review Worksheet (PV-2022-05) 97 F
2 M
S Change LOD to 2. It is almost not plausible to think Alert is a correct answer. Changed.
98 F
2 N
S 99 H
3 B
S 100 H
3 N
S
Form 2.3-5 Written Examination Review Worksheet Form 2.3-5 Instructions for Written Examination Review Worksheet Refer to ES-4.2 for the definitions of terms used in this worksheet for the written examination.
Review each question (Q) as submitted and as subsequently revised and document the following in the associated worksheet columns:
- 1. Enter the level of knowledge (LOK) as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) from 1 (easy) to 5 (difficult); mark direct lookup questions (applicant can directly determine the answer from the provided reference) as LOD 1. A question is (U)nsatisfactory if it is LOD 1 or LOD 5.
- 3. Check the appropriate box if a psychometric flaw is identified:
Stem Focus: The stem lacks enough focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information). This is an (U)nsatisfactory question.
Cues: The stem or one or more answer choices contains cues (e.g., clues, specific determiners, phrasing, length). This is an (U)nsatisfactory question.
T/F: All of the answer choices are a collection of unrelated true/false statements. This is an (U)nsatisfactory question.
Cred. Dist.: The distractors are not credible; single implausible distractors require (E)nhancement, and more than one noncredible distractor in the same question results in an (U)satisfactory question.
Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by the stem). This is an (U)nsatisfactory question.
- 4. Check the appropriate box if a job content flaw is identified:
Job Link: The question is not linked to the job requirements (i.e., the question has a valid knowledge or ability (K/A) but, as written, is not operational in content). This is an (U)nsatisfactory question.
Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory). This is an (U)nsatisfactory question.
- /Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons). This is an (U)nsatisfactory question.
Logic: The question requires backward or reverse logic or application compared to the job requirements. This is an (U)nsatisfactory question.
- 5. Check the first box if a K/A mismatch flaw exists. Check the second box if the question is flawed because it is written at the wrong license level. Either condition results in an (U)nsatisfactory question.
- 6. Enter the questions source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet the criteria of ES-4.2.
- 7. Based on the review performed in steps 2-5, mark the question as (U)nsatisfactory, in need of (E)nhancement, or (S)atisfactory.
- 8. Fully explain the reason for any (U) in column 7 (e.g., how the psychometric attributes are not being met).
- 9. Save the initial review comments and detail subsequent comment resolution so that each exam-bound question is marked by an (S) on this form.