ML23018A046
| ML23018A046 | |
| Person / Time | |
|---|---|
| Site: | Cooper  |
| Issue date: | 11/22/2022 |
| From: | Heather Gepford NRC/RGN-IV/DORS/OB |
| To: | Nebraska Public Power District (NPPD) |
| References | |
| Download: ML23018A046 (1) | |
Text
Form 2.3-5 Written Examination Review Worksheet CNS November 22, 2022, Initial Exam Rev 5 Q
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. K/A Use Flaws
- 6. Source (B/ M / N)
- 7. Status (U /E /S) 8. Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job Link Minutia
- /Units Logic Q-K/A License Level General comments:
- 1.
You always need the page number of the primary reference that answers the question or a copy of the page inserted behind the question is better.
- 2.
For every question the reference must provide the answer to the question. Maybe it is the list of references that is incomplete but for some of the questions the reference did not contain the answer.
- 3.
For Tier 4 questions, they need to be site specific, so where it states at a BWR, make that CNS and if more info is needed to make it specific to Cooper, then please add that information.
- 4.
All choices that are incorrect are labeled as distracters. The correct answer is labeled as answer. For example, Distracter A is incorrect because. Answer C is correct because
- 5.
For every bank question, you either state not used on NRC exam ever or what exam it was last used on in the pedigree section (History field). This is absolutely critical to track for use on prior two NRC exams for a question. It is also required so that you dont exceed the allowed number of previous exam bank questions.
Note for NRR; Final revision of the exam is Revision 6 for all questions. Five questions were found to be overlapping from previous exam (which had a failure on it) so those five questions were removed/changed at rev 5 review.
1 F
2 X
N U
S Unsat for KA mismatch. KA is Ability to locate and determineNo location in the question or answers (needs panel numbers as part of the selection). Secondly, the only thing being tested is the interlock so that is fundamental knowledge not synthesis or cognitive knowledge. Marked as F2.
In rev 2 of question panel locations were added. Question is now Sat.
2 H
3 X
N E
S Stem needs to state what Heatup/cooldown rate must not be exceeded (not maintained) because they dont have to maintain 90F/hr. the procedure states less than or equal to 90F/hr so if they are at 80 they are meeting the procedure so to prevent appeal you need to state it this way.
In rev2 of question these comments were fixed and question is now Sat.
3 F
3 X
N E
S Your plausibility needs work on these. For example, why is it credible to not have the steam adm valve MO-14 (item 1) already open in distracter B? You could state that the governor valve may be the valve that the applicant expects to open and
Form 2.3-5 Written Examination Review Worksheet CNS November 22, 2022, Initial Exam Rev 5 Q
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. K/A Use Flaws
- 6. Source (B/ M / N)
- 7. Status (U /E /S) 8. Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job Link Minutia
- /Units Logic Q-K/A License Level the MO-14 valve is always open. It is a stretch but you get the idea.
Fixed with Rev 3 question.
4 H
4 X
X N
U S
Reference is incorrect and not complete. Alarm Reference is wrong in list of references. It is supposed to be 9.3.3 not 9.3.1 (Core Spray A is 9.3.1 not B) Stem is correct for this aspect.
Procedure 2.2.9 says nothing about this event only that if less than 350 psig, you can inject. How is the DP cell used in the procedure? Is it only by training that you know what to do with the dp cell information? This affects part 1 of each choice. This question needs work.
Fixed with Rev 4 question.
5 F
3 N
S 6
F 2
X X
N U
S subset flaws are introduced when you use the less than values because the setpoint is a given value and the less than or equal to creates the subset with other choices (in this case).
There can be only one value for a relay to energize.
In rev2 of question these comments were fixed and question is now Sat.
7 F
3 N
E S
Use isolation in all four selections after Group 6 text to be complete.
Licensee made suggested changes, question is now Sat with rev 2.
8 F
2 N
E S
Edit-your reference does not complete the support of the answer. The detector explanation is there but not that you get a half scram and rod block.
As a side comment, many of your questions in Tier 2 should not go to SCRAM or EOPs. You should try to focus on the effect at the system level for most of the Tier 2 questions (where the KA will let you).
Licensee completely changed question and it is now Sat with rev2.
9 H
3 X
N E
S Distracter C is not credible. You state in the stem that cps is falling so how could it go up and cause an upscale block? You may have to use another aspect of the SRM besides rod block to complete the distracter list (general rod fault alarm or something like that).
Licensee made suggested changes, question is now Sat with rev 2.
10 H
3 B
E S
Need last use on NRC Exam for bank questions. If none, state that on the form (history field). Licensee committed to fix this in rev 3. This question is fixed and is bank from NRC 2018-09.
Form 2.3-5 Written Examination Review Worksheet CNS November 22, 2022, Initial Exam Rev 5 Q
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. K/A Use Flaws
- 6. Source (B/ M / N)
- 7. Status (U /E /S) 8. Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job Link Minutia
- /Units Logic Q-K/A License Level 11 H
3 N
S REFERENCE REQUIRED (PICS IN THE STEM) 12 F
3 N
S 13 H
3 N
E S
No direct tie to 5.3DC125 in the stem, therefore not Tier 1 as written. Need the procedure (and a step in the procedure is preferred) in the stem. You dont need to overcomplicate the stem with recirc break. What does loss of DC power due to the AC dist system. Here is an example IAW 5.3DC125, if bus AA3 is lost A.
Bus 1F will be lost B.
Bus 1G will be lost C.
Bus 1A will be lost D.
Bus 1B will be lost Licensee made suggested changes, question is now Sat with rev 2. Found as overlapping question contents in Rev 5 with previous exam and was rewritten in Rev 6 and is now Sat.
14 H
3 N
S 15 H
4 X
N E
S stem focus issue. The answer is really a band not a value so it might be appealed. If you used IAW OI #8, what value is within the depressurization rate band for an aggressive cooldown for part 1 (that would not be easy to challenge).
Made suggested changes, question is now Sat with rev 2.
16 H
3 X
N U
S Free review - Did not make suggested changes during free review. Unsat for stem focus. You need to state that the reactor was not scrammed prior to exiting the CR in the stem if you still have the reactor making power.
Made suggested changes, question is now Sat with rev 2.
17 F
3 X
N U
S KA Mismatch-the KA is plant operations for partial or complete loss of REC (CCW). So for your stem the question would be,something after that, such as when are you required to SCRAM? What equipment must be tripped first after the SCRAM? These are plant operations affected by the loss of REC. This would be a great Tier 2 question as written for the interlock on the isolation valve for REC.
License fixed this question in Rev 5 and it is now Sat.
18 F
3 N
E S
2.2.59 is a reference for this question and is required to be listed on reference list. The Control building basement is common to both MCCs and is not necessary for the choices per the NUREG (it is listed in all four choices). This is a fundamental question because location and cross connect are memory items.
Made suggested changes, question is now Sat with rev 2.
Form 2.3-5 Written Examination Review Worksheet CNS November 22, 2022, Initial Exam Rev 5 Q
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. K/A Use Flaws
- 6. Source (B/ M / N)
- 7. Status (U /E /S) 8. Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job Link Minutia
- /Units Logic Q-K/A License Level 19 H
3 X
M U
S REFERENCE REQUIRED No units in all four answers. 5 hrs should be a choice.
Better to use the RHR pump status with selection of instruments from step 4 of 2.4SDC to develop the question Validation 50% missed this question so not LOD = 1 as originally proposed.
Made suggested changes, question is now Sat with rev 2.
20 F
3 N
E S
Need to tie Tier 1 to a procedure in the stem. Validation scores were low on this question (originally scored as LOD = 1)
Made suggested changes, question is now Sat with rev 2.
21 H
3 X
X N
E S
You must tie Tier 1 questions to an EOP, AOP or ARP procedure in the stem to meet the new Tier 1 requirements.
This one is an easy fix. Use the following.
You are in EOP-3A, step PC/P-4 Before Torus pressure reaches 10 psig, Torus spray is required What is the reason for this step? You have slight cueing with two items in the answer and one in the other three. I would create one other distracter with two items in it so that it is balanced. It seems obvious that torus sprays give you a shot at not needing drywell sprays so you might consider taking that piece out of D and then it is balanced and the LOD is 3 then. It seems really easy with that in answer D.
Licensee fixed in Rev 4 and question is now Sat.
22 F
1 X
N U
S Unsat for cueing and LOD. Part2 is too easy and has cueing from stem to answer with RCS in both. Instead of using RCS use reactor recirc piping, which is the limiting component and that eliminates cueing. You need better plausibility discussions also. The MCPR limit in the core safety limit (which is tied to reactor pressure) could be used to enhance your discussion on why the fuel damage aspect is a credible distracter. This is not a comp/higher question either. It is memory all the way.
Licensee still working on this one.
Found as overlapping question contents in Rev 5 with previous exam and was rewritten in Rev 6 and is now Sat.
23 H
3 X
B E
S Need last use on NRC Exam for bank questions. If none, state that on the form (history field).
REFERENCE REQUIRED For Tier 1 you must tie it to a procedure in the stem, in this case EOP-3A, and a step where supp pool temp is evaluated.
Made suggested changes, question is now Sat with rev 2.
24 F
3 N
E S
Need to be clear in the answer write-up that it is the average DW temp that is used for the LCO and EOP-3A condition, not a zone temperature. Since the TS and EOP have the same value, I will give it to you that the stem is tied to Tier 1. You need to put the EOP-3A in the stem though.
Made suggested changes, question is now Sat with rev 2.
Form 2.3-5 Written Examination Review Worksheet CNS November 22, 2022, Initial Exam Rev 5 Q
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. K/A Use Flaws
- 6. Source (B/ M / N)
- 7. Status (U /E /S) 8. Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job Link Minutia
- /Units Logic Q-K/A License Level 25 H
3 B
S NRC 2020-09 EXAM (not previous two NRC exams)
REFERENCE REQUIRED 26 H
3 X
M E
S I believe that RCIC is not credible in this setup so it would not be chosen as written. If you stated that the controller would not work in Auto is that acceptable? Also, should the stem state not including alt strategy equipment? Should stem also state per table 4 of EOP 1A? Also, why is this higher order since it is recall only?
Made suggested changes, question is now Sat with rev 2.
27 H
3 X
M E
Need first part of stem to state that you are in EOP-7A, and evaluating step FS/L-2 for level control.
Still need to shore up distracter analysis Fixed distracter analysis in rev 5 and is now Sat.
28 H
3 B
S 29 F
2 X
N U
S KA mismatch it does not test knowledge of information in Procedure 5.1Incident. it is only asking the basic fire types and that is not even in 5.1Incident. This is also general firefighter knowledge, not operational validity information for a licensed operator. LOD = 1. At least go with a class C fire or use icons from fire panel for areas where auto fire suppression is used to get to method used to fight fire.
Made suggested changes, question is now Sat with rev 2.
30 F
3 B
S Need last use on NRC Exam for bank questions. If none, state that on the form (history field).
31 F
3 N
E S
What is purpose of RCIC logic power failure alarm in the stem of the question? Since this is a Tier 2 question you can just ask the PS to RCIC initiation logic and leave that part out unless I am missing something here? Power Supply questions are fundamental because is it purely recall so change Cog level to fundamental.
Made suggested changes, question is now Sat with rev 2.
32 H
3 N
U S
Credible distracter issue with part 2 of B and D. It is not credible to have the trip reset valve still closed if the linkage was reset (it is a cueing issue). It would make more sense to ask the status of the MO-131 valve and the trip throttle valve.
Licensee made suggested changes, question is now Sat with rev 2.
33 H
3 N
S 34 H
3 M
S
Form 2.3-5 Written Examination Review Worksheet CNS November 22, 2022, Initial Exam Rev 5 Q
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. K/A Use Flaws
- 6. Source (B/ M / N)
- 7. Status (U /E /S) 8. Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job Link Minutia
- /Units Logic Q-K/A License Level 35 H
3 N
E S
This is a Tier 2 question and you made it Tier 1. See the difference?
Made suggested changes, question is now Sat with rev 2.
36 H
2 B
S Need last use on NRC Exam for bank questions. If none, state that on the form (history field).
Licensee completed. This question was completed at Rev 3 but overlapped with the audit exam so licensee replaced and question is now Sat with Rev 4.
37 H
3 B
S Need last use on NRC Exam for bank questions. If none, state that on the form (history field).
Licensee completed.
38 H
3 M
S 39 H
3 B
S Need last use on NRC Exam for bank questions. If none, state that on the form (history field).
Licensee completed.
40 H
3 B
E S
I dont think it is credible to ask if the DGs are running for these conditions. It is credible to ask if they are powering the bus after 30 seconds.
Need last use on NRC Exam for bank questions. If none, state that on the form (history field).
Made suggested changes, question is now Sat with rev 2.
41 F
3 B
S Need last use on NRC Exam for bank questions. If none, state that on the form (history field).
42 F
2 B
S Need last use on NRC Exam for bank questions. If none, state that on the form (history field).
43 H
2 B
S Need last use on NRC Exam for bank questions. If none, state that on the form (history field).
44 H
3 X
N U
S Unsat for two non-credible distracters. The individual parts are credible until you pair them. Then A doesnt seem credible and D doesnt seem credible with the items paired together. Your plausibility would have to be very convincing to state these are true together. Here is a suggestion:
A. fails as is, pump keeps running B. fails open, pump trips on runout conditions C. fails closed, pump trips on low flow D. fails closed, pump keeps running on min flow Made suggested changes, question is now Sat with rev 2.
45 H
3 B
S Need last use on NRC Exam for bank questions. If none, state that on the form (history field).
46 H
3 X
N E
A and D are essentially the same answer here. Also, the NUREG discourages the use of no effect, nothing happens, because of the negative aspect of knowledge measurement and the perception of trickery (the NRC would never give me
Form 2.3-5 Written Examination Review Worksheet CNS November 22, 2022, Initial Exam Rev 5 Q
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. K/A Use Flaws
- 6. Source (B/ M / N)
- 7. Status (U /E /S) 8. Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job Link Minutia
- /Units Logic Q-K/A License Level S
all this information and the answer is nothing happens). Could use 1 X 4 with 4 temps or use HPCI continues to run since no Group 4 occurred and HPCI continues to run because its sub-systems are unaffected and keep your B and C choices.
Made suggested changes, question is now Sat with rev 2.
47 H
3 N
E S
You need narrow range for the instrument in the stem for part 1 to be true.
Made suggested changes, question is now Sat with rev 2.
48 H
3 N
E S
Reason for the action is not supported in your reference provided. Please provide this.
Licensee fixed in rev 4 and question is now Sat.
49 H
3 X
N U
S You have cueing in the stem with excessive cold water. Also, you dont need to know anything that happened with Recirc and just ask with the IRM conditions given, what is the plant response and you can get to the answer. If you state that recirc A speed increased during the startup and you observe the following conditions you will fix the issue.
Made suggested changes, question is now Sat with rev 2.
50 H
3 N
S 51 F
2 B
S Need last use on NRC Exam for bank questions. If none, state that on the form (history field).
52 F
3 N
S Need last use on NRC Exam for bank questions. If none, state that on the form (history field). Licensee corrected and was Sat in Rev 3. However, was found to overlap with audit exam so it was removed and new question written.
With rev 6 the new question is now Sat.
53 H
3 X
N E
S You can be challenged when asking what is the main concern with something, or what is the primary reason. The stem needs to tie directly to the caution statement in procedure 2.2.8. Without this locked in aspect in the stem, applicant could argue that B is also correct (step 2.11 mentions this aspect).
NUREG discourages this also. See Appendix B of NUREG for examples of this condition.
Use Per the caution statement in procedure 2.2.8, what is the main concern if d/p is above that band Made suggested changes, question is now Sat with rev 2.
54 H
3 B
S The None as a distracter will be allowed on this question because you have good plausibility for it and it seems reasonable but remember that the NUREG discourages the use of these distracters.
Need last use on NRC Exam for bank questions. If none, state that on the form (history field).
55 H
3 B
E You need more plausibility discussion on why D is not correct and put emphasis on actions required by procedure in the
Form 2.3-5 Written Examination Review Worksheet CNS November 22, 2022, Initial Exam Rev 5 Q
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. K/A Use Flaws
- 6. Source (B/ M / N)
- 7. Status (U /E /S) 8. Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job Link Minutia
- /Units Logic Q-K/A License Level S
stem to prevent an applicant from arguing that D is correct also if CRS acts conservatively.
Need last use on NRC Exam for bank questions. If none, state that on the form (history field).
Made suggested changes, question is now Sat with rev 2.
56 H
3 X
N U
S Unsat due to multiple correct answers due to subset issues.
You have multiple correct answers with subsets in this question.
You need to reword the stem IAW procedure 2.2.66, what value will cause FCV-55 to isolate and use distracters that cannot be argued as correct. For example A.
High upstream pressure reading 10 psig B.
Low upstream pressure reading 6 psig C.
High downstream pressure reading 50 psig D.
Low downstream pressure reading 5 psig C is correct if PS-108B is used for this example above.
Made suggested changes,but plausibility still needs work.
With Rev 4 answer and writeup still do not match.
With rev 6 the question is now Sat.
57 F
3 X
X N
U S
First, your stem is challengeable as written because it is not a list all question. You have to pick from the four choices and PMIS is not included and it would be an indication available.
This would lead someone to say there is no correct answer.
The stem should be something like Which of the below indications can be used to confirm that the rod is Second of all, your reference support and your plausibility arguments are centered on the logic of a rod that is coupled, not uncoupled. While subtle, the opposite is not always true, so please repair this with your reference support.
Thirdly, You have to be complete with each item. In distracter C you need to state Rod Overtravel Alarm, Rod Drift Alarm, and Four Rod Display. Same is true for answer D. Rod Overtravel Alarm, Rod Drift Alarm, etc.
If you fix your discussion you will see that the Full OUT red light being lit would make no sense for an uncoupled rod, so you need to modify your list.
Would the four rod display be completely out or just out for the quandrant of the uncoupled rod?
Made suggested changes, question is now Sat with rev 2.
58 F
3 N
S 59 H
4 X
X N
E Borderline KA mismatch - you are not monitoring system flow.
You are really asking when can you start them and when do they automatically secure based on RPV level. Also, can you override and spray at any DW pressure? If so then stem
Form 2.3-5 Written Examination Review Worksheet CNS November 22, 2022, Initial Exam Rev 5 Q
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. K/A Use Flaws
- 6. Source (B/ M / N)
- 7. Status (U /E /S) 8. Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job Link Minutia
- /Units Logic Q-K/A License Level S
flawed for part 1. You also have no discussion in plausibility of why part 1 is correct.
With rev4 plausibility writeup still not good.
With rev 6 question is Sat.
60 H
3 X
X N
E S
The reference does not state failure of PC, it states challenge the PC negative pressure capability. When you state the possible consequence in the stem it leaves open the challenge possibility. Since this is a Tier 2 question you can ask where does the RHR system tie into spray (upstream or downstream of component X or component Y). Also, do you see how this is more of a Tier 1 question? This is a really hard question too. It is Cognitive not fundamental. B and C are essentially the same distracter and C needs from Torus to the Drywell to be correct (grammatically match B). I would recommend an easier question on physical connections that is Tier 2 all the way.
Licensee needs to rewrite.
With rewrite in rev6 question is now Sat.
61 F
2 B
S Need last use on NRC Exam for bank questions. If none, state that on the form (history field).
62 H
2 N
S This is an LOD = 2 question.
63 H
3 X
N E
S Distracter D is not credible-How could you be not operable with one door open and operable with BOTH 903 doors open?
Licensee will rewrite. Sent new question and with rev4 the question is now Sat.
64 H
2 B
S 2017 NRC, Q66 65 F
3 B
S 2018 NRC, Q66 66 F
2 N
U S
I could not find your reference in 2.0.1.2, nor could I find any list of allowed two-handed operations. Are you sure you have the reference right or do we not have the latest version of 2.0.1.2? Also, I dont see the Mit SCRAM actions of 2.1.5 in procedure 2.0.1.2. Is this an oversight? Was a bank question but Licensee will rewrite-procedure changed. Licensee wrote new question and with rev6 it is now Sat.
67 F
2 B
E Question is Sat.
You guys have not tracked pedigree as required by NUREG-1021. This question was found in 2020-04 NRC Exam, Q72 and you do not have it documented that way. Does your Vision not track history use? That is what the history field is for on the NRC Exam question worksheet.
However, you must get this data into each worksheet for ALL bank questions. If not previously used on NRC exam, then you put NA in the history field or never used on NRC exam.
Form 2.3-5 Written Examination Review Worksheet CNS November 22, 2022, Initial Exam Rev 5 Q
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. K/A Use Flaws
- 6. Source (B/ M / N)
- 7. Status (U /E /S) 8. Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job Link Minutia
- /Units Logic Q-K/A License Level S
Licensee corrected this issue.
68 F
2 B
S See bank tracking comments above. 2015 NRC Exam, Q72 69 F
2 B
S Pedigree incorrectly states that last used was 2018 NRC Exam, it was last used on 2020-04, Q70.
70 F
3 B
E S
For Tier 4 questions, they need to be site specific, so where it states at a BWR, make that CNS and if more info is needed to make it specific to Cooper, then please add that information.
Also, swap C and D to make it short to long from A to D and this makes D the correct answer.
Made suggested changes, question is now Sat with rev 2.
71 F
3 B
S 72 F
3 B
E S
Is it Bank B1964 or B1965?
Made suggested changes, question is now Sat with rev 2.
73 F
3 B
E S
For Tier 4 questions, they need to be site specific, so where it states at a BWR, make that CNS and if more info is needed to make it specific to Cooper, then please add that information.
Make sure that all of your steam tables are the same revision when you hand them out and they match the one that was used to develop this question. Since Sat pressure is same everywhere for 400F, this is a good opportunity to create a modified question that is site specific to CNS that includes this information.
Licensee made changes and with rev 5 the question is now Sat.
74 F
4 B
E S
For Tier 4 questions, they need to be site specific, so where it states at a BWR, make that CNS and modify it to be site specific for CNS (if this data does not work at CNS).
Made suggested changes, question is now Sat with rev 2.
75 F
3 B
E S
For Tier 4 questions, they need to be site specific, so where it states at a BWR, make that CNS and if more info is needed to make it specific to Cooper, then please add that information.
Made suggested changes, question is now Sat with rev 2.
76 H
3 N
U S
KA Mismatch-question has nothing to do with partial or complete loss of AC (system for KA). References (first 2) have no supporting info for the question. Make sure your references answer the question. This is a Tier 1 question also, so tie it to an abnormal or emergency procedure.
Licensee rewrote question and it is now Sat with rev 6.
77 H
3 N
E I dont think selecting a mode 3 statement is credible for distracters A and C. I would use the knowledge they must know that the hours are not cumulative between C.1 and D.1 of the LCO. This would make distracter A and C this:
Form 2.3-5 Written Examination Review Worksheet CNS November 22, 2022, Initial Exam Rev 5 Q
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. K/A Use Flaws
- 6. Source (B/ M / N)
- 7. Status (U /E /S) 8. Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job Link Minutia
- /Units Logic Q-K/A License Level S
A.
Aug 19 at 0800 B.
Same as you have it C.
Sept 4 at 0800 D.
Sept 3 at 2000 I would switch C and D so they are in chronological order and this makes C correct.
Made suggested changes, question is now Sat with rev 2.
78 F
3 X
N U
S Unsat for not at SRO level. NUREG ES-4.2, page 23 states that SRO knowledge cannot be claimed for any AOP entry condition, nor can it be claimed for plant parameters that require entry in major EOPs (including EOP-9B)= for containment control). If you had something using bullet 2 in middle of page 22 of ES-4.2 for analysis and interpretation of radiation and activity readings (ie not a direct entry) to then enter EOP-9B that would work.
Made suggested changes, question is now Sat with rev 2.
79 H
3 X
N E
S PSP doesnt use DW pressure, it uses torus pressure, so it is more credible to use the DSIL graph for distracter B2 and D2.
Made suggested changes, question is now Sat with rev 2.
80 H
2 X
N U
S Not SRO only as written-with MSIVs closed, no condenser so SRV is only way to release pressure (RO knowledge) and RCIC for cooling (RO knowledge). You have to hit one of the four bullets in the NUREG ES-4.2. Since you are not selecting EOP-3A and specifically not transitioning to an event specific sub procedure it cannot count as SRO only. You also need more explanation on how you are meeting high reactor pressure part of the KA in your analysis because at first glance I did not think you were meeting high reactor pressure part of the KA.
Licensee rewrote question and with rev 6 it is now Sat.
81 F
2 X
N U
S Not SRO only as written. It needs to be written to have the SRO decide what procedure to enter/exit in the selections, not put in the stem. Such as A.
Stay in EOP-6A and 7A B.
Stay in only EOP-6A C.
Exit EOP-6A and 7A and enter EOP-1A D.
Enter SAG -1 This would also be a higher order question.
Made suggested changes, question is now Sat with rev 2.
82 H
3 N
E I believe this is LOD = 3 because it is almost RO entry conditions for 5.3GRID, but because it is not and it is freq not voltage it meets the guidance to be SRO only and I think it is LOD = 3. Do you have validation data to support an LOD = 4?
83 H
3 X
X N
U Not SRO only. This is RP knowledge to enter a high rad area since you provide the dose in the stem. Also, seems like you would be dead if you tried to enter a dose field of 2000 rem/hr in the stem. Are units wrong? Because use of general RP
Form 2.3-5 Written Examination Review Worksheet CNS November 22, 2022, Initial Exam Rev 5 Q
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. K/A Use Flaws
- 6. Source (B/ M / N)
- 7. Status (U /E /S) 8. Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job Link Minutia
- /Units Logic Q-K/A License Level S
knowledge can answer question and is not using the caution, then it also doesnt meet the KA. Also not a Tier 1 question.
Licensee is working on this question. Still needs work in rev 5.
With rev 6 of question it is now Sat.
84 H
3 X
B U
S KA mismatch for failing to evaluate release RATE.
Licensee corrected this error and question is now sat with rev2.
85 H
2 N
S 86 H
2 N
S 87 H
3 X
X N
U S
KA mismatch because you do not have procedure choices in the selections. SRO has to involve procedure selection for the A2 KA so you have to see procedures in the choices to meet the KA (the b part of the KA is required).
Licensee is rewriting question. With rev3 of question it is now Sat with rev2.
88 H
3 X
B U
S KA mismatch-the RBM purpose is to limit MCPR and this KA is for APRM/LPRM. There is a separate system for RBM. Need to go after the APRM/LPRM instruments for the TSB/LCOs.
Licensee is rewriting question. With rev5 of question the stem focus was off (must state flow biased TRIP) and grammar issues with the choices.
Licensee corrected these issues and question is sat with rev 6.
89 H
2 X
B E
S Stem should state something like if parameters do not change to complete the stem and not allow appeal.
Made suggested changes, question is now Sat with rev 2.
90 H
3 X
X N
E S
KA IS PARTIALLY not met because you are not selecting the procedure to be used to mitigate the event (what do you do for the DG fire activation). You do have procedure selection in choices (which is good, but this doesnt help with the event-so not a complete KA match). Also, DG-1 continues to run is in all four choices and so by NUREG rules should be moved into the stem.
Licensee is rewriting question. With rev 3 question is now Sat.
91 H
4 X
X N
U S
No link to procedure choice/use in choices so doesnt meet part b of KA.
Licensee is rewriting question. With rev 3 question is now Sat.
92 H
3 X
N U
S How is 3.9.2 rod position interlock credible with no other information in the stem? Affects credibility of distracter B1 and D1.
Licensee is rewriting question. With rev 3 question is now Sat.
93 H
4 X
X N
E Your reference has conflicting info for your answer. It states 5R Whole body for LOCA and 5R TEDE for fuel handling
Form 2.3-5 Written Examination Review Worksheet CNS November 22, 2022, Initial Exam Rev 5 Q
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. K/A Use Flaws
- 6. Source (B/ M / N)
- 7. Status (U /E /S) 8. Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job Link Minutia
- /Units Logic Q-K/A License Level S
accidents. Stem and choices are affected by this so it needs to be clarified.
Licensee modified stem and is now sat.
94 H
4 X
X N
U S
A2 and C2 not credible if state in the stem which TS/TRM is not met and there are no choices for those items in A and C part 2 items.
Licensee is reworking this question. With rev 5 question still needs edits.to stem for clarity. With rev 6 question is now Sat.
95 F
3 X
N U
S Unsat for not SRO knowledge. RO knowledge for both parts.
Part 1 is RO knowledge and part 2 is control room monitor and this is any Licensed Operator.
Found as overlapping question contents in Rev 5 with previous exam and was rewritten in Rev 6 and is now Sat.
96 F
3 B
S 2018 NRC Exam, Q96 You do not have this marked for pedigree on worksheet. See previous comments on this.
97 F
4 M
S Listed as bank-appears to be modified bank from 2017 NRC Exam, Q94.
98 F
3 B
S 2018 NRC Exam, Q98 You do not have this marked for pedigree on worksheet. See previous comments on this.
99 H
4 X
N U
S KA mismatch -Does not meet KA of knowledge of Fire protection procedures, but knowledge of EALs.
Licensee wrote new question, and it is now sat as rev2.
100 H
3 X
N E
S How is 5.5aircraft plausible with helicopter in air for photos?
Need to somehow make this more credible (distracters C1 and D1)
Licensee modified question and it is now Sat with rev2.
Form 2.3-5 Written Examination Review Worksheet CNS November 22, 2022, Initial Exam Rev 5 Form 2.3-5 Instructions for Written Examination Review Worksheet Refer to ES-4.2 for the definitions of terms used in this worksheet for the written examination. Review each question (Q) as submitted and as subsequently revised and document the following in the associated worksheet columns:
- 1. Enter the level of knowledge (LOK) as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) from 1 (easy) to 5 (difficult); mark direct lookup questions (applicant can directly determine the answer from the provided reference) as LOD 1. A question is (U)nsatisfactory if it is LOD 1 or LOD 5.
- 3. Check the appropriate box if a psychometric flaw is identified:
Stem Focus: The stem lacks enough focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information). This is an (U)nsatisfactory question.
Cues: The stem or one or more answer choices contains cues (e.g., clues, specific determiners, phrasing, length).
This is an (U)nsatisfactory question.
T/F: All of the answer choices are a collection of unrelated true/false statements. This is an (U)nsatisfactory question.
Cred. Dist.: The distractors are not credible; single implausible distractors require (E)nhancement, and more than one noncredible distractor in the same question results in an (U)satisfactory question.
Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by the stem). This is an (U)nsatisfactory question.
- 4. Check the appropriate box if a job content flaw is identified:
Job Link: The question is not linked to the job requirements (i.e., the question has a valid knowledge or ability (K/A) but, as written, is not operational in content). This is an (U)nsatisfactory question.
Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory). This is an (U)nsatisfactory question.
- /Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons). This is an (U)nsatisfactory question.
Logic: The question requires backward or reverse logic or application compared to the job requirements. This is an (U)nsatisfactory question.
- 5. Check the first box if a K/A mismatch flaw exists. Check the second box if the question is flawed because it is written at the wrong license level. Either condition results in an (U)nsatisfactory question.
- 6. Enter the questions source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet the criteria of ES-4.2.
- 7. Based on the review performed in steps 2-5, mark the question as (U)nsatisfactory, in need of (E)nhancement, or (S)atisfactory.
- 8. Fully explain the reason for any (U) in column 7 (e.g., how the psychometric attributes are not being met).
Form 2.3-5 Written Examination Review Worksheet CNS November 22, 2022, Initial Exam Rev 5
- 9. Save the initial review comments and detail subsequent comment resolution so that each exam-bound question is marked by an (S) on this form.