ML15127A502
| ML15127A502 | |
| Person / Time | |
|---|---|
| Site: | Cooper  |
| Issue date: | 04/21/2015 |
| From: | Vincent Gaddy Operations Branch IV |
| To: | Nebraska Public Power District (NPPD) |
| References | |
| Download: ML15127A502 (1) | |
Text
ES-401 CN-2015-04 Written Examination Review Worksheet Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only Distractor C is a true statement, so why is it wrong? Also, A is almost never incorrect.
U 1 F 2 U N Distractors reworded. Question is now SAT.
S A, 41.10 Reword D to make similar to other answers. Add per procedure XXX in stem.
Capitalize unless in D.
E 2 F 3 U B Changes made. Question is now SAT.
S A, 41.5, NRC 2002 3 H 3 N S C, 41.7 Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 B 5 (easy B difficult) rating scale (questions in the 2 B 4 range are acceptable).
- 3. Check the appropriate box if a psychometric flaw is identified:
$ The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
$ The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
$ The answer choices are a collection of unrelated true/false statements.
$ The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
$ One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
$ The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
$ The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
$ The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
$ The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
- 6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7. Based on the reviewer=s judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8. At a minimum, explain any AU@ ratings (e.g., how the Appendix B psychometric attributes are not being met). _Rev 1 Page 1 of 18 OBDI 202 - IOLE Process
ES-401 CN-2015-04 2 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only Add procedure to stem.
E 4 H 3 M Procedure added to stem. Question is now SAT.
S B, 41.10 Dont see how D is plausible.
E 5 H 2 E B Upon further discussion with licensee, D is plausible and question is SAT as is.
S A, 41.8 Still dont see plausibility of B and C. How does this meet K/A of control room abandonment and remote shutdown panel? It meets K/A because control room abandonment has an action that changes the location of control from the control room to the remote shutdown panel.
E 6 F 3 E E M After discussion, determined B and C are plausible because other systems do S respond that way. Also, if a fire, spurious actuations could occur. Added automatically to the stem to ensure only one correct answer. Question is now SAT.
D, 41.7, NRC 2006 Per explanation, B could occur, although unlikely, so could also be considered correct. Reference as provided does not provide complete technical basis for question as written.
E 7 F 2 E N Explanation revised to explain why B is incorrect for the specified plant conditions.
S Stem reworded to add procedure reference. Question is now SAT.
C, 41.4 8 H 2 M S B, 41.7 9 H 2 M S A, 41.14, Reference E Dont need last part of question (delete rest of question after flange).
10 F 2 E N S Stem revised. Question is now SAT. _Rev 1 Page 2 of 18 OBDI 202 - IOLE Process
ES-401 CN-2015-04 3 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C, 41.10 Is this an SRO level question? Based on discussion with licensee operations
? management, it is an RO level learning objective, the material is covered in the 11 H 3 B systems operations portion of license class, and management expectation is that reactor operators should know this information. Therefore, question is SAT as is.
S B, 41.8, Reference Does the question need the last sentence of first paragraph or is that expected plant response? If expected, delete. What makes distractor A incorrect?
?
Per discussion with licensee, distractor A is incorrect due to SLC flow rate not being 12 H 2 E ? N E sufficient to maintain inventory. Question explanation edited to explain this.
S Stem edited. Question is now SAT.
B, 41.5 If distractor C is correct, so is D - makes C not credible. Initial plant conditions in stem can be deleted.
E Based on further technical information provided by licensee, D is NOT a subset of C, 13 F 3 E M therefore no change is needed. Initial plant conditions in stem provide information necessary to answer question, therefore no changes are needed. Question is SAT S as is.
D, 41.5 The question is ok because it specifically references the EOP which states 0.
14 F 3 N S A, 41.7 For this K/A, is 5.5 feet considered low? Also, I think the logic is backward for this U question. Why would the operator need to calculate temperature, isnt there an indication? Also, how would the operator know theyre at the NPSH limit without 15 H 3 U ? N temperature?
S Per licensee, 5.5 feet is considered low so it is a K/A match. The question stem has been reworded to remove the backward logic. Question is now SAT. _Rev 1 Page 3 of 18 OBDI 202 - IOLE Process
ES-401 CN-2015-04 4 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C, 41.7, Reference 16 H 2 B S A, 41.7 Wheres technical reference about rod position and shutdown status (for distractor D)?
?
17 F 3 N Technical reference for distractor D has been provided. Question is SAT as is.
S C, 41.10 How is C credible? Any need to clarify in stem that there is no hydrogen injection occurring? No need to clarify in stem because normal operation is with hydrogen E injection.
18 H 2 E E N S Both A and C reworded to improve plausibility of distractors. Question is now SAT.
D, 41.7 Replace distractor B To ensure that D, which is also true, is incorrect, reword question as follows:
Per Procedure 5.4FIRE-S/D (Fire Induced Shutdown from Outside Control Room), all AC powered Reactor Feedwater Pump lube oil pump control switches are placed in 19 F 3 E E N S PULL-TO-LOCK to ensure.
Upon further discussion with licensee, question is SAT as is.
A, 41.10 Edit stem to remove potential for negative cuing (grid disturbances). Is the first sentence even necessary (could add power level to bulleted list)? Need to add if generator is over or under-excited.
E 20 H 3 E E N Stem edited to remove negative cuing. No need to add if generator is over or under S excited as this doesnt affect the answer. Question is now SAT.
C, 41.5 _Rev 1 Page 4 of 18 OBDI 202 - IOLE Process
ES-401 CN-2015-04 5 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only Is there a dynamic graph on RVLC HMI? The procedure doesnt specify which location to use (so how is RVLC HMI incorrect)? Add reactor to B and D (scram reactor). Lower case rapid power reduction. Add status of annunciator 9-5-2/C-4.
E Per licensee, there is NO dynamic graph on RVLC HMI, making it incorrect. No need 21 H 3 E N for status of annunciator based on other information provided in the stem (candidate should be able to diagnose based on given information). Distractors edited.
S Question is now SAT.
D, 41.10 Reword stem (similar to 19): Per procedure.., SRVs are..to prevent.
E 22 F 2 E N Stem wording is ok as is. Question is SAT.
S A, 41.10 D distractor not credible. Can the distractor on inability to scram rods from original bank be used instead? Reword distractor A to read reduced drive piston seal life.
E 23 F 3 E B Distractor D replaced. Distractor A reworded. Question is now SAT.
S A, 41.6 Add per procedure XX in stem. Need to beef up distractor A (perhaps add words about unmonitored release?). Note that technical reference needs to be redacted on E ADAMS document.
24 F 3 E N S Revisions made. Question is now SAT.
C, 41.10 Add per procedure XXX to stem. Clarify in question that its an initial CR operator action. Also reword question: Based on the above, which. (determined last change E is unnecessary).
25 H 3 E M S Revisions made. Question is now SAT. _Rev 1 Page 5 of 18 OBDI 202 - IOLE Process
ES-401 CN-2015-04 6 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B, 41.7 Where are valves from the stem located and how do they affect reactor building isolation? Need technical reference to support.
?
26 H 4 N Reference and explanation provided. Question is SAT.
S A, 41.9 NRC generated question.
27 F 2 N S C, 41.10 Put reactor in front of pressure instem. Correct answer should not be right at the shutoff head, as one could argue that flow may not occur until below shutoff head.
Change B to 400 and C to 200.
Need to edit explanation section. The explanation stated that the answer is the only E plausible choice (which indicated that the other choices are not plausible/credible).
Reword to say that the answer is only correct choice instead.
28 F 2 E E N Distractors edited. Explanation section edited. Still need to put reactor in question:
listed reactor pressures below S
Question revised and is now SAT.
C, 41.8 Add per procedure XXX in stem.
E 29 H 3 N Question edited and is now SAT.
S B, 41.7 Per SRO only guidance, question is based solely on knowledge of </= 1 hr TS and 30 F 3 N S therefore is RO level.
C, 41.10 Is this an SRO level question (some of the question comes from below the line TS)?
?
31 F 3 ? N Per licensee, the information is included in the systems training lesson plan and so is _Rev 1 Page 6 of 18 OBDI 202 - IOLE Process
ES-401 CN-2015-04 7 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only S RO level knowledge. Question is SAT as is.
D, 41.8 Where is MDEM explained? I need that reference as well in order to fully evaluate question.
E 32 H 3 N Information provided. Question is SAT.
S C, 41.7 M Although D is different from the others, the explanation provided makes sense and 33 F 2 S question is ok as is.
A, 41.7, Modified from NRC 2014 exam 34 H 2 M S B, 41.7 35 H 3 M S C, 41.2, Modified from CNS 2008 36 H 4 M S B, 41.7 Edit stem to read: What is/are..scram signals.
E Question revised to add first part of editorial correction. The intent was to also change the second part to add signals after scram.
37 H 3 E B S Question revised and is now SAT.
D, 41.7, CNS 2006 38 H 3 N S B, 41.5 NRC generated.
39 F 2 N S C, 41.7 Bold after in stem. C not credible.
E 40 H 3 E E N C replaced and question edited. Question is now SAT.
S _Rev 1 Page 7 of 18 OBDI 202 - IOLE Process
ES-401 CN-2015-04 8 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D, 41.7 Replace A (not credible).
E Licensee provided additional information about what the site considers start-up.
41 H 3 E N Distractor A is therefore credible and question is SAT as is.
S D, 41.10 B not credible.
E Licensee provided additional information on why B is credible but incorrect and 42 F 3 E N revised the explanation section accordingly. Question is SAT.
S A, 41.7 43 H 2 N S A, 41.13 Replace B as cornfield substation no longer exists (not credible).
E 44 F 2 E N B replaced. Question is now SAT.
S C, 41.7 Wrong K/A listed on question sheet (see outline for correct statement). I believe the K/A is similar enough in nature that the question is still ok.
E 45 H 3 E B K/A on question sheet corrected. Question is SAT.
S B, 41.7, NRC 2012 Several distractors are true statements meaning multiple correct answers as written.
U Need to add per procedure/document XXX in stem to clarify which answer is correct.
46 H 2 U M E Stem edited to clarify priority of operational concern. Based on this, the procedure S reference in the stem is not required. Needs editorial: Capitalize PRIMARY in the stem. _Rev 1 Page 8 of 18 OBDI 202 - IOLE Process
ES-401 CN-2015-04 9 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only Question revised and is now SAT.
A, 41.5, Modified from CNS 2005 Delete no oil flow in stem as it is unnecessary cueing.
E 47 F 3 E N Stem edited. Question is now SAT.
S A, 41.7 What is the point of providing information about compressor C in the stem when it is not mentioned in any of the answers?
E Per discussion with licensee, the information about compressor C is necessary in 48 H 3 E N order to determine which of the answer choices is correct. Question is therefore SAT S as is.
A, 41.7 Change does to should in stem.
E 49 H 3 E N Stem reworded to read What is the system.. Question is now SAT.
S D, 41.5 50 H 3 N S B, 41.5 51 H 4 N S C, 41.7 52 F 3 N S A, 41.6 Capitalize ONLY in answers A and B, add BOTH to C and D.
E 53 H 3 E N Question edited and is now SAT.
S C, 41.7 54 H 3 N ? Im unsure of where the specified flow instrument is located. Please send a drawing _Rev 1 Page 9 of 18 OBDI 202 - IOLE Process
ES-401 CN-2015-04 10 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only indicating the location of the instrument tap referenced in the question.
S Drawing updated to show location. Question is SAT.
A, 41.6 C and D not credible. With the stem as written, it is evident that the correct control rod is selected, so why would you get a select error?
U 55 H 3 U N Question reworded to make D correct. Question is now SAT.
S B, 41.7 Might someone ask about the current steam dome pressure? Should this be added to stem? Not necessary to add because its an either/or statement and so the 56 F 3 N S information is not necessary to get to the correct answer. Question is SAT as is.
A, 41.5 Any need to specify reactor mode? No, because the other options are never correct, 57 F 2 N S no matter the mode. Question is SAT as is.
C, 41.4 Delete PCIS initiation logic from the stem as it cues the answer.
E Distractor modified to eliminate potential for cuing. Stem left as is. Question is now 58 F 4 E N SAT.
S C, 41.7 Question stem asks what happens when you lose spray valve control and the correct answer says loss of spray (stem cues answer).
U 59 H 3 U N Question stem reworded to remove cuing. Question is now SAT.
S B, 41.8 E Replace distractors with containment spray time delay and flow instead of no time 60 F 3 E E N delay. _Rev 1 Page 10 of 18 OBDI 202 - IOLE Process
ES-401 CN-2015-04 11 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only S
Edited distractors to remove the time delay and instead test solely on flow rates.
Question is now SAT.
B, 41.7 NRC generated.
61 F 3 N S A, 41.5 62 H 3 N S D, 41.4 NRC generated.
63 H 3 N S C, 41.5 Does offgas ever isolate immediately (without time delay)?
Per revised explanation section, offgas can isolate immediately if done manually, but 64 H 3 N S there is no immediate automatic isolation. Question is SAT as is.
C, 41.3 B not credible.
E 65 F 3 E N B replaced. Question is now SAT.
S C, 41.4 K/A more conducive to being examined during operating test. How could the NLO close the valve in an accident without communicating with the control room (renders B not credible)? Also, why would you need communications with the control room U unless you might need to take action (renders A not credible)?
66 F 2 U N S Distractors revised. Question is now SAT.
D, 41.10 67 F 3 M S D, 41.10 68 F 2 E N E D not plausible. Improve A by raising the temperature to above 212, provided this doesnt make it correct (where is it specified that FW temperature doesnt equal _Rev 1 Page 11 of 18 OBDI 202 - IOLE Process
ES-401 CN-2015-04 12 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only average reactor coolant temperature?).
S Per discussions with licensee, D is plausible because it is used during a startup to help verify steam production. A is ok as is and no change is necessary. Question is SAT as is.
B, 41.10 69 F 3 N S D, 41.10 Reference (part of question stem) 70 H 3 N S A, 41.10 Change one distractor to 50 mrem (1 month average dose for pregnant worker) and delete 5000 mrem as distractor.
E 71 F 2 E N Distractors changed. Question is now SAT.
S B, 41.12 Add PCM to C and D and change B to whole body frisk ONLY.
E 72 F 3 N Changes made. Question is now SAT.
S D, 41.12 Similarity to Q98? Questions are not testing same knowledge. Question is SAT.
73 F 2 N S B, 41.12 If C was correct, then A would also be correct (eliminating C as plausible). If D was correct, then B would also be correct (eliminating D as plausible). Make letter case U consistent between answers, either plant shutdown or Plant Shutdown.
74 F 3 U N S Distractors modified to remove subset issue. Question is now SAT.
B, 41.10 75 F 2 E N E B is worded differently than the others, reword to be similar. _Rev 1 Page 12 of 18 OBDI 202 - IOLE Process
ES-401 CN-2015-04 13 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only S B revised, question is now SAT.
D, 41.10 B and C not credible. No indication that the trip is complicated, so why would there be time critical operator actions?
K/A replaced. Need editorial change to first part of all distractors to make it clear that U
reactor power is Between XX% and XX%. Add Between to all distractors or revise F 2 stem to ask for current reactor power range.
76 U N E H 3 Distractors revised. Question is now SAT.
S Reference D, 43.5 How does this question meet the K/A? The question seems more like a loss or malfunction of SW, not component cooling water. Also, although 5.2SW has additional actions, it still has the same base actions as 5.2REC. As a Gr. 6 isolation has not occurred, CRS could N/A the extra steps, so I still dont see how 5.2SW is U incorrect, even though the entry criteria are not met. Delete one in the stem. Not a modified bank question.
77 H 3 U B S Question does meet the K/A as a loss of SW affects ability of CCW. Question stem edited to make 5.2SW incorrect. Question is now SAT.
A, 43.5, NRC 2011 NRC generated. From NRC 2005 exam.
78 H 4 B S A, 43.5 If distractor A was correct, B would also be correct (ERP reading of E+07 would also U require higher entry if E+06 did). Same is true for C and D, eliminating C and A as 79 H 3 U M plausible distractors. Modified NRC 2011 exam.
S Question stem reworded to remove subset issue. Question is now SAT. _Rev 1 Page 13 of 18 OBDI 202 - IOLE Process
ES-401 CN-2015-04 14 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only Reference D, 43.5 80 H 3 N S A, 41.10 If its a load reject, how to the applicants know they still have off-site power? It might be better to have a trip caused by something else (i.e. condenser vacuum) that makes it clear there is no LOOP. Also, B is not credible. If the candidate thinks the diesels are powering the critical buses, it makes no sense why they would try to E backfeed through the normal transformer. If the diesels at Cooper are referred to as emergency diesel generators, then add that to the distractors for consistency.
81 H 3 E E N S Question revised. Per facility, for consistency, they will leave the diesel distractors as is. Question is now SAT.
C, 43.5 82 H 3 N S B, 43.2 Only RO level because the only information needed to answer the question, with the reference as provided, is above the line TS information and <1hr TS action statement. The rest of the information is provided in the reference, making this RO only.
1 U 83 H U N Question has been replaced. New question is SAT.
3 S Reference B, 43.2 Dont understand why the work control procedure is wrong. The procedure discusses the need for configuration control package and maintaining configuration control.
Perhaps the stem should be reworded to make it clear that whats desired is the E location of the configuration control log?
84 H 3 E E N S Question had been edited, clarifying that whats desired is how to control configuration, rendering only one answer correct. Question is now SAT. _Rev 1 Page 14 of 18 OBDI 202 - IOLE Process
ES-401 CN-2015-04 15 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C, 43.3 85 H 3 N S D, 43.2 86 H 3 M S A, 43.5 Change to What is/are the MINIMUM E
Question has been edited and is now SAT.
87 H 3 E N S
Reference B, 43.2 Reference.
88 F 3 N S B, 43.2 With provided reference, A and C are not credible.
U Question revised. I thought that the reference to be provided was also to be revised to remove the mode of applicability information. I need to see the revised proposed reference.
89 F 2 U N Proposed reference provided and was revised as stated. Question is now SAT.
S Reference D, 43.2 90 H 3 N S A, 43.2 91 H 3 N S A, 43.6 Note that the candidates might have some confusion. If asked, the conditions of the second question should NOT be used to answer the first question.
92 F 3 N S Question is SAT as is.
D, 43.5 B and D not plausible as personal safety is always of higher concern than equipment U
93 H 3 U N damage. _Rev 1 Page 15 of 18 OBDI 202 - IOLE Process
ES-401 CN-2015-04 16 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only S Upon further discussion with the licensee, B and D were determined to be plausible due to different plant conditions would cause a different response, and there are similar systems that would require the use of that caution that the individual could confuse with the correct system, causing them to choose the incorrect answer.
Question is SAT as is.
A, 43.5 94 F 3 N S B, 43.5 Add per procedure XXX to stem.
Explanation section explains why adding the procedure to the stem is not desired, but the procedure was added to the stem anyway. I agree that adding the procedure E reference to the stem eliminates A as a plausible distractor, and based on discussions on why the other answers are incorrect, I believe that the procedure 95 F 3 N reference is NOT required in THIS specific instance. Therefore, the procedure reference can be deleted from the question.
S Question revised and is now SAT.
C, 43.7 States should, not shall, in procedure, but based on stem wording, I think its ok.
96 F 2 N S C, 43.3 A not credible. Also, in stem, a SRO should be an SRO.
Distractor reworded to improve plausibility. Edit C to read Verification that correct E parts. Still need to revise stem from a SRO to an SRO.
97 F 2 E N Distractor C edited. Per facility, the convention is to write an acronym as the proper S name, thus a SRO has been left in for consistency with facility practice. Question is now SAT.
B, 43.5 NRC generated. Similarity to Q73? After review, determined that the two questions 98 F 3 N S are testing different knowledge and are SAT as is. _Rev 1 Page 16 of 18 OBDI 202 - IOLE Process
ES-401 CN-2015-04 17 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B, 43.4 99 F 2 M S B, 43.5 Note that this question involves discussion of security procedures (non-safeguards).
100 F 3 N S Question will be redacted from ADAMS files (DRAFT and FINAL EXAM).
B, 43.5 B= 7 F = 37 E = 30 Additional Notes:
RO TOTALS: M = 12 H = 38 U= 7 N = 56 S = 38 B= 2 F = 10 E= 5 Additional Notes: Note that 1 U question (Q77) was a bank question from an NRC exam and therefore is not included in the determination of exam submittal quality.
SRO TOTALS: M= 3 H = 15 U= 5 N = 20 S = 15
GENERAL COMMENT
S
- 1. Bank questions are indicated by B; Modified are indicated by M; New questions are indicated by N
- 2. Chief Examiner comments are indicated in blue.
- 4. The 10CFR55.41/43 distribution is: RO / SRO 41.1 = 0 43.1 = 0 41.2 = 1 43.2 = 7 41.3 = 1 43.3 = 2 41.4 = 4 43.4 = 1 41.5 = 11 43.5 = 13 _Rev 1 Page 17 of 18 OBDI 202 - IOLE Process
ES-401 CN-2015-04 18 Form ES-401-9 41.6 = 3 43.6 = 1 41.7 = 26 43.7 = 1 41.8 = 5 41.9 = 1 41.10 = 18 41.11 = 0 41.12 = 3 41.13 = 1 41.14 = 1
B = 18 (24%) / 9 (36%)
C = 21 (28%) / 4 (16%)
D = 15 (20%) / 5 (20%)