ML13108A245
| ML13108A245 | |
| Person / Time | |
|---|---|
| Site: | Comanche Peak  |
| Issue date: | 04/08/2013 |
| From: | Kelly Clayton Operations Branch IV |
| To: | Luminant Generation Co |
| laura hurley | |
| References | |
| 50-445/13-004, 50-446/13-004 | |
| Download: ML13108A245 (14) | |
Text
ES-401 CP-2013-04 Written Examination Review Worksheet Form ES-401-9 Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 B 5 (easy B difficult) rating scale (questions in the 2 B 4 range are acceptable).
- 3. Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated true/false statements.
The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
- 6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7. Based on the reviewer=s judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8. At a minimum, explain any AU@ ratings (e.g., how the Appendix B psychometric attributes are not being met).
Page 1 of 14 OBDI 202 - IOLE Process Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 1
F 2
X N
U S
Unsat for KA mismatch. Propose new style question where you just ask the power supplies.
Question is now Sat.
2 F
3 X
N U
S Unsat for KA mismatch. The KA is for control instrumentation, not control or instrumentation. Also, when asking PS questions, get straight to the point ( example:
What is the PS to the X component of the Y system?).
Question is now Sat.
3 H
3 M
S 4
H 3
X N
U Unsat for KA mismatch. How can distractor A and D have same noun names for different valves? KA mismatch. You tell them effect (ie loss of design function) when you should ask them the effect, ie is design function lost for this component failure or
Form ES-401-9 Page 2 of 14 OBDI 202 - IOLE Process Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only S
is it reduced.
Question is now Sat.
5 H
3 X
X N
U S
Unsat for KA mismatch. Operating a PORV block valve is not an ECCS control.
I would argue that A is also correct. (Present pressurizer level is 38%, foldout page is 34%.) Procedure is EOS-1.2, (first bullet). Change C and D responses to be written as when/then statements. When., then Add slowly lowering to pzr level bullet in stem and correct type on stem for EOP-1.2 (it is EOS1.2).
Made changes and question is now Sat.
6 H
3 N
U S
Could use a CCP or change the press such that flow would be half or something like that. Sent an example of what we think is a better question for this KA. Too easy, LOD = 1.
Question is now Sat.
7 H
3 X
M E
S Edit - IS this reasonable for an operator to know and is this possible without an SI and turning pressure? What does the FSAR say about a stuck open PORV? Can it reach CS pressure setpoint, SI setpoint? Containment is really large so it doesnt seem believable that 20 psig would be steady state.
Licensee stated that this is a common question and they added a statement that containment spray has not actuated so that the applicant would not think that CS had turned pressure.
Are we assuming that containment spray has FAILED to actuate? Otherwise C and D are not plausible. I suggest picking lower tailpipe temperature and tighten up the responses to all less than Hi 3 setpoint (about 18 psi). Maybe something around 5psig for containment pressure for the answer. Use 2,5, 10, and 15 psig. Remove containment spray has not actuated from the stem. Made recommended changes.
Question is now Sat.
8 H
2 X
B E
S Edit - Remove red flagged and green flagged since they add no value to the distractors.
Question is now Sat.
9 H
3 X
B E
S Edit - distractor D should be 2335# (is PORV lift SP) not 2355#
Suggest deleting by PORV-456 from C and D response. Makes all responses more similar.
Question is Sat.
Form ES-401-9 Page 3 of 14 OBDI 202 - IOLE Process Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 10 F
3 X
B E
S Edit - Stem needs to state loss of the 2D1 DC bus.
Question is now Sat.
11 F
3 X
X N
E S
Unsat for KA mismatch-this question is not asking the definition of a safety train or channel. Never use the at least phrase in a question-psychometric flaw. This creates a subset of the correct answer. Discussion on A distractor is when pressure is greater than the sp not less than the sp (typo).
Broken English in stem, use What pumps make up a complete ECCS train in Mode 4?
Made changes and question is now Sat.
12 F
3 X
X N
E S
Edit - Change distractors to a 2 X 2 with 0 and -0.3 # and reasons for the answers.
Broken English again, use What MIMIMUM containment pressure must be maintained during the containment vent and what is the basis for this value?
Question is now Sat.
13 F
3 B
S Edit-Is this the correct answer? Also, the lights should be given in the stem as green, amber, and red. Reference does not support the answer.
Question is now Sat.
14 H
3 X
N S
Edit - Distractor D not credible. Replace D response with stop only pump 1-02 or 1-04 and observe indications.
Question is now Sat 15 H
3 X
M E
S Edit for making up the controller and position. This is not allowed per HQ since this is a form of attempting to trick the applicant.
No such thing as manual control of plant trip controller.
Modify distracter C and D by removing Tave reference at the end and use a steam pressure value, since the dumps are assumed to be in pressure mode. Example.
reduce steam pressure to 1092 psig.
Question is now Sat.
16 F
3 X
B E
S Change wording of distracter D to LO-LO TAVE with Reactor Trip Signal.
Question is now Sat.
17 H
3 N
U S
Ref incorrect step 4 not step 7 of EOP Unsat for partial K/A mismatch and question is too easy LOD = 1. This covers material outside of KA (ie KA mismatch). Suggest using both TDAFW pump and MDAFW pump effects when CV is closed in one SG only.
Form ES-401-9 Page 4 of 14 OBDI 202 - IOLE Process Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only Made changes and question is now Sat.
18 F
3 B
S 19 H
3 X
N U
S B and D are not credible distracters. Suggest revamping question for actual indications in the CR for DC electrical.
Completely revised question and it is now Sat.
20 H
3 N
S 21 H
3 M
S 22 H
3 X
N E
S Edit-A bullet (similar to the first bullet) in the stem describing the alignment of the turbine building sump might make the 2 responses referring to turbine building more realistic.
Question is now Sat.
23 H
3 X
N U
S Remove distractor A since it is not credible if excess letdown is not in service.
Remove distractor D since it is not credible if not aligned.
Rewrote question and it is now Sat.
24 F
4 N
E S
Too easy as written (LOD = 1). Too many components not directly cooled by SSW.
Rewrote question and it is good now.
Question is now Sat.
25 F
3 X
B E
S Duane proposed some water changes using FP water.
Made recommended changes and question is now Sat.
26 F
2 X
B U
S Unsat - KA mismatch power supplies of inst air compressors. Too easy. Distractors not credible.
Used different bank question and question is now Sat.
27 H
3 X
X N
U Unsat for KA mismatch-the effect of loss or malfunction of IAS on the unit is the KA, not the effect on IAS when cross-tied.
Changed question but now the correct answer and the explanation of the correct answer do not match. Also some of the explanations are with equipment that is not even in the question. Never use the discussion on why the answer is correct that it is correct for the given conditions because then your check and balance of correct answer letter and the body of the question is removed.
Cueing-Noun name on A points to answer.
Form ES-401-9 Page 5 of 14 OBDI 202 - IOLE Process Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only S
Question is now Sat.
28 F
3 X
B U
S Unsat-Cueing between stem and Answer A. Come up with a different valve that doesnt have containment in the name or something else to prevent cueing.
Made changes and question is now Sat.
29 H
3 X
N U
S Unsat-K/A mismatch (Location and interpretation of CRDS AC/DC status alarms) If bkr is open to motor, shouldnt generator breaker also be open? Breaker positions are not alarms.
Remove column 3 from the answers as it is not necessary to answer the question and lowers the disc rimination validity of the question.
Question is now Sat.
30 H
3 N
S 31 H
3 N
S 32 H
2 X
N E
S Reference does not support the answer as provided.
Changed A distracter to sat liquid and question is now Sat.
33 F
2 X
X N
U S
Unsat-K/A mismatch. Seems to be a question relating to how blackout or SI affects 1E busses. Every load center is affected by a blackout therefore distractors A and C are not credible. This is not asking the P/S anyway, but how the power supplies are affected by SBO and SI.
Rewrote the question and it is now Sat.
34 F
2 N
S 35 H
2 B
E S
Edit-The second bullet in each of the three bullet selections is extra info that clouds the choices so it needs to be removed.
Made changes and question is now Sat.
36 H
2 B
E S
Edit-Remove the items that are not part of EHC control, ie manually done, then clean up selections. Made recommended changes done.
Question is now Sat.
37 F
3 N
S 38 F
2 B
S 39 H
3 X
X M
E S
Edit-Made some changes to stem and distractors to better match the KA and question is now Sat.
Form ES-401-9 Page 6 of 14 OBDI 202 - IOLE Process Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 40 H
3 N
S 41 H
3 N
E S
Edit-Are all these items in stem necessary? Answer-yes all needed for five factors for nat circ evaluation. Make a balanced 2 X 2 for D by changing it to steam dump valves should be closed farther. Made recommended changes.
Question is now Sat.
42 H
3 B
E S
My thought process had to do with whether or not the SG would shrink to low level trip, and I dont know the answer to that. Is shrink due to increase in pressure or decrease in heat input. I have always thought it was due to less heat, less bubbles in water. Why would less heat cause the pressure to go up? Im not sure whether answer A or B is correct. Can we justify one correct and one incorrect? Licensee states yes that the question is good as is.
Question is okay as written.
43 H
3 X
N U
S Unsat-KA mismatch-Question does not address the reasons for the actions, stress on reasons for the actions.
Changed question and answers and question is now Sat.
44 H
2 X
N U
S Unsat-KA mismatch - Tough KA to write a question on. What I believe the KA it is looking for is a PZR malfunction occurs and then ask does Sat Temp go up, down, stay the same (maybe 2 X 2 the failure and the expected result). This may be too much of one topic (ie use steam tables to come up with tail pipe parameters).
Seems to be a repeat of a concept already covered. Shouldnt this question relate somehow to talking about pressurizer conditions?
Replaced KA since too many sat conditions with steam table usage. Still need question on this one.
Question looks good with new KA and question is now Sat.
45 H
4 X
N U
S Unsat for SRO-only topic-Selection of procedures, particularly EOPS/AOPS is SRO only.
Modified so that the stem and answer are RO knowledge.
Question is now Sat.
46 H
2 X
N E
S Edit-Can we justify C or D not correct? It seems as if a very small break might cool down the affected loop SG reducing level. Pressure would stay up until MSIVs close.
Revise pedigree for C and D to show why they are not correct.
Licensee updated pedigree and the question is now Sat.
Form ES-401-9 Page 7 of 14 OBDI 202 - IOLE Process Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 47 F
2 N
S 48 H
2 X
B E
S Edit-Changed distracter A to be balanced with other choices and question is now Sat.
49 F
2 X
N U
S Unsat-K/A mismatch. Question refers to a backup indication that PC4 is lost, not backup indication for lost instruments.
Sampled new KA, wrote new question and question is now Sat.
50 F
3 X
X B
U S
Unsat-Distractors not credible and partial KA mismatch-knowledge of the REASONS for the actions is weak at best, need to pick something out of the procedure that has more discrim. validity.
Found a bank question with no KA change and it is now Sat.
51 H
3 X
N U
S Unsat-KA mismatch. This question addresses the loads downstream of the leak, not the valves needed to realign the system, which is the KA.
Modified the question and it is now Sat.
52 H
3 X
N U
S Unsat-KA mismatch-knowledge of the REASONS for the actions, not the actions themselves.
New question and it is now Sat.
53 F
4 X
N U
S Unsat-SRO-only question as written. Selecting procedures is most often SRO only material.
Made several changes to question and answers for balance. The stem and answer require only RO only knowledge because at this value it is an immediate action value to be known from memory for ROs to enter ECA 0.0.
Question is now Sat.
54 H
4 N
S 55 H
3 B
S 56 H
3 X
B U
S Unsat-plausible distracters. Answer B should be re-arranged so that its words are in the same order as the other choice (ie min. injection flow to min. RWST depletion).
Also, the distractors A and C, are these ever a correct answer? These seem not credible to me for distracters.
C and D do not seem plausible. A better distracter might be combinations of stopping pumps and throttling valves. (Stop one CCP and throttle SIP to some minimum value. Stop 1 SIP and throttle ccp flow to some minimum value. Etc)
Made significant mods to several distracters and also after discussion with licensee
Form ES-401-9 Page 8 of 14 OBDI 202 - IOLE Process Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only new elements within several distractors make them more credible.
Question is now Sat.
57 H
3 X
B U
S Unsat-KA mismatch.
Change KA and possibly system topic since CP does not do anything other than trip reactor so permission to resample KA and topic (if needed) to get op valid topic for this plant.
New question is Unsat-the reference doesnt support the answer and the distractors are not credible. One rod dropping is not credible to cause 5 degrees of temp change? Much of the info on this question is GFES anyway. Licensee writing new question for the topic selected.
Question received and is now Sat.
References will be needed to answer this question.
58 H
3 B
S 59 F
3 X
B U
S Unsat-K/A mismatch. This is not an accidental gaseous release, but a planned release. With a tweak this question could be fixed. Just remove words that tie it to planned release.
Made changes and question is now Sat.
60 F
2 X
N E
S Edit-No such thing as Hood County Fire Department. Changed to Granbury Fire Dept.
Question is now Sat.
61 F
2 X
N E
S Edit-Subcooling is really not calculated, but plotted on a graph (using temperature and pressure). Also, Garry to verify what instruments are available at RSP. Done, changed words to plot for B and D choices.
Question is now Sat.
62 H
3 N
S 63 F
2 X
B E
S Edit-Modified one distractor.
Question is now Sat.
64 F
3 X
B E
S Edit-Explanation is wrong for answer C. It is to accommodate the void collapse not prevent it from occurring.
Change B distracter end part to state due to pump start instead of due to the non-condensable gaseshead Made changes and question isnow Sat.
65 H
2 N
S
Form ES-401-9 Page 9 of 14 OBDI 202 - IOLE Process Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 66 F
2 X
B E
S Edit-This is a partial T/F question in that each choice presents new information that is not in the stem. The question could be re-written without this flawed structure, possibly.
Restructure the question to be a what are the MINIMUM requirements and create a 2 X 2 around your requirement choices (both correct and incorrect)
Modified the question and answers and Question is now Sat.
67 F
3 B
S 68 F
3 X
X N
U S
Edit-SRO only question as written. Licensee states that it is not SRO-only because ROs fill out Attachment 1. Choice D could also be correct even though not implicitly mentioned in the reference procedure. Change may to shall?
Although there is no requirement for Attachment 1 to be complete, I would certainly review it prior to allowing the penetration to be opened. If an applicant chooses D, and appeals the question, he might get credit.
May is a wishy/washy word. I would replace may with can on B and C, and replace may NOT with SHALL NOT on A and C (although this could make the question a lot harder) This may be an SRO question.
Made recommended changes, removed TS LCO from C answer and since RO is required to know this information since they do the Attachment 1 work, it is fair for them to be asked this question.
Question is now Sat.
69 F
3 X
B E
S Edit-Suggest changing the numbers to 139, 199, 319, and 349 respectively.
Made changes question is now Sat.
70 H
2 X
B E
S Recommend changing the 9000 in C and D to 5000. Does it make sense to change additional amount of, which appears twice in stem, to amount of additional. (I missed the additional when I first read the question.)
Question is now Sat.
71 F
2 X
N E
S Edit-Too many pieces of info to toggle. This makes it too easy to eliminate all but the answer without knowing the items the question is trying to measure. Use valid distractor info in 2 X 2 array.
Check spelling of Luminesence.
Question is now Sat.
ES-401 CP-2013-04 10 Form ES-401-9 Page 10 of 14 OBDI 202 - IOLE Process Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 72 F
3 X
B U
S Unsat-plausible distracters. Distractors are not credible. What does stored and tagged mean? If stored means left in the core then other choices become partially correct and you may have a subset problem.
A is also correct.
Modified question and answers and question is now Sat.
73 F
2 X
X N
U S
Unsat-Cueing exists in this question and answer therefore it is unsat. The answer contains the 1C5 invertere swap and the stem gives them that they lost 1C5. Why not give them the info to determine what was lost and not just tell them? This is more discriminating. What else would the operator get during a scenario to help diagnose this condition?
Also, The tier 3 questions are not supposed to be system specific but general in nature.
Sampled new KA and wrote new question and it is Sat.
74 F
2 X
N U
S Unsat-KA mismatch with tier 3 topics. The tier 3 questions are not supposed to be system specific but general in nature.
Wrote new question and it is Sat.
75 F
2 X
B E
S Edit stem to align with KA.
Question is now Sat.
76 F
2 X
N E
S Edit-As written, response D is inclusive. To correct it, make all responses say a MINUMUM level of. It could be rewritten to ask, What is the required level band for this situation?
Question modified with bands and is now Sat.
77 H
3 X
N E
S Edit - Focus the stem on procedure selection and actions taken.
Maybe OK as written, but I suggest other distracters. 1. Stop the Charging Pump, then isolate letdown, 2 Isolate letdown, then stop the charging pump and toggle the two procedures.
Question is now Sat.
78 H
4 X
B U
S Unsat-plausible distracters.
C and D distracters are not credible as written. Requested to replace KA for this since could not write credible question on this one.
New K/A and found bank question for it and it is Sat.
ES-401 CP-2013-04 11 Form ES-401-9 Page 11 of 14 OBDI 202 - IOLE Process Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 79 H
4 N
S 80 F
2 X
N E
S Edit - A little confusing about where the break is. No header(piping connecting all steam lines) until the Turbine Building. If break is in Safeguards building, it would be on a steam line. I dont think anyone will go for A or B. I suggest a 2 for 2 question using C and D, along with NOUE and Alert.
Modifying the question per our comments.
Licensee made recommended changes and question is Sat.
References will be needed to answer this question.
81 F
3 X
B E
S Distracter A not credible as written.
Changed A distracter question is now Sat.
82 H
3 N
S 83 H
2 N
S 84 H
2 B
S 85 H
2 B
S 86 H
3 B
S 87 H
4 X
N U
S Unsat - Cueing in the stem for N-16 detector.
Did the N16 decrease give clues to previous questions?
Licensee wrote new question and it is now Sat.
88 F
2 B
E S
Edit-The complete answer is not provided in reference materials. Nothing is mentioned about 1 PORV in service.
Justification and reference provided and question is now Sat.
89 H
3 X
N U
S Unsat-SRO-only question not written. This is an RO knowledge question. If you know the reactor trip occurs (puts you in E0) and the afw pump must be started (trip of both MFW pumps) then procedure selection is not needed to answer the question (ie it does not discriminate).
Licensee wrote new question after sampling new system and K/A and question is now Sat.
This question requires a reference TS 3.7.5 to answer.
90 H
4 N
S Are you sure that this can be done with no references?
ES-401 CP-2013-04 12 Form ES-401-9 Page 12 of 14 OBDI 202 - IOLE Process Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only Is this a fair question without references? Are the entry conditions for all FRGs required to be memorized? Verified LO for this question.
It is Sat as written per CP.
91 H
2 X
X B
U S
Unsat-RO knowledge to answer. This question has two flaws. First, if you know the design pressure for containment, which an RO would, then you know 4psig is not enough to challenge it, so you throw out those two choices, the remaining two choices you can eliminate by cueing. If H2 is the issue then you would use the H2 procedure to combat this event. Recommended a resample since recombiners are retired in place at CP.
CP does not use these anymore therefore New KA and system selected.
Bank question selected for new KA and system 015 and the question is now Sat.
92 H
2 X
B U
S Unsat-RO knowledge to answer this one.
Cant write a an SRO discrim. Question on this topic. Resample a new system and write new question.
Licensee found bank question for the KA and new system selected and it is Sat.
93 F
2 X
X N
U E
S Unsat-RO knowledge to answer this one. Using RO knowledge the relief does not relieve to atmosphere but to ta tank, you can eliminate choices B and C, and with the cueing that an NOUE is in place, an abnormal procedure or higher would be called for, not an RWS procedure.
B and C distracters are not credible as written. Need better distracters.
Duplicates gas tank release question so throw out KA and system.
Selected new system and KA and wrote new question and it needs an edit on the reason for the correct answer. Please clarify the PZR level at 25% with 90% in the explanation. Done Question is now Sat.
94 F
2 X
N U
S Unsat-RO knowledge to answer this one plus cueing leads to answer.
Proper diagnosis of steam pressure inst failure (RO knowledge) leads the cueing to the only choice for the answer. Not sure how to fix this as written.
C and D distracters are not credible as written. Need better distracters.
Cant write a an SRO discrim. Question on this topic. Sampled new generic KA and write new question.
Question is now Sat.
95 F
2 B
S 96 F
3 B
S
ES-401 CP-2013-04 13 Form ES-401-9 Page 13 of 14 OBDI 202 - IOLE Process Q#
- 1.
LOK (F/H)
- 2.
LOD (1-5)
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
B/M/N
- 7.
U/E/S
- 8.
Explanation Stem Focus Cues T/F Cred.
Dist.
Partial Job-Link Minutia
- /
units Back-ward Q=
K/A SRO Only 97 H
3 B
S 98 H
3 B
S 99 F
3 B
S 100 F
2 X
B U
S Unsat-plausible distracters.
C and D not credible distracters. Maybe a 2 out of 2 question?
Replace with 15 minute and 15 minute question.
Licensee made recommended changes and question is now Sat.
RO TOTALS:
B= 28 F= 34 E=
Additional Notes: There were 40 Unsat questions, 30 edits overall, and 30 Sat questions. Of the Unsat questions, 19 were KA mismatch, 11 cred. Distracters, 3 cueing, and 7 wrong license level. See spreadsheet for details.
M= 5 H= 41 U=
N= 42 SRO TOTALS:
B= 14 F= 10 E=
Additional Notes:
M= 0 H= 15 U=
N= 11
GENERAL COMMENT
S:
- 1. Bank questions are indicated by B; Modified are indicated by M; New questions are indicated by N
- 2.
Average difficulty is __2.76 ___ on the RO exam and _2.56_ on the SRO exam.
- 3.
The 10CFR55.41/43 distribution is: RO / SRO 41.1 = 0 43.1 = 2 41.2 = 2 43.2 = 6 41.3 = 3 43.3 = 0 41.4 = 4 43.4 = 1 41.5 = 7 43.5 = 16 41.6 = 4 43.6 = 0 41.7 = 12 43.7 = 0 41.8 = 6 41.9 = 5 41.10 = 20 41.11 = 3 41.12 = 3 41.13 = 1 41.14 = 5
ES-401 CP-2013-04 14 Form ES-401-9 Page 14 of 14 OBDI 202 - IOLE Process
- 5.
The answer distribution is: RO / SRO A = 18 / 5 B = 17
/ 7 C = 22
/ 7 D = 18
/ 6
- 6.
There are 3 questions with attachments provided ( Q57, Q80, and Q89).
- 7. Question 38 was on the 2011 NRC exam and Q97 was on the 2012 NRC exam.