Text

2015-12-DRAFT Written Examination Comments
	ML16012A337
Person / Time
Site:	Fort Calhoun
Issue date:	12/14/2015
From:	Vincent Gaddy; Operations Branch IV
To:	;
References
	Download: ML16012A337 (11)
	v • d • e

ES-401 FCS-2015-12 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only Explanation for distractor B seems to stop mid-sentence. The explanation for 1 F 2 X C N E/S distractor D does not seem sufficient to disregard the answer. /Revised.

There are two different outlets on the regenerative heat exchanger, need to describe which outlet temperature you are referring to. Why would anyone think the regenerative heat exchanger temperature outlet would be correct, since that water has not been cooled by the letdown heat exchanger yet?

2 F 2 X D N U/S Also, if 130 degrees was the correct temperature, then the bypass would also close at 140 degrees - this eliminates 130 as a plausible answer, and therefore renders distractors A and B as non-credible.

Please explain why this question has any discriminating value. /Revised.

3 F 3 A N S 4 H 3 X X X C N E/S Need a comma after Valve in stem. /Revised.

5 F 3 X X B B E/S Add core offload in progress in stem. /Revised.

Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 B 5 (easy B difficult) rating scale (questions in the 2 B 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

$ The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

$ The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

$ The answer choices are a collection of unrelated true/false statements.

$ The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

$ One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

$ The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

$ The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

$ The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

$ The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7. Based on the reviewer=s judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any AU@ ratings (e.g., how the Appendix B psychometric attributes are not being met). _Rev 1 Page 1 of 11 OBDI 202 - IOLE Process

ES-401 FCS-2015-12 2 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 2004 NRC EXAM.

6 H 3 X X B B E/S One could argue that there is no correct answer, as distractor B would eventually happen on a LOCA with no other operator action and there are no time restraints given in the question. /Revised.

Change made from initial review, however, the potential to exceed containment design pressure would always be present on a design basis LOCA with equipment 7 H 3 X D N E/S malfunctions, thus the correct answer can always be chosen no matter how good the other distractors are. /Revised.

Distractors B and D easily eliminated, as a vent valve that opened at a certain pressure would be a relief valve. Also in distractors B and C - I dont see any 8 F 3 X A N U/S plausibility in (normally) draining the quench tank to the containment sump. Leaves A as only credible distractor. /Replaced distractors B & D.

If D were correct, then A would also be correct, so those two are easily eliminated as 9 F 2 X B B E/S correct answers. /Revised.

Explanation states that linear heat rate is a tech spec safety limit, but it is not. The only distractor with a defined safety limit is peak centerline temperature, and since the stem asks for parameters associated with a safety limit, distractor C is easily 10 H 3 X D B U/S eliminated.

All one really needs to know to answer this question is that the boiling point of water decreases when pressure deceases. How does this provide any discriminating value? /Replaced.

Should distractors B and D indicate 109%, since that is a defined maximum trip 11 F 3 X X C B E/S setpoint for VOPT? 107% seems to be just an arbitrary level. /Revised.

There appears to be nothing in the stem addressing the second part of the K/A, based on those predictions, use procedures to correct, control, or mitigate the 12 H 4 X D X M E/S consequences of those malfunctions or operations. Is second half of Question a procedural requirement? Also - give an actual voltage in the stem instead of less than 650 VDC. /Revised.

In justification it appears that the light goes out on a trip, not a reset. Please verify.

13 H 3 X C N E/S

/Revised justification.

What is the purpose of showing the matrix B status when it is not part of the 14 H 3 X X B N E/S question? Why would an applicant pick distractor D, pressure detector failing high, as the question deals with a low pressure ESFAS? /Revised.

Distractor C states that there is sediment in the raw water system. Need to massage 15 F 3 X A N E/S this distractor as the raw water system starts at the suction of the pump. /Revised. _Rev 1 Page 2 of 11 OBDI 202 - IOLE Process

ES-401 FCS-2015-12 3 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 16 H 3 C B S 2007 NRC EXAM. Why would anyone think CEA withdrawal or opening of control 17 H 3 X C B E/S valves would cause reactor power to lower (or temperature to rise)? B and D appear not credible. /Revised stem to add beginning of life.

If 80% were the correct setpoint, then the feedwater regulating valve would also close 18 F 3 X B N U/S at 84%. This eliminates 80% as a possible correct answer, and renders distractors A and C as non-credible. /Revised.

19 F 2 A N S 20 F 3 D B S Distractor D does not fit with the others (i.e. not an actuation). Modify D to be 21 F 3 X A B E/S consistent with the other distractors. /Revised.

When looking at the procedure and the schematic, it appears that battery charger 3 is powering DC bus 1, but the question stem states that the kirk key prevents that bus 22 H 3 X C N E/S from being powered from battery charger 3. Please explain question methodology.

/Revised.

Distractor A is the only distractor that has choice 5, and the only one that does NOT 23 F 2 X D N E/S have choice 4, making it easily discarded (non-credible). Need new A. /Revised.

Cannot understand why anyone would choose to lower EDG voltage and make the voltage differences greater. Thus, distractors B & C do not appear to be credible.

24 H 4 X X D N U/S Also, this question appears to be too similar to JPM S-7 (Parallel and load EDG).

Replace. /Revised.

Question stem gives no indication that conditions have changed which would warrant monitoring containment, thus distractors A & B do not appear to be credible. Will the 25 F 4 X X D N E/S applicants question why RM-052 was not powered from its preferred source if it is available? /Revised stem to eliminate problem.

26 F 4 B N S If 96 psig was the correct setpoint, then the bypass valves would also automatically 27 F 3 X C N E/S open at 78 psig, making 96 psig a non-plausible answer and rendering distractors B and D non-credible. /Revised stem to eliminate problem.

Distractor A is not plausible. Normally, four Raw Water / CCW heat exchangers would be in service, so there would be no additional heat exchangers to put in 28 H 3 X X B B U/S service. Distractor C appears to be not credible, since it does not seem likely that anyone would choose to put containment purge in service when the plant is in modes 1, 2 or 3./ /Revised. _Rev 1 Page 3 of 11 OBDI 202 - IOLE Process

ES-401 FCS-2015-12 4 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only Ensure stem is written such that there is positively only one correct answer (i.e. what 29 F 3 X A N E/S is the primary reason per Procedure XXX. /Revised.

For all sections of AOP-2, there is an action to contact Reactor Engineering. It does not seem plausible that an operator would select a distractor that did not include contacting reactor engineering. Distractors B & C, part 2, could be modified to 30 H 4 X A N E/S reduce power, then restore the CEA, then contact reactor engineering. Also, the distractors are inconsistent. B and C provide specific restoration criteria while A and D do not. REVISE/Revised.

Distractor D is of the none of the above type which should not be used IAW 31 H 3 X C N E/S Appendix B of NUREG 1021. It also renders distractor A implausible, as it would be physically impossible for B, C, and D to all be wrong. /Replaced.

It is not clear why anyone would choose Zirc-Water reaction if the core remains covered, thus Distractors A & B do not appear to be credible. One way to fix the 32 H 4 X D M E/S distractors is to have part 1 of the 2 x 2 question be aluminum-water and zinc-water interactions, as they are both clearly spelled out in the lesson plan. /Revised.

Distractor A is not plausible. It is easy to discount the one (and only) distractor that 33 H 3 X B B E/S does not indicate a spent fuel pool level alarm for a spent fuel pool level leak.

/Revised.

Stem should include a statement similar to all valves set to design setpoint. One 34 H 3 B M E/S could argue since the tech spec specifically gives a range, and lift setpoints overlap, then there are multiple correct answers. /Revised.

If 21 inches Hg were the correct setpoint, then the steam dumps would also isolate 35 F 2 X C B U/S on 19 inches Hg. This makes 21 inches Hg a non-plausible setpoint which renders distractors B and D non-credible. /Revised.

36 F 2 A B S If B were correct, wouldnt that mean that CR ventilation would automatically be 37 H 2 X C B E/S filtered for a SG tube leak or rupture (which is a scenario). This seems implausible -

need a better explanation or replacement of B. /Replaced distractor B.

38 F 2 A B S 2007 NRC EXAM.

LOD 4? Question can be easily answered without reading any of the bullets in the stem (i.e. which of the following is a reason that pzr level might rapidly increase 39 H 4 X A N U/S during an accident?). How does this question have any discriminating value?

/Replaced.

Not enough changed in the stem of the parent question to call this a modified bank 40 H 3 X D B U/S question. It is a bank question. _Rev 1 Page 4 of 11 OBDI 202 - IOLE Process

ES-401 FCS-2015-12 5 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B and C do not appear to be credible. Why would the required action be to improve subcooling if you are already subcooled? Plus - using steam tables just to determine if you are superheated or subcooled is GFES level knowledge. /Replaced.

Answer is in stem. The only distractor that lists a component that has information in 41 F 2 X C B U/S the stem is the correct answer. Nothing is mentioned in the stem about equipment mentioned in A, B, or D. /Revised.

Distractor C does not seem credible. HCV-438C and HCV-438D are the CCW outlet valves, and closing either one of them would not prevent a CCW to RCS leak in any 42 F 3 X D N E/S circumstance, if both HCV-438A and HCV-438B are open (CCW inlet valves).

Please provide further explanation or replace C. /Revised explanation.

43 H 3 C B S 2007 NRC EXAM.

2007 NRC EXAM. Distractor A does not seem credible since the stem tells you that raw water flow is blocked to all four CCW heat exchangers. Distractor C does not seem credible as it does not answer the question, plus using a HPSI pump at 235 44 H 3 X D B U/S psia would quickly pressurize the RCS. That leaves a choice between where to line up fire water, and it seems C would not be credible because the SDC heat exchanger has clean water on both sides where the CCW heat exchanger does not. Please provide further explanation or replace. /Revised.

2005 NRC EXAM. Distractor D does not seem credible as the other distractors 45 H 3 X C B E/S require action by the operator, where distractor D only requires making a phone call.

/Replaced D.

Scenario 1 has a pressurizer pressure control channel failing to 2150 psia. Appears 46 H 3 X B B U/S to be same event - explain why this is different enough or replace. /Replaced.

Scenario 4 has manual/local opening of HCV-268 (same event). This cues correct 47 F 2 X D N E/S answer (replace). Removed from scenario.

48 H 4 A N S Please include the last NRC exam in which bank questions are used.

Take out that an Uncontrolled Heat Extraction event is occurring. Stem should read 49 H 3 X B B E/S something like A main steam line break has occurred downstream of the Main Steam Isolation Valves Also - scenario 4 has a steam break inside containment; will an automatic main steam isolation occur on low SG pressure during this event? If so, that will cue the correct answer to this question. /Revised.

On second bullet in the stem, take out The trip was complicated by and replace 50 F 3 X A N E/S with something like DC Bus 1 was lost. /Revised. _Rev 1 Page 5 of 11 OBDI 202 - IOLE Process

ES-401 FCS-2015-12 6 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 2001 NRC EXAM. Distractor C is of the none of the above type which should not be used IAW Appendix B of NUREG 1021. Distractor B does not appear to be credible because if 125 VDC could be lost at any time, and if lost at 0800, then 120 VAC would be lost prior to 1400, thus making A & B correct answers. Distractor D does 51 H 3 X A M U/S not appear to be credible since it is not bounded by time and would either have power or not have power regardless of minimizing loads. It also appears that if both 120 VAC and 125VDC were lost prior to 1400, then bus IB-3 would be lost as well.

/Revised.

Are there any status lights at FCS where the green light is normal and the red light is abnormal? Distractors B & C could be eliminated simply because the green light would indicate an abnormal condition. Also, there is no correct answer as written. A 52 H 3 X A N U/S green light does not correspond to 4000 VAC - voltage could be any value below the degraded voltage setpoint. Also, distractors D and A are subsets of each other. If 4050 was considered degraded, then 4000 would be even worse. This eliminates D as a plausible distractor. /Revised.

53 F 3 C N S Answer is cued in stem. Stem says Battery Charger #1 Trouble with an initial high 54 H 4 X D B U/S voltage. Correct answer is Charger #1 shutdown on high voltage. Correct answer obvious. /Revised.

55 H 4 B B S 2002 NRC EXAM.

2005 NRC EXAM. Only B, C, and D have be indicated, cueing that A is probably wrong. Only A, B, and C have safety tank low signal actuation will NOT occur, 56 H 3 X X B B U/S cueing that D is probably wrong. This leaves B and C. C says there is a low level with no low level alarm (doesnt appear to make sense). This leaves only B (which happens to be the correct answer). /Revised.

57 H 3 D N S 2005 NRC EXAM. Please explain why Distractor D is credible. Ensure that distractor 58 F 2 X A B E/S C is not a true statement. /Revised.

59 F 3 D B S 2005 NRC exam.

60 H 4 B N S Distractor D is of the none of the above type which should be avoided IAW 61 F 3 D N E/S Appendix B of NUREG 1021. /Revised.

62 H 3 C M S ON 2012 EXAM.

63 H 4 X D N E/S A: not plausible to believe that a lower sampling rate would result in an activity _Rev 1 Page 6 of 11 OBDI 202 - IOLE Process

ES-401 FCS-2015-12 7 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only increase on the monitor. B: not plausible because it doesnt make any sense. What other isotopes are you referring to? C: not plausible because there does not appear to be anything in the stem that would imply any MOV operations are in progress.

Leaves only the correct answer plausible. /Revised and supplemental explanations added.

Distractor A does not seem credible as the distractor describes how to avoid PTS, not how to restore pressure control. Distractor C cues the right answer by stating in the 64 H 4 X X C N U/S distractor, to restore pressure control. Distractor D can be immediately discarded as it has the operator feed a faulted steam generator. /Revised.

2005 NRC EXAM. Distractor C does not appear credible. It is describing stop and 65 H 3 X X A B E/S throttle criteria when HPSI pumps are not running. The stem gives away the fact that HPSI is not running by stating that the AOP is entered, not the EOP. /Revised.

Distractor C does not appear credible since the distractor notes a non-medical person evaluating a medical condition.

66 F 2 X D B U/S A is not plausible, as it is essentially none of the above. Any test taker is probably aware that we wouldnt ask questions where no action is required for a change in medical condition. /Revised.

The reference does not appear to justify the noted correct answer. It does not appear to state that direct CRS oversight and peer checking is required. In addition, Distractor A could be argued correct since the standing order requires permission 67 F 3 X B B E/S from the Shift Manager or CRS. The written exam worksheet indicates a 10CFR55 content of 55.43.6, which is for SRO exams. From the K/A catalog, K/A 2.1.37 has an RO content of 55.41.1. /Revised.

In the stem, include per procedure SO-O-28 Is the justification for not notifying the NRC resident inspector correct? It could be 68 F 3 X C B E/S argued that any time a trip unit is placed in bypass, other than for performing a PRC approved procedure (for example a surveillance test or PRC approved operating or maintenance procedures) is an unexpected use of the bypass keys. /Revised.

ON 2014 EXAM. This is a procedure enhancement opportunity. The explanation states that this is similar to the action for a fuse block, but the procedure does not state that. Also, could Distractor C also be correct? Would it be acceptable to 69 F 2 X A B E/S remove the clearance for the breaker, then open another for the cubicle? The stem does not seem to indicate that this cannot be done. Also - how can this be a new question if it was on the 2014 exam? /Revised - changed to bank question.

ON 2014 EXAM. All but D have the same #4, effectively eliminating D as plausible.

70 H 3 X C B U/S B, C and D all have the same sequence for withdrawing rods, effectively eliminating A as plausible (i.e. two distractor can effectively be eliminated without reading the _Rev 1 Page 7 of 11 OBDI 202 - IOLE Process

ES-401 FCS-2015-12 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only question). /Revised.

71 F 3 D B S Stem should be modified to remove normally accessible. Distractor C is Locked 72 H 3 X X B N U/S High Radiation Area which is not a normally accessible room. Distractor D, indicating grave danger, would is also easily discarded as not normally accessible. /Revised.

This could be construed as a level of difficulty of 1, as only one distractor involves radiation protection, which would easily eliminate the other distractors. Revise 73 F 3 X X D B E/S distractors to include additional RP options. Add per procedure RP-AA-460 in stem. /Revised.

Distractor A is of the all of the above type which should not be used IAW Appendix 74 F 3 X B N S*

B of NUREG 1021.

Recommend revising distractor C to read something similar to, Notify the NRC in accordance with 10CFR50.72 Immediate notification requirements for operating nuclear power reactors. The term immediate can be interpreted differently, but by 75 F 3 X A N E/S having the distractor be In accordance with 10CFR50.72, that kind of defines immediate.

When would distractor A ever be wrong? /Revised.

76 H 3 B N S Two correct answers as written, as both A and C meet the technical specification.

77 F 3 X C N U/S Need to revise stem to ask for MAXIMUM amount of time allowable to restore the heat exchanger to service. /Revised.

A, B, and C all say go to HR-12, effectively eliminating D as plausible. A not 78 H 4 X X B N E/S plausible as the stem cues that the steam generators are isolated. /Revised.

Distractors B and C are not credible, as no one would believe that MVA-18 would 79 F 3 X X A N U/S trump the station blackout procedure. Additionally, all MVA-18 does is give direction to start the diesel (has absolutely nothing to do with loading at all). /Revised.

2007 NRC EXAM. 5th bullet in stem should be VAC (not just V)

A and C appear to be non-credible, as there is no indication of anything that could be 80 H 3 X X B M U/S interpreted as a loss of shutdown cooling occurring. C and D dont appear to be credible, either, as the question asks to determine pressurizer level and the distractors reference reactor coolant level. This appears to leave B as the only plausible answer. /Revised.

81 H 4 X A N E/S Change 160.8 to 161.0 in stem (makes a better question). /Revised. _Rev 1 Page 8 of 11 OBDI 202 - IOLE Process

ES-401 FCS-2015-12 9 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only Distractor C explanation says plausible because the procedure entry is correct.

82 H 4 X D N E/S However, the correct answer (D) directs entry into a different procedure. Please provide explanation. /Revised.

83 F 3 C N S 84 H 3 C N S 85 H 3 D N S 86 H 3 D N S Please provide additional information as to why B or C could be considered plausible 87 H 4 X A N E/S given a lowering CCW surge tank level. /Revised explanation.

88 H 3 A N S 89 H 3 B M S 2012 NRC EXAM.

90 H 3 C N S 2005 NRC EXAM. REFERENCE PROVIDED. Please explain - How is A plausible when OI-NI-2 isnt even mentioned in the provided reference? How do they know which CETs are in what quadrant? Additionally, open reference TS questions on the 91 F 2 X D B U/S written exam should be avoided, as this skill is evaluated during the scenarios. Also, Admin JPM SA3 is Determine In-Core Instrumentation Operability. How does this JPM not cue this question? /Replaced with no reference supplied question.

Please provide reference to justify the first half of the correct answer. /Revised -

92 H 4 A N E/S added references.

93 H 4 B N S ON 2012 EXAM. Second half of A, B, and C are all the same. This cues that 94 H 3 X C B E/S distractor D is not the correct answer (need new D). /Revised distractors.

Stem should include per procedure OPD-04-09 95 F 3 X X D N U/S Distractor A not credible - why would a CRS ever want to impede the execution of an EOP step? Distractor B not credible, as it does not answer the question (regarding use of procedures). Not sure why C is wrong - please explain. /Revised.

96 F 2 X B B E/S 10CFR55.41.5? Should be 55.43.5? /Revised.

97 H 3 X C N U/S 10CFR55.41.1? Should be 55.43.1? A and B can be immediately discarded (i.e.non-credible) because they do not refer to any procedure or technical specification as _Rev 1 Page 9 of 11 OBDI 202 - IOLE Process

ES-401 FCS-2015-12 10 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only distractor C and D do. /Revised.

98 F 3 A B S ON 2012 EXAM.

99 F 3 X B N E/S Add per procedure SO-R-16 in stem. /Revised.

100 F 2 A N S B = 34 F = 35 E = 39 Additional Notes:

RO TOTALS: M= 5 H = 40 U = 20 N = 36 S = 16 B= 4 F= 9 E= 8 Additional Notes:

SRO TOTALS: M= 2 H = 16 U= 6 N = 19 S = 11

GENERAL COMMENT

S

1. Bank questions are indicated by B; Modified are indicated by M; New questions are indicated by N

2. Chief Examiner resolution comments are indicated in blue.

3. Average difficulty is __ 2.95__ on the RO exam and _3.12 on the SRO exam.

4. The 10CFR55.41/43 distribution is: RO / SRO 41.1 = 2 43.1 = 1 41.2 = 2 43.2 = 5 41.3 = 3 43.3 = 1 41.4 = 43.4 = 2 41.5 = 7 43.5 = 14 _Rev 1 Page 10 of 11 OBDI 202 - IOLE Process

ES-401 FCS-2015-12 11 Form ES-401-9 41.6 = 8 43.6 =

41.7 = 15 43.7 = 2 41.8 = 3 41.9 = 2 41.10 = 14 41.11 = 3 41.12 = 2 41.13 = 1 41.14 = 14

5. The answer distribution is: RO / SRO A = 18 (24%) / 7 (28%)

B = 17 (23%) / 7 (28%)

C = 19 (25%) / 6 (24%)

D = 21 (28%) / 5 (20%)

6. There are __0__ RO questions with handouts provided and __0___ SRO questions with handouts provided. _Rev 1 Page 11 of 11 OBDI 202 - IOLE Process