Text

2015-12-DRAFT Written Examination Comments
	ML16012A337
Person / Time
Site:	Fort Calhoun
Issue date:	12/14/2015
From:	Vincent Gaddy; Operations Branch IV
To:	;
References
	Download: ML16012A337 (11)
	v • d • e

ES-401 FCS-2015-12 Written Examination Review Worksheet Form ES-401-9 Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 B 5 (easy B difficult) rating scale (questions in the 2 B 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

The answer choices are a collection of unrelated true/false statements.

The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7. Based on the reviewer=s judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any AU@ ratings (e.g., how the Appendix B psychometric attributes are not being met).

_Rev 1 Page 1 of 11 OBDI 202 - IOLE Process Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

/

units Back-ward Q=

K/A SRO Only 1

F 2

X C

N E/S Explanation for distractor B seems to stop mid-sentence. The explanation for distractor D does not seem sufficient to disregard the answer. /Revised.

2 F

2 X

D N

U/S There are two different outlets on the regenerative heat exchanger, need to describe which outlet temperature you are referring to. Why would anyone think the regenerative heat exchanger temperature outlet would be correct, since that water has not been cooled by the letdown heat exchanger yet?

Also, if 130 degrees was the correct temperature, then the bypass would also close at 140 degrees - this eliminates 130 as a plausible answer, and therefore renders distractors A and B as non-credible.

Please explain why this question has any discriminating value. /Revised.

3 F

3 A

N S

4 H

3 X

X X

C N

E/S Need a comma after Valve in stem. /Revised.

5 F

3 X

X B

B E/S Add core offload in progress in stem. /Revised.

ES-401 FCS-2015-12 2

Form ES-401-9

_Rev 1 Page 2 of 11 OBDI 202 - IOLE Process Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

/

units Back-ward Q=

K/A SRO Only 6

H 3

X X

B B

E/S 2004 NRC EXAM.

One could argue that there is no correct answer, as distractor B would eventually happen on a LOCA with no other operator action and there are no time restraints given in the question. /Revised.

7 H

3 X

D N

E/S Change made from initial review, however, the potential to exceed containment design pressure would always be present on a design basis LOCA with equipment malfunctions, thus the correct answer can always be chosen no matter how good the other distractors are. /Revised.

8 F

3 X

A N

U/S Distractors B and D easily eliminated, as a vent valve that opened at a certain pressure would be a relief valve. Also in distractors B and C - I dont see any plausibility in (normally) draining the quench tank to the containment sump. Leaves A as only credible distractor. /Replaced distractors B & D.

9 F

2 X

B B

E/S If D were correct, then A would also be correct, so those two are easily eliminated as correct answers. /Revised.

10 H

3 X

D B

U/S Explanation states that linear heat rate is a tech spec safety limit, but it is not. The only distractor with a defined safety limit is peak centerline temperature, and since the stem asks for parameters associated with a safety limit, distractor C is easily eliminated.

All one really needs to know to answer this question is that the boiling point of water decreases when pressure deceases. How does this provide any discriminating value? /Replaced.

11 F

3 X

X C

B E/S Should distractors B and D indicate 109%, since that is a defined maximum trip setpoint for VOPT? 107% seems to be just an arbitrary level. /Revised.

12 H

4 X

D X

M E/S There appears to be nothing in the stem addressing the second part of the K/A, based on those predictions, use procedures to correct, control, or mitigate the consequences of those malfunctions or operations. Is second half of Question a procedural requirement? Also - give an actual voltage in the stem instead of less than 650 VDC. /Revised.

13 H

3 X

C N

E/S In justification it appears that the light goes out on a trip, not a reset. Please verify.

/Revised justification.

14 H

3 X

X B

N E/S What is the purpose of showing the matrix B status when it is not part of the question? Why would an applicant pick distractor D, pressure detector failing high, as the question deals with a low pressure ESFAS? /Revised.

15 F

3 X

A N

E/S Distractor C states that there is sediment in the raw water system. Need to massage this distractor as the raw water system starts at the suction of the pump. /Revised.

ES-401 FCS-2015-12 3

Form ES-401-9

_Rev 1 Page 3 of 11 OBDI 202 - IOLE Process Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

/

units Back-ward Q=

K/A SRO Only 16 H

3 C

B S

17 H

3 X

C B

E/S 2007 NRC EXAM. Why would anyone think CEA withdrawal or opening of control valves would cause reactor power to lower (or temperature to rise)? B and D appear not credible. /Revised stem to add beginning of life.

18 F

3 X

B N

U/S If 80% were the correct setpoint, then the feedwater regulating valve would also close at 84%. This eliminates 80% as a possible correct answer, and renders distractors A and C as non-credible. /Revised.

19 F

2 A

N S

20 F

3 D

B S

21 F

3 X

A B

E/S Distractor D does not fit with the others (i.e. not an actuation). Modify D to be consistent with the other distractors. /Revised.

22 H

3 X

C N

E/S When looking at the procedure and the schematic, it appears that battery charger 3 is powering DC bus 1, but the question stem states that the kirk key prevents that bus from being powered from battery charger 3. Please explain question methodology.

/Revised.

23 F

2 X

D N

E/S Distractor A is the only distractor that has choice 5, and the only one that does NOT have choice 4, making it easily discarded (non-credible). Need new A. /Revised.

24 H

4 X

X D

N U/S Cannot understand why anyone would choose to lower EDG voltage and make the voltage differences greater. Thus, distractors B & C do not appear to be credible.

Also, this question appears to be too similar to JPM S-7 (Parallel and load EDG).

Replace. /Revised.

25 F

4 X

X D

N E/S Question stem gives no indication that conditions have changed which would warrant monitoring containment, thus distractors A & B do not appear to be credible. Will the applicants question why RM-052 was not powered from its preferred source if it is available? /Revised stem to eliminate problem.

26 F

4 B

N S

27 F

3 X

C N

E/S If 96 psig was the correct setpoint, then the bypass valves would also automatically open at 78 psig, making 96 psig a non-plausible answer and rendering distractors B and D non-credible. /Revised stem to eliminate problem.

28 H

3 X

X B

B U/S Distractor A is not plausible. Normally, four Raw Water / CCW heat exchangers would be in service, so there would be no additional heat exchangers to put in service. Distractor C appears to be not credible, since it does not seem likely that anyone would choose to put containment purge in service when the plant is in modes 1, 2 or 3./ /Revised.

ES-401 FCS-2015-12 4

Form ES-401-9

_Rev 1 Page 4 of 11 OBDI 202 - IOLE Process Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

/

units Back-ward Q=

K/A SRO Only 29 F

3 X

A N

E/S Ensure stem is written such that there is positively only one correct answer (i.e. what is the primary reason per Procedure XXX. /Revised.

30 H

4 X

A N

E/S For all sections of AOP-2, there is an action to contact Reactor Engineering. It does not seem plausible that an operator would select a distractor that did not include contacting reactor engineering. Distractors B & C, part 2, could be modified to reduce power, then restore the CEA, then contact reactor engineering. Also, the distractors are inconsistent. B and C provide specific restoration criteria while A and D do not. REVISE/Revised.

31 H

3 X

C N

E/S Distractor D is of the none of the above type which should not be used IAW Appendix B of NUREG 1021. It also renders distractor A implausible, as it would be physically impossible for B, C, and D to all be wrong. /Replaced.

32 H

4 X

D M

E/S It is not clear why anyone would choose Zirc-Water reaction if the core remains covered, thus Distractors A & B do not appear to be credible. One way to fix the distractors is to have part 1 of the 2 x 2 question be aluminum-water and zinc-water interactions, as they are both clearly spelled out in the lesson plan. /Revised.

33 H

3 X

B B

E/S Distractor A is not plausible. It is easy to discount the one (and only) distractor that does not indicate a spent fuel pool level alarm for a spent fuel pool level leak.

/Revised.

34 H

3 B

M E/S Stem should include a statement similar to all valves set to design setpoint. One could argue since the tech spec specifically gives a range, and lift setpoints overlap, then there are multiple correct answers. /Revised.

35 F

2 X

C B

U/S If 21 inches Hg were the correct setpoint, then the steam dumps would also isolate on 19 inches Hg. This makes 21 inches Hg a non-plausible setpoint which renders distractors B and D non-credible. /Revised.

36 F

2 A

B S

37 H

2 X

C B

E/S If B were correct, wouldnt that mean that CR ventilation would automatically be filtered for a SG tube leak or rupture (which is a scenario). This seems implausible -

need a better explanation or replacement of B. /Replaced distractor B.

38 F

2 A

B S

2007 NRC EXAM.

39 H

4 X

A N

U/S LOD 4? Question can be easily answered without reading any of the bullets in the stem (i.e. which of the following is a reason that pzr level might rapidly increase during an accident?). How does this question have any discriminating value?

/Replaced.

40 H

3 X

D B

U/S Not enough changed in the stem of the parent question to call this a modified bank question. It is a bank question.

ES-401 FCS-2015-12 5

Form ES-401-9

_Rev 1 Page 5 of 11 OBDI 202 - IOLE Process Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

/

units Back-ward Q=

K/A SRO Only B and C do not appear to be credible. Why would the required action be to improve subcooling if you are already subcooled? Plus - using steam tables just to determine if you are superheated or subcooled is GFES level knowledge. /Replaced.

41 F

2 X

C B

U/S Answer is in stem. The only distractor that lists a component that has information in the stem is the correct answer. Nothing is mentioned in the stem about equipment mentioned in A, B, or D. /Revised.

42 F

3 X

D N

E/S Distractor C does not seem credible. HCV-438C and HCV-438D are the CCW outlet valves, and closing either one of them would not prevent a CCW to RCS leak in any circumstance, if both HCV-438A and HCV-438B are open (CCW inlet valves).

Please provide further explanation or replace C. /Revised explanation.

43 H

3 C

B S

2007 NRC EXAM.

44 H

3 X

D B

U/S 2007 NRC EXAM. Distractor A does not seem credible since the stem tells you that raw water flow is blocked to all four CCW heat exchangers. Distractor C does not seem credible as it does not answer the question, plus using a HPSI pump at 235 psia would quickly pressurize the RCS. That leaves a choice between where to line up fire water, and it seems C would not be credible because the SDC heat exchanger has clean water on both sides where the CCW heat exchanger does not. Please provide further explanation or replace. /Revised.

45 H

3 X

C B

E/S 2005 NRC EXAM. Distractor D does not seem credible as the other distractors require action by the operator, where distractor D only requires making a phone call.

/Replaced D.

46 H

3 X

B B

U/S Scenario 1 has a pressurizer pressure control channel failing to 2150 psia. Appears to be same event - explain why this is different enough or replace. /Replaced.

47 F

2 X

D N

E/S Scenario 4 has manual/local opening of HCV-268 (same event). This cues correct answer (replace). Removed from scenario.

48 H

4 A

N S

49 H

3 X

B B

E/S Please include the last NRC exam in which bank questions are used.

Take out that an Uncontrolled Heat Extraction event is occurring. Stem should read something like A main steam line break has occurred downstream of the Main Steam Isolation Valves Also - scenario 4 has a steam break inside containment; will an automatic main steam isolation occur on low SG pressure during this event? If so, that will cue the correct answer to this question. /Revised.

50 F

3 X

A N

E/S On second bullet in the stem, take out The trip was complicated by and replace with something like DC Bus 1 was lost. /Revised.

ES-401 FCS-2015-12 6

Form ES-401-9

_Rev 1 Page 6 of 11 OBDI 202 - IOLE Process Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

/

units Back-ward Q=

K/A SRO Only 51 H

3 X

A M

U/S 2001 NRC EXAM. Distractor C is of the none of the above type which should not be used IAW Appendix B of NUREG 1021. Distractor B does not appear to be credible because if 125 VDC could be lost at any time, and if lost at 0800, then 120 VAC would be lost prior to 1400, thus making A & B correct answers. Distractor D does not appear to be credible since it is not bounded by time and would either have power or not have power regardless of minimizing loads. It also appears that if both 120 VAC and 125VDC were lost prior to 1400, then bus IB-3 would be lost as well.

/Revised.

52 H

3 X

A N

U/S Are there any status lights at FCS where the green light is normal and the red light is abnormal? Distractors B & C could be eliminated simply because the green light would indicate an abnormal condition. Also, there is no correct answer as written. A green light does not correspond to 4000 VAC - voltage could be any value below the degraded voltage setpoint. Also, distractors D and A are subsets of each other. If 4050 was considered degraded, then 4000 would be even worse. This eliminates D as a plausible distractor. /Revised.

53 F

3 C

N S

54 H

4 X

D B

U/S Answer is cued in stem. Stem says Battery Charger #1 Trouble with an initial high voltage. Correct answer is Charger #1 shutdown on high voltage. Correct answer obvious. /Revised.

55 H

4 B

B S

2002 NRC EXAM.

56 H

3 X

X B

B U/S 2005 NRC EXAM. Only B, C, and D have be indicated, cueing that A is probably wrong. Only A, B, and C have safety tank low signal actuation will NOT occur, cueing that D is probably wrong. This leaves B and C. C says there is a low level with no low level alarm (doesnt appear to make sense). This leaves only B (which happens to be the correct answer). /Revised.

57 H

3 D

N S

58 F

2 X

A B

E/S 2005 NRC EXAM. Please explain why Distractor D is credible. Ensure that distractor C is not a true statement. /Revised.

59 F

3 D

B S

2005 NRC exam.

60 H

4 B

N S

61 F

3 D

N E/S Distractor D is of the none of the above type which should be avoided IAW Appendix B of NUREG 1021. /Revised.

62 H

3 C

M S

ON 2012 EXAM.

63 H

4 X

D N

E/S A: not plausible to believe that a lower sampling rate would result in an activity

ES-401 FCS-2015-12 7

Form ES-401-9

_Rev 1 Page 7 of 11 OBDI 202 - IOLE Process Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

/

units Back-ward Q=

K/A SRO Only increase on the monitor. B: not plausible because it doesnt make any sense. What other isotopes are you referring to? C: not plausible because there does not appear to be anything in the stem that would imply any MOV operations are in progress.

Leaves only the correct answer plausible. /Revised and supplemental explanations added.

64 H

4 X

X C

N U/S Distractor A does not seem credible as the distractor describes how to avoid PTS, not how to restore pressure control. Distractor C cues the right answer by stating in the distractor, to restore pressure control. Distractor D can be immediately discarded as it has the operator feed a faulted steam generator. /Revised.

65 H

3 X

X A

B E/S 2005 NRC EXAM. Distractor C does not appear credible. It is describing stop and throttle criteria when HPSI pumps are not running. The stem gives away the fact that HPSI is not running by stating that the AOP is entered, not the EOP. /Revised.

66 F

2 X

D B

U/S Distractor C does not appear credible since the distractor notes a non-medical person evaluating a medical condition.

A is not plausible, as it is essentially none of the above. Any test taker is probably aware that we wouldnt ask questions where no action is required for a change in medical condition. /Revised.

67 F

3 X

B B

E/S The reference does not appear to justify the noted correct answer. It does not appear to state that direct CRS oversight and peer checking is required. In addition, Distractor A could be argued correct since the standing order requires permission from the Shift Manager or CRS. The written exam worksheet indicates a 10CFR55 content of 55.43.6, which is for SRO exams. From the K/A catalog, K/A 2.1.37 has an RO content of 55.41.1. /Revised.

68 F

3 X

C B

E/S In the stem, include per procedure SO-O-28 Is the justification for not notifying the NRC resident inspector correct? It could be argued that any time a trip unit is placed in bypass, other than for performing a PRC approved procedure (for example a surveillance test or PRC approved operating or maintenance procedures) is an unexpected use of the bypass keys. /Revised.

69 F

2 X

A B

E/S ON 2014 EXAM. This is a procedure enhancement opportunity. The explanation states that this is similar to the action for a fuse block, but the procedure does not state that. Also, could Distractor C also be correct? Would it be acceptable to remove the clearance for the breaker, then open another for the cubicle? The stem does not seem to indicate that this cannot be done. Also - how can this be a new question if it was on the 2014 exam? /Revised - changed to bank question.

70 H

3 X

C B

U/S ON 2014 EXAM. All but D have the same #4, effectively eliminating D as plausible.

B, C and D all have the same sequence for withdrawing rods, effectively eliminating A as plausible (i.e. two distractor can effectively be eliminated without reading the

ES-401 FCS-2015-12 8

Form ES-401-9

_Rev 1 Page 8 of 11 OBDI 202 - IOLE Process Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

/

units Back-ward Q=

K/A SRO Only question). /Revised.

71 F

3 D

B S

72 H

3 X

X B

N U/S Stem should be modified to remove normally accessible. Distractor C is Locked High Radiation Area which is not a normally accessible room. Distractor D, indicating grave danger, would is also easily discarded as not normally accessible. /Revised.

73 F

3 X

X D

B E/S This could be construed as a level of difficulty of 1, as only one distractor involves radiation protection, which would easily eliminate the other distractors. Revise distractors to include additional RP options. Add per procedure RP-AA-460 in stem. /Revised.

74 F

3 X

B N

S*

Distractor A is of the all of the above type which should not be used IAW Appendix B of NUREG 1021.

75 F

3 X

A N

E/S Recommend revising distractor C to read something similar to, Notify the NRC in accordance with 10CFR50.72 Immediate notification requirements for operating nuclear power reactors. The term immediate can be interpreted differently, but by having the distractor be In accordance with 10CFR50.72, that kind of defines immediate.

When would distractor A ever be wrong? /Revised.

76 H

3 B

N S

77 F

3 X

C N

U/S Two correct answers as written, as both A and C meet the technical specification.

Need to revise stem to ask for MAXIMUM amount of time allowable to restore the heat exchanger to service. /Revised.

78 H

4 X

X B

N E/S A, B, and C all say go to HR-12, effectively eliminating D as plausible. A not plausible as the stem cues that the steam generators are isolated. /Revised.

79 F

3 X

X A

N U/S Distractors B and C are not credible, as no one would believe that MVA-18 would trump the station blackout procedure. Additionally, all MVA-18 does is give direction to start the diesel (has absolutely nothing to do with loading at all). /Revised.

80 H

3 X

X B

M U/S 2007 NRC EXAM. 5th bullet in stem should be VAC (not just V)

A and C appear to be non-credible, as there is no indication of anything that could be interpreted as a loss of shutdown cooling occurring. C and D dont appear to be credible, either, as the question asks to determine pressurizer level and the distractors reference reactor coolant level. This appears to leave B as the only plausible answer. /Revised.

81 H

4 X

A N

E/S Change 160.8 to 161.0 in stem (makes a better question). /Revised.

ES-401 FCS-2015-12 9

Form ES-401-9

_Rev 1 Page 9 of 11 OBDI 202 - IOLE Process Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

/

units Back-ward Q=

K/A SRO Only 82 H

4 X

D N

E/S Distractor C explanation says plausible because the procedure entry is correct.

However, the correct answer (D) directs entry into a different procedure. Please provide explanation. /Revised.

83 F

3 C

N S

84 H

3 C

N S

85 H

3 D

N S

86 H

3 D

N S

87 H

4 X

A N

E/S Please provide additional information as to why B or C could be considered plausible given a lowering CCW surge tank level. /Revised explanation.

88 H

3 A

N S

89 H

3 B

M S

2012 NRC EXAM.

90 H

3 C

N S

91 F

2 X

D B

U/S 2005 NRC EXAM. REFERENCE PROVIDED. Please explain - How is A plausible when OI-NI-2 isnt even mentioned in the provided reference? How do they know which CETs are in what quadrant? Additionally, open reference TS questions on the written exam should be avoided, as this skill is evaluated during the scenarios. Also, Admin JPM SA3 is Determine In-Core Instrumentation Operability. How does this JPM not cue this question? /Replaced with no reference supplied question.

92 H

4 A

N E/S Please provide reference to justify the first half of the correct answer. /Revised -

added references.

93 H

4 B

N S

94 H

3 X

C B

E/S ON 2012 EXAM. Second half of A, B, and C are all the same. This cues that distractor D is not the correct answer (need new D). /Revised distractors.

95 F

3 X

X D

N U/S Stem should include per procedure OPD-04-09 Distractor A not credible - why would a CRS ever want to impede the execution of an EOP step? Distractor B not credible, as it does not answer the question (regarding use of procedures). Not sure why C is wrong - please explain. /Revised.

96 F

2 X

B B

E/S 10CFR55.41.5? Should be 55.43.5? /Revised.

97 H

3 X

C N

U/S 10CFR55.41.1? Should be 55.43.1? A and B can be immediately discarded (i.e.non-credible) because they do not refer to any procedure or technical specification as

ES-401 FCS-2015-12 10 Form ES-401-9

_Rev 1 Page 10 of 11 OBDI 202 - IOLE Process Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

B/M/N

7.

U/E/S

8.

Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

/

units Back-ward Q=

K/A SRO Only distractor C and D do. /Revised.

98 F

3 A

B S

ON 2012 EXAM.

99 F

3 X

B N

E/S Add per procedure SO-R-16 in stem. /Revised.

100 F

2 A

N S

RO TOTALS:

B = 34 F = 35 E = 39 Additional Notes:

M = 5 H = 40 U = 20 N = 36 S = 16 SRO TOTALS:

B = 4 F = 9 E = 8 Additional Notes:

M = 2 H = 16 U = 6 N = 19 S = 11

GENERAL COMMENT

S

1. Bank questions are indicated by B; Modified are indicated by M; New questions are indicated by N

2.

Chief Examiner resolution comments are indicated in blue.

3.

Average difficulty is __ 2.95__ on the RO exam and _3.12 on the SRO exam.

4.

The 10CFR55.41/43 distribution is: RO / SRO 41.1 = 2 43.1 = 1 41.2 = 2 43.2 = 5 41.3 = 3 43.3 = 1 41.4 =

43.4 = 2 41.5 = 7 43.5 = 14

ES-401 FCS-2015-12 11 Form ES-401-9

_Rev 1 Page 11 of 11 OBDI 202 - IOLE Process 41.6 = 8 43.6 =

41.7 = 15 43.7 = 2 41.8 = 3 41.9 = 2 41.10 = 14 41.11 = 3 41.12 = 2 41.13 = 1 41.14 = 14

5.

The answer distribution is: RO / SRO A = 18 (24%)

/

7 (28%)

B = 17 (23%)

/

7 (28%)

C = 19 (25%)

/

6 (24%)

D = 21 (28%)

/

5 (20%)

6.

There are __0__ RO questions with handouts provided and __0___ SRO questions with handouts provided.