ML16152A337

2016-04 - Draft Written Exam Comments

ML16152A337
Person / Time
Site:	Diablo Canyon
Issue date:	04/25/2016
From:	Vincent Gaddy Operations Branch IV
To:
References
Download: ML16152A337 (28)

Text

ES-401 DC-2016-04 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only General comments for submittal

• Use of no change, no action required, or nothing happens is generally not plausible. If a no change is the correct answer, it is viewed by the applicant as a trick question, if it is a distractor then it is not credible. See detailed discussions on each question.

• There are a lot of questions that deal with train separation (power supplies, valves, pumps, etc) and this is a good Tier 3 question to ask once, but not a specific design feature to ask for each and every system and the plant because this is a general design criterion for every nuclear plant in the country and has minimal discriminatory value for the DC specific license.

Anyone with basic knowledge of nuclear power plants can answer these questions but that doesnt mean they should get a license to operate your facility).

• The NUREG SRO guidance states that you should not be able to answer SRO-only questions solely with RO knowledge (ie system knowledge) however there may be a KA where it is needed to hit at least part of the KA.

Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 B 5 (easy B difficult) rating scale (questions in the 2 B 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

$ The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

$ The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

$ The answer choices are a collection of unrelated true/false statements.

$ The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

$ One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

$ The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

$ The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

$ The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

$ The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7. Based on the reviewer=s judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any AU@ ratings (e.g., how the Appendix B psychometric attributes are not being met). _Rev 1 Page 1 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 2 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only However, using this aspect to introduce RO knowledge on more than one or two SRO-only questions reduces the answer choice to 50/50 and therefore is not only a bad practice but it can be argued that two non-credible distractors makes a question Unsat and LOD = 1.

• Attention to detail is poor on several of the questions wrt spelling and grammar errors.

• Answer distribution is off. Need to balance it correctly on both SRO and RO sections of the exam.

• Overall LOD is too low on this exam. Many questions are just too easy and not discriminating enough for the NRC exam.

• Due to number of changes, for revision control the final submittal has been designated as Rev X. All questions have been changed to reflect Rev X.

1 H 2 B 41.7 M S Disagree with modified designator. This is a bank question. Change correct answer to something other than D because the correct answer was D in the bank question.

E Rev 1 - What was changed in new revision?

2 H 3 A 41.7 B DCPP Comment - misunderstood intent of comment. Reordered answers and classified question as bank S

Question is now SAT.

Why is distractor A plausible because in cold leg recirc the water is coming from the sump so this valve is already open, right?

E Possible negative cueing with distractor C (hot leg supply valve) and cold leg recirc in the stem. Discuss.

3 H 3 X X B 41.7 N DCPP comment - no change at this time, possible change - make answers a matrix of valve positions to open the valve. The hot leg valve referenced in the comment is part of the interlock (it is the supply valve to RHR)

S DC updated question to address cueing. Typos - 8804A or B? 8894B or 8804B?

Typos fixed - question is now SAT.

E Plausibility of distractor C and D are questionable as written. Remains the same is 4 H 2 X A 41.7 B not credible with associated discussion in the explanation section because if I were guessing for an answer, 1-1 HX would logically go to loops 1 and 2 and 1-2 HX would _Rev 1 Page 2 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 3 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only go to loops 3 and 4. An applicant might think that flow remains the same because it has an accumulator on it and doesnt immediately fail open? This would be a better plausibility discussion for C.

A better version of this question might be:

A. Rise by approximately 1000 gpm and stabilize S B. Lower to zero C. Rise until 1-2 pump runout occurs and the pump trips D. Remains the same Rev 1 - DC added mechanical stop variant to the question. Question is now SAT.

E In explanation section 8807B is not the right valve number for this question-typo.

5 H 3 A 41.7 N S Rev 1 - Fixed typo. Question is now SAT.

This is LOD=1 Not plausible to think SI Actuation reset if the SI Actuation light was still ON. A NO on the reset is clearly an ON light which affects the two OFF U distracters.

DCPP Comment - will discuss not sure understand comment. Answer is lights are ON. Both ON indicate one train has reset, and one has not. The OFFs are plausible if 6 H 2 C 41.7 B believed that either train will cause the alarm to reset. Normal response is 08-21 OFF and 08-22 ON. (distractor C)

This is an LOD-1 question and needs to be replaced. It is not plausible to think that the SI actuation light would go off if only one train is reset.

S Question was rewritten and is now SAT.

7 F 3 Past NRC Exam 01/2010 C 41.7 B S _Rev 1 Page 3 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 4 Form ES-401-9 In explanation section you should try to tie the KA of cause and effect better to ensure there is no misconception. On my first review I thought this was a KA mismatch question because it does not appear to be a cause and effect question.

After a second read, It appears that the cause is temp rising in CCW, the effect is E what can I do to attempt to lower CCW temp and not have to trip the unit or shutdown?

Distractor D is not credible since RCPs are needed at full power and this is too obvious. Discuss plausibility of isolating cooling to SFP HX.

Rev 1- Did not change distractor D.

DCPP Comment - need to discuss. Added to explanation, see if it helps No changes were made to question. Isolating RCP oil coolers is just not plausible when you are at power.

DCPP Comment - reworked answers to remove RCP oil cooler Past DCPP NRC 8 H 3 X A 41.7 B Exam 07/2011 The one aspect of Spent Fuel Pool in the previous question that made it marginally plausible (lower than CCW temp) was removed in the current revision of the question.

SFP is now not plausible. At this point, the question needs to be replaced. It has become a question that does not differentiate between qualified/not qualified applicants. Need to write a reasonably challenging question that matches the intent of the K/A. Two options would be a failure of the CCW to Letdown HX temperature control valve, or a failure of a valve that provides cooling to an RCP, and resulting RCP temperature trip criteria.

Replaced question 3/16/16 Is boron concentration needed for this question? If this phenomenon occurs regardless of boron concentration, please remove as it cues the applicant to think S about boron when considering what is happening with reactivity.

Changed question to state MOL rather than boron concentration - Question is now SAT.

KA mismatch - this KA is asking the effect of spray valve failure ON the PZR PRESS U Control System not the effect of a failure of the controller on the spray valve or overall 9 H 3 A 41.10 X N pressure control.

S Rev 1- Question 46 used in place of question 9. Question 9 is now SAT.

10 F 3 C 41.7 B E Typo in explanation section, loop low flow not loop flow flow. _Rev 1 Page 4 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 5 Form ES-401-9 S

Rev 1 - Typo fixed. Question is SAT.

E Second part of distractor A is not credible. It does not fit the logic given. Change it to be Past NRC Exam 11 H 3 X B 41.7 B A. 1/2 1/2 03/2012 S Rev 1 - Changed distractor A to 1 / 2, 1 / 2. Question is now SAT.

12 H 3 B 41.7 N S 13 F 3 B 41.8 N S This is a common train question and is not unique to CSS. Also, anything with both open is not credible since only a single train of equipment is needed to ensure a SF is met. This makes all three distractors not credible and LOD = 1.

U Rev 1 - This is one of four questions that have been submitted where the first of three bullets are wrong and the other two are correct and the answer is 2 and 3 only

- this is a predictability concern. Using NaOH to reduce containment pressure is not a plausible distractor. Question does not meet the K/A - does not test knowledge of design features or interlocks.

DCPP Comment - replaced 14 F 3 X C 41.7 N Under what conditions does statement a) apply? During design basis LOCA? Need to state. - Post-LOCA containment sump Maximum is not credible. The question asks for the basis for minimum level. The answer is obviously a minimum pH when you are talking NaOH. With the most basic chemistry knowledge, the applicant can immediately eliminate 2 distractors. Change distractors to a minimum pH of 9.5. Done Change ph to pH. Done at least is not necessary if you use minimum Done S Change 8 to 8.0 - Done Question is now SAT.

U K/A mismatch. K/A requires knowledge of abnormal condition procedures. Question only requires knowledge of expected/unexpected alarms.

15 H 3 B 41.10 X N DCPP Comment - will discuss - must know what causes the alarms, and therefore, which ones would require attention or action during a LOCA. May have to replace KA as there are no abnormal procedures (AP's) for CS. Alarm responses have usually been considered acceptable abnormal procedures. _Rev 1 Page 5 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 6 Form ES-401-9 Question cannot take credit for ARPs as abnormal procedures. Need to write a question that covers content on a procedure that is used to address a CS abnormal condition - EOP RNO would be appropriate.

DC wrote new question- question is now SAT.

S E Reference drawing appears to show Group IV valves are the ones operated not Group I which would mean there was no correct answer - Tavg; IV DCPP comment - Groups I and II are the 40% (condenser steam dumps). First drawing is of groups I and II. The group IV drawing is included for the explanation.

16 H 2 X B 41.7 N The wording of the question is confusing. Are you bypassing Group 1 (which is how it reads) or are you bypassing the Tavg input to Group 1 so that you can use Group 1?

DCPP comment - reworded to clarify question based on Rev 8 comment S Question is now SAT.

17 H 3 B 41.4 N S Used on 2012 NRC exam (you should put which one it was on in the worksheet field).

I had to look this up to find it. Distractors B, C, and D are all not credible. Post trip you E dont worry about narrow range level control nor shrink nor cooldown when asking in the stem the minimum flow. If you had a max flow in the stem then it might be more DCPP NRC Exam plausible for distractor D. Because this was missed on previous reviews it is marked 18 F 2 X 11/2012 A 41.5 B as an E but must be fixed. LOD =1 with these distractors.

(past 2 NRC exams)

DCPP incorporated NRC comments 2 x 2 S

Question is now SAT.

You need a two part stem to answer this question since the answers are all two parts E

Also distractor C is partially not credible for operating valves locally for AFW on an auto start.

Does not seem credible to have a pressure transmitter reading zero with both LCV-110 and 111 100% open and no low flow alarms. This effects two distracters.

19 H 3 X X D 41.7 B DCPP Comment - this is the normal condition (low/no pressure indicated and the valves full open), seems plausible they would be in that lineup for the question.

Added this explanation to the question explanation. _Rev 1 Page 6 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 7 Form ES-401-9 Add valve nomenclature to question.

S Nomenclature added. Question is now SAT.

Cueing to answer with no semicolon in answer A between the parts of the answer and it exists (semicolon) in the other three distractors. This is also an unbalanced 2 X E 2. Why is it credible that the EDG O/P BKR will remain open when a Loss of all vital power in in progress and the diesel is recovered and the corresponding bus is dead?

If you fix the semicolon issue and balance the 2 X 2 properly it will be good.

DCPP NRC Exam 20 H 3 X X A 41.7 B 07/2011 DCPP Comment - plausible to think that if a relay has tripped the diesel, then some operator action will be required when the diesel is started. Modified B to be balanced S with D.

Question is now SAT.

Distractors B and C are not credible as written. Why would an AFW pump start and E its associated valves not work for a single power loss and vice-versa. You could just ask the power supplies to the valves or the auto start circuit and have four DC bus choices. LOD = 1 due to distractors.

No effect distracter is unacceptable. This effects distracter A.

DCPP NRC Exam DCPP Comment - question involves power supply to the TDAFW pump valve and 21 H 2 X D 41.7 B 06/2008 the DC power supply to the LCV's. (there are only 3 DC buses). Modified to 2x2 Need to clean up the 2x2. is not capable versus will NOT be capable, comma versus no comma. Done S

Question is now SAT.

E Stem focus is not tied to Loss of offsite power so you need to add that to stem prior to Main unit trip. Distractors A and D are not credible for the given conditions (startup power not used at full power). Also, you have cueing in all three distractors with Immediately the first word of each of those and the correct answer does not. You also have a subset issue going on with several of these choices.

K/A mismatch. K/A requires knowledge of effects on EDG during full-load testing WITH and a loss of offsite power event. Question only asks about a normal reactor 22 H 2 X X B 41.7 X N trip. Also, is it really credible to open the EDG 1-1 output breaker from a trip at full power?

DCPP Comment - the main generator trip results in a loss of 500 kV or loss of offsite power. The question meets the KA because it requires knowledge of what happens when paralleled and then a loss of the grip (or 500 occurs)

Rewrote question _Rev 1 Page 7 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 8 Form ES-401-9 NRC comments above not addressed with exception of K/A match. Cueing (immediately), two implausible distractors (s/u bus). Subset - Tripping open the aux bkr is a subset of ensuring that a breaker has tripped open.

S Sat but work on D and explanation Enhanced explanation (and its correct)

Question is now SAT.

23 H 2 D 41.4 N S Distractor C is not credible because Release continues is not credible as written. If E you state that the PRM is tied to a different valve or that it fails as is on loss of power to the monitor or maybe if in another system there is a backup PRM, this might make it more credible. This is also a No Action distracter which is not allowed.

DCPP NRC Exam DCPP comment - unclear what the issue is. C and D should imply what is stated 24 F 2 X A 41.13 M above. Please discuss.

04/2007 Distractor C is not credible. All other answers reference the plant vent. Where, besides the plant vent, would the applicant believe that this release would be going?

S DC wrote new question - question is now SAT.

DCPP NRC Exam 25 F 2 A 41.7 B S 01/2010 DCPP NRC Exam 26 F 3 D 41.7 B S 02/2005 27 H 3 B 41.2 M S K/A mismatch. K/A is asking for knowledge of how AOPs and EOPs work together.

U This question appears to only require knowledge of E-1 and an ARP (PK) procedure.

Also, did not see step 7, pg. 8 of E-1 in the background documents for this question DCPP Comment - SAT?.

28 H 3 C 41.10 N Unsat - question does not match the K/A. Need to work in an abnormal with a major EOP. It does not have to be a CS AOP - can be something that impacts CS, i.e.

power, cooling etc.

S _Rev 1 Page 8 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 9 Form ES-401-9 DC wrote new question - Question is now SAT.

Some minor spelling errors in explanation section.

D is not credible for Tavg < Tref, also it is the only distracter that has the rods E moving in.

DCPP Comment - rewrote question Delete the Tavg program band bullet in the stem - this is system knowledge that the DCPP NRC Exam 29 H 3 X A 41.7 N applicant needs to know.

12/2007 Verify band is the same for each unit removed band from question, turns out the bands are the same for each unit.

S DC wrote new question. Need to add A total of to each answer choice to avoid subset issue. Otherwise, question is good.

DC fixed subset issue. Question is now SAT.

DCPP NRC 30 H 3 D 41.5 M S Exam04/2007 The distractors are all not plausible based on the answer and stem setup. Nearly U every control strategy designed for the primary variable (in this case level) requires the process deviation to stop when the controller is taken to manual. LOD = 1. If you used the discussion about the median signal and how it is used this would be a good question. Single fault design would not allow the other choices to be plausible anyway. You could also ask what would happen with no action first (in auto and the instrument failing) then ask what happens to level (what value does it settle out at) if taken to manual and have them roughly estimate median level based on instrument 31 H 2 X A 41.7 N values.

Answer is a No Effect which is not allowed. Question needs to be revised so that the answer requires operator action and/or plant system movement.

DCPP comment - not sure the suggested changes meet the KA. Rewrote question to deal with the AUTO/Manual transfer.

S Question is now SAT.

32 H 3 DCPP NRC Exam 02/2009 D 41.2 B S 33 F 3 B 41.2 N S E Although this is a good question as written, there are two problems with it. First, the 34 F 3 A 41.4 N NUREG discourages adding additional information to the question and answer that is _Rev 1 Page 9 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 10 Form ES-401-9 not part of the KA unless it is needed to build a good set of distractors. This makes the question appealable by an applicant during post exam reviews because the KA did not invoke this additional information to be asked. Second, if you just provide a list of 2 non-vital and two vital 480 buses you would have the question and answer and that is all that is needed. Another way to do it is with a loss of a bus when these are needed and ask what happens to the system. Marked as an edit for discussion.

DCPP Comment - understand the comment, the equipment is not used very much and non-vital. Knowing the actual power supplies is not something required for these fans. Can discuss other power supply options, perhaps a 2 vital 480 v buses, one vital, one non- vital, one non-vital/one vital or 2 non-vital. is about as deep as one could reasonably go.

All three distractors in one location (100 aux building) and the correct answer in another location (117 containment). Very clear cueing.

S DC removed locations. Question is now SAT.

This is another train redundancy question so this must be changed. Also, you should E put per the FRZ basis document in the stem of the question to make it a legally defendable case if challenged versus the equipment damage choices.

This is LOD=1. Would give this Unsat but is previously approved question. Also, K/A mismatch. K/A requires knowledge of parameters to prevent exceeding design limits.

Do not see how that knowledge is tested in this question.

DCPP NRC Exam 35 F 3 X C 41.8 X M 01/2010 DCPP Comment - changed to 2x2. Not equipment operated in the control room, question focus is the procedure hydrogen limit and the concern (if exceeded).

0.5% as a maximum is not plausible. Use 4% - this is a commonly known H2 limit.

S DC changed to 4% - question is now SAT.

Distractor A is not credible (no effect) and is not allowed per the NUREG. Answer B is E

a subset of distractor C and subsets are not allowed.

Suggest the following:

Which of the following AFW equipment starts based on this event:

DCPP NRC Exam A. Only the motor driven pumps start (after a time delay) 36 H 3 X A 41.7 B 01/2010 B. Only the motor driven pumps start (immediately)

C. Only the turbine driven pump starts (after a time delay)

D. Only the turbine driven pump starts (immediately)

DCPP comment - modified question S

Question is now SAT. _Rev 1 Page 10 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 11 Form ES-401-9 Distractor A is not credible (no effect not allowed) and there is no explanation for it either. Is there a Mode 2 for these fans? That might help with a new distractor A.

E Explanation section needs work (shift down, eliminate redundancy and add justification for a new distractor A).

DCPP comment - as a side note, how does one test an interlock that potentially did 37 H 3 X D 41.11 N not actuate if "no effect" is not allowed? For instance in this question, the intent of A was that the coincidence was not met (plausible, I believe) and therefore the mode would not change.

Back to the fix, modified A (and B)

S NUREG-1021 specifically states that no effect/no action required distractors should be avoided. Question is now SAT.

Stem is missing word Air after Service. There is cueing in the stem with IA and the answer. To fix this change the stem to read:

E Which of the following describes how this valve responds to a leak that develops on the service air header?

38 F 4 X A 41.4 N DCPP Comment - modified as requested.

S Question is now SAT.

39 H 3 B 41.2 B S U I dont think that this is what the KA is asking for. Determine or interpret containment P, T, and H means read the values off of a graph or an instrument not give them increasing trends in the stem and have them diagnose the SBLOCA. You could ask where these are read (location/panel), maybe a PAM instrument recognition aspect, use normal values for these parameters and SBLOCA values to contrast, or something like that. You didnt send the USAR as required for references but does it distinguish between an RCS leak and a SBLOCA? If so, you could also focus on that difference with these values as well. Also need to send us the latest copy of your USAR as required by Attachment 3 of ES-201 and as discussed during the kick-off call for the exam.

40 H 2 X X C 41.5 X N Distractors C and D are too easy to eliminate for the given conditions (LOD = 1).

DCPP Comment - FSAR has been sent.

New question First half of question is LOD-1. The definition of a LOCA is basic knowledge that will have been covered in simulator scenarios dozens of times. Second half of question is good. _Rev 1 Page 11 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 12 Form ES-401-9 Explanation is incorrect if setpoint is 3.0 - Containment pressure SI will occur when S pressure rises an additional 1.3 psig - should say 1.7psig DC worked MSIV isolation on containment pressure into the question. Question is now SAT.

U Another train question based on basic plant design (second part of all three distractors and answer). Could do something like one phase A switch and one Phase B switch, both phase A, both phase B, and have a balanced 2 X 2 on just this aspect 41 F 2 X B 41.7 N DCPP Comment - rewrote as suggested.

S Question is now SAT.

42 H 2 Past NRC Exam 01/2010 D 41.2 X B S KA mismatch. This system is asking for loss of makeup, which is loss of charging, E due to DP issues between charging and the RCS. Is there a DP controller for charging that could malfunction to meet this KA? The FRS aspect is an EPE question and this APE is in the APE only section so you should try to write it at the abnormal level first.

Past DCPP NRC DCPP comment - replaced 43 H 3 D 41.10 X B Exam07/2011 Question still does not have a loss of makeup/charging aspect. This is a basic GFE DP question with the minor exception of FCV-128. Need to write a loss of charging question.

S DC wrote new question - question is now SAT.

What do the NRC L091C 03/2012 words mean in the worksheet? Is this the audit exam for that years NRC exam, was it a requal exam question or what?

E Credibility of throttling RHR flow to delay depletion of RWST inventory when there is no leakage in the system and only that the sump is blocked?

Past DCPP NRC 44 F 2 X C 41.8 B DCPP comment - NRC exam from 03/2012. RWST inventory is a stated goal of Exam NRC 03/2012 ECA-1.3 and several steps deal with RWST inventory. Plausible distractor. Enhanced explanation and wording of question.

S Distractor A is ok. Question is now SAT.

Past DCPP NRC E This question may be too close to the earlier question on CCW (Q8). We made need 45 H 3 X B 41.8 N Exam NRC 03/2012 to change the KA if we cant fix one or the other questions. DIstractor D does not _Rev 1 Page 12 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 13 Form ES-401-9 seem credible.

K/A mismatch. K/A requires knowledge of the effect on the CCW flow header of a loss of CCW. This question concerns whether or not CFCUs should be secured. Is not marked Unsat due to previously approved NRC question.

DCPP comment - rewrote question There is no proposed answer and the explanation remains from the previous question.

S DC wrote new question - question is now SAT.

Reference does not support the reason the other pump is stopped although it does make sense. You need to balance the selections. Instead of trip all RCPs, match the U selections by changing distractor B to read:

A. Trip the reactor and B. Trip the reactor and stop only RCP 1-2 to terminate flow.

C. Stop only RCP 1-2 to terminate flow through PCV-455B and perform a plant shutdown per D. Stop both RCP 1-1 and 1-2 to terminate flow through PCV-455B and perform a plant shutdown per E.

Also, OP-L4 is not a credible shutdown procedure at this power since that procedure states it is only good down to 20% power. Need to find a better procedure or change this aspect as well.

K/A mismatch. K/A requires knowledge of the reasons for actions contained in the EOP for PZR PCS malfunction. This question only tests knowledge of the required 46 H 3 X C 41.10 X N steps in the AP.

DC made changes for above comments, however used the new Q46 for a replacement to Q9. A new Q46 will need to be drafted.

DCPP Comment - question replaced Lisa just added a TS event (Scenario 3, Event 2) that overlaps with this question -

need to discuss.

Explanation for A does not correlate with stem - Channel 456 is not less than 2185.

Need to discuss the plausibility of all PORVs are open, and why one would be closed.

Need to be sure that there is no cueing between the PIs and the valves in the S answer. _Rev 1 Page 13 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 14 Form ES-401-9 DC rewrote question. Question is now SAT.

E Cueing exists between the answer and the other choices. A is valves close, B is open (and is the answer), C is close, and D is close. No action is not allowed per NUREG.

Unbalanced 2 X 2. You could try something like this:

A. Verify the valves close by observing the green lights lit and red lights out on the recirc valve control switch indications B. Verify the valves open with green lights out and red lights lit on the recirc valve control switch indications C. Place the recirc valve control switch for each valve to OPEN then verify D. Place the recirc valve control switch for each valve to CLOSE then verify DCPP Comment - valves are not operated during the EOPs, changed intent of question to be able to remove the "no action required".

47 H 2 X X B 41.7 N DC rewrote question. The question does not read well - very hard to follow.

Remove in their normal operating position from each distractor. The choices cannot be true/false statements, i.e. in their normal position of closed - this is obviously false, therefore the distractor can be eliminated without even reading the stem.

Stem/choice correlation does not make sense. The stem asks what should be the status. This asks the question for only one half of the answer. For the other half of the question (the normal position of the valves) - why is it plausible to think that the valves are normally closed?

S DC selected another K/A and wrote new question - Question is now SAT.

Typo in stem sprays valves. B and C need help to be credible. If the depressurization E has just started as given in the stem, then voids in the head is not credible so collapsing them is not credible. You might be able to fix this aspect by :

A. To establish.

DCPP NRC Exam B. To establishand collapse voids that may occur during depressurization 48 H 2 X D 41.5 B C. To min.and collapse voids that may occur during depressurization 1/2010 D. To min..

DCPP comment - good change suggested, incorporated into B and C S

Question is now SAT.

E Distractor B is not credible with given information. You could use a controller failure for feedwater and not be specific for this distractor.

DCPP NRC Exam 49 H 3 C 41.4 X B 4/2007 DCPP comment - lifting safety is a listed accident in the FSAR for steamline ruptures. _Rev 1 Page 14 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 15 Form ES-401-9 Modified B to state "main feedwater reg valve controller is malfunctioning place the S controller in MANUAL and attempt to restore level " per comment.

Question is now SAT.

DCPP NRC Exam 50 F 3 A 41.4 B S 1/2010 C is not credible with the given stem phrasing. Cooldown rate being exceeded has E nothing to do with natural circulation. You could put a Thot value or an RCS pressure or something like that.

DCPP NRC Exam 51 F 3 X B 41.5 B DCPP Comment - changed as recommended 4/2007 S Remove indicating an inactive loop from C.

Question is now SAT.

K/A mismatch. K/A requires knowledge of reasons for actions in EOP for loss of vital U AC electrical instrument bus. Question as written is only designed to determine why LCV-113 and 115 have an operator assigned to them while in MANUAL.

52 H 2 B 41.7 X N Option 1 occurs in all three distractors. Distractor D should be either 2 or 3. Should the distractors be or or and?

S DC made changes. Question is now SAT.

DCPP NRC Exam 53 H 3 D 41.7 B S 07/2011 54 F 3 D 41.7 N S E Used on 2012 NRC exam Worksheet explanation for distracter A is wrong-it does not match the choices.

Not credible to determine number of spray pumps required on containment sump level. This effects wo distracters. Marked as Edit vice Unsat due to previously approved question.

DCPP NRC Exam 11/2012 DCPP Comment - modified question, reference required, 55 F 2 X C 41.10 N (past 2 NRC exam)

Can eliminate all three distractors with the simple knowledge that CS Pump 1-2 is powered from bus H.

A requirement to stop a CS Pump when containment pressure is still 28 psig is not plausible (distractor B).

Need to try to write a question that does not require handing out an EOP step.

S Generally we try to keep the RO exam free of handouts. _Rev 1 Page 15 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 16 Form ES-401-9 DC wrote new question - Question is now SAT.

56 H 2 D 41.5 B S 57 F 2 C 41.10 B S U

KA mismatch. This KA is not for an RCS leak. Also the choices are LOD = 1 and dont address actual capacities for either charging or letdown. This question is too easy and doesnt address the KA. Also, what is the procedure you use for level control malfunctions for the Pressurizer/RCS? This is the procedure intended for this 58 F 2 C 41.8 X N KA (APE without a leak but just a system malfunction).

Should the output fail to 0% or 100%?

DC changed to 100%. Question is now SAT.

S Stem focus needs work and two distractors are partially not credible as written. The stagnant loop issue is not credible with other pumps running. One suggestion to fix this question is this:

E The operator is directed to trip _____ RCPs in order to ___________.

A. 2 ; Limit the heat input from two RCPs during a degraded core cooling condition B. 1 ; Limit the heat input from one RCP during a degraded core cooling 59 H 2 X X D 41.5 M condition C. 2 ; preserve two pumps from damage that may occur during operation under highly voided conditions D. 1 ; preserve one pump from damage that may occur during operation under highly voided conditions S Answer is still D.

Changes made. Question is now SAT.

KA mismatch. How does the question answer the KA for determining location of High E activity with the alarm? Also distractors C and D are not credible. This makes the question LOD = 1. What other information have you given them in the stem to help DCPP NRC Exam confirm that the monitors would be potentially not functioning properly?

60 H 2 X B 41.9 X N 03/2012 Marked as an E due to previous use on NRC exam.

S DC wrote new question - Question is now SAT.

U This is too easy as written and therefore LOD = 1.

61 F 2 D 41.5 X M DCPP Modified question to 2x2 _Rev 1 Page 16 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 17 Form ES-401-9 The answer D has adequate twice when you read the stem with it.

Are we sure that we can justify that subcooling is the key parameter. Is this in the basis or training material? Is there a better term, like primary parameter since subcooling is the parameter that must be met first?

DC made changes. Question is now SAT.

S Distractor D is not credible.

E This question would be better suited as a 2 x 2. Tasking the applicant to know that RCS temperature must be reduced to less than 554F and why thats important.

DCPP modified to 2x2 62 H 2 X A 41.4 N Is 1130 psig the actual yellow path criteria? If not, pick a slightly higher pressure. If an applicant just looks at 1130 in the steam tables (ignoring the psia conversion),

they will find 559 and determine that the answer cannot be B or D by luck.

S DC changed to 1145 psig. Question is now SAT.

U This is too easy as written and therefore LOD = 1. Should be asking something like why on the magenta path for containment (F05) a value of 94 ft is used with LI-942 versus once you enter FRZ.2 for the magenta you use LI-940 and if < 95.75 ft you return to procedure in effect. Also could ask what equipment gets taken out at what 63 F 2 X A 41.8 N elevations as the water is coming up. I dont think you sent us that procedure either, if you have one for this detail.

S DC wrote new 2x2 question. Question is now SAT.

Second part of distractor A and B are not credible. A suggested change is the E following:

A. RM-30 challenge the lower limit of containment pressure at -5.5 psig B. RM-44A challenge the lower limit of containment pressure at -5.5 psig C. RM-44A challenge the lower limit of containment pressure at -3.5 psig 64 F 2 X C 41.5 M D. RM-30 challenge the lower limit of containment pressure at -3.5 psig Answer is D.

Editorial Comment: Proposed Answer indicates D. Correct answer is C.

S DCPP comment - modified as recommended Question is now SAT.

U This is too easy as written and therefore LOD = 1. None of the distractor are credible 65 F 2 X A 41.2 X N except maybe B. Suggested change is the following:

During a LOCA, an RCS overcooling event is in progress due to an excessive _Rev 1 Page 17 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 18 Form ES-401-9 cooldown rate with no RCPs running.

FR-P.1, response to Imminent Pressurized Thermal Shock Condition, allows termination of SI if RVLSI _______ is at least ______.

A. Full Range  ; 60%

B. Full Range  ; 41%

C. Dynamic Range ; 60%

D. Dynamic Range ; 41%

Answer is still A.

K/A mismatch. K/A requires knowledge of operating behavior characteristics in relation to an overcooling event not system knowledge.

Replaced question New question does not test the ability to operate or monitor. Need to develop a question that gives some parameters for a PTS or overcooling situation and asks for actions to be taken, i.e. given SG dryout conditions - determine that dryout has S occurred (operating behavior characteristics) and what actions are to be taken (ability to operate or monitor). Example: in FR-P1 and Th is increasing, then control feed flow and steam dump to stabilize.

DC wrote new question - question is now SAT.

E Distractor D is not plausible and the explanation needs work.

66 F 2 X C 41.10 N DCPP Comment - replaced D S Question is now SAT.

This question makes no sense based on your explanation, the explanation appears to cover a completely different setup and this is not a good instrument for measuring knowledge of the plant computer (usually QSPDS or something along those lines and E ask something not plant specific since it is Tier 3 such as what do ### mean or magenta colors, etc).

Is this a repeat from previous two exams or not? DC spreadsheet says it is but worksheet says it is not.

DCPP NRC Exam 67 F 2 X X C 41.7 X B Correct answer cant be a no effect/nothing happens. This would be marked Unsat 08/2014 if not previously NRC approved.

DC wrote new generic colors question. Proposed answer remains from original S question.

DC changed answer. Question is now SAT.

68 F 2 B 41.10 B S 69 F 2 DCPP NRC Exam C 41.2 M S _Rev 1 Page 18 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 19 Form ES-401-9 07/2011 There are a lot of better questions that measure more detailed knowledge of this topic U

than this question. The distractors need work to be plausible.

70 F 2 X A 41.10 N LOD=1 as written.

S Changed two distractors - question is now SAT.

U Distractors B and D are not credible as written. I suggest use other modes with the pressure and the 5 minute time to fix this question.

Remove if any from the stem. Action will always be required in answers/distracters.

71 F 2 X C 41.3 N Distracters B and D need operator action added to them.

DCPP comment - modified answer for MODE 2 S Question is now SAT.

E This is not a higher order question, but fundamental question. You need to underline and bold highest in the stem to focus on this aspect of the question. Typos in 72 F 2 X C 41.12 N explanation section.

Need to fix typos in explanation D.

S Explanation fixed. Question is now SAT.

73 F 2 D 41.12 N S E There are a lot of better EOP entry condition questions to write than this one.

Distractor D is not credible and is not allowed.

Distracter D has no associated operator action or plant response. Remove if any 74 H 3 X D 41.7 N from the stem.

S DC wrote new question - question is now SAT.

75 F 2 DCPP NRC Exam 01/2010 D 41.7 B S E

You dont give the 300 psig pressure in the stem and yet the explanation for procedure transition states that in a few steps later when it is checked and stable above 300 psig the transition to E-1.2 can occur-this is a stem focus issue?

Also, using diverse indications to determine if a parameter is actually stable is an RO function (there is another KA for that as well) and so is the red path determination 76 H 3 X D 43.5 N (Distractor D).

Rev1 - DC added 600 psig to the stem. DC changed stem to have one incore rise to 800F with all others at 510F. Need to add another one or two incores failing high.

Procedure requires 5 incores for a transition to occur. 1 failed incore is not a plausible distractor.

E _Rev 1 Page 19 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 20 Form ES-401-9 DCPP Comment - change made to number of TCs Typo in stem - two other incores [are] reading 2300F Typo fixed. Question is now SAT.

S 77 F 2 DCPP NRC Exam 01/2010 B 43.2 B S 78 F 2 C 43.2 N S To eliminate RO knowledge choices altogether, why not use procedure selection more (such as the sections from OP J-10:IV and other sections)

E 43.2 79 H 3 X D X N 43.5 Rev 1 - DC changed question to a 2x2 with half of the question being which section S

of a procedure to direct and half on an operability call for the inverter. Question is now SAT.

Remove RO knowledge portion of the selections and have 4 procedure selections.

E Here is an idea for this one:

A. Transition to E-1.1 B. Stay in ECA-1.2 C. Transition to E-1 D. Finish ECA then transition to E something Cant have answer be stay in and other three choices transition or still psycometrically flawed.

DCPP NRC Exam 80 H 4 X B 43.5 X B 07/2011 Rev 1 - DC changed question to have four different procedure transitions. Need to fix typo in distractor D - then to to. Should B read EOP ECA-1.1 or just ECA-1.1? It is referred to as just ECA-1.1 in all other questions.

DCPP Comment - typo and EOP change made.

Question is now SAT.

S 81 H 3 X X D 43.5 N E Cueing between stem (recirc pump) and answer (Loss of recirculation). I recommend _Rev 1 Page 20 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 21 Form ES-401-9 changing the component that fails to something different but that will still not allow flow for recirc. Distractor lengths are not balanced either. You could fix the length issues with this:

A. Finish E-1.3 and then transition back to E-1 B. Transition to ECA-1.1 C. Remain in E-1.3 at step 14 to continue efforts to place RHR in cold leg S recirculation D. Remain in E-1.3 at step 12 while dispatching an operator to locally open the valve XXXX Where valve XXX is the valve you pick to replace the 8982B valve due to its name.

Rev 1 - DC revised question to place crew in ECA-1.1 and determine direction from this point. DC revised the question to eliminate RO answers and create 2x2 with half being procedure transition and half being detailed knowledge of procedure sequence.

Question is now SAT.

References needed on draft submittal question (ECG 8.9 (LCO only), Tech Spec 3.5.4, BAST and RWST level tables from C-20)

Mode is RO knowledge. Distractor B is of the same flavor as everything is good and E

should not be used. I would recommend using the ECG action requirements that are in C and D and make that the correct answer with a 2 X 2 from those items. This would make the entire question SRO-only.

82 H 3 X D 43.2 X N The correct answer is a No effect/action statement which is not allowed. Revise so that the correct answer requires some plant change, operator action, etc.

S Rev 1 - DC replaced the no action required distractors with a take action, but no tech specs are entered statements. Question requires specific knowledge of AP-6 actions, a calculation, and a tech spec call. Question is now SAT.

E Isnt knowing gas bubbles from the fuel RO knowledge (ie entry conditions for the AP-21 for fuel damage (affects the answer). Increased drag on a fuel bundle could also be true as fuel damage (maybe not enough to pull the bundle apart and release gas, but still true). A warped bundle would have increased drag. See PV OP Experience on this very story.

Rev 1 - DC revised question to a 2x2 with indications of fuel damage combined with DCPP NRC Exam SRO knowledge of where to place a damaged assembly. Where is it procedurally 83 H 2 X X D 43.7 X B 04/2007 directed that lowering the assembly as low as possible is the correct action? I do not see a reason why placing the assembly in an approved safe location (the upender, lowered) would be wrong. Does the Red overload light stay locked in? If so, the overload could occur when removing the assembly and stay locked in during the fuel movement across the cavity - would make B another correct answer. Does the red overload stop the machine? Try to work some fuel handling interlocks into the first half of the question and then confirm the second half of the question is based in _Rev 1 Page 21 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 22 Form ES-401-9 procedure.

DC confirmed that the putting the assembly in the lowered upender is the actual correct answer and changed the answer key. DC confirmed that the red overload light would stop the machine, therefore it would not provide indication in this scenario as the machine is still moving.

Change stem to, which of the following would provide positive indication to the operator - this way it can be said that the red overload would not provide indication S because it would not be in if the machine was moving.

Question was rewritten. Need to fix typo/grammar in second half of stem.

Question stem was repaired. Question is now SAT.

84 F 2 D 43.1 N S Reference needed on draft submittal question (EAL charts)

I dont understand the references needed for this. The EAL chart is all that is needed E

for this question and is all that was submitted for the handouts. What is LEP2?

Not credible to have containment intact and a distracter having loss of third barrier.

85 H 2 C 43.1 N Rev 1 - The reference provided was a typo - on the EAL chart will be provided as a handout. DC changed the stem to show a significant drop in containment pressure to S make a failure of containment more plausible. Additionally, applicant will have to determine how Bus H being out of service affects the containment spray and CFC lineup. Question is now SAT.

U Reference needed on draft submittal question (LCO 3.4.7 and 3.4.8)

This is basically a direct look-up question and is therefore Unsat. LOD = 1.

Did not take advantage of Free review comments.

Rev 1 - DC rewrote question to make a 2x2 basis question on RHR tech spec bases for determining when loops are filled and when Note 1 applies. The new question distractors provides too much information/reasoning - i.e. take this action because of 86 H 3 D 43.2 N this. The because of this statements need to be determined by the applicant, not given in the distractors. Need to remove RCS level is just below top of the hot legs as this makes it obvious that loops are not filled. Also need to remove approximately and pick an absolute level so that there is no wiggle room in the question. Part of the question should test whether the applicant knows the 112 ft requirement or not. Make the question a 2x2 with first half of answer being enter 3.4.7 or 3.4.8 based on a level of 111 ft, and the second half of the question being a distinction within the spec (3.4.7 - SG secondary side levels) (3.4.8 - Restore within 1 hr versus enter action statement). Also, need a new Q86 background and handout attachment. _Rev 1 Page 22 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 23 Form ES-401-9 DCPP Comment per suggestion. Created background file.

Change the second half of the 2x2 to whether you enter action A or B.

Change from enter the applicable 3.4.7/8 action immediately to the actual action that would be entered, i.e. enter Action B immediately.

Need to say enter actions immediately in the distractors.

Need to match the second half of the distractor A and the answer D.

S Fixed distractors - question is now SAT.

Reference needed on draft submittal question (LCO 3.5.2)

U Cueing from stem to answer. STM-89 is in the stem and is the correct answer. This is also a direct look up question and is therefore LOD = 1.

87 H 3 X C 43.3 N Did not take advantage of Free review comments.

DC rewrote question. Need to fix typo in distractor B.

S Typo fixed. Question is now SAT.

U Made improvements from free review question but with knowledge of a CCW leak (given in stem) you can eliminate distractors B and D. if you used another procedure or other procedure selections like OP F-2:VII it might help this question. Typo in stemleak location has been determined to be CCW piping..

RO level question. First part can be answered by knowing entry conditions to major AOPs and second part can be answered by knowing immediate operator actions.

Rev 1 - DC created a 2x2 question with first half being selection of the section of a procedure and the second half being an understanding of the detailed knowledge of the procedure and the confirmation of cavitation.

88 H 3 X X A 43.5 X N Between choices A and B, there is no need to determine whether the CCW pumps are showing cavitation as both choices state that pumps should be monitored.

Reword:

a. Per section C, trip the reactor and all RCPs and transition to E-0

b. Per section C, monitor CCW pumps and trip reactor and RCPs if CCW pump cavitation occurs Take the CCW pump amps bullet and split into 2:

• All CCW pump amps are swinging 1-2 amps

• No discernable increase in CCW pump noise DCPP Comment - made requested change - made modification to B to _Rev 1 Page 23 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 24 Form ES-401-9 incorporate the cavitation. Needs NRC review Typo at the end of distractor B.

Why did we add trip one CCW pump to B?

Are we now saying that the indications are of CCW pump cavitation? Previously, DC stated that cavitation is not confirmed u. How can we say if cavitation continues in distractor B?

S DC made necessary changes to distractor B. Question is now SAT.

Reference needed on draft submittal question (TS 3.3.1)

E DNBR knowledge is above the line information and system knowledge for RO, which affects distractors A and C. Also have cueing from stem with low power and low 89 H 3 X X B 43.2 M power description in the answer B.

S DC to change DNBR to another distractor.

DNBR distractor changed. Question is now SAT.

E K/A mismatch. K/A requires use of procedures to align standby equipment with the EDG. Question only determines correct approval path to implement Appendix X.

Explain how this meets the intent of the K/A.

Rev 1: DC rewrote question to a loss of all AC question. Need to reword third bullet in stem - does not read correctly - has App X been performed or has just permission been given?

90 H 4 DCPP NRC Exam 07/2011 C 43.5 X N Is SEC permission required for entry into App X or to start the charging pump and exceed load limit, or both? Reword question: What actions should the CRS direct?

DCPP Comment - changed per comment It is not clear what was changed. The question does not meet SRO-only requirements as the CRS is not required to direct any procedures.

Question rewritten. Proposed answer is incorrect and remains from original question.

S Proposed answer was fixed. Question is now SAT.

E Reference needed on draft submittal question (Tech Spec 3.3.3 and only Appendix 9.3)

Distracter D - No action/effect 91 H 3 X A 43.2 N Rev 1 - DC reworded distractors to eliminate no action/no action statement. Why is distractor B plausible - entering Action A twice?

DCPP comment - added to justification that multiple entries sometimes allowed.

Added example to background _Rev 1 Page 24 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 25 Form ES-401-9 S Cannot provide the entire STP R-27A, or question is direct lookup. Attachment 9.3 on its own would be acceptable. Applicants must answer question using knowledge of the bases statements provided in the background.

Handout limited to Attachment 9.3 and TS 3.3.3. Question is now SAT.

Explain why entering AP-21 is wrong. Damage to fuel has occurred as given in the U

stem, the systems checklist does not say any or all of the individual symptoms so damage is there. You dont have to get an alarm for radiation to enter this and put the fuel in a safe place, correct?

Not credible to enter AP for irradiated fuel assemblies without any radiation alarms.

This effects two distracters.

DCPP Comment - replaced question 92 F 3 X A 43.2 N Need to state, what is the minimum amount of water between the operator and the spent fuel being moved. If 8 ft is enough, then 23 ft is certainly enough.

Typo in second half of question.

S Question fixed and is now SAT.

93 F 3 DCPP NRC Exam 02/2009 B 43.7 B S Not credible for the oncoming SFM to not review Tech Spec Summary Report. This eliminates distracter D. Also, this question borders LOD=1.

E DCPP comment - its a generic KA which is a low level difficulty. Due to the closeness of the KA to #95, randomly selected a new KA (2.1.37) and new question.

Where is the SRO only aspect to this question? Do you have guidance in conduct of ops of when to use a normal downpower versus a rapid downpower procedure?

94 F 2 X A 43.3 N Need to find a way to work procedural direction into the question.

Question rewritten. He/She needs to not be capitalized - he or she.

DCPP comment - due to limited use (maybe 2 weeks a cycle), deborating demin thought to be a bit obscure, another attempt made to meet KA.

S DC wrote question regarding evolutions requiring reactivity brief. Question is now SAT.

E Probably shouldnt write another question that uses the same procedure (Q94). Do you have another procedure that meets this KA from a different procedure, such as 95 F 2 C 43.1 N overtime?

Would rephrase this question to ask in order of preference starting with the Most _Rev 1 Page 25 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 26 Form ES-401-9 preferred. A) 1,2,3 B) 3,2,1 C) 2,1,3 D) 2,3,1 etc I think it could be potentially confusing if you leave one out in the answer field.

S DCPP - done.

Question is now SAT.

This KA is for process questions, not who is responsible for it. Ask something about E the process for doing IPTE so it has more discriminating value.

DC rewrote IPTE question.

96 F 3 DCPP NRC Exam 07/2011 D 43.3 X N Distractors A & C are not credible. A shutdown to Mode 3 is not a plausible distractor as an evolution requiring IPTE.

S Question rewritten and is now SAT.

97 H 2 B 43.1 N S Distractor C is not credible to have the rad assessment less than property saving E

value. Make C 10 mrem and 15 mrem to fix.

98 F 3 X B 43.4 M DCPP Comment - adjusted C S

Question is now SAT.

D is too long and the words are not necessary. How about this:

D.. E-3 to E-2 to E-3 (similar to the C distractor)

E DCPP Comment modified A Typo in distractor D - extra spaces.

DCPP NRC Exam 99 H 3 X B 43.5 B 04/2007 DC changed distractor A to E3 only - this is not a plausible distractor when the stem explicitly states that the leak is upstream of the MSIV. Give the conditions (that require an SRO-level diagnostic analysis) in the plant after MSIVs are closed and S allow the applicant to diagnose the status of the plant. Change D to, E-3 to E-2 to ECA-3.1.

A need to diagnose the upstream leak was added to the stem. Question is now SAT.

100 F 2 A 43.5 N S B = 29 F = 33 (44%) E = 36 (48%) Additional Notes:

RO TOTALS:

M= 9 H = 42 (56%) U = 16 (21%) _Rev 1 Page 26 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 27 Form ES-401-9 N = 37 S = 23 (30%)

B= 5 F = 11 (44%) E = 15 (60%) Additional Notes:

SRO TOTALS: M= 2 H = 14 (56%) U = 4 (16%)

N = 18 S = 6 (24%)

GENERAL COMMENT

S

1. Chief Examiner comments are indicated in black. Peer reviewer comments in purple. DCPP comments are in red.

2. Average difficulty is __2.50 ___ on the RO exam and 2.72 ___ on the SRO exam.

3. Question overlap from previous two NRC exams: Q18 and Q55.

4. The 10CFR55.41/43 distribution is: RO / SRO 41.1 = 0 43.1 = 4 41.2 = 7 43.2 = 8 41.3 = 1 43.3 = 3 41.4 = 7 43.4 = 1 41.5 = 9 43.5 = 7 41.6 = 0 43.6 = 0 41.7 = 30 43.7 = 2 41.8 = 6 41.9 = 1 41.10 = 10 41.11 = 1 41.12 = 2 41.13 = 1 41.14 = 0

5. The answer distribution is: RO / SRO A = 20 (25%) / 5 (20%) _Rev 1 Page 27 of 28 OBDI 202 - IOLE Process

ES-401 DC-2016-04 28 Form ES-401-9 B = 18 (23%) / 7 (28%)

C = 19 (24%) / 5 (20%)

D = 18 (23%) / 8 (32%)

6. There are __0__ RO questions with handouts provided and __6___ SRO questions with handouts provided. _Rev 1 Page 28 of 28 OBDI 202 - IOLE Process