Revision as of 05:44, 3 April 2019

Text

Wolf Creek-2015-11-PROPOSED Written Exam Comments
	ML16036A387
Person / Time
Site:	Wolf Creek
Issue date:	11/13/2015
From:	Vincent Gaddy; Operations Branch IV
To:	;
References
	Download: ML16036A387 (53)
	v • d • e

ES-401 WC-201 5-11 Written Examination Review Worksheet Rev 8 Form ES-401-9 Attachment 8 Page 1 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 1 F 2 X X N U E S A - 41.10 R1 1. Correct answer is only correct in conditions where there is a spurious or unnecessary Safety Injection.

Revised question

2. Answer "A" is also correct if SI is spurious.

Revised question

3. More correct purpose of step is to determine validity of SI signal, not allowing more time to prevent solid condition. Re

-work question to this end.

Revised question R2 1. Change the question to a one part and with initial stem information Revised question 2. Determine the reason for the actions taken in EMG E

-0, Step 5, given the above conditions.

Revised question R3 - Sat 2 H 2 B E S B - 41.14 R0 1. Minor edits in stem Fixed R1 - Sat 3 H 3 N E S C - 41.7 R0 1. Distractor "C" not credible since stem identifies pressure is lowering. Take this out of stem. Done 2. Nomenclature for PZR Master Pressure Controller Selector Switch not correct in stem. Fixed 3. Refs don't show correlation between PORVs and block valves Noted for future exams R1 - Sat ES-401 WC-2015-11 2 Rev 8 Form ES-401-9 Attachment 8 Page 2 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 4 H 2 N E E S B - 41.10, Handout R 2 1. Having 2 nd part of answer doesn't add any discriminatory value since the 1 st part of each answer is unique.

Generic Comment.

The two parts are used to show the student reviewed all the data and determined which pump parameter has exceeded the limit and on which pump. The second part answers the KA by having the student use the given plant computer printout to determine component status. The first part could be deleted but then the answers don't complete the whole picture for the asked question. 2. Ref 2 needs Attach B, Step B1 since the FOP states "IF any of the following occurs, THEN immediately go to Attachment B, Step B1:"

Added this step to this ref.

3. Per Attach B, Reactor trip is ONLY required if Rx power > 48%. No initial power level given in the stem

- could argue there isn't any correct answer

. Added power level 4. For "C" - provide value for Controlled RCP shutdown in the explanation.

I didn't see a value for Number 1 Seal Injection Temperature

- without knowing this value, it's not possible to determine if a controlled RCP shutdown is warranted per FOP #3.

Added controlled shutdown values to the answer explanation. Added a screen shot of NPIS CVCS which includes a value for VCT temperature which is what seal injection temperature will be.

5. The use of the word "shutdown" is confusing

- there is a difference between controlled plant shutdown and controlled RCP shutdown. Attach C is used for controlled RCP shutdown, not the plant. Added RCP to the phrase 'controlled RCP shutdown' 6. The term "too high" is subjective. Suggest using "exceeds the limit" or "above shutdown criteria" Changed to 'has exceeded the limit'

7. Suggest using "stop" the RCP instead of trip to match wording in procedure.

Changed to stop

8. Suggest "Using the attached NPIS indication, which of the following identifies the required crew response per OFN BB

-005, RCP Malfunctions?"

Done R 3 - Need to change Answer D to RCP motor bearing instead of thrust bearing to match the foldout page and consistent with Answer B.

Done R 4 - Sat ES-401 WC-2015-11 3 Rev 8 Form ES-401-9 Attachment 8 Page 3 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 5 F 2 X X N U E S D - 41.7 R0 1. The 3 rd part of each answer has no discriminatory value since question can be identified knowing only parts 1 and 2 (which is a 2x2 format).

Revised to 2x2

2. Answers "A" and "B" are not credible since it is fundamental knowledge that RCS press/temp will not LOWER with loss of RHR cooling.

Revised to 2x2

3. What is setpoint of RHR discharge relief valve?

600 psig R1 - Need to remove the lower/rise from the justifications. Fixed R2 - Sat 6 F 3 N E E S D - 41.10 R0 1, Add procedure number and title to stem: "Per OFN EG

-004, CCW System Malfunctions, the operators will-"

fixed 2. Suggest "A" to read "isolate service loop, trip the reactor, trip RCPs." This matches SERVICE LOOP CCW PUMP TRIP CRITERIA actions. Then answer "B" can be actions for LOSS OF CCW TO SAFETY LOOP PUMP TRIP CRITERIA. fixed R1 - Edits Done R2 - Sat 7 H 2 N S B - 41.14 R0 - Sat ES-401 WC-2015-11 4 Rev 8 Form ES-401-9 Attachment 8 Page 4 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 8 H 2 X N E E S B - 41.10 R0 1. The explanation for the correct answer is not adequate. The description should include what happens (or is supposed to happen) after each of the two HS's are actuated. How does each of the two HS's accomplish the Rx trip

- signals sent to open the Rx trip breakers and/or bypass breakers? Are there any mechanical breaker actuations?

Added more information to the correct answer reason to answer these questions.

2. What is the reference for the correct answer? What defines the "normal" breaker lineup? (recommend using "breaker" lineup rather than "plant")

Procedure E

-0 is not adequate to determine whether "D" is the correct answer.

Per GEN 003 to withdraw shutdown rods it sends you to SYS SF

-120 and section 6.5.2 closes the reactor trip breakers only locally. At this point only the trip breakers are closed the bypass breakers are only ever closed during testing. Breaker replaced plant in the correct justification. Added the SYS to the references.

3. Explanations for distractors offer very little value. There's no description as to the technical aspect

- what does the lineup

, as displayed in the picture

, mean for A

-C? Added words to describe what each light and line up indicates.

4. Is the value for Reactor power (55%) operationally valid? Where did the number come from?

Yes if the plant was at 100% and the MSIVs were closed and an ATWS condition existed our steam dump system can handle up to 40% power with the SG ARVs adding another 12% to that and rods not moving.

Note: Good use of pictures as alternate to just words. R1 - System reference still needs to be added.

Done R2 - Sat 9 H 3 B E E S A - 41.7 R0 - 4 th bullet states Containment pressure is normal

- approach is to provide operationally valid data to applicant in order to enable them to qualify the data (what is normal or abnormal, good or bad, etc). In this case, provide applicant a value for Containment pressure (maybe 0.3 psig)

Added a value R1 - Suggest changing the "basis for action

" answer of Maintain RCS cooldown rate to an answer that is plausible for the 270,000 lbm/hr (i.e.ensure sufficient level to provide for secondary heat sink.)

Changed 'maintain RCS cooldown rate' to 'Maintain Secondary Heat Sink' for two distractors. This is a more plausible distractor since it is correct for most other circumstances instead of EMG C

-21. Eliminated 'reduced and' from the two 30,000 lbm/hr distractors to make all for answer choices 'maintained' R2 - Sat ES-401 WC-2015-11 5 Rev 8 Form ES-401-9 Attachment 8 Page 5 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 10 H 3 N E E S D - 41.7 R0 1. Explanation for "D" doesn't identify how a P

-14 causes a Reactor trip/MFP trips.

What is the reference for this?

Should say main turbine trip. It does say trip of both MFPs which is what is a start signal for the MDAFWPs. Added the reference to the file. 2. All answers have 2 parts. Since all Part 1 answers are unique, there is no value added to having the 2 nd part. All the applicant needs to know to get the correct answer is that only the MDAFW pumps start.

Deleted the second part of the answer.

3. What are SMART valves? Reference?

Added reference 4 for the smart valves

4. Since TDAFW pump is a distractor, what is ref that describes its auto start only on low SG level?

Added reference 5 to the file. TD pump will start on other things as well but nothing the question stem indicates

5. When identifying setpoints (P

-14, low SG level), it is helpful to include the setpoints in the explanations to aid the examiners in their review since they are not familiar with Wolf Creek.

Added the P

-14 information to the explanation for the question.

6. Does the initial power level of 30% impact the question?

Yes, if it were over 50% (P-9) then two things. If power is over 50% then the turbine trip will cause a reactor trip, this will remove all the heat input to the RCS and therefore the SG which would cause shrink to lower the SG levels to lower than the low level start of all the AFWPs. This power level makes the question operationally valid since I could not say that level stayed above 23.5% on a trip from over 50% power.

7. Change stem to read "What effect, if any, does this failure have on the AFW system?" Added R1 - Add reference for the AFW system SY1406100. Done R2 - Sat ES-401 WC-2015-11 6 Rev 8 Form ES-401-9 Attachment 8 Page 6 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 11 H 3 N E E S C - 41.8 R0 1. Need ref for page in BD EMG C

-0 (per Answer Explanation)

Added reference 3

2. Cueing: Only the correct answer "C" has "are expected to last until" while all the others have "are expected to be totally discharged by" Change all answers to "are expected to last until" because it eliminates cueing AND is more in line with the concern that bus voltage doesn't lower to less than a useful value (105 vdc), not total discharge of the batteries

. Changed items in distractors.

3. Cueing: Only the correct answer has the time of 1600, making it stand out as different from all distractors. Added 1600 to one distractor.

4. Delete "from all NK batteries" at the end of stem.

Deleted 5. For "A" and "B"

- why not use 1600 instead of 1400? This would match the correct answer. Changed all 1400 out with 1600 R1 - 1. Add reference BD EMG C

-0 Done 2. Wrong section was removed from question following initial comments. Remove "-from all NK batteries." From the 3rd sentence and replace the last line with original version. Fixed R2 - Sat ES-401 WC-2015-11 7 Rev 8 Form ES-401-9 Attachment 8 Page 7 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 12 H 2 N E S C - 41.10 R0 1. All answers have 2 parts. Since all Part 1 answers are unique, there is no value added to having the 2nd part. All the applicant needs to know to get the correct answer is the highest priority alarm. Suggest deleting part 2 for each answer and delete "AND why" from the stem. This changes LOD from 3 to 2.

Deleted second part 2. Could delete the first bullet since it doesn't provide any value.

Deleted 3. What is ref that links ALR 00-055C , ESW PMP TROUBLE (ref 1) to the correct answer "C" 055B, ESW PMP B PRESS LO?

Placed the wrong annunciator and response to the question but the correct annunciator and response in the explanation. Corrected since the only way 55B could come in is if the breaker was closed and for this case it is not.

4. Is 055B, ESW PMP B PRESS LO an annunciator? If so, need the ARP as reference.

See above 5. For 2 nd bullet, suggest deleting "and notes the following alarms locked in:" since the alarms are not listed in the stem.

Deleted R1 - Sat 13 F 2 N E E S C - 41.7 R0 1. Does the Reactor power given impact the question? If not, suggest using 100% power to avoid applicant's "reading too much" into the question.

Changed to 100%

2. For the correct answer "C"

- what are the "other NN buses"?

Buses that have not been lost. Added this to the explanation.

3. For the distractor instruments that are not NN02 powered, identify the NN bus.

Added power supplies for the other instruments in the explanation R1 - Need to add the reference to the question. Done R2 - Sat ES-401 WC-2015-11 8 Rev 8 Form ES-401-9 Attachment 8 Page 8 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 14 H 3 N E S A - 41.5 R0 1. What is the ref for the diesel having to be stopped locally due to loss of dc power to controls in the Control Room?

Added another reference from the local annunciator panel for the response to a loss of DC it has more information about the different circuits and which loss causes what.

2. What is NE

-107 and where is it located? Reference?

It is in the diesel room. The local alarm panel annunciator has been added as a reference.

3. Ref 1 should include page 1 of Attach D of OFN NK

-020 to show link betwee n NK04 and NE02.

Added R1 - Sat 15 H 3 X M E S C - 41.5 R0 1. Explanation should start with a description of the ESW actuation

- opening of the feeder breaker (name?) causes- what- and that caused the ESW actuation? SI? Added why the ESW system starts, the diesel starts so it starts to cool the diesel.

2. OFN EF-033, Attach B, has "** Note: Position is applicable if SYS EF

-205 is in affect." The ** is identified on EF HIS-37 (Distractor "C"). Given SYS EF

-205 is ESW/CIRC WATER COLD WEATHER OPERATIONS, does the stem need a statement that would clearly preclude this procedure from being in affect? Like "During the month of July, the unit is operating at 100%"

Added during the summer to the stem.

3. If the ESW system has actuated, the correct answer is that EF HIS

-41 is OPEN but needs to be closed. However, this valve is in series with HV

-39 which should have closed on the SIS. If true, then the system parameters would indicate normal, yes? If system indications are normal, then the question would not be a good KA match.

4. Add the actual procedure in the 3rd bullet of the stem.

Done R1 - Add OFN procedure title, which is required for RO level question. Done R2 - Change 'parameters' to 'indication' and changed the question. Done R3 - Sat ES-401 WC-2015-11 9 Rev 8 Form ES-401-9 Attachment 8 Page 9 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 16 H 3 B E E S C - 41.7, 10 R0 1. For "C" and "D"

- title is "RHR To Accumulator Injection Loops 1 & 2

" added 2. Generic Comment - in all question stems, do not capitalize the word "ONE"

- instead, use "one." For example, "Which one of the following-" not "Which ONE of the following-"

(Comment for next exam)

Changed R1 1. Capitalize Seal Water Return Isolation in Answers A & B Done 2. 2nd sentence in correct answer justification "RCS pressure is the only indication that is looked for in C

-12" Fixed 3. Add statement in the justification for RCP seal water return isolation valves to discuss the potential for applicant to confuse the Seal Water Return Isolation valves (discussed in C

-12) with the RCP seal water valves.

Done R2 - Sat ES-401 WC-2015-11 10 Rev 8 Form ES-401-9 Attachment 8 Page 10 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 17 H 3 N E E E S D - 41.10 R0 1. The Note prior to C

-11, Step 3, "RWST switchover must be reset to prevent automatic transfer to an empty containment sump." Then Step 3 is "Reset Containment Spray And SI Signals" with 6 hand switches

- is this the SI(RWST) that the explanation says needs to be reset? If yes, the explanation is confusing because Step 3 appears to reset SI (2 hand switches), Cnmt Spray (2 hand switches) and RWST Switchover (2 hand switches).

Added more info to the explanation

3. Why is "A" distractor (P

-4) plausible?

Several signals require the reactor trip breakers to be re

-closed in order to reset. If this action is performed then the P

-4 that is locked in from the original trip will clear and allow other signals to now be reset. Example after a reactor trip and SI the P-4 will not allow any other auto SI from occurring until the reactor trip breakers are re

-closed. This also changes what the steam dumps do post trip or after re

-closure of the breakers. If the student confuses this with the SI(RWST) reset then this is plausible, and this is performed in other procedures post trip. If needed I could change this to 'ONLY CTMT spray signal to allow for manual operation of the pumps'

4. Distractor "B" is technically correct because Step 24 is resetting Cnmt Isolation Phase A and B. Would need to rewrite distractor as "ONLY Phase A" Added ONLY to this distractor.

5. Like previous comments, all answers have 2 parts. Since all Part 1 answers are unique, there is no (limited) value added to having the 2nd part. All the applicant needs to know to get the correct answer is the "what signal is reset in C

-11." As in other questions the value is that it explains what the first part of the answer means or is trying to accomplish. I can delete this but if feel it makes the question harder for no reason. R1 - Relook at stem focus to eliminate the potential for other distractor in the question to be correct. There is a potential for not having a correct answer in resetting SI(RWST) ONLY.

Deleted ONLY from three answer choices and changed distractor 1 (P

-4) to CISB. Added references R2 - Reword stem to focus on actions taken in C

-11, rewr ite distractors to match stem change, remove the second part of the answer.

Done R3 - Sat ES-401 WC-2015-11 11 Rev 8 Form ES-401-9 Attachment 8 Page 11 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 18 H 3 B E E S C - 41.7 R0 1. Stem asks for "current" status of the "A" train system, which implies a present tense. However, all answers have either "will stop" or "will remain running"

- both are future tense. They should be "is stopped" or "is running."

Changed 2. Is the 55 seconds in the stem significant?

Yes. Per the explanation the length of time the bus see's the Undervoltage is important to how it will react. At 119 seconds the normal feeder breaker will open and since the stem indicates that time has not been reached yet the breaker stays closed.

3. What is the ref that identifies the Normal Feeder Breaker (NB0112) will stay closed after this transient

? Added ref to question file. SY1406401

4. What is the ref that identifies the Emergency Supply Breaker (EDG output breaker?) will stay closed after this transient? Highlighted portion of SY1406401?

Added ref to question file. SY1406401

5. What is the ref that identifies the EDG will remain running after this transient? Highlighted portion of SY1406401?

Added ref to question file. SY1406401

6. Since the Ann is identified in the stem, the ALR should be included as a reference.

Added ref R1 - Need to add additional references to the comment section.

Done R2 - Sat 19 H 2 N E S C - 41.5 R0 1. Add Tave=Tref in the stem to remove the possibility of challenges to distractor A Done R1 - Sat. The question does test the GFE knowledge of reactivity and temperature effects of a dropped rod, but the applicant has to understand the turbine control system to get the correct answer.

ES-401 WC-2015-11 12 Rev 8 Form ES-401-9 Attachment 8 Page 12 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 20 F 2 B E E S A - 41.10 R0 1. For "C" - is this plausible in Mode 5? Is OFN BG

-009 applicable in Mode 5? Could an alternate boration flowpath using Attach A be used instead?

Per the reference provided this procedure can be used in any mode if negative reactivity is needed for any reason.

2. For "D"

- delete "normal" to read "check if letdown can be established-" since stem states Mode 5 and Step 5 of procedure has "Low pressure LTDN from RHR" as option of step "Check Letdown Established For Current Plant Conditions." Deleted R1 - minor edits Done R2 - Sat 21 H 3 N E E S A - 41.7 R0 1. Reference and explanation and identified correct answer don't match. Correct answer per OFN is startup can continue or YES. Per Ref 1 (source not identified) is overlap shows N

-31 is failed channel.

The correct answer was meant to be NO. The IR detector indications were slightly changed to ensure the P

-6 permissive in not lit and this was added to the stem. The explanation was corrected but the answer/distractors were not.

2. The paragraph below "Answer Explanation" states startup can continue per Step P12 but this paragraph isn't associated with any answer. The Correct answer states N-31 is reading too low but doesn't identify whether the startup can continue (which is YES). However, answer "C" shows N31 and YES but it's identified as incorrect.

See above 3. Ref 2 (OFN SB

-008, Rev 40) is incorrectly highlighted as it should show Step P2 and RNO which is "Go to Step P10.

" See above R1 - edits Done R2 - Sat ES-401 WC-2015-11 13 Rev 8 Form ES-401-9 Attachment 8 Page 13 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 22 F 2 X N U E S B - 41.2 R0 1. Per stem (use bullets), is reactor startup in progress by stating all SD rods have been withdrawn? Note prior to Ref 1, OFN SB-008, Attach Q, step Q3 says two IR channels must be operable to commence a startup so if stem is stating a startup is in progress, this would change the question.

Or is the question written with the plant at power? 2. What annunciator(s) alarm(s) when IR NI fails high?

3. Based on annunciator, operators would identify failed IR NI, correct? And based on their diagnosis, they would have entered OFN SB

-008, yes? Then based on the failed IR NI, Attach Q would be selected (show this in highlights). Then going through steps, at Q1, Ref 1 should show 4 th bullet of The Following Lights on NI Cabinet (LIT

- High Level Trip, High Level Rod Stop, Power Above Permissive P

-6 ) 4. At step Q4, (not highlighted in Ref 1), is the PR

- Operable and the IR Reactor Trip - Blocked? If not, how do the operators block the IR reactor trip?

5. Why are Ref 3, ALR 00

-077B, IR HI VOLT FAIL, and Ref 4, ALR 00-077C, NIS CH IN TEST, included as references? Not explained in Answer Explanation.

6. No reference available for 82D, IR HI FLUX ROD STOP, which is identified in the stem of question.

7. If the function of the Level Trip Bypass Switch in bypass is to prevent an actual reactor trip or rod stop (per Ref 2), what is purpose of Q4 RNO in OFN SB

-008 (Block IR reactor trip)?

8. Note: Per "C"

- function of the bypass switch is to bypass reactor trip and rod stops. Question tests knowledge of rod stop and IR instrument power.

9. See Q22 rev 0

-btl for editorial changes.

After researching this question further it was determined that at the power level (SD

banks withdrawn) and the question setup this was too difficult to come up with good distractors. The question was revised to place the unit at a higher power level and then only have one part to ask the student. It now asks for the same type of understanding but with the unit at power.

R1 - (Rewrite of the original question

). Rewrite Distractor C justification

. Done R 2 - Sat ES-401 WC-2015-11 14 Rev 8 Form ES-401-9 Attachment 8 Page 14 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 23 F 2 B E S A - 41.11 R0 SY1407300, Process and Effluent Rad Monitoring Sys, Rev 17, list several process rad monitors that could be used as plausible distractors.

This should be identified as a question reference.

Added R1 - Sat 24 F 2 N E E S D - 41.10 R0 1. OFN RP

-017, Section 2.0 , SYMPTOMS OR ENTRY CONDITIONS, states the procedure is entered by the Shift Manager, not the CRS as identified in the stem.

Changed to read entered by the crew

2. Revise question from "Which of the following is vital equipment that the RO will operate for this condition AND why?" to "Which of the following actions will the RO perform for this condition and why?"

Changed 3. For Answer "D"

- delete "due to possible hot shorts." This is the only answer that contains additional info on the "why" portion of the answer.

Deleted 4. For Answer "D"

- Change to match "C" so it reads "Ensure NK4401, B US NB02 BRKR CONTROL POWER, is OPEN to-"

Changed 5. For Answer "C"

- consider changing description of breaker to "BB PCV

-456A PORV Control Power, is CLOSED-" Delete the word "breaker" since it's implied to be a breaker just by its noun description.

Changed 6. For "A"

- change "proper SDM" to "adequate SDM" Changed 7. Note: Ref 1 is rev 46 but is provided references has this procedure as Rev 47

- no effect identified.

Changed to rev 47 R1 - Change 1st word in Answer D to Ensure, Add references to the comments section. Done R2 - Sat ES-401 WC-2015-11 15 Rev 8 Form ES-401-9 Attachment 8 Page 15 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 25 F 3 X X X N U E S B - 41.9 R0 1. There are two correct answers. Stem of question presents FR

-Z1 being performed so it can be assumed all parts of procedure would be done. As a result, both Phase A (Step 1) and Phase B (Step 7) would be performed. Therefore, answers "A" (CISA) and "C" (CISB) are correct.

However, the BD states Phase A (Attach A) is for non

-essential penetrations while Phase B (Attach D) doesn't specify that penetrations are essential or non

-essential. This might make answer "C" incorrect but the explanation for answer "C" states the reason is correct.

Reviewed entry conditions for FR

-Z1 and determined that there were two correct answers. Changed distractor to a valve that is not affected by CISA or B.

2. BD-EMG FR-Z1 for Step 1 (CISA) specifically points out that "closed" was reworded to "properly aligned" because some valves may have been previously realigned. Therefore, if any lines are necessary for plant recovery, they may not be required to be isolated. Wording of stem and answers must be in accordance with the BD. They are. If you read the RNO column it says if any valves are not closed then close them. That is why the stem states closed. The question is not asking which valves are closed and then reopened. Some valves are reopened per procedure the ones in the stem are not they are closed.

3. For consistency, the valve titles should be the same as the procedure. Therefore, answers "B" and "C" should read: "EG HV

-58, CCW to RCS Outside CTMT Isolation" Changed valve

4. For consistency and ease of reading, Part 2 of "A" and "C" should read: "To ensure containment penetrations are properly aligned to prevent release of radioactive materials."

Changed 5. For consistency and ease of reading, Part 2 of "B" and "D" should read: "To ensure containment penetrations are closed to eliminate all sources of high containment pressure."

Changed R1 - Write as 2 part question and "To ensure containment penetrations are closed to-" is in all part 2 of answers.. Also deleted 'Containment penetrations closed' from all four answer choices so as to avoid cueing.

R2 - Sat ES-401 WC-2015-11 16 Rev 8 Form ES-401-9 Attachment 8 Page 16 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 26 H 3 X X N U U S A - 41.10, HANDOUT R0 1. Use bullets in stem for ease of reading. (see Q26 rev0

-btl). Fixed 2. Handout to be clean, clear copy of EMG ES-11, one page (front/back) of pages 38 and 40 (not to include p. 39, Foldout Page). That is how it is saved no foldout page

3. Modify last bullet to say crew is performing Steps 21 and 22 to determine if CCPs and SI pumps should be stopped

. (see Q26 rev0

-btl) Changed 4. Modified question for simplification/clarity. (see Q26 rev0

-btl) Changed 5. Modified table to eliminate duplicate wording from each answer.

(see Q26 rev0

-btl) Changed 6. Using the revised explanation in Q26 rev0

-btl for "Incorrect

- "B" CCP with NO SI pumps" it doesn't seem very plausible that the applicant will determine that NO SI pumps are required. With the procedure step as a handout, the applicant would have to make multiple errors to result in no SI pumps running. This KA is using reference materials so a handout will always be provided. A common error is not using adverse CTMT values in all procedures (shown in our validation for the question) and then determining subcooling (common error).

7. The last explanation is "Incorrect

- B CCP with A SI pump running" but it should be "A" CCP and "A" SI pump running. (see Q26 rev0

-btl) Fixed R1 - Second part of Distractor C and D are not plausible. Change the pressure in the stem to raise subcooling to between the normal and adverse containment values for SI determination.

Raised RCS pressure to 900 psig from 585 psig so that subcooling is more plausible for securing SI pumps per step 22.

R2 - Sat 27 H 2 B E S D - 41.10 R0 1. There are two Q27 ref 1 files (.doc and .pdf) fixed 2. Revise stem to read "- has been entered. As the crew begins Step 15 to depressurize the S/Gs, the STA reports that a Red Path on the Integrity Status Tree exists. Which of the following describes the required action(s)?"

Change d 3. In explanations, the info in FR

-C2 (prior to Step 15) is a Caution, not a Note.

Changed R1 - Sat ES-401 WC-2015-11 17 Rev 8 Form ES-401-9 Attachment 8 Page 17 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 28 H 2 M E E S A - 41.2, 3 R0 1. For all answers: adding the parameter of steam flow adds no discriminatory value since the answer can be determined based on steam pressure.

Removed 2. All answers have "Initially to several seconds later" so it should be added to stem and taken out of all answers. The answers are fairly complicated to read to anything that can be done to make it easier for the applicants should be done.

Changed to a two column format

3. Provided ref discusses the flywheel but no ref is provided that discusses loop RCS temps and S/G response.

Added to ref

4. For Part 1 of the answers, they are different from time 0 to several seconds (little change, changing rapidly) so don't need from "several seconds out to 1 minute).

Again, simplify the answers.

Changed to a two column format

5. What is significance of 45% initial power?

Yes since the power level is less than P8 (RCP trip will not cause a Rx trip) then the Rx will not trip and will continue to supply heat just as before the loss of the single RCP. This makes the question more difficult because if the Rx trips then all loops will go to 557F due to steam dumps working in auto for a trip which makes the coast down of the RCP irrelevant for the question so it would miss the KA.

R1 - Add references , incorporated 'No Operator actions' in the question. Done R2 - Sat ES-401 WC-2015-11 18 Rev 8 Form ES-401-9 Attachment 8 Page 18 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 29 H 2 M E S B - 41.1 R0 1. Correct answer explanation doesn't address effect of BA FLOW CTRL at 0.0 turns. Added more to the discussion on how the controller works.

2. Stem: During auto makeup, controller was inadvertently set to 0.0 turns

- doesn't' seem plausible. Maybe inadvertently set prior to the auto makeup?

Modified stem to remove concern

3. Stem: says power is stable, then answers A, B and C say it "will continue to rise/rise/lower"

- confusing No the stem must state that power is stable so when the auto makeup occurs what is the response to power after. If power is not stable to start with then the question can not be answered.

4. For "D"

- delete word "flowing" and "at this point."

Changed 5. All four answers have "Reactor power will" which is already in the stem. Delete from all answers

- easier to read.

Removed 6. Answer "C" implies the reactor was critical but this wasn't in the stem bullets. Change bullet to "Reactor is critical at 1 x 10

-8 amps and stable" Added 7. Change stem to "With NO operator action, which of the following describes the initial response to reactor power?" "A" is "Rise until trip -" "B" is "Rise to slightly above the POAH" etc Changed R1 - Sat 30 H 3 N S C - 41.7 R0 - Sat 31 F 2 N E S A - 41.8 R0 1. "B" says NG01 and NG02 but explanation says NG03 and NG04

- which is correct? Fixed 2. "A" is not plausible because it's 120 VAC and the pumps are 4160.

See below 3. What is voltage of NG buses? If less than 4160, not plausible.

See below 4. Refs for distractors? Explanations should at least identify the bus voltage.

The original buses listed were all safety related which made the question more difficult. Changed all the distractors to 4160 VAC buses (there are only 20 sets in the power block) and then made the wrong answers a reverse of the correct answer.

R1 - Sat ES-401 WC-2015-11 19 Rev 8 Form ES-401-9 Attachment 8 Page 19 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 32 H 2 N E S D - 41.8 R0 The only ref provided for this question is the TS surveillances

- this is not normally assumed to be RO level knowledge. If the facility specifically agrees that this is RO level knowledge, and the information exists in some other ref material (system training manual, procedure, etc) then ok. Otherwise, this is Unsat for KA.

These numbers are on the logs that the ROs take everyday. Changed the stem to eliminate the TS reference issue and focus on the logs.

R1 - Sat 33 F 2 B S D - 41.3 R0 - Sat 34 H 2 N E E S D - 41.5, 7 R0 1. Stem and explanation for correct answer (D) states "perform per procedure?" What procedure?

Especially with an A2 K/A, the plant specific procedure should be identified.

The procedure is referenced in the question reference area, added this to the answer explanation area as well. Updated the question reference to show the flow path of the procedure steps better.

2. Stem doesn't indicate whether makeup is in progress

- should it?

No, the leak from the RCS is leaking into the CCW system. If makeup were going then there would be no way to determine where the water was coming from. Also with the vent valve closed this means that radiation was detected in the CCW system that is what closes it.

R1 - Modif y the questions to avoid ending a sentence with a preposition and to provide which Procedure actions are being performed (OFN EG

-004) which is required for RO level question. Improve distractor choices for 2nd half of question and answer explanation to better match OFN EG

-004 guidance.

Done R2 - Sat ES-401 WC-2015-11 20 Rev 8 Form ES-401-9 Attachment 8 Page 20 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 35 H 2 X X M U U U S C - 41.5, 7, 10 R0 1. Should the stem provide PZR pressure and trend?

Added but the 33C alarm indicates that pressure is lowering.

2. "B" isn't plausible

-a dramatic response to conditions provided.

Changed action to place PZR master controller in manual and control pressure which will not correct the issue but is in the ALR if that were the problem.

3. The way the question is stated, "A" could also be correct answer. Question is which of the following procedures and actions will mitigate this event, so entering the ALR (which is a valid entry based on annunciator 033C) and energizing backup htrs (stem doesn't say they are NOT energized) so this answer would/could be correct. Revise stem so only one correct answer.

No the question asks what will mitigate the event, energizing heaters will not mitigate this event. If that was all the operator did then the reactor would trip on low pressure and SI so while entering this ALR is a correct procedure to enter it will NOT mitigate this event.

4. Ref 1 doesn't contain steps that identify Attach V as correct.

Revised references to show this path

5. No ref for operation of PZR Master Controller

- what is effect of output demand at 40% and down slow. Added the lesson plan to show how the controller works, most of this is skill of the craft. At 40% and down slow the heaters should be energized.

6. No ref for operation of spray valve controllers

- output demand at 0% and 35%

The lesson plan was added to show the pressure numbers that make heaters and sprays work. At 0% the sprays are closed and at any value greater than that they start to open and move on to full open at 100%.

7. Per the ALR, should "A" action be "and check PZR backup heaters energized"?

changed 8. Since stem says 60% and stable, add the word "then" after "The RO" so The RO then notices- added R1 - Answer A is still correct answer (mitigate) and changes to Answer B made it an additional correct answer.

Updated the answer explanation. Also added references to this block R2 - Stem still says "mitigate this event" and minor stem changes. Changed question from 'mitigate' to 'stop'. Some of the distractors might be argued that they 'mitigate' the event even if the action doesn't 'stop' the pressure drop.

R3 - Sat ES-401 WC-2015-11 21 Rev 8 Form ES-401-9 Attachment 8 Page 21 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 36 F 3 N E S D - 41.7 R1 - Add to the justifications the association of the answer with the alarm.

Took "Due to a loss of..

" out of each answer, edits to Justifications.

Done R2 - Sat 37 H 2 N E E S D - 41.7 R0 1. Stem not clear

- was there a valid SI signal that didn't automatically actuate (- becomes necessary to manually actuate SI.")? Is the 60 sec reset timer also applicable for automatically actuated SI's?

1) EMG E-0, Foldout page item #2 provides Manual SI Actuation Criteria for Subcooling and PZR Level. See below.

Added 'due to low PZR level' to the question. There is not an automatic actuation for this parameter. 2) The timer actuates on SIS signal, regardless of how actuated.

2. Ref material doesn't really explain the effect of resetting SI on "related plant equipment." What does "related plant equipment" mean?

Added the word 'Safety' to specify we are asking about safety related equipment that responds to LOCA sequencer actuation. Reference 2, Note 6 specifies the components are all individually sealed in (Latched) so that loss of the actuation signal will not cause these components to return to the condition held prior to the advent of the actuation signal. 3. The explanation for correct answer (D)

- doesn't address effect on related plant equipment (second part of answer

). '(If any)' is included in the question to facilitate selecting correct answer. There is no effect on safety related plant equipment since the 60 second timer has not completed. One of the distractors also has NO plant response. 4. Change stem to read "- the CRS directs the RO to reset the SI signal."

Done 5. What are H2 fans? Is this their official title? Reference materials for statements made in the explanations?

CTMT H2 Mixing Fans, see below. Updated question choices and answer explanation.

6. What is Ref 2 supposed to show as it relates to this question?

Reference 2 shows logic associated with ESFAS actuation, both automatic and manual and the response of some of the safety related plant equipment, along with the note highlighted above.

7. Separate Part 1 and Part 2 of answers with something else besides a comma. At the least, use a semi

-colon. Otherwise, it reads as a sentence.

Done R1 - Change 'No effect.." from two answer choices to 'Remain in SI actuation configuration.' Also add references

. Done R2 - Sat ES-401 WC-2015-11 22 Rev 8 Form ES-401-9 Attachment 8 Page 22 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 38 F 2 B E E S C - 41.7, 10 R0 1. Since this is Bank question from Callaway

- make sure it has been updated to reflect site

-specific alarm s and nomenclature.

Validated 2. Refs (ALRs) for "C" and "D"?

What is level setpoint for each annuc.?

ALR 00-047D - ALR 00-047E - 3. Explanation for "B" correct answer says 12% or lower but ALR says 11% or lower

. Step 12 of EMG ES

-12, TRANSFER TO COLD LEG RECIRCULATION states to check RWST Level <12%, which would be less than or EQUAL to 11% and also specifies Annunciator 00

-047C, RWST LEVEL LOLO 2

- LIT as criteria to perform Step 13. Updated Answer Explanation.

4. Do ALR 047C and ES

-12 line-up? 047C Step 1 says check RWST level < 11% and step 2 for RWST > 6%, then step 3 RNO to complete cold leg recirc as required by EMGs. However, ES

-12, step 12b says check RWST level < 12% where the last bullet is the annunciator 047C. Which one is correct?

EMG ES-12 is correct. Entry condition to ALR 047C is Less than or EQUAL to 11%. Step 1 should probably read "Or Equal to' as well. I discussed with Lou Brosch, Procedure Writer. He concurred and will update procedure.

5. Arrange answers short to long so correct answer becomes "C" (unless there was reason to list as is).

Done R1 - Need to swap Answers B and C to make the order short to long. Add Step 12 in the stem since two of the distractors would be lit prior to the CS swapover.

Done R2 - Sat ES-401 WC-2015-11 23 Rev 8 Form ES-401-9 Attachment 8 Page 23 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 39 F 2 N E S D - 41.7 R0 1. How does question address K/A of "manually operate and/or monitor in the control room" if the fan auto starts? If monitored in the control room, how?

Fan switches and running indication is located on the Main Control Board RL-020. See below and newly added reference 2.

2. Good OE tied to question.

3. Where is ref for auto start of "A" Cavity Cooling fan on loss of power to "B" fan

? Added E-13GN04 as reference 2.

4. Do the Cavity Cooling fans have input and output breakers? The stem states "- but its output breaker trips and will NOT reset." Is this somehow communicating that a loss of power to "B" fan occurred? Not clear.

There is not an input breaker. Output breaker is our standard vernacular. The word output could be deleted, but might confuse students. Recommend leaving as is.

Left as is.

R1 - Sat 40 F 3 X N U U S C - 41.10 R0 1. Looking at a blank Attach A

- if the answer is obtained by only recognizing that Required Action 2 is applicable, then this question is Unsat

- direct lookup.

Student must evaluate each parameter vs minimum and maximum allowed value. For a value outside of acceptable values, either action 1 or 2 is applicable. The student must comprehend value result and demonstrate use of surveillance form to ascertain correct answer. Since an evaluation must be performed, we do not consider this a direct lookup.

2. Explanations say "pre suction" and "post suction" while answers use static and dynamic. What is pre suction and post suction? Haven't heard those terms-Changed the answer explanation to match the answer choices.

3. Answers B and C give a reason the surveillance is UNSAT but include an action statement, while A and D only state the surveillance has failed for a reason. The correct answer is the only one with an action

. Added 'and must be declared INOPERABLE' to both answers Answer choices B and C (Distractors 1 & 3).

4. Provided ref is marginally valuable

- contains generic info related to surveillance procedures (and isn't legible in some sections).

Updated reference.

R1 - Would consider this question a LOD 1 due to the answer can be determined by a true false determination on the first part of each answer.

Replaced with alternate question. R2 - Sat ES-401 WC-2015-11 24 Rev 8 Form ES-401-9 Attachment 8 Page 24 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 41 F 2 N E S B - 41.7 R0 1. What is the instrument tolerance for these valves? Even if + or

- 1%, the re could be more than one correct answer.

An applicant would likely pull the last surveillance test performed on these valves to show that only 2 valves or up to 4 valves would actually be open in the plant.

Per STS MT

-008, S/G SPRING LOADED SAFETY VALVE SETTINGS, As

-Left acceptance criteria must be within 1% of design lift set pressures on two consecutive tests. Added 'lift set tolerance' to the list of items to ignore, along with blowdown and accumulation.

2. What is the value of Ref 2?

Demonstrates which valves are affected and where they are in the system.

R1 - Sat 42 F 2 X N U S C - 41.8 R0 1. "C" can be determined by eliminating all answers with #3. Deleted #3 from distractor 2.

Need to add the word "ONLY" after B, C, and D.

Added "ONLY" to correct answer and distractors 1 &

2. R1 - Sat 43 H 3 M E S B - 41.5 R0 1. In stem, add "in accordance with procedure OFN SB-008" after "- what procedural action will the crew take in accordance with procedure OFN SB

-008 to mitigate the failure?

" Added. Also split the answers into 1) and 2)

2. Second part of question

- need OFN SB

-008 as ref to validate the correct answer.

Is action taken a "memory action?" Added OFN SB

-008 as Reference 2. Step B1 to take manual control of MFP speed is a memory action step.

R1 - Sat 44 F 2 M S D - 41.7 R0 - Sat ES-401 WC-2015-11 25 Rev 8 Form ES-401-9 Attachment 8 Page 25 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 45 H 3 N E S A - 41.7, 8 R0 1. First paragraph in Explanation

- 1) states "The B MDAFWP starting allows the signal-" but in stem, the B MDAFWP fails to start. 2) states "When the B MD pump trips the D SG valve-" but in stem, the B MDAFWP fails to start.

Corrected explanation, The pump start sends a signal to the MD Flow control valves, except for D. 'D' will still close on high flow even though B MD AFP is not running.

'A' will remain full open without corresponding pump running.

2. In stem, change question to read "What is the status of the following MDAFW P discharge valves 1 minute after the reactor trip?"

Done, but changed to new format to eliminate reference to 1 minute and specify No Operator Action taken.

3. What is ref for which SGs are supplied by which MDAFWPs? The statement is made in the Explanation for answer D

- "Correct is A

- BC and B - AD" Added References 2 and 3

4. What is ref that states the TDAFWP will supply > 300 gpm to each SG? It is this amount of flow that "closes" the MDAFWP discharge valves, so the valves are NOT "throttled" Added Reference 3

5. What ref states that TDAFW flow will be > 300 gpm within 1 min after reactor trip?

Flow trend from desktop simulator below. Flow rise is immediate, well within a minute, but we changed the question to eliminate the reference to 1 minute by making it in reference to the time flow stabilizes. See also Reference 3.

R1 - Sat ES-401 WC-2015-11 26 Rev 8 Form ES-401-9 Attachment 8 Page 26 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 46 H 3 N E E S A - 41.7 R0 1. No refs for correct answer (and distractors) for NG04

- NK26 - NK04 (first three sources). MS Word Ref 1 shows NK04

- NN16 - NN04. Replaced, Entire flowpath is Ref 2 now 2. Since it's possible for NN15 to supply NN01 and NN03, why is this not an "acceptable power lineup" per TS? Could applicant argue that an alternate lineup is acceptable even though TS's are required to be entered?

See LCO 3.8.9 basis below. To eliminate any concern with inverter vs. bus operability determination, we modified the question to specify any technical specification action. The inverter would be inoperable with a cross train lineup.

3. It would be helpful if the explanations identified what was incorrect in each lineup. Example: For D: NK01 feeds INV NN15 but supplies NN01, not NN03.

Added better explanations including comments on Ref 2.

4. Is Ref 2 for this question??

(OFN PK-029 , LOSS OF NON VITAL 125 VDC BUS PK01) No, removed.

5. Is Ref 3 for this question?? (SY1506305 , DC and Instrument Power Non-Class 1E, Section 0.2, LOSS OF PK01 DISTRIBUTION PANELS

) No, removed.

6. There are two Q46 ref 1's (1 MS Word, 1 Adobe)

Renamed 7. MS Word Ref 1 is marginally legible.

Replaced, Ref 2 now R1 - Distractor C not a physically possible lineup, add refs. Changed distractor that was not a physically possible lineup to one that is physically possible but makes distribution system INOPERABLE per LCO 3.8.9. Also added references

. R2 - Sat ES-401 WC-2015-11 27 Rev 8 Form ES-401-9 Attachment 8 Page 27 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 47 H 3 N E S C - 41.10 R0 1. STS KJ-011A says the overload test portion (6300 kW and 6821 kW) should be performed at the end of the 24 hr test, not 90 min into it. Also, it states "Momentary transients, less than 30 seconds in duration, outside of the load range due to changing bus loads, will NOT invalidate this test." So would the conditions in the stem present a situation that would invalidate the surveillance? If this is true, then shouldn't the applicants be more aware than just Answer C?

This question is not asking what is wrong with the surveillance it is asking about diesel load limits. Changed the stem to ask about the diesel.

2. What reference states that 4.25 kV is acceptable such that Answer A is not also correct? SYS KJ-123 states the upper limit on voltage is 4320 volts

3. Explanation for C says high load can cause overheating and insulation breakdown

- what ref is this from? Also, explanation says loading over 6.2

-6.8 is limited to 2 hrs per procedure

- is this the STS KJ

-011A? Doesn't it state the lower limit is 6.3?

Corrected the value in the explanation. This is a skill of the craft item, any electrical system that is overloaded will shorten its life due to overheating the wire causing insulation breakdown over time and the wire will fail.

R1 - Sat 48 H 2 B S B - 41.7 R0 - Sat 49 F 2 N E S B - 41.7, 8 R0 - Added ref. Specified in stem that plant is operating in summer. Improved answer explanation to specify CTMT H2 mixing fans will be operating in Fast speed to eliminate concern that there might be a second correct answer if CTMT H2 Mixing fans were running in SLOW speed.

R1 - Sat 50 H 2 B S A - 41.7 R0 - Sat 51 F 2 N E C - 41.11 R0 Reword Distractor A to state "Check the ALERT alarm setpoint prior to performing a radioactive release."

Done R1 - Sat ES-401 WC-2015-11 28 Rev 8 Form ES-401-9 Attachment 8 Page 28 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 52 H 2 B S C - 41.10 R0 If tripping the reactor subsequently trips the turbine, then Distractor C is partially correct. While Answer D is more correct, it cannot be argued that it is the only correct answer. If a turbine trip setpoint is reached, it is not wrong to ensure at some point that the turbine is tripped. Need to reword C & D to be more specific.

Almost all procedures at WC trip the reactor first. The turbine will not be tripped before the reactor at power level >50% (P9) because we don't want challenge the safety systems. Yes the turbine will trip at some time but not by the Operator unless a secondary failure were to occur. Even for a secondary failure with the BOP as the only Operator available in the control room, the reactor can be tripped using SB HS

-42 prior to attempting to trip the turbine manually.

53 H 3 B S B - 41.7 R0 - Sat 54 F 2 B E S C - 41.7 R0 Cannot have a 2 x 2 question with three different aspects as it makes distractors less plausible. Simply ask the question as to which compressors are running and what the position of the PV

-11 valve is.

Done R1 - Sat 55 H 3 X N U S C - 41.9, 10 R1 1. Distractor A is not credible given all the indications provided in the stem.

Distractor B is not credible. There is no plausible reason as to why an applicant might consider stopping fuel movement in the fuel building would be the correct answer for a containment integrity issue.

Changed two distractors R2 - Sat ES-401 WC-2015-11 29 Rev 8 Form ES-401-9 Attachment 8 Page 29 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 56 H 3 N E S D - 41.7 R0 1. All three distractors can be easily eliminated with basic knowledge of ECCS injection operation. All the applicant really needs to figure out is that the plant is tripped and SI is initiated.

Question demonstrates two knowledge bits: 1) that Reactor Trip and SI are required based on given conditions

2) ECCS injection lineup for high head injection is to all four loops.

Distractor 1 (C) is plausible if 1) missed.

Distractor 2 (D) is plausible if 1) missed and student thinks starting a second CCP might be directed by OFN BB

-007 to address the inability to maintain level with a single CCP.

Distractor 3 (B) is plausible if 2) not understood

2. Question stem creates potential confusion when applicants are told to assume operator action and asked what will happen in 5 minutes.

Re-phrased question and eliminated reference to the 5 minutes.

3. Distractor B should be written to ensure that "ONLY" means loops 1&2 only, not ECCS mode only.

Changed R1 - Sat 57 H 3 N E S B - 41.5, 7 R0 Remove the "and why?" part of the question and delete the "due to-" parts of each answer, i.e. "actual pressurizer level lowers." The reasoning as to why these actions do or do not occur should be developed by the applicant. Completed R1 - Sat 58 H 2 N E S A - 41.7 R1 - How is the ability to monitor non

-nuclear instrumentation being examined? Changed question in stem to better demonstrate ability.

The temperature at which the RCS stabilizes is non

-nuclear instrumentation being monitored.

R2 - Sat ES-401 WC-2015-11 30 Rev 8 Form ES-401-9 Attachment 8 Page 30 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 59 H 3 N E S B - 41.5, 7, 10 R1 1. Assessing plant conditions and then selecting a procedure or section of a procedure to mitigate, recover, or with which to proceed. (ES

-401, Attach 2, Fig 2)

Revised question to "which ONE of the following procedures will mitigate the Critical Safety Function Condition with the HIGHEST priority" Also changed distractor 3 from EMG E-1 to EMG FR

-S2 to make all answer choices an EMG FR procedure. And provided a containment pressure and IR SUR indications so that EMG FR

-H1 and EMG FR-S2 are applicable but NOT the CSFSTs with the highest priority.

2. KA - is the 1200F a design limit or just entry condition into FR

-C1? Performance of EMG FR-C1 will address the challenge to Core Cooling Critical Safety Function Status and attempt to prevent exceeding design limits.

R2 - Sat 60 F 3 N E S A - 41.10 R1 1. Distractors B &

D are not credible. It is not plausible to believe that any applicant would consider using a non

-borated water source prior to a borated water source to refill the SFP. OFN EC-046 directs using ANY of the three borated sources, there is not a listed priority so any of the other choices cannot be used as a distractor. Choices are RWST, RHUT, or Rx Makeup per SYS BG

-216. RNO for this step if NO Borated sources are available are to use Rx Makeup per SYS EC

-200, ESW system, or Fire Protection Water. Those distractors are plausible since OFN EC

-046, step 15 (and Attachment A, step A7) directs use of unborated sources if Borated Sources are NOT available. However, changed the two distractors to the other plausible procedure driven emergency source, Fire Protection. Might be more plausible if student incorrectly thinks Fire Protection provides more volume flow for rapidly lowering level.

2. Prior to "Which of the following areas," place, "Per OFN EC

-046, FUEL POOL COOLING AND CLEANUP MALFUNCTIONS" to avoid any situation where another procedure might direct an evacuation of other areas.

Added Per 'OFN EC

-046.' Noun name of procedure is in the question stem.

R2 - Sat 61 H 2 B S A - 41.11 R0 - Sat. Note

- use of the "if any" in the stem isn't necessary if none of the answers include a no change option.

ES-401 WC-2015-11 31 Rev 8 Form ES-401-9 Attachment 8 Page 31 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 62 F 2 N E S A - 41.8 R0 - Distractor A could be argued to be considered a second correct answer. The flow restrictor does indeed restrict flow to the main turbine whether the majority of flow is leaving via a steam line break or not. Added 'during full power operation' to the end of the distractor. This is wrong since one of the design features include

- minimum pressure loss across the nozzle during full power operation. Made this choice D to keep short to long answer choices.

R1 - Sat 63 H 2 B S B - 41.5, 7 R0 - Sat 64 F 2 B E S C - 41.1 R0 1. What is the value of having the current boron conc in the stem?

It lets the student know time in core life.

2. For C and D

- what is "normal" dilution?

Normal is in regards the flow path, but is not needed. The student can assume 'normal' if we did not specify 'alternate' dilution. Removed 'normal' from the two answer choices.

3. For D

- is it plausible to have a "parked position" while at 35% power?

Changed to 'Current position;' which is still wrong.

R1 - Sat 65 F 2 N E S C - 41.7 R0 - The question asks which detector "detects the presence of abnormal heat" and the correct answer is the only option with "heat detector" in its name. Reword to avoid any potential cueing.

Deleted the word 'Heat.' Correct answer now reads 'Protectowire Linear Detector.'

R1 - Sat 66 F 2 B E E S A - 41.10 R1 - (same as Rev 0) Distractor A: EOP action steps never become optional, they are either applicable, not applicable, or superseded. Reword Distractor A to state something to the effect of "become secondary priorities upon entry into EMG FR

-C1." Modified Distractor and changed correct answer to A to keep shortest to longest answer order.

R2 - Edits to Distractor A Changed Distractor 1 again.

'secondary priorities' distractor is a subset of remains 'applicable distractor'. Changed to 'may be performed at CRS discretion...'

R3 - Sat ES-401 WC-2015-11 32 Rev 8 Form ES-401-9 Attachment 8 Page 32 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 67 F 2 N E E S D - 41.10 R0 - Need to be more specific on this question. It could be easily argued that RCS pressure of 2185 psig and lowering, PZR level at 91% and rising, or S/G level at 77% and rising would be reasonable reasons to "have the crew trip the reactor." Ask the question in a way that examines distinct reactor trip requirements

- either procedural trip criteria or exceeding a protection system setting.

Made question more specific by asking which condition exceeded a reactor trip setpoint.

R1 - Change distractor to low S/G trip setpoint, instead of high P

-14 setpoint and updated answer explanation. Also add references

. Done R 2 - Sat 68 F 2 N E E S A - 41.10 R 1 - Correct answer can be too easily identified with elementary nuclear plant operations knowledge. There is little chance that any applicant would consider any answer other than moving rods for a planned evolution as it is universally understood that this does not happen without a peer check. Select a different reactivity manipulation Changed answer to an alternate reactivity manipulation since peer checks for control rod manipulations are universally understood

. R 2 - Change answer to a different alternate reactivity manipulation

increase turbine loading instead of routine dilution for temperature control.

Done R3 - Sat 69 H 3 B E S C - 41.10 R0 - Reword distractor B. "Total S/G leakage" could mean a number of different issues, and therefore can be easily eliminated due to not being specific. Reword to "Combined primary to secondary leakage in 'A' and 'B' S/Gs" or something to that effect. Reworded distractor B. R1 - Sat ES-401 WC-2015-11 33 Rev 8 Form ES-401-9 Attachment 8 Page 33 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 70 F 2 N E S D - 41.10 R0 - 1. How are A and B plausible for Part 1? Per the explanation, the only discriminatory knowledge is that NPIS is a computer point and not an annunciator?

Added 'causing a MCB Annunciator to actuate' to the first sentence. This will make pulling that annunciator card more plausible

. Updated Answer explanation and referenced ALR 00

-097C as an example of computer point generated MCB Annunciator.

2. How are A and C plausible for Part 2? Is there ever a time where an OOS sticker is placed on the NPIS terminal? How many NPIS terminals are there in the CR?

Changed 'NPIS terminal' to 'Affected MCB Annunciator.' There are multiple NPIS terminals in the CR.

R1 - Sat ES-401 WC-2015-11 34 Rev 8 Form ES-401-9 Attachment 8 Page 34 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 71 H 2 B E E S B - 41.12 R0 1. Need ref for correct answer

- what says admin limit is 2000 mR?

Added reference for 2000 mr/year admin limit. This should be an E since no change to the question was needed to correct this issue.

2. Why is ref 1 provided? No calc uses Emergency Exposure limit.

Added correct reference. The original question was during an emergency but after a discussion after looking at JPM overlap

, we changed it to normal activities.

3. Distractor A is not supported by the explanation that 4000mR is allowed with approval. If the limit for this description is 4000mR then 4000

- 1400 = 2600/75 = 34.67 hours2.792 days 0.399 weeks 0.0918 months .

There is not a distractor for 4000 as the mistake. The distractor is 2000

-1400-225. This makes use of the extra information given in the stem so the only mistake made is not just using the different limit numbers.

4. Explanation for D states the incorrect answer is also wrong. 5000

-1400 = 3600/75 = 48 hours2 days 0.286 weeks 0.0658 months .

(Explanation calculated 5000

-1400=2600 but correct answer is 3600.)

Corrected 5. The stem does not state whether the year to date exposure was all at Wolf Creek or if the individual received some of it from another plant. The stem states the individual is a Wolf Creek employee and we don't send people to other sites often. Added all dose from Wolf Creek to the stem.

6. Explanation for C identifies procedure AP 25B

-100 but it's not included as a ref.

Added this reference R1 - Fix math error/typo in answer explanation. Modif y question to eliminate one of the assumption parenthesis statements (to the nearest hour)

Done R2 - Sat ES-401 WC-2015-11 35 Rev 8 Form ES-401-9 Attachment 8 Page 35 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 72 F 2 N E E E S C - 41.12 R0 1. The stem is vague when asking for "in the local area.

" Does this mean the local area of the valves being operated for the evolution

? Ref 1 identifies that HP will need to discuss which rooms, systems and plant areas may be affected during a crud burst associated with the hydrogen peroxide addition.

Focused stem to areas where personnel have access since this is what the KA is asking for.

2. Unsat - a ll of the distractors are not plausible due to applicant confusing what water is or is not contaminated. Distractor A is only plausible if the applicant thinks that you're blowing down the RCS side of the SG or there is a Tube Leak/Tube Rupture.

All are plausible. Strengthened the answer explanations to show this.

If there is a tube leak this would raise dose rates but since the stem doesn't state one exists then it will not. That's what makes it a good distractor. Makeup to the RMWST procedure states that contamination levels could increase in the area of venting however the distractor states makeup not vent. This precaution makes this distractor plausible. Batching boric acid is plausible since you have to understand how to batch, what water to use, where it goes, and so on. This takes place in the aux building so that helps to support this possible conclusion. The water used in this evolution is reactor makeup water which once again has the note for potential contamination. All are plausible.

3. For answer D, why is (TBL01, RMWST) added?

Added because questions during validation showed this needed to be defined better. Changed distractor to write out reactor makeup water storage tank.

4. Ref for question is SYS EJ

-110A? Question was revised and this reference was not corrected, fixed.

5. Knowledge of the crud burst as a result of a hydrogen peroxide add is good knowledge to test but better distractors or didn't approach is required.

See above R1 - Change distractor 1 from SG Blowdown to bypassing RCS filter for a better plausible, but wrong answer choice.

Done R2 - Update answer explanation for 11/4 comment change.

Done R3 - Sat ES-401 WC-2015-11 36 Rev 8 Form ES-401-9 Attachment 8 Page 36 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 73 F 2 X X X N U U S B - 41.10 R0 This is an SRO

-only question due to the RO being required to know transition points in EMG F-0 which would direct the entry into subsequent functional restoration procedures. NUREG 1021 ES 401, Attachment 2 (Clarification Guidance for SRO

-only Questions),page 22, big block, 3rd bullet states that if the question requires knowledge of diagnostic steps and decision points in the EOP's that involve transitions to event specific sub

-procedures or emergency contingency procedure then it is determined to be an S RO-only question.

No, this is a question on a DIRECT entry into a red path based on indications given from F

-0. ROs are required to know entry conditions to red and orange paths. This question does not ask if the student knows what procedure they are in currently, it asks for given these indications which CSF is the highest priority. This knowledge is found in AP 15C

-003 and is RO knowledge. Made format changes as requested.

R1 This is not a Tier 3 generic plant knowledge question. See ES

-401, D.2.a (page 6). "Ensure that the questions selected for Tier 3 maintain their focus on plant

-wide generic knowledge and abilities and do not become an extension of Tier 2, Plant Systems." Replace question (same K/A)

Replaced with new question, same K/A R2 - Sat 74 F 3 X N U U S B - 41.10 R0 This is not a Tier 3 question. The question is specific to the operation of the RHR system. See ES-401, D.2.a (page 6). "Ensure that the questions selected for Tier 3 maintain their focus on plant

-wide generic knowledge and abilities and do not become an extension of Tier 2, Plant Systems."

The applicable K/A is 2.4.9. Emergency procedures

- Knowledge of low power/shutdown implication in accident (e.g., loss of coolant accident or loss of Residual Heat Removal) mitigation strategies. To eliminate the notion that the question was an extension of Tier 2, Plant Systems, changed the question to closer match the K/A wording and made the answer choices (distractors) more generic and not procedure/system knowledge based by removing specific valve numbers. R1 Still Unsat. Eliminate specific plant conditions, ch an g e distractor to reduce RHR flow. Done R2 - Sat ES-401 WC-2015-11 37 Rev 8 Form ES-401-9 Attachment 8 Page 37 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 75 F 3 N E S B - 41.10 R0 1. For the correct answer

- does terminating the event always mean that the emergency class is terminated? Changed correct answer to 'Terminating the emergency classification.'

2. Answer C justification is that this is done per procedure but the answer just says stopping the pump. If stopping ECCS pumps results in a degradation of plant safety or is indicative of worsening conditions, then it would be required to be reported.

Added 'due to a small break LCOA in Containment to the initial statement. Student can now demonstrate understanding of procedure knowledge in EMG ES

-11, POST LOCA COOLDOWN AND DEPRESSURIZATION, beginning at step 21 to sequentially stop ECCS pumps if plant conditions support. This procedure has foldout page action to restart ECCS pumps as necessary to maintain subcooling or pzr level; which would be indicative of worsening conditions and the required report to NRC

3. Answer D

- if a SGTR is the cause of the event, would this still not be required to be reported even though it's lifting at setpoint (initiating of offsite release)?

Added 'due to a small break LOCA in Containment' to the initial statement. This ensures S/G ARV lifting is not a second correct answer. R1 - Sat ES-401 WC-2015-11 38 Rev 8 Form ES-401-9 Attachment 8 Page 38 of 53 OBDI 202 - IOLE Process SRO-Only Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 76 H 3 N E E S D - 43.5 R0 1. With the handout provided, the applicant can see SI initiation is not part of the decision criteria for EAL

-4 (MSLB1 is Faulted SG) for Distracters A and C.

That is not the point of the question. A steam line fault will cause SI to actuate even though the tree doesn't ask for it. The tree is looking for very specific items but other items can be present and not asked for.

2. Distracter B can be eliminated by looking at the EAL-3 flow chart and seeing that no decision is made on the chart without knowing SI initiation status AND some data about RCS leakage. Knowing that an SI has actuated doesn't eliminate this tree. The tree doesn't ask for if it has or not it is looking for other items. This is a mistake that has been made in requal and training as well.

3. This question can be answered correctly by looking at what is said and what isn't on the EAL flow charts only, not based on ability to discern what the event is.

The SI is NOT key to NOT using EAL

-4 it is just not asked for. If an SI were present but the other indications were you would still use this tree.

4. Indications include an SI occurs

- this must be associated with a Reactor Trip so Power would not be able to be "stable."

Moved this item up, this will intended to be a time line setup so power was stable to start with so the student would not think the changes were from a power change.

5. Need to identify what the Handout is in the Comments

- not just saying one is provided. This includes page numbers if only part of the 37 page form is intended to be handed out.

Added page numbers to the handout statement R1 - Remove Handout. Rework question Done R2 - Sat ES-401 WC-2015-11 39 Rev 8 Form ES-401-9 Attachment 8 Page 39 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 77 H 3 B E E E E S B - 43.5 R0 1. While the initial conditions would provide entry conditions for procedures in answers B and C, entry conditions for A and D are not evident or credible. Per entry conditions into the distractors these are credible since the entry condition has been met. The choice is which is the highest priority of the all the procedure entry conditions that are met.

2. To ensure that B is the only correct answer, there needs to be a reason why C has a lower priority than B.

Maybe a Conduct of Operations expectation that one is address above another for a given reason. OFN BB-031 step 1 tells you if you have entered it and accumulator isolations are closed and you are in mode 3 or 4 then go to OFN EJ-015. OFN EG-004 provides actions to restore CCW. If both B train CCW pumps are damaged by fire, they cannot be placed in service. The foldout page directs placing the B RHR pump in PTL if neither pump can be placed in service. Because the A RHR pump is also unavailable, a loss of RHR cooling is the higher priority.

3. If entry conditions to CCW System Malfunctions are not met, and therefore it would not be entered in this situation, then there is no issue of "priority" as stated in the stem. Entry conditions are met since the with a loss of all B train pumps (which is the one cooling now) then multiple alarms will be received in the control room

4. Should include ref materials for distractors, so in this question, the page of each distractor procedure, Section 2, SYMPTOMS OR ENTRY CONDITIONS

. Added other procedures and highlighted the entry conditions so you can see they are met.

R1 - Research ref for priority of B higher than C, revise explanations Done R2 - replace question Done R3 - Add Wolf Creek OE and refs Done R4 - Sat 78 F 3 N E S B - 43.2 R0 1. In stem, change "base" to "basis" Changed 2. In each answer, use the symbol for micro "µ" instead of "u" Changed 3. Explanation for "A" could be more accurate

- SGTR or SLB, offsite and Control Room doses Added 4. Add "and Bases" to the Reference Added R1 - Sat ES-401 WC-2015-11 40 Rev 8 Form ES-401-9 Attachment 8 Page 40 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 79 H 3 N E S D - 43.2, 5 R1 1. The explanation for the correct answer, A, doesn't address the first part of the question (what procedure should be used).

Added 2. Reference(s) for inverter operations, ac and dc buses would be helpful for examiner review. Unable to verify statement "on the bypass transformer via the static switch." This statement appears to be critical to the correct answer as it identifies the power source to NN15 as NG01.

The best documentation for this is the OFN. The drawing at the end of the OFN has some info and the main overall drawing has the in's and out's of the inverter.

3. The TS and Bases refer to the "inverter" being OPERABLE, not the DC bus. Is it correct to ask for operability of NN03 or should it ask if NN15 is operable?

The NOTE in OFN NN-021 refers to NN03 being operable

- is this consistent?

Changed question to ask NN15 operability. The statement in the OFN is inconsistent with TS and this has been reported to the correct individual.

4. Ref 1 doesn't include the pages that identify entry conditions or how to get to Attach I. It also doesn't include the steps in Attach I that line up NN15 from NG01

- just includes step I.6.6 that doesn't mention NG01.

Added additional pages R2 - Sat 80 H 3 N E E S B - 43.5 R1 1. Stem asked for event in progress and action but all answers only include action.

Changed question to only ask for actions per the procedure since individual procedure steps are SRO only knowledge.

2. If unique events are identified like Rev 0, this is a two part question with unique Part 1 answers. No discriminatory value added to Part 2.

That is why the event was not listed in the answer and distractors. The SRO part is what procedure steps would the crew take and since I did not include what procedure the crew is in this makes it even more SRO.

3. How is this SRO-only? Is system level knowledge all that is needed to answer this question since Part 1 is implied and unique? Also, doesn't identify specific procedure number. See above 4. Why is RCP MALFUNCTIONS included as a reference (ref 2)?

Deleted reference R2 - Concerns of #2 and 3 still exist. Changed question to state what action the CRS would direct to make SRO only specific question and added applicable procedure to all four answer choices.

Capitalized proper name words to follow procedure writers guide.

R3 - Sat ES-401 WC-2015-11 41 Rev 8 Form ES-401-9 Attachment 8 Page 41 of 53 OBDI 202 - IOLE Process 81 H 3 N E E S C - 43.2 R0 1. Ref 2, OFN AF

-025, doesn't include page for entry conditions.

Added to reference.

2. What procedure directs splitting switchyard into East/West? Add to stem?

This is performed by the TSO and not Wolf Creek so we don't have a procedure.

3. Ref 3, SY1406401 Revision 018 , Emergency Diesel Generator System (Electrical), states the degraded voltage timer is "below approximately 90%" so is 3740 volts close enough to ensure the timer will actuate the bus isolation? Concern is that applicant might argue that "A" is also correct answer.

Is there a surveillance procedure that checks the timer?

Changed this value to 3536 (85%) to ensure it is met but not as low as the undervoltage which is 70% of normal (4160 VAC). There is no surveillance for the timer the degraded voltage will start the timer.

4. Ref 2, OFN AF

-025, step 9 isn't applicable since stem implies that TSO reported grid instability. Step 9 RNO is to go to step 11. Step 11 is yes, then step 12 is Attach E. Correct, that is the flow path to Attachment E.

5. TS 3.8.1 and bases are required for Part 2 of stem

- they should be included as references to question.

Added these to the references 6. Is TSO required to follow WC procedures? OFN AF

-025, NOTE before step 9, "The TSO will notify the Control Room within two hours upon the loss of the ability to assess the operation of the electrical system relative to predictive or actual voltage." No they are not. They have procedures that require them to notify us of various things but we don't have their procedures. This is not a loss of ability to asse ss items this is a degraded voltage condition.

7. Per TS 3.8.1 Bases, the EDGs are considered onsite standby power sources

- the first paragraph under Explanation discusses that a running EDG isn't considered inoperable, but Part 2 of all answers identify only OFFSITE circuits.

Yes the question asks if the EDG is running based on the length of time the degraded voltage condition has existed and the answer is yes it will be loaded on the bus and the NB will be isolated from the switchyard. The second part of the answers is asking if the offsite circuit is operable not the EDG. Deleted this statement from the explanation

8. For A and C, part 2 of answers is "All offsite circuits are OPERABLE." How many offsite circuits are there? Is this statement plausible? This would be the SRO

-only part of the question.

Changed distractors to be more plausible. With the situation given and one EDG running it's more plausible to have both circuits inoperable than to have both operable. We have 2 offsite circuits, one to each safeguards buses. We have 3 lines feeding the switchyard (345 volt lines). Don't get offsite circuit and offsite power supplies confused.

R1 - Add LCO 3.8.1 to Ref Block.

Add VAC to stem after 3536.

Done R2 - Sat ES-401 WC-2015-11 42 Rev 8 Form ES-401-9 Attachment 8 Page 42 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 82 H 3 M E E E N/A E E S A - 43.2 R0 1. Add to stem "- what actions are required in accordance with procedure xx?"

Changed the answer to show procedure reference. The original answer was based on TS so changed to base on OFN

2. Explanation doesn't say WHY either part is correct. For Part 2:

If TS gives 48 hrs to initiate action to insert rods, why is this a correct action "now?" Could applicants argue there isn't a correct answer

? Would Ops continue with startup and initiate troubleshooting on S32B, using the 48 hr window?

Changed answer to eliminate this issue. Ops would not continue.

3. 2 SRNI's also required in Mode 2 (below P

-6)? Explanation only says Modes 3, 4, 5. Deleted this statement in the explanation since this is now a procedure question and not a TS question.

4. For Part 1: In determining OPERABLE/INOP, is there a better ref than STS CR-001? TS Bases? Surveillance procedure? Is there guidance that says if they differ by more than 1 decade, it's always the higher reading instrument that's INOP?

No but it's not the high one. With three detectors agreeing with each other the one that is not in alignment is broke. The guidance is the channel check.

5. For answers A and B, part 2: Is Required Action K.2.2 "Place the Rod Control System in a condition incapable of rod withdrawal," the same as "open reactor trip breakers?"

There are required actions within TS 3.3.1 that say "Open reactor trip breakers (RTBs)" so it seems to imply they are different actions.

Removed this part of the question. There is more than one way to make rod control incapable of withdraw. R1 - Concerns above still exist.

Revised explanations R2 - Concerns still exist with question/answers

- replace question.

Replacement question developed R3 - Backup question not needed. Decision to use actual plant start up data instead. Rev 3 not used. Submitted Rev 4 with actual plant data R4 - Update K/A information to original version Done R5 - Update Comments block for Mod Bank, r ef s Done R6 - Sat ES-401 WC-2015-11 43 Rev 8 Form ES-401-9 Attachment 8 Page 43 of 53 OBDI 202 - IOLE Process 83 H 3 M E S B - 43.1, 5 HANDOUT R1 1. Ensure handout doesn't provide any cue to any other question in RO/SRO exam.

Does not Correct Classification Path: 2. How does applicant answer "yes" to SGTF1 (SG tube leakage > 150 GPD)

? What is the reference?

Added the bases for the status tree to answer this.

3. How does applicant answer "yes" to SGTF2 (Failed fuel

)? What is the reference?

Added the bases for the status tree to answer this.

4. How does applicant answer "yes" to SGTF 3 (SGTR > than capacity of one CCP)? What is the reference?

Added the bases for the status tree to answer this. 5. How does the applicant answer "Yes" to SGTF6 (Faulted SG inside CTMT cannot be stopped until blown dry)? I don't see anything specifically for this in the stem.

What ref describes any auto isolation of MSIVs?

EMG E-2, Faulted SG isolation will have the crew isolate the MSIVs, step 1. There are no valves between MSIVs and the SG so any faulted SG will blow down into containment.

6. How does the applicant answer "Yes" to SGTF7 (CTMT integrity)? What is the reference for Containment Mini Purge Exhaust Isolation Outlet Dampers auto closing on receipt of CPIS?

Added ref 3 to the question. Added the bases for the status tree to answer this.

7. How does the applicant answer "No" to SGTF8 (GT RE 59/60)? I don't see anything in the stem. Is a "No" answer to SGTF8 consistent with a "Yes" answer to SGTF2 (Failed fuel)?

Is there any reference to support the correct answer? No. Since the stem was silent on the status of GT RE 59/60 per the rules of test taking they are not in alarm (I didn't say it was broke so it is fine). Failed fuel is indicated by the red path for H

-1 per the stem (no AFW).

Distractor Path

8. The Explanations for incorrect classification for C and D: is it trying to say the applicant gets to GE by answering "Yes" at SGTF5 (ruptured and faulted)?

Yes, since there is a faulted SG and a ruptured SG a plausible distractor could be they mistake them as the same SG.

Part 2 of Answer

9. What reference links CTMT PURGE ISO SYS status lights to Containment Mini Purge Exhaust Isolation Outlet Dampers and SA066-X and Y? (I couldn't find SA066-X or Y on the drawing and the highlighted portions of the drawing don't identify the dampers other than ZS0011/0012)

Added picture SY1301301 1 0. What is reference for statement in Explanations B and C for incorrect Part 2 that these lights (Header for CTMT ISO SYS PHASE A) come on to show [CISA] isolation was successful? For this to be plausible, the applicant must think that Mini Purge dampers are part of CISA, not CPIS

- correct? Yes SY1301301 R2 - Sat ES-401 WC-2015-11 44 Rev 8 Form ES-401-9 Attachment 8 Page 44 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 84 H 3 N S D - 43.5 R0 - Sat 85 H 3 X N U U E S C - 43.5 HANDOUT R0 - Question is not written at the SRO level. Question can be answered using knowledge of entry conditions for major Red/Orange Functional Restoration Procedures.

Modified question to ask from a CRS perspective. There are three factors that must be considered when evaluating level of question.

1. Student must realize Adverse CTMT values exist. Without this knowledge bit, entry to EMG FR

-Z2 will not be recognized.

2. Student must assess four CTMT values and determine which procedures are applicable. "Assess plant conditions and then select a procedure or section of a procedure to mitigate, recover, or with witch to proceed."

3. Student must recognize more than one procedure entry conditions are met and apply knowledge of administrative procedures (EMG F

-0) that specify hierarchy, implementation, and/or coordination of plant normal, abnormal, and emergency procedures.

R1 - Concern still exist s Revised question R2 - Minor edit. Done R3 - Sat 86 F 3 N E E S D - 43.2 R0 1. Develop a first half of the question that does not involve a direct lookup using a straightforward flow limit chart. Submitted new question that removed graph.

2. Is it necessary to change the pressures for each distractor? It would be better to pick one set of pressures and have the applicant evaluate the situation in some way that does not involve a direct lookup.

Submitted new question.

R1 - New question, removed Handout. Minor edits to stem Done R2 - Sat 87 F 3 N E S C - 43.1 R1 1. Stem should state to whom the report is made.

Added NRC 2. Could pull the "Wolf Creek" out of all answers and put in the stem. (- 4 hours0.167 days 0.0238 weeks 0.00548 months is Wolf Creek __________?)

Moved to stem

3. Put question number and revision in the worksheet.

Added R2 - Sat ES-401 WC-2015-11 45 Rev 8 Form ES-401-9 Attachment 8 Page 45 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 88 H 4 N E E S C - 43.5 R1 1. What is RWST level when LOLO1 and LOLO2 alarm s come in? Reference?

ALR 00-047D LOLO1 - ALR 00-047C LOLO2

- 2. Stem bullet that crew has completed ES

-12, so Step 23 says Return To Procedure And Step In Effect would put crew back in E

-1, correct? So what procedure guidance is used when both RHR pumps have fluctuating flow and amps while in E

-1? Deleted the bullet that EMG ES

-12 was complete and added steps 1

-11 were complete to the bullet prior. This is where the crew would be waiting for Annunciator 047C, RWST LVEL LOLO 2 to actuate.

3. Put question number and revision in the worksheet.

Added R2 - Edits to stem

- add bullet. Added 'A short time later' to stem bullet R3 - Sat ES-401 WC-2015-11 46 Rev 8 Form ES-401-9 Attachment 8 Page 46 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 89 H 3 X X M U E S A - 43.5 R0 1. Question is not written at the SRO level. Question can be answered using knowledge of entry conditions for major EOPs and general knowledge of the overall sequence of events. No, the second part is SRO only per 55.43 b.5. The student must know and understand specific procedure steps to answer this question and the correct transition. The understanding of E

-2 to the end and then the decision point to determine what procedure to transition to next (in this case E

-1) based on indications makes this SRO.

2. Distractors become not credible and LOD drops when you add a third question to the standard 2 x 2 approach as it provides the applicant with more opportunities to identify a reason to eliminate a distractor. Additionally, the third question has a two

-

part answer, therefore providing yet another opportunity to rule out a distractor. The 2 x 2 questions only work when two questions with 2 answers are used. In this case, the applicant can correctly answer the question with any 2 of the 4 pieces of information. Changed question to a 2X2

3. The question analysis seems to state that ECCS flow would be reduced as part of the last step in E

-2, however the correct answer states otherwise. Please clarify.

No, per the last step in E

-2 ECCS flow must remain since RCS pressure is still lowering and PZR level is not high enough. Changed the answer from weather ECCS flow should be reduced to which procedure will the crew transition to since this question is more straight forward and the same concept is used, should ECCS flow be reduced.

Updated reference 2 to show these items as well. This question should be an E since ES-401 Attachment 2 E was used as the SRO only part, procedure transitions that are NOT direct entry conditions to major EOPs, this is a transition not a direct entry. R1 - move "in Containment" from all answers to stem, change "crew" to "SRO direct" R2 - Sat ES-401 WC-2015-11 47 Rev 8 Form ES-401-9 Attachment 8 Page 47 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 90 H 3 X N U E E S C - 43.2 R 0 1. LOD for Part 1 is barely a 2. Easy to reduce choices to 50

-50 with basic RO level knowledge and two correct answers (A & D)

. Modified the frequency distractors to 'raise' 2. There are two files named Q90 ref 2 rev 0.

Deleted the word document Q90 ref 2 rev 0, OFN NB

-030. OFN NB

-042 is the applicable procedure when paralleled.

R 1 - Difficulty concern still exists. Changed frequency to governor speed. Procedure step 6.4.2 adjusts governor speed for proper synchroscope rotation speed. Added sync scope to stem

. R 2 - Match action with procedure guidance. Changed governor speed back to frequency. Frequency is changed by adjusting governor. Added switch numbers to both voltage and frequency choices.

R3 - Sat 91 H 2 N E E S A - 43.2 R0 1. In stem: What is "Data A failure 1,2,3 AND GW" mean? Reference?

Power loss to RPIS as per the KA

2. Part 2 of the A2 K/A is "based on those predictions use procedures to correct, control or mitigate the consequences-" How is this part of K/A met?

Modified answers to ask about the failure but then asked about actions the crew would take based on the failure. The correct answer is per TS the wrong answer is shutdown per OFN. R1 - changes to Part 2 of answers not acceptable. Will consider TS to be considered for procedures used. Restored question to original version. Specified MCB annunciator in stem, separated answers.

R2 - Sat 92 H 3 X N U E S B - 43.5 R0 - If the malfunction of the FPS is the Halon NOT activating, what is the Part 2 of the K/A to use procedures to correct, control or mitigate this malfunction? The procedure used in the answer isn't a result of the malfunction, nor is the prediction of the impact (event classification).

Changed the question to predict the impacts of Halon not actuating as part 1 and made the appropriate procedure to mitigate the event part 2. Removed all reference to the classification from the question.

R1 - Update Explanations and refs. Done R2 - Sat ES-401 WC-2015-11 48 Rev 8 Form ES-401-9 Attachment 8 Page 48 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 93 H 3 N S A - 43.7 R0 - Sat 94 F 3 X B U U E E E S B - 43.2 R0 (2.1.32) Need to delete "secondary side" and pick another safety related function as the second half of distractors B & D. It would be difficult to believe that any applicant would select a secondary plant design limit for a DBA EDG support function when fuel/containment is the other choice.

Need to look in the design limit bases in Sections 3.2, 3.4 and 3.6, breakdown the high level "fuel and containment" design limits into more specific limits, and then select more challenging distractors (parameters that are potentially believable as a primary design limit but are not officially called out in TS bases).

These are the only distractors that even make sense. The SG secondary side would affect containment (which is listed as a system being protected) and therefor the connection could be made that the EDG supplies power to AFW which would feed a break if not isolated. SFP is plausible with the items of Fukushima failing and causing more problems. These distractors are plausible for reasons that the EDG supplies power to systems that support the overall boundary that is being challenged. While the suggested TS bases to look at for the support systems do discuss items that support the design limits making this leap would cause this question to be LOD 5 since they are not directly listed in the EDG TS basis. Deleted the first part of the question as it did not answer the KA and made the second part into a true 2X2.

R1 (2.1.32) - Not Tier 3 question (Unsat)

Replace KA Done R2 (2.1.23) - Overlap with another question, replace K/A. Done R3 (2.1.2) - New question, new K/A. Revise stem and answers for consistency Done R4 - change "action" to "immediate action" in stem to match procedure guidance Done R5 - Sat 95 F 2 N E D - 43.7 R0 1. Stem should be cleaned

-up to improve readability, i.e. "and/or" in place of "and or" and "has arisen" instead of "has arose." Done 2. Use bullets to separate initial conditions and simplify the wording. Done 3. Reword the stem to state "Refueling machine operation in Bypass mode is desired" to ensure that you do not predict the answer by stating that bypass mode will be required. Done R1 - Sat ES-401 WC-2015-11 49 Rev 8 Form ES-401-9 Attachment 8 Page 49 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 96 F 2 M E E S C - 43.5, 6 R0 1. Is there no other procedure, i.e. general work control/pre

-job brief guidelines that would include the requirements listed in distractors A & B? There appears to be a high risk for multiple correct answers. If the question is intended to only consider th e guidance in the IPTE procedure. Enhanced stem to state the number and title of the procedure that requires this brief. This question was focused on the reference provided and was stated in the original stem which eliminates the more than one correct answer issue identified by the NRC. The stem was only changed to state the procedure number since the title was already in the older version.

2. LOD-1: The correct answer is easy to determine when compared to the distractors. Distractors A & B cover routine aspects of coordinating actions in the field for any evolution. Only answer C covers an aspect unique to infrequent evolutions.

LOD 2 The question is asking what must be discussed per AI 15C

-006 and all the other items listed here are covered in other types of briefings. The key here is that the AI procedure requires a minimum number of items be discussed that may or may not be the same as other briefs. This makes a detailed understanding of this procedure important to determining the correct answer.

EPF 06-001-02 has contact information required. This has been added to references as #3. Changed distractor about breaks to 'log dose received'. Added EPF 06

-001-05 as reference #4 to show logging of dose for this type of brief. These items are plausible so only one correct answer. Only changed one distractor so I could show the forms indicate what must be discussed. Breaks are discussed for long jobs but the documentation of this is not written anywhere so this change made the distractor more plausible. 3. Distractor D is not credible. Completing any nuclear evolution, especially infrequently performed evolutions, will never be briefed with the need to complete them "as quickly as possible."

EMG ES-12: "Steps 1 through 10 and step 13, if applicable, shall be performed without delay." This could be interpreted to mean as quickly as possible. Time Critical JPMs could also be interpreted to mean perform as quickly as possible. The plant has performed RTD cross

-calibrations in the past that required collecting data as quickly as possible, to preclude the effects of RCS temperature drift over time. Changed this distractor to read 'performed without delay' to match other procedure steps that state this.

R1 - minor edit Done R2 - Sat ES-401 WC-2015-11 50 Rev 8 Form ES-401-9 Attachment 8 Page 50 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 97 F 3 X B U E S D - 43.5 R0 - If all of these procedures have some level of applicability in this situation, as it appears they do, then this question has multiple correct answers. The question asks, "what procedure would be used?" After reading the distractor analyses, it appears that arguments can be made that each of these procedures may be referenced or used while managing the additional scope, i.e. a new work order to address the additional scope will follow the requirements of AP 16C

-006, MPAC WORK REQUEST / WORK ORDER PROCESS CONTROLS, therefore the procedure will be "used." Need to clarify the question to prevent multiple correct answers.

Changed stem to ask for 'which procedure governs Ops actions when employing compensatory measures resulting from scope growth'. This limits the answers to the single procedure.

R1 - change 'contingency' to 'compensatory' measures in first paragraph and delete 'additional' from question. Update Answer Explanation

s. Done R2 - Sat 98 F 2 B S C - 43.4 R0 - Sat 99 F 3 X X B U U E E S D - 43.5 R1 1. SRO level: question does not meet SRO

-only guidance. Question can be answered using knowledge of entry conditions for major EOPs and AOPs and general knowledge of the overall sequence of events.

2. Distractors A: Distractor A is not credible as there is no plausible reason to believe that an SI is required

- the distractor analysis states, "Plausible if the student assumes other things are broke outside of what the stem states." This statement confirms that the distractor is not credible as applicants are directed to not assume anything.

3. Distractor C: Distractor C is not credible. It is not plausible to believe that the entire crew would be expected to cease implementation of an EOP in order to transition to an OFN to perform emergency boration.

4. Put question number and revision in the worksheet.

R2 - Not Tier 3 question, unsat R3 - New question, same K/A. Edits to stem, answers and explanations required.

R4 - revise explanations R5 - Sat ES-401 WC-2015-11 51 Rev 8 Form ES-401-9 Attachment 8 Page 51 of 53 OBDI 202 - IOLE Process Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 100 F 2 X X X B U U E S A - 43.1 R0 1. Question format should be improved. Use bullets and past tense for stem conditions, i.e. "Crew Immediate Actions have been performed." Ensure the proper terminology for equipment and technical functions.

2. SRO level: question does not meet SRO

-only guidance. Question can be answered using knowledge of entry conditions for major EOPs and general knowledge of the overall sequence of events.

3. Cueing/Distractors: By stating in the stem "when an SI occurs," this cues the applicant that the basis for the action (the second half of the question) is related to the SI. It would be best to establish some initial conditions that would require an SI and have the applicant determine that an SI has occurred. Due to the cueing, the two distractors related to 30 gpm boration flow are not credible. Add noun name for E

-0 to distractors C & D. Improve wording consistency in distractors C & D, i.e. "continue with the EMG FR-S1" versus "continue with EMG FR

-S1" and "This is" and "This action is." R1 - not Tier 3 question, unsat R2 - New question, new K/A. Delete first paragraph of stem, minor edits to distractors B, C.

R3 - Sat ES-401 WC-2015-11 52 Rev 8 Form ES-401-9 Attachment 8 Page 52 of 53 OBDI 202 - IOLE Process RO TOTALS:

B = 2 0 F = 33 E = 54 Additional Notes:

M = 6 H = 42 U = 11 N = 4 9 S = 10 SRO TOTALS:

B = 6 F = 10 E = 14 Additional Notes:

M = 4 H = 15 U = 8 N = 15 S = 3

GENERAL COMMENT

S:

1. Bank questions are indicated by B; Modified are indicated by M; New questions are indicated by N

2. Chief Examiner comments are indicated in black on E or S questions and in red for U questions

. Licensee responses are in blue for E questions and in blue for U questions.

3. Average Level of Difficulty is

__ 2.4_ on the RO exam and 2.84 on the SRO exam.

4. The 10CFR55.41/43 distribution is: RO / SRO 41.1 = x 43.1 = x 41.2 = x 43.2 = x 41.3 = x 43.3 = 41.4 = 43.4 = x 41.5 = x 43.5 = x 41.6 = 43.6 = x 41.7 = x 43.7 = x 41.8 = x 41.9 = x 41.10 = x 41.11 = x 41.12 = x 41.13 = 41.14 = x 5. The answer distribution is: RO / SRO A = 1 8 (24%) / 5 (2 0%) B = 19 (25.3%) / 6 (24%) C = 22 (29.3%) / 7 (28%) D = 16 (21.3%) / 7 (28%) 6. There is 1 RO question (Q26) with an attachment provided.

7. There are 2 SRO questions (Q83, 85) with attachments provided.

ES-401 WC-2015-11 53 Rev 8 Form ES-401-9 Attachment 8 Page 53 of 53 OBDI 202 - IOLE Process Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 B 5 (easy B difficult) rating scale (questions in the 2 B 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

$ The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

$ The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

$ The answer choices are a collection of unrelated true/false statements. $ The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

$ One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem). 4. Check the appropriate box if a job content error is identified:

$ The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content). $ The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory). $ The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons). $ The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO

-only (K/A and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES

-401 Section D.2.f

. 7. Based on the reviewer=s judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any A U@ ratings (e.g., how the Appendix B psychometric attributes are not being met).

Generic Comments

1. Having 2nd part of answer doesn't add any discriminatory value since the 1st part of each answer is unique.

2. In all question stems, do not capitalize the word "ONE"

- instead, use "one." For example, "Which one of the following-" not "Which ONE of the following-"

Include in your Exam Writer's Guide if you have one.

3. Consider using the same format for 2 part answers (see Q16 for the format, then Q17 as not the same). Put in Exam Writer's Guide.

4. For 2 part answers, make sure Explanations address both parts, even if one part is correct.

5. Use of simulator to prove/disprove plant conditions must be done carefully

- usually the last choice if no other ref can be identified.