ML16036A387

2015-11-PROPOSED Written Exam Comments

ML16036A387
Person / Time
Site:	Wolf Creek
Issue date:	11/13/2015
From:	Vincent Gaddy Operations Branch IV
To:
References
Download: ML16036A387 (53)

Text

ES-401 WC-2015-11 Written Examination Review Worksheet Form ES-401-9 Rev 8

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 41.10 R1

1. Correct answer is only correct in conditions where there is a spurious or unnecessary Safety Injection. Revised question U 2. Answer A is also correct if SI is spurious. Revised question

3. More correct purpose of step is to determine validity of SI signal, not allowing 1 F 2 X X N E more time to prevent solid condition. Re-work question to this end. Revised question R2 S 1. Change the question to a one part and with initial stem information Revised question

2. Determine the reason for the actions taken in EMG E-0, Step 5, given the above conditions. Revised question R3 - Sat B - 41.14 E R0 2 H 2 B S 1. Minor edits in stem Fixed R1 - Sat C - 41.7 R0

1. Distractor C not credible since stem identifies pressure is lowering. Take this out of stem. Done E

3 H 3 N 2. Nomenclature for PZR Master Pressure Controller Selector Switch not correct in S

stem. Fixed

3. Refs dont show correlation between PORVs and block valves Noted for future exams R1 - Sat Page 1 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 2 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B - 41.10, Handout R2

1. Having 2nd part of answer doesnt add any discriminatory value since the 1st part of each answer is unique. Generic Comment. The two parts are used to show the student reviewed all the data and determined which pump parameter has exceeded the limit and on which pump. The second part answers the KA by having the student use the given plant computer printout to determine component status. The first part could be deleted but then the answers dont complete the whole picture for the asked question.

2. Ref 2 needs Attach B, Step B1 since the FOP states IF any of the following occurs, THEN immediately go to Attachment B, Step B1: Added this step to this ref.

3. Per Attach B, Reactor trip is ONLY required if Rx power > 48%. No initial power level given in the stem - could argue there isnt any correct answer. Added power level E 4. For C - provide value for Controlled RCP shutdown in the explanation. I didnt see a value for Number 1 Seal Injection Temperature - without knowing this value, E

4 H 2 N its not possible to determine if a controlled RCP shutdown is warranted per FOP #3.

S Added controlled shutdown values to the answer explanation. Added a screen shot of NPIS CVCS which includes a value for VCT temperature which is what seal injection temperature will be.

5. The use of the word shutdown is confusing - there is a difference between controlled plant shutdown and controlled RCP shutdown. Attach C is used for controlled RCP shutdown, not the plant. Added RCP to the phrase controlled RCP shutdown

6. The term too high is subjective. Suggest using exceeds the limit or above shutdown criteria Changed to has exceeded the limit

7. Suggest using stop the RCP instead of trip to match wording in procedure.

Changed to stop

8. Suggest Using the attached NPIS indication, which of the following identifies the required crew response per OFN BB-005, RCP Malfunctions? Done R3 - Need to change Answer D to RCP motor bearing instead of thrust bearing to match the foldout page and consistent with Answer B. Done R4 - Sat Page 2 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 3 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 41.7 R0

1. The 3rd part of each answer has no discriminatory value since question can be U identified knowing only parts 1 and 2 (which is a 2x2 format). Revised to 2x2 5 F 2 X X N E 2. Answers A and B are not credible since it is fundamental knowledge that RCS S press/temp will not LOWER with loss of RHR cooling. Revised to 2x2

3. What is setpoint of RHR discharge relief valve? 600 psig R1 - Need to remove the lower/rise from the justifications. Fixed R2 - Sat D - 41.10 R0 1, Add procedure number and title to stem: Per OFN EG-004, CCW System E Malfunctions, the operators will fixed 6 F 3 N E 2. Suggest A to read isolate service loop, trip the reactor, trip RCPs. This matches S SERVICE LOOP CCW PUMP TRIP CRITERIA actions. Then answer B can be actions for LOSS OF CCW TO SAFETY LOOP PUMP TRIP CRITERIA. fixed R1 - Edits Done R2 - Sat B - 41.14 7 H 2 N S R0 - Sat Page 3 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 4 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B - 41.10 R0

1. The explanation for the correct answer is not adequate. The description should include what happens (or is supposed to happen) after each of the two HSs are actuated. How does each of the two HSs accomplish the Rx trip - signals sent to open the Rx trip breakers and/or bypass breakers? Are there any mechanical breaker actuations? Added more information to the correct answer reason to answer these questions.

2. What is the reference for the correct answer? What defines the normal breaker lineup? (recommend using breaker lineup rather than plant) Procedure E-0 is not adequate to determine whether D is the correct answer. Per GEN 003 to withdraw E shutdown rods it sends you to SYS SF-120 and section 6.5.2 closes the reactor trip 8 H 2 X N E breakers only locally. At this point only the trip breakers are closed the bypass breakers are only ever closed during testing. Breaker replaced plant in the correct S justification. Added the SYS to the references.

3. Explanations for distractors offer very little value. Theres no description as to the technical aspect - what does the lineup, as displayed in the picture, mean for A-C?

Added words to describe what each light and line up indicates.

4. Is the value for Reactor power (55%) operationally valid? Where did the number come from? Yes if the plant was at 100% and the MSIVs were closed and an ATWS condition existed our steam dump system can handle up to 40% power with the SG ARVs adding another 12% to that and rods not moving.

Note: Good use of pictures as alternate to just words.

R1 - System reference still needs to be added. Done R2 - Sat A - 41.7 R0 - 4th bullet states Containment pressure is normal - approach is to provide operationally valid data to applicant in order to enable them to qualify the data (what is normal or abnormal, good or bad, etc). In this case, provide applicant a value for E Containment pressure (maybe 0.3 psig) Added a value 9 H 3 B E R1 - Suggest changing the basis for action answer of Maintain RCS cooldown rate to an answer that is plausible for the 270,000 lbm/hr (i.e.ensure sufficient level to S provide for secondary heat sink.) Changed 'maintain RCS cooldown rate' to 'Maintain Secondary Heat Sink' for two distractors. This is a more plausible distractor since it is correct for most other circumstances instead of EMG C-21. Eliminated 'reduced and' from the two 30,000 lbm/hr distractors to make all for answer choices 'maintained' R2 - Sat Page 4 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 5 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 41.7 R0

1. Explanation for D doesnt identify how a P-14 causes a Reactor trip/MFP trips.

What is the reference for this? Should say main turbine trip. It does say trip of both MFPs which is what is a start signal for the MDAFWPs. Added the reference to the file.

2. All answers have 2 parts. Since all Part 1 answers are unique, there is no value added to having the 2nd part. All the applicant needs to know to get the correct answer is that only the MDAFW pumps start. Deleted the second part of the answer.

3. What are SMART valves? Reference? Added reference 4 for the smart valves

4. Since TDAFW pump is a distractor, what is ref that describes its auto start only on E low SG level? Added reference 5 to the file. TD pump will start on other things as well but nothing the question stem indicates 10 H 3 N E

5. When identifying setpoints (P-14, low SG level), it is helpful to include the setpoints S

in the explanations to aid the examiners in their review since they are not familiar with Wolf Creek. Added the P-14 information to the explanation for the question.

6. Does the initial power level of 30% impact the question? Yes, if it were over 50%

(P-9) then two things. If power is over 50% then the turbine trip will cause a reactor trip, this will remove all the heat input to the RCS and therefore the SG which would cause shrink to lower the SG levels to lower than the low level start of all the AFWPs.

This power level makes the question operationally valid since I could not say that level stayed above 23.5% on a trip from over 50% power.

7. Change stem to read What effect, if any, does this failure have on the AFW system? Added R1 - Add reference for the AFW system SY1406100. Done R2 - Sat Page 5 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 6 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 41.8 R0

1. Need ref for page in BD EMG C-0 (per Answer Explanation) Added reference 3

2. Cueing: Only the correct answer C has are expected to last until while all the others have are expected to be totally discharged by Change all answers to are expected to last until because it eliminates cueing AND is more in line with the concern that bus voltage doesnt lower to less than a useful value (105 vdc), not total discharge of the batteries. Changed items in distractors.

E 3. Cueing: Only the correct answer has the time of 1600, making it stand out as 11 H 3 N E different from all distractors. Added 1600 to one distractor.

S 4. Delete from all NK batteries at the end of stem. Deleted

5. For A and B - why not use 1600 instead of 1400? This would match the correct answer. Changed all 1400 out with 1600 R1 -

1. Add reference BD EMG C-0 Done

2. Wrong section was removed from question following initial comments. Remove from all NK batteries. From the 3rd sentence and replace the last line with original version. Fixed R2 - Sat Page 6 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 7 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 41.10 R0

1. All answers have 2 parts. Since all Part 1 answers are unique, there is no value added to having the 2nd part. All the applicant needs to know to get the correct answer is the highest priority alarm. Suggest deleting part 2 for each answer and delete AND why from the stem. This changes LOD from 3 to 2. Deleted second part

2. Could delete the first bullet since it doesnt provide any value. Deleted E 3. What is ref that links ALR 00-055C, ESW PMP TROUBLE (ref 1) to the correct 12 H 2 N S answer C 055B, ESW PMP B PRESS LO? Placed the wrong annunciator and response to the question but the correct annunciator and response in the explanation.

Corrected since the only way 55B could come in is if the breaker was closed and for this case it is not.

4. Is 055B, ESW PMP B PRESS LO an annunciator? If so, need the ARP as reference. See above

5. For 2nd bullet, suggest deleting and notes the following alarms locked in: since the alarms are not listed in the stem. Deleted R1 - Sat C - 41.7 R0

1. Does the Reactor power given impact the question? If not, suggest using 100%

power to avoid applicants reading too much into the question. Changed to 100%

E

2. For the correct answer C - what are the other NN buses? Buses that have not 13 F 2 N E been lost. Added this to the explanation.

S

3. For the distractor instruments that are not NN02 powered, identify the NN bus.

Added power supplies for the other instruments in the explanation R1 - Need to add the reference to the question. Done R2 - Sat Page 7 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 8 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 41.5 R0

1. What is the ref for the diesel having to be stopped locally due to loss of dc power to controls in the Control Room? Added another reference from the local annunciator panel for the response to a loss of DC it has more information about the different E

14 H 3 N circuits and which loss causes what.

S

2. What is NE-107 and where is it located? Reference? It is in the diesel room. The local alarm panel annunciator has been added as a reference.

3. Ref 1 should include page 1 of Attach D of OFN NK020 to show link between NK04 and NE02. Added R1 - Sat C - 41.5 R0

1. Explanation should start with a description of the ESW actuation - opening of the feeder breaker (name?) causes what and that caused the ESW actuation? SI?

Added why the ESW system starts, the diesel starts so it starts to cool the diesel.

2. OFN EF-033, Attach B, has ** Note: Position is applicable if SYS EF-205 is in affect. The ** is identified on EF HIS-37 (Distractor C). Given SYS EF-205 is ESW/CIRC WATER COLD WEATHER OPERATIONS, does the stem need a statement that would clearly preclude this procedure from being in affect? Like E During the month of July, the unit is operating at 100% Added during the summer 15 H 3 X M S to the stem.

3. If the ESW system has actuated, the correct answer is that EF HIS-41 is OPEN but needs to be closed. However, this valve is in series with HV-39 which should have closed on the SIS. If true, then the system parameters would indicate normal, yes? If system indications are normal, then the question would not be a good KA match.

4. Add the actual procedure in the 3rd bullet of the stem. Done R1 - Add OFN procedure title, which is required for RO level question. Done R2 - Change 'parameters' to 'indication' and changed the question. Done R3 - Sat Page 8 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 9 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 41.7, 10 R0

1. For C and D - title is RHR To Accumulator Injection Loops 1 & 2 added

2. Generic Comment - in all question stems, do not capitalize the word ONE -

instead, use one. For example, Which one of the following not Which ONE of the following (Comment for next exam) Changed E

R1 16 H 3 B E

1. Capitalize Seal Water Return Isolation in Answers A & B Done S

2. 2nd sentence in correct answer justification RCS pressure is the only indication that is looked for in C-12 Fixed

3. Add statement in the justification for RCP seal water return isolation valves to discuss the potential for applicant to confuse the Seal Water Return Isolation valves (discussed in C-12) with the RCP seal water valves. Done R2 - Sat Page 9 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 10 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 41.10 R0

1. The Note prior to C-11, Step 3, RWST switchover must be reset to prevent automatic transfer to an empty containment sump. Then Step 3 is Reset Containment Spray And SI Signals with 6 hand switches - is this the SI(RWST) that the explanation says needs to be reset? If yes, the explanation is confusing because Step 3 appears to reset SI (2 hand switches), Cnmt Spray (2 hand switches) and RWST Switchover (2 hand switches). Added more info to the explanation

3. Why is A distractor (P-4) plausible? Several signals require the reactor trip breakers to be re-closed in order to reset. If this action is performed then the P-4 that is locked in from the original trip will clear and allow other signals to now be reset.

Example after a reactor trip and SI the P-4 will not allow any other auto SI from occurring until the reactor trip breakers are re-closed. This also changes what the steam dumps do post trip or after re-closure of the breakers. If the student confuses this with the SI(RWST) reset then this is plausible, and this is performed in other E procedures post trip. If needed I could change this to ONLY CTMT spray signal to E allow for manual operation of the pumps 17 H 3 N 4. Distractor B is technically correct because Step 24 is resetting Cnmt Isolation E

Phase A and B. Would need to rewrite distractor as ONLY Phase A Added ONLY S to this distractor.

5. Like previous comments, all answers have 2 parts. Since all Part 1 answers are unique, there is no (limited) value added to having the 2nd part. All the applicant needs to know to get the correct answer is the what signal is reset in C-11. As in other questions the value is that it explains what the first part of the answer means or is trying to accomplish. I can delete this but if feel it makes the question harder for no reason.

R1 - Relook at stem focus to eliminate the potential for other distractor in the question to be correct. There is a potential for not having a correct answer in resetting SI(RWST) ONLY. Deleted ONLY from three answer choices and changed distractor 1 (P-4) to CISB. Added references R2 -

Reword stem to focus on actions taken in C-11, rewrite distractors to match stem change, remove the second part of the answer. Done R3 - Sat Page 10 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 11 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 41.7 R0

1. Stem asks for current status of the A train system, which implies a present tense. However, all answers have either will stop or will remain running - both are future tense. They should be is stopped or is running. Changed

2. Is the 55 seconds in the stem significant? Yes. Per the explanation the length of time the bus sees the Undervoltage is important to how it will react. At 119 seconds the normal feeder breaker will open and since the stem indicates that time has not been reached yet the breaker stays closed.

E

3. What is the ref that identifies the Normal Feeder Breaker (NB0112) will stay closed 18 H 3 B E after this transient? Added ref to question file. SY1406401 S 4. What is the ref that identifies the Emergency Supply Breaker (EDG output breaker?) will stay closed after this transient? Highlighted portion of SY1406401?

Added ref to question file. SY1406401

5. What is the ref that identifies the EDG will remain running after this transient?

Highlighted portion of SY1406401? Added ref to question file. SY1406401

6. Since the Ann is identified in the stem, the ALR should be included as a reference.

Added ref R1 - Need to add additional references to the comment section. Done R2 - Sat C - 41.5 R0 E 1. Add Tave=Tref in the stem to remove the possibility of challenges to distractor A 19 H 2 N Done S

R1 - Sat. The question does test the GFE knowledge of reactivity and temperature effects of a dropped rod, but the applicant has to understand the turbine control system to get the correct answer. Page 11 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 12 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 41.10 R0

1. For C - is this plausible in Mode 5? Is OFN BG-009 applicable in Mode 5?

Could an alternate boration flowpath using Attach A be used instead? Per the E reference provided this procedure can be used in any mode if negative reactivity is 20 F 2 B E needed for any reason.

S 2. For D - delete normal to read check if letdown can be established since stem states Mode 5 and Step 5 of procedure has Low pressure LTDN from RHR as option of step Check Letdown Established For Current Plant Conditions. Deleted R1 - minor edits Done R2 - Sat A - 41.7 R0

1. Reference and explanation and identified correct answer dont match. Correct answer per OFN is startup can continue or YES. Per Ref 1 (source not identified) is overlap shows N-31 is failed channel. The correct answer was meant to be NO. The IR detector indications were slightly changed to ensure the P-6 permissive in not lit and this was added to the stem. The explanation was corrected but the E answer/distractors were not.

21 H 3 N E 2. The paragraph below Answer Explanation states startup can continue per Step S P12 but this paragraph isnt associated with any answer. The Correct answer states N-31 is reading too low but doesnt identify whether the startup can continue (which is YES). However, answer C shows N31 and YES but its identified as incorrect. See above

3. Ref 2 (OFN SB-008, Rev 40) is incorrectly highlighted as it should show Step P2 and RNO which is Go to Step P10. See above R1 - edits Done R2 - Sat Page 12 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 13 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B - 41.2 R0

1. Per stem (use bullets), is reactor startup in progress by stating all SD rods have been withdrawn? Note prior to Ref 1, OFN SB-008, Attach Q, step Q3 says two IR channels must be operable to commence a startup so if stem is stating a startup is in progress, this would change the question. Or is the question written with the plant at power?

2. What annunciator(s) alarm(s) when IR NI fails high?

3. Based on annunciator, operators would identify failed IR NI, correct? And based on their diagnosis, they would have entered OFN SB-008, yes? Then based on the failed IR NI, Attach Q would be selected (show this in highlights). Then going through steps, at Q1, Ref 1 should show 4th bullet of The Following Lights on NI Cabinet (LIT

- High Level Trip, High Level Rod Stop, Power Above Permissive P-6 )

4. At step Q4, (not highlighted in Ref 1), is the PR - Operable and the IR Reactor Trip - Blocked? If not, how do the operators block the IR reactor trip?

U

5. Why are Ref 3, ALR 00-077B, IR HI VOLT FAIL, and Ref 4, ALR 00-077C, NIS CH 22 F 2 X N E IN TEST, included as references? Not explained in Answer Explanation.

S 6. No reference available for 82D, IR HI FLUX ROD STOP, which is identified in the stem of question.

7. If the function of the Level Trip Bypass Switch in bypass is to prevent an actual reactor trip or rod stop (per Ref 2), what is purpose of Q4 RNO in OFN SB-008 (Block IR reactor trip)?

8. Note: Per C - function of the bypass switch is to bypass reactor trip and rod stops. Question tests knowledge of rod stop and IR instrument power.

9. See Q22 rev 0-btl for editorial changes.

After researching this question further it was determined that at the power level (SD banks withdrawn) and the question setup this was too difficult to come up with good distractors. The question was revised to place the unit at a higher power level and then only have one part to ask the student. It now asks for the same type of understanding but with the unit at power.

R1 - (Rewrite of the original question). Rewrite Distractor C justification. Done R2 - Sat Page 13 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 14 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 41.11 R0 E SY1407300, Process and Effluent Rad Monitoring Sys, Rev 17, list several process 23 F 2 B S rad monitors that could be used as plausible distractors. This should be identified as a question reference. Added R1 - Sat D - 41.10 R0

1. OFN RP-017, Section 2.0, SYMPTOMS OR ENTRY CONDITIONS, states the procedure is entered by the Shift Manager, not the CRS as identified in the stem.

Changed to read entered by the crew

2. Revise question from Which of the following is vital equipment that the RO will operate for this condition AND why? to Which of the following actions will the RO perform for this condition and why? Changed

3. For Answer D - delete due to possible hot shorts. This is the only answer that E contains additional info on the why portion of the answer. Deleted 24 F 2 N E 4. For Answer D - Change to match C so it reads Ensure NK4401, BUS NB02 S BRKR CONTROL POWER, is OPEN to Changed

5. For Answer C - consider changing description of breaker to BB PCV-456A PORV Control Power, is CLOSED Delete the word breaker since its implied to be a breaker just by its noun description. Changed

6. For A - change proper SDM to adequate SDM Changed

7. Note: Ref 1 is rev 46 but is provided references has this procedure as Rev 47 -

no effect identified. Changed to rev 47 R1 - Change 1st word in Answer D to Ensure, Add references to the comments section. Done R2 - Sat Page 14 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 15 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B - 41.9 R0

1. There are two correct answers. Stem of question presents FR-Z1 being performed so it can be assumed all parts of procedure would be done. As a result, both Phase A (Step 1) and Phase B (Step 7) would be performed. Therefore, answers A (CISA) and C (CISB) are correct. However, the BD states Phase A (Attach A) is for non-essential penetrations while Phase B (Attach D) doesnt specify that penetrations are essential or non-essential. This might make answer C incorrect but the explanation for answer C states the reason is correct. Reviewed entry conditions for FR-Z1 and determined that there were two correct answers.

Changed distractor to a valve that is not affected by CISA or B.

2. BD-EMG FR-Z1 for Step 1 (CISA) specifically points out that closed was reworded to properly aligned because some valves may have been previously realigned. Therefore, if any lines are necessary for plant recovery, they may not be required to be isolated. Wording of stem and answers must be in accordance with U

the BD. They are. If you read the RNO column it says if any valves are not closed 25 F 3 X X X N E then close them. That is why the stem states closed. The question is not asking S which valves are closed and then reopened. Some valves are reopened per procedure the ones in the stem are not they are closed.

3. For consistency, the valve titles should be the same as the procedure. Therefore, answers B and C should read: EG HV-58, CCW to RCS Outside CTMT Isolation Changed valve

4. For consistency and ease of reading, Part 2 of A and C should read: To ensure containment penetrations are properly aligned to prevent release of radioactive materials. Changed

5. For consistency and ease of reading, Part 2 of B and D should read: To ensure containment penetrations are closed to eliminate all sources of high containment pressure. Changed R1 - Write as 2 part question and To ensure containment penetrations are closed to is in all part 2 of answers.. Also deleted 'Containment penetrations closed' from all four answer choices so as to avoid cueing.

R2 - Sat Page 15 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 16 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 41.10, HANDOUT R0

1. Use bullets in stem for ease of reading. (see Q26 rev0-btl). Fixed

2. Handout to be clean, clear copy of EMG ES-11, one page (front/back) of pages 38 and 40 (not to include p. 39, Foldout Page). That is how it is saved no foldout page

3. Modify last bullet to say crew is performing Steps 21 and 22 to determine if CCPs and SI pumps should be stopped. (see Q26 rev0-btl) Changed

4. Modified question for simplification/clarity. (see Q26 rev0-btl) Changed

5. Modified table to eliminate duplicate wording from each answer. (see Q26 rev0-btl) Changed U

6. Using the revised explanation in Q26 rev0-btl for Incorrect - B CCP with NO SI 26 H 3 X X N U pumps it doesnt seem very plausible that the applicant will determine that NO SI S pumps are required. With the procedure step as a handout, the applicant would have to make multiple errors to result in no SI pumps running. This KA is using reference materials so a handout will always be provided. A common error is not using adverse CTMT values in all procedures (shown in our validation for the question) and then determining subcooling (common error).

7. The last explanation is Incorrect - B CCP with A SI pump running but it should be A CCP and A SI pump running. (see Q26 rev0-btl) Fixed R1 - Second part of Distractor C and D are not plausible. Change the pressure in the stem to raise subcooling to between the normal and adverse containment values for SI determination. Raised RCS pressure to 900 psig from 585 psig so that subcooling is more plausible for securing SI pumps per step 22.

R2 - Sat D - 41.10 R0

1. There are two Q27 ref 1 files (.doc and .pdf) fixed E 2. Revise stem to read has been entered. As the crew begins Step 15 to 27 H 2 B depressurize the S/Gs, the STA reports that a Red Path on the Integrity Status Tree S

exists. Which of the following describes the required action(s)? Changed

3. In explanations, the info in FR-C2 (prior to Step 15) is a Caution, not a Note.

Changed R1 - Sat Page 16 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 17 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 41.2, 3 R0

1. For all answers: adding the parameter of steam flow adds no discriminatory value since the answer can be determined based on steam pressure. Removed

2. All answers have Initially to several seconds later so it should be added to stem and taken out of all answers. The answers are fairly complicated to read to anything that can be done to make it easier for the applicants should be done. Changed to a two column format

3. Provided ref discusses the flywheel but no ref is provided that discusses loop RCS E temps and S/G response. Added to ref 28 H 2 M E 4. For Part 1 of the answers, they are different from time 0 to several seconds (little S change, changing rapidly) so dont need from several seconds out to 1 minute).

Again, simplify the answers. Changed to a two column format

5. What is significance of 45% initial power? Yes since the power level is less than P8 (RCP trip will not cause a Rx trip) then the Rx will not trip and will continue to supply heat just as before the loss of the single RCP. This makes the question more difficult because if the Rx trips then all loops will go to 557F due to steam dumps working in auto for a trip which makes the coast down of the RCP irrelevant for the question so it would miss the KA.

R1 - Add references, incorporated 'No Operator actions' in the question. Done R2 - Sat Page 17 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 18 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B - 41.1 R0

1. Correct answer explanation doesnt address effect of BA FLOW CTRL at 0.0 turns. Added more to the discussion on how the controller works.

2. Stem: During auto makeup, controller was inadvertently set to 0.0 turns - doesnt seem plausible. Maybe inadvertently set prior to the auto makeup? Modified stem to remove concern

3. Stem: says power is stable, then answers A, B and C say it will continue to rise/rise/lower - confusing No the stem must state that power is stable so when the E auto makeup occurs what is the response to power after. If power is not stable to 29 H 2 M start with then the question can not be answered.

S

4. For D - delete word flowing and at this point. Changed

5. All four answers have Reactor power will which is already in the stem. Delete from all answers - easier to read. Removed

6. Answer C implies the reactor was critical but this wasnt in the stem bullets.

Change bullet to Reactor is critical at 1 x 10-8 amps and stable Added

7. Change stem to With NO operator action, which of the following describes the initial response to reactor power? A is Rise until trip B is Rise to slightly above the POAH etc Changed R1 - Sat C - 41.7 30 H 3 N S R0 - Sat A - 41.8 R0

1. B says NG01 and NG02 but explanation says NG03 and NG04 - which is correct? Fixed

2. A is not plausible because its 120 VAC and the pumps are 4160. See below E

31 F 2 N 3. What is voltage of NG buses? If less than 4160, not plausible. See below S

4. Refs for distractors? Explanations should at least identify the bus voltage.

The original buses listed were all safety related which made the question more difficult. Changed all the distractors to 4160 VAC buses (there are only 20 sets in the power block) and then made the wrong answers a reverse of the correct answer.

R1 - Sat Page 18 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 19 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 41.8 R0 The only ref provided for this question is the TS surveillances - this is not normally E assumed to be RO level knowledge. If the facility specifically agrees that this is RO 32 H 2 N level knowledge, and the information exists in some other ref material (system S

training manual, procedure, etc) then ok. Otherwise, this is Unsat for KA. These numbers are on the logs that the ROs take everyday. Changed the stem to eliminate the TS reference issue and focus on the logs.

R1 - Sat D - 41.3 33 F 2 B S R0 - Sat D - 41.5, 7 R0

1. Stem and explanation for correct answer (D) states perform per procedure?

What procedure? Especially with an A2 K/A, the plant specific procedure should be identified. The procedure is referenced in the question reference area, added this to the answer explanation area as well. Updated the question reference to show the flow path of the procedure steps better.

E

2. Stem doesnt indicate whether makeup is in progress - should it? No, the leak 34 H 2 N E from the RCS is leaking into the CCW system. If makeup were going then there S would be no way to determine where the water was coming from. Also with the vent valve closed this means that radiation was detected in the CCW system that is what closes it.

R1 - Modify the questions to avoid ending a sentence with a preposition and to provide which Procedure actions are being performed (OFN EG-004) which is required for RO level question. Improve distractor choices for 2nd half of question and answer explanation to better match OFN EG-004 guidance. Done R2 - Sat Page 19 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 20 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 41.5, 7, 10 R0

1. Should the stem provide PZR pressure and trend? Added but the 33C alarm indicates that pressure is lowering.

2. B isnt plausible -a dramatic response to conditions provided. Changed action to place PZR master controller in manual and control pressure which will not correct the issue but is in the ALR if that were the problem.

3. The way the question is stated, A could also be correct answer. Question is which of the following procedures and actions will mitigate this event, so entering the ALR (which is a valid entry based on annunciator 033C) and energizing backup htrs (stem doesnt say they are NOT energized) so this answer would/could be correct.

Revise stem so only one correct answer. No the question asks what will mitigate the event, energizing heaters will not mitigate this event. If that was all the operator did then the reactor would trip on low pressure and SI so while entering this ALR is a correct procedure to enter it will NOT mitigate this event.

U 4. Ref 1 doesnt contain steps that identify Attach V as correct. Revised references to show this path U

35 H 2 X X M 5. No ref for operation of PZR Master Controller - what is effect of output demand at U 40% and down slow. Added the lesson plan to show how the controller works, most S of this is skill of the craft. At 40% and down slow the heaters should be energized.

6. No ref for operation of spray valve controllers - output demand at 0% and 35%

The lesson plan was added to show the pressure numbers that make heaters and sprays work. At 0% the sprays are closed and at any value greater than that they start to open and move on to full open at 100%.

7. Per the ALR, should A action be and check PZR backup heaters energized?

changed

8. Since stem says 60% and stable, add the word then after The RO so The RO then notices added R1 - Answer A is still correct answer (mitigate) and changes to Answer B made it an additional correct answer. Updated the answer explanation. Also added references to this block R2 - Stem still says mitigate this event and minor stem changes. Changed question from 'mitigate' to 'stop'. Some of the distractors might be argued that they 'mitigate' the event even if the action doesn't 'stop' the pressure drop.

R3 - Sat Page 20 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 21 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 41.7 E R1 - Add to the justifications the association of the answer with the alarm. Took Due 36 F 3 N S to a loss of.. out of each answer, edits to Justifications. Done R2 - Sat D - 41.7 R0

1. Stem not clear - was there a valid SI signal that didnt automatically actuate (

becomes necessary to manually actuate SI.)? Is the 60 sec reset timer also applicable for automatically actuated SIs? 1) EMG E-0, Foldout page item #2 provides Manual SI Actuation Criteria for Subcooling and PZR Level. See below.

Added due to low PZR level to the question. There is not an automatic actuation for this parameter. 2) The timer actuates on SIS signal, regardless of how actuated.

2. Ref material doesnt really explain the effect of resetting SI on related plant equipment. What does related plant equipment mean? Added the word Safety to specify we are asking about safety related equipment that responds to LOCA sequencer actuation. Reference 2, Note 6 specifies the components are all individually sealed in (Latched) so that loss of the actuation signal will not cause these components to return to the condition held prior to the advent of the actuation signal.

E 3. The explanation for correct answer (D) - doesnt address effect on related plant 37 H 2 N E equipment (second part of answer). (If any) is included in the question to facilitate S selecting correct answer. There is no effect on safety related plant equipment since the 60 second timer has not completed. One of the distractors also has NO plant response.

4. Change stem to read the CRS directs the RO to reset the SI signal. Done

5. What are H2 fans? Is this their official title? Reference materials for statements made in the explanations? CTMT H2 Mixing Fans, see below. Updated question choices and answer explanation.

6. What is Ref 2 supposed to show as it relates to this question? Reference 2 shows logic associated with ESFAS actuation, both automatic and manual and the response of some of the safety related plant equipment, along with the note highlighted above.

7. Separate Part 1 and Part 2 of answers with something else besides a comma. At the least, use a semi-colon. Otherwise, it reads as a sentence. Done R1 - Change 'No effect.." from two answer choices to 'Remain in SI actuation configuration.' Also add references. Done R2 - Sat Page 21 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 22 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 41.7, 10 R0

1. Since this is Bank question from Callaway - make sure it has been updated to reflect site-specific alarms and nomenclature. Validated

2. Refs (ALRs) for C and D? What is level setpoint for each annuc.?

ALR 00-047D - 36% on 2/4 instruments ALR 00-047E - 99.8% OR 96.9% on 1/4 instruments

3. Explanation for B correct answer says 12% or lower but ALR says 11% or lower.

Step 12 of EMG ES-12, TRANSFER TO COLD LEG RECIRCULATION states to check RWST Level <12%, which would be less than or EQUAL to 11% and also E specifies Annunciator 00-047C, RWST LEVEL LOLO 2 - LIT as criteria to perform 38 F 2 B E Step 13. Updated Answer Explanation.

S 4. Do ALR 047C and ES-12 line-up? 047C Step 1 says check RWST level < 11%

and step 2 for RWST > 6%, then step 3 RNO to complete cold leg recirc as required by EMGs. However, ES-12, step 12b says check RWST level < 12% where the last bullet is the annunciator 047C. Which one is correct? EMG ES-12 is correct. Entry condition to ALR 047C is Less than or EQUAL to 11%. Step 1 should probably read Or Equal to as well. I discussed with Lou Brosch, Procedure Writer. He concurred and will update procedure.

5. Arrange answers short to long so correct answer becomes C (unless there was reason to list as is). Done R1 - Need to swap Answers B and C to make the order short to long. Add Step 12 in the stem since two of the distractors would be lit prior to the CS swapover. Done R2 - Sat Page 22 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 23 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 41.7 R0

1. How does question address K/A of manually operate and/or monitor in the control room if the fan auto starts? If monitored in the control room, how? Fan switches and running indication is located on the Main Control Board RL-020. See below and newly added reference 2.

E 2. Good OE tied to question.

39 F 2 N 3. Where is ref for auto start of A Cavity Cooling fan on loss of power to B fan?

S Added E-13GN04 as reference 2.

4. Do the Cavity Cooling fans have input and output breakers? The stem states but its output breaker trips and will NOT reset. Is this somehow communicating that a loss of power to B fan occurred? Not clear. There is not an input breaker. Output breaker is our standard vernacular. The word output could be deleted, but might confuse students. Recommend leaving as is. Left as is.

R1 - Sat C - 41.10 R0

1. Looking at a blank Attach A - if the answer is obtained by only recognizing that Required Action 2 is applicable, then this question is Unsat - direct lookup. Student must evaluate each parameter vs minimum and maximum allowed value. For a value outside of acceptable values, either action 1 or 2 is applicable. The student must comprehend value result and demonstrate use of surveillance form to ascertain correct answer. Since an evaluation must be performed, we do not consider this a direct lookup.

U 2. Explanations say pre suction and post suction while answers use static and dynamic. What is pre suction and post suction? Havent heard those terms 40 F 3 X N U Changed the answer explanation to match the answer choices.

S 3. Answers B and C give a reason the surveillance is UNSAT but include an action statement, while A and D only state the surveillance has failed for a reason. The correct answer is the only one with an action. Added and must be declared INOPERABLE to both answers Answer choices B and C (Distractors 1 & 3).

4. Provided ref is marginally valuable - contains generic info related to surveillance procedures (and isnt legible in some sections). Updated reference.

R1 - Would consider this question a LOD 1 due to the answer can be determined by a true false determination on the first part of each answer. Replaced with alternate question.

R2 - Sat Page 23 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 24 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B - 41.7 R0

1. What is the instrument tolerance for these valves? Even if + or - 1%, there could be more than one correct answer. An applicant would likely pull the last surveillance test performed on these valves to show that only 2 valves or up to 4 valves would E actually be open in the plant. Per STS MT-008, S/G SPRING LOADED SAFETY 41 F 2 N S VALVE SETTINGS, As-Left acceptance criteria must be within 1% of design lift set pressures on two consecutive tests. Added lift set tolerance to the list of items to ignore, along with blowdown and accumulation.

2. What is the value of Ref 2? Demonstrates which valves are affected and where they are in the system.

R1 - Sat C - 41.8 R0 U 1. C can be determined by eliminating all answers with #3. Deleted #3 from 42 F 2 X N S distractor 2. Need to add the word ONLY after B, C, and D. Added ONLY to correct answer and distractors 1 & 2.

R1 - Sat B - 41.5 R0

1. In stem, add in accordance with procedure OFN SB-008 after what E procedural action will the crew take in accordance with procedure OFN SB-008 to 43 H 3 M mitigate the failure? Added. Also split the answers into 1) and 2)

S

2. Second part of question - need OFN SB-008 as ref to validate the correct answer.

Is action taken a memory action? Added OFN SB-008 as Reference 2. Step B1 to take manual control of MFP speed is a memory action step.

R1 - Sat D - 41.7 44 F 2 M S R0 - Sat Page 24 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 25 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 41.7, 8 R0

1. First paragraph in Explanation - 1) states The B MDAFWP starting allows the signal but in stem, the B MDAFWP fails to start. 2) states When the B MD pump trips the D SG valve but in stem, the B MDAFWP fails to start. Corrected explanation, The pump start sends a signal to the MD Flow control valves, except for D. D will still close on high flow even though B MD AFP is not running. A will remain full open without corresponding pump running.

2. In stem, change question to read What is the status of the following MDAFWP discharge valves 1 minute after the reactor trip? Done, but changed to new format to E eliminate reference to 1 minute and specify No Operator Action taken.

45 H 3 N S 3. What is ref for which SGs are supplied by which MDAFWPs? The statement is made in the Explanation for answer D - Correct is A - BC and B - AD Added References 2 and 3

4. What is ref that states the TDAFWP will supply > 300 gpm to each SG? It is this amount of flow that closes the MDAFWP discharge valves, so the valves are NOT throttled Added Reference 3

5. What ref states that TDAFW flow will be > 300 gpm within 1 min after reactor trip?

Flow trend from desktop simulator below. Flow rise is immediate, well within a minute, but we changed the question to eliminate the reference to 1 minute by making it in reference to the time flow stabilizes. See also Reference 3.

R1 - Sat Page 25 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 26 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 41.7 R0

1. No refs for correct answer (and distractors) for NG04 - NK26 - NK04 (first three sources). MS Word Ref 1 shows NK04 - NN16 - NN04. Replaced, Entire flowpath is Ref 2 now

2. Since its possible for NN15 to supply NN01 and NN03, why is this not an acceptable power lineup per TS? Could applicant argue that an alternate lineup is acceptable even though TSs are required to be entered? See LCO 3.8.9 basis below. To eliminate any concern with inverter vs. bus operability determination, we modified the question to specify any technical specification action. The inverter would be inoperable with a cross train lineup.

E

3. It would be helpful if the explanations identified what was incorrect in each lineup.

46 H 3 N E Example: For D: NK01 feeds INV NN15 but supplies NN01, not NN03. Added better S explanations including comments on Ref 2.

4. Is Ref 2 for this question?? (OFN PK-029, LOSS OF NON VITAL 125 VDC BUS PK01) No, removed.

5. Is Ref 3 for this question?? (SY1506305, DC and Instrument Power Non-Class 1E, Section 0.2, LOSS OF PK01 DISTRIBUTION PANELS) No, removed.

6. There are two Q46 ref 1s (1 MS Word, 1 Adobe) Renamed

7. MS Word Ref 1 is marginally legible. Replaced, Ref 2 now R1 - Distractor C not a physically possible lineup, add refs. Changed distractor that was not a physically possible lineup to one that is physically possible but makes distribution system INOPERABLE per LCO 3.8.9. Also added references.

R2 - Sat Page 26 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 27 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 41.10 R0

1. STS KJ-011A says the overload test portion (6300 kW and 6821 kW) should be performed at the end of the 24 hr test, not 90 min into it. Also, it states Momentary transients, less than 30 seconds in duration, outside of the load range due to changing bus loads, will NOT invalidate this test. So would the conditions in the stem present a situation that would invalidate the surveillance? If this is true, then shouldnt the applicants be more aware than just Answer C? This question is not asking what is wrong with the surveillance it is asking about diesel load limits.

E 47 H 3 N Changed the stem to ask about the diesel.

S

2. What reference states that 4.25 kV is acceptable such that Answer A is not also correct? SYS KJ-123 states the upper limit on voltage is 4320 volts

3. Explanation for C says high load can cause overheating and insulation breakdown

- what ref is this from? Also, explanation says loading over 6.2-6.8 is limited to 2 hrs per procedure - is this the STS KJ-011A? Doesnt it state the lower limit is 6.3?

Corrected the value in the explanation. This is a skill of the craft item, any electrical system that is overloaded will shorten its life due to overheating the wire causing insulation breakdown over time and the wire will fail.

R1 - Sat B - 41.7 48 H 2 B S R0 - Sat B - 41.7, 8 R0 - Added ref. Specified in stem that plant is operating in summer. Improved E answer explanation to specify CTMT H2 mixing fans will be operating in Fast speed 49 F 2 N S to eliminate concern that there might be a second correct answer if CTMT H2 Mixing fans were running in SLOW speed.

R1 - Sat A - 41.7 50 H 2 B S R0 - Sat C - 41.11 R0 51 F 2 N E Reword Distractor A to state Check the ALERT alarm setpoint prior to performing a radioactive release. Done R1 - Sat Page 27 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 28 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 41.10 R0 If tripping the reactor subsequently trips the turbine, then Distractor C is partially correct. While Answer D is more correct, it cannot be argued that it is the only correct answer. If a turbine trip setpoint is reached, it is not wrong to ensure at some point 52 H 2 B S that the turbine is tripped. Need to reword C & D to be more specific. Almost all procedures at WC trip the reactor first. The turbine will not be tripped before the reactor at power level >50% (P9) because we dont want challenge the safety systems. Yes the turbine will trip at some time but not by the Operator unless a secondary failure were to occur. Even for a secondary failure with the BOP as the only Operator available in the control room, the reactor can be tripped using SB HS-42 prior to attempting to trip the turbine manually.

B - 41.7 53 H 3 B S R0 - Sat C - 41.7 R0 E Cannot have a 2 x 2 question with three different aspects as it makes distractors less 54 F 2 B S plausible. Simply ask the question as to which compressors are running and what the position of the PV-11 valve is. Done R1 - Sat C - 41.9, 10 R1 U 1. Distractor A is not credible given all the indications provided in the stem.

55 H 3 X N Distractor B is not credible. There is no plausible reason as to why an applicant S

might consider stopping fuel movement in the fuel building would be the correct answer for a containment integrity issue. Changed two distractors R2 - Sat Page 28 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 29 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 41.7 R0

1. All three distractors can be easily eliminated with basic knowledge of ECCS injection operation. All the applicant really needs to figure out is that the plant is tripped and SI is initiated.

Question demonstrates two knowledge bits:

1) that Reactor Trip and SI are required based on given conditions

2) ECCS injection lineup for high head injection is to all four loops.

E Distractor 1 (C) is plausible if 1) missed.

56 H 3 N S Distractor 2 (D) is plausible if 1) missed and student thinks starting a second CCP might be directed by OFN BB-007 to address the inability to maintain level with a single CCP.

Distractor 3 (B) is plausible if 2) not understood

2. Question stem creates potential confusion when applicants are told to assume operator action and asked what will happen in 5 minutes. Re-phrased question and eliminated reference to the 5 minutes.

3. Distractor B should be written to ensure that ONLY means loops 1&2 only, not ECCS mode only. Changed R1 - Sat B - 41.5, 7 R0 E Remove the and why? part of the question and delete the due to parts of each 57 H 3 N S answer, i.e. actual pressurizer level lowers. The reasoning as to why these actions do or do not occur should be developed by the applicant. Completed R1 - Sat A - 41.7 E R1 - How is the ability to monitor non-nuclear instrumentation being examined?

58 H 2 N Changed question in stem to better demonstrate ability. The temperature at which S the RCS stabilizes is non-nuclear instrumentation being monitored.

R2 - Sat Page 29 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 30 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B - 41.5, 7, 10 R1

1. Assessing plant conditions and then selecting a procedure or section of a procedure to mitigate, recover, or with which to proceed. (ES-401, Attach 2, Fig 2)

Revised question to which ONE of the following procedures will mitigate the Critical E Safety Function Condition with the HIGHEST priority Also changed distractor 3 from 59 H 3 N EMG E-1 to EMG FR-S2 to make all answer choices an EMG FR procedure. And S provided a containment pressure and IR SUR indications so that EMG FR-H1 and EMG FR-S2 are applicable but NOT the CSFSTs with the highest priority.

2. KA - is the 1200F a design limit or just entry condition into FR-C1? Performance of EMG FR-C1 will address the challenge to Core Cooling Critical Safety Function Status and attempt to prevent exceeding design limits.

R2 - Sat A - 41.10 R1

1. Distractors B & D are not credible. It is not plausible to believe that any applicant would consider using a non-borated water source prior to a borated water source to refill the SFP. OFN EC-046 directs using ANY of the three borated sources, there is not a listed priority so any of the other choices cannot be used as a distractor.

Choices are RWST, RHUT, or Rx Makeup per SYS BG-216. RNO for this step if NO Borated sources are available are to use Rx Makeup per SYS EC-200, ESW system, E or Fire Protection Water. Those distractors are plausible since OFN EC-046, step 15 60 F 3 N (and Attachment A, step A7) directs use of unborated sources if Borated Sources are S NOT available. However, changed the two distractors to the other plausible procedure driven emergency source, Fire Protection. Might be more plausible if student incorrectly thinks Fire Protection provides more volume flow for rapidly lowering level.

2. Prior to Which of the following areas, place, Per OFN EC-046, FUEL POOL COOLING AND CLEANUP MALFUNCTIONS to avoid any situation where another procedure might direct an evacuation of other areas. Added Per OFN EC-046.

Noun name of procedure is in the question stem.

R2 - Sat A - 41.11 61 H 2 B S R0 - Sat. Note - use of the if any in the stem isnt necessary if none of the answers include a no change option. Page 30 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 31 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 41.8 R0 - Distractor A could be argued to be considered a second correct answer. The flow restrictor does indeed restrict flow to the main turbine whether the majority of E flow is leaving via a steam line break or not. Added during full power operation to 62 F 2 N S the end of the distractor. This is wrong since one of the design features include -

minimum pressure loss across the nozzle during full power operation. Made this choice D to keep short to long answer choices.

R1 - Sat B - 41.5, 7 63 H 2 B S R0 - Sat C - 41.1 R0

1. What is the value of having the current boron conc in the stem? It lets the student know time in core life.

E 2. For C and D - what is normal dilution? Normal is in regards the flow path, but is 64 F 2 B S not needed. The student can assume normal if we did not specify alternate dilution. Removed normal from the two answer choices.

3. For D - is it plausible to have a parked position while at 35% power? Changed to Current position; which is still wrong.

R1 - Sat C - 41.7 R0 - The question asks which detector detects the presence of abnormal heat and E the correct answer is the only option with heat detector in its name. Reword to avoid 65 F 2 N S any potential cueing. Deleted the word Heat. Correct answer now reads Protectowire Linear Detector.

R1 - Sat A - 41.10 R1 - (same as Rev 0) Distractor A: EOP action steps never become optional, they are either applicable, not applicable, or superseded. Reword Distractor A to state E something to the effect of become secondary priorities upon entry into EMG FR-C1.

Modified Distractor and changed correct answer to A to keep shortest to longest 66 F 2 B E answer order.

S R2 - Edits to Distractor A Changed Distractor 1 again. 'secondary priorities' distractor is a subset of remains 'applicable distractor'. Changed to 'may be performed at CRS discretion...'

R3 - Sat Page 31 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 32 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 41.10 R0 - Need to be more specific on this question. It could be easily argued that RCS pressure of 2185 psig and lowering, PZR level at 91% and rising, or S/G level at 77%

E and rising would be reasonable reasons to have the crew trip the reactor. Ask the question in a way that examines distinct reactor trip requirements - either procedural 67 F 2 N E trip criteria or exceeding a protection system setting. Made question more specific by S asking which condition exceeded a reactor trip setpoint.

R1 - Change distractor to low S/G trip setpoint, instead of high P-14 setpoint and updated answer explanation. Also add references. Done R2 - Sat A - 41.10 R1 - Correct answer can be too easily identified with elementary nuclear plant operations knowledge. There is little chance that any applicant would consider any answer other than moving rods for a planned evolution as it is universally understood E that this does not happen without a peer check. Select a different reactivity 68 F 2 N E manipulation S Changed answer to an alternate reactivity manipulation since peer checks for control rod manipulations are universally understood.

R2 - Change answer to a different alternate reactivity manipulation; increase turbine loading instead of routine dilution for temperature control. Done R3 - Sat C - 41.10 R0 - Reword distractor B. Total S/G leakage could mean a number of different E issues, and therefore can be easily eliminated due to not being specific. Reword to 69 H 3 B S Combined primary to secondary leakage in A and B S/Gs or something to that effect. Reworded distractor B.

R1 - Sat Page 32 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 33 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 41.10 R0 -

1. How are A and B plausible for Part 1? Per the explanation, the only discriminatory knowledge is that NPIS is a computer point and not an annunciator?

Added causing a MCB Annunciator to actuate to the first sentence. This will make E pulling that annunciator card more plausible. Updated Answer explanation and 70 F 2 N referenced ALR 00-097C as an example of computer point generated MCB S Annunciator.

2. How are A and C plausible for Part 2? Is there ever a time where an OOS sticker is placed on the NPIS terminal? How many NPIS terminals are there in the CR?

Changed NPIS terminal to Affected MCB Annunciator. There are multiple NPIS terminals in the CR.

R1 - Sat Page 33 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 34 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B - 41.12 R0

1. Need ref for correct answer - what says admin limit is 2000 mR? Added reference for 2000 mr/year admin limit. This should be an E since no change to the question was needed to correct this issue.

2. Why is ref 1 provided? No calc uses Emergency Exposure limit. Added correct reference. The original question was during an emergency but after a discussion after looking at JPM overlap, we changed it to normal activities.

3. Distractor A is not supported by the explanation that 4000mR is allowed with approval. If the limit for this description is 4000mR then 4000 - 1400 = 2600/75 =

34.67 hours7.75463e-4 days <br />0.0186 hours <br />1.107804e-4 weeks <br />2.54935e-5 months <br />. There is not a distractor for 4000 as the mistake. The distractor is 2000 -

E 1400-225. This makes use of the extra information given in the stem so the only 71 H 2 B E mistake made is not just using the different limit numbers.

S 4. Explanation for D states the incorrect answer is also wrong. 5000-1400 = 3600/75

= 48 hours5.555556e-4 days <br />0.0133 hours <br />7.936508e-5 weeks <br />1.8264e-5 months <br />. (Explanation calculated 5000-1400=2600 but correct answer is 3600.)

Corrected

5. The stem does not state whether the year to date exposure was all at Wolf Creek or if the individual received some of it from another plant. The stem states the individual is a Wolf Creek employee and we dont send people to other sites often. Added all dose from Wolf Creek to the stem.

6. Explanation for C identifies procedure AP 25B-100 but its not included as a ref.

Added this reference R1 - Fix math error/typo in answer explanation. Modify question to eliminate one of the assumption parenthesis statements (to the nearest hour) Done R2 - Sat Page 34 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 35 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 41.12 R0

1. The stem is vague when asking for in the local area. Does this mean the local area of the valves being operated for the evolution? Ref 1 identifies that HP will need to discuss which rooms, systems and plant areas may be affected during a crud burst associated with the hydrogen peroxide addition. Focused stem to areas where personnel have access since this is what the KA is asking for.

2. Unsat - all of the distractors are not plausible due to applicant confusing what water is or is not contaminated. Distractor A is only plausible if the applicant thinks that youre blowing down the RCS side of the SG or there is a Tube Leak/Tube Rupture.

All are plausible. Strengthened the answer explanations to show this. If there is a tube leak this would raise dose rates but since the stem doesnt state one exists then it will not. Thats what makes it a good distractor. Makeup to the RMWST procedure E states that contamination levels could increase in the area of venting however the E distractor states makeup not vent. This precaution makes this distractor plausible.

72 F 2 N Batching boric acid is plausible since you have to understand how to batch, what water E to use, where it goes, and so on. This takes place in the aux building so that helps to S support this possible conclusion. The water used in this evolution is reactor makeup water which once again has the note for potential contamination. All are plausible.

3. For answer D, why is (TBL01, RMWST) added? Added because questions during validation showed this needed to be defined better. Changed distractor to write out reactor makeup water storage tank.

4. Ref for question is SYS EJ-110A? Question was revised and this reference was not corrected, fixed.

5. Knowledge of the crud burst as a result of a hydrogen peroxide add is good knowledge to test but better distractors or didnt approach is required. See above R1 - Change distractor 1 from SG Blowdown to bypassing RCS filter for a better plausible, but wrong answer choice. Done R2 - Update answer explanation for 11/4 comment change. Done R3 - Sat Page 35 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 36 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B - 41.10 R0 This is an SRO-only question due to the RO being required to know transition points in EMG F-0 which would direct the entry into subsequent functional restoration procedures. NUREG 1021 ES 401, Attachment 2 (Clarification Guidance for SRO-only Questions),page 22, big block, 3rd bullet states that if the question requires knowledge of diagnostic steps and decision points in the EOPs that involve transitions to event specific sub-procedures or emergency contingency procedure then it is determined to U be an SRO-only question. No, this is a question on a DIRECT entry into a red path based on indications given from F-0. ROs are required to know entry conditions to red 73 F 2 X X X N U and orange paths. This question does not ask if the student knows what procedure S they are in currently, it asks for given these indications which CSF is the highest priority. This knowledge is found in AP 15C-003 and is RO knowledge. Made format changes as requested.

R1 This is not a Tier 3 generic plant knowledge question. See ES-401, D.2.a (page 6).

Ensure that the questions selected for Tier 3 maintain their focus on plant-wide generic knowledge and abilities and do not become an extension of Tier 2, Plant Systems. Replace question (same K/A) Replaced with new question, same K/A R2 - Sat B - 41.10 R0 This is not a Tier 3 question. The question is specific to the operation of the RHR system. See ES-401, D.2.a (page 6). Ensure that the questions selected for Tier 3 maintain their focus on plant-wide generic knowledge and abilities and do not become an extension of Tier 2, Plant Systems. The applicable K/A is 2.4.9. Emergency U procedures - Knowledge of low power/shutdown implication in accident (e.g., loss of U coolant accident or loss of Residual Heat Removal) mitigation strategies. To eliminate 74 F 3 X N the notion that the question was an extension of Tier 2, Plant Systems, changed the S

question to closer match the K/A wording and made the answer choices (distractors) more generic and not procedure/system knowledge based by removing specific valve numbers.

R1 Still Unsat. Eliminate specific plant conditions, change distractor to reduce RHR flow.

Done R2 - Sat Page 36 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 37 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B - 41.10 R0

1. For the correct answer - does terminating the event always mean that the emergency class is terminated? Changed correct answer to Terminating the emergency classification.

2. Answer C justification is that this is done per procedure but the answer just says stopping the pump. If stopping ECCS pumps results in a degradation of plant safety or is indicative of worsening conditions, then it would be required to be reported. Added E due to a small break LCOA in Containment to the initial statement. Student can now 75 F 3 N demonstrate understanding of procedure knowledge in EMG ES-11, POST LOCA S

COOLDOWN AND DEPRESSURIZATION, beginning at step 21 to sequentially stop ECCS pumps if plant conditions support. This procedure has foldout page action to restart ECCS pumps as necessary to maintain subcooling or pzr level; which would be indicative of worsening conditions and the required report to NRC

3. Answer D - if a SGTR is the cause of the event, would this still not be required to be reported even though its lifting at setpoint (initiating of offsite release)? Added due to a small break LOCA in Containment to the initial statement. This ensures S/G ARV lifting is not a second correct answer.

R1 - Sat Page 37 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 38 Rev 8 Form ES-401-9 SRO-Only

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 43.5 R0

1. With the handout provided, the applicant can see SI initiation is not part of the decision criteria for EAL-4 (MSLB1 is Faulted SG) for Distracters A and C. That is not the point of the question. A steam line fault will cause SI to actuate even though the tree doesnt ask for it. The tree is looking for very specific items but other items can be present and not asked for.

2. Distracter B can be eliminated by looking at the EAL-3 flow chart and seeing that no decision is made on the chart without knowing SI initiation status AND some data about RCS leakage. Knowing that an SI has actuated doesnt eliminate this tree.

The tree doesnt ask for if it has or not it is looking for other items. This is a mistake E that has been made in requal and training as well.

76 H 3 N E 3. This question can be answered correctly by looking at what is said and what isnt S on the EAL flow charts only, not based on ability to discern what the event is. The SI is NOT key to NOT using EAL-4 it is just not asked for. If an SI were present but the other indications were you would still use this tree.

4. Indications include an SI occurs - this must be associated with a Reactor Trip so Power would not be able to be stable. Moved this item up, this will intended to be a time line setup so power was stable to start with so the student would not think the changes were from a power change.

5. Need to identify what the Handout is in the Comments - not just saying one is provided. This includes page numbers if only part of the 37 page form is intended to be handed out. Added page numbers to the handout statement R1 - Remove Handout. Rework question Done R2 - Sat Page 38 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 39 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B - 43.5 R0

1. While the initial conditions would provide entry conditions for procedures in answers B and C, entry conditions for A and D are not evident or credible. Per entry conditions into the distractors these are credible since the entry condition has been met. The choice is which is the highest priority of the all the procedure entry conditions that are met.

2. To ensure that B is the only correct answer, there needs to be a reason why C has a lower priority than B. Maybe a Conduct of Operations expectation that one is address above another for a given reason. OFN BB-031 step 1 tells you if you have entered it and accumulator isolations are closed and you are in mode 3 or 4 then go E to OFN EJ-015.

E OFN EG-004 provides actions to restore CCW. If both B train CCW pumps are 77 H 3 B E damaged by fire, they cannot be placed in service. The foldout page directs placing the B RHR pump in PTL if neither pump can be placed in service. Because the A E RHR pump is also unavailable, a loss of RHR cooling is the higher priority.

S 3. If entry conditions to CCW System Malfunctions are not met, and therefore it would not be entered in this situation, then there is no issue of priority as stated in the stem. Entry conditions are met since the with a loss of all B train pumps (which is the one cooling now) then multiple alarms will be received in the control room

4. Should include ref materials for distractors, so in this question, the page of each distractor procedure, Section 2, SYMPTOMS OR ENTRY CONDITIONS. Added other procedures and highlighted the entry conditions so you can see they are met.

R1 - Research ref for priority of B higher than C, revise explanations Done R2 - replace question Done R3 - Add Wolf Creek OE and refs Done R4 - Sat B - 43.2 R0

1. In stem, change base to basis Changed E 2. In each answer, use the symbol for micro µ instead of u Changed 78 F 3 N S 3. Explanation for A could be more accurate - SGTR or SLB, offsite and Control Room doses Added

4. Add and Bases to the Reference Added R1 - Sat Page 39 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 40 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 43.2, 5 R1

1. The explanation for the correct answer, A, doesnt address the first part of the question (what procedure should be used). Added

2. Reference(s) for inverter operations, ac and dc buses would be helpful for examiner review. Unable to verify statement on the bypass transformer via the static switch. This statement appears to be critical to the correct answer as it identifies the power source to NN15 as NG01. The best documentation for this is the OFN. The E drawing at the end of the OFN has some info and the main overall drawing has the 79 H 3 N ins and outs of the inverter.

S

3. The TS and Bases refer to the inverter being OPERABLE, not the DC bus. Is it correct to ask for operability of NN03 or should it ask if NN15 is operable? The NOTE in OFN NN-021 refers to NN03 being operable - is this consistent? Changed question to ask NN15 operability. The statement in the OFN is inconsistent with TS and this has been reported to the correct individual.

4. Ref 1 doesnt include the pages that identify entry conditions or how to get to Attach I. It also doesnt include the steps in Attach I that line up NN15 from NG01 -

just includes step I.6.6 that doesnt mention NG01. Added additional pages R2 - Sat B - 43.5 R1

1. Stem asked for event in progress and action but all answers only include action.

Changed question to only ask for actions per the procedure since individual procedure steps are SRO only knowledge.

2. If unique events are identified like Rev 0, this is a two part question with unique Part 1 answers. No discriminatory value added to Part 2. That is why the event was not listed in the answer and distractors. The SRO part is what procedure steps would E the crew take and since I did not include what procedure the crew is in this makes it 80 H 3 N E even more SRO.

S 3. How is this SRO-only? Is system level knowledge all that is needed to answer this question since Part 1 is implied and unique? Also, doesnt identify specific procedure number. See above

4. Why is RCP MALFUNCTIONS included as a reference (ref 2)? Deleted reference R2 - Concerns of #2 and 3 still exist. Changed question to state what action the CRS would direct to make SRO only specific question and added applicable procedure to all four answer choices. Capitalized proper name words to follow procedure writers guide.

R3 - Sat Page 40 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 41 Rev 8 Form ES-401-9 C - 43.2 R0

1. Ref 2, OFN AF-025, doesnt include page for entry conditions. Added to reference.

2. What procedure directs splitting switchyard into East/West? Add to stem? This is performed by the TSO and not Wolf Creek so we dont have a procedure.

3. Ref 3, SY1406401 Revision 018, Emergency Diesel Generator System (Electrical), states the degraded voltage timer is below approximately 90% so is 3740 volts close enough to ensure the timer will actuate the bus isolation? Concern is that applicant might argue that A is also correct answer. Is there a surveillance procedure that checks the timer? Changed this value to 3536 (85%) to ensure it is met but not as low as the undervoltage which is 70% of normal (4160 VAC). There is no surveillance for the timer the degraded voltage will start the timer.

4. Ref 2, OFN AF-025, step 9 isnt applicable since stem implies that TSO reported grid instability. Step 9 RNO is to go to step 11. Step 11 is yes, then step 12 is Attach E. Correct, that is the flow path to Attachment E.

5. TS 3.8.1 and bases are required for Part 2 of stem - they should be included as references to question. Added these to the references

6. Is TSO required to follow WC procedures? OFN AF-025, NOTE before step 9, E The TSO will notify the Control Room within two hours upon the loss of the ability to 81 H 3 N E assess the operation of the electrical system relative to predictive or actual voltage.

No they are not. They have procedures that require them to notify us of various S things but we dont have their procedures. This is not a loss of ability to assess items this is a degraded voltage condition.

7. Per TS 3.8.1 Bases, the EDGs are considered onsite standby power sources - the first paragraph under Explanation discusses that a running EDG isnt considered inoperable, but Part 2 of all answers identify only OFFSITE circuits. Yes the question asks if the EDG is running based on the length of time the degraded voltage condition has existed and the answer is yes it will be loaded on the bus and the NB will be isolated from the switchyard. The second part of the answers is asking if the offsite circuit is operable not the EDG. Deleted this statement from the explanation

8. For A and C, part 2 of answers is All offsite circuits are OPERABLE. How many offsite circuits are there? Is this statement plausible? This would be the SRO-only part of the question. Changed distractors to be more plausible. With the situation given and one EDG running its more plausible to have both circuits inoperable than to have both operable. We have 2 offsite circuits, one to each safeguards buses.

We have 3 lines feeding the switchyard (345 volt lines). Dont get offsite circuit and offsite power supplies confused.

R1 - Add LCO 3.8.1 to Ref Block. Add VAC to stem after 3536. Done R2 - Sat Page 41 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 42 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 43.2 R0

1. Add to stem what actions are required in accordance with procedure xx?

Changed the answer to show procedure reference. The original answer was based on TS so changed to base on OFN

2. Explanation doesnt say WHY either part is correct. For Part 2: If TS gives 48 hrs to initiate action to insert rods, why is this a correct action now? Could applicants argue there isnt a correct answer? Would Ops continue with startup and initiate troubleshooting on S32B, using the 48 hr window? Changed answer to eliminate this issue. Ops would not continue.

3. 2 SRNIs also required in Mode 2 (below P-6)? Explanation only says Modes 3, 4,

5. Deleted this statement in the explanation since this is now a procedure question E and not a TS question.

E 4. For Part 1: In determining OPERABLE/INOP, is there a better ref than STS CR-001? TS Bases? Surveillance procedure? Is there guidance that says if they differ by E

more than 1 decade, its always the higher reading instrument thats INOP? No but 82 H 3 M N/A its not the high one. With three detectors agreeing with each other the one that is E not in alignment is broke. The guidance is the channel check.

E 5. For answers A and B, part 2: Is Required Action K.2.2 Place the Rod Control System in a condition incapable of rod withdrawal, the same as open reactor trip S

breakers? There are required actions within TS 3.3.1 that say Open reactor trip breakers (RTBs) so it seems to imply they are different actions. Removed this part of the question. There is more than one way to make rod control incapable of withdraw.

R1 - Concerns above still exist. Revised explanations R2 - Concerns still exist with question/answers - replace question. Replacement question developed R3 - Backup question not needed. Decision to use actual plant start up data instead.

Rev 3 not used. Submitted Rev 4 with actual plant data R4 - Update K/A information to original version Done R5 - Update Comments block for Mod Bank, refs Done R6 - Sat Page 42 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 43 Rev 8 Form ES-401-9 B - 43.1, 5 HANDOUT R1

1. Ensure handout doesnt provide any cue to any other question in RO/SRO exam.

Does not Correct Classification Path:

2. How does applicant answer yes to SGTF1 (SG tube leakage > 150 GPD)? What is the reference? Added the bases for the status tree to answer this.

3. How does applicant answer yes to SGTF2 (Failed fuel)? What is the reference?

Added the bases for the status tree to answer this.

4. How does applicant answer yes to SGTF3 (SGTR > than capacity of one CCP)?

What is the reference? Added the bases for the status tree to answer this.

5. How does the applicant answer Yes to SGTF6 (Faulted SG inside CTMT cannot be stopped until blown dry)? I dont see anything specifically for this in the stem.

What ref describes any auto isolation of MSIVs? EMG E-2, Faulted SG isolation will have the crew isolate the MSIVs, step 1. There are no valves between MSIVs and the SG so any faulted SG will blow down into containment.

6. How does the applicant answer Yes to SGTF7 (CTMT integrity)? What is the reference for Containment Mini Purge Exhaust Isolation Outlet Dampers auto closing on receipt of CPIS? Added ref 3 to the question. Added the bases for the status tree to answer this.

E 83 H 3 M 7. How does the applicant answer No to SGTF8 (GT RE 59/60)? I dont see S anything in the stem. Is a No answer to SGTF8 consistent with a Yes answer to SGTF2 (Failed fuel)? Is there any reference to support the correct answer? No.

Since the stem was silent on the status of GT RE 59/60 per the rules of test taking they are not in alarm (I didnt say it was broke so it is fine). Failed fuel is indicated by the red path for H-1 per the stem (no AFW).

Distractor Path:

8. The Explanations for incorrect classification for C and D: is it trying to say the applicant gets to GE by answering Yes at SGTF5 (ruptured and faulted)? Yes, since there is a faulted SG and a ruptured SG a plausible distractor could be they mistake them as the same SG.

Part 2 of Answer

9. What reference links CTMT PURGE ISO SYS status lights to Containment Mini Purge Exhaust Isolation Outlet Dampers and SA066-X and Y? (I couldnt find SA066-X or Y on the drawing and the highlighted portions of the drawing dont identify the dampers other than ZS0011/0012) Added picture SY1301301

10. What is reference for statement in Explanations B and C for incorrect Part 2 that these lights (Header for CTMT ISO SYS PHASE A) come on to show [CISA] isolation was successful? For this to be plausible, the applicant must think that Mini Purge dampers are part of CISA, not CPIS - correct? Yes SY1301301 R2 - Sat Page 43 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 44 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 43.5 84 H 3 N S R0 - Sat C - 43.5 HANDOUT R0 - Question is not written at the SRO level. Question can be answered using knowledge of entry conditions for major Red/Orange Functional Restoration Procedures. Modified question to ask from a CRS perspective. There are three factors that must be considered when evaluating level of question.

1. Student must realize Adverse CTMT values exist. Without this knowledge bit, entry to EMG FR-Z2 will not be recognized.

U

2. Student must assess four CTMT values and determine which procedures are U

85 H 3 X N applicable. Assess plant conditions and then select a procedure or section of a E procedure to mitigate, recover, or with witch to proceed.

S 3. Student must recognize more than one procedure entry conditions are met and apply knowledge of administrative procedures (EMG F-0) that specify hierarchy, implementation, and/or coordination of plant normal, abnormal, and emergency procedures.

R1 - Concern still exists Revised question R2 - Minor edit. Done R3 - Sat D - 43.2 R0

1. Develop a first half of the question that does not involve a direct lookup using a E straightforward flow limit chart. Submitted new question that removed graph.

86 F 3 N E 2. Is it necessary to change the pressures for each distractor? It would be better to S pick one set of pressures and have the applicant evaluate the situation in some way that does not involve a direct lookup. Submitted new question.

R1 - New question, removed Handout. Minor edits to stem Done R2 - Sat C - 43.1 R1

1. Stem should state to whom the report is made. Added NRC E

87 F 3 N 2. Could pull the Wolf Creek out of all answers and put in the stem. ( 4 hours4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br /> is S

Wolf Creek __________?) Moved to stem

3. Put question number and revision in the worksheet. Added R2 - Sat Page 44 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 45 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 43.5 R1

1. What is RWST level when LOLO1 and LOLO2 alarms come in? Reference?

ALR 00-047D LOLO1 - 2/4 level channels 36%, added as reference 2 ALR 00-047C LOLO2 - 1/4 level channels 11%, added as reference 3 E 2. Stem bullet that crew has completed ES-12, so Step 23 says Return To Procedure 88 H 4 N E And Step In Effect would put crew back in E-1, correct? So what procedure guidance is used when both RHR pumps have fluctuating flow and amps while in E-1?

S Deleted the bullet that EMG ES-12 was complete and added steps 1-11 were complete to the bullet prior. This is where the crew would be waiting for Annunciator 047C, RWST LVEL LOLO 2 to actuate.

3. Put question number and revision in the worksheet. Added R2 - Edits to stem - add bullet. Added 'A short time later' to stem bullet R3 - Sat Page 45 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 46 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 43.5 R0

1. Question is not written at the SRO level. Question can be answered using knowledge of entry conditions for major EOPs and general knowledge of the overall sequence of events. No, the second part is SRO only per 55.43 b.5. The student must know and understand specific procedure steps to answer this question and the correct transition. The understanding of E-2 to the end and then the decision point to determine what procedure to transition to next (in this case E-1) based on indications makes this SRO.

2. Distractors become not credible and LOD drops when you add a third question to the standard 2 x 2 approach as it provides the applicant with more opportunities to identify a reason to eliminate a distractor. Additionally, the third question has a two-U part answer, therefore providing yet another opportunity to rule out a distractor. The 2 x 2 questions only work when two questions with 2 answers are used. In this case, 89 H 3 X X M E the applicant can correctly answer the question with any 2 of the 4 pieces of S information. Changed question to a 2X2

3. The question analysis seems to state that ECCS flow would be reduced as part of the last step in E-2, however the correct answer states otherwise. Please clarify. No, per the last step in E-2 ECCS flow must remain since RCS pressure is still lowering and PZR level is not high enough. Changed the answer from weather ECCS flow should be reduced to which procedure will the crew transition to since this question is more straight forward and the same concept is used, should ECCS flow be reduced.

Updated reference 2 to show these items as well. This question should be an E since ES-401 Attachment 2 E was used as the SRO only part, procedure transitions that are NOT direct entry conditions to major EOPs, this is a transition not a direct entry.

R1 - move in Containment from all answers to stem, change crew to SRO direct R2 - Sat Page 46 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 47 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 43.2 R0

1. LOD for Part 1 is barely a 2. Easy to reduce choices to 50-50 with basic RO level knowledge and two correct answers (A & D). Modified the frequency distractors to raise U

2. There are two files named Q90 ref 2 rev 0. Deleted the word document Q90 ref 2 E rev 0, OFN NB-030. OFN NB-042 is the applicable procedure when paralleled.

90 H 3 X N E R1 - Difficulty concern still exists. Changed frequency to governor speed.

S Procedure step 6.4.2 adjusts governor speed for proper synchroscope rotation speed. Added sync scope to stem.

R2 - Match action with procedure guidance. Changed governor speed back to frequency. Frequency is changed by adjusting governor. Added switch numbers to both voltage and frequency choices.

R3 - Sat A - 43.2 R0

1. In stem: What is Data A failure 1,2,3 AND GW mean? Reference? Power loss to RPIS as per the KA

2. Part 2 of the A2 K/A is based on those predictions use procedures to correct, E

control or mitigate the consequences How is this part of K/A met? Modified 91 H 2 N E answers to ask about the failure but then asked about actions the crew would take S based on the failure. The correct answer is per TS the wrong answer is shutdown per OFN.

R1 - changes to Part 2 of answers not acceptable. Will consider TS to be considered for procedures used. Restored question to original version. Specified MCB annunciator in stem, separated answers.

R2 - Sat B - 43.5 R0 - If the malfunction of the FPS is the Halon NOT activating, what is the Part 2 of the K/A to use procedures to correct, control or mitigate this malfunction? The U procedure used in the answer isnt a result of the malfunction, nor is the prediction of 92 H 3 X N E the impact (event classification). Changed the question to predict the impacts of Halon not actuating as part 1 and made the appropriate procedure to mitigate the S

event part 2. Removed all reference to the classification from the question.

R1 - Update Explanations and refs. Done R2 - Sat Page 47 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 48 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 43.7 93 H 3 N S R0 - Sat B - 43.2 R0 (2.1.32)

Need to delete secondary side and pick another safety related function as the second half of distractors B & D. It would be difficult to believe that any applicant would select a secondary plant design limit for a DBA EDG support function when fuel/containment is the other choice. Need to look in the design limit bases in Sections 3.2, 3.4 and 3.6, breakdown the high level fuel and containment design limits into more specific limits, and then select more challenging distractors (parameters that are potentially believable as a primary design limit but are not officially called out in TS bases). These are the only distractors that even make U sense. The SG secondary side would affect containment (which is listed as a system U being protected) and therefor the connection could be made that the EDG supplies E power to AFW which would feed a break if not isolated. SFP is plausible with the 94 F 3 X B items of Fukushima failing and causing more problems. These distractors are E plausible for reasons that the EDG supplies power to systems that support the overall E boundary that is being challenged. While the suggested TS bases to look at for the S support systems do discuss items that support the design limits making this leap would cause this question to be LOD 5 since they are not directly listed in the EDG TS basis. Deleted the first part of the question as it did not answer the KA and made the second part into a true 2X2.

R1 (2.1.32) - Not Tier 3 question (Unsat) Replace KA Done R2 (2.1.23) - Overlap with another question, replace K/A. Done R3 (2.1.2) - New question, new K/A. Revise stem and answers for consistency Done R4 - change action to immediate action in stem to match procedure guidance Done R5 - Sat D - 43.7 R0

1. Stem should be cleaned-up to improve readability, i.e. and/or in place of and or and has arisen instead of has arose. Done 95 F 2 N E 2. Use bullets to separate initial conditions and simplify the wording. Done

3. Reword the stem to state Refueling machine operation in Bypass mode is desired to ensure that you do not predict the answer by stating that bypass mode will be required. Done R1 - Sat Page 48 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 49 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 43.5, 6 R0

1. Is there no other procedure, i.e. general work control/pre-job brief guidelines that would include the requirements listed in distractors A & B? There appears to be a high risk for multiple correct answers. If the question is intended to only consider the guidance in the IPTE procedure. Enhanced stem to state the number and title of the procedure that requires this brief. This question was focused on the reference provided and was stated in the original stem which eliminates the more than one correct answer issue identified by the NRC. The stem was only changed to state the procedure number since the title was already in the older version.

2. LOD-1: The correct answer is easy to determine when compared to the distractors. Distractors A & B cover routine aspects of coordinating actions in the field for any evolution. Only answer C covers an aspect unique to infrequent evolutions. LOD 2 The question is asking what must be discussed per AI 15C-006 and all the other items listed here are covered in other types of briefings. The key here is that the AI procedure requires a minimum number of items be discussed that E may or may not be the same as other briefs. This makes a detailed understanding of 96 F 2 M E this procedure important to determining the correct answer. EPF 06-001-02 has S contact information required. This has been added to references as #3. Changed distractor about breaks to log dose received. Added EPF 06-001-05 as reference

1. 4 to show logging of dose for this type of brief. These items are plausible so only one correct answer. Only changed one distractor so I could show the forms indicate what must be discussed. Breaks are discussed for long jobs but the documentation of this is not written anywhere so this change made the distractor more plausible.

3. Distractor D is not credible. Completing any nuclear evolution, especially infrequently performed evolutions, will never be briefed with the need to complete them as quickly as possible. EMG ES-12: Steps 1 through 10 and step 13, if applicable, shall be performed without delay. This could be interpreted to mean as quickly as possible. Time Critical JPMs could also be interpreted to mean perform as quickly as possible. The plant has performed RTD cross-calibrations in the past that required collecting data as quickly as possible, to preclude the effects of RCS temperature drift over time. Changed this distractor to read performed without delay to match other procedure steps that state this.

R1 - minor edit Done R2 - Sat Page 49 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 50 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 43.5 R0 - If all of these procedures have some level of applicability in this situation, as it appears they do, then this question has multiple correct answers. The question asks, what procedure would be used? After reading the distractor analyses, it appears that arguments can be made that each of these procedures may be referenced or used while managing the additional scope, i.e. a new work order to address the U additional scope will follow the requirements of AP 16C-006, MPAC WORK 97 F 3 X B E REQUEST / WORK ORDER PROCESS CONTROLS, therefore the procedure will be used. Need to clarify the question to prevent multiple correct answers. Changed S

stem to ask for which procedure governs Ops actions when employing compensatory measures resulting from scope growth. This limits the answers to the single procedure.

R1 - change contingency to compensatory measures in first paragraph and delete

'additional' from question. Update Answer Explanations. Done R2 - Sat C - 43.4 98 F 2 B S R0 - Sat D - 43.5 R1

1. SRO level: question does not meet SRO-only guidance. Question can be answered using knowledge of entry conditions for major EOPs and AOPs and general knowledge of the overall sequence of events.

2. Distractors A: Distractor A is not credible as there is no plausible reason to believe U that an SI is required - the distractor analysis states, Plausible if the student assumes other things are broke outside of what the stem states. This statement U confirms that the distractor is not credible as applicants are directed to not assume 99 F 3 X X B E anything.

E 3. Distractor C: Distractor C is not credible. It is not plausible to believe that the S entire crew would be expected to cease implementation of an EOP in order to transition to an OFN to perform emergency boration.

4. Put question number and revision in the worksheet.

R2 - Not Tier 3 question, unsat R3 - New question, same K/A. Edits to stem, answers and explanations required.

R4 - revise explanations R5 - Sat Page 50 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 51 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 43.1 R0

1. Question format should be improved. Use bullets and past tense for stem conditions, i.e. Crew Immediate Actions have been performed. Ensure the proper terminology for equipment and technical functions.

2. SRO level: question does not meet SRO-only guidance. Question can be answered using knowledge of entry conditions for major EOPs and general knowledge of the overall sequence of events.

U

3. Cueing/Distractors: By stating in the stem when an SI occurs, this cues the U applicant that the basis for the action (the second half of the question) is related to 100 F 2 X X X B E the SI. It would be best to establish some initial conditions that would require an SI and have the applicant determine that an SI has occurred. Due to the cueing, the two S

distractors related to 30 gpm boration flow are not credible. Add noun name for E-0 to distractors C & D. Improve wording consistency in distractors C & D, i.e. continue with the EMG FR-S1 versus continue with EMG FR-S1 and This is and This action is.

R1 - not Tier 3 question, unsat R2 - New question, new K/A. Delete first paragraph of stem, minor edits to distractors B, C.

R3 - Sat Page 51 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 52 Rev 8 Form ES-401-9 B = 20 F = 33 E = 54 RO TOTALS: M= 6 H = 42 U = 11 Additional Notes:

N = 49 S = 10 B=6 F = 10 E = 14 SRO TOTALS: M= 4 H = 15 U= 8 Additional Notes:

N = 15 S=3

GENERAL COMMENT

S:

1. Bank questions are indicated by B; Modified are indicated by M; New questions are indicated by N

2. Chief Examiner comments are indicated in black on E or S questions and in red for U questions. Licensee responses are in blue for E questions and in blue for U questions.

3. Average Level of Difficulty is __ 2.4_ on the RO exam and 2.84 on the SRO exam.

4. The 10CFR55.41/43 distribution is: RO / SRO 41.1 = x 43.1 = x 41.2 = x 43.2 = x 41.3 = x 43.3 =

41.4 = 43.4 = x 41.5 = x 43.5 = x 41.6 = 43.6 = x 41.7 = x 43.7 = x 41.8 = x 41.9 = x 41.10 = x 41.11 = x 41.12 = x 41.13 =

41.14 = x

5. The answer distribution is: RO / SRO A = 18 (24%) / 5 (20%)

B = 19 (25.3%) / 6 (24%)

C = 22 (29.3%) / 7 (28%)

D = 16 (21.3%) / 7 (28%)

6. There is 1 RO question (Q26) with an attachment provided.

7. There are 2 SRO questions (Q83, 85) with attachments provided. Page 52 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 53 Rev 8 Form ES-401-9 Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 B 5 (easy B difficult) rating scale (questions in the 2 B 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

$ The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

$ The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

$ The answer choices are a collection of unrelated true/false statements.

$ The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

$ One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

$ The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

$ The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

$ The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

$ The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7. Based on the reviewer=s judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any AU@ ratings (e.g., how the Appendix B psychometric attributes are not being met).

Generic Comments:

1. Having 2nd part of answer doesnt add any discriminatory value since the 1st part of each answer is unique.

2. In all question stems, do not capitalize the word ONE - instead, use one. For example, Which one of the following not Which ONE of the following Include in your Exam Writers Guide if you have one.

3. Consider using the same format for 2 part answers (see Q16 for the format, then Q17 as not the same). Put in Exam Writers Guide.

4. For 2 part answers, make sure Explanations address both parts, even if one part is correct.

5. Use of simulator to prove/disprove plant conditions must be done carefully - usually the last choice if no other ref can be identified. Page 53 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 Written Examination Review Worksheet Form ES-401-9 Rev 8

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 41.10 R1

1. Correct answer is only correct in conditions where there is a spurious or unnecessary Safety Injection. Revised question U 2. Answer A is also correct if SI is spurious. Revised question

3. More correct purpose of step is to determine validity of SI signal, not allowing 1 F 2 X X N E more time to prevent solid condition. Re-work question to this end. Revised question R2 S 1. Change the question to a one part and with initial stem information Revised question

2. Determine the reason for the actions taken in EMG E-0, Step 5, given the above conditions. Revised question R3 - Sat B - 41.14 E R0 2 H 2 B S 1. Minor edits in stem Fixed R1 - Sat C - 41.7 R0

1. Distractor C not credible since stem identifies pressure is lowering. Take this out of stem. Done E

3 H 3 N 2. Nomenclature for PZR Master Pressure Controller Selector Switch not correct in S

stem. Fixed

3. Refs dont show correlation between PORVs and block valves Noted for future exams R1 - Sat Page 1 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 2 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B - 41.10, Handout R2

1. Having 2nd part of answer doesnt add any discriminatory value since the 1st part of each answer is unique. Generic Comment. The two parts are used to show the student reviewed all the data and determined which pump parameter has exceeded the limit and on which pump. The second part answers the KA by having the student use the given plant computer printout to determine component status. The first part could be deleted but then the answers dont complete the whole picture for the asked question.

2. Ref 2 needs Attach B, Step B1 since the FOP states IF any of the following occurs, THEN immediately go to Attachment B, Step B1: Added this step to this ref.

3. Per Attach B, Reactor trip is ONLY required if Rx power > 48%. No initial power level given in the stem - could argue there isnt any correct answer. Added power level E 4. For C - provide value for Controlled RCP shutdown in the explanation. I didnt see a value for Number 1 Seal Injection Temperature - without knowing this value, E

4 H 2 N its not possible to determine if a controlled RCP shutdown is warranted per FOP #3.

S Added controlled shutdown values to the answer explanation. Added a screen shot of NPIS CVCS which includes a value for VCT temperature which is what seal injection temperature will be.

5. The use of the word shutdown is confusing - there is a difference between controlled plant shutdown and controlled RCP shutdown. Attach C is used for controlled RCP shutdown, not the plant. Added RCP to the phrase controlled RCP shutdown

6. The term too high is subjective. Suggest using exceeds the limit or above shutdown criteria Changed to has exceeded the limit

7. Suggest using stop the RCP instead of trip to match wording in procedure.

Changed to stop

8. Suggest Using the attached NPIS indication, which of the following identifies the required crew response per OFN BB-005, RCP Malfunctions? Done R3 - Need to change Answer D to RCP motor bearing instead of thrust bearing to match the foldout page and consistent with Answer B. Done R4 - Sat Page 2 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 3 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 41.7 R0

1. The 3rd part of each answer has no discriminatory value since question can be U identified knowing only parts 1 and 2 (which is a 2x2 format). Revised to 2x2 5 F 2 X X N E 2. Answers A and B are not credible since it is fundamental knowledge that RCS S press/temp will not LOWER with loss of RHR cooling. Revised to 2x2

3. What is setpoint of RHR discharge relief valve? 600 psig R1 - Need to remove the lower/rise from the justifications. Fixed R2 - Sat D - 41.10 R0 1, Add procedure number and title to stem: Per OFN EG-004, CCW System E Malfunctions, the operators will fixed 6 F 3 N E 2. Suggest A to read isolate service loop, trip the reactor, trip RCPs. This matches S SERVICE LOOP CCW PUMP TRIP CRITERIA actions. Then answer B can be actions for LOSS OF CCW TO SAFETY LOOP PUMP TRIP CRITERIA. fixed R1 - Edits Done R2 - Sat B - 41.14 7 H 2 N S R0 - Sat Page 3 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 4 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B - 41.10 R0

1. The explanation for the correct answer is not adequate. The description should include what happens (or is supposed to happen) after each of the two HSs are actuated. How does each of the two HSs accomplish the Rx trip - signals sent to open the Rx trip breakers and/or bypass breakers? Are there any mechanical breaker actuations? Added more information to the correct answer reason to answer these questions.

2. What is the reference for the correct answer? What defines the normal breaker lineup? (recommend using breaker lineup rather than plant) Procedure E-0 is not adequate to determine whether D is the correct answer. Per GEN 003 to withdraw E shutdown rods it sends you to SYS SF-120 and section 6.5.2 closes the reactor trip 8 H 2 X N E breakers only locally. At this point only the trip breakers are closed the bypass breakers are only ever closed during testing. Breaker replaced plant in the correct S justification. Added the SYS to the references.

3. Explanations for distractors offer very little value. Theres no description as to the technical aspect - what does the lineup, as displayed in the picture, mean for A-C?

Added words to describe what each light and line up indicates.

4. Is the value for Reactor power (55%) operationally valid? Where did the number come from? Yes if the plant was at 100% and the MSIVs were closed and an ATWS condition existed our steam dump system can handle up to 40% power with the SG ARVs adding another 12% to that and rods not moving.

Note: Good use of pictures as alternate to just words.

R1 - System reference still needs to be added. Done R2 - Sat A - 41.7 R0 - 4th bullet states Containment pressure is normal - approach is to provide operationally valid data to applicant in order to enable them to qualify the data (what is normal or abnormal, good or bad, etc). In this case, provide applicant a value for E Containment pressure (maybe 0.3 psig) Added a value 9 H 3 B E R1 - Suggest changing the basis for action answer of Maintain RCS cooldown rate to an answer that is plausible for the 270,000 lbm/hr (i.e.ensure sufficient level to S provide for secondary heat sink.) Changed 'maintain RCS cooldown rate' to 'Maintain Secondary Heat Sink' for two distractors. This is a more plausible distractor since it is correct for most other circumstances instead of EMG C-21. Eliminated 'reduced and' from the two 30,000 lbm/hr distractors to make all for answer choices 'maintained' R2 - Sat Page 4 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 5 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 41.7 R0

1. Explanation for D doesnt identify how a P-14 causes a Reactor trip/MFP trips.

What is the reference for this? Should say main turbine trip. It does say trip of both MFPs which is what is a start signal for the MDAFWPs. Added the reference to the file.

2. All answers have 2 parts. Since all Part 1 answers are unique, there is no value added to having the 2nd part. All the applicant needs to know to get the correct answer is that only the MDAFW pumps start. Deleted the second part of the answer.

3. What are SMART valves? Reference? Added reference 4 for the smart valves

4. Since TDAFW pump is a distractor, what is ref that describes its auto start only on E low SG level? Added reference 5 to the file. TD pump will start on other things as well but nothing the question stem indicates 10 H 3 N E

5. When identifying setpoints (P-14, low SG level), it is helpful to include the setpoints S

in the explanations to aid the examiners in their review since they are not familiar with Wolf Creek. Added the P-14 information to the explanation for the question.

6. Does the initial power level of 30% impact the question? Yes, if it were over 50%

(P-9) then two things. If power is over 50% then the turbine trip will cause a reactor trip, this will remove all the heat input to the RCS and therefore the SG which would cause shrink to lower the SG levels to lower than the low level start of all the AFWPs.

This power level makes the question operationally valid since I could not say that level stayed above 23.5% on a trip from over 50% power.

7. Change stem to read What effect, if any, does this failure have on the AFW system? Added R1 - Add reference for the AFW system SY1406100. Done R2 - Sat Page 5 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 6 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 41.8 R0

1. Need ref for page in BD EMG C-0 (per Answer Explanation) Added reference 3

2. Cueing: Only the correct answer C has are expected to last until while all the others have are expected to be totally discharged by Change all answers to are expected to last until because it eliminates cueing AND is more in line with the concern that bus voltage doesnt lower to less than a useful value (105 vdc), not total discharge of the batteries. Changed items in distractors.

E 3. Cueing: Only the correct answer has the time of 1600, making it stand out as 11 H 3 N E different from all distractors. Added 1600 to one distractor.

S 4. Delete from all NK batteries at the end of stem. Deleted

5. For A and B - why not use 1600 instead of 1400? This would match the correct answer. Changed all 1400 out with 1600 R1 -

1. Add reference BD EMG C-0 Done

2. Wrong section was removed from question following initial comments. Remove from all NK batteries. From the 3rd sentence and replace the last line with original version. Fixed R2 - Sat Page 6 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 7 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 41.10 R0

1. All answers have 2 parts. Since all Part 1 answers are unique, there is no value added to having the 2nd part. All the applicant needs to know to get the correct answer is the highest priority alarm. Suggest deleting part 2 for each answer and delete AND why from the stem. This changes LOD from 3 to 2. Deleted second part

2. Could delete the first bullet since it doesnt provide any value. Deleted E 3. What is ref that links ALR 00-055C, ESW PMP TROUBLE (ref 1) to the correct 12 H 2 N S answer C 055B, ESW PMP B PRESS LO? Placed the wrong annunciator and response to the question but the correct annunciator and response in the explanation.

Corrected since the only way 55B could come in is if the breaker was closed and for this case it is not.

4. Is 055B, ESW PMP B PRESS LO an annunciator? If so, need the ARP as reference. See above

5. For 2nd bullet, suggest deleting and notes the following alarms locked in: since the alarms are not listed in the stem. Deleted R1 - Sat C - 41.7 R0

1. Does the Reactor power given impact the question? If not, suggest using 100%

power to avoid applicants reading too much into the question. Changed to 100%

E

2. For the correct answer C - what are the other NN buses? Buses that have not 13 F 2 N E been lost. Added this to the explanation.

S

3. For the distractor instruments that are not NN02 powered, identify the NN bus.

Added power supplies for the other instruments in the explanation R1 - Need to add the reference to the question. Done R2 - Sat Page 7 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 8 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 41.5 R0

1. What is the ref for the diesel having to be stopped locally due to loss of dc power to controls in the Control Room? Added another reference from the local annunciator panel for the response to a loss of DC it has more information about the different E

14 H 3 N circuits and which loss causes what.

S

2. What is NE-107 and where is it located? Reference? It is in the diesel room. The local alarm panel annunciator has been added as a reference.

3. Ref 1 should include page 1 of Attach D of OFN NK020 to show link between NK04 and NE02. Added R1 - Sat C - 41.5 R0

1. Explanation should start with a description of the ESW actuation - opening of the feeder breaker (name?) causes what and that caused the ESW actuation? SI?

Added why the ESW system starts, the diesel starts so it starts to cool the diesel.

2. OFN EF-033, Attach B, has ** Note: Position is applicable if SYS EF-205 is in affect. The ** is identified on EF HIS-37 (Distractor C). Given SYS EF-205 is ESW/CIRC WATER COLD WEATHER OPERATIONS, does the stem need a statement that would clearly preclude this procedure from being in affect? Like E During the month of July, the unit is operating at 100% Added during the summer 15 H 3 X M S to the stem.

3. If the ESW system has actuated, the correct answer is that EF HIS-41 is OPEN but needs to be closed. However, this valve is in series with HV-39 which should have closed on the SIS. If true, then the system parameters would indicate normal, yes? If system indications are normal, then the question would not be a good KA match.

4. Add the actual procedure in the 3rd bullet of the stem. Done R1 - Add OFN procedure title, which is required for RO level question. Done R2 - Change 'parameters' to 'indication' and changed the question. Done R3 - Sat Page 8 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 9 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 41.7, 10 R0

1. For C and D - title is RHR To Accumulator Injection Loops 1 & 2 added

2. Generic Comment - in all question stems, do not capitalize the word ONE -

instead, use one. For example, Which one of the following not Which ONE of the following (Comment for next exam) Changed E

R1 16 H 3 B E

1. Capitalize Seal Water Return Isolation in Answers A & B Done S

2. 2nd sentence in correct answer justification RCS pressure is the only indication that is looked for in C-12 Fixed

3. Add statement in the justification for RCP seal water return isolation valves to discuss the potential for applicant to confuse the Seal Water Return Isolation valves (discussed in C-12) with the RCP seal water valves. Done R2 - Sat Page 9 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 10 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 41.10 R0

1. The Note prior to C-11, Step 3, RWST switchover must be reset to prevent automatic transfer to an empty containment sump. Then Step 3 is Reset Containment Spray And SI Signals with 6 hand switches - is this the SI(RWST) that the explanation says needs to be reset? If yes, the explanation is confusing because Step 3 appears to reset SI (2 hand switches), Cnmt Spray (2 hand switches) and RWST Switchover (2 hand switches). Added more info to the explanation

3. Why is A distractor (P-4) plausible? Several signals require the reactor trip breakers to be re-closed in order to reset. If this action is performed then the P-4 that is locked in from the original trip will clear and allow other signals to now be reset.

Example after a reactor trip and SI the P-4 will not allow any other auto SI from occurring until the reactor trip breakers are re-closed. This also changes what the steam dumps do post trip or after re-closure of the breakers. If the student confuses this with the SI(RWST) reset then this is plausible, and this is performed in other E procedures post trip. If needed I could change this to ONLY CTMT spray signal to E allow for manual operation of the pumps 17 H 3 N 4. Distractor B is technically correct because Step 24 is resetting Cnmt Isolation E

Phase A and B. Would need to rewrite distractor as ONLY Phase A Added ONLY S to this distractor.

5. Like previous comments, all answers have 2 parts. Since all Part 1 answers are unique, there is no (limited) value added to having the 2nd part. All the applicant needs to know to get the correct answer is the what signal is reset in C-11. As in other questions the value is that it explains what the first part of the answer means or is trying to accomplish. I can delete this but if feel it makes the question harder for no reason.

R1 - Relook at stem focus to eliminate the potential for other distractor in the question to be correct. There is a potential for not having a correct answer in resetting SI(RWST) ONLY. Deleted ONLY from three answer choices and changed distractor 1 (P-4) to CISB. Added references R2 -

Reword stem to focus on actions taken in C-11, rewrite distractors to match stem change, remove the second part of the answer. Done R3 - Sat Page 10 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 11 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 41.7 R0

1. Stem asks for current status of the A train system, which implies a present tense. However, all answers have either will stop or will remain running - both are future tense. They should be is stopped or is running. Changed

2. Is the 55 seconds in the stem significant? Yes. Per the explanation the length of time the bus sees the Undervoltage is important to how it will react. At 119 seconds the normal feeder breaker will open and since the stem indicates that time has not been reached yet the breaker stays closed.

E

3. What is the ref that identifies the Normal Feeder Breaker (NB0112) will stay closed 18 H 3 B E after this transient? Added ref to question file. SY1406401 S 4. What is the ref that identifies the Emergency Supply Breaker (EDG output breaker?) will stay closed after this transient? Highlighted portion of SY1406401?

Added ref to question file. SY1406401

5. What is the ref that identifies the EDG will remain running after this transient?

Highlighted portion of SY1406401? Added ref to question file. SY1406401

6. Since the Ann is identified in the stem, the ALR should be included as a reference.

Added ref R1 - Need to add additional references to the comment section. Done R2 - Sat C - 41.5 R0 E 1. Add Tave=Tref in the stem to remove the possibility of challenges to distractor A 19 H 2 N Done S

R1 - Sat. The question does test the GFE knowledge of reactivity and temperature effects of a dropped rod, but the applicant has to understand the turbine control system to get the correct answer. Page 11 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 12 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 41.10 R0

1. For C - is this plausible in Mode 5? Is OFN BG-009 applicable in Mode 5?

Could an alternate boration flowpath using Attach A be used instead? Per the E reference provided this procedure can be used in any mode if negative reactivity is 20 F 2 B E needed for any reason.

S 2. For D - delete normal to read check if letdown can be established since stem states Mode 5 and Step 5 of procedure has Low pressure LTDN from RHR as option of step Check Letdown Established For Current Plant Conditions. Deleted R1 - minor edits Done R2 - Sat A - 41.7 R0

1. Reference and explanation and identified correct answer dont match. Correct answer per OFN is startup can continue or YES. Per Ref 1 (source not identified) is overlap shows N-31 is failed channel. The correct answer was meant to be NO. The IR detector indications were slightly changed to ensure the P-6 permissive in not lit and this was added to the stem. The explanation was corrected but the E answer/distractors were not.

21 H 3 N E 2. The paragraph below Answer Explanation states startup can continue per Step S P12 but this paragraph isnt associated with any answer. The Correct answer states N-31 is reading too low but doesnt identify whether the startup can continue (which is YES). However, answer C shows N31 and YES but its identified as incorrect. See above

3. Ref 2 (OFN SB-008, Rev 40) is incorrectly highlighted as it should show Step P2 and RNO which is Go to Step P10. See above R1 - edits Done R2 - Sat Page 12 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 13 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B - 41.2 R0

1. Per stem (use bullets), is reactor startup in progress by stating all SD rods have been withdrawn? Note prior to Ref 1, OFN SB-008, Attach Q, step Q3 says two IR channels must be operable to commence a startup so if stem is stating a startup is in progress, this would change the question. Or is the question written with the plant at power?

2. What annunciator(s) alarm(s) when IR NI fails high?

3. Based on annunciator, operators would identify failed IR NI, correct? And based on their diagnosis, they would have entered OFN SB-008, yes? Then based on the failed IR NI, Attach Q would be selected (show this in highlights). Then going through steps, at Q1, Ref 1 should show 4th bullet of The Following Lights on NI Cabinet (LIT

- High Level Trip, High Level Rod Stop, Power Above Permissive P-6 )

4. At step Q4, (not highlighted in Ref 1), is the PR - Operable and the IR Reactor Trip - Blocked? If not, how do the operators block the IR reactor trip?

U

5. Why are Ref 3, ALR 00-077B, IR HI VOLT FAIL, and Ref 4, ALR 00-077C, NIS CH 22 F 2 X N E IN TEST, included as references? Not explained in Answer Explanation.

S 6. No reference available for 82D, IR HI FLUX ROD STOP, which is identified in the stem of question.

7. If the function of the Level Trip Bypass Switch in bypass is to prevent an actual reactor trip or rod stop (per Ref 2), what is purpose of Q4 RNO in OFN SB-008 (Block IR reactor trip)?

8. Note: Per C - function of the bypass switch is to bypass reactor trip and rod stops. Question tests knowledge of rod stop and IR instrument power.

9. See Q22 rev 0-btl for editorial changes.

After researching this question further it was determined that at the power level (SD banks withdrawn) and the question setup this was too difficult to come up with good distractors. The question was revised to place the unit at a higher power level and then only have one part to ask the student. It now asks for the same type of understanding but with the unit at power.

R1 - (Rewrite of the original question). Rewrite Distractor C justification. Done R2 - Sat Page 13 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 14 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 41.11 R0 E SY1407300, Process and Effluent Rad Monitoring Sys, Rev 17, list several process 23 F 2 B S rad monitors that could be used as plausible distractors. This should be identified as a question reference. Added R1 - Sat D - 41.10 R0

1. OFN RP-017, Section 2.0, SYMPTOMS OR ENTRY CONDITIONS, states the procedure is entered by the Shift Manager, not the CRS as identified in the stem.

Changed to read entered by the crew

2. Revise question from Which of the following is vital equipment that the RO will operate for this condition AND why? to Which of the following actions will the RO perform for this condition and why? Changed

3. For Answer D - delete due to possible hot shorts. This is the only answer that E contains additional info on the why portion of the answer. Deleted 24 F 2 N E 4. For Answer D - Change to match C so it reads Ensure NK4401, BUS NB02 S BRKR CONTROL POWER, is OPEN to Changed

5. For Answer C - consider changing description of breaker to BB PCV-456A PORV Control Power, is CLOSED Delete the word breaker since its implied to be a breaker just by its noun description. Changed

6. For A - change proper SDM to adequate SDM Changed

7. Note: Ref 1 is rev 46 but is provided references has this procedure as Rev 47 -

no effect identified. Changed to rev 47 R1 - Change 1st word in Answer D to Ensure, Add references to the comments section. Done R2 - Sat Page 14 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 15 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B - 41.9 R0

1. There are two correct answers. Stem of question presents FR-Z1 being performed so it can be assumed all parts of procedure would be done. As a result, both Phase A (Step 1) and Phase B (Step 7) would be performed. Therefore, answers A (CISA) and C (CISB) are correct. However, the BD states Phase A (Attach A) is for non-essential penetrations while Phase B (Attach D) doesnt specify that penetrations are essential or non-essential. This might make answer C incorrect but the explanation for answer C states the reason is correct. Reviewed entry conditions for FR-Z1 and determined that there were two correct answers.

Changed distractor to a valve that is not affected by CISA or B.

2. BD-EMG FR-Z1 for Step 1 (CISA) specifically points out that closed was reworded to properly aligned because some valves may have been previously realigned. Therefore, if any lines are necessary for plant recovery, they may not be required to be isolated. Wording of stem and answers must be in accordance with U

the BD. They are. If you read the RNO column it says if any valves are not closed 25 F 3 X X X N E then close them. That is why the stem states closed. The question is not asking S which valves are closed and then reopened. Some valves are reopened per procedure the ones in the stem are not they are closed.

3. For consistency, the valve titles should be the same as the procedure. Therefore, answers B and C should read: EG HV-58, CCW to RCS Outside CTMT Isolation Changed valve

4. For consistency and ease of reading, Part 2 of A and C should read: To ensure containment penetrations are properly aligned to prevent release of radioactive materials. Changed

5. For consistency and ease of reading, Part 2 of B and D should read: To ensure containment penetrations are closed to eliminate all sources of high containment pressure. Changed R1 - Write as 2 part question and To ensure containment penetrations are closed to is in all part 2 of answers.. Also deleted 'Containment penetrations closed' from all four answer choices so as to avoid cueing.

R2 - Sat Page 15 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 16 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 41.10, HANDOUT R0

1. Use bullets in stem for ease of reading. (see Q26 rev0-btl). Fixed

2. Handout to be clean, clear copy of EMG ES-11, one page (front/back) of pages 38 and 40 (not to include p. 39, Foldout Page). That is how it is saved no foldout page

3. Modify last bullet to say crew is performing Steps 21 and 22 to determine if CCPs and SI pumps should be stopped. (see Q26 rev0-btl) Changed

4. Modified question for simplification/clarity. (see Q26 rev0-btl) Changed

5. Modified table to eliminate duplicate wording from each answer. (see Q26 rev0-btl) Changed U

6. Using the revised explanation in Q26 rev0-btl for Incorrect - B CCP with NO SI 26 H 3 X X N U pumps it doesnt seem very plausible that the applicant will determine that NO SI S pumps are required. With the procedure step as a handout, the applicant would have to make multiple errors to result in no SI pumps running. This KA is using reference materials so a handout will always be provided. A common error is not using adverse CTMT values in all procedures (shown in our validation for the question) and then determining subcooling (common error).

7. The last explanation is Incorrect - B CCP with A SI pump running but it should be A CCP and A SI pump running. (see Q26 rev0-btl) Fixed R1 - Second part of Distractor C and D are not plausible. Change the pressure in the stem to raise subcooling to between the normal and adverse containment values for SI determination. Raised RCS pressure to 900 psig from 585 psig so that subcooling is more plausible for securing SI pumps per step 22.

R2 - Sat D - 41.10 R0

1. There are two Q27 ref 1 files (.doc and .pdf) fixed E 2. Revise stem to read has been entered. As the crew begins Step 15 to 27 H 2 B depressurize the S/Gs, the STA reports that a Red Path on the Integrity Status Tree S

exists. Which of the following describes the required action(s)? Changed

3. In explanations, the info in FR-C2 (prior to Step 15) is a Caution, not a Note.

Changed R1 - Sat Page 16 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 17 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 41.2, 3 R0

1. For all answers: adding the parameter of steam flow adds no discriminatory value since the answer can be determined based on steam pressure. Removed

2. All answers have Initially to several seconds later so it should be added to stem and taken out of all answers. The answers are fairly complicated to read to anything that can be done to make it easier for the applicants should be done. Changed to a two column format

3. Provided ref discusses the flywheel but no ref is provided that discusses loop RCS E temps and S/G response. Added to ref 28 H 2 M E 4. For Part 1 of the answers, they are different from time 0 to several seconds (little S change, changing rapidly) so dont need from several seconds out to 1 minute).

Again, simplify the answers. Changed to a two column format

5. What is significance of 45% initial power? Yes since the power level is less than P8 (RCP trip will not cause a Rx trip) then the Rx will not trip and will continue to supply heat just as before the loss of the single RCP. This makes the question more difficult because if the Rx trips then all loops will go to 557F due to steam dumps working in auto for a trip which makes the coast down of the RCP irrelevant for the question so it would miss the KA.

R1 - Add references, incorporated 'No Operator actions' in the question. Done R2 - Sat Page 17 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 18 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B - 41.1 R0

1. Correct answer explanation doesnt address effect of BA FLOW CTRL at 0.0 turns. Added more to the discussion on how the controller works.

2. Stem: During auto makeup, controller was inadvertently set to 0.0 turns - doesnt seem plausible. Maybe inadvertently set prior to the auto makeup? Modified stem to remove concern

3. Stem: says power is stable, then answers A, B and C say it will continue to rise/rise/lower - confusing No the stem must state that power is stable so when the E auto makeup occurs what is the response to power after. If power is not stable to 29 H 2 M start with then the question can not be answered.

S

4. For D - delete word flowing and at this point. Changed

5. All four answers have Reactor power will which is already in the stem. Delete from all answers - easier to read. Removed

6. Answer C implies the reactor was critical but this wasnt in the stem bullets.

Change bullet to Reactor is critical at 1 x 10-8 amps and stable Added

7. Change stem to With NO operator action, which of the following describes the initial response to reactor power? A is Rise until trip B is Rise to slightly above the POAH etc Changed R1 - Sat C - 41.7 30 H 3 N S R0 - Sat A - 41.8 R0

1. B says NG01 and NG02 but explanation says NG03 and NG04 - which is correct? Fixed

2. A is not plausible because its 120 VAC and the pumps are 4160. See below E

31 F 2 N 3. What is voltage of NG buses? If less than 4160, not plausible. See below S

4. Refs for distractors? Explanations should at least identify the bus voltage.

The original buses listed were all safety related which made the question more difficult. Changed all the distractors to 4160 VAC buses (there are only 20 sets in the power block) and then made the wrong answers a reverse of the correct answer.

R1 - Sat Page 18 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 19 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 41.8 R0 The only ref provided for this question is the TS surveillances - this is not normally E assumed to be RO level knowledge. If the facility specifically agrees that this is RO 32 H 2 N level knowledge, and the information exists in some other ref material (system S

training manual, procedure, etc) then ok. Otherwise, this is Unsat for KA. These numbers are on the logs that the ROs take everyday. Changed the stem to eliminate the TS reference issue and focus on the logs.

R1 - Sat D - 41.3 33 F 2 B S R0 - Sat D - 41.5, 7 R0

1. Stem and explanation for correct answer (D) states perform per procedure?

What procedure? Especially with an A2 K/A, the plant specific procedure should be identified. The procedure is referenced in the question reference area, added this to the answer explanation area as well. Updated the question reference to show the flow path of the procedure steps better.

E

2. Stem doesnt indicate whether makeup is in progress - should it? No, the leak 34 H 2 N E from the RCS is leaking into the CCW system. If makeup were going then there S would be no way to determine where the water was coming from. Also with the vent valve closed this means that radiation was detected in the CCW system that is what closes it.

R1 - Modify the questions to avoid ending a sentence with a preposition and to provide which Procedure actions are being performed (OFN EG-004) which is required for RO level question. Improve distractor choices for 2nd half of question and answer explanation to better match OFN EG-004 guidance. Done R2 - Sat Page 19 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 20 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 41.5, 7, 10 R0

1. Should the stem provide PZR pressure and trend? Added but the 33C alarm indicates that pressure is lowering.

2. B isnt plausible -a dramatic response to conditions provided. Changed action to place PZR master controller in manual and control pressure which will not correct the issue but is in the ALR if that were the problem.

3. The way the question is stated, A could also be correct answer. Question is which of the following procedures and actions will mitigate this event, so entering the ALR (which is a valid entry based on annunciator 033C) and energizing backup htrs (stem doesnt say they are NOT energized) so this answer would/could be correct.

Revise stem so only one correct answer. No the question asks what will mitigate the event, energizing heaters will not mitigate this event. If that was all the operator did then the reactor would trip on low pressure and SI so while entering this ALR is a correct procedure to enter it will NOT mitigate this event.

U 4. Ref 1 doesnt contain steps that identify Attach V as correct. Revised references to show this path U

35 H 2 X X M 5. No ref for operation of PZR Master Controller - what is effect of output demand at U 40% and down slow. Added the lesson plan to show how the controller works, most S of this is skill of the craft. At 40% and down slow the heaters should be energized.

6. No ref for operation of spray valve controllers - output demand at 0% and 35%

The lesson plan was added to show the pressure numbers that make heaters and sprays work. At 0% the sprays are closed and at any value greater than that they start to open and move on to full open at 100%.

7. Per the ALR, should A action be and check PZR backup heaters energized?

changed

8. Since stem says 60% and stable, add the word then after The RO so The RO then notices added R1 - Answer A is still correct answer (mitigate) and changes to Answer B made it an additional correct answer. Updated the answer explanation. Also added references to this block R2 - Stem still says mitigate this event and minor stem changes. Changed question from 'mitigate' to 'stop'. Some of the distractors might be argued that they 'mitigate' the event even if the action doesn't 'stop' the pressure drop.

R3 - Sat Page 20 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 21 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 41.7 E R1 - Add to the justifications the association of the answer with the alarm. Took Due 36 F 3 N S to a loss of.. out of each answer, edits to Justifications. Done R2 - Sat D - 41.7 R0

1. Stem not clear - was there a valid SI signal that didnt automatically actuate (

becomes necessary to manually actuate SI.)? Is the 60 sec reset timer also applicable for automatically actuated SIs? 1) EMG E-0, Foldout page item #2 provides Manual SI Actuation Criteria for Subcooling and PZR Level. See below.

Added due to low PZR level to the question. There is not an automatic actuation for this parameter. 2) The timer actuates on SIS signal, regardless of how actuated.

2. Ref material doesnt really explain the effect of resetting SI on related plant equipment. What does related plant equipment mean? Added the word Safety to specify we are asking about safety related equipment that responds to LOCA sequencer actuation. Reference 2, Note 6 specifies the components are all individually sealed in (Latched) so that loss of the actuation signal will not cause these components to return to the condition held prior to the advent of the actuation signal.

E 3. The explanation for correct answer (D) - doesnt address effect on related plant 37 H 2 N E equipment (second part of answer). (If any) is included in the question to facilitate S selecting correct answer. There is no effect on safety related plant equipment since the 60 second timer has not completed. One of the distractors also has NO plant response.

4. Change stem to read the CRS directs the RO to reset the SI signal. Done

5. What are H2 fans? Is this their official title? Reference materials for statements made in the explanations? CTMT H2 Mixing Fans, see below. Updated question choices and answer explanation.

6. What is Ref 2 supposed to show as it relates to this question? Reference 2 shows logic associated with ESFAS actuation, both automatic and manual and the response of some of the safety related plant equipment, along with the note highlighted above.

7. Separate Part 1 and Part 2 of answers with something else besides a comma. At the least, use a semi-colon. Otherwise, it reads as a sentence. Done R1 - Change 'No effect.." from two answer choices to 'Remain in SI actuation configuration.' Also add references. Done R2 - Sat Page 21 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 22 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 41.7, 10 R0

1. Since this is Bank question from Callaway - make sure it has been updated to reflect site-specific alarms and nomenclature. Validated

2. Refs (ALRs) for C and D? What is level setpoint for each annuc.?

ALR 00-047D - 36% on 2/4 instruments ALR 00-047E - 99.8% OR 96.9% on 1/4 instruments

3. Explanation for B correct answer says 12% or lower but ALR says 11% or lower.

Step 12 of EMG ES-12, TRANSFER TO COLD LEG RECIRCULATION states to check RWST Level <12%, which would be less than or EQUAL to 11% and also E specifies Annunciator 00-047C, RWST LEVEL LOLO 2 - LIT as criteria to perform 38 F 2 B E Step 13. Updated Answer Explanation.

S 4. Do ALR 047C and ES-12 line-up? 047C Step 1 says check RWST level < 11%

and step 2 for RWST > 6%, then step 3 RNO to complete cold leg recirc as required by EMGs. However, ES-12, step 12b says check RWST level < 12% where the last bullet is the annunciator 047C. Which one is correct? EMG ES-12 is correct. Entry condition to ALR 047C is Less than or EQUAL to 11%. Step 1 should probably read Or Equal to as well. I discussed with Lou Brosch, Procedure Writer. He concurred and will update procedure.

5. Arrange answers short to long so correct answer becomes C (unless there was reason to list as is). Done R1 - Need to swap Answers B and C to make the order short to long. Add Step 12 in the stem since two of the distractors would be lit prior to the CS swapover. Done R2 - Sat Page 22 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 23 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 41.7 R0

1. How does question address K/A of manually operate and/or monitor in the control room if the fan auto starts? If monitored in the control room, how? Fan switches and running indication is located on the Main Control Board RL-020. See below and newly added reference 2.

E 2. Good OE tied to question.

39 F 2 N 3. Where is ref for auto start of A Cavity Cooling fan on loss of power to B fan?

S Added E-13GN04 as reference 2.

4. Do the Cavity Cooling fans have input and output breakers? The stem states but its output breaker trips and will NOT reset. Is this somehow communicating that a loss of power to B fan occurred? Not clear. There is not an input breaker. Output breaker is our standard vernacular. The word output could be deleted, but might confuse students. Recommend leaving as is. Left as is.

R1 - Sat C - 41.10 R0

1. Looking at a blank Attach A - if the answer is obtained by only recognizing that Required Action 2 is applicable, then this question is Unsat - direct lookup. Student must evaluate each parameter vs minimum and maximum allowed value. For a value outside of acceptable values, either action 1 or 2 is applicable. The student must comprehend value result and demonstrate use of surveillance form to ascertain correct answer. Since an evaluation must be performed, we do not consider this a direct lookup.

U 2. Explanations say pre suction and post suction while answers use static and dynamic. What is pre suction and post suction? Havent heard those terms 40 F 3 X N U Changed the answer explanation to match the answer choices.

S 3. Answers B and C give a reason the surveillance is UNSAT but include an action statement, while A and D only state the surveillance has failed for a reason. The correct answer is the only one with an action. Added and must be declared INOPERABLE to both answers Answer choices B and C (Distractors 1 & 3).

4. Provided ref is marginally valuable - contains generic info related to surveillance procedures (and isnt legible in some sections). Updated reference.

R1 - Would consider this question a LOD 1 due to the answer can be determined by a true false determination on the first part of each answer. Replaced with alternate question.

R2 - Sat Page 23 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 24 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B - 41.7 R0

1. What is the instrument tolerance for these valves? Even if + or - 1%, there could be more than one correct answer. An applicant would likely pull the last surveillance test performed on these valves to show that only 2 valves or up to 4 valves would E actually be open in the plant. Per STS MT-008, S/G SPRING LOADED SAFETY 41 F 2 N S VALVE SETTINGS, As-Left acceptance criteria must be within 1% of design lift set pressures on two consecutive tests. Added lift set tolerance to the list of items to ignore, along with blowdown and accumulation.

2. What is the value of Ref 2? Demonstrates which valves are affected and where they are in the system.

R1 - Sat C - 41.8 R0 U 1. C can be determined by eliminating all answers with #3. Deleted #3 from 42 F 2 X N S distractor 2. Need to add the word ONLY after B, C, and D. Added ONLY to correct answer and distractors 1 & 2.

R1 - Sat B - 41.5 R0

1. In stem, add in accordance with procedure OFN SB-008 after what E procedural action will the crew take in accordance with procedure OFN SB-008 to 43 H 3 M mitigate the failure? Added. Also split the answers into 1) and 2)

S

2. Second part of question - need OFN SB-008 as ref to validate the correct answer.

Is action taken a memory action? Added OFN SB-008 as Reference 2. Step B1 to take manual control of MFP speed is a memory action step.

R1 - Sat D - 41.7 44 F 2 M S R0 - Sat Page 24 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 25 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 41.7, 8 R0

1. First paragraph in Explanation - 1) states The B MDAFWP starting allows the signal but in stem, the B MDAFWP fails to start. 2) states When the B MD pump trips the D SG valve but in stem, the B MDAFWP fails to start. Corrected explanation, The pump start sends a signal to the MD Flow control valves, except for D. D will still close on high flow even though B MD AFP is not running. A will remain full open without corresponding pump running.

2. In stem, change question to read What is the status of the following MDAFWP discharge valves 1 minute after the reactor trip? Done, but changed to new format to E eliminate reference to 1 minute and specify No Operator Action taken.

45 H 3 N S 3. What is ref for which SGs are supplied by which MDAFWPs? The statement is made in the Explanation for answer D - Correct is A - BC and B - AD Added References 2 and 3

4. What is ref that states the TDAFWP will supply > 300 gpm to each SG? It is this amount of flow that closes the MDAFWP discharge valves, so the valves are NOT throttled Added Reference 3

5. What ref states that TDAFW flow will be > 300 gpm within 1 min after reactor trip?

Flow trend from desktop simulator below. Flow rise is immediate, well within a minute, but we changed the question to eliminate the reference to 1 minute by making it in reference to the time flow stabilizes. See also Reference 3.

R1 - Sat Page 25 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 26 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 41.7 R0

1. No refs for correct answer (and distractors) for NG04 - NK26 - NK04 (first three sources). MS Word Ref 1 shows NK04 - NN16 - NN04. Replaced, Entire flowpath is Ref 2 now

2. Since its possible for NN15 to supply NN01 and NN03, why is this not an acceptable power lineup per TS? Could applicant argue that an alternate lineup is acceptable even though TSs are required to be entered? See LCO 3.8.9 basis below. To eliminate any concern with inverter vs. bus operability determination, we modified the question to specify any technical specification action. The inverter would be inoperable with a cross train lineup.

E

3. It would be helpful if the explanations identified what was incorrect in each lineup.

46 H 3 N E Example: For D: NK01 feeds INV NN15 but supplies NN01, not NN03. Added better S explanations including comments on Ref 2.

4. Is Ref 2 for this question?? (OFN PK-029, LOSS OF NON VITAL 125 VDC BUS PK01) No, removed.

5. Is Ref 3 for this question?? (SY1506305, DC and Instrument Power Non-Class 1E, Section 0.2, LOSS OF PK01 DISTRIBUTION PANELS) No, removed.

6. There are two Q46 ref 1s (1 MS Word, 1 Adobe) Renamed

7. MS Word Ref 1 is marginally legible. Replaced, Ref 2 now R1 - Distractor C not a physically possible lineup, add refs. Changed distractor that was not a physically possible lineup to one that is physically possible but makes distribution system INOPERABLE per LCO 3.8.9. Also added references.

R2 - Sat Page 26 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 27 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 41.10 R0

1. STS KJ-011A says the overload test portion (6300 kW and 6821 kW) should be performed at the end of the 24 hr test, not 90 min into it. Also, it states Momentary transients, less than 30 seconds in duration, outside of the load range due to changing bus loads, will NOT invalidate this test. So would the conditions in the stem present a situation that would invalidate the surveillance? If this is true, then shouldnt the applicants be more aware than just Answer C? This question is not asking what is wrong with the surveillance it is asking about diesel load limits.

E 47 H 3 N Changed the stem to ask about the diesel.

S

2. What reference states that 4.25 kV is acceptable such that Answer A is not also correct? SYS KJ-123 states the upper limit on voltage is 4320 volts

3. Explanation for C says high load can cause overheating and insulation breakdown

- what ref is this from? Also, explanation says loading over 6.2-6.8 is limited to 2 hrs per procedure - is this the STS KJ-011A? Doesnt it state the lower limit is 6.3?

Corrected the value in the explanation. This is a skill of the craft item, any electrical system that is overloaded will shorten its life due to overheating the wire causing insulation breakdown over time and the wire will fail.

R1 - Sat B - 41.7 48 H 2 B S R0 - Sat B - 41.7, 8 R0 - Added ref. Specified in stem that plant is operating in summer. Improved E answer explanation to specify CTMT H2 mixing fans will be operating in Fast speed 49 F 2 N S to eliminate concern that there might be a second correct answer if CTMT H2 Mixing fans were running in SLOW speed.

R1 - Sat A - 41.7 50 H 2 B S R0 - Sat C - 41.11 R0 51 F 2 N E Reword Distractor A to state Check the ALERT alarm setpoint prior to performing a radioactive release. Done R1 - Sat Page 27 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 28 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 41.10 R0 If tripping the reactor subsequently trips the turbine, then Distractor C is partially correct. While Answer D is more correct, it cannot be argued that it is the only correct answer. If a turbine trip setpoint is reached, it is not wrong to ensure at some point 52 H 2 B S that the turbine is tripped. Need to reword C & D to be more specific. Almost all procedures at WC trip the reactor first. The turbine will not be tripped before the reactor at power level >50% (P9) because we dont want challenge the safety systems. Yes the turbine will trip at some time but not by the Operator unless a secondary failure were to occur. Even for a secondary failure with the BOP as the only Operator available in the control room, the reactor can be tripped using SB HS-42 prior to attempting to trip the turbine manually.

B - 41.7 53 H 3 B S R0 - Sat C - 41.7 R0 E Cannot have a 2 x 2 question with three different aspects as it makes distractors less 54 F 2 B S plausible. Simply ask the question as to which compressors are running and what the position of the PV-11 valve is. Done R1 - Sat C - 41.9, 10 R1 U 1. Distractor A is not credible given all the indications provided in the stem.

55 H 3 X N Distractor B is not credible. There is no plausible reason as to why an applicant S

might consider stopping fuel movement in the fuel building would be the correct answer for a containment integrity issue. Changed two distractors R2 - Sat Page 28 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 29 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 41.7 R0

1. All three distractors can be easily eliminated with basic knowledge of ECCS injection operation. All the applicant really needs to figure out is that the plant is tripped and SI is initiated.

Question demonstrates two knowledge bits:

1) that Reactor Trip and SI are required based on given conditions

2) ECCS injection lineup for high head injection is to all four loops.

E Distractor 1 (C) is plausible if 1) missed.

56 H 3 N S Distractor 2 (D) is plausible if 1) missed and student thinks starting a second CCP might be directed by OFN BB-007 to address the inability to maintain level with a single CCP.

Distractor 3 (B) is plausible if 2) not understood

2. Question stem creates potential confusion when applicants are told to assume operator action and asked what will happen in 5 minutes. Re-phrased question and eliminated reference to the 5 minutes.

3. Distractor B should be written to ensure that ONLY means loops 1&2 only, not ECCS mode only. Changed R1 - Sat B - 41.5, 7 R0 E Remove the and why? part of the question and delete the due to parts of each 57 H 3 N S answer, i.e. actual pressurizer level lowers. The reasoning as to why these actions do or do not occur should be developed by the applicant. Completed R1 - Sat A - 41.7 E R1 - How is the ability to monitor non-nuclear instrumentation being examined?

58 H 2 N Changed question in stem to better demonstrate ability. The temperature at which S the RCS stabilizes is non-nuclear instrumentation being monitored.

R2 - Sat Page 29 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 30 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B - 41.5, 7, 10 R1

1. Assessing plant conditions and then selecting a procedure or section of a procedure to mitigate, recover, or with which to proceed. (ES-401, Attach 2, Fig 2)

Revised question to which ONE of the following procedures will mitigate the Critical E Safety Function Condition with the HIGHEST priority Also changed distractor 3 from 59 H 3 N EMG E-1 to EMG FR-S2 to make all answer choices an EMG FR procedure. And S provided a containment pressure and IR SUR indications so that EMG FR-H1 and EMG FR-S2 are applicable but NOT the CSFSTs with the highest priority.

2. KA - is the 1200F a design limit or just entry condition into FR-C1? Performance of EMG FR-C1 will address the challenge to Core Cooling Critical Safety Function Status and attempt to prevent exceeding design limits.

R2 - Sat A - 41.10 R1

1. Distractors B & D are not credible. It is not plausible to believe that any applicant would consider using a non-borated water source prior to a borated water source to refill the SFP. OFN EC-046 directs using ANY of the three borated sources, there is not a listed priority so any of the other choices cannot be used as a distractor.

Choices are RWST, RHUT, or Rx Makeup per SYS BG-216. RNO for this step if NO Borated sources are available are to use Rx Makeup per SYS EC-200, ESW system, E or Fire Protection Water. Those distractors are plausible since OFN EC-046, step 15 60 F 3 N (and Attachment A, step A7) directs use of unborated sources if Borated Sources are S NOT available. However, changed the two distractors to the other plausible procedure driven emergency source, Fire Protection. Might be more plausible if student incorrectly thinks Fire Protection provides more volume flow for rapidly lowering level.

2. Prior to Which of the following areas, place, Per OFN EC-046, FUEL POOL COOLING AND CLEANUP MALFUNCTIONS to avoid any situation where another procedure might direct an evacuation of other areas. Added Per OFN EC-046.

Noun name of procedure is in the question stem.

R2 - Sat A - 41.11 61 H 2 B S R0 - Sat. Note - use of the if any in the stem isnt necessary if none of the answers include a no change option. Page 30 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 31 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 41.8 R0 - Distractor A could be argued to be considered a second correct answer. The flow restrictor does indeed restrict flow to the main turbine whether the majority of E flow is leaving via a steam line break or not. Added during full power operation to 62 F 2 N S the end of the distractor. This is wrong since one of the design features include -

minimum pressure loss across the nozzle during full power operation. Made this choice D to keep short to long answer choices.

R1 - Sat B - 41.5, 7 63 H 2 B S R0 - Sat C - 41.1 R0

1. What is the value of having the current boron conc in the stem? It lets the student know time in core life.

E 2. For C and D - what is normal dilution? Normal is in regards the flow path, but is 64 F 2 B S not needed. The student can assume normal if we did not specify alternate dilution. Removed normal from the two answer choices.

3. For D - is it plausible to have a parked position while at 35% power? Changed to Current position; which is still wrong.

R1 - Sat C - 41.7 R0 - The question asks which detector detects the presence of abnormal heat and E the correct answer is the only option with heat detector in its name. Reword to avoid 65 F 2 N S any potential cueing. Deleted the word Heat. Correct answer now reads Protectowire Linear Detector.

R1 - Sat A - 41.10 R1 - (same as Rev 0) Distractor A: EOP action steps never become optional, they are either applicable, not applicable, or superseded. Reword Distractor A to state E something to the effect of become secondary priorities upon entry into EMG FR-C1.

Modified Distractor and changed correct answer to A to keep shortest to longest 66 F 2 B E answer order.

S R2 - Edits to Distractor A Changed Distractor 1 again. 'secondary priorities' distractor is a subset of remains 'applicable distractor'. Changed to 'may be performed at CRS discretion...'

R3 - Sat Page 31 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 32 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 41.10 R0 - Need to be more specific on this question. It could be easily argued that RCS pressure of 2185 psig and lowering, PZR level at 91% and rising, or S/G level at 77%

E and rising would be reasonable reasons to have the crew trip the reactor. Ask the question in a way that examines distinct reactor trip requirements - either procedural 67 F 2 N E trip criteria or exceeding a protection system setting. Made question more specific by S asking which condition exceeded a reactor trip setpoint.

R1 - Change distractor to low S/G trip setpoint, instead of high P-14 setpoint and updated answer explanation. Also add references. Done R2 - Sat A - 41.10 R1 - Correct answer can be too easily identified with elementary nuclear plant operations knowledge. There is little chance that any applicant would consider any answer other than moving rods for a planned evolution as it is universally understood E that this does not happen without a peer check. Select a different reactivity 68 F 2 N E manipulation S Changed answer to an alternate reactivity manipulation since peer checks for control rod manipulations are universally understood.

R2 - Change answer to a different alternate reactivity manipulation; increase turbine loading instead of routine dilution for temperature control. Done R3 - Sat C - 41.10 R0 - Reword distractor B. Total S/G leakage could mean a number of different E issues, and therefore can be easily eliminated due to not being specific. Reword to 69 H 3 B S Combined primary to secondary leakage in A and B S/Gs or something to that effect. Reworded distractor B.

R1 - Sat Page 32 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 33 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 41.10 R0 -

1. How are A and B plausible for Part 1? Per the explanation, the only discriminatory knowledge is that NPIS is a computer point and not an annunciator?

Added causing a MCB Annunciator to actuate to the first sentence. This will make E pulling that annunciator card more plausible. Updated Answer explanation and 70 F 2 N referenced ALR 00-097C as an example of computer point generated MCB S Annunciator.

2. How are A and C plausible for Part 2? Is there ever a time where an OOS sticker is placed on the NPIS terminal? How many NPIS terminals are there in the CR?

Changed NPIS terminal to Affected MCB Annunciator. There are multiple NPIS terminals in the CR.

R1 - Sat Page 33 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 34 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B - 41.12 R0

1. Need ref for correct answer - what says admin limit is 2000 mR? Added reference for 2000 mr/year admin limit. This should be an E since no change to the question was needed to correct this issue.

2. Why is ref 1 provided? No calc uses Emergency Exposure limit. Added correct reference. The original question was during an emergency but after a discussion after looking at JPM overlap, we changed it to normal activities.

3. Distractor A is not supported by the explanation that 4000mR is allowed with approval. If the limit for this description is 4000mR then 4000 - 1400 = 2600/75 =

34.67 hours7.75463e-4 days <br />0.0186 hours <br />1.107804e-4 weeks <br />2.54935e-5 months <br />. There is not a distractor for 4000 as the mistake. The distractor is 2000 -

E 1400-225. This makes use of the extra information given in the stem so the only 71 H 2 B E mistake made is not just using the different limit numbers.

S 4. Explanation for D states the incorrect answer is also wrong. 5000-1400 = 3600/75

= 48 hours5.555556e-4 days <br />0.0133 hours <br />7.936508e-5 weeks <br />1.8264e-5 months <br />. (Explanation calculated 5000-1400=2600 but correct answer is 3600.)

Corrected

5. The stem does not state whether the year to date exposure was all at Wolf Creek or if the individual received some of it from another plant. The stem states the individual is a Wolf Creek employee and we dont send people to other sites often. Added all dose from Wolf Creek to the stem.

6. Explanation for C identifies procedure AP 25B-100 but its not included as a ref.

Added this reference R1 - Fix math error/typo in answer explanation. Modify question to eliminate one of the assumption parenthesis statements (to the nearest hour) Done R2 - Sat Page 34 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 35 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 41.12 R0

1. The stem is vague when asking for in the local area. Does this mean the local area of the valves being operated for the evolution? Ref 1 identifies that HP will need to discuss which rooms, systems and plant areas may be affected during a crud burst associated with the hydrogen peroxide addition. Focused stem to areas where personnel have access since this is what the KA is asking for.

2. Unsat - all of the distractors are not plausible due to applicant confusing what water is or is not contaminated. Distractor A is only plausible if the applicant thinks that youre blowing down the RCS side of the SG or there is a Tube Leak/Tube Rupture.

All are plausible. Strengthened the answer explanations to show this. If there is a tube leak this would raise dose rates but since the stem doesnt state one exists then it will not. Thats what makes it a good distractor. Makeup to the RMWST procedure E states that contamination levels could increase in the area of venting however the E distractor states makeup not vent. This precaution makes this distractor plausible.

72 F 2 N Batching boric acid is plausible since you have to understand how to batch, what water E to use, where it goes, and so on. This takes place in the aux building so that helps to S support this possible conclusion. The water used in this evolution is reactor makeup water which once again has the note for potential contamination. All are plausible.

3. For answer D, why is (TBL01, RMWST) added? Added because questions during validation showed this needed to be defined better. Changed distractor to write out reactor makeup water storage tank.

4. Ref for question is SYS EJ-110A? Question was revised and this reference was not corrected, fixed.

5. Knowledge of the crud burst as a result of a hydrogen peroxide add is good knowledge to test but better distractors or didnt approach is required. See above R1 - Change distractor 1 from SG Blowdown to bypassing RCS filter for a better plausible, but wrong answer choice. Done R2 - Update answer explanation for 11/4 comment change. Done R3 - Sat Page 35 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 36 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B - 41.10 R0 This is an SRO-only question due to the RO being required to know transition points in EMG F-0 which would direct the entry into subsequent functional restoration procedures. NUREG 1021 ES 401, Attachment 2 (Clarification Guidance for SRO-only Questions),page 22, big block, 3rd bullet states that if the question requires knowledge of diagnostic steps and decision points in the EOPs that involve transitions to event specific sub-procedures or emergency contingency procedure then it is determined to U be an SRO-only question. No, this is a question on a DIRECT entry into a red path based on indications given from F-0. ROs are required to know entry conditions to red 73 F 2 X X X N U and orange paths. This question does not ask if the student knows what procedure S they are in currently, it asks for given these indications which CSF is the highest priority. This knowledge is found in AP 15C-003 and is RO knowledge. Made format changes as requested.

R1 This is not a Tier 3 generic plant knowledge question. See ES-401, D.2.a (page 6).

Ensure that the questions selected for Tier 3 maintain their focus on plant-wide generic knowledge and abilities and do not become an extension of Tier 2, Plant Systems. Replace question (same K/A) Replaced with new question, same K/A R2 - Sat B - 41.10 R0 This is not a Tier 3 question. The question is specific to the operation of the RHR system. See ES-401, D.2.a (page 6). Ensure that the questions selected for Tier 3 maintain their focus on plant-wide generic knowledge and abilities and do not become an extension of Tier 2, Plant Systems. The applicable K/A is 2.4.9. Emergency U procedures - Knowledge of low power/shutdown implication in accident (e.g., loss of U coolant accident or loss of Residual Heat Removal) mitigation strategies. To eliminate 74 F 3 X N the notion that the question was an extension of Tier 2, Plant Systems, changed the S

question to closer match the K/A wording and made the answer choices (distractors) more generic and not procedure/system knowledge based by removing specific valve numbers.

R1 Still Unsat. Eliminate specific plant conditions, change distractor to reduce RHR flow.

Done R2 - Sat Page 36 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 37 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B - 41.10 R0

1. For the correct answer - does terminating the event always mean that the emergency class is terminated? Changed correct answer to Terminating the emergency classification.

2. Answer C justification is that this is done per procedure but the answer just says stopping the pump. If stopping ECCS pumps results in a degradation of plant safety or is indicative of worsening conditions, then it would be required to be reported. Added E due to a small break LCOA in Containment to the initial statement. Student can now 75 F 3 N demonstrate understanding of procedure knowledge in EMG ES-11, POST LOCA S

COOLDOWN AND DEPRESSURIZATION, beginning at step 21 to sequentially stop ECCS pumps if plant conditions support. This procedure has foldout page action to restart ECCS pumps as necessary to maintain subcooling or pzr level; which would be indicative of worsening conditions and the required report to NRC

3. Answer D - if a SGTR is the cause of the event, would this still not be required to be reported even though its lifting at setpoint (initiating of offsite release)? Added due to a small break LOCA in Containment to the initial statement. This ensures S/G ARV lifting is not a second correct answer.

R1 - Sat Page 37 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 38 Rev 8 Form ES-401-9 SRO-Only

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 43.5 R0

1. With the handout provided, the applicant can see SI initiation is not part of the decision criteria for EAL-4 (MSLB1 is Faulted SG) for Distracters A and C. That is not the point of the question. A steam line fault will cause SI to actuate even though the tree doesnt ask for it. The tree is looking for very specific items but other items can be present and not asked for.

2. Distracter B can be eliminated by looking at the EAL-3 flow chart and seeing that no decision is made on the chart without knowing SI initiation status AND some data about RCS leakage. Knowing that an SI has actuated doesnt eliminate this tree.

The tree doesnt ask for if it has or not it is looking for other items. This is a mistake E that has been made in requal and training as well.

76 H 3 N E 3. This question can be answered correctly by looking at what is said and what isnt S on the EAL flow charts only, not based on ability to discern what the event is. The SI is NOT key to NOT using EAL-4 it is just not asked for. If an SI were present but the other indications were you would still use this tree.

4. Indications include an SI occurs - this must be associated with a Reactor Trip so Power would not be able to be stable. Moved this item up, this will intended to be a time line setup so power was stable to start with so the student would not think the changes were from a power change.

5. Need to identify what the Handout is in the Comments - not just saying one is provided. This includes page numbers if only part of the 37 page form is intended to be handed out. Added page numbers to the handout statement R1 - Remove Handout. Rework question Done R2 - Sat Page 38 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 39 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only B - 43.5 R0

1. While the initial conditions would provide entry conditions for procedures in answers B and C, entry conditions for A and D are not evident or credible. Per entry conditions into the distractors these are credible since the entry condition has been met. The choice is which is the highest priority of the all the procedure entry conditions that are met.

2. To ensure that B is the only correct answer, there needs to be a reason why C has a lower priority than B. Maybe a Conduct of Operations expectation that one is address above another for a given reason. OFN BB-031 step 1 tells you if you have entered it and accumulator isolations are closed and you are in mode 3 or 4 then go E to OFN EJ-015.

E OFN EG-004 provides actions to restore CCW. If both B train CCW pumps are 77 H 3 B E damaged by fire, they cannot be placed in service. The foldout page directs placing the B RHR pump in PTL if neither pump can be placed in service. Because the A E RHR pump is also unavailable, a loss of RHR cooling is the higher priority.

S 3. If entry conditions to CCW System Malfunctions are not met, and therefore it would not be entered in this situation, then there is no issue of priority as stated in the stem. Entry conditions are met since the with a loss of all B train pumps (which is the one cooling now) then multiple alarms will be received in the control room

4. Should include ref materials for distractors, so in this question, the page of each distractor procedure, Section 2, SYMPTOMS OR ENTRY CONDITIONS. Added other procedures and highlighted the entry conditions so you can see they are met.

R1 - Research ref for priority of B higher than C, revise explanations Done R2 - replace question Done R3 - Add Wolf Creek OE and refs Done R4 - Sat B - 43.2 R0

1. In stem, change base to basis Changed E 2. In each answer, use the symbol for micro µ instead of u Changed 78 F 3 N S 3. Explanation for A could be more accurate - SGTR or SLB, offsite and Control Room doses Added

4. Add and Bases to the Reference Added R1 - Sat Page 39 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 40 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 43.2, 5 R1

1. The explanation for the correct answer, A, doesnt address the first part of the question (what procedure should be used). Added

2. Reference(s) for inverter operations, ac and dc buses would be helpful for examiner review. Unable to verify statement on the bypass transformer via the static switch. This statement appears to be critical to the correct answer as it identifies the power source to NN15 as NG01. The best documentation for this is the OFN. The E drawing at the end of the OFN has some info and the main overall drawing has the 79 H 3 N ins and outs of the inverter.

S

3. The TS and Bases refer to the inverter being OPERABLE, not the DC bus. Is it correct to ask for operability of NN03 or should it ask if NN15 is operable? The NOTE in OFN NN-021 refers to NN03 being operable - is this consistent? Changed question to ask NN15 operability. The statement in the OFN is inconsistent with TS and this has been reported to the correct individual.

4. Ref 1 doesnt include the pages that identify entry conditions or how to get to Attach I. It also doesnt include the steps in Attach I that line up NN15 from NG01 -

just includes step I.6.6 that doesnt mention NG01. Added additional pages R2 - Sat B - 43.5 R1

1. Stem asked for event in progress and action but all answers only include action.

Changed question to only ask for actions per the procedure since individual procedure steps are SRO only knowledge.

2. If unique events are identified like Rev 0, this is a two part question with unique Part 1 answers. No discriminatory value added to Part 2. That is why the event was not listed in the answer and distractors. The SRO part is what procedure steps would E the crew take and since I did not include what procedure the crew is in this makes it 80 H 3 N E even more SRO.

S 3. How is this SRO-only? Is system level knowledge all that is needed to answer this question since Part 1 is implied and unique? Also, doesnt identify specific procedure number. See above

4. Why is RCP MALFUNCTIONS included as a reference (ref 2)? Deleted reference R2 - Concerns of #2 and 3 still exist. Changed question to state what action the CRS would direct to make SRO only specific question and added applicable procedure to all four answer choices. Capitalized proper name words to follow procedure writers guide.

R3 - Sat Page 40 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 41 Rev 8 Form ES-401-9 C - 43.2 R0

1. Ref 2, OFN AF-025, doesnt include page for entry conditions. Added to reference.

2. What procedure directs splitting switchyard into East/West? Add to stem? This is performed by the TSO and not Wolf Creek so we dont have a procedure.

3. Ref 3, SY1406401 Revision 018, Emergency Diesel Generator System (Electrical), states the degraded voltage timer is below approximately 90% so is 3740 volts close enough to ensure the timer will actuate the bus isolation? Concern is that applicant might argue that A is also correct answer. Is there a surveillance procedure that checks the timer? Changed this value to 3536 (85%) to ensure it is met but not as low as the undervoltage which is 70% of normal (4160 VAC). There is no surveillance for the timer the degraded voltage will start the timer.

4. Ref 2, OFN AF-025, step 9 isnt applicable since stem implies that TSO reported grid instability. Step 9 RNO is to go to step 11. Step 11 is yes, then step 12 is Attach E. Correct, that is the flow path to Attachment E.

5. TS 3.8.1 and bases are required for Part 2 of stem - they should be included as references to question. Added these to the references

6. Is TSO required to follow WC procedures? OFN AF-025, NOTE before step 9, E The TSO will notify the Control Room within two hours upon the loss of the ability to 81 H 3 N E assess the operation of the electrical system relative to predictive or actual voltage.

No they are not. They have procedures that require them to notify us of various S things but we dont have their procedures. This is not a loss of ability to assess items this is a degraded voltage condition.

7. Per TS 3.8.1 Bases, the EDGs are considered onsite standby power sources - the first paragraph under Explanation discusses that a running EDG isnt considered inoperable, but Part 2 of all answers identify only OFFSITE circuits. Yes the question asks if the EDG is running based on the length of time the degraded voltage condition has existed and the answer is yes it will be loaded on the bus and the NB will be isolated from the switchyard. The second part of the answers is asking if the offsite circuit is operable not the EDG. Deleted this statement from the explanation

8. For A and C, part 2 of answers is All offsite circuits are OPERABLE. How many offsite circuits are there? Is this statement plausible? This would be the SRO-only part of the question. Changed distractors to be more plausible. With the situation given and one EDG running its more plausible to have both circuits inoperable than to have both operable. We have 2 offsite circuits, one to each safeguards buses.

We have 3 lines feeding the switchyard (345 volt lines). Dont get offsite circuit and offsite power supplies confused.

R1 - Add LCO 3.8.1 to Ref Block. Add VAC to stem after 3536. Done R2 - Sat Page 41 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 42 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 43.2 R0

1. Add to stem what actions are required in accordance with procedure xx?

Changed the answer to show procedure reference. The original answer was based on TS so changed to base on OFN

2. Explanation doesnt say WHY either part is correct. For Part 2: If TS gives 48 hrs to initiate action to insert rods, why is this a correct action now? Could applicants argue there isnt a correct answer? Would Ops continue with startup and initiate troubleshooting on S32B, using the 48 hr window? Changed answer to eliminate this issue. Ops would not continue.

3. 2 SRNIs also required in Mode 2 (below P-6)? Explanation only says Modes 3, 4,

5. Deleted this statement in the explanation since this is now a procedure question E and not a TS question.

E 4. For Part 1: In determining OPERABLE/INOP, is there a better ref than STS CR-001? TS Bases? Surveillance procedure? Is there guidance that says if they differ by E

more than 1 decade, its always the higher reading instrument thats INOP? No but 82 H 3 M N/A its not the high one. With three detectors agreeing with each other the one that is E not in alignment is broke. The guidance is the channel check.

E 5. For answers A and B, part 2: Is Required Action K.2.2 Place the Rod Control System in a condition incapable of rod withdrawal, the same as open reactor trip S

breakers? There are required actions within TS 3.3.1 that say Open reactor trip breakers (RTBs) so it seems to imply they are different actions. Removed this part of the question. There is more than one way to make rod control incapable of withdraw.

R1 - Concerns above still exist. Revised explanations R2 - Concerns still exist with question/answers - replace question. Replacement question developed R3 - Backup question not needed. Decision to use actual plant start up data instead.

Rev 3 not used. Submitted Rev 4 with actual plant data R4 - Update K/A information to original version Done R5 - Update Comments block for Mod Bank, refs Done R6 - Sat Page 42 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 43 Rev 8 Form ES-401-9 B - 43.1, 5 HANDOUT R1

1. Ensure handout doesnt provide any cue to any other question in RO/SRO exam.

Does not Correct Classification Path:

2. How does applicant answer yes to SGTF1 (SG tube leakage > 150 GPD)? What is the reference? Added the bases for the status tree to answer this.

3. How does applicant answer yes to SGTF2 (Failed fuel)? What is the reference?

Added the bases for the status tree to answer this.

4. How does applicant answer yes to SGTF3 (SGTR > than capacity of one CCP)?

What is the reference? Added the bases for the status tree to answer this.

5. How does the applicant answer Yes to SGTF6 (Faulted SG inside CTMT cannot be stopped until blown dry)? I dont see anything specifically for this in the stem.

What ref describes any auto isolation of MSIVs? EMG E-2, Faulted SG isolation will have the crew isolate the MSIVs, step 1. There are no valves between MSIVs and the SG so any faulted SG will blow down into containment.

6. How does the applicant answer Yes to SGTF7 (CTMT integrity)? What is the reference for Containment Mini Purge Exhaust Isolation Outlet Dampers auto closing on receipt of CPIS? Added ref 3 to the question. Added the bases for the status tree to answer this.

E 83 H 3 M 7. How does the applicant answer No to SGTF8 (GT RE 59/60)? I dont see S anything in the stem. Is a No answer to SGTF8 consistent with a Yes answer to SGTF2 (Failed fuel)? Is there any reference to support the correct answer? No.

Since the stem was silent on the status of GT RE 59/60 per the rules of test taking they are not in alarm (I didnt say it was broke so it is fine). Failed fuel is indicated by the red path for H-1 per the stem (no AFW).

Distractor Path:

8. The Explanations for incorrect classification for C and D: is it trying to say the applicant gets to GE by answering Yes at SGTF5 (ruptured and faulted)? Yes, since there is a faulted SG and a ruptured SG a plausible distractor could be they mistake them as the same SG.

Part 2 of Answer

9. What reference links CTMT PURGE ISO SYS status lights to Containment Mini Purge Exhaust Isolation Outlet Dampers and SA066-X and Y? (I couldnt find SA066-X or Y on the drawing and the highlighted portions of the drawing dont identify the dampers other than ZS0011/0012) Added picture SY1301301

10. What is reference for statement in Explanations B and C for incorrect Part 2 that these lights (Header for CTMT ISO SYS PHASE A) come on to show [CISA] isolation was successful? For this to be plausible, the applicant must think that Mini Purge dampers are part of CISA, not CPIS - correct? Yes SY1301301 R2 - Sat Page 43 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 44 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 43.5 84 H 3 N S R0 - Sat C - 43.5 HANDOUT R0 - Question is not written at the SRO level. Question can be answered using knowledge of entry conditions for major Red/Orange Functional Restoration Procedures. Modified question to ask from a CRS perspective. There are three factors that must be considered when evaluating level of question.

1. Student must realize Adverse CTMT values exist. Without this knowledge bit, entry to EMG FR-Z2 will not be recognized.

U

2. Student must assess four CTMT values and determine which procedures are U

85 H 3 X N applicable. Assess plant conditions and then select a procedure or section of a E procedure to mitigate, recover, or with witch to proceed.

S 3. Student must recognize more than one procedure entry conditions are met and apply knowledge of administrative procedures (EMG F-0) that specify hierarchy, implementation, and/or coordination of plant normal, abnormal, and emergency procedures.

R1 - Concern still exists Revised question R2 - Minor edit. Done R3 - Sat D - 43.2 R0

1. Develop a first half of the question that does not involve a direct lookup using a E straightforward flow limit chart. Submitted new question that removed graph.

86 F 3 N E 2. Is it necessary to change the pressures for each distractor? It would be better to S pick one set of pressures and have the applicant evaluate the situation in some way that does not involve a direct lookup. Submitted new question.

R1 - New question, removed Handout. Minor edits to stem Done R2 - Sat C - 43.1 R1

1. Stem should state to whom the report is made. Added NRC E

87 F 3 N 2. Could pull the Wolf Creek out of all answers and put in the stem. ( 4 hours4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br /> is S

Wolf Creek __________?) Moved to stem

3. Put question number and revision in the worksheet. Added R2 - Sat Page 44 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 45 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 43.5 R1

1. What is RWST level when LOLO1 and LOLO2 alarms come in? Reference?

ALR 00-047D LOLO1 - 2/4 level channels 36%, added as reference 2 ALR 00-047C LOLO2 - 1/4 level channels 11%, added as reference 3 E 2. Stem bullet that crew has completed ES-12, so Step 23 says Return To Procedure 88 H 4 N E And Step In Effect would put crew back in E-1, correct? So what procedure guidance is used when both RHR pumps have fluctuating flow and amps while in E-1?

S Deleted the bullet that EMG ES-12 was complete and added steps 1-11 were complete to the bullet prior. This is where the crew would be waiting for Annunciator 047C, RWST LVEL LOLO 2 to actuate.

3. Put question number and revision in the worksheet. Added R2 - Edits to stem - add bullet. Added 'A short time later' to stem bullet R3 - Sat Page 45 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 46 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 43.5 R0

1. Question is not written at the SRO level. Question can be answered using knowledge of entry conditions for major EOPs and general knowledge of the overall sequence of events. No, the second part is SRO only per 55.43 b.5. The student must know and understand specific procedure steps to answer this question and the correct transition. The understanding of E-2 to the end and then the decision point to determine what procedure to transition to next (in this case E-1) based on indications makes this SRO.

2. Distractors become not credible and LOD drops when you add a third question to the standard 2 x 2 approach as it provides the applicant with more opportunities to identify a reason to eliminate a distractor. Additionally, the third question has a two-U part answer, therefore providing yet another opportunity to rule out a distractor. The 2 x 2 questions only work when two questions with 2 answers are used. In this case, 89 H 3 X X M E the applicant can correctly answer the question with any 2 of the 4 pieces of S information. Changed question to a 2X2

3. The question analysis seems to state that ECCS flow would be reduced as part of the last step in E-2, however the correct answer states otherwise. Please clarify. No, per the last step in E-2 ECCS flow must remain since RCS pressure is still lowering and PZR level is not high enough. Changed the answer from weather ECCS flow should be reduced to which procedure will the crew transition to since this question is more straight forward and the same concept is used, should ECCS flow be reduced.

Updated reference 2 to show these items as well. This question should be an E since ES-401 Attachment 2 E was used as the SRO only part, procedure transitions that are NOT direct entry conditions to major EOPs, this is a transition not a direct entry.

R1 - move in Containment from all answers to stem, change crew to SRO direct R2 - Sat Page 46 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 47 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 43.2 R0

1. LOD for Part 1 is barely a 2. Easy to reduce choices to 50-50 with basic RO level knowledge and two correct answers (A & D). Modified the frequency distractors to raise U

2. There are two files named Q90 ref 2 rev 0. Deleted the word document Q90 ref 2 E rev 0, OFN NB-030. OFN NB-042 is the applicable procedure when paralleled.

90 H 3 X N E R1 - Difficulty concern still exists. Changed frequency to governor speed.

S Procedure step 6.4.2 adjusts governor speed for proper synchroscope rotation speed. Added sync scope to stem.

R2 - Match action with procedure guidance. Changed governor speed back to frequency. Frequency is changed by adjusting governor. Added switch numbers to both voltage and frequency choices.

R3 - Sat A - 43.2 R0

1. In stem: What is Data A failure 1,2,3 AND GW mean? Reference? Power loss to RPIS as per the KA

2. Part 2 of the A2 K/A is based on those predictions use procedures to correct, E

control or mitigate the consequences How is this part of K/A met? Modified 91 H 2 N E answers to ask about the failure but then asked about actions the crew would take S based on the failure. The correct answer is per TS the wrong answer is shutdown per OFN.

R1 - changes to Part 2 of answers not acceptable. Will consider TS to be considered for procedures used. Restored question to original version. Specified MCB annunciator in stem, separated answers.

R2 - Sat B - 43.5 R0 - If the malfunction of the FPS is the Halon NOT activating, what is the Part 2 of the K/A to use procedures to correct, control or mitigate this malfunction? The U procedure used in the answer isnt a result of the malfunction, nor is the prediction of 92 H 3 X N E the impact (event classification). Changed the question to predict the impacts of Halon not actuating as part 1 and made the appropriate procedure to mitigate the S

event part 2. Removed all reference to the classification from the question.

R1 - Update Explanations and refs. Done R2 - Sat Page 47 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 48 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 43.7 93 H 3 N S R0 - Sat B - 43.2 R0 (2.1.32)

Need to delete secondary side and pick another safety related function as the second half of distractors B & D. It would be difficult to believe that any applicant would select a secondary plant design limit for a DBA EDG support function when fuel/containment is the other choice. Need to look in the design limit bases in Sections 3.2, 3.4 and 3.6, breakdown the high level fuel and containment design limits into more specific limits, and then select more challenging distractors (parameters that are potentially believable as a primary design limit but are not officially called out in TS bases). These are the only distractors that even make U sense. The SG secondary side would affect containment (which is listed as a system U being protected) and therefor the connection could be made that the EDG supplies E power to AFW which would feed a break if not isolated. SFP is plausible with the 94 F 3 X B items of Fukushima failing and causing more problems. These distractors are E plausible for reasons that the EDG supplies power to systems that support the overall E boundary that is being challenged. While the suggested TS bases to look at for the S support systems do discuss items that support the design limits making this leap would cause this question to be LOD 5 since they are not directly listed in the EDG TS basis. Deleted the first part of the question as it did not answer the KA and made the second part into a true 2X2.

R1 (2.1.32) - Not Tier 3 question (Unsat) Replace KA Done R2 (2.1.23) - Overlap with another question, replace K/A. Done R3 (2.1.2) - New question, new K/A. Revise stem and answers for consistency Done R4 - change action to immediate action in stem to match procedure guidance Done R5 - Sat D - 43.7 R0

1. Stem should be cleaned-up to improve readability, i.e. and/or in place of and or and has arisen instead of has arose. Done 95 F 2 N E 2. Use bullets to separate initial conditions and simplify the wording. Done

3. Reword the stem to state Refueling machine operation in Bypass mode is desired to ensure that you do not predict the answer by stating that bypass mode will be required. Done R1 - Sat Page 48 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 49 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only C - 43.5, 6 R0

1. Is there no other procedure, i.e. general work control/pre-job brief guidelines that would include the requirements listed in distractors A & B? There appears to be a high risk for multiple correct answers. If the question is intended to only consider the guidance in the IPTE procedure. Enhanced stem to state the number and title of the procedure that requires this brief. This question was focused on the reference provided and was stated in the original stem which eliminates the more than one correct answer issue identified by the NRC. The stem was only changed to state the procedure number since the title was already in the older version.

2. LOD-1: The correct answer is easy to determine when compared to the distractors. Distractors A & B cover routine aspects of coordinating actions in the field for any evolution. Only answer C covers an aspect unique to infrequent evolutions. LOD 2 The question is asking what must be discussed per AI 15C-006 and all the other items listed here are covered in other types of briefings. The key here is that the AI procedure requires a minimum number of items be discussed that E may or may not be the same as other briefs. This makes a detailed understanding of 96 F 2 M E this procedure important to determining the correct answer. EPF 06-001-02 has S contact information required. This has been added to references as #3. Changed distractor about breaks to log dose received. Added EPF 06-001-05 as reference

1. 4 to show logging of dose for this type of brief. These items are plausible so only one correct answer. Only changed one distractor so I could show the forms indicate what must be discussed. Breaks are discussed for long jobs but the documentation of this is not written anywhere so this change made the distractor more plausible.

3. Distractor D is not credible. Completing any nuclear evolution, especially infrequently performed evolutions, will never be briefed with the need to complete them as quickly as possible. EMG ES-12: Steps 1 through 10 and step 13, if applicable, shall be performed without delay. This could be interpreted to mean as quickly as possible. Time Critical JPMs could also be interpreted to mean perform as quickly as possible. The plant has performed RTD cross-calibrations in the past that required collecting data as quickly as possible, to preclude the effects of RCS temperature drift over time. Changed this distractor to read performed without delay to match other procedure steps that state this.

R1 - minor edit Done R2 - Sat Page 49 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 50 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only D - 43.5 R0 - If all of these procedures have some level of applicability in this situation, as it appears they do, then this question has multiple correct answers. The question asks, what procedure would be used? After reading the distractor analyses, it appears that arguments can be made that each of these procedures may be referenced or used while managing the additional scope, i.e. a new work order to address the U additional scope will follow the requirements of AP 16C-006, MPAC WORK 97 F 3 X B E REQUEST / WORK ORDER PROCESS CONTROLS, therefore the procedure will be used. Need to clarify the question to prevent multiple correct answers. Changed S

stem to ask for which procedure governs Ops actions when employing compensatory measures resulting from scope growth. This limits the answers to the single procedure.

R1 - change contingency to compensatory measures in first paragraph and delete

'additional' from question. Update Answer Explanations. Done R2 - Sat C - 43.4 98 F 2 B S R0 - Sat D - 43.5 R1

1. SRO level: question does not meet SRO-only guidance. Question can be answered using knowledge of entry conditions for major EOPs and AOPs and general knowledge of the overall sequence of events.

2. Distractors A: Distractor A is not credible as there is no plausible reason to believe U that an SI is required - the distractor analysis states, Plausible if the student assumes other things are broke outside of what the stem states. This statement U confirms that the distractor is not credible as applicants are directed to not assume 99 F 3 X X B E anything.

E 3. Distractor C: Distractor C is not credible. It is not plausible to believe that the S entire crew would be expected to cease implementation of an EOP in order to transition to an OFN to perform emergency boration.

4. Put question number and revision in the worksheet.

R2 - Not Tier 3 question, unsat R3 - New question, same K/A. Edits to stem, answers and explanations required.

R4 - revise explanations R5 - Sat Page 50 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 51 Rev 8 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only A - 43.1 R0

1. Question format should be improved. Use bullets and past tense for stem conditions, i.e. Crew Immediate Actions have been performed. Ensure the proper terminology for equipment and technical functions.

2. SRO level: question does not meet SRO-only guidance. Question can be answered using knowledge of entry conditions for major EOPs and general knowledge of the overall sequence of events.

U

3. Cueing/Distractors: By stating in the stem when an SI occurs, this cues the U applicant that the basis for the action (the second half of the question) is related to 100 F 2 X X X B E the SI. It would be best to establish some initial conditions that would require an SI and have the applicant determine that an SI has occurred. Due to the cueing, the two S

distractors related to 30 gpm boration flow are not credible. Add noun name for E-0 to distractors C & D. Improve wording consistency in distractors C & D, i.e. continue with the EMG FR-S1 versus continue with EMG FR-S1 and This is and This action is.

R1 - not Tier 3 question, unsat R2 - New question, new K/A. Delete first paragraph of stem, minor edits to distractors B, C.

R3 - Sat Page 51 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 52 Rev 8 Form ES-401-9 B = 20 F = 33 E = 54 RO TOTALS: M= 6 H = 42 U = 11 Additional Notes:

N = 49 S = 10 B=6 F = 10 E = 14 SRO TOTALS: M= 4 H = 15 U= 8 Additional Notes:

N = 15 S=3

GENERAL COMMENT

S:

1. Bank questions are indicated by B; Modified are indicated by M; New questions are indicated by N

2. Chief Examiner comments are indicated in black on E or S questions and in red for U questions. Licensee responses are in blue for E questions and in blue for U questions.

3. Average Level of Difficulty is __ 2.4_ on the RO exam and 2.84 on the SRO exam.

4. The 10CFR55.41/43 distribution is: RO / SRO 41.1 = x 43.1 = x 41.2 = x 43.2 = x 41.3 = x 43.3 =

41.4 = 43.4 = x 41.5 = x 43.5 = x 41.6 = 43.6 = x 41.7 = x 43.7 = x 41.8 = x 41.9 = x 41.10 = x 41.11 = x 41.12 = x 41.13 =

41.14 = x

5. The answer distribution is: RO / SRO A = 18 (24%) / 5 (20%)

B = 19 (25.3%) / 6 (24%)

C = 22 (29.3%) / 7 (28%)

D = 16 (21.3%) / 7 (28%)

6. There is 1 RO question (Q26) with an attachment provided.

7. There are 2 SRO questions (Q83, 85) with attachments provided. Page 52 of 53 OBDI 202 - IOLE Process

ES-401 WC-2015-11 53 Rev 8 Form ES-401-9 Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 B 5 (easy B difficult) rating scale (questions in the 2 B 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

$ The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

$ The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

$ The answer choices are a collection of unrelated true/false statements.

$ The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

$ One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

$ The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

$ The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

$ The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

$ The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7. Based on the reviewer=s judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any AU@ ratings (e.g., how the Appendix B psychometric attributes are not being met).

Generic Comments:

1. Having 2nd part of answer doesnt add any discriminatory value since the 1st part of each answer is unique.

2. In all question stems, do not capitalize the word ONE - instead, use one. For example, Which one of the following not Which ONE of the following Include in your Exam Writers Guide if you have one.

3. Consider using the same format for 2 part answers (see Q16 for the format, then Q17 as not the same). Put in Exam Writers Guide.

4. For 2 part answers, make sure Explanations address both parts, even if one part is correct.

5. Use of simulator to prove/disprove plant conditions must be done carefully - usually the last choice if no other ref can be identified. Page 53 of 53 OBDI 202 - IOLE Process