ML16293A973

2016-07 Proposed Written Exam Comments

ML16293A973
Person / Time
Site:	Comanche Peak
Issue date:	07/11/2016
From:	Vincent Gaddy Operations Branch IV
To:
References
Download: ML16293A973 (35)

Text

ES-401 1 Form ES-401-9 General Comments:

1. Change distractor order on all Bank questions so the distractor order is not identical to the source Bank question.

This is not required by NUREG 1021, however, will be evaluated on a question by question basis and accommodated whenever possible based on balancing of A, B, C, D distribution requirement.

2. Essentially all Technical References are missing Revision numbers.

All question revisions are included in the worksheets and all technical revisions are included at the top right of each reference table.

3. To the extent possible, when parameters are given in the stem, a trend should be given (increasing, decreasing, stable).

Trends included as applicable in submitted questions.

4. To the extent possible, with consideration given to Answer distribution, order answers from Short-to-Long for ease of reading.

This has been evaluated on a question by question basis, some questions were purposefully ordered from Long-to-Short to ensure balancing of A, B, C, D distribution requirement. However, in most cases the Short-to-Long ordering was used when necessary.

5. Plausibility statements like incorrect but plausible if the applicant doesnt understand or applicant doesnt recall or if applicant thinks wrong answer is correct or similar statements add very little value to understanding why a distractor is plausible. It is understood that if someone doesnt remember or doesnt understand something, they might select the answer as correct.

Misconception or misunderstanding per NUREG 1021 is a plausible reason for a distractor. Included more information in plausibility statements based on individual question comments, as necessary.

6. Plausibility statements should be written with the understanding that Examiners are not licensed operators are your facility. While they are not John Q. Public, it is helpful to provide more information in the Explanations. This precludes the need for Examiners to search Ref Material for information needed to validate all aspects of the answer/distractors.

(Note: All time spent by Examiners on exam review is charged to the Initial License Exam and billed to the facility at the current inspection rate.)

Plausibility statements are written that refer to the reference which provides the groundwork for the statement.

Included more information in plausibility statements based on individual question comments, as necessary.

ES-401 2 Form ES-401-9

7. Ensure capitalization of plant equipment (specific valves, pumps, rad monitors, steam generators, etc) and locations (Containment, Aux Bldg, etc) is consistent throughout ALL questions. Capitalization scheme should be identical to plant procedures.

This is the normal process for CPNPP. We also use capitalization when the intent is to highlight information in the stem.

8. Numerous K/A Match statements do not correctly identify what the K/A requirement is. They appear to be written more on what the question is testing, not what the K/A requires to be tested.

K/A statements have been corrected as requested based on individual question comments.

9. All questions that have appeared on NRC Initial License Exam must be identified, even though they are considered Bank.

This will be included in the worksheets for all questions submitted.

10. The stem bullets should be presented in a logical order to help the applicants process the info. Usually, this is chronological order as thats how train, going through the procedures. This isnt always true, but there should be a reason not to do it this way. Whatever best helps the applicant without violating other rules, like cueing.

This is the normal process for CPNPP. Evaluated and corrected if necessary based on individual question comments.

11. Questions that have been used on a previous NRC exam should be identified in the Question History portion of the worksheet, Last NRC Exam ____________. This is especially true for questions used on either of last 2 NRC exams.

This was included in the submittal for all questions from the last two NRC exams. See statement 9 for questions that are older than 2 years.

12. For all Bank questions used on the last 2 NRC exams (RO and SRO) - check for applicant performance (% correct, questions asked during exam, post-exam comments) and if any post-exam changes were made to the question for any reason.

When applicable the revised question is used.

13. For all questions - Check all two-part questions to ensure both parts are asked as questions and not just fill-in-the-blank statements.

Some fill in the blank questions have two parts and are not 2 by 2 questions.

14. Consider identifying questions in the stem with 1) and 2) to better separate and identify its two parts. Could also use 1) and 2) for each answer. (see below)

We took out the 1 and 2 intentionally to reduce student fatigue and do not intend to restore based on student feedback.

ES-401 3 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans)

Distractors A, B, and C are all correct. If following the procedure, first trip the reactor (Distractor C),

then increase seal injection flow (Distractor B) (Step 1 says increase seal injection flow to ALL RCPs, > 6 gpm. Distractor B says to RCP 2-03 #1 Seal), then ensure CCW flow (Distractor A). Nothing in the stem U

1 F 3 X C B requires the applicant to identify the FIRST action.

S Distractor A is NOT correct and plausibility statement required revision. Distractor B required editorial changes to stem to ensure that answer could not be considered correct. Thus only one distractor problem and question is E not U. Distractors A & B swapped in order for psychometric balance.

2 H 3 B N S 3 H 3 C N S

1. Unit for specific volume is not °F, and this information is not required. Remove mention of specific volume. Corrected.

2. How is all information in stem used? Could any E bullets be removed? RCS pressure removed as this 4 H 4 A N S was only used for setting the exit parameter for subcooled liquid. All other information is used to eliminate other possible means of reducing the core outlet temperature other than basic heat transfer from ECCS.

ES-401 4 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans)

1. Distractor cues that either A or B is the correct answer by specifically mentioning isolating or breaking vacuum. Could reword the distractors to remove mention of vacuum. (i.e., close both PORVs; and close containment service air isolation valve.)

2. Adding to comment above: Format of each distractor should be the same - either all have action and reason or none of them do. Example:

Distractor A - Close PORVs (action) to isolate vacuum fill manifold (reason). Answer B could be reworded to same format: Close cnmt SA isolation valve (action) to break vacuum in PRT (action) (need to add in PRT). Distractors C and D have action but no reason so they either need a reason or remove the reason from A and B. Reworded Answer and Distractors to avoid possible cuing.

3. Should 1-LI-452 be LI-462? (Step 5.5.2, p. 39)

E 5 F 4 B N Corrected.

S 4. Given step 5.5.3, is Distractor A plausible since the procedure directs the PORVs to be closed? It is plausible and not correct.

5. Is Distractor D plausible given the PRT is at 23 vacuum (cant vent a vacuum). Yes, as opening the vent valve would break the vacuum but this would not be an acceptable method.

6. How long is necessary? (Explanation for Answer B) Could applicant argue that breaking vacuum isnt necessary because it may take several hours to return a CCP - and therefore several hours is necessary? Answer basis is less than strong.

Rephrased question to delineate that an action must be taken eliminating any ambiguity that nothing is required.

7. Add procedure reference in stem to comply with Part 2 of KA. Added.

ES-401 5 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans)

1. LOD should be 3 (or 2). 4 is too high. As a new question, the validation data supported a LOD of 4.

2. If there isnt a hand switch per se, then consider E rewording stem to remove the term hand switch.

6 F 3 A N E Use After attempting closure of both valves, the following indications are observed: HS stands for S Hand Switch - reworded as requested.

3. In stem, 2) - capitalize Pressurizer Vent Valves like it is in bullets above. (consistency) Okay This appears to be a bank (or modified) from the B

7 F 2 D S 2009 initial license exam, not listed on the question (2009) history. Agree 2009 NRC exam, added to worksheet.

1. Consider more discrimination than either 430 or

<430 This knowledge is LOD=1 so immediately reduces to a 50-50 question. Changed C & D to 326.

2. Explanation for Distractor C says for Part 2 but U plausible because multiple items discharge to the 8 H 2 X X D N S PRT but they all combine What are the multiple items? Does it matter? Other relief valves discharge but it does not matter for this question.

3. General Comment - trend on PRZR Vapor Temp and PRT Press? Fixed.

9 H 3 C N S B

10 H 2 C S (2015)

ES-401 6 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans)

1. Wording of stem is laborious how about What is the status of the following two minutes after the above indications first appeared? Also, consider deleting the first sentence in the question above picture When the following indications are observed:

because question is asking about 2 minutes later.

E Revised.

11 H 3 D N S 2. Explanations dont include a description of what the picture is showing - how the applicant must interpret the picture into what it means Revised

3. Why is it correct to say Tavg will be less than 564 after 2 minutes? Where is the ref for this? The Plant Trip Controller will reduce temperature to 557 and this will have occurred within 2 minutes.

12 H 3 A N S This appears to be a bank from the 2013 initial license exam, not listed on the question history.

Correct.

1. Is the noun name for 1-RE-5100 correct? (General Comment #6) Revised nomenclature.

B E 2. Ref provided doesnt identify 1-RV-5100B. The 13 H 3 D (2013) S reference in ALM-3200 to Opens discharge to Co-Current Waste is 5100B. The valve name is not stated in the procedure.

3. What is ref for noun names of the 2 valves? RWS-108. Component ID Database referenced for verification purposes.

E Blackout signal or Blackout sequencer? Added 14 F 3 A N S clarification.

1. This is a LOK=H question, as one has to ascertain which valves, then fail positions, then power supplies.

Okay.

E 15 H 3 B N 2. First statement Containment Spray has actuated S on Unit 2 doesnt appear to be required. Okay.

3. Consider What power supplies are required for Chemical Additive Tank Rephrased

ES-401 7 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans) 16 H 2 C N S

1. Need to explain why Distractors A and D cant be easily eliminated (LOD=1). If generator level is rising, then FRV would not decrease if moving closer to setpoint, and would not increase if moving away from setpoint.

2. Doesnt Part 2 of question depend on how far from setpoint the system is? Based on both of these E

17 H 3 C M comments, it is clear that a detailed understanding of S the setpoints and control of the FCVs is required.

Yes, how far the actual level is from setpoint, changes the demand which adds additional plausibility to all distractors. It is this detailed knowledge that makes this question difficult and is a level 3. Additionally, two SROs missed the question during validation.

1. The attached reference discusses main feedwater back leakage for Unit 2 only, and the stem discusses Unit 1. Does this apply? Question is changed to Unit

2. The procedure guidance is both units but the condition is applicable to Unit 2 only.

E 2. Close to an SRO only question because Part 2 requires determination of OPERABLE. Does CP has 18 H 3 D N E a specific requirement for ROs to know this? Or is S this ok because OPERABLE is determined only from the procedure? This is RO level as it is specifically delineated in a Procedure Note and ROs are expected to have an understanding of Notes and Cautions. An actual determination of Operability is not being made by the RO.

E Consider adding 2-4 RPM to Part 2 question to 19 H 3 A N E match procedure (instead of slowly). Changed.

S

ES-401 8 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans)

If the battery is supply DC loads, doesnt that mean that switchboard 1ED1 is in service? If so, then A is not a credible distractor. And C isnt credible either.

Explanations state that 1ED1 is in service. Revised U

20 H 3 X B N second part of distractors based on actions for load S shedding DC loads from the bus. As this is plausible to minimize voltage decline and is also plausible as this action is performed for a de-energized bus prior to restoration.

1. Explanation for Part 1 of answer doesnt address why requires normal start is plausible. It explains why Emergency start will still work, but doesnt address the EDG is tripped when low lube oil header pressure occurs without an Emergency start signal present. What would the operator need to do to perform a normal start? Local? Remote? Revised E plausibility statement and deleted Remote from stem.

21 H 3 B N E 2. Is there a 2 min time-delay before a Normal start can occur if the EDG trips on low lube oil pressure S with both switches are in Slow start? Yes

3. What defines a Blackout signal (Blackout sequencer)? Blackout signal and sequencer are used interchangeably at CPNPP as a signal is used as the starting point of the sequencer operation when power is restored.

4. Minor editorial edits

1. This appears to be a bank from the 2012 initial license exam, not listed on the question history.

Correct.

B E 2. All Explanations imply only 1 air receiver - when 22 F 2 D (2012) S stem and ref material say 2. Also, ref material distinguishes some actions are affected if 1 of 2 receivers is > 150 psig so it seems important to clearly articulate in the Explanations. Clarified.

ES-401 9 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans)

1. This appears to be a bank from the 2007 initial license exam, not listed on the question history.

Correct.

2. Explain how this meets the intent of the KA by verifying one valve closed. Also, the action required is either verify the valve is closed or manually close the valve. It could be argued that saying the valve automatically closes is cueing, and the auto function B E 23 F 2 A is disabled is cueing. This is the action required thus (2007) S it meets the K/A.

3. Since this is an A2 KA, there should be a reference to a procedure in the stem. Add IAW procedure _____ to front or end of Part 2. If there is not a procedure that directs the actions in the answers, then question is Unsat. Added procedure.

4. To simplify all answers, take out valve from each and put in stem. Corrected.

1. This appears to be a bank from the 2015 initial license exam, not listed on the question history.

B E Correct. Missed that it was on 2015 Exam.

24 H 3 D (2015) S 2. All answers could be simplified if SG NR level reaches its LOW-LOW setpoint was taken out and put in stem. Corrected.

1. Is this picture showing both red and green lights illuminated? Yes

2. Since question asks about before and after SI, why do we need a picture of the valve position during E

25 H 3 A N SI actuation? What good is the picture when the S question contains the valve nomenclature? Picture adds to K/A match as monitoring is indicated.

3. What is AUTO shutdown mean (second bullet)?

Clarified.

ES-401 10 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans)

1. This qualifies as a new question, not modified.

Updated.

2. Is it possible for 1EB1 and 1EB2 to be credible distractors? Two answers being MCCs and two being switchgears. 1EB1 and 1EB2 would be credible distractors, but the current list appears more credible as written.

3. Are 1EB3/4 480 VAC buses and 1EB3-1/4-1 480 VAC MCCs? If not, question is Unsat. Yes, 1EB3-1 E

26 F 2 D N and 1EB4-1 are MCCs which come off of the 1EB3 S and 1EB4 Switchgear respectively.

4. Explanation for C and D list the same IA Compressor. Corrected.

5. What is the second part of Explanations A and B mean? And they are the same statement. Removed.

6. For Distractors A and B - control power supply to IA Dryers is 480 VAC? Or is it the supply to IA Dryer control power? Use of Control Power terminology was incorrect.

1. Explanation A and B: For Part 2, explanation for why its plausible doesnt make sense. The settings for LEAD was set to 0 as stated in the stem. It wasnt E

27 H 3 C N an as found reading of 72. Corrected.

S 2. Why is the stem formatted the way it is? Per SOP-509B then hard return, with procedure title in front part of Part 1 question. Corrected.

1. Change second bullet into the stem question: Per IPO-010B, ., a max of ___ penetrations when reducing RCS level below a min of ___ inches E Corrected.

28 F 3 C N S 2. Plausibility statement for 5 penetrations isnt very helpful. If more conservative is the basis, then the best number is 0. Revised to 0 based on this feedback.

ES-401 11 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans)

1. Part 1 of Distractors A & B are subsets of C & D.

(If less than 70% is right, then less than 30% is also right). Bounded in stem

2. Part 2 of Distractors A and C easily eliminated as cold calibrated pressurizer level would not be calibrated by hot leg temperature. (but good if used E

29 F 3 B N for Mode changes) This question is not referring to S instrument calibration it is asking which instrument should be used during cooldown when a certain temperature is reached. CPNPP uses RCS Hot Leg temperatures for temperature monitoring and mode changes during plant cooldown, thus, making RCS Hot Leg temperatures plausible

1. Distractor B is also correct in addition to Answer C. The question asks startup rate to get to 2%

power. Since startup rate is changed as power approaches 3X10-6 amps, Distractor B is also a correct answer. (Step 5.4.1.C, page 60) Added word initial in stem to clarify

2. For Distractor B - no ref provided. This is step 5.4.1.C. Corrected references

3. For Answer C - the ref provided is from the wrong section in the procedure (Section 5.2, Reactor Startup Using Control Rod Withdrawal to 1 x 10-8 amps). Per the stem, the reactor is critical at 10-8 so the applicable section is now 5.4, Increasing Reactor E

30 F 3 C N Power to Approximately 2% Following Reactor S Startup And Establishing Main Feedwater Flow to the SGs. Step 5.4.1.B directs a 0.5 dpm SUR to 2%

power. Corrected references

4. First bullet should read Reactor startup is in progress on Unit 1 using IPO-002A, Plant Startup From Hot Standby Okay

5. Third bullet should read Unit Supervisor has directed raising reactor power using control rods to approximately 2% Then question is simply Per IPO-002A, what startup rate is used to raise power to 2%? Okay

6. In question, name of procedure is wrong - should be Startup, not Start. Corrected

ES-401 12 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans)

1. This appears to be a bank from the 2013 initial license exam, not listed on the question history.

2. This question is Unsat but wont count as one if its verified that it was a Bank question from a previous NRC exam.

3. This is an LOD=1 question, simply testing the knowledge of how to read a steam table.

(E) 31 H 4 A N 4. It also does not match the K/A, as the question S does not deal with the operational implications of saturation and subcooling of water.

Question was #32 on 2013 NRC exam with exact same K/A. Rejected K/A as writing a question for this system and this K/A was overlapping other concepts which were already being tested (Q49).

E 32 F 4 C N Minor edit Minor editorial changes S

1. Consider Part 1 question: Unaffected SG NR levels will ___? Changed

2. What is reference for Part 2 of Answer B? Is the U

33 H 3 X B N change in RCS Tave time dependent, such that the S question should be Initially, RCS Tave will ___?

References were conflicting, changed part 2 of question.

1. In Explanation for Answer B, what is reference MR1? List as ref? Add to question refs? Simplified references and added MR1 to references

2. ARV setpoint is 1125 psig = 1140 psia. From Steam Tables, 1140 psig is extrapolated to 560.71 so rounded up to 561 (not 562) so could applicant argue E

34 H 3 B N no right answer? Originally at 561°F, changed to S 562°F based on validation feedback. Changed back to 561°F

3. What is IR amps when at POAH? 3x10-6 amps Validation data was poor, revised question to reflect effect on RCS, specifically PZR level.

E Edit Part 1 question to supply header temperature 35 F 3 B N S rises Okay

ES-401 13 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans)

1. Since power is above 10%, turbine trip will result in a reactor trip. Is there any procedural guidance that would have an operator trip the turbine first? If not, then Part 1 of Distractors A and B are not credible.

(P-9 is 50% power, not 10%) The next bullet requires E

36 H 3 D N a turbine trip rather than a reactor trip if power were S less than 10% thus tripping the turbine without tripping the reactor is plausible and credible.

2. A2 K/As normally reference a procedure in either the stem of the question or in the answer/distractors.

Added procedure to stem.

37 F 3 D N S This is a LOK=F question. Agree

1. With a negative Tave - Tref, it is not plausible to think that inserting control rods would make temperature increase. (So Part 1 of Distractors C and D are not plausible) Also, might be a better question if the deviation is 5°F or higher, and the steps per minute are 72 and 48 (which is the speed in manual).

CPNPP believes that original distractors were plausible and thus these changes are editorial.

E Discerning which direction control rods move based 38 H 3 B N S on indication of the meter is definitely RO level and would be considered discriminating in nature for License applicants at a LOD of 2.

2. Plausible explanation for 16 spm is that the applicant might think theyre in the sloped portion of the speed logic - but the Logic Diagram says 32 spm? Reworded question to ask only parts directly related to K/A without introducing the Distractors which were believed to be implausible

ES-401 14 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans)

1. Would be helpful to add title of OPGD-3, Attach 5 as Shift Operations Skill of the Craft since its not identified on page provided. Is there any guidance that specifically states the ARV controller should be manual or auto? No Or is this up to the US? This is up to the US but as temperature is maintained at 557 and no cooldown is initiated in this procedure automatic control would be desired if functioning properly. The lack of definitive guidance is why manually controlling the ARV at 1092 psig is not a E distractor as this could not be eliminated as a wrong 39 H 2 A N S answer.

2. Since stem says EOS-0.1A is in progress and all SG pressures are 1130 and rising, does this mean all SG ARVs have not been controlling SG pressures at 1125 since the Reactor trip? No, the ARVs have a pilot valve arrangement and usually experience a delay/overshoot before the pilot valve opens and allows the ARV to open and control at the controller setpoint. A slightly higher pressure was chosen to ensure that all applicants recognize that an adjustment is necessary.

40 F 3 B M S

ES-401 15 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans)

1. Not clear why Distractor C isnt also correct (see

1. 5 below) No an RCP is not required to be tripped for loss of CCW to the thermal barrier if seal injection is maintained.

2. Is this SRO only knowledge? There is a note in the EOP bases that discusses Phase B isolation, and loss of CCW. Does this go beyond mitigative strategy of the EOP? CPNPP believes the question was a system knowledge level question. Detailed review of the references led to rewording in order to ensure the question is at a system knowledge level and thus RO level without question. Consider these changes to be editorial.

3. Explanation for Answer D isnt much help - add E

41 H 3 D M WHY is CCW lost to RCP motor and bearing coolers:

S Hi Cntmt press - Cntmt spray - Phase B - Loss of CCW to Cntmt Improved.

4. Explanation for Distractor C isnt much help -

WHY isnt CCW lost to RCP thermal barriers for these circumstances but CCW flow IS lost to RCP motor and bearing coolers? Reference? Clarified.

5. Stem states what CET temperatures are, however, at this point in the event, RCPs are running so Thot / Tcold / Tave would be used, correct? Not necessarily. It is the highest temperature and in LBLOCAs the CETs are usually the highest. Deleted bullet as CET temperature was not needed for modified question as was the case for the original question.

1. Add In accordance with SOP-103A to either front or end of stem question. Corrected.

E 2. Plausibility statement for Distractor C, Part 1, has 42 F 2 A B S no value - everything would be plausible if the applicant thought the distractor was the correct answer. Improved plausibility

ES-401 16 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans)

1. ABN-502, Step 6 is Identify and isolate affected train (valves 4512 and 4514 closed). Step 6.d has the operator verify affected loop isolated. Step 7 is verify one train surge tank level stable or increasing.

How can you get to Step 8 with leakage NOT stopped? The surge tank has a separator plate which is solid beginning at about 58% and thus one side E

43 H 4 A N stabilizes. Once the leak is fully isolated both sides S would then refill. Added additional reference for clarity on partition plate.

2. Need to have a procedural reference in the question stem. Corrected.

3.

Reference:

M1-0229-A is barely legible. This is as clear as we can provide without going to oversize document.

1. What is ref for Answer A, Part 2? (if applicant challenges the question) The Thermodynamic properties of the pressurizer. An increase in pressure 44 H 3 A N S forces water out of the pressurizer. Additional references provided.

2. Anyway to link this to a procedure? ALM, ABN ABN-705.

1. This appears to be a bank from the 2011 initial license exam, not listed on the question history.

B E Correct.

45 H 4 B (2011) S 2. Capitalizing the word AUTOMATIC in the stem might cause the applicants to believe it has enhanced meaning - consider lower case. Agreed.

1. Add bullet for EOP-0.0A, Reactor Trip and Safety E

46 H 2 A N Injection, in progress. Done S 2. This is a LOK=H question. Agree

ES-401 17 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans)

1. K/A requires knowledge of the reason for HPI/PORV cycling during LOAF. The answer is given in the stem - SI without adequate bleed path.

2. Part 1 of Distractors B and D not credible. In LOAF, RCPs are immediately secured so PZR spray is not available (unless it is made clear that it is Alt U PZR spray usig CCPs).

47 F 3 C X N S 3. Need to have a procedural reference in the question stem. Determined that proposed question was for a Loss of Heat Sink and not a Loss of Main Feedwater as required by the K/A. Further, determined that writing an RO level question to the K/A was not plausible. Rejected K/A as detailed on ES-401-4. Replaced Question.

48 F 3 D N S This is a LOK=F question. Agree.

49 H 3 D N S

1. Need to have a procedural reference in the question stem (IAW procedure ____, ) Added procedure.

2. Reword stem - it asks what actions are required, then states the action but infers the applicant to fill in the blanks. Removed the question.

E 3. What ref states LT-551 and 554 are the normal 50 H 2 A N S channels (both are Channel 1?) selected for control?

Reference provided.

4. Second half of all Part 2s has no discriminatory value. (Answer can be identified with Part 1 and either FK-510 or 520 - applicant doesnt need to know FK-530 or 540). Doesnt make the question invalid; just noted. Noted For Part 2 question in stem, delete or equal to since E

51 F 2 A M procedure says to verify volts between 128 and 140 S VDC. Deleted text as recommended This appears to be a bank from the 2015 retake B

52 F 3 B S exam, not listed on the question history. Added to (2015R) question history

ES-401 18 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans)

Is plausibility statement for Part 1, 95 psig, correct?

Per ABN-301, if IA Compressor 1-02 had been in Lead, it would start at 105 psig (per NOTE before step 2.3.1, page 4). Are Distractors A and B (Part 1) plausible? SOP-509A is the appropriate reference for E

53 F 2 C M IAC operation. With IAC X-01 in LEAD it will cycle S between 105 and115 psig. With IAC 1-02 in BACKUP it will cycle between 100 and 115 psig. If any IAC other than 1-01 and 1-02 is in STANDBY it will cycle between 95 and 115 psig which makes distractors A

& B plausible.

1. Question data states K/A as W/E12, Excessive Heat Transfer. The listed K/A is for 040, Steam Line B

54 H 3 C S Rupture. Corrected.

(2012) 2. What is title of drawing E1-0019 Sht. C? Added

3. References for B and D? Added

1. Add annunciator window name to the first bullet -

PRZR PORV OUT TEMP HI is in progress for re-establishing? Added bullet with annunciator name.

2. ARP says loop seal is for Block Valve, not PORV U as listed in stem first bullet. Corrected.

55 H 3 X D X M E 3. While FRH-0.1 says RNO is to open Rx Head and PZR vents, that doesnt substantiate adequate or S inadequate core cooling. During review of this comment, determined that in depth procedural knowledge beyond RO level was required. Rewrote Part 1 of question.

ES-401 19 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans)

1. The distractor explanations discuss the voltage regulator being in manual or automatic, but there is no mention of it in the stem. Should the stem state that the voltage regulator is in auto? Added but would be assumed unless stated otherwise.

2. 345 KV switchyard voltage limits in ABN-402 (342

- 361 KV) dont match TDM-401A Turbine/Generator E Limit Curves, Reactive Capability Curve (340 to 361 56 H 4 D N E kV). TDM states that Transmission Limits are more restrictive which is the reason for the delta.

S 3. ABN-402, Step 5 of ref material for checking main generator capability limits against the curve - this step is under the Generator Voltage Regulator Failure section so is not applicable to question stem. What Ops procedure directs operators to operate Main Gen within curve limitations? Step 5.5 E says how to do it, what says when to do it? Added Reference Asking Part 2 (CB D continues to withdraw) doesnt fit with Part 1 (either tripping the reactor or inserting E

57 H 2 B N rods to CBO). Agreed, question order was reversed S so that integral worth changing is asked before the RO action.

1. Question says K/A EK3.05. Actual K/A is AK3.05.

Corrected

2. How does this meet KA for knowledge of the reasons for actions contained in the EOP/AOP?

(The reason is explained in Explanation A.) Part 1 is knowing if SW7 on NMT2 card is trip or bypass; Part U

58 H 3 X A X N 2 is knowing if PZR Level Hi is 3 or 4 channels.

S 3. For Part 2 of D - if there were 4 channels and 1 was bypassed, wouldnt the logic be 2 out of 3?

4. Is knowledge of SW #7 on NMT2 card for channel 0461 trivia or minutia? Agreed, this is probably minutia and beyond what is desirable to test. Wrote new question.

ES-401 20 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans)

1. The stem reads as if automatic safety injection has already been reinstated. Stem should be clarified to state that reinstating automatic safety injection is required. (Could confuse the applicants.)

(Consider 3rd bullet: Operators are performing EOP-0.0A, Attachment 9, Post Event System Realignment, Step 11, to reinstate automatic SI actuation signal E

59 F 3 B N Agreed.

S 2. Based on the NOTE, the operational implications seems to be the Tech Spec requirement for 2 SR detectors to be operable whenever RTBs are closed.

An applicant could argue that automatic SI could be reinstated with 1 or 0 SR detectors operable, thus there could be two correct answers. Added clarifying clause to distinguish a single correct answer.

Part 1 of Distractors A and B are not credible with the provided picture. While the explanation states that the applicant must know the power on light is lit when power is available and dark when not available, the U lights are CONTROL POWER ON and 60 H 3 X D N S INSTRUMENT POWER ON, so it is not credible to think that the light would be dark when power was available. Removed the Instrument Power and Control Power ON portion of the picture and revised explanations.

61 F 4 D N S

ES-401 21 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans)

1. This is a LOK=F question. Integrating plant knowledge along with the conditions given is more than just recalling facts, thus CPNPP believes this is H. Chief Examiner determined question LOK=F.

2. ABN-304, Rev 9, says Condenser Available (C-9) is lost with vacuum less than 12.3" Hg so is setpoint 12.3 or < 12.3 or <= 12.3? Applicant could argue that there is no correct answer. The setpoint is = 12.3 U 3. What is acceptance range of this setpoint based on plant I&C data? With distractor only 0.3 difference, 62 F 2 X X D N E the range might be large enough to include the 12.0 S value. One applicant did exactly this on a previous examDetailed review of I&C calibration revealed that the setpoint is 12.3 but the tolerance allows 12.0, thus per your concern could be considered correct. Based on this changed 12.0Hg to 17.5Hg which is the MFP low vacuum trip setpoint.

4. Consider combining 1st and 2nd bullets into Unit 2 is in Hot Standby using IPO-007B, Maintaining Hot Standby Agreed.

1. This is a LOK=F question. Okay.

2. This appears to be a bank from the 2015 retake exam, not listed on the question history. No, the question is very similar but a different letdown configuration and different answer. This is the one in our bank. The 2015R question (Q65) would have E probably been more accurately marked as a modified 63 F 4 B B S to the bank question.

3. Since 3rd bullet says depressurization is in progress, Part 1 question should be RCS is being depressurized with ___ Corrected

4. Part 2 of question should be RCS cooldown rate is limited to < ____ °F/hr. Both procedures say less than Added 64 F 2 C B S

ES-401 22 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans)

1. First bullet - space between Unit 1 and Large Added E

65 F 3 A N 2. Should the reference be FRZ-0.2A, not S Containment Status Tree since it is an attachment to the procedure? Corrected

1. Will applicants understand the term vaulted or should question ask about the SO being sent to Operations Record Center? Vaulted is a common term at CPNPP and is even used in the same E paragraph with respect to Shift Order is not vaulted.

66 F 3 B N S 2. Consider moving Operations Standing Order to beginning of Part 1 question (like Part 2) for ease of reading. Reworded per recommendation and changed superseded to cancelled for agreement with procedure.

1. Change the names of the operators from Joe and Dave to something different than the parent question.

Joe & Dave are now Rick & Bill

2. Couldnt find NMG-114 on the Reference CD.

Provide all NMGs if not previously provided. NMGs were inadvertently omitted will be provided.

3. Format question as a question (Which of the M E following identifies the expected verbal 67 F 2 C (2011) S communications ) Done

4. The question clearly states verbal comm expectation is during implementation of ERGs within the CR - neither ref identified stated this so is there another ref that says this? Added ODA-102 Reference. Also, communication during emergencies falls into Critical and therefore this guidance must be followed.

1. This appears to be a bank from the 2013 initial license exam, not listed on the question history.

2. This question is SRO only knowledge. (ES-401, page 23, Evaluating core conditions and emergency B U classifications based on core conditions.) When 68 F 3 C X (2013) S used as a Bank question in 2013, this was an SRO question. Replaced with new question. [Question was not labeled as SRO in bank and was overlooked when reviewing the 2013 exam as only the RO portion was reviewed for the RO exam.]

ES-401 23 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans)

E 1. New question - not Bank Okay.

69 F 2 C N S 2. Minor edit to stem - remove bullet Done

1. Consider removing on 4/1/16 - Unit 1 from all 3 bullets and put it before the timed bullets for ease of reading. What is value of on 4/1/16? Removed 4/1/16 and moved Unit 1

2. Consider putting the MWth in the question stems for ease of reading. Moved

3. Question is written in 2 x 3 format (2 choices for E Part 1, 3 choices for Part 2). Was this intended? Yes 70 F 2 B N S this was intentional as a 2 x 2 would generate an implausible answer.

4. 3rd bullet - should it read 2100 - Calorimetric is performed instead of is due? Then the Part 2 question would have the at 2100 deleted. Corrected

5. First question - consider deleting at 1200 at the end since the time is given in the 2nd bullet.

Corrected.

1. This question is listed as a Modified bank, but only one minor change to the stem, and the answer does not change. This is a Bank question. Yes it is a bank.

2. Question in stem is worded better in the Bank question. Not per our reading fatigue improvement effort.

E 3. Explanation for Distractor A says Escorted Rad 71 F 2 C B E Worker is from a vendor - are all Escorted Rad Workers not CPNPP employees? They could be a S CPNPP employee, but want to avoid confusion with the applicants on escorted versus radiation worker.

4. Need to make sure terminology is correct -

Escorted Rad Workers are DDE and operators are TEDE (per STA-655, Attach 8.A) but question stems says DDE for both. Corrected.

ES-401 24 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans)

1. This is a direct lookup question (LOD=1). All an applicant has to do is look for the Contact RP sections. Then, knowing nothing else, can determine that exceeding 8 feet is greater than 7 feet, and thus U the correct answer.

72 F 3 X D B E 2. Overlap with RO Admin JPM RA4? Both include reviewing a RWP. Based on these two comments S rejected the K/A as demonstrating the ability to comply with RWP requirements without using a RWP does not seem practical. Replaced with Bank question from 2014 NRC.

Should the 3 SROs be identified as USs instead to match terminology in ODA-102, Attach 8.A? Since E the SM is an SRO, might an applicant think there are 73 F 3 B N S 4 SROs total or that the 3 SROs must include the SM? Might eliminate possible confusion. Added word other to eliminate confusion.

1. The explanation for Distractor C states that it is unlikely that only one white annunciator would alarm, not impossible. Need to ensure the correct answer is appeal-proof, or come up with some other distractors.

CPNPP does not have any parameters with Orange banding; thus Distractor C cannot be correct.

Distractor C is plausible because orange banding is allowed per OWI-109 it just has not been used yet at E

74 H 3 A N CPNPP.

S 2. OWI-109 as the reference - where does it discuss WHITE annunciator alarms? Page 6 of 11 has Red, Orange and Yellow but no White. White is the common term used to identify annunciators which do not have a color code. Included another portion of OWI-109 and OPGD 3 Att. 4 to explain. No concerns were raised during validation as to the use of the term White.

ES-401 25 Form ES-401-9

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 1.

LOD 6. Source 7. Status Q LOK 8. Explanation (1- Back (B/ M / N) (U /E /S)

(F/H) Stem T/ Cred. Job- #/ Q- SRO

5) Cues Partial Minutia ward Focus F Dist Link Units K/A Only (Ans)

First comment in sample item test review is still valid

- what reference states that the operator first refers to the LOGIC portion of ALM? How would this choice be defendable to a judge upon appeal? Removed the word first from the first question. The operator must E

75 F 2 C N refer to the LOGIC portion of the ALM to determine if S the control board alarm setpoint is exceeded. There is no ALM for plant computer alarms, however, there is a section of the ALM which provides Plant Computer points that the operator may refer to but they do not include setpoint and logic information.

ES-401 26 Form ES-401-9 SRO Only Portion of Written Exam

3. Psychometric Flaws 4. Job Content Flaws 5. Other

1. 2.

6. Source 7. Status Q LOK LOD Back 8. Explanation Stem Cred. Job- #/ Q- SRO (B/ M / N) (U /E /S)

(F/H) (1-5) Cues T/F Partial Minutia ward Focus Dist Link Units K/A Only (Ans)

1. Part 2 of Distractors A and B not credible.

Whether the applicant realizes the cause of the trip, he knows he has to perform natural circulation cooldown with no RCPs, thus eliminating two distractors. This is not accurate as both IPO-005A and EOS-0.2A can be performed with no RCPs running (See your Item 4 below). However, only one of the two is the correct procedural transition out of EOS-0.1A - that being a transition to EOS-0.2A.

2. SRO-Only statement is not correct. The stem provides status of plant in EOS-0.1A (diagnostics of plant conditions) with direction to perform a cooldown (procedure transition). Only knowledge required to answer question is RO knowledge of First Out Panel and purpose, overall sequence of events or overall mitigative strategy of a plant cooldown without RCPs.

Incorrect. As noted in answer to Item 1 both procedures can be performed without RCPs, but only one is a correct procedure transition to a sub-procedure which is not RO level knowledge.

E 3. From Alarm panel shown in stem, how does 76 H 2 C N S applicant determine that cause of Turbine trip was main generator lockout? ALM-4000A given as ref shows Digital Alarms that are not included in stem.

Also, how are other 3 Probable Causes listed in ALM-4000A ruled out? Not important to answering question. What applicant has is that the Turbine Trip was the First Out and the alarm panel provides sufficient information to determine that RCPs are not running.

4. Explanation for Part 2 of Distractor A says IPO-005A cooldown cannot be performed without RCPs, but PreReqs in IPO-005A (2.8) says that if RCPs are stopped, then PERFORM the compensatory actions of OWI-104-56 as required. What does this mean?

Incorrect statement in explanation as IPO-005A can be performed without RCPs running, but cannot be entered without RCPs running from EOS-0.1A.

Additionally, RCPs are maintained running in IPO-005A as long as practical. However, the procedure has contingent steps for performing a cooldown which did not initiate from the ERG network without RCPs running. Clarified explanations.

ES-401 27 Form ES-401-9

3. Psychometric Flaws 4. Job Content Flaws 5. Other

1. 2.

6. Source 7. Status Q LOK LOD Back 8. Explanation Stem Cred. Job- #/ Q- SRO (B/ M / N) (U /E /S)

(F/H) (1-5) Cues T/F Partial Minutia ward Focus Dist Link Units K/A Only (Ans)

1. Distractor B can be argued to be correct in addition to Distractor D. To ENSURE a valve is closed means to close it if it is not. The stem does not clarify that you should ensure the valve closes once the conditions are met. Incorrect, as closing the PORV with the current conditions is wrong. When the conditions are met at a later time the valve automatically closes, thus B cannot be correct without assuming additional plant conditions and additional failures. Therefore B is not defendable under any circumstances as correct.

2. Should stem indicate that SI has actuated? Has no pertinence on question and thus just adds additional material to the stem which is not necessary.

3. At CP, 1 SG blowing dry can reduce RCS temp to 330°F? Not under normal single faulted SG conditions. However, with full AFW flow and operator inattention allowing the other generators to blow down until MSLI, approaching this value is not E unprecedented during simulator scenarios 77 H 4 D N E 4. Where is WR RCS temperature read? Should Loop Thot be used instead with RCPs running? WR S temperatures is a generic term for Tcold and Thot which should be very similar with RCPs running.

CPNPP actually uses Tcold.

5. In this event, securing RCPs is not a significant concern until pressure lowers to well under 1,000 psig, correct? Correct.

6. SRO-Only statement is not correct. Knowledge of diagnostic steps and decision points in the EOPs Reworded SRO only statement.

7. If PORV 456 is just leaking, could CRS direct opening PORV block valve since PORV should be open anyway and then close it when press is < 580?

This could make Distractor A also correct. Note the RNO to Step 5c states Manually open one block valve unless it was closed to isolate an open PORV.

If the SRO chose to open a block valve to the leaking PORV this would require an ERG procedure deviation which requires at least 2 SROs to concur with, thus not practical while answering a written question.

ES-401 28 Form ES-401-9

3. Psychometric Flaws 4. Job Content Flaws 5. Other

1. 2.

6. Source 7. Status Q LOK LOD Back 8. Explanation Stem Cred. Job- #/ Q- SRO (B/ M / N) (U /E /S)

(F/H) (1-5) Cues T/F Partial Minutia ward Focus Dist Link Units K/A Only (Ans)

1. How can you be certain that S/G levels are still above 50% (correct answer explanation discusses that S/G levels would initially be 67%, but it is not apparent that levels are guaranteed to be above 50%) Based on BOL conditions ambient losses often approach the heat input of the RCPs making it difficult for plant heatup. Under normal conditions each SG would be fed at less than 100 gpm while maintain 10-8 amps. The increase in AFW flow to 860 gpm as required by FRS-0.1A step 3 would have increased the SG levels from the starting value thus it E is likely that the SG levels are > 70% at this time.

2. To get to Step 10, Reactor must still be critical 78 H 4 A N E otherwise at Step 8, operators would go to Step 18.

S So either Reactor still > 5% power or IR SUR is not negative. Since stem says critical at 10-8, reactor is below POAH, correct? MSIVs are closed, yes? Then essentially no steaming so SG levels should not lower much, correct? Correct.

3. What happens to Reactor power during SG blowdown? Does it reach POAH? The question assumption is that it continues to maintain a zero startup rate.

4. Change 5th bullet to read Operators transitioned from EOP-0.0A to FRS-0.1A, Response to Nuclear Power Generation/ATWT Added

ES-401 29 Form ES-401-9

3. Psychometric Flaws 4. Job Content Flaws 5. Other

1. 2.

6. Source 7. Status Q LOK LOD Back 8. Explanation Stem Cred. Job- #/ Q- SRO (B/ M / N) (U /E /S)

(F/H) (1-5) Cues T/F Partial Minutia ward Focus Dist Link Units K/A Only (Ans)

1. Unless we expect the applicants to memorize Step 8 of EOP-2, add to 4th bullet what step 8 is Check if ECCS Flow Should be Reduced Added

2. The bullets should be presented in a logical order to help the applicants process the info. Usually, this is chronological order as thats how train, going through the procedures. So fault occurs (MSLB), E-0 is entered, AC Safeguards buses (2ST, 2EA2), SI status (can make applicant determine without specifically stating), AFW alignment (AFW flow), RCS E temperature and trend (should this be provided?)

subcooling, then transition to EOP-2, Step 8 in E

79 H 3 X D N progress, AFW flow if changed, SG levels and trend, S subcooling if changed, RCS pressure and trend, PZR U level and trend. Made editorial changes to stem to improve flow. Parameters were in correct order for determinations required by question.

This question was submitted as a post-exam comment - CPNPP recommended accepting distractor C as the correct answer and not accepting answer D as a correct answer. The NRC resolution for this question was to delete it from the exam.

Therefore, this question as submitted and enhanced is evaluated as Unsat for the purpose of determining whether CPNPPs submittal was Sat or Unsat.

1. Part 1 of Distractors B and D not plausible, as it seems apparent that any licensed operator could be assigned to perform a procedure during EOP implementation. (In the case where the control room is staffed by two ROs and a Unit Supervisor, there U

80 M 3 X A X N would be no SRO to give it to.)

S 2. For Part 2 - appears the closure of all 4 FWIVs is an entry condition (symptom) into the ABN, which is RO level knowledge. Agreed with comments. Unable to write an SRO question to selected K/A. Reselected and developed new question.

ES-401 30 Form ES-401-9

3. Psychometric Flaws 4. Job Content Flaws 5. Other

1. 2.

6. Source 7. Status Q LOK LOD Back 8. Explanation Stem Cred. Job- #/ Q- SRO (B/ M / N) (U /E /S)

(F/H) (1-5) Cues T/F Partial Minutia ward Focus Dist Link Units K/A Only (Ans)

1. The K/A listed on the outline does not match the K/A on the question. (It appears the initial outline submittal provided by the NRC was incorrect. Please E correct the outline.) Corrected on worksheet.

B 81 H 4 B E 2. This question is listed as a Modified bank, but only (2015) one minor change to the stem, and the answer does S not change. This is a Bank question from the 2015 NRC exam. Identify on the worksheet. Listed as 2015 NRC Bank.

1. Are there any other power requirements that may be more conservative due to the difference in Power 82 H 3 A N S Range Channel Readings? i.e., QPTR. No

2. This is a LOK=H question. Agree

1. Would 8 hours9.259259e-5 days <br />0.00222 hours <br />1.322751e-5 weeks <br />3.044e-6 months <br /> be a better part 2 distractor for Distractors B and D (2 hours2.314815e-5 days <br />5.555556e-4 hours <br />3.306878e-6 weeks <br />7.61e-7 months <br /> plus 6 hours6.944444e-5 days <br />0.00167 hours <br />9.920635e-6 weeks <br />2.283e-6 months <br />)? Done

2. For C and D, Part 1: Add System after Rod Control to match OPT-106A. Done

3. For Part 2 question - does clock start at time of E discovery or at completion of OPT? Discovery, 83 H 4 C N E however the surveillance would be considered complete for those rods when the malfunction occurs S per the note of LCO 3.1.5: This LCO is not applicable while performing SR 3.1.4.2 no longer applies from the time of the malfunction.

4. Is applicant expected to have memorized SDB RILs? Yes, for Shutdown Banks - Not Control Banks 84 F 3 B N S

ES-401 31 Form ES-401-9

3. Psychometric Flaws 4. Job Content Flaws 5. Other

1. 2.

6. Source 7. Status Q LOK LOD Back 8. Explanation Stem Cred. Job- #/ Q- SRO (B/ M / N) (U /E /S)

(F/H) (1-5) Cues T/F Partial Minutia ward Focus Dist Link Units K/A Only (Ans)

1. Is listing all cold leg temps the only way for the applicant to rule out a false FRP indication? Seems like cueing Is loss of RCPs enough info? Yes, all Tcolds are needed and this is not cuing as it is necessary information for the determination of the plant conditions.

E 2. Why not give applicant enough data for them to diagnose an RCS cooldown in progress (3rd bullet) -

85 H 4 C B E more operationally valid. Corrected S 3. Why is Leg 3 so much colder? Because once the ruptured SG is stopped from steaming, the loop becomes stagnant and the cold leg temperature approaches the temperature of ECCS injection flow.

4. Bullets are out of order - put in sequence to aid applicants in processing information to the extent possible/reasonable. Reordered.

1. The stem states that unit 1 is in Mode 3 waiting to enter mode 2, but TCA 1.7 assumes initial reactor power is full power plus 0.6 percent. If so, does the TCA apply, thus does the procedure expediency apply? (procedure expediency applies per OPGD-3, Attach 6, but ref to TCA is incorrect. In fact, it would be a good distractor to see if applicants understand that stem doesnt match initial cond of TCA) The analysis assumptions for the worst case Inadvertent SI are different from those in the question and thus the TCA should not have been used as a reference E

86 H 2 B N for question. Procedure expediency guidance per S OPGD-3 is the basis for the actions and correct answer.

2. KA Match statement is incorrect. Applicant does NOT have to determine an inadvertent SI has occurred since its the 2nd bullet! Also, reference to the requirements of the safety analysis is incorrect as the initial conditions in the analysis do not match the stem. (Ref to TCA is also incorrect in SRO Only statement) Corrected.

3. 2nd bullet should read An Inadvertent SI occurs Done

ES-401 32 Form ES-401-9

3. Psychometric Flaws 4. Job Content Flaws 5. Other

1. 2.

6. Source 7. Status Q LOK LOD Back 8. Explanation Stem Cred. Job- #/ Q- SRO (B/ M / N) (U /E /S)

(F/H) (1-5) Cues T/F Partial Minutia ward Focus Dist Link Units K/A Only (Ans)

1. Knowledge of TS LCO 3.7.7 is not tested since it is in all answers. Applicant only needs to know 3.4.6.

Is required knowledge of 3.4.6 RO level knowledge or SRO (at LOD=1)? Incorrect as the entry into LCO 3.4.6 is driven by a NOTE below the line in LCO 3.7.7 and thus this is SRO knowledge. As ROs do not declare equipment inoperable SRO knowledge is 87 H 3 C N S required to determine that One required RCS loop is inoperable. The SRO must make a determination that one train of CCW inoperable and that a supported system LCO which would not normally need to be entered per TS rules of usage does need to be entered.

2. Question is New, not Bank Corrected.

1. Does procedural hierarchy have you respond to alarms and Alarm Procedures first? If so, then 1ALB-8B would be correct, as that is the first procedure to go to, which directs you ABN-305. That would make both part 2 distractors correct. (If procedure hierarchy doesnt specifically direct entry into ABN first - allows U

88 H 2 X X D N concurrent entry - then 2 right answers) Revised S stem to properly distinguish which procedure the proper action is driven from and improved wording.

2. Reference for TDAFWP Steam Admission Valve powered from 1ED2? Added ALM Reference.

Drawing references were very difficult to size to a readable version for inclusion. E1-0020 Sht. F.

Would the question work better if part 1 distractors on B and D were SG 1-04 ARV is OPENED using its CONTROL OVERRIDE SG 1-01 and SG 1-03 ARVs E

89 H 3 A N are fully OPENED using their controllers in manual S Both the current wording and the proposed wording are acceptable. Do not see benefit of rewriting and potentially introducing an error.

1. Since the stem states During turbine runback, the applicant need not interpret any indications, thus U the question does not meet the K/A. Reworded to 90 F 3 D X N E ensure the applicant interprets.

2. Part 2 of question is SRO knowledge but doesnt S meet KA. Part 1 meets the K/A which meets the requirements.

ES-401 33 Form ES-401-9

3. Psychometric Flaws 4. Job Content Flaws 5. Other

1. 2.

6. Source 7. Status Q LOK LOD Back 8. Explanation Stem Cred. Job- #/ Q- SRO (B/ M / N) (U /E /S)

(F/H) (1-5) Cues T/F Partial Minutia ward Focus Dist Link Units K/A Only (Ans)

1. How does this meet KA for Containment Iodine Removal? Also, how is verify system alarm setpoints met? Preaccess filtration is the only iodine removal system at CPNPP. After reviewing these U comments determined that writing an operationally 91 F 2 A X N S valid SRO level question for the K/A was not possible. Rejected K/A and wrote new question.

2. The SRO Only aspect is LCO Tracking Program for Containment Isolation Valves when KA is Containment Iodine Removal?

1. Is stem operationally valid? Would operator transition from E-0 to E-2 with Containment press >

18 psig? Yes E 2. Part 2 of A and C is not plausible (or LOD=1).

92 F 3 D B S Disagree. Knowing when to perform the FRZ is a difficult SRO Rules of Usage learning point as demonstrated by the fact that an entire table of ODA-407 is committed to this very item.

93 F 3 B N S

1. What is diff between permission to change Mode and approve Mode change? The permission requirement is a single signoff in the process of 94 F 3 C N S MODE changes. The approval is the final authority that states that all permissions have been granted and that the MODE change can proceed.

1. The only answer that doesnt begin with the word with is the correct answer cueing? Can Distractor B E A be reworded? Reworded Answer to make agree 95 F 3 B (2013) S with psychometrics of distractors.

2. This appears to be a bank from the 2013 NRC exam, not listed on the question history Agree 96 F 4 A N S

ES-401 34 Form ES-401-9

3. Psychometric Flaws 4. Job Content Flaws 5. Other

1. 2.

6. Source 7. Status Q LOK LOD Back 8. Explanation Stem Cred. Job- #/ Q- SRO (B/ M / N) (U /E /S)

(F/H) (1-5) Cues T/F Partial Minutia ward Focus Dist Link Units K/A Only (Ans)

1. Stem cues that two distractors are incorrect. The cue states that a Batch Liquid Radioactive Effluent Release is planned, and the correct answer is a Batch Radioactive Effluent release. This makes part 2 of Distractors C and D implausible. Disagree, validators have selected D during both validations.

C has not been picked based on individuals knowing E

97 F 2 B N the time is 15 minutes and thereby eliminating C, but S both must be plausible as D has been selected by several individuals.

2. Borderline Non-Tier 3 question as it does not test to plant-wide, generic knowledge. It is specific to a given set of plant conditions. Disagree as Generic K/A statement drives to a specific given set of plant conditions.

98 F 2 D N S This is not a tier 3 question. It does not focus on U plant-wide generic knowledge and abilities and is an 99 H 4 X A N E extension of Tier 2, Plant Systems. Based on this feedback rejected K/A as it cannot be written to for S Tier 3.

While question is a modification of the question B attached, that question has been modified before.

100 H 2 C S (2010) This is a Bank question from 2010 initial license exam, Question 100. Identify on worksheet. Done.

S - 16 (21%)

RO: E - 48 (64%)

U - 11 (15%)

S - 8 (32%)

SRO: E - 11 (44%)

U - 6 (24%)

Instructions (Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts:

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

ES-401 35 Form ES-401-9

3. Psychometric Flaws 4. Job Content Flaws 5. Other

1. 2.

6. Source 7. Status Q LOK LOD Back 8. Explanation Stem Cred. Job- #/ Q- SRO (B/ M / N) (U /E /S)

(F/H) (1-5) Cues T/F Partial Minutia ward Focus Dist Link Units K/A Only (Ans)

2. Enter the level of difficulty (LOD) of each question a 1(easy) to 5 ( difficult); (questions with a difficulty between 2 and 4 are acceptable)

3. Check the appropriate box if a psychometric flaw is identified:

• Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

• Cues: The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc.).

• T/F: The answer choices are a collection of unrelated true/false statements.

• Cred. Dist: The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

• Partial: One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

• Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

• Minutia: The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

• # / Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

• Backward: The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those K/As that are designated SRO-only (K/A and license level mismatches are unacceptable)

6. Enter questions source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet the criteria of ES-401 Section D.2.f.

7. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of Iditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any U Status ratings (e.g., how the Appendix B psychometric attributes are not being met).