ML13169A437

2013 Braidwood Station Initial License Examination Written Examination Review Form ES-401-9

ML13169A437
Person / Time
Site:	Braidwood
Issue date:	04/15/2013
From:	NRC/RGN-III
To:	Exelon Generation Co
Zoia, C.
Shared Package
ML11354A318	List: ML13165A158 ML13169A433 ML13169A434 ML13169A435 ML13169A437 ML13169A438 ML13169A439
References
Download: ML13169A437 (17)

Text

ES-401 Written Examination Review Worksheet Form ES-401-9 Braidwood March 2013 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 1+ H 3 N S 2 H 3 N U NRC: The explanation for the correct answer could be read as 78 minutes or 84 minutes (02:24), but the correct distractor (B) says E

78 minutes (02:18) - which answer is right? Also, distractors C and D are too long periods of time to be plausible.

Licensee: The 84 minute (02:24) explanation was from a previous version and was updated to its current value of 78 minutes (02:18).

Also, due to the plausible technical basis of the second longest distractor, only the longest distractor was deemed implausible and replaced.

3 H 2 N E NRC: Explain why would distractor A (none) be plausible? Also, change distractor B to B and C, this is more plausible. The heater groups shouldnt be mixed.

Licensee: Distractor A was considered to be plausible because it was plausible that no heaters would automatically energize upon restoration of power to a specific bus under given conditions.

Moved the third bullet to top in stem. The last bullet was deemed necessary to make clear that other potential procedural action was NOT yet performed, and clarified the current condition of the system.

4 H 2 N S NRC: 1/2 twice style noted - Satisfactory as-is. Case 2 physical description question (with core at saturation - shouldnt temperature & pressure be trending together?) answered adequately (not necessarily throughout the entire system) - no changes needed.

5 F 2 M E NRC: Distractor C is not plausible (Neither), a procedure would be used. Is there another procedural possibility for this situation?

Suggest clarifying the stem to ask for which procedure entry conditions exist to avoid being an SRO Only question.

Licensee: Replaced distractor C as suggested with 0BwOA Refuel-2, REFUELING CAVITY OR SPENT FUEL POOL LEVEL LOSS.

With humidity rising, the applicants may consider a gradual level loss possible. Also, restructured the stem to ask which procedure entry condition existed - therefore, the question was clearly RO level. Finally, revised the explanation to further clarify.

Page 1 of 17

ES-401 Written Examination Review Worksheet Form ES-401-9 Braidwood March 2013 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 6 H 2 X N U NRC: Distractors A and B are not plausible. The pressure lines cannot cross based on stem conditions, and what is the difference F

(or the limit) that these choices are trying to convey? K/A implies that the change in S/G pressure is the result of a component manipulation (e.g., throttling a steam dump or atmospheric vent).

Licensee: Question was replaced with a new, fundamental level question.

7 F 2 N U NRC: 1/2 twice style noted - How is hot well level going to adversely affect the LP turbines? How are distractors A & D plausible?

E Licensee: Due to the LP turbines proximity to the condenser and its interrelationship with condenser pressure, all choices were considered plausible. Clarified the explanations only.

Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

• The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

• The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

• The answer choices are a collection of unrelated true/false statements.

• The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

• One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

• The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

• The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

• The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

• The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).

A + in the Q# column indicates that question was reviewed as part of the representative sample of 30 questions.

Page 2 of 17

ES-401 Written Examination Review Worksheet Form ES-401-9 Braidwood March 2013 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 8+ F 3 N E NRC: Distractor D should also contain 1SD002A-H. One of the answers should contain all the valves.

Licensee: Changed distractor D to contain the SD002 valves as suggested.

9 F 2 N U NRC: 1/2 twice style noted - ONLY 0PR02J is not plausible; 1/2PR28J (Vent Stack) monitoring is obvious. Suggest to change ONLY 0PR02J to ONLY 1/2PR28J OR a.The release will be unmonitored and unisolable b.The release will be unmonitored and isolable c.The release will be monitored and unisolable d.The release will be monitored and isolable Licensee: Selected the option to substitute 1/2PR28J for 0PR02J in distractors A and B.

10 F 2 M S 11 H 3  ? M E NRC: A) Distractor B is implausible because BOTH the temperature rises (in different areas) occur due to 1CC9414 closing ONLY. B) Case 2 (1CC9438) is not addressed by itself in any distractors.

Licensee: A) Distractor B - plausible because its first statement was actually correct, and the applicant then had to discern the second statement was not. B) Distractor D - changed second statement to address NRC comment.

12 H 3 N S 13+ H 3 N S 14 H 3 M S 15 H 3 B S NRC: (2009 NRC Exam) 16+ F 2 N S 17+ F 2 N E NRC: The question stem uses reverse logic. The question might ask, for example, For which of the following would the actual PRT level remain constant or decrease with the same distractors and solution.

Licensee: Revised the stem to Which of the following will result in PRT level staying constant:

Page 3 of 17

ES-401 Written Examination Review Worksheet Form ES-401-9 Braidwood March 2013 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 18 H 3 N E NRC: While ES-401 clearly allows limiting the scope of the K/A, in this case, this question could easily accommodates using the full S scope. For example, if the pump works, refer to 1BwOA PRI-10 (or PRI-6) and the time, or refer to the AOP if it does not.

Licensee: Entering either PRI-6 or Pri-10 was correct, so this aspect was not included. Question was SAT as-is.

19 H 3 N S 20 H 2 N E NRC: The question uses reverse logic (i.e., each of the following will cause a reactor trip EXCEPT). The question should seek the proper action for the current conditions, versus identifying improper actions to be avoided.

Licensee: Changed stems last sentence to which of the following can be performed without causing a reactor trip.

21 F 2 N S 22+ H 2 N S 23 H 3 B E NRC: The second bullet is unneeded. Also, the explanation does not say why the pump cannot be manually started (simply states that the U

auto start is prevented).

Licensee: Deleted second bullet. Also, added a pump interlock explanation. Upon further licensee review, the original question could be argued to have two correct answers. Revised distractors A &

D: revised A to add, with suction from RWST and revised D to add, from RWST.

24+ F 3 B E NRC: The distractors provide more information than elicited by the stem to differentiate similar choices. The stem needs to be adjusted so each distractor answers the question asked.

Licensee: Restructured the stem to be a 2 part question. Part 2 now requires, This results in to address the previously unasked information. Also, inserted ONLY before ONE in distractor C.

Page 4 of 17

ES-401 Written Examination Review Worksheet Form ES-401-9 Braidwood March 2013 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 25 X M U NRC: Does not match K/A. Limits in questions are for Primary System. System for K/A is Main and Reheat Steam, a Secondary S

System with separate limits.

Licensee: The question met the K/A due to its focus on the H 2 operational implications of a cool down of the Primary System (correctly applying appropriate limits), which is normally accomplished using Secondary System cooling (Main Steam). In addition, the question was modified from a question originally on the 2009 Braidwood NRC Exam (that used the same K/A). Therefore, the question was found to be SAT as-is.

26 H 2 N S 27 H 3 N S NRC: Accepted the requested change (below) - including noun names with EPNs was also made a Generic Comment.

E Licensee: Author comment (accepted): add valve name for AF005A in stem. Added EPN for local remote switch on PL04J.

28 F 3 B S 29 F 2 N S NRC: Accepted the requested question clarification.

E Licensee: Author comment (accepted): consider stem change to replace indicate that with would cause and replace has opened with to open 30+ H 2  ? N U NRC: The loss of DC bus event is well known reactor trip. Thus, the 2 distractors that dont contain it are implausible. Also, reactor trips E

are not the only event that results in a change in Mode. Finally, explain more fully how the questions meets the intent of the K/A.

Licensee: Agreed to an enhancement of the stem to replace events 2 and 3. Also, modified distractors and enhanced the explanation to reflect the changes and the K/A concern.

31+ F 2 N E NRC: The loss of the 1A and 1C tanks causing the 1B EDG ONLY to fail to meet TS limits is implausible.

S Licensee: The licensee explained that several systems do not follow the typical A-C : Train A / B-D : Train B logic, therefore, 1B EDG ONLY was acceptable and the question was SAT as-is.

Page 5 of 17

ES-401 Written Examination Review Worksheet Form ES-401-9 Braidwood March 2013 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 32 F 2  ? N E NRC: Based on the conditions and the other distractors that all have 2 limits exceeded, exceeding ALL limits seems more plausible than exceeding NO limits (Distractor A). Finally, explain more fully how the questions meets the intent of the K/A.

Licensee: Included in the answer explanation that the reference was a placard on the MCB and added more detail. Included the reference to the placard (and procedures) that listed the following limits:

Continuous: 5500 KW @ 954 amp 2000 hour0.0231 days <br />0.556 hours <br />0.00331 weeks <br />7.61e-4 months <br />s: 5500-5935 @1030 amp 2hrs in 24 hrs: 5935-6050@1050 amp Finally, needed to bound the stem by time; thus, changed the phrase just prior to the data list to The following indications have been present for the past 2 hour2.314815e-5 days <br />5.555556e-4 hours <br />3.306878e-6 weeks <br />7.61e-7 months <br />s:

33 H 1 B U NRC: Since PR monitors detect radiation levels and not dose, Case 1 is clearly the correct answer (LOD = 1). Also, If any of the other 2 S answer choices were correct there would be multiple correct answers (that is., A, B, C are subsets of D; A, B are subsets of C; and A is a subset of B).

Licensee: Because no other answer choices are correct, no subsets exist. Also pointed out that the question was on Byron 2012 NRC exam and validated at a success rate of 76.9% for 13 operators. At Braidwood 3 of 8 validators also missed the question (62.5% success rate). Since the question clearly tested a common misconception of dose versus radiation level, the question was deemed SAT as is.

34+ F 2 N S 35 H 3 N U NRC: The level of detail specified in the distracters requires memorization of Supplemental Action details beyond the level S

required for closed book exams.

Licensee: The question tested required system knowledge and required operator action summaries - SAT as is.

Page 6 of 17

ES-401 Written Examination Review Worksheet Form ES-401-9 Braidwood March 2013 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 36 F 2 B U NRC: 1/2 twice style noted - The procedural limitation (versus a physical limitation) may make C correct. Also, please specify where pressure is read/measured.

Licensee: Added to the stem per BwOP SA-1, startup and operation of station air compressors. In stem, after the ___(1)___

be procedurally required Added a bullet that local SAC control cabinet supply pressure is 28 psig due to a large leak that has been temporarily repaired. At end of the last bullet in the stem add on the MCB (this was where pressure was read). Author comment (accepted): Deleted the first 3 bullets in the stem - they were unnecessary.

37 F 2 B S NRC: (2009 NRC Exam) 38+ H 2 N S 39 H 2 B E NRC: Since PRNIs are below 5% and decreasing, FR-S.1 is implausible for an Immediate Action step. Suggest a PRNI value of 5% and SLOWLY decreasing to increase its plausibility. Explain K/A match also.

Licensee: Changed power level to 5% and dropping. After discussion - K/A met. Also, rephrased the last stem statement to read, Of the following, the next procedurally required action is 40 H 2 B S 41+ H 3 N S 42 H 2 B S NRC: Author comment (accepted): changed distractor A to read RCP versus spelling out reactor coolant pump to match the other E

distractors. Also, insert ONLY before if in distractor B.

43+ F 2 M E NRC: Starting the 1B pump with CV121 full open is implausible.

S Licensee: Plausible because 1BwOA PRI-15 does this if at full Normal Operating Pressure. Deemed acceptable as is.

44 F 3  ? N U NRC: K/A is related to loss of RH but nothing in question states loss of RH or component.

S Licensee: Showed that a loss of RHR was implied.

45 H 2 N S Page 7 of 17

ES-401 Written Examination Review Worksheet Form ES-401-9 Braidwood March 2013 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 46 H 2 N S 47 F 2 N U NRC: 1/2 twice style noted - the procedural selection portion is inappropriate for the RO applicants.

E Licensee: Modified the explanation to state that the mitigating strategies referenced are the major action categories listed in the Westinghouse ERGs and required knowledge for all ROs.

48 H 2 N U NRC: Procedural selections and appropriate transitions are inappropriate for the RO applicants.

E Licensee: Added KA explanation that per objective T.CA3-05, Operator Action Summary (OAS) knowledge, though not specifically called out, is required.

49+ H 2 N E NRC: The second part of each of the answers is not asked for.

These should be either deleted or the question stem should be modified to include and how is it prevented.

Licensee: Changed distractor A to starting standby HD pump.

Restructured the stem to make this a 2-part question. Moved This is prevented by ___ to the second part of the stem.

50 F 2 N S 51+ H 1 N U NRC: 1/2 twice style noted - LOD = 1 for (1); if they know that the plenum is in the reactor, and then its a direct lookup in the steam tables. Also, this seems like a LOK = H question.

Licensee: Changed the stem so the first part asked where the saturation was occurring (plenum or SG tubes) and moved the temperatures up to the stem. Also, changed the RCS CL temperature to be somewhat subcooled and changed part (1) of each choice to match new stem structure. Finally, fixed distractor Ds repeated word typo and ensured the low LOD was corrected.

52 H 3 N U NRC: Distractor A may also be correct or partially correct because the controller wont control in auto until the operable channel is E selected. The AOP directs manual control of level until the operable channel selected, and L/D must be restored.

Licensee: Clarified the question to specifically ask about letdown isolation and also economized wording. 1/2 twice style used.

Page 8 of 17

ES-401 Written Examination Review Worksheet Form ES-401-9 Braidwood March 2013 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 53 H 3 N E NRC: 1/2 twice style noted - the distractors would be clearer in a table format versus written as sentences. Also, consider drops slightly instead of NOT to zero gpm.

Licensee: Restructure choices into two column format and reworded distractors, as requested.

54+ F 2  ? B  ? NRC: Is this knowledge required from memory? Remove the words In accordance with BwOA PRI-8 in the stem. Enhance the E

explanation of why wrong choices are wrong.

Licensee: Verified that this knowledge was required from memory.

Removed in accordance with 2BwOA PRI-8 and added the following explanations:

• B: Isolating SX to both unit 2 chillers is not directed by the procedure.

• C: procedure does not direct this action either and insufficient load would be removed to support remaining operation of loads.

• D: this action may only be done after opening the 1SX005 and only if SX header pressure is subsequently less than 90 psig.

55 H 3 B S 56 H 3 N S NRC: What is the base adjuster control switch and what does it do.

Explain why this is wrong.

E Licensee: Added the explanation: The base adjuster will do nothing if the voltage regulator is in automatic. Control is shifted to the Base Adjuster if the automatic voltage regulator is taken to off. Author comment (accepted): Changed voltage regulator control switch to volt adjustor control switch.

57 H 2 N S 58 H 2 N S NRC: 1/2 twice style noted. Explain how the response tests the knowledge of the reasons for the difference in the power limits.

Licensee: The reasons for the difference in the power limits were explained to be inherent in the selection of the alignment method and power level restrictions (where Xenon is the basis).

Page 9 of 17

ES-401 Written Examination Review Worksheet Form ES-401-9 Braidwood March 2013 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 59+ H 2 N S NRC: 1/2 twice style noted - satisfactory as-is. Question: Overlap between IRNI and PRNI: Is there a published thumb rule?

Licensee: No thumb rule for this. Referred to big note NI-2.

60 H 2 N U NRC: Distractors A and B are not plausible. Automatic realignment of ventilation, IF it occurred, would be the result of High E

Radiation, and would be indicated first by an ALERT alarm. Also, it has similarities to Question 62.

Licensee: Reworded distractor A to look similar to B. Also, editing performed on Question 62 to avoid noted similarities.

61 H 3 X B U NRC: Yellow is not a plausible RM-11 color and this question is very similar to Question 34. Also, this question does not apply an S

accidental release situation (K/A not met?).

Licensee: Meets the K/A because CW dilution was reduced to be below the release allowance and thus becomes an accidental release situation. Also, with lower dilution flow, yellow is plausible due to the higher concentration of radiation in the blowdown effluent. Accepted the question as is.

62+ H 2 N S NRC: Author comment (accepted): Deleted the first 3 bullets of stem to eliminate apparent similarities with question 60.

E 63 F 2 B S 64 H 3 N S NRC: Delete the reference to procedure ES-0.4 in the stem - ROs are not responsible for specific procedural actions from memory.

E Licensee: Deleted as directed by 1BwEP-ES0.4 65+ F 2 N U NRC: Are operators expected to memorize status trees?

S Licensee: They are expected to know all red paths including the parameters needed to assess them. Added the objective number to the explanation.

Page 10 of 17

ES-401 Written Examination Review Worksheet Form ES-401-9 Braidwood March 2013 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 66 F 2 N E NRC: Unlimited access is implausible, and distractor A does not address the Zone of Control at all. Also, the second part of C could be interpreted as either person may grant authorization.

Explanation should include why only the RO can grant permission (seems like the SM has overall authority).

Licensee: Revised A (first part) to match B, and A (second part) to say once this permission is gained, has unlimited access.

Modified the stem to The student will obtain. Modified C (second part) to BOTH must authorize. Added explanation that the RO is only person who may authorize entry into the zone of control.

67 H 3 B U NRC: 1/2 twice style noted - it would not be plausible for the license to become inactive at the end of the next quarter (July 1) when another shift is needed for an active license in the current quarter.

Licensee: Added bullet to stem to say that the NSO was on medical leave during the second quarter of year. Changed second part of C and D to six/seven.

68 H 2 N S 69 F 2 N U NRC: 1/2 twice style noted - Maximum Boron Concentration is implausible.

Licensee: Replaced with Average of 10 highest CETCs.

70+ F 2 M S 71 F 2 B S NRC: (2011 NRC Exam) Cert Exam overlap noted.

E Licensee: To differentiate this question from the cert exam, changed the stem to have the OB train in normal operation, and the OA train in standby (the correct answer was now B).

72+ F 2 M S 73 F 2 M E NRC: Expediting releases is implausible (C).

Licensee: Replaced with Start all EDGs.

74 F 3 B E NRC: Transitioning to ES-0.0, REDIAGNOSIS is implausible.

Consider using FR-C.1 instead.

S Licensee: ES-0.0, REDIAGNOSIS has been used correctly occasionally in recent situations, distractor was acceptable as is.

Page 11 of 17

ES-401 Written Examination Review Worksheet Form ES-401-9 Braidwood March 2013 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 75+ F 2 N S For RO portion of Exam: N(10%,8)=49, M(11)=9, B(<75%,56)=17; LOK: F=32, H(50-60%,38-45)=43; E=28, U(20%,15)=7 Average LOD=(174/75)=2.32 76 H 3 N U NRC: ECCS CANNOT be relied upon to perform its UFSAR safety function is not correct. Assuming (1) With NO further operator E

action the CV pump will likely continue to inject until the pump, gear changer, or motor bearings fail, but that wont be for some time.

That is, there isnt a high temperature trip associated with high oil temperatures for the CV pumps. It needs to be shown that the CV pump wont run 24 hours2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br /> with SX discharge pressure at 82 psig.

Therefore, no correct answer.

Licensee: Cannot be relied upon to perform its UFSAR safety function defines inoperable, which it is. Enhancement: removed the phrase SI pumps ensure from distractors B and D (first part).

77 H 2 N S 78+ H 3 N E NRC: Distractor B is only plausible when RCS is adverse and given plant conditions it clearly is not. Suggest changing it to steam the intact Steam Generators. Level of detail - is this beyond what is required for closed book exam? Also, need to reference the appropriate procedures for each of the actions per 55.43(b)5.

Licensee: Distractor B was plausible because applicants must determine both that the choice required adverse containment and the condition did not exist. Therefore, only a minor editorial change was required - deleted the is in third bullet after Subsequently.

Finally, reference to the appropriate procedures for actions is implied.

79 H 3 N E NRC: Distractor D (2) must be changed. With both SR detectors inoperable, Mode 1 is implausible. Suggest using Mode 6 in case somebody believes you cant change modes with both SRs inoperable. Explain the procedure selection element.

Licensee: Changed distractor D (part 2) to Mode 6. Procedure usage was identified as TS 3.3.1 and 3.0.4 (recognize mode limitations). Also modified answer C (part 2) to but rods must be maintained in a condition where they are NOT capable of withdrawal. Left 10CFR reference unchanged.

Page 12 of 17

ES-401 Written Examination Review Worksheet Form ES-401-9 Braidwood March 2013 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 80 F 2 N U NRC: Distractors C & D are implausible for tripping the RCP at step 18 of E-0 because waiting that long would cause an SI.

E Suggest making these distractors trip the RCP followed by 1BwEP ES-1.1, SI Termination.

Licensee: Changed distractors C & D (part 2) from at step 18 1BwEP-0 to trip the 1B RCP for C, and to trip the 1D RCP for D. Also, added a bullet in stems procedure list for ES-1.1. Finally, added continue implementation of 1BwEP-0, followed by 1BwEP ES-1.1 to distractors C & D.

81 F 2 M E NRC: Is the bullet for control rods are operating properly necessary? Also, reference the appropriate procedures for each of the actions per 55.43(b)5.

Licensee: Modify the last bullet to remove and functioning properly. Reference to the appropriate procedures is implied.

82+ H 2 N E NRC: Enhance distractors C & D by adding and stop the 1A CV pump to the second part of the distractor so that the applicant has to S

decide if he should secure all pressurization sources or just a CV pump. In other words, the applicants choice should be deciding between just a CV pump or both a CV and a RHR pump, not between a CV or a RHR pump.

Licensee: If added, the same action would be in all 4 distractors and unneeded in any. An argument could also be made that stopping the 1B RH pump (in conjunction with stopping the 1A CV pump) was correct (preventing the RH relief valves from lifting). However, stopping the RH pump alone would not mitigate the event.

Therefore, no change was needed.

83+ F 3 N S 84 H 3 B S 85 H 3 B S NRC: Question: Are operators expected to know status trees?

Licensee: Yes, red path status trees are required knowledge.

86 H 2 N E NRC: The stem should be consistent related to the annunciator and bypass permissive. One is . CLEARED. the other is CLEARED (DARK). Either add a (DARK) or remove it. Suggest removing it, as the applicants should know the terminology.

Licensee: Deleted (DARK).

Page 13 of 17

ES-401 Written Examination Review Worksheet Form ES-401-9 Braidwood March 2013 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 87+ H 3 N S 88 H 2 B E NRC: Distractor D is implausible. Why would one transition to CA-1.1 for one train of RHR being available with suction from the S containment sump? A better reason could be which will direct 1SI8812A to be closed. Verify that reason is actually incorrect.

Licensee: If an RH pump was not running in ES-1.3, step 3.b, the RNO column is performed. The last step in the RNO column is transfer to CA-1.1 if neither RH pump is running. This is plausible because status of the pumps sends crew to an RNO step with kick out to CA-1.1. No change needed.

89 H 2 N S NRC: Could it be argued that raising level minimally, say to 10%,

would be insufficient and thus, no correct answer?

Licensee: Such an assumption would be prohibited by the exam rules. No change needed.

90+ H 2 N E NRC: FR-S.1 is not plausible (Distractor A). Suggest increasing PRNIs to 5% to enhance plausibility.

Licensee: Swapped the order of zero and negative 0.2 DPM in the IRNI SUR bullet to enhance Distractor A.

91+ F 1 N U NRC: LOD = 1. You would not leave the MCR without tripping the reactor first. Suggest to focus on those situations where this recommendation would first be made. Also, overlaps question 92!

Licensee: Restructured question to list 3 conditions:

1) MCR evacuation required

2) fire not out in 30 min

3) SCBAs is necessary Which of the conditions, analyzed separately, require Rx trip?

A) ONLY cond. 1 B) Cond. 1 AND 2 C) Cond. 1 AND 3 D) Cond. 1, 2 AND 3 92 F 2 N S Page 14 of 17

ES-401 Written Examination Review Worksheet Form ES-401-9 Braidwood March 2013 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 93 H 2 N U NRC: It seems wrong to ONLY lower setpoints without lowering reactor power, thus A & C are implausible.

S Licensee: Added to explanation that OTDT and OPDT setpoints are well above 100% (i.e. margin available) and it is plausible to reduce these setpoints without requiring an actual reduction in power. The question was SAT.

94+ F 2 N E NRC: Distractor B is implausible; manual Phase A is too drastic of a response. Also, C should read in its designated core location, and the stem should read In response to this event, the crew should versus of the following options.

Licensee: Changed distractor B to, MUST initiate containment closure. Other recommended changes were considered, upon further review, more minor and were not included in the revision.

95+ F 2 N E NRC: Granting permission to resume suspended fuel movements would be more plausible than performing an ICRR (D).

Licensee: Changed distractor D to, approve changes to the move sheet.

96 F 2 N E NRC: Distractor B is implausible. SROs do not hang clearance orders. Also, approval of key issuance is more plausible than simply Issuance of keys Licensee: Distractor B does not say that SROs hang clearance orders, but that they supervise it, which is plausible. Changed distractor C wording to Approve issuance as suggested.

Page 15 of 17

ES-401 Written Examination Review Worksheet Form ES-401-9 Braidwood March 2013 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 97 H 3 N U NRC: Why is distractor B incorrect? If I have a 1.1 gpm leak into the Containment floor drain sump, why is the redundant detection S

capability lost? If the alarm comes in, didnt it just detect a leak greater than 1 gpm? Why is part (2) incorrect? We did not state in the stem that the level detectors are broken. U if there are 2 correct answers.

Licensee: Although with 1 gpm or greater water flowing into the Containment Floor Drain sump, Annunciator 2-1-A2 CNMT DRAIN LEAK DETECT FLOW HIGH actuates, the bases only allows for the use of PC002 and PC003 via trending to monitor for leakage and meeting the requirement to detect a 1 gpm RCS leak within 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />.

Therefore, with surveillance 2BwOS RF-1 current, the LCO is still met when the alarm actuates, however, loss of the Annunciator function results in a loss of redundant leak detection UNTIL the surveillance is performed using PC002/PC003. This surveillance is NOT normally current. The question is SAT as submitted.

NRC: 10CFR55.43(b)(4) Radiation hazards that may arise during 98 H 2 N E normal and abnormal situations, including maintenance activities and various contamination conditions, seems more appropriate.

Licensee: Changed the CFR reference to 10CFR55.43b.4 99 F 2 N E NRC: Is there enough information in the stem to answer this question? CA-0.0 checks the status of bus 142 prior to cross-tying S

142 to 242. Since no information is given, is it ok to assume bus 142 is not faulted? Perhaps the last bullet of the stem should be changed from The following annunciators are LIT: to ONLY the following annunciators are LIT:

Licensee: Assuming any other annunciators were lit would be contrary to given exam rules. SAT as submitted.

100 H 3 M E NRC: Suggest changing stem to provide a containment condition which would make it ADVERSE versus telling them it is ADVERSE.

Also remove the second sentences from all distractors and modify C or D. The 2nd sentences in the distractors are unneeded.

Licensee: Changed Containment is ADVERSE to 1RE-AR020 and 021 High Range Containment Radiation monitors indicate 3 x 10E5 R/hr. Removed 2nd statement in all choices.

For SRO portion of Exam: N(10%,2)=20, M(4)=2, B(<75%,19)=3; LOK: F=9, H(50%,13)=16; E=12, U(20%,5)=1 Average LOD=58/25=2.32 Additional Comments:

Page 16 of 17

ES-401 Written Examination Review Worksheet Form ES-401-9 Braidwood March 2013 Exam

1) Generic Comment: Add noun names to questions where only EPNs are given.

Page 17 of 17