ML22133A244

From kanterella
Jump to navigation Jump to search
Form ES-401-9
ML22133A244
Person / Time
Site: Point Beach  NextEra Energy icon.png
Issue date: 07/31/2019
From: Randy Baker
NRC/RGN-III/DRS/OLB
To:
Point Beach
Baker R
Shared Package
ML17215A930 List:
References
Download: ML22133A244 (16)


Text

ES-401 Written Examination Review Worksheet Form ES-401-9

Facility: Point Beach Nuclear Plant Exam Date: July 15-26, 2019

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO (F/H) (1-5) Focus Dist. Link units ward K/A Only B/M/N U/E/S Explanation

NRC:

1 H 2 B S Comanche Peak NRC Exam 2015, Q39 Response: Question is SAT as written.

NRC:

2 H 2 B S McGuire NRC Exam 2015, Q40 Note: Steam tables required to solve Response: Question is SAT as written.

NRC:

3 H 2 B S Byron NRC Exam 2014, Q2 Response: Question is SAT as written.

NRC:

4 F 2 N S Response: Question is SAT as written.

Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2. Enter the level of difficulty (LOD) of each question using a 1 (easy) to 5 (difficult); questions with a difficulty between 2 and 4 are acceptable.
3. Check the appropriate box if a psychometric flaw is identified:
  • Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
  • Cues: The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length).
  • T/F: The answer choices are a collection of unrelated true/false statements.
  • Cred. Dist>: The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
  • Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
4. Check the appropriate box if a job content error is identified:
  • Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
  • Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory).
  • #/Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
  • Backward: The question requires reverse logic or application compared to the job requirements.
5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only. (K/A and license-level mismatches are unacceptable).
6. Enter question source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet criteria of ES-401 Section D.2.f.
7. Based on the reviewer s judgment, is the question, as written, (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
8. At a minimum, explain any U status ratings (e.g., how the Appendix B psychometric attributes are not being met).

Page 1 of 16 ES-401 2 Form ES-401-9

Facility: Point Beach Nuclear Plant Exam Date: July 15-26, 2019

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO (F/H) (1-5) Focus Dist. Link units ward K/A Only B/M/N U/E/S Explanation

NRC: Distractor B not plausible as RCP A hottest motor bearing rate of increase and highest temperature are both lower than the equivalent values on RCP B. Both pumps share a pump trip criteria for motor bearing temperature of 90C. RCP A having a higher rate of increase or a higher max temperature than RCP B for bearing temperature would be more plausible. In addition, explanation for distractor B does not accurately describe stem conditions.

E Response: Changed the temps for hottest motor brg for RCP A to 75/77/80/82, and 5 H 3 X N S changed RCP B to 77/79/81/83 This would is a 5°C/20 min rise for RCP A and a 4°C/20 min rise for RCP B.

Changed the justification for B to Plausible as the operator will have to recall the correct temperature for both the stator and motor bearing. Given the rate of rise, RCP A hottest motor bearing will exceed the setpoint of 90°C in 30 minutes while RCP B will be less than the setpoint, and this will occur after a required trip for the B RCP.

Question is now SAT.

NRC: Distractor C incorrectly lists SEP -1 has directing operators to E-0 if SI 6 F 2 N E accumulators are not isolated. This is done by step 1 of SEP 2.

S Response: Justification C: Typo corrected (SEP-1 changed to SEP-2)

Question is now SAT.

NRC:

7 H 3 B S References Provided: Control board diagram PBNP NRC Exam 2003, Q8 Response: Question is SAT as written.

NRC:

8 F 2 B S PBNP NRC Exam 2012, Q4 Response: Question is SAT as written.

NRC: Distractor analysis for Distractors A and B are swapped from the answers E provided in the question. (Analysis A describes answer B and vice versa.)

9 F 2 B S Catawba NRC Retake Exam 2009, Q8 Response: Justification A and B switched Question is now SAT.

NRC: Distractor A and answer C do not include a complete answer for the MSIV 10 F 2 X B E closure portion. Specifically, the MSIV isolation occurs because an SI signal is S present and steam flow exceeds a value when a LOW TAVG condition exists.

Therefore the distractor and answer should say High Steamline Flow Coincident with Low TAVG. The justification for the correct answer should be reworded so as to not

Page 2 of 16

ES-401 3 Form ES-401-9

Facility: Point Beach Nuclear Plant Exam Date: July 15-26, 2019

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO (F/H) (1-5) Focus Dist. Link units ward K/A Only B/M/N U/E/S Explanation

imply that the high steam flow alone is causing the isolation to occur. Removing the words High steam flow in the last sentence will accomplish this.

Ginna NRC Exam 2014, Q8 Response: Distractor A and C, added with Low TAVG.

Correct answer justification removed high steam flow.

Justification A, added With the SI signal present, and steam flow greater than 0.52 E6 lb/hr, and TAVE less than 543°F, will cause the closure both MSIVs.

Question is now SAT.

NRC:

11 F 2 B S Ginna NRC Retake Exam 2012, Q11 Response: Question is SAT as written.

NRC: Distractors A and D appear to effectively say the same thing, do not cool down so much that you cause pressurizer level to go low enough that the bubble will expand into the reactor vessel head. If this is not the case provide further detail in the distractor analysis as to why these answers sufficiently differ.

In the distractor analysis section, the answer letter appear to be mixed up from how they appear in the question. The order of the analysis appears correct, just how they are labeled.

Response: Justification distractor letters were in the wrong order, corrected.

12 F 3 X N E Distractor A changed To minimize damage to the RCP seals caused by seal S leakage and ensure subcooling requirements are met for future RCP operations.

Justification A change to Plausible as this action will cause the primary to cooled down, which will limit the temperature of the seal leakage, and will help meet the subcooling requirements needed to start the RCPs which may be required later in the EOP network depending on the recovery actions.

This changed the distractor length and required the distractor choices and justifications to be reordered.

Question is now SAT.

13 H 3 N S NRC:

Response: Question is SAT as written.

NRC:

14 H 3 B S PBNP NRC Exam 2005, Q15 Response: Question is SAT as written.

Page 3 of 16

ES-401 4 Form ES-401-9

Facility: Point Beach Nuclear Plant Exam Date: July 15-26, 2019

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO (F/H) (1-5) Focus Dist. Link units ward K/A Only B/M/N U/E/S Explanation

NRC: Distractor C is not credible as the leak is occurring in the Unit 2 Turbine Building as indicated by the Unit 2 TB sump alarm. A Unit 1 Zurn strainer clog does not seem credible with these initial conditions. This distractor appears to be a relic of the original modified question which had a Unit 1 TB sump alarm.

15 H 2 X M E The distractor analysis was from the original question and is not accurate for the S modifications made to the stem.

PBNP NRC Exam 2007, Q15 Response: Distractor C changed to Unit 2. Justifications reworked and plausible distractors changed.

Question is now SAT.

16 H 2 N S NRC:

Response: Question is SAT as written.

17 H 3 N S NRC:

Response: Question is SAT as written.

NRC: A value for reactor pressure, less than 2335 psig should be included in the stem indicating that the criteria for feed and bleed has absolutely not been met and E therefore a competent operator can fully eliminated Distractor A as a correct answer.

18 H 2 X B S Catawba NRC Exam 2008, Q16 Response: 6th bullet changed to The OATC notes RCS pressure is 2090 psig and RISING Question is now SAT.

NRC: AOP-6B calls out AOP-6A as an entry condition, therefore making Distractor C a partially correct answer. Not clear where dropped rod location in the core directs 6A or 6B to be carried out.

Response: Distractor C changed to AOP -24, Response to Instrument Malfunctions U Justification changed to Plausible if the operator has the misconception that in 19 H 2 N S instrument failure caused these indications, as this procedure is initially entered when an instrument fails to allow for the operator to stabilize the plant. An instrument failure is not the underlying issue, and will not address the conditions This changed the distractor length and required the distractor choices and justifications to be reordered Question is now SAT.

NRC:

20 H 3 B S PBNP NRC Exam 2003, Q20 Response: Question is SAT as written.

Page 4 of 16

ES-401 5 Form ES-401-9

Facility: Point Beach Nuclear Plant Exam Date: July 15-26, 2019

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO (F/H) (1-5) Focus Dist. Link units ward K/A Only B/M/N U/E/S Explanation

21 F 2 B S NRC:

Response: Question is SAT as written.

22 F 3 B S NRC:

Response: Question is SAT as written.

23 F 2 B S NRC:

Response: Question is SAT as written.

24 F 2 N S NRC:

Response: Question is SAT as written.

NRC: Question requires recall of a plant location and required action for a specific 25 F 3 N E given condition not requiring analysis. Assess as fundamental knowledge.

S Response: Changed pedigree to make question LOW COG Question is now SAT.

26 H 3 N S NRC:

Response: Question is SAT as written.

NRC:

27 F 2 B S Callaway NRC Exam 2009, Q27 Response: Question is SAT as written.

NRC: Distractor D analysis is poorly worded (leakage is causing the leak).

PBNP NRC Exam 2003, Q5 28 H 2 B E Response: Justification D changed to Plausible if the operator determines this valve S should have shut based on the indications, but CCW leakage into the RCP oil, not thermal barrier leakage is causing the indications.

Question is now SAT.

NRC:

29 H 3 B S References Provided: Control board indications diagram PREVIOUS TWO EXAMS: PBNP NRC Exam 2017, Q5 Response: Question is SAT as written.

NRC:

30 H 2 B S DC COOK NRC Exam 2012, Q4 Response: Question is SAT as written.

31 H 4 B S NRC: PBNP NRC Exam 2011, Q7 Response: Question is SAT as written.

Page 5 of 16

ES-401 6 Form ES-401-9

Facility: Point Beach Nuclear Plant Exam Date: July 15-26, 2019

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO (F/H) (1-5) Focus Dist. Link units ward K/A Only B/M/N U/E/S Explanation

32 H 2 B S NRC:

Response: Question is SAT as written.

NRC: Justification incorrectly calls out containment at 10 psig.

33 H 2 M E V.C. Summer NRC Exam 2005, Q11 S Response: Justification typo corrected.

Question is now SAT.

NRC:

34 H 3 B S PBNP NRC Exam 2009, Q33 Response: Question is SAT as written.

NRC:

35 H 3 B S PBNP NRC Exam 2003, Q52 Response Question is SAT as written.

NRC:

36 H 2 B S Millstone NRC Exam 2009, Q38 Response: Question is SAT as written.

NRC:

37 H 2 B S Prairie Island NRC Exam 2016, Q36 Note: Steam tables required to solve Response: Question is SAT as written.

NRC:

38 H 2 N S References Provided: Control board indications diagram Response: Question is SAT as written.

NRC:

39 F 4 B S PREVIOUS TWO EXAMS: PBNP NRC Exam 2017, Q69 Response: Question is SAT as written.

NRC:

40 H 3 B S Ginna NRC Retake Exam 2011, Q11 Response: Question is SAT as written.

NRC:

41 H 3 N S References Provided: Control board indications diagram Response: Question is SAT as written.

Page 6 of 16

ES-401 7 Form ES-401-9

Facility: Point Beach Nuclear Plant Exam Date: July 15-26, 2019

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO (F/H) (1-5) Focus Dist. Link units ward K/A Only B/M/N U/E/S Explanation

NRC:

42 F 3 B S Turkey Point NRC Exam 2013, Q41 Response: Question is SAT as written.

NRC: Noun names for components should be with their equipment identification number in the second bullet, not separately listed at the bottom of the stem.

E V.C. Summer NRC Exam 2005, Q33 43 H 2 X B S Response: 2 nd bullet changed to While monitoring the trend for 1RE-215, Condenser Air Ejector Gas Monitor and 1RE-232, Steam Line 1B Monitor on PPCS, a 15 gpm tube leak develops in the B Steam Generator Question is now SAT.

44 F 3 B S NRC:

Response: Question is SAT as written.

NRC: Distractor D not credible that the reactor would remain at power with no feedwater pumps operating, stem clearly indicates both pumps trip.

Prairie Island NRC Exam 2012, Q44 E Response: Second half of Distractor D changed to AOP-2B, Feedwater System 45 H 3 X B Malfunction with a branch to AOP-25, Turbine Trip Without Reactor Trip, S Justification changed to The second part is incorrect, plausible as AOP-2B, is called out when a Feed pump trip occurs and power is < 75%, and a branch to AOP-25 would be needed; having the misconception that an SI would not have happened and the power final power after the turbine trip would be < 50%.

Question is now SAT.

NRC: Are the EDGs normally aligned to their respective busses? (Doesnt this remain true even if one unit is in Mode 5?) If so, it is not necessary to include that item in the stem initial conditions.

Are the applicants (ROs) required to memorize the order in which feed pumps will be utilized when in CSP-H.1, Step 5?

Response: The purpose for the aligned to respective busses bullet is to remove E any ambiguity and EGD availability requirements when in MODE 5. In MODE 5, TS 46 H 3 N S only requires one EDG available to supply one safeguards bus. Stating aligned to respective busses will ensure the student is taking all EDGs into consideration, and not trying to determine which of the Unit 2 diesels is aligned and how this will affect the question.

The order in which the method of feed restoration is utilized is considered overall mitigation strategy and therefore required student knowledge.

Question is now SAT.

Page 7 of 16

ES-401 8 Form ES-401-9

Facility: Point Beach Nuclear Plant Exam Date: July 15-26, 2019

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO (F/H) (1-5) Focus Dist. Link units ward K/A Only B/M/N U/E/S Explanation

NRC:

PREVIOUS TWO EXAMS: PBNP NRC Exam 2017, Q47 47 H 3 B S References Provided: Incoming and Running Voltage meters along with Synchroscope indication (photo in the stem).

Response: Question is SAT as written.

NRC: Are the applicants required to know ARP Operator Actions from memory?

E Question in the stem is confusing (seems open ended).

48 H 3 N S References Provided: 2C20 panel indication (photos in the stem).

Response: Question Statement, changed per to by in the second half.

Question is now SAT.

NRC: For Distractor C to be plausible there must be some condition that will cause the fuel racks to fail to the zero position.

Diablo Canyon NRC Exam 2012, Q19 Response: The Cool Down Timer when actuated energizes the governor solenoid E to shut down the EDG engine by causing governor to move the fuel rack to the zero 49 F 2 B position, a failure of this this timer or solenoid, causing the solenoid to energize S would cause the fuel rack to fail in the zero position.

Also, with the engine at a standstill, any stop signal will energize the engine stop timer, and cooldown timer, a malfunction here could also result in a zero position on the fuel racks.

Question is now SAT.

50 F 2 B S NRC:

Response: Question is SAT as written.

NRC:

51 H 2 N S References Provided: 4 Control room monitor screen shots. (MINS, HP2086:RE223, HP2023:1RE229, & HP2054:2RE229)

Response: Question is SAT as written.

NRC:

52 H 3 B S PBNP NRC Exam 2012, Q53 Response: Question is SAT as written.

53 H 3 B S NRC:

Response: Question is SAT as written.

Page 8 of 16

ES-401 9 Form ES-401-9

Facility: Point Beach Nuclear Plant Exam Date: July 15-26, 2019

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO (F/H) (1-5) Focus Dist. Link units ward K/A Only B/M/N U/E/S Explanation

NRC: The stem does not identify how the units will be cross-tied when determining what required actions will be for operators on each unit - therefore doesnt match the K/A.

54 H 3 N S Response: Instrument Air is a single system for the site and serves both units in an almost identical manner. Both Service and Instrument Air Compressors are common to both units. The Service Air system is cross-tied to the Instrument Air system (so a leak in the Instrument air system, will be made up by the Service Air system).

Question is SAT as written.

NRC:

55 F 2 B S PBNP NRC Exam 2011, Q55 Response: Question is SAT as written.

56 F 2 N S NRC:

Response: Question is SAT as written.

57 F 2 N S NRC:

Response: Question is SAT as written.

NRC:

58 H 3 B S DC Cook NRC Exam 2014, Q58 Response: Question is SAT as written.

NRC: The analysis for Distractor B should be clarified to indicate these action would be correct if PT-482 was still in service and the applicant mistakes which instrument has failed high.

59 H 3 B E PBNP NRC Exam 2005, Q59 S Response: Justification B changed to Plausible, because these actions would be correct if PT-482 was still in service and the operator mistakes which instrument has failed high.

Question is now SAT.

NRC: Question requires the applicant to recall two distinct minimum requirement 60 H 3 M E levels and determine/analyze which is more restrictive. Assess as higher cog?

S Response: Changed Cognitive Level to HIGH COG Question is now SAT.

61 H 3 M S NRC:

Response: Question is SAT as written.

62 H 2 B S NRC:

Response: Question is SAT as written.

Page 9 of 16

ES-401 10 Form ES-401-9

Facility: Point Beach Nuclear Plant Exam Date: July 15-26, 2019

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO (F/H) (1-5) Focus Dist. Link units ward K/A Only B/M/N U/E/S Explanation

NRC:

63 F 3 B S PBNP NRC Exam 2007, Q23 Response: Question is SAT as written.

NRC:

64 F 2 B S Millstone Unit 3 NRC Exam 2011, Q62 Response: Question is SAT as written.

65 F 3 N S NRC:

Response: Question is SAT as written.

E NRC: Insert the word to in Distractor B (No further tracking due to a backup...)

66 F 2 N S Response: Distractor B, corrected typo by adding the word to.

Question is now SAT.

NRC: Correct the title of the reference provided (Plan not Plant). Correct the question pedigree to reflect only using a Table as reference, not a graph.

67 H 3 M S References Provided: ROD 1.3, Reactivity Plan for Power Changes-U2C37, Rev.16 (8000- 9000) MWD/MTU Response: Question is SAT as written.

NRC: Need to include Question Number on page.

68 H 3 B S DC Cook NRC Exam 2008, Q67 Response: Question is SAT as written.

NRC: Distractor A should state as directed in place of if directed, IAW OM 3.41.

69 F 3 B E PREVIOUS TWO EXAMS: PBNP NRC Exam 2017, Q69 S Response: Distractor A changed from if directed to as directed.

Question is now SAT.

NRC:

70 F 2 B S McGuire NRC Exam 2010, Q69 Response: Question is SAT as written.

NRC: The question stem does not provide sufficient initial conditions to elicit 1 correct answer. 10 CFR 20 provides exposure limits for both Annual and Lifetime.

E Comanche Peak NRC Exam 2013, Q70 71 F 2 X B S Response: Question statement, added With the EXCEPTION of Planned Special Exposures, which of the following describes: This should remove ambiguity and ensure only one correct answer.

Question is now SAT.

Page 10 of 16

ES-401 11 Form ES-401-9

Facility: Point Beach Nuclear Plant Exam Date: July 15-26, 2019

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO (F/H) (1-5) Focus Dist. Link units ward K/A Only B/M/N U/E/S Explanation

NRC: This question is very system specific and may not be applicable for a Tier 3 question which must be focused on generic plant wide topics 72 F 2 X B E Ginna NRC Retake Exam 2011, Q71 S Response: Reselected K/A for a more generic Tier 3 K/A under Radiation Control (2.3.13)

Question is now SAT.

NRC:

73 F 2 B S STP NRC Exam 2011, Q45 Response: Question is SAT as written.

NRC:

74 F 3 B S Catawba NRC Exam 2013, Q75 Response: Question is SAT as written.

NRC:

75 F 2 B S Diablo Canyon NRC Exam 2012, Q75 Response: Question is SAT as written.

76 H 2 N S NRC:

Response: Question is SAT as written.

NRC: Distractor B is not credible. Specifically, part 2 associated with TS 3.6.3. Why would the applicant assess a failure of a containment isolation valve if the stem of the problem just indicates a system leak and does not imply that the containment isolation function was required and did not occur?

References Provided: TRM 3.5.1 and TS 3.6.3 Callaway NRC Exam 2016, Q76 77 H 3 X M E Response: The misapplication of the tech spec would be the application of it to S include the penetration itself, not just to the isolation valves. So based on the leak location there is no longer two containment isolation valves available on that penetration.

Justification B changed to The second part is incorrect, plausible if the operator has the misconception that a leak in the penetration flow path between two containment isolation valves would make the containment penetration inoperable due to the leak location.

Question is now SAT.

78 H 2 X B E NRC: This question is not considered modified as per the requirements of ES-401, S page 9, significantly modify each question by changing at least one pertinent condition in the stem and at least one distractor. In comparison to the original

Page 11 of 16

ES-401 12 Form ES-401-9

Facility: Point Beach Nuclear Plant Exam Date: July 15-26, 2019

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO (F/H) (1-5) Focus Dist. Link units ward K/A Only B/M/N U/E/S Explanation

question, no pertinent conditions in the stem were changed and no distractors were changed and no answer that previously a distractor became the correct answer.

Is it ever expected that the EOP - 3 would be directly entered? In assessing the Symptoms or Entry Conditions of EOP - 3 it is a procedure transitioned to without direct entry criteria.

Indian Point NRC Exam 2013, Q79 Response: Question pedigree changed from Modified to Bank Question is now SAT.

NRC:

79 H 3 N S Reference Provided: TS 3.8.1 and picture of control board indications for electrical plant Response: Question is SAT as written.

NRC: The stem does not indicate the status of the North Instrument Air Header nor the status of IA and SA compressors. As a result, it is not clear that the stem offers enough information to order a Trip of the Reactor as required by AOP-5B. AOP-5B would certainly be the correct procedure based on annunciators received and plant conditions, but the procedure directing a reactor trip does not appear that the stem provides adequate information for this decision.

Response: 4 th bullet changed to Instrument Air header pressures are 65 psig and U LOWERING SLOWLY. And 5 th bullet added saying All Service and Instrument air 80 H 3 X N S compressor are running and loaded

Distractors A and B, changed to AOP-24, Response to Instrument Malfunctions, take manual control of both Feed Regulating valves and restore SG level, this was done to prevent a possible procedure which could be considered a correct answer, despite the fact that the original choice did not correct the conditions in the stem.

Justifications updated for changes Question is now SAT.

NRC:

81 H 3 B S Ginna NRC Exam 2008, Q80 Response: Question is SAT as written.

82 F 4 N S NRC:

Response: Question is SAT as written.

83 H 3 X B E NRC: Justification appears to incorrectly indicate that an UNUSUAL EVENT is the S correct EAL based on having exceeded the RU1.2 criteria. The stem indicates that Page 12 of 16

ES-401 13 Form ES-401-9

Facility: Point Beach Nuclear Plant Exam Date: July 15-26, 2019

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO (F/H) (1-5) Focus Dist. Link units ward K/A Only B/M/N U/E/S Explanation

the release rate exceeds 2 times the ODCM limit starting at 2205 and would have continued until 2315. This exceeds criteria RU1.3 not RU1.2.

Reference Provided: EAL Charts North Anna NRC Exam 2016, Q83 Response: Justification corrected typo Question is now SAT.

NRC:

84 H 2 B S Ginna NRC Retake Exam 2011, Q84 Response: Question is SAT as written.

NRC: The difference in service water pressure is a cue that answer D is correct as that is the only answer which addresses the abnormal service water pressure on the E South Header. Considered an enhancement as this a previous NRC exam question.

85 H 2 X B S PREVIOUS TWO EXAMS: PBNP NRC Exam 2017, Q90 Response: SW pressure bullets, changed to 70 and 75 respectively.

Question is now SAT.

NRC:

86 H 3 B S PREVIOUS TWO EXAMS: PBNP NRC Exam 2015, Q82 Response: Question is SAT as written.

87 H 3 N S NRC:

Response: Question is SAT as written.

NRC: K/A is associated with the containment cooling system (022). The questions U concerns a trip of the containment spray system (026). Recommend K/A change.

88 H 2 X N S Reference Provided: PPC screen capture Response: K/A reselected to 026A2.04 Containment Spray System (CSS)

Question is now SAT.

NRC:

89 H 4 M S PBNP NRC Exam 2011, Q90 Response: Question is SAT as written.

NRC: K/A states, Ability to perform without reference to procedures those actions U that require immediate operation of system components and controls. The question 90 H 3 X N S requires the applicant to determine what procedures to use. The only procedure with immediate actions to perform from memory is E - 0, which are not related to entering and carrying out the actions of AOP 0.0 and EOP 0.1.

Page 13 of 16

ES-401 14 Form ES-401-9

Facility: Point Beach Nuclear Plant Exam Date: July 15-26, 2019

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO (F/H) (1-5) Focus Dist. Link units ward K/A Only B/M/N U/E/S Explanation

Response: Distractor A, added perform immediate actions, to make it similar to distractor B and more discriminatory.

Question is now SAT.

91 F 4 N S NRC:

Response: Question is SAT as written.

NRC:

92 H 2 B S Reference Provided: EAL Charts and EAL Bases Pages DC Cook NRC Exam 2014, Q92 Response: Question is SAT as written.

NRC: This question does not appear to be adequately discriminatory (LOD=1) for an initial license class as it assumes they could mistake the cross tied nature of the E condensate system from the main condenser hotwells.

93 H 2 X B S Response: After discussion, the question was not assigned an LOD=1

Distractor C and D, removed OP 3A, Power Operation to Hot Standby Question is now SAT.

NRC: Distractor analysis implies that the scenario given would be covered by TS 5.2.2. Based on the requirements of TS 5.2.2.b, within two hours to correct an unexpected absence, the required number of licensed operators in the control room would have to be met per 50.54(m)(2)(i), having an STA on shift per TS 5.2.2.e, and having an AO assigned to each unit containing fuel and an additional AO assigned when either reactor is in Mode 1-4 per TS 5.2.2.a. The last requirement of TS 5.2.2.a concerns AOs, but indicates that only 3 are required (or perhaps 4 if conservatively E read) based on the plant conditions given in the stem and therefore would not be 94 F 3 X B S impacted based on losing the 5th AO. OM 3.1 has a separate requirement which is not met requiring 5 AOs. Therefore, the action to restore the 5th AO within 2 hours2.314815e-5 days <br />5.555556e-4 hours <br />3.306878e-6 weeks <br />7.61e-7 months <br /> comes from procedure OM 3.1 and not TS 5.2.2.

PBNP NRC Exam 2005, Q95 Response: Question statement, added Per OM 3.1, Operations Shift Staffing Requirements, to direct the question to the correct reference.

Question is now SAT.

NRC: Is it SRO only knowledge to know the basis for tripping RCPs during SBLOCA actions? This is a fold out page requirement and would appear to be a part of the 95 H 2 M S overall mitigating strategy of EOP LOCA response.

Note: Steam tables required to solve Seabrook NRC Exam 2009, Q95 Page 14 of 16

ES-401 15 Form ES-401-9

Facility: Point Beach Nuclear Plant Exam Date: July 15-26, 2019

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T/F Cred. Partial Job-Minutia #/ Back-Q= SRO (F/H) (1-5) Focus Dist. Link units ward K/A Only B/M/N U/E/S Explanation

Response: The fold out page is considered RO knowledge, while the basis for that action is considered SRO knowledge.

Question is SAT as written.

NRC: SR 303 has changed since this question was originally administered at Millstone. Specifically, the missed surveillance may be performed up to 30 days later (monthly surveillance) when a risk evaluation is performed. Therefore the correct answer may only be partially right in that the crew is not necessarily limited to 24 96 H 3 X B E hours to perform the train B surveillance if they perform the risk assessment.

S Millstone Unit 3 NRC Exam 2009, Q96 Response: Distractor D changed to Remain in the current ACTION CONDITION for A Train, the crew has 30 days to complete the B Train surveillance and risk assessment per Surveillance Requirement SR 3.0.3.

Question is now SAT.

NRC:

97 H 3 B S PBNP NRC Exam 2011, Q98 Response: Question is SAT as written.

NRC: The question stem is awkwardly worded and could be considered a cue with regards to and impact on fuel handling? Perhaps reword to say, and is there an E impact on fuel handling?

98 H 3 X X B S Response: Question stem and answers m odified; The steam was modified to a defueled condition, and the answers were modified to a two part format. This was done to remove ambiguity between refueling and fuel move procedures Question is now SAT.

NRC:

99 H 3 N S Reference Provided: EAL Charts and EAL Bases Pages Response: Question is SAT as written.

100 H 3 B S NRC:

Response: Question is SAT as written.

Page 15 of 16

ES-401 Written Examination Review Worksheet Form ES-401-9

Facility: Point Beach Nuclear Plant Exam Date: July 15-26, 2019

B= 49 F= 32 E= 21 RO TOTALS: M= 5 H= 43 U= 1 (1.3%) Additional Notes: SATISFACTORY Su bmittal N= 21 (12 = H)

B= 13 F= 3 E= 8 (16%SRO TOTALS: M= 3 H= 22 U= 3 (12%) Additional Notes: SATISFACTORY Submittal N= 9 (7 = H)

GENERAL COMMENT

S:

1. Question numbers highlighted as xx are sample test items the facility submitted for pre-review.
2. Bank questions are indicated by B; Modified are indicated by M; New questions are indicated by N
3. Questions from the previous 2 NRC Exams: __4 _ (RO)/ __ 2__ (SRO)
4. Average difficulty is ___ 2.51___ on the RO exam and ___ 2.76___ on the SRO exam.
5. The 10CFR55.41/43 distribution is:RO / SRO 41.1 = 0 / 0 41.8 = 7 / 0 43.1 = 0 / 0 41.2 = 3 / 0 41.9 = 3 / 0 43.2 = 2 / 5 41.3 = 3 / 0 41.10 = 19 / 10 43.3 = 2 / 0 41.4 = 3 / 0 41.11 = 1 / 0 43.4 = 3 / 3 41.5 = 21 / 6 41.12 = 1 / 2 43.5 = 18 / 19 41.6 = 4 / 0 41.13 = 0 / 0 43.6 = 1 / 0 41.7 = 34 / 3 41.14 = 0 / 0 43.7 = 0 / 0
6. The answer distribution is:

RO / SRO A = 22 ( 29%) / 5 ( 20%)

B = 17 ( 23%) / 9 (36%)

C = 18 (24%) / 6 ( 24%)

D = 18 (24%) / 5 (20%)

7. There are __ 8__ (RO) / __6 __ (SRO) questions with references/ attachments provided.

Page 16 of 16