ML23003A769

U2 - Miscellaneous Exam Material (Folder 3)

ML23003A769
Person / Time
Site:	Millstone
Issue date:	09/21/2022
From:	Brian Fuller NRC/RGN-I/DORS/OB
To:	Jeffrey Riley Dominion Energy Nuclear Connecticut
References
EPID L-2022-OLL-0007
Download: ML23003A769 (1)

Text

Side Door Food Tables 2022 Millstone 2 NRC Written Exam Seating Chart FRONT Proctor A. Chapman M. LeGaspi C. Robbins D. Koropatkin !

S. Sliwa M. Gregory J. Magee C. Hart

! J. Wadsworth !

Proctor N. Scoran N. Maynard J. Steffen Bathroom BACK Proctor Room for answering questions and observation Front Door Notes

1. Tables end to end are 4 feet or more a part.

2. Tables the candidates are sitting at are 8 feet long.

3. Candidates side to side are~ 10 feet apart.

4. Candidates front to back are~ 7 feet apart.

Question Candidate Time Robbins 1

4 0800 55-76152 2

40 Steffen 0825 55-76153 Wadsworth 3

4 0922 55-73075 Sliwa 4

37 1013 55-73035 64 Chapman 1022 5

55-63387 6

Hart 1029 13 55-76147 Wadsworth 7

32 1036 55-73075 Wadsworth 8

37 1050 55-73075 Millstone 2 2022 Written Exam Candidate Questions and Responses Question Asked by Candidate Response to Candidates Are we assuming two RCPs have been Answer the question based on information secured due to SIAS; trip two leave two?

provided. Based on what is stated in the Therefore only two are running.

question.

(verbatim}

Is the question asking if SIAS will actuate Answer the question based on information on any SIAS setpoint or RCS pressure provided. Based on what is stated in the only? (Verbatim) question.

Answer the question based on information Have any RCPs been secured due to SIAS? provided. Based on what is stated in the question.

Asking if need one more channel to trip Write down your assumptions and answer question based on information provided.

and does "B" channel count as tripped.

Brian approved the following response: "A.

Does the entire control boards include Control boards accessible to the operator control boards not in the OATC area?

ATC". Wrote on White Board and announced at 1120.

What power supplies are isolated, does Brian approved t he following response: " In that mean de-energized? Are they the 2 isolate means de-energized". Wrote on only power left on the bus if isolate White Board and announced at 1120.

means de-energized?

Is opening limit switch the same as open Answer the question with the information limit switch?

provided and document assumptions.

There is not enough information. There Brian approved the following response:

11 All power to RPS channel 'B' fails". Wrote on are multiple power supplies in RPS.

White Board and announced at 1120.

Standard Answer: "Answer the question based on the information provided".

Start Time: 0750 Brian Called Candidates still Time remaining In exam N/A No No additional information provided N/A No No additional information provided N/A No No additional information provided N/A No No additional information provided All Yes~ 1110 Except J. Magee/J. Steffen Both correct All Yes~ 1110 Except J. Magee (correct)

J. Steffen (incorrect)

N/A No No additional information provided All Except Magee/Steffen/

Yes~ 1110 Koropatkin Magee incorrect Two others correct

Question Candidate Time 9

43 Koropatkin 55-64025 1110 Maynard 10 19 1112 55-76151 Wadsworth 11 44 1125 55-73075 12 6

Wadsworth 1248 55-73075 Gregory 13 86 1250 55-64021 14 90 Sliwa 1426 55-73035 Millstone 2 2022 Written Exam Candidate Questions and Responses Question Asked by Candidate Response to Candidates Control of temperature by equipment or Answer the question based by procedure?

on the information provided.

Are we to assume that nothing stops the Answer the question with the information CEAs from coming out?

provided.

Is F5268A reading higher than normal and You have the information required. Answer is it higher than F5268A in answer.

the question with the information provided.

Is this over an unlimited time frame?

Brian approved the following response:

Because after a couple of hours it will go "Over the first 15 minutes". Wrote on back to setpoint.

White Board and announced at 1342.

Asked about the sequence of alarms. In question 1. the sequence is confusing. Is it Answer the question with the information the first alarm because that would be the sequence? Doesn't understand the provided and document assumptions.

sequence relative to the answers.

Answer the question with the information Is subcooling going up or down?

provided.

Standard Answer: "Answer the question based on the information provided".

Start Time: 0750 Brian Called Candidates still Time remaining In exam No N/A No additional N/A No No additional information provided N/A No No additional information provided Wadsworth, Sliwa, LeGaspi and Hart left Yes~ 1338 in exam. Only Koropatkin incorrect N/A No No additional information provided N/A No No additional information provided

Millstone Unit 2 2022 Initial License Exam Post Examination Comments Candidate and Facility Comments, Enhancements and Corrections that will be Addressed before Reuse Question Comments Enhancement - the comment was to add over a short period of time and add that the bias was adjusted for two 6

pump operation. The question and response during the exam was that it was over 15 minutes. One person missed.

9 Enhancement - the comment was to add a time, maybe 30 seconds. No one missed.

13 Enhancement - the comment was underline "be completed" in number 2 of stem. Four people missed.

Enhancement - This question needs to be changed to remove ambiguity over the time. The intent of the question 14 was how does Thot and Tcold respond when natural circulation is building in. Not how some candidates read it as what are Thot and Tcold 5 minutes after the trip. Three people missed.

Comment - need to look at whether answer "A" is also correct. This has been reviewed and answer "A" is not 24 correct. Ten people missed.

27 Enhancement - remove from the stem; 118 11 RBCCW Heat Exchanger is not in service and Annunciator RBCCW HX TEMP HI (C-06/7, D-8) alarms. Two people missed.

30 Enhancement - the comment was to add the noun name for 2-Sl-651. Six people missed.

32 Enhancement - comment was to change answer C. from "opening" limit switches to "open" limit switch. No one missed.

33 Enhancement - the comment was to possibly add to the stem "full" to the bullet of a Pressurizer Code Safety Valve open. One person missed.

Enhancement - the comment is that this question could be written to make it clearer. Possibly make a table for 36 the answers and remove the 1 of 2 and 2 of 3 answers. And add with respect to the high power trip. Two people missed.

40 Enhancement - the comment was to possibly add at containment pressure value to the stem. Three people missed.

46 Enhancement - the comment was to possibly add "for VA-10" after the static switch in the stem. This is because we don't generally talk about static switch. Three people missed.

so Enhancement - the comment was to make the question clearer since the title of the procedure section states Setpoint change for RC-14 and PPC. Ten people missed.

62 Enhancement - the comment was to underline "signal' in the stem. One person missed.

63 Enhancement - the comment was to add "on a timer to discharge" to answer 118 11

• Three people missed.

64 Enhancement - the comment, which was provided to the candidates during the exam with NRC approval was to change answer "A" to "Control boards accessible to the operator ATC". No one missed.

Correction - the comment was no answer was correct since after 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> at> 40 °F/hr is not correct since the cooldown must be initiated no later that one hour after the event. And within one hour at a rate of> 40 °F/hr is 77 not correct because there is no requirement to initiate a cooldown in the first hour at > 40 °F/hr. Five people missed.

Enhancement - the comment was that the first two annunicators could be cause the Controlled Bleed Off relief valve failing open so the word sequence the question made it confusing, i.e. was the question asking the result of 86 the first thing in the sequence or end of the sequence. A possible change would be to change distractors "A" and "B" to failing closed and change question stem to of the above listed annunciators would be caused by... No one missed.

FORM 9 - EXAM ITEM ANALYSIS Exam ID# Millstone 2, 2022 NRC ILT Written Examination Date Evaluation Instrument Administered: September 21, 2022 Number of Trainees Evaluated: 12 Section A - Any question receiving greater than 50% failure rate D N/A List each c uestion receiving greater than 50% failure rate.

Question Question Review Failure Corrective Action Number Rate(%)

Conclusion*

10/12 candidates missed this question and all the incorrect answers were selected. Containment Integrity is a one-hour Technical Specification. An 24 83.3%

G overall knowledge of Containment Integrity and the associated Technical Specification caused this high failure rate. This knowledge gap was closed during the exam review.

6/12 candidates missed this question. This question had a KIA of knowledge of the relationship between Functional Recovery and the following systems or 26 50.0%

H components: Shutdown cooling system. Restoration of SOC is very deep in the Functional Recovery procedures. All that missed this question selected the same answer. This knowledge gap was closed during the exam review.

6/12 candidates missed this question; 4 ROs and 2 SROs. This question was on the electrical alignment of main board light indications for a Shutdown 30 50.0%

G Cooling suction valve. Two of the three distractors were selected incorrectly. This knowledge gap was closed during the exam review.

6/12 candidates missed this question. All selected 34 50.0%

G the same distractor. This knowledge gap was closed durinq the exam review.

10/12 candidates missed this question. All that missed this question selected the same distractor.

50 83.3%

D The question has ambiguity. This question will be changed before it is administered again. There was no knowledge gap with this question.

3/6 SRO candidates missed this question. Two SROs that missed it were Instant SROs. This 76 50.0%

G knowledge gap was closed during the exam review.

04/28/22 NISP-TR-01 Revision 4

FORM 9 - EXAM ITEM ANALYSIS 77 83.3%

88 66.6%

D G

5/6 SRO candidates missed this question. There was no correct answer. The requirement is to initiate a plant cooldown no later than one hour after the event and after one hour the, the operator will establish and maintain an average cooldown rate of greater than 40°F/hr. One answer was the cooldown is required to be initiated after one hour and the other was the cooldown is required to be initiated within 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> at a rate of> 40 within 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />. Both these answers are not correct. This question will be changed before it is administered again.

4/6 SRO candidates missed this question. All that missed the question picked the same distractor. This was a TS question on the required volume of the Condensate Storage Tank and the TS action if the volume is not met. All that selected the distractor got the volume correct and the action incorrect. This knowledge gap was closed during the exam review.

• Review Conclusion A. Insufficient training for the learning objective tested B. Learning objectives not adequately covered in the lesson plan C. Poorly worded or invalid learning objective D. Poorly worded or invalid test item or answer E. Incorrect answer in the exam key F. More than one correct answer G. Question acceptable H. Other (state reason in table or on additional sheet)

Section B - Greater than 25% overall exam failure

~ N/A Conclusion Summary The exam was acceptable RO exam portion average scores All candidates= 85.9%

RO candidates only = 83.3%

SRO candidates only= 88.4%

Range 77.3% to 90.6%

SRO exam portion average scores 82%

Range 76% to 92%

Total scores 85.9%

Range of total scores 77.3% to 90.6%

04/28/22 Corrective Action

1.

Revise question 50 to remove ambiguity in question so it is clear what the question is asking for.

2. Revise question 77 to provide a correct answer.

CA 11293257 has been opened to track this corrective action to completion.

NISP-TR-01 Revision 4

FORM 9 - EXAM ITEM ANALYSIS Notes:

1. (40) questions were missed by no candidates (40% of questions no one missed).

2. (24) questions were missed by one candidate (64% of questions one or less people missed).

3. (12) questions were missed by two candidates (76% of questions two or less people missed).

4. (12) questions were missed by three candidates (88% of questions three or less people missed).

5. (3) questions were missed by four candidates.

6. (4) questions were missed by five candidates.

7. (3) questions were missed by six candidates.

8. (2) questions were missed by ten candidates.

lo ** 'I ~z. z,,

04/28/22 NISP-TR-01 Revision 4