2CAN032305, 03 Post Examination Analysis

03 Post Examination Analysis

ML23114A153
Person / Time
Site:	Arkansas Nuclear
Issue date:	03/23/2023
From:	Nicholson E Entergy Operations
To:	Clyde Osterholtz NRC/RGN-IV/DORS
References
2CAN032305
Download: ML23114A153 (1)

Text

We request that all examination materials related to the ANO Unit 2 2023 NRC Operator License Examinations be withheld from public disclosure for a period of two years.

Enclosure 1 2CAN032305 2023 ILO NRC Written Exam Applicant Questions and Comments during Exam

2023 Unit 2 ILO NRC Written Exam Administered March 15th, 2023 APPLICANT QUESTIONS AND RESPONSES APPLICANT QID# TIME APPLICANT QUESTION/COMMENT PROCTOR RESPONSE NAME/DOCKET #

8 0937 Brandon Tribble/55-72723 Is this failure on the input or output of The conditions and the controller? stem of the question were read back to the applicant. No further information was provided. The conditions state that the failure is from the pressure transmitter, which is the input to the controller.

42 1042 Caleb Walker/55-76377 Do I assume current plant alignment? The conditions and the stem were read back to the applicant. No additional information was provided. From the

briefing, the applicants are not to assume any additional failures or plant alignments unless specifically stated in the stem or conditions of the question.

81 1137 Brandon Tribble/55-72723 The question stem refers to regulated After a discussion voltage but the reference refers to with the exam team, unregulated voltage points. What are the determined that the unregulated voltage values? applicant did not need unregulated voltage to answer the question (the applicant can deduce the values from the information given).

No additional information was provided.

21 1141 Josef Nichols/55-76378 Do I consider the plant conditions in the The conditions and stem to determine which radiation the stem were read monitor to use or do I just answer based back to the on what the Annunciator Corrective applicant. No Action says? additional

information was provided. The conditions of the question render one of the radiation monitors incapable of monitoring radiation.

25 1143 Josef Nichols/55-76378 Do I consider the rate of Containment The conditions and sump level rise as a leakrate? the stem were read back to the applicant. No addition information was provided. The question conditions state that the sump is rising at 10 gpm, not that a leakrate has been performed.

24 1301 Kyle Rollans/55-76375 Sometimes we drain the sump and The conditions and sometimes we drain to the Hold-Up tank. stem were read back Which do I consider to be normal? to the applicant. No additional information was provided. The conditions in the stem determine

which method is used (at normal full power).

99 1303 Brandon Tribble/55-72723 When answering this question, do I The conditions and consider the situation in which the SM stem were read back becomes incapacitated? to the applicant. No additional information was provided. The stem of the question does not ask about when the SM becomes incapacitated. It asks about when the SM can delegate authority.

67 1408 Kyle Rollans/55-76375 What does most limiting Tech Spec The conditions and action mean? Does that mean the action stem were read back that has the shortest time to take an to the applicant. No action or does that mean the action that additional will place the plant in Mode 3 the information was fastest? provided. The stem of the question asks about the most limiting tech spec action (1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> or less action) which also

corresponds to having to be in Mode 3 within the following 6 hours6.944444e-5 days <br />0.00167 hours <br />9.920635e-6 weeks <br />2.283e-6 months <br />.

This information did not need to be clarified to answer the question.

28 1409 Brian Pawlowski/55-73399 What is the noun name for 2F-3A/B in After a discussion answer choice A? with the exam team and referring to the procedure noun name for 2PSV-4800 and looking at the question, the noun name for 2F-3A/B was not needed to answer the question.

There is only one set of filters in the CVCS system. No additional information was provided.

72 1439 Kyle Rollans/55-76375 How long has the plant been stable? This information was not needed to answer the question.

Read stem and answer choices to the applicant. No further information was provided.

71 1540 Brian Pawlowski/55-73399 Brian stated that he thought this Recorded his question had two correct answers (B and comment and read C). He did not have a question only question and answer wanted to make this comment. choices to applicant.

No additional information was provided. Applicant was reading too much into distractor C.

We request that all examination materials related to the ANO Unit 2 2023 NRC Operator License Examinations be withheld from public disclosure for a period of two years.

Enclosure 2 2CAN032305 2023 ILO NRC Written Post-Exam Analysis

2023 Unit 2 ILO NRC Exam Analysis 3/15/2023 RO SROI SROU Overall CORRECT R4 R1 R2 R3 I2 I1 I3 U1 U2 U3 % Missed 1 B 1 2 A B B B 30% 2 3 A 3 4 C 4 5 D 5 6 D 6 7 C 7 8 A C 10% 8 9 A 9 10 C 10 11 B 11 12 C 12 13 B D 10% 13 14 C D 10% 14 15 D 15 16 B 16 17 D B 10% 17 18 A 18 19 D 19 20 A 20 21 B 21 22 A 22 23 B 23 24 D C B 20% 24 25 C 25 26 B 26 27 D C C C 30% 27 28 A B C 20% 28 29 C A D 20% 29 30 B 30 31 A 31 32 A 32 33 C 33 34 D 34 35 C D 10% 35 36 C 36 37 D 37 38 B C 10% 38 39 D 39 40 D 40 41 A 41 42 B D D A 30% 42 43 D B 10% 43 44 B 44 45 B 45

46 A 46 47 C 47 48 C D 10% 48 49 A B 10% 49 50 B A A 20% 50 51 B A 10% 51 52 A 52 53 C A 10% 53 54 D C 10% 54 55 D C 10% 55 56 B 56 57 A B 10% 57 58 B 58 59 B A A A 30% 59 60 D 60 61 B D 10% 61 62 C 62 63 A B B 20% 63 64 A 64 65 D 65 66 A 66 67 C A A A A A A 60% 67 68 C B D B 30% 68 69 A B 10% 69 70 D B B 20% 70 71 B A C C 30% 71 72 C A 10% 72 73 B 73 74 D 74 75 C B B B 30% 75 76 D 76 77 D 77 78 C 78 79 B 79 80 A 80 81 A 81 82 C 82 83 A 83 84 B 84 85 C A 17% 85 86 A 86 87 B A 17% 87 88 C 88 89 D B 17% 89 90 B 90 91 A 91 92 D 92 93 A D B C 50% 93 94 D 94

95 B 95 96 C 96 97 B C A C A 67% 97 98 C D B 33% 98 99 C A 17% 99 100 D 100 96.0 88.0 97.0 98.0 92.0 96.0 86.6 94.6 88.0 84.0 91.0 88.0 97.0 99.0 98.0 92.2 Class Avg 91.3 RO Avg 92.8 SRO Avg OVERALL Avg 84.0 88.0 84.0 96.0 100.0 96.0 SRO section 91.3 96.0 86.6 94.6 88.0 84.0 92.0 89.3 97.3 98.6 98.6 RO section 92.5

We request that all examination materials related to the ANO Unit 2 2023 NRC Operator License Examinations be withheld from public disclosure for a period of two years.

Enclosure 3 2CAN032305 2023 ILO NRC Written Post-Exam Analysis Tier 4 Only

2023 Unit 2 ILO NRC Exam Analysis-TIER 4 GFES SECTION 3/15/2023 RO SROI SROU Overall CORRECT R4 R1* R2 R3 I2 I1 I3 U1 U2 U3 % Missed 70 D B B 20% 70 71 B A C C 30% 71 72 C A 10% 72 73 B 73 74 D 74 75 C B B B 30% 75

• R1 did NOT take NRC GFES exam

We request that all examination materials related to the ANO Unit 2 2023 NRC Operator License Examinations be withheld from public disclosure for a period of two years.

Enclosure 4 2CAN032305 2023 ILO NRC Written Exam Post-Exam Applicant Comments

2023 Unit 2 ILO NRC Written Exam Administered March 15th, 2023 POST-EXAM APPLICANT COMMENTS Below are the applicant post-exam comments concerning the NRC Written Exam.

QID# MISS RATE APPLICANT COMMENTS During post-exam review, applicants stated the following reasons for answering this question incorrectly:

Incorrectly applied Tech Spec action for Minimum Temperature for Criticality rather than the Tech Spec for Tcold Did not recall that RWT boron concentration had an upper limit of 3000 ppm 67 60%

(thought Tech Spec LCO was just greater than 2500 ppm with no upper limit)

Applicants agreed this was a valid question with the approved answer key being correct.

During post-exam review, applicants stated the following reasons for answering this question incorrectly:

Applicants did not recall the procedural requirement of 10% power change requirement to be High Risk reactivity management evolution. Rationalized 5%

93 50%

as being correct when the procedural limit could not be recalled.

Applicants did not recall 5.3 HgA limit in the normal operating procedure for condenser vacuum. Incorrectly applied Loss of Condenser Vacuum AOP limit of 5.15 HgA for AOP exit.

Applicants agreed that this was a valid question with the approved answer key being correct.

During post-exam review, applicants stated the following reasons for answering this question incorrectly:

Applicants incorrectly determined that a eSOMS Component deviation record was required to be performed. This is not a requirement of OP-3305.002.

Applicants incorrectly determined that a removed from service marker was required to be placed on the window whenever the procedure OP-3305.002 97 67% directs to NOT place removed from service marker on window due to it being a reflash annunciator. Applicant stated that they read too much into this question and did not recall the procedural requirement.

Applicants agreed that this was a valid question with the approved answer key being correct.

We request that all examination materials related to the ANO Unit 2 2023 NRC Operator License Examinations be withheld from public disclosure for a period of two years.

Enclosure 5 2CAN032305 2023 ILO NRC Written Exam Seating Chart

2023 Unit 2 ILO NRC Written Exam Administered March 15th, 2023 Seating Chart (Front: West)

Proctors SRO SRO Wyett Nichols RO RO Rollans Davis SRO SRO Hendrix Pawlowski RO RO Kendrick Walker SRO SRO Tribble Alexander

We request that all examination materials related to the ANO Unit 2 2023 NRC Operator License Examinations be withheld from public disclosure for a period of two years.

Enclosure 6 2CAN032305 2023 ILO NRC Written Exam Post-Exam Performance Analysis Results

2023 Unit 2 ILO NRC Written Exam Administered March 15th, 2023 PERFORMANCE ANALYSIS FOR WRITTEN EXAM The threshold for determination of questions to be analyzed was a miss rate of 50% or higher.

Below are the applicant comments concerning these questions and the results of the exam analysis.

QID# MISS RATE APPLICANT COMMENTS ANALYSIS RESULT During post-exam review, applicants stated the ANO Unit 2 recommends that this following reasons for answering this question answer should not be changed and incorrectly: the question should not be deleted Incorrectly applied Tech Spec action for or modified.

Minimum Temperature for Criticality rather than the Tech Spec for Tcold WTANO-2022-239 CA 24 initiated to Did not recall that RWT boron concentration perform a training needs analysis to 67 60% had an upper limit of 3000 ppm (thought address this knowledge deficiency.

Tech Spec LCO was just greater than 2500 ppm with no upper limit)

Applicants agreed this was a valid question with the approved answer key being correct.

During post-exam review, applicants stated the ANO Unit 2 recommends that this following reasons for answering this question answer should not be changed and incorrectly: the question should not be deleted Applicants did not recall the procedural or modified.

requirement of 10% power change requirement to be High Risk reactivity WTANO-2022-239 CA25 initiated to management evolution. Rationalized 5% as perform a training needs analysis to being correct when the procedural limit address this knowledge deficiency.

could not be recalled.

93 50%

Applicants did not recall 5.3 HgA limit in the normal operating procedure for condenser vacuum. Incorrectly applied Loss of Condenser Vacuum AOP limit of 5.15 HgA for AOP exit.

Applicants agreed that this was a valid question with the approved answer key being correct.

During post-exam review, applicants stated the ANO Unit 2 recommends that this following reasons for answering this question answer should not be changed and incorrectly: the question should not be deleted Applicants incorrectly determined that a or modified.

97 67% eSOMS Component deviation record was required to be performed. This is not a WTANO-2022-239 CA26 initiated to requirement of OP-3305.002. perform a training needs analysis to Applicants incorrectly determined that a address this knowledge deficiency.

removed from service marker was required

to be placed on the window whenever the procedure OP-3305.002 directs to NOT place removed from service marker on window due to it being a reflash annunciator.

Applicant stated that they read too much into this question and did not recall the procedural requirements.

Applicants agreed that this was a valid question with the approved answer key being correct.

We request that all examination materials related to the ANO Unit 2 2023 NRC Operator License Examinations be withheld from public disclosure for a period of two years.

Enclosure 7 2CAN032305 2023 ILO NRC Written Exam Training Analysis Corrective Actions

CORRECTIVE ACTION WT-WTANO-2022-00239 CA Number: 24 Site Group Name Assigned By: ANO Training Operations Staff ANO Harris,James P Assigned To: ANO Training Operations Staff ANO Rowbotham,Theron Subassigned To :

Originated By: Rowbotham,Theron 3/30/2023 09:21:44 Performed By:

Subperformed By:

Approved By:

Closed By:

Current Due Date: 06/01/2023 Initial Due Date: 06/02/2023 CA Type: TRAINING ACTION CA Priority: NOT USED Plant Constraint: TRAINING TRACKING CA

Description:

Action:

Perform a training screening and a training needs analysis as necessary for the high missed question on the 2023 Unit 2 NRC ILO Exam for the following K/A to address this knowledge deficiency.

(G2.2.39) Equipment Control: Knowledge of less than or equal to 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> TS action statements (does not include action statements of 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> or less that follow the expiration of a completion time for a TS condition for which an action statement has already been entered)

This high missed question was covered with the 2023 Unit 2 ILO Class during the exam debrief to ensure all gaps associated with this question was closed.

Response

Subresponse :

Closure Comments:

CORRECTIVE ACTION WT-WTANO-2022-00239 CA Number: 25 Site Group Name Assigned By: ANO Training Operations Staff ANO Harris,James P Assigned To: ANO Training Operations Staff ANO Rowbotham,Theron Subassigned To :

Originated By: Rowbotham,Theron 3/30/2023 09:25:11 Performed By:

Subperformed By:

Approved By:

Closed By:

Current Due Date: 06/08/2023 Initial Due Date: 06/09/2023 CA Type: TRAINING ACTION CA Priority: NOT USED Plant Constraint: TRAINING TRACKING CA

Description:

Action:

Perform a training screening and a training needs analysis as necessary for the high missed question on the 2023 Unit 2 NRC ILO Exam for the following K/A to address this knowledge deficiency.

(075)(SF8 CW) CIRCULATING WATER SYSTEM (G2.1.37) CONDUCT OF OPERATIONS: Knowledge of procedures, guidelines, or limitations associated with reactivity management.

This high missed question was covered with the 2023 Unit 2 ILO Class during the exam debrief to ensure all gaps associated with this question was closed.

Response

Subresponse :

Closure Comments:

CORRECTIVE ACTION WT-WTANO-2022-00239 CA Number: 26 Site Group Name Assigned By: ANO Training Operations Staff ANO Harris,James P Assigned To: ANO Training Operations Staff ANO Rowbotham,Theron Subassigned To :

Originated By: Rowbotham,Theron 3/30/2023 09:27:39 Performed By:

Subperformed By:

Approved By:

Closed By:

Current Due Date: 06/01/2023 Initial Due Date: 06/02/2023 CA Type: TRAINING ACTION CA Priority: NOT USED Plant Constraint: TRAINING TRACKING CA

Description:

Action:

Perform a training screening and a training needs analysis as necessary for the high missed question on the 2023 Unit 2 NRC ILO Exam for the following K/A to address this knowledge deficiency.

(G2.2.43) EQUIPMENT CONTROL: Knowledge of the process used to track inoperable alarms.

This high missed question was covered with the 2023 Unit 2 ILO Class during the exam debrief to ensure all gaps associated with this question was closed.

Response

Subresponse :

Closure Comments: