ML081770291

Misc. Post Operator Licensing Exam Correspondence (Exam Proctor Log, Item Analysis, Seat Chart, Etc.) (Folder 1)

ML081770291
Person / Time
Site:	Susquehanna
Issue date:	05/22/2008
From:	Peal R Susquehanna
To:	Caruso J Operations Branch I
Shared Package
ML080390056	List: IR 05000387/2008302 ML080460104 ML081330540 ML081750015 ML081770288 ML081770291 ML081770397 ML081770427 ML081770476 ML081770483 ML081770487 ML081770499
References
50-387/08-302, 50-388/08-302, PLA 006371
Download: ML081770291 (12)

Text

Susquehanna Learning Center 769 Salem Boulevard Berwick, PA 18603-0467 570-542-3353 May 22,2008 Mr. John Caruso USNRC Chief Examiner USNRC Region 1 475 Allendale Road King of Prussia, PA 19406-1415 Susquehanna Learning Center Post-Examination Materials PLA 006371

Dear Mr. Caruso:

In accordance with the guidance provided in NUREG 1021, "Operating Licensing Examination Standards for Power Reactors" (Revision 9 Supp 1) ES-501 "Initial Post-ExaminationActivities", the following materials are submitted in support of the Susquehanna Initial Licensing Examination that concluded on May 16,2008.

1. Form ES-403-1 "RO- Written Examination Grading Quality Checklist"

2. The graded, ORIGINAL, Written Examination Applicant Coversheet and Answer Sheets.

3. A clean copy of each Applicant's Answer Sheet.

4. Master copy of the RO Examination with Answer Key.

5. All questions asked by the Applicants during the administration of the examination and the Proctor's responses to those questions. (No clarifications were provided on the whiteboard during the exam.)

6. The Written Examination Seating Chart.

7. SSES NRC Exam Analysis Spreadsheet.

8. SSES Written Post-Exam Comments and Facility Response.

9. SSES Training Action Requests.

Post-exam analysis indicates seven [7] potential RO generic knowledge weaknesses (Questions missed by 50 percent or more of the Applicants). Individual and generic weaknesses are identified on Item #7, attached NRC Exam Analysis. Investigation and disposition of the potential generic weaknesses are being tracked by the Corrective Action Program.

Following administration of the Written Examination, the Applicants participated in an exam review session. Individual knowledge deficiencies were identified and corrected. All comments were discussed with the candidates. Enhancements to identified questions will be performed prior to reuse. Refer to Item #8, attached Post-Exam Comments.

USNRC PLA 006371 Page 2 May 22,2008 During the post-exam review, newly discovered technical information identifiedthat the correct answer of Question #2 should be 'C'(instead of 'LY). It was determined that in fact 'C' is the correct answer and the answer key was changed prior to formal grading. An error in the training material was identified and the material is being corrected and tracked by the Corrective Action program.

This change was discussed and reviewed with the candidates. Refer to Items #8 and #9 for specific details.

The NRC RO Written Master Exam and Answer Key were updated, Item #4, to reflect this change as well as pen and ink changes identified during exam administration.

All individuals signed on to Form ES-201-3, "Examination Security Agreement", have not yet completed the post-examinationsignature. When Form ES-201-3, "Examination Security Agreement", has been completed, it will be forwarded to you, thus completing the necessary documentation for this Susquehanna Initial Licensing Examination.

If you have any questions, or require more inforimation, please contact me at 570-542-3126 or Chris Michaels at 570-542-3734.

Robert M. Peal Manager-NuclearTraining Response: No

Enclosures:

See 1-9 above cc: R. M. Fry R. R. Sgarro Ops Letter File Nuc Records - NUCPT CM/RMP/nk

2008 SSES NRC Written Examination Post-Exam Comments and Analysis SSES Written Post-Exam Comments and Analvsis a 16/08 Question Candidate Comment and ResDonse 1 No comments from candidates.

Yeastedt I thought with the switch maintained in AUTO, the HPCl Aux Oil pump logic sealed-in. I remember going through that logic on prints.

Training Response:

Question #2 was identified as a generic knowledge weakness and evaluated. The staff reviewed the question and an action request (AR-NTG#I031434) WiaS initiated to review for technical accuracy.

Upon investigation, the staff determined that the training material was in-correct and the GE prints confirmed that the logic does seal-in.

Actions were initiated to correct the training material and verify simulator response, which was verified to be correct. Prior to formal grading, the RO Answer Key was changed to reflect the new correct answer as C (instead of D as originally proposed). The RO Master Exam was updated with justifications corrected. The candidates exams were graded with the corrected answer key.

Followup training actions are being tracked by the Corrective Action program and inclulde ensuring potential knowledge deficiencies are corrected for on-shift operators.

No Comment 4 No Comment 5 No comments from candidates.

1 miss - Individual knowledge weakness identified and corrected.

6 No Comment 7 No Comment 8 No Comment 9 No Comment 10 No comments from candidates.

1 miss - Individual knowledge weakness identified and corrected.

11 No comments from candidates.

1 miss - Individual knowledge weakness identified and corrected.

12 No Comment 13 No comments from candidates.

1 miss - Individual knowledge weakness identified and corrected.

14 No Comment 15 No Comment 16 No Comment 17 No Comment 18 No Comment 19 No Comment 20 No Comment 21 No comments from candidates.

1 miss - Individual knowledge weakness identified and corrected.

Page 1 of 4

2008 SSES NRC Written Examination Post-Exam Comrnents and Analysis I

Question Candidate Comment and Response No Comment No Comment No Comment No comments from candidates.

1 miss - Individual knowledge weakness identified and corrected.

No Comment

~

No Comment

~~~

No Comment 28 No Comment 29 No Comment 30 I No Comment No Comment No comments from candidates.

1 miss - Individual knowledge weakness identified and corrected 33 No comments from candidates.

1 miss - Individual knowledge weakness identified and corrected.

No Comment No Comment No Comment 37 No Comment 38 No comment from candidates.

150% of the candidates missed this question. The staff has reviewed the question and i.t is technically correct. Post-exam review identified a generic knowledge weakness in that candidates did not know the trip threshold for the Flower Load Unbalance circuit. Training material was verified to be correct. AR issued to investigate and disposition the generic weakness.

39 I No Comment 40 I No Comment No Comment No Comment No Comment e+--

46 No Comment No Comment No Comment 47 I No Comment 48 No Comment 49 No Comment Page 2 of 4

2008 SSES NRC Written Examination Post-Exam Comments and Analysis Question Candidate Comment and Response 50 No comments from candidates.

1 miss - Individual knowledge weakness identified and corrected.

51 No comments fromi candidates.

2 50% of the Candidates missed this question. The staff has reviewed the question and it is technically correct. Post-exam review identified a generic knowledge weakness. One candidate did not recognize that the MSlVs would be closed and one candidate had a knowledge weakness of EOP bases. Training material was verified to be correct.

AR issued to investigate and disposition the generic weakness.

52 No Comment 53 No Comment 54 No Comment 55 No comments from candidates.

2 50% of the candidates missed this question. The staff has reviewed the question and it is technically correct. Post-exam review identified a generic knowledge weakness in that both candidates did not recognize that the M/A Station controller at 1C651 must be manually lowered. Training material was verified to be correct. AR issued to investigate and disposition the generic weakness.

56 No Comment 57 No comments from candidates.

1 miss - Individual knowledge weakness identified and corrected.

58 No Comment 59 No Comment 60 No Comment 61 No Comment 62 No Comment 63 No comments from candidates.

1 miss - Individual knowledge weakness identified and corrected.

64 No Comment 65 No Comment 66 No Comment 67 No Comment 68 No Comment 69 No comments from candidates.

2 50% of the candidates missed this question. The staff has reviewed the question and it is technically correct. Post-exam review identified a generic knowledge weakness in that both candidates did not remember the criteria stated in the off-normal procedure. Training material was verified to be correct. AR issued to investigate and disposition the generic weakness.

Page 3 of 4

2008 SSES NRC Written Examination Post-Exam Comments and Analysis Comment and Response No comments from candidates.

1 miss - Individual knowledge weakness identified and corrected.

No Comment No Comment No comments from candidates.

2 50% of the candidates missed this question. The staff has reviewed the question and it is technically correct. Post-exam review identified a generic knowledge weakness in that both candidates did not remember the specific requirement stated in the off-normal procedure, directing EOP entry. Training material was verified to be correct. AR issued to investigate and disposition the generic weakness.

~~

No Comment No Comment LOCNLOOP testing is a complex test and requires coordination. This surveillance could be designated a SICTE.

2 50% of the candiidates missed this question. The training staff reviewed the question and it is technically correct. While any complex test may be designated as a SICTE, on direction from management staff, there is no requirement to designate this procedure as a SICTE.

In fact, this test is routinely conducted during refuel outage without designation as a SICTE and there is not requirement to designate this test a SICTE. Choice C, the ILRT test in accordance with SE-100-003 is a 10 year test and is required to be designated a SICTE. No change to the exam or answer key is required.

Post-exam review identified a generic knowledge weakness in that both candidates did not remember the specific time requirement for designation of a SKTE. Training material was verified to be correct.

AR issued to investigate and disposition the generic weakness.

Page 4 of 4

I I I I I I I

Average

r PROCTOR LOC-22R NRC Written Exam Seating Chart - 5/16/2008 L

U U

/ j I I CII U U

/PRocToRl Susquehanna Learning Center - Classrooms 4 /5

Questions During SSES RO Written Exam Administration - 05/16/08 TIME CANDIDATE -

CANDIDATE Question or Comment / Response 0820 Wygant Question # I 0:

Stated that LITS-B21-1N026B is not on the 1COO5 rack, but instead is on the IC004 rack Proctor response:

Acknowledge the comment and stated that LITSB21-1N026B is the correct transmitter, as stated.

Following verification of the error, informed all three candidates that a location error existed and that LITS-B21-1N026B was the transmitter intended in the question and that it is located on the 1COO4 rack. Note that this error did inot change the intent of the question and did not affect the intended correct answer.

0835 Richter Question # I 0:

Stated that He had noticed that the LITS-B21-1N026B is on the 1COO4 rack, not the 1COO5 rack as stated in the question.

Proctor response:

Following verification of the error, informed all three candidates that a location error existed and that LITS-B21-1N026B was the transmitter intended in the question and that it is located on the IC004 rack. Note that this error did not change the intent of the question and did not affect the intended correct answer.

1110 Yeastedt Question #7:

Asked: Does the word require imply or mean that the system must be manually aligned, operation action required or that it is automatically aligned?

Proctor response:

The choices do not imply either meaning. You can read the choices that the system needs instead of requires.

Note: All four choices used the words ...system requires. There are no alternate choices for the candidate to determine whether automatic or manual action is required. We see that the statements could be read to mean or imply that operator action may be required.

1305 Richter Question #54:

Regarding Choice A, he stated that he is comfortable with his answer but he wanted to comment that the word aligns implies that valves are moved prior to sprays and he believes that this means to initiate and take the action to actually spray the drywell.

Proctor response:

Repeated back by stating that I understood his comment and that he interprets align to mean initiate. No further clarification was provided.

1) No corrections or clarifications were placed on the whiteboard during exam administration.

Page 1 of 1

Confirm Information Page 1 of 1 reate ->-> Describe-> Optional Data-> Confirm ->FINISHED Action Request Confirmation You have successfully created A NTG 1032918 lame: MICHAELS*CHRISTOPHER G lvent Date: 05/16/2008 14: 13 Broblem: During LOC 22 NRC RO post-exam analysis and review, individual knowledge weaknesses were identified and corrected. Six (6) generic knowledge weaknesses were identified. This tracking AR t o ensure candidate knowledge weaknesses are corrected and t o evaluate the generic weaknesses for program or training material issues. This action taken IAW NTP-31.5 and NUREG-1021 ES-403.

We: DURING LOC 22 NRC RO POST-EXAM ANALYSIS AND REVIE\N, INDIVIDUAL KNOWLEDGE WEAKNESSES WERE IDENTIFIED AND CORRECTED. SIX (6) GENERIC KNOWLEDGE WEAKNESSES WERE IDENTIFIED. THIS TRACKING AR TO ENSURE CANDIDATE KNOWLEDGE WEAKNESSES ARE CORRECTE 3ypass Supervisor Review? N iub-Ty pe: NTG iub-Category: EXAMS h e Date: 06/26/2008 14:20 YGNT Responsible Group:

YGNT Method of Discovery:

YGNT Originator Review?

'rimary System:

omponents:

3ocuments:

%elatedItems (Type) (Relationship Type):

ontrolled Documents:

rrend Codes:

r Generate Additional AR I FJ [Print]

63 2006 Scientech LLC. Unauthorized use strictlv Drohibited http://nimsappsvr.papl.com:7778/amx/arPreview.jsp?message=The%2OAction%2ORequest ... 5/21/2008

Confirm Information Page 1 of 1

reate ->-> Describe-> Optional Data-> Confirm ->FINISHED Action Request Confirmation You have successfully created AR NTG 1031434 Yame: MICHAELS* CH RISTOPHER G Ivent Date: 0 5116/ 2 008 06 :4 7 Voblem: During 2008 NRC RO Written Exam Review on 5/16/08, a technic(a1 issue may exist with Question # 2 regarding the HPCI Aux Oil pump logic. The question is consistent with the training material, but following a review of the logic prints, may have an alternate answer given the question setup in the stem. Operations training t o evaluate technictat accuracy of the question and training material, includirig the simulator t o determine correct operation and initiate corrective actions as appropriate. Separate ARs wil be initiated as needed, e.g., t o correct training issues with LOC 22 candidates.

ritle: DURING 2008 NRC RO WRITEN EXAM REVIEW ON 5/16/08, A TECHNICAL ISSUE MAY EXIST WITH QUESTION # 2 REGARDING THE HPCI AUX OIL PUMP LOGIC. THE QUESTION I S CONSISTENT WITH THE TRAINING MATERIAL, BUT FOLLOWING A REVIEW OF THE LOGIC PRINTS, MAY H Bypass Supervisor Review? N

u b-Type

NTG

u b-Category

EXAMS Due Date: 06/19/:2008 06:57 YGNT Responsible Group:

YGNT Method of Discovery:

YGNT Originator Review?

Primary System: N/A Components:

Documents:

Related Items (Type) (Relationship Type):

Eontrolled Documents:

rrend Codes:

I Generate Additional AR 1 [Close]  %[I 2006 Scientech LLC. Unauthorized use strictly prohibited http://nimsappsvr.papl.com:7778/amx/arPreview.jsp?message=The%2OAction%2ORequest... 5/19/2008