ML081770291: Difference between revisions
StriderTol (talk | contribs) (Created page by program invented by StriderTol) |
StriderTol (talk | contribs) (Created page by program invented by StriderTol) |
||
| Line 3: | Line 3: | ||
| issue date = 05/22/2008 | | issue date = 05/22/2008 | ||
| title = Misc. Post Operator Licensing Exam Correspondence (Exam Proctor Log, Item Analysis, Seat Chart, Etc.) (Folder 1) | | title = Misc. Post Operator Licensing Exam Correspondence (Exam Proctor Log, Item Analysis, Seat Chart, Etc.) (Folder 1) | ||
| author name = Peal R | | author name = Peal R | ||
| author affiliation = PPL Susquehanna, LLC | | author affiliation = PPL Susquehanna, LLC | ||
| addressee name = Caruso J | | addressee name = Caruso J | ||
| addressee affiliation = NRC/RGN-I/DRS/OB | | addressee affiliation = NRC/RGN-I/DRS/OB | ||
| docket = 05000387, 05000388 | | docket = 05000387, 05000388 | ||
| Line 21: | Line 21: | ||
==Dear Mr. Caruso:== | ==Dear Mr. Caruso:== | ||
In accordance with the guidance provided in NUREG 1021, "Operating Licensing Examination Standards for Power Reactors" (Revision 9 Supp 1 ) ES-501 "Initial Post-Examination Activities", the following materials are submitted in support of the Susquehanna Initial Licensing Examination that concluded on May 16,2008. 1. Form ES-403-1 "RO- Written Examination Grading Quality Checklist" 2. The graded, ORIGINAL, Written Examination Applicant Coversheet and Answer Sheets. 3. A clean copy of each Applicant's Answer Sheet. 4. Master copy of the RO Examination with Answer Key. | In accordance with the guidance provided in NUREG 1021, "Operating Licensing Examination Standards for Power Reactors" (Revision 9 Supp 1 ) ES-501 "Initial Post-Examination Activities", the following materials are submitted in support of the Susquehanna Initial Licensing Examination that concluded on May 16,2008. 1. Form ES-403-1 "RO- Written Examination Grading Quality Checklist" 2. The graded, ORIGINAL, Written Examination Applicant Coversheet and Answer Sheets. 3. A clean copy of each Applicant's Answer Sheet. 4. Master copy of the RO Examination with Answer Key. | ||
: 5. All questions asked by the Applicants during the administration of the examination and the Proctor's responses to those questions. (No clarifications were provided on the whiteboard during the exam.) 6. The Written Examination Seating Chart. 7. SSES NRC Exam Analysis Spreadsheet. | : 5. All questions asked by the Applicants during the administration of the examination and the Proctor's responses to those questions. (No clarifications were provided on the whiteboard during the exam.) 6. The Written Examination Seating Chart. 7. SSES NRC Exam Analysis Spreadsheet. | ||
: 8. SSES Written Post-Exam Comments and Facility Response. 9. SSES Training Action Requests. Post-exam analysis indicates seven | : 8. SSES Written Post-Exam Comments and Facility Response. 9. SSES Training Action Requests. Post-exam analysis indicates seven | ||
[7] potential RO generic knowledge weaknesses (Questions missed by 50 percent or more of the Applicants). | [7] potential RO generic knowledge weaknesses (Questions missed by 50 percent or more of the Applicants). | ||
Individual and generic weaknesses are identified on Item #7, attached NRC Exam Analysis. Investigation and disposition of the potential generic weaknesses are being tracked by the Corrective Action Program. | Individual and generic weaknesses are identified on Item #7, attached NRC Exam Analysis. Investigation and disposition of the potential generic weaknesses are being tracked by the Corrective Action Program. | ||
| Line 99: | Line 99: | ||
Note: All four choices used the words | Note: All four choices used the words | ||
"...system requires". There are no alternate choices for the candidate to determine whether automatic or manual action is required. We see that the statements could be read to mean or imply that operator action may be required. | "...system requires". There are no alternate choices for the candidate to determine whether automatic or manual action is required. We see that the statements could be read to mean or imply that operator action may be required. | ||
Question #54: Regarding Choice A, he stated that he is comfortable with his answer but he wanted to comment that the word "aligns" implies that valves are moved prior to sprays and he believes that this means to "initiate" and take the action to actually spray the drywell. Proctor respons'e: Repeated back by stating that I understood his comment and that he interprets align to mean initiate. No further clarification was provided. | Question #54: Regarding Choice A, he stated that he is comfortable with his answer but he wanted to comment that the word "aligns" implies that valves are moved prior to sprays and he believes that this means to "initiate" and take the action to actually spray the drywell. Proctor respons'e: Repeated back by stating that I understood his comment and that he interprets align to mean initiate. No further clarification was provided. | ||
: 1) No corrections or clarifications were placed on the whiteboard during exam administration. | : 1) No corrections or clarifications were placed on the whiteboard during exam administration. | ||
Page 1 of 1 Confirm Information Page 1 of 1 reate ->-> Describe-> | Page 1 of 1 Confirm Information Page 1 of 1 reate ->-> Describe-> | ||
Revision as of 09:49, 12 July 2019
| ML081770291 | |
| Person / Time | |
|---|---|
| Site: | Susquehanna  |
| Issue date: | 05/22/2008 |
| From: | Peal R Susquehanna |
| To: | Caruso J Operations Branch I |
| Shared Package | |
| ML080390056 | List: |
| References | |
| 50-387/08-302, 50-388/08-302, PLA 006371 | |
| Download: ML081770291 (12) | |
Text
Susquehanna Learning Center 769 Salem Boulevard Berwick, PA 18603-0467 570-542-3353 May 22,2008 Mr. John Caruso USNRC Chief Examiner USNRC Region 1 475 Allendale Road King of Prussia, PA 19406-1415 Susquehanna Learning Center Post-Examination Materials PLA 006371
Dear Mr. Caruso:
In accordance with the guidance provided in NUREG 1021, "Operating Licensing Examination Standards for Power Reactors" (Revision 9 Supp 1 ) ES-501 "Initial Post-Examination Activities", the following materials are submitted in support of the Susquehanna Initial Licensing Examination that concluded on May 16,2008. 1. Form ES-403-1 "RO- Written Examination Grading Quality Checklist" 2. The graded, ORIGINAL, Written Examination Applicant Coversheet and Answer Sheets. 3. A clean copy of each Applicant's Answer Sheet. 4. Master copy of the RO Examination with Answer Key.
- 5. All questions asked by the Applicants during the administration of the examination and the Proctor's responses to those questions. (No clarifications were provided on the whiteboard during the exam.) 6. The Written Examination Seating Chart. 7. SSES NRC Exam Analysis Spreadsheet.
- 8. SSES Written Post-Exam Comments and Facility Response. 9. SSES Training Action Requests. Post-exam analysis indicates seven
[7] potential RO generic knowledge weaknesses (Questions missed by 50 percent or more of the Applicants).
Individual and generic weaknesses are identified on Item #7, attached NRC Exam Analysis. Investigation and disposition of the potential generic weaknesses are being tracked by the Corrective Action Program.
Following administration of the Written Examination, the Applicants participated in an exam review session. Individual knowledge deficiencies were identified and corrected.
All comments were discussed with the candidates.
Enhancements to identified questions will be performed prior to reuse. Refer to Item #8, attached Post-Exam Comments.
USNRC PLA 006371 Page 2 May 22,2008 During the post-exam review, newly discovered technical information identified that the correct answer of Question #2 should be 'C' (instead of 'LY). It was determined that in fact 'C' is the correct answer and the answer key was changed prior to formal grading.
An error in the training material was identified and the material is being corrected and tracked by the Corrective Action program. This change was discussed and reviewed with the candidates.
Refer to Items #8 and #9 for specific details. The NRC RO Written Master Exam and Answer Key were updated, Item
- 4, to reflect this change as well as pen and ink changes identified during exam administration.
All individuals signed on to Form ES-201-3, "Examination Security Agreement", have not yet completed the post-examination signature. When Form ES-201-3, "Examination Security Agreement", has been completed, it will be forwarded to you, thus completing the necessary documentation for this Susquehanna Initial Licensing Examination.
If you have any questions, or require more inforimation, please contact me at 570-542-31 26 or Chris Michaels at 570-542-3734.
_- . Robert M. Peal Manager-Nuclear Training Response:
No
Enclosures:
See 1-9 above cc: R. M. Fry R. R. Sgarro Ops Letter File Nuc Records - NUCPT CM/RMP/n k 2008 SSES NRC Written Examination Post-Exam Comments and Analysis SSES Written Post-Exam Comments and Analvsis a1 6/08 Question 1 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 Candidate Yeastedt Comment and ResDonse No comments from candidates.
"I thought with the switch maintained in AUTO, the HPCl Aux Oil pump logic sealed-in.
I remember going through that logic on prints." Training Response:
Question #2 was identified as a generic knowledge weakness and evaluated. The staff reviewed the question and an action request (AR-NTG#I 031 434) WiaS initiated to review for technical accuracy. Upon investigation, the staff determined that the training material was in-correct and the GE prints confirmed that the logic does seal-in. Actions were initiated to correct the training material and verify simulator response, which was verified to be correct.
Prior to formal grading, the RO Answer Key was changed to reflect the new correct answer as "C" (instead of D as originally proposed).
The RO Master Exam was updated with justifications corrected. The candidates exams were graded with the corrected answer key. Followup training actions are being tracked by the Corrective Action program and inclulde ensuring potential knowledge deficiencies are corrected for on-shift operators.
No Comment No Comment No comments from candidates.
1 miss - Individual knowledge weakness identified and corrected.
No Comment No Comment No Comment No Comment No comments from candidates.
1 miss - Individual knowledge weakness identified and corrected.
No comments from candidates.
1 miss - Individual knowledge weakness identified and corrected.
No Comment No comments from candidates.
1 miss - Individual knowledge weakness identified and corrected.
No Comment No Comment No Comment No Comment No Comment No Comment No Comment No comments from candidates.
1 miss - Individual knowledge weakness identified and corrected.
Page 1 of 4 2008 SSES NRC Written Examination Post-Exam Comrnents and Analysis Question I Candidate Comment and Response No Comment No Comment No Comment No comments from candidates.
1 miss - Individual knowledge weakness identified and corrected.
No Comment No Comment ~ ~~~ No Comment No Comment 28 29 No Comment 30 I No Comment No Comment No comments from candidates.
1 miss - Individual knowledge weakness identified and corrected 33 No comments from candidates.
1 miss - Individual knowledge weakness identified and corrected.
No Comment No Comment No Comment No Comment No comment from candidates.
37 38 150% of the candidates missed this question.
The staff has reviewed the question and i.t is technically correct. Post-exam review identified a generic knowledge weakness in that candidates did not know the trip threshold for the Flower Load Unbalance circuit. Training material was verified to be correct. AR issued to investigate and disposition the generic weakness.
No Comment 39 I 40 I No Comment No Comment No Comment No Comment e+-- 46 No Comment No Comment No Comment 47 I No Comment No Comment 48 49 No Comment Page 2 of 4 Question 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 Candidate 2008 SSES NRC Written Examination Post-Exam Comments and Analysis Comment and Response No comments from candidates.
1 miss - Individual knowledge weakness identified and corrected.
No comments fromi candidates.
2 50% of the Candidates missed this question. The staff has reviewed the question and it is technically correct.
Post-exam review identified a generic knowledge weakness. One candidate did not recognize that the MSlVs would be closed and one candidate had a knowledge weakness of EOP bases. Training material was verified to be correct.
AR issued to investigate and disposition the generic weakness.
No Comment No Comment No Comment No comments from candidates.
2 50% of the candidates missed this question.
The staff has reviewed the question and it is technically correct. Post-exam review identified a generic knowledge weakness in that both candidates did not recognize that the M/A Station controller at 1 C651 must be manually lowered. Training material was verified to be correct.
AR issued to investigate and disposition the generic weakness.
No Comment No comments from candidates.
1 miss - Individual knowledge weakness identified and corrected.
No Comment No Comment No Comment No Comment No Comment No comments from candidates.
1 miss - Individual knowledge weakness identified and corrected.
No Comment No Comment No Comment No Comment No Comment No comments from candidates.
2 50% of the candidates missed this question.
The staff has reviewed the question and it is technically correct. Post-exam review identified a generic knowledge weakness in that both candidates did not remember the criteria stated in the off-normal procedure. Training material was verified to be correct. AR issued to investigate and disposition the generic weakness.
Page 3 of 4 2008 SSES NRC Written Examination Post-Exam Comments and Analysis Comment and Response No comments from candidates. 1 miss - Individual knowledge weakness identified and corrected.
No Comment No Comment No comments from candidates.
2 50% of the candidates missed this question. The staff has reviewed the question and it is technically correct. Post-exam review identified a generic knowledge weakness in that both candidates did not remember the specific requirement stated in the off-normal procedure, directing EOP entry. Training material was verified to be correct. AR issued to investigate and disposition the generic weakness.
~~ No Comment No Comment "LOCNLOOP testing is a complex test and requires coordination. This surveillance could be designated a SICTE."
2 50% of the candiidates missed this question.
The training staff reviewed the question and it is technically correct. While any complex test may be designated as a SICTE, on direction from management staff, there is no requirement to designate this procedure as a SICTE. In fact, this test is routinely conducted during refuel outage without designation as a SICTE and there is not requirement to designate this test a SICTE. Choice C, the ILRT test in accordance with SE-100-003 is a 10 year test and is required to be designated a SICTE.
No change to the exam or answer key is required.
Post-exam review identified a generic knowledge weakness in that both candidates did not remember the specific time requirement for designation of a SKTE. Training material was verified to be correct.
AR issued to investigate and disposition the generic weakness.
Page 4 of 4
I I I I I I Average I PROCTOR r LOC-22R NRC Written Exam Seating Chart - 5/16/2008
/jI U U L U U I CI /PRocToRl I Susquehanna Learning Center - Classrooms 4 /5 Questions During SSES RO Written Exam Administration - 05/16/08 TIME 0820 0835 1110 1305 CANDIDATE Wygant Richter Yeastedt Richter CANDIDATE - Question or Comment / Response Question #I 0: Stated that "LITS-B21-1 N026B is not on the 1 COO5 rack, but instead is on the IC004 rack Proctor response: Acknowledge the comment and stated that LITSB21-1 N026B is the correct transmitter, as stated. Following verification of the error, informed all three candidates that a location error existed and that LITS-B21-1 N026B was the transmitter intended in the question and that it is located on the 1 COO4 rack. Note that this error did inot change the intent of the question and did not affect the intended correct answer.
Question #I 0: Stated that "He had noticed that the LITS-B21-1 N026B is on the 1 COO4 rack, not the 1 COO5 rack as stated in the question." Proctor response:
Following verification of the error, informed all three candidates that a location error existed and that LITS-B21-1 N026B was the transmitter intended in the question and that it is located on the IC004 rack. Note that this error did not change the intent of the question and did not affect the intended correct answer.
Question #7: Asked: "Does the word require imply or mean that the system must be manually aligned, operation action required or that it is automatically aligned?" Proctor response: "The choices do not imply either meaning. You can read the choices that the "system needs" instead of "requires".
Note: All four choices used the words
"...system requires". There are no alternate choices for the candidate to determine whether automatic or manual action is required. We see that the statements could be read to mean or imply that operator action may be required.
Question #54: Regarding Choice A, he stated that he is comfortable with his answer but he wanted to comment that the word "aligns" implies that valves are moved prior to sprays and he believes that this means to "initiate" and take the action to actually spray the drywell. Proctor respons'e: Repeated back by stating that I understood his comment and that he interprets align to mean initiate. No further clarification was provided.
- 1) No corrections or clarifications were placed on the whiteboard during exam administration.
Page 1 of 1 Confirm Information Page 1 of 1 reate ->-> Describe->
Optional Data-> Confirm ->FINISHED Action Request Confirmation You have successfully created A NTG 1032918 lame: lvent Date:
Broblem: We: MICHAELS*CHRISTOPHER G 05/16/2008 14: 13 During LOC 22 NRC RO post-exam analysis and review, individual knowledge weaknesses were identified and corrected.
Six (6) generic knowledge weaknesses were identified. This tracking AR to ensure candidate knowledge weaknesses are corrected and to evaluate the generic weaknesses for program or training material issues. This action taken IAW NTP-31.5 and NUREG-1021 ES-403.
DURING LOC 22 NRC RO POST-EXAM ANALYSIS AND REVIE\N, INDIVIDUAL KNOWLEDGE WEAKNESSES WERE IDENTIFIED AND CORRECTED.
SIX (6) GENERIC KNOWLEDGE WEAKNESSES WERE IDENTIFIED.
THIS TRACKING AR TO ENSURE CANDIDATE KNOWLEDGE WEAKNESSES ARE CORRECTE 3ypass Supervisor Review? N i u b -Ty pe : iub-Category:
EXAMS he Date: 06/26/2008 14:20 YGNT Responsible Group: YGNT Method of Discovery:
YGNT Originator Review?
'rimary System: :omponents:
3ocu ments: %elated Items (Type) (Relationship Type): :ontrolled Documents:
rrend Codes: NTG r Generate Additional AR I FJ [Print] 63 2006 Scientech LLC. Unauthorized use strictlv Drohibited http://nimsappsvr.papl.com:7778/amx/arPreview.jsp?message=The%2OAction%2ORequest
... 5/21/2008 Confirm Information Page 1 of 1 :reate ->-> Describe-> Optional Data-> Confirm ->FINISHED Action Request Confirmation You have successfully created AR NTG 1031434 Yame: Ivent Date: Voblem: ritle: MICHAELS
- CH RISTO PH ER G 0 51 16/ 2 0 0 8 06 : 4 7 During 2008 NRC RO Written Exam Review on 5/16/08, a technic(a1 issue may exist with Question #2 regarding the HPCI Aux Oil pump logic. The question is consistent with the training material, but following a review of the logic prints, may have an alternate answer given the question setup in the stem. Operations training to evaluate technictat accuracy of the question and training material, includirig the simulator to determine correct operation and initiate corrective actions as appropriate. Separate ARs wil be initiated as needed, e.g., to correct training issues with LOC 22 candidates.
DURING 2008 NRC RO WRITEN EXAM REVIEW ON 5/16/08, A TECHNICAL ISSUE MAY EXIST WITH QUESTION #2 REGARDING THE HPCI AUX OIL PUMP LOGIC. THE QUESTION IS CONSISTENT WITH THE TRAINING MATERIAL, BUT FOLLOWING A REVIEW OF THE LOGIC PRINTS, MAY H Bypass Supervisor Review?
N ;u b-Type: NTG ;u b-Category:
EXAMS Due Date: 06/19/:2008 06:57 YGNT Responsible Group: YGNT Method of Discovery:
YGNT Originator Review?
Components:
Documents:
Related Items (Type) (Relationship Type): Eontrolled Documents:
rrend Codes: Primary System: N/A I Generate Additional AR 1 [Close] [%I 2006 Scientech LLC. Unauthorized use strictly prohibited http://nimsappsvr.papl.com:7778/amx/arPreview.jsp?message=The%2OAction%2ORequest
... 5/19/2008