IR 05000528/2013301: Difference between revisions

From kanterella
Jump to navigation Jump to search
(Created page by program invented by StriderTol)
(Created page by program invented by StriderTol)
 
(8 intermediate revisions by the same user not shown)
Line 1: Line 1:
{{Adams
{{Adams
| number = ML13142A344
| number = ML13351A508
| issue date = 05/21/2013
| issue date = 12/17/2013
| title = Palo Verde Nuclear Generating Station, Units 1, 2, and 3 - Notification of NRC Initial Operator Licensing Examination 05000528/13-301; 05000529/13-301; 05000530/13-301
| title = Er 05000528/2013301; 05000529/2013301; 05000530/2013301; October 1 - November 20, 2013; Palo Verde Nuclear Generating Station, Units 1, 2, and 3; Initial Operator Licensing Examination Report
| author name = Gaddy V G
| author name = Gaddy V
| author affiliation = NRC/RGN-IV/DRS
| author affiliation = NRC/RGN-IV/DRS/OB
| addressee name = Edington R K
| addressee name = Edington R
| addressee affiliation = Arizona Public Service Co
| addressee affiliation = Arizona Public Service Co
| docket = 05000528, 05000529, 05000530
| docket = 05000528, 05000529, 05000530
| license number = NPF-041, NPF-051, NPF-074
| license number = NPF-041, NPF-051, NPF-074
| contact person =  
| contact person = Gaddy V
| document report number = 50-528/13-301, 50-529/13-301, 50-530/13-301
| document report number = 50-528/13-301, 50-529/13-301, 50-530/13-301
| document type = Inspection Plan, Letter
| document type = Letter, License-Operator Examination Report
| page count = 3
| page count = 13
}}
}}


Line 18: Line 18:


=Text=
=Text=
{{#Wiki_filter:
{{#Wiki_filter:UNITE D S TATE S NUC LEAR RE GULATOR Y C OMMI S SI ON ber 17, 2013
[[Issue date::May 21, 2013]]


Randall K. Edington, Executive Vice President, Nuclear/CNO
==SUBJECT:==
PALO VERDE NUCLEAR GENERATING STATION, UNITS 1, 2, AND 3 -
NRC EXAMINATION REPORT 05000528/2013301; 05000529/2013301; 05000530/2013301


Arizona Public Service Company P.O. Box 52034, Mail Stop 7602 Phoenix, AZ 85072-2034
==Dear Mr. Edington:==
On November 9, 2013, the U.S. Nuclear Regulatory Commission (NRC) completed an initial operator license examination at Palo Verde Nuclear Generating Station, Units 1, 2, and 3. The enclosed report documents the examination results and licensing decisions. The preliminary examination results were discussed on November 9, 2013, with Mr. B. Bement, Senior Vice President for Nuclear Operations, and other members of your staff. A telephonic exit meeting was conducted on November 20, 2013, with Mr. W. Potter, Simulator Support Section Leader, who was provided the NRC licensing decisions.
 
The examination included the evaluation of eleven applicants for reactor operator licenses, eight applicants for instant senior reactor operator licenses, and six applicants for upgrade senior reactor operator licenses. The license examiners determined that all twenty five of the applicants satisfied the requirements of 10 CFR Part 55 and the appropriate licenses have been issued. There was one post examination comment submitted by your staff. Enclosure 1 contains details of this report and Enclosure 2 summarizes post examination comment resolution. No findings were identified during this examination.
 
In accordance with 10 CFR 2.390 of the NRC's "Rules of Practice," a copy of this letter and its enclosure will be available electronically for public inspection in the NRC Public Document Room or from the Publicly Available Records (PARS) component of NRCs document system (ADAMS). ADAMS is accessible from the NRC Web site at http://www.nrc.gov/reading-rm/adams.html (the Public Electronic Reading Room).
 
Sincerely,
/RA/
Vincent G. Gaddy, Chief Operations Branch Division of Reactor Safety Dockets: 50-528; 50-529; 50-530 Licenses: NPF-41; NPF-51; NPF-74 Enclosures:
1. NRC Examination Report 05000528;05000529; 05000530/2013301, w/Attachment 2. NRC Review of PVNGS Written Post-Examination Comments Electronic Distribution for Palo Verde Nuclear Generating Station Electronic distribution by RIV:
Regional Administrator (Marc.Dapas@nrc.gov)
Deputy Regional Administrator (Steven.Reynolds@nrc.gov)
DRP Director (Kriss.Kennedy@nrc.gov)
DRP Deputy Director (Troy.Pruett@nrc.gov)
DRS Director (Tom.Blount@nrc.gov)
DRS Deputy Director (Jeff.Clark@nrc.gov)
Senior Resident Inspector (Tony.Brown@nrc.gov)
Resident Inspector (John.Reynoso@nrc.gov)
Resident Inspector (Mica.Baquera@nrc.gov)
Resident Inspector (Dustin.Reinert@nrc.gov)
Administrative Assistant (Revonna.Stuart@nrc.gov)
Branch Chief, DRP/A (Ryan.Lantz@nrc.gov)
Senior Project Engineer, DRP/A (Bob.Hagar@nrc.gov)
Public Affairs Officer (Victor.Dricks@nrc.gov)
Public Affairs Officer (Lara.Uselding@nrc.gov)
Project Manager (Balwant.Singal@nrc.gov)
Branch Chief, DRS/TSB (Ray.Kellar@nrc.gov)
RITS Coordinator (Marisa.Herrera@nrc.gov)
ACES (R4Enforcement.Resource@nrc.gov)
Regional Counsel (Karla.Fuller@nrc.gov)
Technical Support Assistant (Loretta.Williams@nrc.gov)
Congressional Affairs Officer (Jenny.Weil@nrc.gov)
RIV/ETA: OEDO (Brett.Rini@nrc.gov)
R:\_REACTORS\_PV\2013\PV 2013301 RP kdc.docx  ML ML13351A508 SUNSI Review Completed: __KDC__ ADAMS:  Yes No Initials: __KDC__
Publicly Available Non-Publicly Available Sensitive Non-Sensitive OE:OB OE:OB SOE:OB OE:OB OE:OB SPE: PB SHedger CSteely BLarson DStrickland CCowdrey MBloodgood
/RA/ /RA/ /RA/ /RA/ /RA/ /RA/
12/16/13 12/16/13 12/13/13 12/16/13 12/16/13 12/16/13 OE:OB (R3) SOE:OB C: PBA C:OB CMoore KClayton WWalker VGaddy TFarnholts for TBlount for
/RA/telecom /RA/ /RA/ /RA/
12/13/13 12/13/13 12/17/13 12/17/13 OFFICIAL RECORD COPY  T=Telephone E=E-mail F=Fax
 
U.S. NUCLEAR REGULATORY COMMISSION
 
==REGION IV==
Dockets: 50-528; 50-529; 50-530 Licenses: NPF-41; NPF-51; NPF-74 Report: 05000528/2013301; 05000529/2013301; 05000530/2013301 Licensee: Arizona Public Service Company Facility: Palo Verde Nuclear Generating Station, Units 1, 2, and 3 Location: 5951 S. Wintersburg Road Tonopah, Arizona Dates: October 1 - November 20, 2013 Inspectors: K. Clayton, Senior Operations Engineer B. Larson, Senior Operations Engineer C. Steely, Operations Engineer S. Hedger, Operations Engineer D. Strickland, Operations Engineer C. Cowdrey, Operations Engineer M. Bloodgood, Senior Project Engineer (DRP)
C Moore, Operations Engineer (RIII)
Approved by: Vincent Gaddy, Chief Operations Branch Division of Reactor Safety-1-  Enclosure 1
 
=SUMMARY OF FINDINGS=
ER 05000528/2013301; 05000529/2013301; 05000530/2013301; October 1 - November 20, 2013; Palo Verde Nuclear Generating Station, Units 1, 2, and 3; Initial Operator Licensing Examination Report.
 
NRC examiners evaluated the competency of eleven applicants for reactor operator licenses, eight applicants for instant senior reactor operator licenses, and six applicants for upgrade senior reactor operator licenses at Palo Verde Nuclear Generating Station, Units 1, 2, and 3.
 
The licensee developed the examinations using NUREG-1021, "Operator Licensing Examination Standards for Power Reactors," Revision 9, Supplement 1. The written examination was administered by the licensee on November 1, 2013. NRC examiners administered the operating tests the week of November 4, 2013.
 
The examiners determined that all 25 of the applicants satisfied the requirements of 10 CFR Part 55 and the appropriate licenses have been issued.


SUBJECT: PALO VERDE NUCLEAR GENERATING STATION, UNITS 1, 2, AND 3 - NOTIFICATION OF NRC INITIAL OPERATOR LICENSING EXAMINATION 05000528/2013301; 05000529/2013301; 05000530/2013301
===NRC-Identified and Self-Revealing Findings===


==Dear Mr. Edington:==
None.
In a telephone conversation on April 11, 2013, between Messrs. W. Potter, Simulator Support Section Leader, and C. Steely, Chief Examiner, arrangements were made for the administration of licensing examinations at Palo Verde Nuclear Generating Station, Units 1, 2 and 3 during the week of November 4, 2013.
 
===Licensee-Identified Violations===
 
None.
 
=REPORT DETAILS=
 
==OTHER ACTIVITIES (OA)==
{{a|4OA5}}
==4OA5 Other Activities (Initial Operator License Examination)==
 
===.1 License Applications===
 
====a. Scope====
NRC examiners reviewed all license applications submitted to ensure each applicant satisfied relevant license eligibility requirements. The examiners also audited four of the license applications in detail to confirm that they accurately reflected the subject applicants qualifications. This audit focused on the applicants experience and on-the-job training, including control manipulations that provided significant reactivity changes.
 
For the reactivity credits, the licensee had several credits (which were not used on the final applications) that did not meet the intent of the regulation for positive control of the reactor as evidenced with parameter changes and accurate logs for one and only one individual. There were several credits where numerous applicants were logged into the control room at the same time, which clearly does not meet the spirit of having one person signed in to the logs as an under-instruction watch-stander and that person performing the manipulation credit. The chief examiner asked the licensee to remove these credits from the final applications and use other control manipulation credits from the qualification cards that met the spirit of the regulation for this activity. The licensee completed these changes prior to final application submittal and wrote Condition Report PVAR 4477615 to capture this issue.
 
====b. Findings====
No findings were identified.
 
===.2 Examination Development===
 
====a. Scope====
NRC examiners reviewed integrated examination outlines and draft examinations submitted by the licensee against the requirements of NUREG-1021. The NRC examination team conducted an onsite validation of the operating tests.
 
====b. Findings====
No findings were identified.
 
NRC examiners provided outline, draft examination and post-validation comments to the licensee. The licensee satisfactorily completed comment resolution prior to examination administration.
 
NRC examiners determined that the written examinations initially submitted by the licensee were within the range of acceptability expected for a proposed examination.
 
The draft scenarios submitted required numerous changes due to overlap issues with the previous two NRC examinations. The licensee wrote Condition Report PVAR 4476184 to address this issue. Several critical tasks were not tied to physical parameters (not just procedure transitions) as required to meet the NUREG-1021 guidance. The licensee wrote Condition Report PVAR 4476152 to address this issue. There were several other examination development/administration issues that required condition reports and were rolled up in the previous two conditions reports listed above.
 
During examination validation, the NRC and licensee examination teams identified six procedure enhancement opportunities that were captured by Condition Report PVAR 4480931.
 
===.3 Operator Knowledge and Performance===
 
====a. Scope====
On November 1, 2013, the licensee proctored the administration of the written examination for all 25 applicants, analyzed the results, and presented their analysis and post-examination comments to the NRC with a letter postmarked on November 14, 2013. These items were reviewed on November 18, 2013.
 
The NRC examination team administered the various portions of the operating tests to all 25 applicants the week of November 4, 2013.
 
====b. Findings====
No findings were identified.
 
All 25 of the applicants passed the written examination and all 25 passed all parts of the operating test. The final written examinations, final operating test, and post-examination analysis may be accessed in the ADAMS system under the accession numbers noted in the attachment, which includes one post-examination comment. There was one post-examination comment that requested a change to the answer key, Question 80, to which the NRC regional office accepted the recommended change and the answer key was changed accordingly. (See Enclosure 2 for a brief synopsis of the question, the comments, and the NRC resolution of these comments. The complete submittal can be found in the ADAMS system using accession number ML13343A136.)
 
The examination team noted the following generic weaknesses:
There were two questions missed by 50 percent or more of the applicants, with each question analyzed by the licensee as required by NUREG-1021. Both question weaknesses were determined to be knowledge weaknesses. The licensee wrote Condition Report PVAR 4479704 to address these weaknesses and the operating test weaknesses.
 
Additionally, the licensee wrote Condition Report PVAR 4481035 to address the problem of general content issues with the examination. Specifically, the applicants appeared to study old examination materials (such as events on previous scenarios and JPMs from the bank) and then tried to predict the direction or outcome of the task being administered. The licensee was informed that this methodology is not in accordance with the NRC standards or a systems approach to training and should be avoided.
 
Additionally, NUREG-1021 specifically limits the use of bank materials on the NRC examination because of the predictability of this practice. On page 1 of APPENDIX A, OVERVIEW OF GENERIC EXAMINATION CONCEPTS, it states that:
The internal attributes of the examination, such as its level of knowledge, level of difficulty, and use of item banks, also impact the operational and discriminatory validity of the examination, which, in turn, can affect its consistency and reliability. If the internal and external attributes of examinations are allowed to vary significantly, the uniform conditions that are required by Section 107 of the Atomic Energy Act of 1954, as amended, and the basis upon which the NRCs licensing decisions rest are challenged.
 
The NRC must reasonably control and structure the examination processes to ensure the integrity of the licenses it issues.
 
Furthermore, it states on page 10 of this same appendix in section C.3.e for Use of Item Banks that:
Test item banks are a valuable resource for learning and represent one fundamental basis for training and testing. However, it would be inappropriate to copy all or a significant portion of the items for an examination directly from the bank if the same items were previously used for testing or training. Test item banks must be used properly to maintain the validity, reliability, and consistency of the examinations.
 
Previously administered test items reduce examination integrity because examination discrimination is reduced.
 
It also states below that paragraph that:
Furthermore, when the bank of items from which the examination is drawn is known to the examinees prior to the examination, the examination is said to be highly predictable. Predictable examinations tend not to discriminate because what is being tested is simple recognition of the answer. Although studying past examinations can have a positive learning value, total predictability of examination coverage through over-reliance upon examination banks reduces examination integrity. When the examinees know the precise and limited pool from which test items will be drawn, they will tend only to study from that pool (i.e., studying to the test) and may likely exclude from study the larger domain of job knowledge. When this occurs, it decreases the confidence in the validity inferences that are made from performance on the test to that of the larger realm of knowledge or skill to be mastered.
 
===.4 Simulation Facility Performance===
 
====a. Scope====
The NRC examiners observed simulator performance with regard to plant fidelity during examination validation and administration. There were several minor simulator fidelity observations that did not impact scenario administration and are documented below as required by NUREG-1021. These observations do not constitute audit or inspection findings and, without further verification and review in accordance with IP 71111.11, are not indicative of non-compliance with 10 CFR 55.46. The licensee wrote condition reports, listed with PVAR numbers, in the table below:
Item                      Description                    Condition Report #
Condensate pump C      This temp exceeded the        PVAR 4476190 upper thrust bearing temp alarm setpoint of 194 degrees F during some scenarios. This was unplanned but did not impact the scenario administration Containment temp and      Simulator temperatures for    PVAR 4476190 NCW outlet temp          Containment and NCW outlet for the running and idle CEDM ACUs need to be adjusted for better fidelity to Unit 1. This did not impact the scenario administration.
 
SG Blowdown constants    Blowdown constants on the      Simulator discrepancy DRC simulator are different than  2013-3612 has been Unit 1. This does not align    created.
 
with Operator Information Aid for Appendix F of 40DP-9OP14. This did not impact the scenario administration.
 
ERFDADS RCS leak rate    The simulator ERFDADS          PVAR 4476190 RCS leak rate for a SGTL event appeared to change between morning and afternoon runs of the same scenario (8 gpm in the AM; 5-6 gpm in the PM). This did not impact the scenario administration.
 
Multiple TCW alarms      There were multiple B06        PVAR 4477166 and B07 alarms that came fairly quickly after inserting the TCW sheared shaft malfunction. Need to verify that the timing of the alarms is appropriate for the condition. Need to verify amperage indication was appropriate on affected pump motor.
 
The NIS Control Channel  The NIS Control Channel        PVAR 4476283 gain adjustment          gain adjustment                PVAR 4476289 potentiometer            potentiometer in Unit 1 is different than the simulators (One PVAR for simulator fidelity; one for Palo Verdes like-for-like component replacement process).


As agreed during the telephone conversation, your staff will prepare the examinations based on the guidelines in NUREG-1021, "Operator Licensing Examination Standards for Power Reactors," Revision 9, Supplement 1, and NUREG-1122, "Knowledge and Abilities Catalog for Nuclear Power Plant Operators," Revision 2, Supplement 1. The NRC's regional office will discuss with your staff any changes that might be necessary before the examinations are
2B SIT Tank Hi-Hi and Lo-     This issue was found and       Simulator discrepancy DRC Lo Pressure Alarm              fixed after validation week    2013-3591 was created setpoints not correct          but prior to examination      and fixed prior to administration week.


administered.
examination administration week.


To meet the above schedule, it will be necessary for your staff to furnish the examination outlines by August 16, 2013. The written examinations, operating tests, and supporting reference materials identified in Attachment 3 to ES-201 will be due by September 6, 2013.
====b. Findings====
No findings were identified.


Pursuant to Title 10, Section 55.40(b)(3), of the Code of Federal Regulations (10 CFR 55.40(b)(3)), an authorized representative of the facility licensee shall approve the outlines, examinations, and tests before they are submitted to the NRC for review and approval. All materials shall be complete and ready-to-use. We request that any personal, proprietary, sensitive unclassified, or safeguards information in your response be contained in a separate enclosure and appropriately marked. Any delay in receiving the required examinations and reference materials, or the submittal of inadequate or incomplete materials, may cause the examinations to be rescheduled. In addition, your support for on-site validation of the examinations is required during the week of September 30, 2013.
===.5 Examination Security===


In order to conduct the requested written examinations and operating tests, it will be necessary for your staff to provide adequate space and accommodations in accordance with ES-402, and to make the simulation facility available on the dates noted above. In accordance with ES-302, your staff should retain the original simulator performance data (e.g., system pressures, temperatures, and levels) generated during the dynamic operating tests until the examination results are final.
====a. Scope====
The NRC examiners reviewed examination security during both the onsite preparation week and examination administration week for compliance with 10 CFR 55.49 and NUREG-1021. Plans for simulator security and applicant control were reviewed and discussed with licensee personnel.


Appendix E to NUREG-1021 contains a number of NRC policies and guidelines that will be in effect while the written examinations and operating tests are being administered.
====b. Findings====
No findings were identified.
{{a|4OA6}}
==4OA6 Meetings, Including Exit==


To permit timely NRC review and evaluation, your staff should submit preliminary operator and senior operator license applications (Office of Management and Budget (OMB) approval number 3150-0090), medical certifications (OMB approval number 3150-0024), and waiver requests (if any) (OMB approval number 3150-0090) at least 30 days before the first examination date. If the applications are not received at least 30 days before the examination date, a postponement may be necessary. Signed applications certifying that all training has been completed should be submitted at least 14 days before the first examination date.
The chief examiner presented the preliminary examination results to Mr. B. Bement, Site Vice President of Nuclear Operations, and other members of the staff on November 9, 2013. A telephonic exit was conducted on November 20, 2013, between Messrs. Kelly Clayton, Chief Examiner, and W. Potter, Simulator Support Section Leader.


This letter contains information collections that are subject to the Paperwork Reduction Act of 1995 (44 U.S.C. 3501 et seq.). These information collections were approved by OMB, under approval number 3150-0018, which expires on April 30, 2016. The public reporting burden for this collection of information is estimated to average 50 hours per response, including the time for reviewing instructions, gathering and maintaining the data needed, and completing and reviewing the collection of information. Send comments regarding this burden estimate or any other aspect of these information collections, including suggestions for reducing the burden, to the Records and FOIA/Privacy Services Branch (T-5 F52), U.S. Nuclear Regulatory Commission, Washington, DC 20555-0001, or by Internet electronic mail to INFOCOLLECTS@NRC.GOV.
The licensee did not identify any information or materials used during the examination as proprietary.


The NRC may neither conduct nor sponsor, and a person is not required to respond to, an information collection, unless it displays a currently valid OMB control number.
ATTACHMENT:


In accordance with 10 CFR 2.390 of the NRC's "Rules of Practice," a copy of this letter will be available electronically for public inspection in the NRC's Public Document Room or from the Publicly Available Records (PARS) component of the NRC's Agencywide Documents Access and Management System (ADAMS). ADAMS is accessible from the electronic Reading Room page of the NRC's public Web site at http://www.nrc.gov/reading-rm/adams.html. Thank you for your cooperation in this matter. Mr. Potter has been advised of the policies and guidelines referenced in this letter. If you have any questions regarding the NRC's examination procedures and guidelines, please contact Mr. Steely at 817-200-1432, or myself at
=SUPPLEMENTAL INFORMATION=


817-200-1159.
==KEY POINTS OF CONTACT==


Sincerely,/RA/
===Licensee Personnel===
Vincent Gaddy, Chief Operations Branch Division of Reactor Safety
: [[contact::B. Bement]], Vice President of Nuclear Operations
: [[contact::D. Mims]], Vice President of Nuclear Regulatory Assurance
: [[contact::W. Potter]], Simulator Support Section Leader
: [[contact::L. Burton]], Operations Training / Written Examination Author
: [[contact::A. Rasmussen]], Operating Test Author
===NRC Personnel===
: [[contact::T. Brown]], Senior Resident Inspector


Dockets: 50-528; 50-529; 50-530 Licenses: NPF-41; NPF-51; NPF-74
==ADAMS DOCUMENTS REFERENCED==


ML13142A344 ADAMS: No Yes SUNSI Review Complete Reviewer Initials: VGG Publicly Available Non-Sensitive Non-publicly Available Sensitive OE:OB C:OB CSteely VGaddy /RA/ /RA/ 5/21/2013 5/21/2013
}}
}}

Latest revision as of 12:23, 20 December 2019

Er 05000528/2013301; 05000529/2013301; 05000530/2013301; October 1 - November 20, 2013; Palo Verde Nuclear Generating Station, Units 1, 2, and 3; Initial Operator Licensing Examination Report
ML13351A508
Person / Time
Site: Palo Verde  Arizona Public Service icon.png
Issue date: 12/17/2013
From: Vincent Gaddy
Operations Branch IV
To: Edington R
Arizona Public Service Co
Gaddy V
References
50-528/13-301, 50-529/13-301, 50-530/13-301
Download: ML13351A508 (13)


Text

UNITE D S TATE S NUC LEAR RE GULATOR Y C OMMI S SI ON ber 17, 2013

SUBJECT:

PALO VERDE NUCLEAR GENERATING STATION, UNITS 1, 2, AND 3 -

NRC EXAMINATION REPORT 05000528/2013301; 05000529/2013301; 05000530/2013301

Dear Mr. Edington:

On November 9, 2013, the U.S. Nuclear Regulatory Commission (NRC) completed an initial operator license examination at Palo Verde Nuclear Generating Station, Units 1, 2, and 3. The enclosed report documents the examination results and licensing decisions. The preliminary examination results were discussed on November 9, 2013, with Mr. B. Bement, Senior Vice President for Nuclear Operations, and other members of your staff. A telephonic exit meeting was conducted on November 20, 2013, with Mr. W. Potter, Simulator Support Section Leader, who was provided the NRC licensing decisions.

The examination included the evaluation of eleven applicants for reactor operator licenses, eight applicants for instant senior reactor operator licenses, and six applicants for upgrade senior reactor operator licenses. The license examiners determined that all twenty five of the applicants satisfied the requirements of 10 CFR Part 55 and the appropriate licenses have been issued. There was one post examination comment submitted by your staff. Enclosure 1 contains details of this report and Enclosure 2 summarizes post examination comment resolution. No findings were identified during this examination.

In accordance with 10 CFR 2.390 of the NRC's "Rules of Practice," a copy of this letter and its enclosure will be available electronically for public inspection in the NRC Public Document Room or from the Publicly Available Records (PARS) component of NRCs document system (ADAMS). ADAMS is accessible from the NRC Web site at http://www.nrc.gov/reading-rm/adams.html (the Public Electronic Reading Room).

Sincerely,

/RA/

Vincent G. Gaddy, Chief Operations Branch Division of Reactor Safety Dockets: 50-528; 50-529; 50-530 Licenses: NPF-41; NPF-51; NPF-74 Enclosures:

1. NRC Examination Report 05000528;05000529; 05000530/2013301, w/Attachment 2. NRC Review of PVNGS Written Post-Examination Comments Electronic Distribution for Palo Verde Nuclear Generating Station Electronic distribution by RIV:

Regional Administrator (Marc.Dapas@nrc.gov)

Deputy Regional Administrator (Steven.Reynolds@nrc.gov)

DRP Director (Kriss.Kennedy@nrc.gov)

DRP Deputy Director (Troy.Pruett@nrc.gov)

DRS Director (Tom.Blount@nrc.gov)

DRS Deputy Director (Jeff.Clark@nrc.gov)

Senior Resident Inspector (Tony.Brown@nrc.gov)

Resident Inspector (John.Reynoso@nrc.gov)

Resident Inspector (Mica.Baquera@nrc.gov)

Resident Inspector (Dustin.Reinert@nrc.gov)

Administrative Assistant (Revonna.Stuart@nrc.gov)

Branch Chief, DRP/A (Ryan.Lantz@nrc.gov)

Senior Project Engineer, DRP/A (Bob.Hagar@nrc.gov)

Public Affairs Officer (Victor.Dricks@nrc.gov)

Public Affairs Officer (Lara.Uselding@nrc.gov)

Project Manager (Balwant.Singal@nrc.gov)

Branch Chief, DRS/TSB (Ray.Kellar@nrc.gov)

RITS Coordinator (Marisa.Herrera@nrc.gov)

ACES (R4Enforcement.Resource@nrc.gov)

Regional Counsel (Karla.Fuller@nrc.gov)

Technical Support Assistant (Loretta.Williams@nrc.gov)

Congressional Affairs Officer (Jenny.Weil@nrc.gov)

RIV/ETA: OEDO (Brett.Rini@nrc.gov)

R:\_REACTORS\_PV\2013\PV 2013301 RP kdc.docx ML ML13351A508 SUNSI Review Completed: __KDC__ ADAMS: Yes No Initials: __KDC__

Publicly Available Non-Publicly Available Sensitive Non-Sensitive OE:OB OE:OB SOE:OB OE:OB OE:OB SPE: PB SHedger CSteely BLarson DStrickland CCowdrey MBloodgood

/RA/ /RA/ /RA/ /RA/ /RA/ /RA/

12/16/13 12/16/13 12/13/13 12/16/13 12/16/13 12/16/13 OE:OB (R3) SOE:OB C: PBA C:OB CMoore KClayton WWalker VGaddy TFarnholts for TBlount for

/RA/telecom /RA/ /RA/ /RA/

12/13/13 12/13/13 12/17/13 12/17/13 OFFICIAL RECORD COPY T=Telephone E=E-mail F=Fax

U.S. NUCLEAR REGULATORY COMMISSION

REGION IV

Dockets: 50-528; 50-529; 50-530 Licenses: NPF-41; NPF-51; NPF-74 Report: 05000528/2013301; 05000529/2013301; 05000530/2013301 Licensee: Arizona Public Service Company Facility: Palo Verde Nuclear Generating Station, Units 1, 2, and 3 Location: 5951 S. Wintersburg Road Tonopah, Arizona Dates: October 1 - November 20, 2013 Inspectors: K. Clayton, Senior Operations Engineer B. Larson, Senior Operations Engineer C. Steely, Operations Engineer S. Hedger, Operations Engineer D. Strickland, Operations Engineer C. Cowdrey, Operations Engineer M. Bloodgood, Senior Project Engineer (DRP)

C Moore, Operations Engineer (RIII)

Approved by: Vincent Gaddy, Chief Operations Branch Division of Reactor Safety-1- Enclosure 1

SUMMARY OF FINDINGS

ER 05000528/2013301; 05000529/2013301; 05000530/2013301; October 1 - November 20, 2013; Palo Verde Nuclear Generating Station, Units 1, 2, and 3; Initial Operator Licensing Examination Report.

NRC examiners evaluated the competency of eleven applicants for reactor operator licenses, eight applicants for instant senior reactor operator licenses, and six applicants for upgrade senior reactor operator licenses at Palo Verde Nuclear Generating Station, Units 1, 2, and 3.

The licensee developed the examinations using NUREG-1021, "Operator Licensing Examination Standards for Power Reactors," Revision 9, Supplement 1. The written examination was administered by the licensee on November 1, 2013. NRC examiners administered the operating tests the week of November 4, 2013.

The examiners determined that all 25 of the applicants satisfied the requirements of 10 CFR Part 55 and the appropriate licenses have been issued.

NRC-Identified and Self-Revealing Findings

None.

Licensee-Identified Violations

None.

REPORT DETAILS

OTHER ACTIVITIES (OA)

4OA5 Other Activities (Initial Operator License Examination)

.1 License Applications

a. Scope

NRC examiners reviewed all license applications submitted to ensure each applicant satisfied relevant license eligibility requirements. The examiners also audited four of the license applications in detail to confirm that they accurately reflected the subject applicants qualifications. This audit focused on the applicants experience and on-the-job training, including control manipulations that provided significant reactivity changes.

For the reactivity credits, the licensee had several credits (which were not used on the final applications) that did not meet the intent of the regulation for positive control of the reactor as evidenced with parameter changes and accurate logs for one and only one individual. There were several credits where numerous applicants were logged into the control room at the same time, which clearly does not meet the spirit of having one person signed in to the logs as an under-instruction watch-stander and that person performing the manipulation credit. The chief examiner asked the licensee to remove these credits from the final applications and use other control manipulation credits from the qualification cards that met the spirit of the regulation for this activity. The licensee completed these changes prior to final application submittal and wrote Condition Report PVAR 4477615 to capture this issue.

b. Findings

No findings were identified.

.2 Examination Development

a. Scope

NRC examiners reviewed integrated examination outlines and draft examinations submitted by the licensee against the requirements of NUREG-1021. The NRC examination team conducted an onsite validation of the operating tests.

b. Findings

No findings were identified.

NRC examiners provided outline, draft examination and post-validation comments to the licensee. The licensee satisfactorily completed comment resolution prior to examination administration.

NRC examiners determined that the written examinations initially submitted by the licensee were within the range of acceptability expected for a proposed examination.

The draft scenarios submitted required numerous changes due to overlap issues with the previous two NRC examinations. The licensee wrote Condition Report PVAR 4476184 to address this issue. Several critical tasks were not tied to physical parameters (not just procedure transitions) as required to meet the NUREG-1021 guidance. The licensee wrote Condition Report PVAR 4476152 to address this issue. There were several other examination development/administration issues that required condition reports and were rolled up in the previous two conditions reports listed above.

During examination validation, the NRC and licensee examination teams identified six procedure enhancement opportunities that were captured by Condition Report PVAR 4480931.

.3 Operator Knowledge and Performance

a. Scope

On November 1, 2013, the licensee proctored the administration of the written examination for all 25 applicants, analyzed the results, and presented their analysis and post-examination comments to the NRC with a letter postmarked on November 14, 2013. These items were reviewed on November 18, 2013.

The NRC examination team administered the various portions of the operating tests to all 25 applicants the week of November 4, 2013.

b. Findings

No findings were identified.

All 25 of the applicants passed the written examination and all 25 passed all parts of the operating test. The final written examinations, final operating test, and post-examination analysis may be accessed in the ADAMS system under the accession numbers noted in the attachment, which includes one post-examination comment. There was one post-examination comment that requested a change to the answer key, Question 80, to which the NRC regional office accepted the recommended change and the answer key was changed accordingly. (See Enclosure 2 for a brief synopsis of the question, the comments, and the NRC resolution of these comments. The complete submittal can be found in the ADAMS system using accession number ML13343A136.)

The examination team noted the following generic weaknesses:

There were two questions missed by 50 percent or more of the applicants, with each question analyzed by the licensee as required by NUREG-1021. Both question weaknesses were determined to be knowledge weaknesses. The licensee wrote Condition Report PVAR 4479704 to address these weaknesses and the operating test weaknesses.

Additionally, the licensee wrote Condition Report PVAR 4481035 to address the problem of general content issues with the examination. Specifically, the applicants appeared to study old examination materials (such as events on previous scenarios and JPMs from the bank) and then tried to predict the direction or outcome of the task being administered. The licensee was informed that this methodology is not in accordance with the NRC standards or a systems approach to training and should be avoided.

Additionally, NUREG-1021 specifically limits the use of bank materials on the NRC examination because of the predictability of this practice. On page 1 of APPENDIX A, OVERVIEW OF GENERIC EXAMINATION CONCEPTS, it states that:

The internal attributes of the examination, such as its level of knowledge, level of difficulty, and use of item banks, also impact the operational and discriminatory validity of the examination, which, in turn, can affect its consistency and reliability. If the internal and external attributes of examinations are allowed to vary significantly, the uniform conditions that are required by Section 107 of the Atomic Energy Act of 1954, as amended, and the basis upon which the NRCs licensing decisions rest are challenged.

The NRC must reasonably control and structure the examination processes to ensure the integrity of the licenses it issues.

Furthermore, it states on page 10 of this same appendix in section C.3.e for Use of Item Banks that:

Test item banks are a valuable resource for learning and represent one fundamental basis for training and testing. However, it would be inappropriate to copy all or a significant portion of the items for an examination directly from the bank if the same items were previously used for testing or training. Test item banks must be used properly to maintain the validity, reliability, and consistency of the examinations.

Previously administered test items reduce examination integrity because examination discrimination is reduced.

It also states below that paragraph that:

Furthermore, when the bank of items from which the examination is drawn is known to the examinees prior to the examination, the examination is said to be highly predictable. Predictable examinations tend not to discriminate because what is being tested is simple recognition of the answer. Although studying past examinations can have a positive learning value, total predictability of examination coverage through over-reliance upon examination banks reduces examination integrity. When the examinees know the precise and limited pool from which test items will be drawn, they will tend only to study from that pool (i.e., studying to the test) and may likely exclude from study the larger domain of job knowledge. When this occurs, it decreases the confidence in the validity inferences that are made from performance on the test to that of the larger realm of knowledge or skill to be mastered.

.4 Simulation Facility Performance

a. Scope

The NRC examiners observed simulator performance with regard to plant fidelity during examination validation and administration. There were several minor simulator fidelity observations that did not impact scenario administration and are documented below as required by NUREG-1021. These observations do not constitute audit or inspection findings and, without further verification and review in accordance with IP 71111.11, are not indicative of non-compliance with 10 CFR 55.46. The licensee wrote condition reports, listed with PVAR numbers, in the table below:

Item Description Condition Report #

Condensate pump C This temp exceeded the PVAR 4476190 upper thrust bearing temp alarm setpoint of 194 degrees F during some scenarios. This was unplanned but did not impact the scenario administration Containment temp and Simulator temperatures for PVAR 4476190 NCW outlet temp Containment and NCW outlet for the running and idle CEDM ACUs need to be adjusted for better fidelity to Unit 1. This did not impact the scenario administration.

SG Blowdown constants Blowdown constants on the Simulator discrepancy DRC simulator are different than 2013-3612 has been Unit 1. This does not align created.

with Operator Information Aid for Appendix F of 40DP-9OP14. This did not impact the scenario administration.

ERFDADS RCS leak rate The simulator ERFDADS PVAR 4476190 RCS leak rate for a SGTL event appeared to change between morning and afternoon runs of the same scenario (8 gpm in the AM; 5-6 gpm in the PM). This did not impact the scenario administration.

Multiple TCW alarms There were multiple B06 PVAR 4477166 and B07 alarms that came fairly quickly after inserting the TCW sheared shaft malfunction. Need to verify that the timing of the alarms is appropriate for the condition. Need to verify amperage indication was appropriate on affected pump motor.

The NIS Control Channel The NIS Control Channel PVAR 4476283 gain adjustment gain adjustment PVAR 4476289 potentiometer potentiometer in Unit 1 is different than the simulators (One PVAR for simulator fidelity; one for Palo Verdes like-for-like component replacement process).

2B SIT Tank Hi-Hi and Lo- This issue was found and Simulator discrepancy DRC Lo Pressure Alarm fixed after validation week 2013-3591 was created setpoints not correct but prior to examination and fixed prior to administration week.

examination administration week.

b. Findings

No findings were identified.

.5 Examination Security

a. Scope

The NRC examiners reviewed examination security during both the onsite preparation week and examination administration week for compliance with 10 CFR 55.49 and NUREG-1021. Plans for simulator security and applicant control were reviewed and discussed with licensee personnel.

b. Findings

No findings were identified.

4OA6 Meetings, Including Exit

The chief examiner presented the preliminary examination results to Mr. B. Bement, Site Vice President of Nuclear Operations, and other members of the staff on November 9, 2013. A telephonic exit was conducted on November 20, 2013, between Messrs. Kelly Clayton, Chief Examiner, and W. Potter, Simulator Support Section Leader.

The licensee did not identify any information or materials used during the examination as proprietary.

ATTACHMENT:

SUPPLEMENTAL INFORMATION

KEY POINTS OF CONTACT

Licensee Personnel

B. Bement, Vice President of Nuclear Operations
D. Mims, Vice President of Nuclear Regulatory Assurance
W. Potter, Simulator Support Section Leader
L. Burton, Operations Training / Written Examination Author
A. Rasmussen, Operating Test Author

NRC Personnel

T. Brown, Senior Resident Inspector

ADAMS DOCUMENTS REFERENCED