IR 05000528/1991030
| ML17306A520 | |
| Person / Time | |
|---|---|
| Site: | Palo Verde  |
| Issue date: | 02/28/1992 |
| From: | Zimmerman R NRC OFFICE OF INSPECTION & ENFORCEMENT (IE REGION V) |
| To: | Conway W ARIZONA PUBLIC SERVICE CO. (FORMERLY ARIZONA NUCLEAR |
| References | |
| NUDOCS 9203100226 | |
| Download: ML17306A520 (27) | |
Text
~yPL llfCy fp
~4
Cy C
I 0O I
r. ~
p
/y QN n 4**y0 UNITED STATES NUCLEAR REGULATORYCOMMISSION
REGION V
1450 MARIALANE WALNUTCREEK, CALIFORNIA94596-5368 Fgg g,8 1932 Docket Nos.
50-528, 50-529, 50-530 Arizona Public Service Company P.O.
Box 53999, Station 9012 Phoenix, Arizona 85072-3999 Attention:
Mr.
M.
F.
Conway Executive Vice President, Nuclear-Subject:
RESPONSE TO NRC EMERGENCY LIGHTING CONCERNS E
Thank you for your letter of December 27, 1991, in response to our Inspection Report No. 50-528/91-30, dated October 16, 1991, informing us of the actions being taken to address our concerns regarding the management of the emergency lighting program.
Me will continue to monitor your performance and progress in this area during future inspections.
Your cooperation with us is appreciated.
Sincerely, R7 R.
.
immerman, Director Di 'on of Reactor Safety and Projects
'9203100226 920228 PDR ADOCK 05000528
PDR C'r= o t
I
Docket Nos.
50-528, 50-529, 50-530 Arizona Public Service Company P.O.
Box 53999, Station 9012 Phoenix, Arizona 85072-3999 Attention:
Nr.
M.
F.
Conway Executive Vice President, Nuclear RESPONSE TO NRC EMERGENCY LIGHTING CONCERNS Your cooperation with us is appreciated.
Sincerely, Subject:
Thank you for your letter of December 27, 1991, in response to our Inspection Report No. 50-528/91-30, dated October 16, 1991, informing us of the actions being taken to address our concerns regarding the management of the emergency lighting program.
Me will
-continue to monitor your performance and progress in this area during future inspections.
t bcc w/copy of letter dated December 27, Docket File Resident Inspector Project Inspector G.
Cook R.
Huey B. Faulkenberry J. Hartin J. Zollicoffer State of'Arizona R.
P.
Zimmerman, Director Division of Reactor Safety and projects A
1991:
bcc w/o copy of letter dated December 27, 1991:
N. Smith REGION V/vivian o~.~
p '- l-la-4WagnenCVangenbungh PNanbut
/ /
/ /
~pe'~2 D
'
-KPer-kins
/ /
RZimmerman
/ /
Docket Nos.
50-528, 50-529,
'50-530 Arizona Public Service Company P.O.
Box 53999, Station 9012 Phoenix, Arizona 85072-3999 Attention:
Nr.
W. F.
Conway Executive Vice President, Nuclear Subject:
RESPONSE TO NRC EMERGENCY LIGHTING CONCERNS Thank you for your letter of December 27, 1991, in response to our Inspection Report No. 50-528/91-30, dated October 16, 1991, informing us of the actions
. being taken to address our concerns regarding the management of the-emergency lighting program.
Your corrective actions taken to address these concerns
.,
will be verified during a future inspection..
Your cooperation with us is appreciated.
Sincerely, R.
P.
Zimmerman, Director Division of Reactor Safety and Projects bcc w/copy of letter dated December 27, 1991:
Docket File Resident Inspector Project Inspector G.
Gook R.
Huey B. Faulkenberry J. Hartin J. Zollicoffer State of Arizona bcc w/o copy of letter dated December 27, 1991:
N. Smith REGION V/vivian
)
N ~~a Y
V~M BWagne+~
C anDenburgh PNarbut DKirsch 2 /cc/0'g.
Z. /zg /g<
2-/Zc/52.
'
gg/3P KPerkins
/ /
RE T
COPY RE COPY RE VEST COPY REQUEST COPY REQUEST COPY ES NO YES NO YES NO YES" NO YES NO RZimmerman
/ /
REQUEST COPY SEND TO PDR YES NO ES NO
l t
I l
h
~ 7 WILLIAMF. CONWAY EXECUTIVEVICEPRESIDENT NUCLEAR REC="I'ir"0 HRC REGIOH Y Arizona Public Service Companytyyi OEt 3J pg I2.
f P,O. BOX 53999
~
PHOENIX, ARIZONA95072.3999 102-02091-MFC/TRB/DLK December 27, 1991 Mr. John B. Martin, Regional Administrator U. S: Nuclear Regulatory Commission Region V 1450 Maria Lane, Suite 210 Walnut Creek, CA 94596-5368 Reference:
1) NRC Inspection Report 50-528, 529, 530/91-30 2) Conversation between P. Narbut, NRC and T. R. Bradish, APS on November 22, 1991 - Response Extension Request to December 27, 1991
Dear Mr. Martin:
Palo Verde Nuclear Generating Station (PVNGS)
Units 1,2 and 3 RESPONSE TO NRC CONCERNS
~7il:
1. 7-Reference 1 requests that Arizona Public Service Company (APS) provide information regarding the management of the emergency lighting program. APS's response is provided in Attachment 1, which describes completed engineering and management actions, and actions being taken to enhance trending and improve installed plant equipment.
System Performance Monitoring and Trending is part of an improvement initiative that is being implemented by APS.
Due to the length of time needed to fully implement the program, interim measures are being taken to enhance monitoring of the
'erformance of the emergency lighting system by System Engineering.
These interim measures are described in Attachment 2.
ln addition, APS is providing a description of the plan for transferring the functions of the Emergency lighting Team to the Fire Protection Engineering Section. This description is provided in Attachment 3.
page 2 102-02091-MFC/TRB/DLK December 27, 1991 Should you have any further questions or require additional. information, please contact Mr. E. C. Simpson of my staff.
Very truly yoUrs, M!FC/DLK/css Attachment 1 - Response to NRC Concerns Attachment 2-Interim Emergency Lighting Equipment Performance Monitoring
,Attachment 3 - Emergency Lighting Team Transition
l l
I
ATTACHMENT1 RESPONSE TO NRC CONCERNS
1'
RESPONSE TO NRC CONCERNS NCE N-PERFORMANCE IN EME EN L
N Y
EM You do not appear to have effectively implemented a method to monitor whether recent system modifications are actually resulting in improved emergency lighting system performance.
~APS RESPONSE At PVNGS, monitoring of system performance, which includes the effectiveness of
.system modifications, is accomplished by tvio means:
~
Failure Data Trending (FDT) monitors equipment deficiencies over time to detect, recurring deficiencies and negative trends that are not immediately obvious; and,
~
System Engineering monitors and evaluates the day-to-day activities on.
specified systems to assess system performance and to anticipate problems.
ln addition, the Emergency Lighting Team provided an oversite function which resulted in feedback to management and engineering on the effectiveness of the emergency lighting system.
A. Enhancements to the FDT program that have been completed since August, 1990, or are being implemented include:
~
Providing component-specific failure criteria to more clearly focus FDT efforts on those components that can prevent a system from performing its intended function.
~
Performing increased analysis of component histories prior to issuance of the FDT Quarterly Report to facilitate the identification of recurring failures and negative trends.
~
Reviewing all failure reports submitted to ensure consistency prior to being made available for on-line review.
These enhancements have been completed for emergency lighting, but are still in progress for other systems.
The FDT program effectrveness is demonstrated in that the three specific examples of
"failed equipment" noted in the NRC inspection Report were reported through the FDT program activities to engineering for further evaluation and action.
(See Section ll, below.)
~
I
B. The following actions are being taken to erihance the monitoring of system performance by System Engineering.
'I
~
Review monitoring programs at other plants to help determine the best approach to effective performance monitoring by April, 1992; Establish revised monitoring and trending program guidelines by June, 1992; Communicate the program guidelines to the appropriate engineers to establish a clear and common understanding of the expectations by June,
- 1992; and,
~
Implement the new guidelines on emergency lighting as one of the pilot
. systems by August, 1992.
~ ~
This is a long-term. action plan.
The interim methodology for monitoring the
. performance of e'mergency lighting equipment is detailed in Attachment 2.
The long-term plan discussed above and the measures being taken in Attachment 2 will form the basis of our long-term trending program for emergency lighting.
During the NRC emergency lighting follow-up inspection conducted in August, 1991 (Reference 1), the NRC expressed an interest in reviewing updated information on Exide and Holophane inverter availability similar to that presented to the NRC on August 28, 1990. Development of the information provided in August, 1990, required an intensive effort by APS to research and develop information to a level of detail that was well in excess of normal Failure Data Trending or s'stem performance monitoring.
In response to the NRC's interest, however, APS will provide the updated information on Exide and Holophane inverter availability by January 31, 1992. This is being done in order to determine the impact of increased engineering and maintenance on the availability of the emergency lighting system. APS does not intend to maintain trending information to this level of detail on an on-going basis.
NRC CONCERN - RECURRING DEFICIENCIES Several types of emergency lighting system deficiencies, similar to those noted during previous NRC inspections, appear to be recurring.
~lP RE PDN E
I In 1990, there were some recurring emergency lighting deficiencies.
Improvements made to preventative maintenance, the use of more thorough testing,.and.modifications to the plant design have resolved most of these conditions.
One condition not yet fully resolved relates to recovering the specific gravity of the Exide batteries following a discharge.
Some improvements have been made and engineering and management are in the process of determining additicnal improvements to the design and testing method to resolve this issue; In Reference 1, the NRC identified Exide battery low specific gravity and low voltage relay (LVR) problems as examples of recurring failures. These examples were based on a review of a FDT report.
APS concurs that there was a problem with the Exide LVR's in June, 1990.
LVR deficiencies were initially'identifiedto APS engineering and management as a result of the emergency lighting work order review of July, 1990.
The deficiency was determined to be an inappropriate setpoint that did not fullyaccount forthe length of cable between the DC supply batteries and the Exide inverter unit.
Once the deficiency was identified, the LVR setpoints were revised and adjusted by Site Modification 1,2,3-SM-QD-008 in August, 1990.
Since the initial setpoint change, the LVR setpoints have been changed again to accommodate a removal of loads from the Exide UPS's by Design Change Package (DCP) 1,2,3-XE-QD-026.
These changes to the LVR's have resolved the problems associated with the LVR's. This has been confirmed through subsequent system testing and no further problems have been observed in this area.
With regard to low specific gravity, a review of the emergency lighting work orders performed in July, 1990, identified instances in which the recharge time for the Exide batteries exceeded 72 hours8.333333e-4 days <br />0.02 hours <br />1.190476e-4 weeks <br />2.7396e-5 months <br /> before meeting the specific gravity acceptance criteria. The Exide UPS's were considered unavailable until the specific gravity criteria was met. APS considered this a prudent course of action, even though the 72-hour time limit was administratively established.
Specific gravity recovery time requirements are not specified in the manufacturer's instructions or IEEE 450-1980.
l f
e An Engineering Evaluation Request (EER} was issued to determine the factors that prevent rapid recovery of specific gravity.
While the limited output of the battery chargers is the major factor, excessive cable lengths was identified by the EER as a contributing factor.
As a result of DCP 1,2,3-XE-QD-027, the cable length was reduced, thus improving battery charger efficiency. The.EER also recommended reducing the load on the Exide inverter to improve the capacity of the UPS.
As
previously mentioned, DCP 1,2,3-XE-QD-026 was issued to accomplish this.
Retests associated with DCP's 1,2,3-XE-QD-026 and QD-027 in October, 1991 revealed that, while the design changes did provide an improved discharge margin,
"they did not fully resolve the slow recharging issue.
Engineering is considering a number of additional actions to resolve the issue of slow recharging of the Exide
'atteries, including changes to the battery chargers, alternative battery designs, and revised acceptance criteria. Until a permanent resolution is implemented, a maintenance work instruction will be developed to improve specific gravity recovery times of Exide batteries following a freshening charge.
This instruction is expected to be developed during the second quarter of 1992.
llL NRC CONCERN ENGlNEERING AND MANAGEMENTINVOLVEMENT
Appropriate licensee engineering and management personnel do not appear to be properly involved in the timely evaluation and correction of several of those recurring deficiencies.
APS RESPONSE The engineering and management involvement and commitment to proactiveness is clearly demonstrated by the following:
~
PVNGS senior management established the Emergency Lighting Team and closely monitors its actions and reports.
Engineering is proactive in identifying design weaknesses and senior management has committed resources to expeditiously implement required design changes.
As a result, since March, 1989, engineering has issued eight design changes (some of which address multiple issues)
on design weaknesses, In addition, management was proactive in committing funds to expeditiously implement all eight design changes.
~
Senior management has elevated the priority level applied to corrective and preventative maintenance work performed on emergency lighting.
~
MNCR's are used to report and resolve emergency lighting deficiencies.
The Dual-Lite Pilot Program was established to determine the proper PM frequency for Dual-Lltes located in high temperature environments.
~
increased QC inspection time is now being devoted to emergency lighting.
~
Engineering performed a failure mode analysis on Dual-Lite fixtures to more clearly focus Failure Data Trending efforts in that area.
The recurring deficiencies cited by the 'NRC (in Reference 1} demonstrate that engineering and management are deeply involved in the emergency lighting program, since each deficiency was being addressed appropriately, as described in
%ection Il, above. APS management willcontinue to closely monitor the progress of the emergency lighting program to ensure that pending issues are resolved and improved performance is maintained.
Attachment 2 describes enhancements to the program for monitoring performance of the emergency lighting system that are
. being implemented on an interim basis.
ATTACHMENT2 INTERIMEMERGENCY-LIGHTING EQUIPMENT PERFORMANCE MONITORING
lNTERlMEMERGENCY LlGHTlNG EQUlPMENT PERFORMANCE MONlTORING To monitor equipment performance, the System Engineer must be able to trend critical parameters, such as inter-cell voltages, charging voltages and specific gravity. The System Engineer also needs to be cognizant of system problems. To expedite obtaining the necessary parameters and increase System Engineering's real time awareness of emergency lighting performance, the following willoccur:
~
The work order review process willbe changed to provide for in-line review of emergency lighting PM work orders by the System Engineer following the Work Graup Supervisor review. This willallow the System Engineer to sort and trend critical parameters.
Copies of all emergency lighting Material Non-Conformance Reports (MNCR's)
and Condition Reporting/Disposition Requests (CRDR's) willbe provided to the System Engineer to sort and categorize like failures.
~
Failure Data Trending information will be provided to the System Engineer on a
'eekly basis to identify similar failures or problems r~~rc~h
.
<c g>
3n addition, the following willalso be provided:
~
Trending software and training to provide the System Engineer with more sophisticated tools to sort and categorize data.
~
Any additional assistance that may be needed to initiallyset-up and support the enhanced trending program.
These measures willultimately be phased into the System Performance Monitoring and Trending Program as discussed in Attachment 1,Section I.B.
ATTACHMENT3 EMERGENCY LiGHTINGTEAMTRANSITION