ML120100205: Difference between revisions

From kanterella
Jump to navigation Jump to search
(Created page by program invented by StriderTol)
(Created page by program invented by StriderTol)
 
Line 15: Line 15:


=Text=
=Text=
{{#Wiki_filter:ENTERGY NUCLEARNRC Regulatory ConferenceNRC Regulatory ConferencePalisades Nuclear PlantPalisades Nuclear PlantJanuary 11, 2012January 11, 2012Reactor Trip DuringReactor Trip During Panel ED Panel ED--11 11--2 Maintenance2 MaintenanceEntergy Nuclear Operations ENTERGY NUCLEAR 22 Tony Vitale Site Vice PresidentEntergy -Palisades ENTERGY NUCLEAR 333AgendaAgendaIntroductionTony VitaleObjectivesTony VitaleApparent ViolationTony VitaleCausesDavid HamiltonKey Corrective ActionsDavid HamiltonTimelineDavid HamiltonSignificanceFrank YanikConclusionsTony Vitale ENTERGY NUCLEAR 444ObjectivesObjectivesDiscuss the apparent violation andEntergy's acceptanceReview the causal analysis and corrective actions taken and plannedDiscuss the background and event timelineProvide additional insights into the safety significance of the event ENTERGY NUCLEAR 555Apparent ViolationApparent ViolationEntergy concurs with the apparent violationEntergy has additional information forconsideration regarding the safety significance of the finding ENTERGY NUCLEAR 6 Palisades Performance Recovery Plan Palisades Performance Recovery PlanPlan Areas-Leadership Effectiveness-Safety Culture-Corrective Action Program-Equipment Reliability-Refueling Outages-Communication Plan ENTERGY NUCLEAR 7 Palisades Performance Recovery Plan Palisades Performance Recovery PlanLeadership Effectiveness
{{#Wiki_filter:NRC Regulatory Conference Palisades Nuclear Plant January 11, 2012 Reactor Trip During Panel ED-11-2 Maintenance Entergy Nuclear Operations ENTERGY NUCLEAR
-Problem Statement-Leaders are not sufficientlyengaged and intrusive to identify and correctbehavior and performance gaps at all levels of theorganization.
 
-Vision Statement-Leaders are engaged andintrusive to identify and correct behavior andperformance gaps. Leaders routinely spend time inthe field with eyes on the problems to provideoversight and reinforce standards. Leaderscontinually reinforce the principles for a strongnuclear safety culture.
Tony Vitale Site Vice President Entergy - Palisades ENTERGY NUCLEAR                     2
ENTERGY NUCLEAR 8 Palisades Performance Recovery Plan Palisades Performance Recovery PlanSafety Culture
 
-Problem Statement -Degradation of safetyculture principles has led to siteperformance deficiencies
Agenda
-Vision Statement-All station personnelexhibit proper risk sensitivity andawareness. Mitigating strategies areconsistently implemented.
* Introduction            Tony Vitale
ENTERGY NUCLEAR 9 Palisades Performance Recovery Plan Palisades Performance Recovery PlanCorrective Action Program-Problem Statement-The Corrective ActionProgram is not always valued or effectivelyused by Palisades leadership and personnelto identify, investigate, and correct problemsin a timely manner to improve performance.-Vision Statement-Success in theimplementation of a strong corrective actionprogram is evidenced by Palisadespersonnel identifying and correcting issuesat low levels.
* Objectives              Tony Vitale
ENTERGY NUCLEAR 10 Palisades Performance Recovery Plan Palisades Performance Recovery PlanEquipment Reliability-Problem Statement-Critical equipment failureshave lead to plant derates, forced outages,schedule perturbations, increased radiological dose,unplanned limiting conditions for operation, reworkand failed post maintenance tests. Scheduleadherence and stability are improved, thus limitingrisk to operation.-Vision Statement-Success in equipment reliabilityis evidenced by Palisades achieving top decileperformance in unit capability factor (currently>94.38%), low rework rates, lower collectiveradiation exposure and no unplanned AOTs.
* Apparent Violation      Tony Vitale
ENTERGY NUCLEAR 11 Palisades Performance Recovery Plan Palisades Performance Recovery PlanRefueling Outages
* Causes                  David Hamilton
-Problem Statement-Ownership of the outage preparation andexecution process must be improved to support station operation andmaintenance. Work must be scheduled where appropriate, plannedeffectively and completed when scheduled.
* Key Corrective Actions  David Hamilton
-Vision Statement-The objective of this Recovery Plan is to provideimprovement in the implementation of the outage managementprocess at Palisades by the following:Affirming and continually reinforcing ownership of the outage workmanagement process by all Palisades employees and contractors throughfrequent communication, effective preparatory meetings and management interaction.Establishing effective outage preparation meetings so that highaccountability and team work is evident in preparations.Displaying effective performance indicators to drive accountability down tothe supervisor/worker level inside and outside of the Planning, Scheduling &Outage department.Developing a long range schedule of coordinated self evaluation,peerevaluation and nuclear oversight to assess the adequacy of outagereadiness, its implementation at all levels, and potential areasforimprovement.
* Timeline                David Hamilton
ENTERGY NUCLEAR 12 Palisades Performance Recovery Plan Palisades Performance Recovery PlanCommunication Plan
* Significance            Frank Yanik
-Problem Statement-Important to ensure wecommunicate effectively to our employeesand have them engaged in our recovery.-Vision Statement-Palisades employees arewell informed of the causes, contributorsand corrective actions of our currentsituation. Additionally, the employees areengaged and empowered in the execution ofthe plan. Employee ownership is evident.
* Conclusions              Tony Vitale ENTERGY NUCLEAR                               3
ENTERGY NUCLEAR 13 13 David HamiltonGeneral Manager Plant OperationsEntergy -Palisades ENTERGY NUCLEAR 14 Event ResponsePalisades Root Cause Evaluation Team-Human performance error review and event timeline-Focused on both direct technical cause andorganization and programmatic aspectsCorporate Event Response Team (CERT)-Independently reviewed event causes and contributors-Focused on organizational and programmatic aspects ENTERGY NUCLEAR 15 15 15Causal AnalysisCausal AnalysisRoot Cause -OrganizationalSenior leaders have not established a sufficientlysensitive culture of risk recognition andmanagement. This resulted in the plant'smanagers, supervisors and workers notrecognizing, accounting for, or preparing for, theindustrial safety risk and plant operational nuclearrisk involved with the panel ED-11-2 breakerinspection and replacement maintenance.
 
ENTERGY NUCLEAR 16 16 16Causal AnalysisCausal AnalysisContributing Cause 1 -TechnicalBreaker coordination for the 125 VDC system left train was insufficient toprevent a reactor trip under the short circuit conditions experienced duringED-11-2 maintenance on 09/25/11Contributing Cause 2 -OrganizationalWork orders used for removal and inspection of breakers 72-119, 72-120, 72-121 and 72-123 did not include details appropriate for maintenance onenergized, high critical electrical equipment with the plant on lineContributing Cause 3 -Human PerformanceOversight by managers and supervisors did not result in identification andcorrection of the human performance errors and weaknesses in theworkinvolving the inspection and replacement of breakers in the ED-11-2 panelContributing Cause 4 -Human PerformanceManagers, supervisors and workers did not consistently follow approvedprocedures for job preparation, job execution and risk management ENTERGY NUCLEAR 17 17 17Corrective ActionsCorrective ActionsKey Technical Actions -short termactions to prevent recurrenceTemporary modification was installed to raise themagnetic trip settings of breakers 72-01 and 72-02 to the highest level, coupled with removingcircuits capable of exceeding trip currentDamaged bus connectors and suspect breakersin Panel ED-11-2 were replaced ENTERGY NUCLEAR 18 18 18Corrective ActionsCorrective ActionsKey Organizational ActionsEntergy Standards for procedure compliance,accountability, and intolerable behaviorsreinforced via face to face communications fromthe COO through Individual Contributor LevelsManagement observation program structuredwith guidance to provide specific oversight andfeedback on safety culture behaviors, riskrecognition and mitigation, procedure adherence,and standards reinforcement.Initiated third party safety culture assessment ENTERGY NUCLEAR 19 19 19Corrective ActionsCorrective Actions Key Human Performance ActionsEnsure compliance with Entergy risk management proceduresIssued guidance for work on all energizedelectrical circuits to ensure appropriate nuclear safetyWork order quality improvements ENTERGY NUCLEAR 20 20 20Corrective ActionsCorrective ActionsKey Work Management ActionsAt T-5 critical evolutions meeting and T-2technical rigor meeting, validate actions andmitigation of risk associated with work activities-SVP challenge of risk assessment-Fleet challenge up through COO of risk assessmentClear identification of risk activities and riskmitigators in work schedules, and daily planning meetings ENTERGY NUCLEAR 21Palisades Recovery Plan and Fleet ActionsDefined intolerable leader behaviorsDefined intolerable worker behaviorsReview of risk activities cascaded through siteand corporate managementStructured paired management observation andintervention of worker and leader behaviors-Fleet observation and intervention-Independent observation and interventionLeadership assessment of organizational andsafety culture competencies.
Objectives
ENTERGY NUCLEAR 22Importance of TimelineExtremely important to our significance determination tounderstand the timeline with accuracy-Impact on human performance assumptions-Impact on operator capability assumptions-Assumed plant conditions during various points in the event in the PRAExtensive validation effort to ensure accuracy for bothPRA and root cause evaluation ENTERGY NUCLEAR 23 23Timeline -Event9/25/11 (Sun): Initial conditions (prior to event)9/25/11 15:06: Equipment actuation9/25/11 15:06: EOP-1 Post-Trip entered9/25/11 15:17: Generator breakers opened viarelay jumper9/25/11 15:27: EOP-9 Functional Recovery entered*9/25/11 15:28: Pressurizer level exceeded 62.8%*9/25/11 15:31: High S/G E-50A level @ 90%*9/25/11 15:31: ONP-2.3 Loss of DC Power entered*Denotes events critical to PRA discussion ENTERGY NUCLEAR 24 24Timeline -Event9/25/11 15:37:   ONP 24.1 and ONP 24.3 Loss of PreferredAC Bus Y-10 and Y-30 entered*9/25/11 15:37: High PCS pressure (2200 psia) and highpressurizer level; B channel controllersplaced in service9/25/11 15:42: CVCS letdown orifice stop valves closed*9/25/11 15:44: P-8C AFW flow to S/G E-50A isolated9/25/11 15:49: Power restored to 2400V Bus 1E EA-13*9/25/11 15:57: Left channel SIAS; SI throttled*9/25/11 15:57: DC busses ED-10L & ED-10R, andpreferred AC bus EY-30 reenergized*Denotes events critical to PRA discussion ENTERGY NUCLEAR 25 25Timeline -Event9/25/11 16:02: Power restored to bus 1E EA-13*9/25/11 16:03: Steam supply to AFW pump P-8B isolated*9/25/11 16:09: AFW flow to S/G E-50B isolated*9/25/11 16:15: Pressurizer level peaks at 101.5%*9/25/11 16:39: P-8C AFW flow to S/G E-50B restored*9/25/11 16:46: Preferred AC bus EY-10 reenergized;ADVs available*9/25/11 18:52: AFW pump P-8B availability restored*9/25/11 19:33: Battery charger #3 ED-17 placed in service*Denotes events critical to PRA discussion ENTERGY NUCLEAR 26 26 Frank YanikPRA EngineerEntergy -Palisades ENTERGY NUCLEAR 27 27 27 Significance Determination Significance DeterminationOverview and conclusionsKey inputs and assumptionsImpact on event risk characterization ENTERGY NUCLEAR 28 28 Significance Determination Significance Determination Preface PrefaceEvent TimelineRigorous timeline validationData context important 28 ENTERGY NUCLEAR 29 29 Significance Determination Significance DeterminationEntergy ConclusionsEntergy ConclusionsCCDP is4.3E-6Dominant sequences involve failure to recover lost trainof DC power sourceContributing sequences involve failure to securecharging pumps prior to lifting PZR SRVsStuck open PZR SRV LOCA can be mitigated withcharging system (2 of 3 pumps and SIRWT suctionsource) and AFW 29 ENTERGY NUCLEAR 30 30 Significance Determination Significance Determination Entergy Conclusions (con Entergy Conclusions (con
* Discuss the apparent violation and Entergys acceptance
''t)t)Isolation of turbine driven auxiliary feedwater pump P-8Bto avoid overfill not a significant risk contributorMotor driven auxiliary feedwater pump P-8A remainedavailable from control room throughout eventRestoration of P-8B simple, well-trained task,especially given EOP Supplement 19 steps alreadyperformed 30 ENTERGY NUCLEAR 31 31 31 Entergy Perspectives on Entergy Perspectives onKey Inputs and AssumptionsKey Inputs and AssumptionsProbability of recovery of DC powerProbability of preventing challenge (lift) ofpressurizer (PZR) safety relief valve (SRV)Probability of stuck open PZR SRVAvailability of AFW Pump P-8ANormal maintenance unavailabilities ENTERGY NUCLEAR 32 32 Probability of DC Power Recovery Probability of DC Power RecoveryTime available to recover DC power is at least 2 hours(no AFW)Actions to restore power are simple and straightforwardonce the fault condition is clearedTwo options are available to restore DC power:Restoration of the connection of the DC bussegments to the battery (HEP = 0.1)Alignment of the alternate charger to the DC bussegments (HEP = 0.1)Total Effective HEP 0.01 (0.1
* Review the causal analysis and corrective actions taken and planned
* 0.1) 32 ENTERGY NUCLEAR 33 33 33PZR SRV Challenge ProbabilityPZR SRV Challenge ProbabilityComplexity of action and time available greatlyimpact probability (and overall results)For Entergy modelAction is simple trip of operating charging pumpsTime available based on maximum charging flow forloss of DC eventTime available allows for recovery of failed attemptsFor NRC evaluationAction is "control pressurizer level"-may be viewedas more complexTime available about equal to time required -may bebased on 133 gpm charging flow ENTERGY NUCLEAR 34PZR SRV Challenge Probability HEP TimelineTime available to diagnose/execute action -62 mins
* Discuss the background and event timeline
-Operators determine in-service channel A to PZR levelcontrol is de-energized and change to channel B -31minutes (1537)
* Provide additional insights into the safety significance of the event ENTERGY NUCLEAR                                   4
-Time to operators confirm boration requirements met -51minutes (1557)
 
-Operators terminated charging flow -51 minutes (1557)11 minutes remained available to complete theaction to prevent a challenge to PZR safeties ENTERGY NUCLEAR 35 35 35Stuck Open PZR SRV ProbabilityStuck Open PZR SRV ProbabilityPalisades valves tested for steam, transition & water relief (part ofTMI Action Plan)Test conditions based on consideration of PWR FSAR transientsand extended high pressure liquid injection eventsAll tests found satisfactory operationFor Entergy modelPalisades-specific SRV qualification testing supports use of generic failure ratesFor NRC evaluationGeneric bounding SRV failure probability used ENTERGY NUCLEAR 36 36 36AFW PAFW P--8A Availability8A AvailabilityP-8A remained available on manual start from thecontrol room (or locally) throughout eventLoss of DC power resulted in loss of power to pump controlschemeHowever, without DC panel ED-11-1, a low suction pressure tripsignal cannot trip the pumpED-11A remained available; this provided DC power to theswitchgear supplying AC to P-8AAssuming P-8A unavailable without restoration increasesimportance of restoration of P-8B ENTERGY NUCLEAR 37 37 37ConclusionConclusionBased on investigation and evaluation of theevent, Entergy determined that the CCDP is 4.3E-6a.Failure to recover DC power is ~ 74% of CCDPb.Failure to control pressurizer level is ~ 16%
Apparent Violation
of CCDP ENTERGY NUCLEAR 38 38 Tony Vitale Site Vice PresidentEntergy -Palisades ENTERGY NUCLEAR 39 39 39 Summary SummaryEntergy concurs with the violationA thorough review of the event wasperformed to identify all related causesEntergy has developed effectivecorrective actions for root andcontributing causesFleet engagementWelcome the opportunity for future updates with Staff}}
* Entergy concurs with the apparent violation
* Entergy has additional information for consideration regarding the safety significance of the finding ENTERGY NUCLEAR                              5
 
Palisades Performance Recovery Plan
* Plan Areas
        -   Leadership Effectiveness
        -   Safety Culture
        -   Corrective Action Program
        -   Equipment Reliability
        -   Refueling Outages
        -   Communication Plan ENTERGY NUCLEAR                           6
 
Palisades Performance Recovery Plan
* Leadership Effectiveness
        -   Problem Statement - Leaders are not sufficiently engaged and intrusive to identify and correct behavior and performance gaps at all levels of the organization.
        -   Vision Statement - Leaders are engaged and intrusive to identify and correct behavior and performance gaps. Leaders routinely spend time in the field with eyes on the problems to provide oversight and reinforce standards. Leaders continually reinforce the principles for a strong nuclear safety culture.
ENTERGY NUCLEAR                                                 7
 
Palisades Performance Recovery Plan
* Safety Culture
        - Problem Statement - Degradation of safety culture principles has led to site performance deficiencies
        - Vision Statement - All station personnel exhibit proper risk sensitivity and awareness. Mitigating strategies are consistently implemented.
ENTERGY NUCLEAR                                     8
 
Palisades Performance Recovery Plan
* Corrective Action Program
        -   Problem Statement - The Corrective Action Program is not always valued or effectively used by Palisades leadership and personnel to identify, investigate, and correct problems in a timely manner to improve performance.
        -   Vision Statement - Success in the implementation of a strong corrective action program is evidenced by Palisades personnel identifying and correcting issues at low levels.
ENTERGY NUCLEAR                                             9
 
Palisades Performance Recovery Plan
* Equipment Reliability
        -   Problem Statement - Critical equipment failures have lead to plant derates, forced outages, schedule perturbations, increased radiological dose, unplanned limiting conditions for operation, rework and failed post maintenance tests. Schedule adherence and stability are improved, thus limiting risk to operation.
        -   Vision Statement - Success in equipment reliability is evidenced by Palisades achieving top decile performance in unit capability factor (currently
              >94.38%), low rework rates, lower collective radiation exposure and no unplanned AOTs.
ENTERGY NUCLEAR                                                   10
 
Palisades Performance Recovery Plan
* Refueling Outages
        -     Problem Statement - Ownership of the outage preparation and execution process must be improved to support station operation and maintenance. Work must be scheduled where appropriate, planned effectively and completed when scheduled.
        -     Vision Statement - The objective of this Recovery Plan is to provide improvement in the implementation of the outage management process at Palisades by the following:
* Affirming and continually reinforcing ownership of the outage work management process by all Palisades employees and contractors through frequent communication, effective preparatory meetings and management interaction.
* Establishing effective outage preparation meetings so that high accountability and team work is evident in preparations.
* Displaying effective performance indicators to drive accountability down to the supervisor/worker level inside and outside of the Planning, Scheduling &
Outage department.
* Developing a long range schedule of coordinated self evaluation, peer evaluation and nuclear oversight to assess the adequacy of outage readiness, its implementation at all levels, and potential areas for improvement.
ENTERGY NUCLEAR                                                                             11
 
Palisades Performance Recovery Plan
* Communication Plan
        - Problem Statement - Important to ensure we communicate effectively to our employees and have them engaged in our recovery.
        - Vision Statement - Palisades employees are well informed of the causes, contributors and corrective actions of our current situation. Additionally, the employees are engaged and empowered in the execution of the plan. Employee ownership is evident.
ENTERGY NUCLEAR                                         12
 
David Hamilton General Manager Plant Operations Entergy - Palisades ENTERGY NUCLEAR                             13
 
Event Response
* Palisades Root Cause Evaluation Team
        - Human performance error review and event timeline
        - Focused on both direct technical cause and organization and programmatic aspects
* Corporate Event Response Team (CERT)
        - Independently reviewed event causes and contributors
        - Focused on organizational and programmatic aspects ENTERGY NUCLEAR                                       14
 
Causal Analysis Root Cause - Organizational Senior leaders have not established a sufficiently sensitive culture of risk recognition and management. This resulted in the plants managers, supervisors and workers not recognizing, accounting for, or preparing for, the industrial safety risk and plant operational nuclear risk involved with the panel ED-11-2 breaker inspection and replacement maintenance.
ENTERGY NUCLEAR                                         15
 
Causal Analysis Contributing Cause 1 - Technical Breaker coordination for the 125 VDC system left train was insufficient to prevent a reactor trip under the short circuit conditions experienced during ED-11-2 maintenance on 09/25/11 Contributing Cause 2 - Organizational Work orders used for removal and inspection of breakers 72-119, 72-120, 72-121 and 72-123 did not include details appropriate for maintenance on energized, high critical electrical equipment with the plant on line Contributing Cause 3 - Human Performance Oversight by managers and supervisors did not result in identification and correction of the human performance errors and weaknesses in the work involving the inspection and replacement of breakers in the ED-11-2 panel Contributing Cause 4 - Human Performance Managers, supervisors and workers did not consistently follow approved procedures for job preparation, job execution and risk management ENTERGY NUCLEAR                                                                 16
 
Corrective Actions Key Technical Actions - short term actions to prevent recurrence
* Temporary modification was installed to raise the magnetic trip settings of breakers 72-01 and 72-02 to the highest level, coupled with removing circuits capable of exceeding trip current
* Damaged bus connectors and suspect breakers in Panel ED-11-2 were replaced ENTERGY NUCLEAR                                       17
 
Corrective Actions Key Organizational Actions
* Entergy Standards for procedure compliance, accountability, and intolerable behaviors reinforced via face to face communications from the COO through Individual Contributor Levels
* Management observation program structured with guidance to provide specific oversight and feedback on safety culture behaviors, risk recognition and mitigation, procedure adherence, and standards reinforcement.
* Initiated third party safety culture assessment ENTERGY NUCLEAR                                       18
 
Corrective Actions Key Human Performance Actions
* Ensure compliance with Entergy risk management procedures
* Issued guidance for work on all energized electrical circuits to ensure appropriate nuclear safety
* Work order quality improvements ENTERGY NUCLEAR                                 19
 
Corrective Actions Key Work Management Actions
* At T-5 critical evolutions meeting and T-2 technical rigor meeting, validate actions and mitigation of risk associated with work activities
        - SVP challenge of risk assessment
        - Fleet challenge up through COO of risk assessment
* Clear identification of risk activities and risk mitigators in work schedules, and daily planning meetings ENTERGY NUCLEAR                                             20
 
Palisades Recovery Plan and Fleet Actions
* Defined intolerable leader behaviors
* Defined intolerable worker behaviors
* Review of risk activities cascaded through site and corporate management
* Structured paired management observation and intervention of worker and leader behaviors
        - Fleet observation and intervention
        - Independent observation and intervention
* Leadership assessment of organizational and safety culture competencies.
ENTERGY NUCLEAR                                       21
 
Importance of Timeline
* Extremely important to our significance determination to understand the timeline with accuracy
        - Impact on human performance assumptions
        - Impact on operator capability assumptions
        - Assumed plant conditions during various points in the event in the PRA
* Extensive validation effort to ensure accuracy for both PRA and root cause evaluation ENTERGY NUCLEAR                                                           22
 
Timeline - Event 9/25/11 (Sun): Initial conditions (prior to event) 9/25/11 15:06: Equipment actuation 9/25/11 15:06: EOP-1 Post-Trip entered 9/25/11 15:17: Generator breakers opened via relay jumper 9/25/11 15:27: EOP-9 Functional Recovery entered
    *9/25/11 15:28: Pressurizer level exceeded 62.8%
    *9/25/11 15:31: High S/G E-50A level @ 90%
    *9/25/11 15:31: ONP-2.3 Loss of DC Power entered
    *Denotes events critical to PRA discussion ENTERGY NUCLEAR                                       23
 
Timeline - Event 9/25/11 15:37: ONP 24.1 and ONP 24.3 Loss of Preferred AC Bus Y-10 and Y-30 entered
    *9/25/11 15:37: High PCS pressure (2200 psia) and high pressurizer level; B channel controllers placed in service 9/25/11 15:42: CVCS letdown orifice stop valves closed
    *9/25/11 15:44: P-8C AFW flow to S/G E-50A isolated 9/25/11 15:49: Power restored to 2400V Bus 1E EA-13
    *9/25/11 15:57: Left channel SIAS; SI throttled
    *9/25/11 15:57: DC busses ED-10L & ED-10R, and preferred AC bus EY-30 reenergized
    *Denotes events critical to PRA discussion ENTERGY NUCLEAR                                             24
 
Timeline - Event 9/25/11 16:02: Power restored to bus 1E EA-13
    *9/25/11 16:03: Steam supply to AFW pump P-8B isolated
    *9/25/11 16:09: AFW flow to S/G E-50B isolated
    *9/25/11 16:15: Pressurizer level peaks at 101.5%
    *9/25/11 16:39: P-8C AFW flow to S/G E-50B restored
    *9/25/11 16:46: Preferred AC bus EY-10 reenergized; ADVs available
    *9/25/11 18:52: AFW pump P-8B availability restored
    *9/25/11 19:33: Battery charger #3 ED-17 placed in service
    *Denotes events critical to PRA discussion ENTERGY NUCLEAR                                             25
 
Frank Yanik PRA Engineer Entergy - Palisades ENTERGY NUCLEAR                     26
 
Significance Determination
* Overview and conclusions
* Key inputs and assumptions
* Impact on event risk characterization ENTERGY NUCLEAR                             27
 
Significance Determination Preface
* Event Timeline
* Rigorous timeline validation
* Data context important ENTERGY NUCLEAR                           28
 
Significance Determination Entergy Conclusions CCDP is 4.3E-6
* Dominant sequences involve failure to recover lost train of DC power source
* Contributing sequences involve failure to secure charging pumps prior to lifting PZR SRVs
* Stuck open PZR SRV LOCA can be mitigated with charging system (2 of 3 pumps and SIRWT suction source) and AFW ENTERGY NUCLEAR                                               29
 
Significance Determination Entergy Conclusions (cont)
* Isolation of turbine driven auxiliary feedwater pump P-8B to avoid overfill not a significant risk contributor
* Motor driven auxiliary feedwater pump P-8A remained available from control room throughout event
* Restoration of P-8B simple, well-trained task, especially given EOP Supplement 19 steps already performed ENTERGY NUCLEAR                                               30
 
Entergy Perspectives on Key Inputs and Assumptions
* Probability of recovery of DC power
* Probability of preventing challenge (lift) of pressurizer (PZR) safety relief valve (SRV)
* Probability of stuck open PZR SRV
* Availability of AFW Pump P-8A
* Normal maintenance unavailabilities ENTERGY NUCLEAR                                   31
 
Probability of DC Power Recovery
* Time available to recover DC power is at least 2 hours (no AFW)
* Actions to restore power are simple and straightforward once the fault condition is cleared
* Two options are available to restore DC power:
* Restoration of the connection of the DC bus segments to the battery (HEP = 0.1)
* Alignment of the alternate charger to the DC bus segments (HEP = 0.1)
* Total Effective HEP 0.01 (0.1
* 0.1)
ENTERGY NUCLEAR                                               32
 
PZR SRV Challenge Probability
* Complexity of action and time available greatly impact probability (and overall results)
* For Entergy model
* Action is simple trip of operating charging pumps
* Time available based on maximum charging flow for loss of DC event
* Time available allows for recovery of failed attempts
* For NRC evaluation
* Action is control pressurizer level - may be viewed as more complex
* Time available about equal to time required - may be based on 133 gpm charging flow ENTERGY NUCLEAR                                                 33
 
PZR SRV Challenge Probability HEP Timeline
* Time available to diagnose/execute action - 62 mins
        - Operators determine in-service channel A to PZR level control is de-energized and change to channel B - 31 minutes (1537)
        - Time to operators confirm boration requirements met - 51 minutes (1557)
        - Operators terminated charging flow - 51 minutes (1557)
* 11 minutes remained available to complete the action to prevent a challenge to PZR safeties ENTERGY NUCLEAR                                                     34
 
Stuck Open PZR SRV Probability
* Palisades valves tested for steam, transition & water relief (part of TMI Action Plan)
* Test conditions based on consideration of PWR FSAR transients and extended high pressure liquid injection events
* All tests found satisfactory operation
* For Entergy model
* Palisades-specific SRV qualification testing supports use of generic failure rates
* For NRC evaluation
* Generic bounding SRV failure probability used ENTERGY NUCLEAR                                                                             35
 
AFW P-8A Availability
* P-8A remained available on manual start from the control room (or locally) throughout event
* Loss of DC power resulted in loss of power to pump control scheme
* However, without DC panel ED-11-1, a low suction pressure trip signal cannot trip the pump
* ED-11A remained available; this provided DC power to the switchgear supplying AC to P-8A
* Assuming P-8A unavailable without restoration increases importance of restoration of P-8B ENTERGY NUCLEAR                                                         36
 
Conclusion
* Based on investigation and evaluation of the event, Entergy determined that the CCDP is 4.3E-6
: a. Failure to recover DC power is ~ 74% of CCDP
: b. Failure to control pressurizer level is ~ 16%
of CCDP ENTERGY NUCLEAR                                           37
 
Tony Vitale Site Vice President Entergy - Palisades ENTERGY NUCLEAR                    38
 
Summary
* Entergy concurs with the violation
* A thorough review of the event was performed to identify all related causes
* Entergy has developed effective corrective actions for root and contributing causes
* Fleet engagement
* Welcome the opportunity for future updates with Staff ENTERGY NUCLEAR                                 39}}

Latest revision as of 09:54, 12 November 2019

D-11-2 Presentation for Meeting on January 11, 2012, at 1:30 Pm
ML120100205
Person / Time
Site: Palisades Entergy icon.png
Issue date: 01/11/2012
From:
Entergy Nuclear Operations
To:
NRC/RGN-III
References
Download: ML120100205 (39)


Text

NRC Regulatory Conference Palisades Nuclear Plant January 11, 2012 Reactor Trip During Panel ED-11-2 Maintenance Entergy Nuclear Operations ENTERGY NUCLEAR

Tony Vitale Site Vice President Entergy - Palisades ENTERGY NUCLEAR 2

Agenda

  • Introduction Tony Vitale
  • Objectives Tony Vitale
  • Apparent Violation Tony Vitale
  • Causes David Hamilton
  • Key Corrective Actions David Hamilton
  • Timeline David Hamilton
  • Significance Frank Yanik
  • Conclusions Tony Vitale ENTERGY NUCLEAR 3

Objectives

  • Discuss the apparent violation and Entergys acceptance
  • Review the causal analysis and corrective actions taken and planned
  • Discuss the background and event timeline
  • Provide additional insights into the safety significance of the event ENTERGY NUCLEAR 4

Apparent Violation

  • Entergy concurs with the apparent violation
  • Entergy has additional information for consideration regarding the safety significance of the finding ENTERGY NUCLEAR 5

Palisades Performance Recovery Plan

  • Plan Areas

- Leadership Effectiveness

- Safety Culture

- Corrective Action Program

- Equipment Reliability

- Refueling Outages

- Communication Plan ENTERGY NUCLEAR 6

Palisades Performance Recovery Plan

  • Leadership Effectiveness

- Problem Statement - Leaders are not sufficiently engaged and intrusive to identify and correct behavior and performance gaps at all levels of the organization.

- Vision Statement - Leaders are engaged and intrusive to identify and correct behavior and performance gaps. Leaders routinely spend time in the field with eyes on the problems to provide oversight and reinforce standards. Leaders continually reinforce the principles for a strong nuclear safety culture.

ENTERGY NUCLEAR 7

Palisades Performance Recovery Plan

  • Safety Culture

- Problem Statement - Degradation of safety culture principles has led to site performance deficiencies

- Vision Statement - All station personnel exhibit proper risk sensitivity and awareness. Mitigating strategies are consistently implemented.

ENTERGY NUCLEAR 8

Palisades Performance Recovery Plan

  • Corrective Action Program

- Problem Statement - The Corrective Action Program is not always valued or effectively used by Palisades leadership and personnel to identify, investigate, and correct problems in a timely manner to improve performance.

- Vision Statement - Success in the implementation of a strong corrective action program is evidenced by Palisades personnel identifying and correcting issues at low levels.

ENTERGY NUCLEAR 9

Palisades Performance Recovery Plan

  • Equipment Reliability

- Problem Statement - Critical equipment failures have lead to plant derates, forced outages, schedule perturbations, increased radiological dose, unplanned limiting conditions for operation, rework and failed post maintenance tests. Schedule adherence and stability are improved, thus limiting risk to operation.

- Vision Statement - Success in equipment reliability is evidenced by Palisades achieving top decile performance in unit capability factor (currently

>94.38%), low rework rates, lower collective radiation exposure and no unplanned AOTs.

ENTERGY NUCLEAR 10

Palisades Performance Recovery Plan

  • Refueling Outages

- Problem Statement - Ownership of the outage preparation and execution process must be improved to support station operation and maintenance. Work must be scheduled where appropriate, planned effectively and completed when scheduled.

- Vision Statement - The objective of this Recovery Plan is to provide improvement in the implementation of the outage management process at Palisades by the following:

  • Affirming and continually reinforcing ownership of the outage work management process by all Palisades employees and contractors through frequent communication, effective preparatory meetings and management interaction.
  • Establishing effective outage preparation meetings so that high accountability and team work is evident in preparations.
  • Displaying effective performance indicators to drive accountability down to the supervisor/worker level inside and outside of the Planning, Scheduling &

Outage department.

  • Developing a long range schedule of coordinated self evaluation, peer evaluation and nuclear oversight to assess the adequacy of outage readiness, its implementation at all levels, and potential areas for improvement.

ENTERGY NUCLEAR 11

Palisades Performance Recovery Plan

  • Communication Plan

- Problem Statement - Important to ensure we communicate effectively to our employees and have them engaged in our recovery.

- Vision Statement - Palisades employees are well informed of the causes, contributors and corrective actions of our current situation. Additionally, the employees are engaged and empowered in the execution of the plan. Employee ownership is evident.

ENTERGY NUCLEAR 12

David Hamilton General Manager Plant Operations Entergy - Palisades ENTERGY NUCLEAR 13

Event Response

  • Palisades Root Cause Evaluation Team

- Human performance error review and event timeline

- Focused on both direct technical cause and organization and programmatic aspects

  • Corporate Event Response Team (CERT)

- Independently reviewed event causes and contributors

- Focused on organizational and programmatic aspects ENTERGY NUCLEAR 14

Causal Analysis Root Cause - Organizational Senior leaders have not established a sufficiently sensitive culture of risk recognition and management. This resulted in the plants managers, supervisors and workers not recognizing, accounting for, or preparing for, the industrial safety risk and plant operational nuclear risk involved with the panel ED-11-2 breaker inspection and replacement maintenance.

ENTERGY NUCLEAR 15

Causal Analysis Contributing Cause 1 - Technical Breaker coordination for the 125 VDC system left train was insufficient to prevent a reactor trip under the short circuit conditions experienced during ED-11-2 maintenance on 09/25/11 Contributing Cause 2 - Organizational Work orders used for removal and inspection of breakers 72-119, 72-120, 72-121 and 72-123 did not include details appropriate for maintenance on energized, high critical electrical equipment with the plant on line Contributing Cause 3 - Human Performance Oversight by managers and supervisors did not result in identification and correction of the human performance errors and weaknesses in the work involving the inspection and replacement of breakers in the ED-11-2 panel Contributing Cause 4 - Human Performance Managers, supervisors and workers did not consistently follow approved procedures for job preparation, job execution and risk management ENTERGY NUCLEAR 16

Corrective Actions Key Technical Actions - short term actions to prevent recurrence

  • Temporary modification was installed to raise the magnetic trip settings of breakers 72-01 and 72-02 to the highest level, coupled with removing circuits capable of exceeding trip current
  • Damaged bus connectors and suspect breakers in Panel ED-11-2 were replaced ENTERGY NUCLEAR 17

Corrective Actions Key Organizational Actions

  • Entergy Standards for procedure compliance, accountability, and intolerable behaviors reinforced via face to face communications from the COO through Individual Contributor Levels
  • Management observation program structured with guidance to provide specific oversight and feedback on safety culture behaviors, risk recognition and mitigation, procedure adherence, and standards reinforcement.
  • Initiated third party safety culture assessment ENTERGY NUCLEAR 18

Corrective Actions Key Human Performance Actions

  • Ensure compliance with Entergy risk management procedures
  • Issued guidance for work on all energized electrical circuits to ensure appropriate nuclear safety
  • Work order quality improvements ENTERGY NUCLEAR 19

Corrective Actions Key Work Management Actions

  • At T-5 critical evolutions meeting and T-2 technical rigor meeting, validate actions and mitigation of risk associated with work activities

- SVP challenge of risk assessment

- Fleet challenge up through COO of risk assessment

  • Clear identification of risk activities and risk mitigators in work schedules, and daily planning meetings ENTERGY NUCLEAR 20

Palisades Recovery Plan and Fleet Actions

  • Defined intolerable leader behaviors
  • Defined intolerable worker behaviors
  • Review of risk activities cascaded through site and corporate management
  • Structured paired management observation and intervention of worker and leader behaviors

- Fleet observation and intervention

- Independent observation and intervention

  • Leadership assessment of organizational and safety culture competencies.

ENTERGY NUCLEAR 21

Importance of Timeline

  • Extremely important to our significance determination to understand the timeline with accuracy

- Impact on human performance assumptions

- Impact on operator capability assumptions

- Assumed plant conditions during various points in the event in the PRA

  • Extensive validation effort to ensure accuracy for both PRA and root cause evaluation ENTERGY NUCLEAR 22

Timeline - Event 9/25/11 (Sun): Initial conditions (prior to event) 9/25/11 15:06: Equipment actuation 9/25/11 15:06: EOP-1 Post-Trip entered 9/25/11 15:17: Generator breakers opened via relay jumper 9/25/11 15:27: EOP-9 Functional Recovery entered

  • 9/25/11 15:28: Pressurizer level exceeded 62.8%
  • 9/25/11 15:31: High S/G E-50A level @ 90%
  • 9/25/11 15:31: ONP-2.3 Loss of DC Power entered
  • Denotes events critical to PRA discussion ENTERGY NUCLEAR 23

Timeline - Event 9/25/11 15:37: ONP 24.1 and ONP 24.3 Loss of Preferred AC Bus Y-10 and Y-30 entered

  • 9/25/11 15:37: High PCS pressure (2200 psia) and high pressurizer level; B channel controllers placed in service 9/25/11 15:42: CVCS letdown orifice stop valves closed
  • 9/25/11 15:44: P-8C AFW flow to S/G E-50A isolated 9/25/11 15:49: Power restored to 2400V Bus 1E EA-13
  • 9/25/11 15:57: Left channel SIAS; SI throttled
  • 9/25/11 15:57: DC busses ED-10L & ED-10R, and preferred AC bus EY-30 reenergized
  • Denotes events critical to PRA discussion ENTERGY NUCLEAR 24

Timeline - Event 9/25/11 16:02: Power restored to bus 1E EA-13

  • 9/25/11 16:03: Steam supply to AFW pump P-8B isolated
  • 9/25/11 16:09: AFW flow to S/G E-50B isolated
  • 9/25/11 16:15: Pressurizer level peaks at 101.5%
  • 9/25/11 16:39: P-8C AFW flow to S/G E-50B restored
  • 9/25/11 16:46: Preferred AC bus EY-10 reenergized; ADVs available
  • 9/25/11 18:52: AFW pump P-8B availability restored
  • 9/25/11 19:33: Battery charger #3 ED-17 placed in service
  • Denotes events critical to PRA discussion ENTERGY NUCLEAR 25

Frank Yanik PRA Engineer Entergy - Palisades ENTERGY NUCLEAR 26

Significance Determination

  • Overview and conclusions
  • Key inputs and assumptions
  • Impact on event risk characterization ENTERGY NUCLEAR 27

Significance Determination Preface

  • Event Timeline
  • Rigorous timeline validation
  • Data context important ENTERGY NUCLEAR 28

Significance Determination Entergy Conclusions CCDP is 4.3E-6

  • Dominant sequences involve failure to recover lost train of DC power source
  • Contributing sequences involve failure to secure charging pumps prior to lifting PZR SRVs
  • Stuck open PZR SRV LOCA can be mitigated with charging system (2 of 3 pumps and SIRWT suction source) and AFW ENTERGY NUCLEAR 29

Significance Determination Entergy Conclusions (cont)

  • Isolation of turbine driven auxiliary feedwater pump P-8B to avoid overfill not a significant risk contributor
  • Motor driven auxiliary feedwater pump P-8A remained available from control room throughout event
  • Restoration of P-8B simple, well-trained task, especially given EOP Supplement 19 steps already performed ENTERGY NUCLEAR 30

Entergy Perspectives on Key Inputs and Assumptions

  • Probability of recovery of DC power
  • Probability of stuck open PZR SRV
  • Availability of AFW Pump P-8A
  • Normal maintenance unavailabilities ENTERGY NUCLEAR 31

Probability of DC Power Recovery

  • Time available to recover DC power is at least 2 hours2.314815e-5 days <br />5.555556e-4 hours <br />3.306878e-6 weeks <br />7.61e-7 months <br /> (no AFW)
  • Actions to restore power are simple and straightforward once the fault condition is cleared
  • Two options are available to restore DC power:
  • Restoration of the connection of the DC bus segments to the battery (HEP = 0.1)
  • Alignment of the alternate charger to the DC bus segments (HEP = 0.1)
  • Total Effective HEP 0.01 (0.1
  • 0.1)

ENTERGY NUCLEAR 32

PZR SRV Challenge Probability

  • Complexity of action and time available greatly impact probability (and overall results)
  • For Entergy model
  • Action is simple trip of operating charging pumps
  • Time available based on maximum charging flow for loss of DC event
  • Time available allows for recovery of failed attempts
  • For NRC evaluation
  • Action is control pressurizer level - may be viewed as more complex
  • Time available about equal to time required - may be based on 133 gpm charging flow ENTERGY NUCLEAR 33

PZR SRV Challenge Probability HEP Timeline

  • Time available to diagnose/execute action - 62 mins

- Operators determine in-service channel A to PZR level control is de-energized and change to channel B - 31 minutes (1537)

- Time to operators confirm boration requirements met - 51 minutes (1557)

- Operators terminated charging flow - 51 minutes (1557)

  • 11 minutes remained available to complete the action to prevent a challenge to PZR safeties ENTERGY NUCLEAR 34

Stuck Open PZR SRV Probability

  • Palisades valves tested for steam, transition & water relief (part of TMI Action Plan)
  • Test conditions based on consideration of PWR FSAR transients and extended high pressure liquid injection events
  • All tests found satisfactory operation
  • For Entergy model
  • Palisades-specific SRV qualification testing supports use of generic failure rates
  • For NRC evaluation
  • Generic bounding SRV failure probability used ENTERGY NUCLEAR 35

AFW P-8A Availability

  • P-8A remained available on manual start from the control room (or locally) throughout event
  • Loss of DC power resulted in loss of power to pump control scheme
  • However, without DC panel ED-11-1, a low suction pressure trip signal cannot trip the pump
  • ED-11A remained available; this provided DC power to the switchgear supplying AC to P-8A
  • Assuming P-8A unavailable without restoration increases importance of restoration of P-8B ENTERGY NUCLEAR 36

Conclusion

  • Based on investigation and evaluation of the event, Entergy determined that the CCDP is 4.3E-6
a. Failure to recover DC power is ~ 74% of CCDP
b. Failure to control pressurizer level is ~ 16%

of CCDP ENTERGY NUCLEAR 37

Tony Vitale Site Vice President Entergy - Palisades ENTERGY NUCLEAR 38

Summary

  • Entergy concurs with the violation
  • A thorough review of the event was performed to identify all related causes
  • Entergy has developed effective corrective actions for root and contributing causes
  • Fleet engagement
  • Welcome the opportunity for future updates with Staff ENTERGY NUCLEAR 39