ML062480134: Difference between revisions

From kanterella
Jump to navigation Jump to search
(Created page by program invented by StriderTol)
 
(StriderTol Bot change)
 
(3 intermediate revisions by the same user not shown)
Line 3: Line 3:
| issue date = 09/05/2006
| issue date = 09/05/2006
| title = Draft Regulatory Guide DG-1161, an Approach for Determining the Technical Adequacy of Probabilistic Risk Assessment Results for Risk-informed Activities (Proposed Revision 1 of Regulatory Guide 1.200, Dated February 2004)
| title = Draft Regulatory Guide DG-1161, an Approach for Determining the Technical Adequacy of Probabilistic Risk Assessment Results for Risk-informed Activities (Proposed Revision 1 of Regulatory Guide 1.200, Dated February 2004)
| author name = Drouin M T
| author name = Drouin M
| author affiliation = NRC/RES/DRASP/DDPRA/RASP
| author affiliation = NRC/RES/DRASP/DDPRA/RASP
| addressee name =  
| addressee name =  
Line 9: Line 9:
| docket =  
| docket =  
| license number =  
| license number =  
| contact person = Drouin M T (301)415-6675
| contact person = Drouin M (301)415-6675
| case reference number = DG-1161
| case reference number = DG-1161
| document report number = RG-1.200, Rev 1
| document report number = RG-1.200, Rev 1
Line 17: Line 17:


=Text=
=Text=
{{#Wiki_filter:This regulatory guide is being issued in draft form to involve the public in the early stages of the development of a regulatory positionin this area. It has not received staff review or approval and does not represent an official NRC staff position.Public comments are being solicited on this draft guide (including any implementation schedule) and its associated regulatoryanalysis or value/impact statement. Comments should be accompanied by appropriate supporting data. Written comments maybe submitted to the Rules and Directives Branch, Office of Administration, U.S. Nuclear Regulatory Commission, Washington, DC20555-0001. Comments may be submitted electronically through the NRC's interactive rulemaking Web page athttp://www.nrc.gov/what-we-do/regulatory/rulemaking.html. Copies of comments received may be examined at the NRC'sPublic Document Room, 11555 Rockville Pike, Rockville, MD. Comments will be most helpful if received by October 14, 2006
{{#Wiki_filter:U.S. NUCLEAR REGULATORY COMMISSION                                          September 2006 OFFICE OF NUCLEAR REGULATORY RESEARCH                                                    Division 1 DRAFT REGULATORY GUIDE
.Requests for single copies of draft or active regulatory guides (which may be reproduced) or placement on an automatic distribution listfor single copies of future draft guides in specific divisions should be made to the U.S. Nuclear Regulatory Commission,Washington, DC 20555, Attention: Reproduction and Distribution Services Section, or by fax to (301)415-2289; or by emailto Distribution@nrc.gov. Electronic copies of this draft regulatory guide are available through the NRC's interactive rulemakingWeb page (see above); the NRC's public Web site under Draft Regulatory Guides in the Regulatory Guides document collectionof the NRC's Electronic Reading Room at http://www.nrc.gov/reading-rm/doc-collections/; and the NRC's Agencywide DocumentsAccess and Management System (ADAMS) at http://www.nrc.gov/reading-rm/adams.html, under Accession No. ML062480134. U.S. NUCLEAR REGULATORY COMMISSION September 2006OFFICE OF NUCLEAR REGULATORY RESEARCH Division 1    DRAFT REGULATORY GUIDEContact: M.T. Drouin(301) 415-6675DRAFT REGULATORY GUIDE DG-1161(Proposed Revision 1 of Regulatory Guide 1.200, dated February 2004)AN APPROACH FOR DETERMININGTHE TECHNICAL ADEQUACYOF PROBABILISTIC RISK ASSESSMENT RESULTSFOR RISK-INFORMED ACTIVITIESA. INTRODUCTIONIn 1995, the U.S. Nuclear Regulatory Commission (NRC) issued a Policy Statement (Ref. 1)on the use of probabilistic risk analysis (PRA), encouraging its use in all regulatory matters. That Policy Statement states that "-the use of PRA technology should be increased to the extent supported by thestate-of-the-art in PRA methods and data and in a manner that complements the NRC's deterministic approach."  Since that time, many uses have been implemented or undertaken, including modification of the NRC's reactor safety inspection program and initiation of work to modify reactor safety regulations.
 
Consequently, confidence in the information derived from a PRA is an important issue, in that the accuracy of the technical content must be sufficient to justify the specific results and insights that are used to support the decision under consideration.This regulatory guide describes one acceptable approach for determining whether the qualityof the PRA, in total or the parts that are used to support an application, is sufficient to provide confidence in the results, such that the PRA can be used in regulatory decision-making for light-water reactors.
==Contact:==
This guidance is intended to be consistent with the NRC's PRA Policy Statement and subsequent, more detailed, guidance in Regulatory Guide 1.174 (Ref. 2). It is also intended to reflect and endorseguidance provided by standards-setting and nuclear industry organizations.
M.T. Drouin (301) 415-6675 DRAFT REGULATORY GUIDE DG-1161 (Proposed Revision 1 of Regulatory Guide 1.200, dated February 2004)
DG-1161, Page 2When used in support of an application, this regulatory guide will obviate the need foran in-depth review of the base PRA by NRC reviewers, allowing them to focus their review on key assumptions and areas identified by peer reviewers as being of concern and relevant to the application.
AN APPROACH FOR DETERMINING THE TECHNICAL ADEQUACY OF PROBABILISTIC RISK ASSESSMENT RESULTS FOR RISK-INFORMED ACTIVITIES A. INTRODUCTION In 1995, the U.S. Nuclear Regulatory Commission (NRC) issued a Policy Statement (Ref. 1) on the use of probabilistic risk analysis (PRA), encouraging its use in all regulatory matters. That Policy Statement states that the use of PRA technology should be increased to the extent supported by the state-of-the-art in PRA methods and data and in a manner that complements the NRCs deterministic approach. Since that time, many uses have been implemented or undertaken, including modification of the NRCs reactor safety inspection program and initiation of work to modify reactor safety regulations.
Consequently, this guide will provide for a more focused and consistent review process. In this regulatory guide, as in RG 1.174, the quality of a PRA analysis used to support an application is measured in terms of its appropriateness with respect to scope, level of detail, and technical acceptability.This regulatory guide was issued for trial use in February of 2004, and five trial applicationswere conducted. This revision incorporates lessons learned from those pilot applications (Ref. 3).
Consequently, confidence in the information derived from a PRA is an important issue, in that the accuracy of the technical content must be sufficient to justify the specific results and insights that are used to support the decision under consideration.
In addition, the appendices to this regulatory guide have been revised to address the changes made in the professional society PRA standards and industry PRA guidance documents.The NRC issues regulatory guides to describe to the public methods that the staff considersacceptable for use in implementing specific parts of the agency's regulations, to explain techniques that the staff uses in evaluating specific problems or postulated accidents, and to provide guidance to applicants. Regulatory guides are not substitutes for regulations, and compliance with regulatory guides is not required. The NRC issues regulatory guides in draft form to solicit public comment and involve the public in developing the agency's regulatory positions. Draft regulatory guides have not received complete staff review and, therefore, they do not represent official NRC staff positions.This regulatory guide contains information collections that are covered by the requirementsof 10 CFR Part 50 which the Office of Management and Budget (OMB) approved under OMB control number 3150-0011. The NRC may neither conduct nor sponsor, and a person is not required to respond to,an information collection request or requirement unless the requesting document displays a currently valid OMB control number.
This regulatory guide describes one acceptable approach for determining whether the quality of the PRA, in total or the parts that are used to support an application, is sufficient to provide confidence in the results, such that the PRA can be used in regulatory decision-making for light-water reactors.
1In this regulatory guide, a part of a PRA can be understood to be equivalent to that piece of the analysis for whichan applicable PRA standard identifies a supporting level requirement.DG-1161, Page 3B. DISCUSSIONExisting Guidance Related to the Use of PRA in Reactor Regulatory ActivitiesSince the NRC issued its PRA Policy Statement, a number of risk-informed regulatory activitieshave been implemented and the necessary technical documents are being developed to provide guidance on the use of PRA information.One specific regulatory guide and its associated standard review plan (SRP) is RG 1.174and SRP Section 19 (Ref. 4), which provide general guidance on applications that address changes to the licensing basis. Key aspects of this document include the following:*It describes a "risk-informed integrated decision-making process" that characterizes how riskinformation is used and, more specifically, it clarifies that such information is one element of the decision-making process. That is, decisions "are expected to be reached in an integrated fashion, considering traditional engineering and risk information, and may be based on qualitative factors as well as quantitative analyses and information."*It reflects the staff's recognition that the PRA needed to support regulatory decisions can vary(i.e., that the "scope, level of detail, and quality of the PRA is to be commensurate with the application for which it is intended and the role the PRA results play in the integrated decision process"). For some applications and decisions, only particular parts 1 of the PRAneed to be used. In other applications, a full-scope PRA is needed. General guidance regarding scope, level of detail, and quality for a PRA is provided in the application-specific documents.*While this document is written in the context of one reactor regulatory activity (licenseamendments), the underlying philosophy and principles are applicable to a broad spectrum of reactor regulatory activities.In addition, separate regulatory guides provide guidance for such specific applicationsas inservice testing (Ref. 5), inservice inspection (Ref. 6), quality assurance (Ref. 7), and technical specifications (Ref. 8). The NRC has also prepared SRP sections for each of the application-specific regulatory guides, with the exception of quality assurance.PRA standards have also been under development by the American Society of MechanicalEngineers (ASME) and the American Nuclear Society (ANS):*On April 5, 2002, ASME issued a standard for a full-power, internal events (excluding fire)Level 1 PRA and a limited Level 2 PRA, and subsequently issued Addenda A and B to that standard on December 5, 2003, and December 30, 2005, respectively (Ref. 9). ASME issued Addendum B in response to the NRC staff's position on Addendum A, lessons learned from the pilots, and other public comments provided to ASME.*In December 2003, ANS issued a standard for external events (Ref. 10).
This guidance is intended to be consistent with the NRCs PRA Policy Statement and subsequent, more detailed, guidance in Regulatory Guide 1.174 (Ref. 2). It is also intended to reflect and endorse guidance provided by standards-setting and nuclear industry organizations.
*ASME and ANS are developing Level 1 PRA standards for internal fire, external events,and low-power shutdown operating mode, as well as Level 2 and Level 3 PRA standards.
This regulatory guide is being issued in draft form to involve the public in the early stages of the development of a regulatory position in this area. It has not received staff review or approval and does not represent an official NRC staff position.
DG-1161, Page 4Reactor owners' groups have been developing and applying a PRA peer review programfor several years. The Nuclear Energy Institute (NEI) issued NEI-00-02 (Ref. 11), which documents one such process:*On August 16, 2002, NEI submitted draft industry guidance for self-assessments (Ref. 11)to address the use of industry peer review results in demonstrating conformance with the ASME PRA Standard. This additional guidance, which is intended to be incorporated into a revision of NEI-00-02 (per NEI, Ref. 11), contains the following:Self-assessment guidance documentAppendix 1 - actions for industry self-assessmentAppendix 2 - industry peer review subtier criteria*On May 19, 2006, NEI issued a revision to the self-assessment guidance incorporated in NEI-00-02,to satisfy the peer review requirement(s) of the ASME PRA Standard (ASME-RA-Sa-2003) as endorsed/modified by the NRC and updated by Addendum B of the ASME PRA Standard (Ref. 11).*In August 2006, NEI issued NEI-05-04, "Process for Performing Follow-On PRA Peer ReviewsUsing the ASME PRA Standard.This document provides guidance for conducting and documenting a follow-on peer review for PRAs using the ASME PRA Standard (Ref. 12).SECY-00-0162 (Ref. 13) describes an approach for addressing PRA quality in risk-informedactivities, including identification of the scope and minimal functional attributes of a technically acceptable PRA.Regulatory Guide 1.201, "Guidelines for Categorizing Structures, Systems, and Componentsin Nuclear Power Plants According to their Safety Significance" (Ref. 14), discusses an approach, along with References 8 and 11, to support the new rule established as Title 10, Section 50.69,of the Code of Federal Regulations (10 CFR 50.69), "Risk-informed categorization and treatmentof structures, systems, and components for nuclear power reactors" (Ref. 15).SECY-04-0118, "Plan for the Implementation of the Commission's Phased Approachto PRA Quality" (Ref. 16), presents the staff's approach to defining the needed PRA quality for current or anticipated applications, as well as the process for achieving this quality, while allowing risk-informed decisions to be made using currently available methods until all of the necessary guidance documents are developed and implemented.Purposes of this Regulatory GuideThe purposes of this regulatory guide are to provide guidance to licensees for use in determiningthe technical adequacy of a PRA used in a risk-informed regulatory activity, and to endorse standards and industry guidance. Toward that end, this regulatory guide provides guidance in four areas:(1)a minimal set of functional requirements of a technically acceptable PRA (2)the NRC's position on PRA consensus standards and industry PRA program documents (3)demonstration that the PRA (in total or specific parts) used in regulatory applicationsis of sufficient technical adequacy(4)documentation to support a regulatory submittal DG-1161, Page 5This regulatory guide provides more detailed guidance, relative to RG 1.174, on PRA technicaladequacy in a risk-informed integrated decision-making process. It does not provide guidance on how PRA results are used in application-specific decision-making processes; that guidance is provided in such documents as References 5 - 8.The regulatory guides that address specific applications, such as RG 1.201, allow for the useof PRAs that are not full-scope (e.g., do not include contributions from external initiating events or low-power and shutdown modes of operation). Those regulatory guides do, however, state that the missing scope items are to be addressed in some way, such as by using bounding analyses.
Public comments are being solicited on this draft guide (including any implementation schedule) and its associated regulatory analysis or value/impact statement. Comments should be accompanied by appropriate supporting data. Written comments may be submitted to the Rules and Directives Branch, Office of Administration, U.S. Nuclear Regulatory Commission, Washington, DC 20555-0001. Comments may be submitted electronically through the NRCs interactive rulemaking Web page at http://www.nrc.gov/what-we-do/regulatory/rulemaking.html. Copies of comments received may be examined at the NRCs Public Document Room, 11555 Rockville Pike, Rockville, MD. Comments will be most helpful if received by October 14, 2006.
This regulatory guide does not address such alternative methods to the evaluation of risk contributions; rather, this guide only addresses PRA methods.Relationship to Other Guidance DocumentsThis regulatory guide is a supporting document to other NRC regulatory guides that addressrisk-informed activities. At a minimum, these guides include (1) RG 1.174 and SRP Section 19, which provide general guidance on applications that address changes to the licensing basis; (2) the regulatory guides for specific applications such as for inservice testing, inservice inspection, quality assurance, and technical specifications (Refs. 4-7); and (3) regulatory guides associated with implementation of certain regulations, particularly those that rely on a plant-specific PRA to implement the rule.
Requests for single copies of draft or active regulatory guides (which may be reproduced) or placement on an automatic distribution list for single copies of future draft guides in specific divisions should be made to the U.S. Nuclear Regulatory Commission, Washington, DC 20555, Attention: Reproduction and Distribution Services Section, or by fax to (301)415-2289; or by email to Distribution@nrc.gov. Electronic copies of this draft regulatory guide are available through the NRCs interactive rulemaking Web page (see above); the NRCs public Web site under Draft Regulatory Guides in the Regulatory Guides document collection of the NRCs Electronic Reading Room at http://www.nrc.gov/reading-rm/doc-collections/; and the NRCs Agencywide Documents Access and Management System (ADAMS) at http://www.nrc.gov/reading-rm/adams.html, under Accession No. ML062480134.
 
When used in support of an application, this regulatory guide will obviate the need for an in-depth review of the base PRA by NRC reviewers, allowing them to focus their review on key assumptions and areas identified by peer reviewers as being of concern and relevant to the application.
Consequently, this guide will provide for a more focused and consistent review process. In this regulatory guide, as in RG 1.174, the quality of a PRA analysis used to support an application is measured in terms of its appropriateness with respect to scope, level of detail, and technical acceptability.
This regulatory guide was issued for trial use in February of 2004, and five trial applications were conducted. This revision incorporates lessons learned from those pilot applications (Ref. 3).
In addition, the appendices to this regulatory guide have been revised to address the changes made in the professional society PRA standards and industry PRA guidance documents.
The NRC issues regulatory guides to describe to the public methods that the staff considers acceptable for use in implementing specific parts of the agencys regulations, to explain techniques that the staff uses in evaluating specific problems or postulated accidents, and to provide guidance to applicants. Regulatory guides are not substitutes for regulations, and compliance with regulatory guides is not required. The NRC issues regulatory guides in draft form to solicit public comment and involve the public in developing the agencys regulatory positions. Draft regulatory guides have not received complete staff review and, therefore, they do not represent official NRC staff positions.
This regulatory guide contains information collections that are covered by the requirements of 10 CFR Part 50 which the Office of Management and Budget (OMB) approved under OMB control number 3150-0011. The NRC may neither conduct nor sponsor, and a person is not required to respond to, an information collection request or requirement unless the requesting document displays a currently valid OMB control number.
DG-1161, Page 2
 
B. DISCUSSION Existing Guidance Related to the Use of PRA in Reactor Regulatory Activities Since the NRC issued its PRA Policy Statement, a number of risk-informed regulatory activities have been implemented and the necessary technical documents are being developed to provide guidance on the use of PRA information.
One specific regulatory guide and its associated standard review plan (SRP) is RG 1.174 and SRP Section 19 (Ref. 4), which provide general guidance on applications that address changes to the licensing basis. Key aspects of this document include the following:
* It describes a risk-informed integrated decision-making process that characterizes how risk information is used and, more specifically, it clarifies that such information is one element of the decision-making process. That is, decisions are expected to be reached in an integrated fashion, considering traditional engineering and risk information, and may be based on qualitative factors as well as quantitative analyses and information.
* It reflects the staffs recognition that the PRA needed to support regulatory decisions can vary (i.e., that the scope, level of detail, and quality of the PRA is to be commensurate with the application for which it is intended and the role the PRA results play in the integrated decision process). For some applications and decisions, only particular parts1 of the PRA need to be used. In other applications, a full-scope PRA is needed. General guidance regarding scope, level of detail, and quality for a PRA is provided in the application-specific documents.
* While this document is written in the context of one reactor regulatory activity (license amendments), the underlying philosophy and principles are applicable to a broad spectrum of reactor regulatory activities.
In addition, separate regulatory guides provide guidance for such specific applications as inservice testing (Ref. 5), inservice inspection (Ref. 6), quality assurance (Ref. 7), and technical specifications (Ref. 8). The NRC has also prepared SRP sections for each of the application-specific regulatory guides, with the exception of quality assurance.
PRA standards have also been under development by the American Society of Mechanical Engineers (ASME) and the American Nuclear Society (ANS):
* On April 5, 2002, ASME issued a standard for a full-power, internal events (excluding fire)
Level 1 PRA and a limited Level 2 PRA, and subsequently issued Addenda A and B to that standard on December 5, 2003, and December 30, 2005, respectively (Ref. 9). ASME issued Addendum B in response to the NRC staffs position on Addendum A, lessons learned from the pilots, and other public comments provided to ASME.
* In December 2003, ANS issued a standard for external events (Ref. 10).
* ASME and ANS are developing Level 1 PRA standards for internal fire, external events, and low-power shutdown operating mode, as well as Level 2 and Level 3 PRA standards.
1 In this regulatory guide, a part of a PRA can be understood to be equivalent to that piece of the analysis for which an applicable PRA standard identifies a supporting level requirement.
DG-1161, Page 3
 
Reactor owners groups have been developing and applying a PRA peer review program for several years. The Nuclear Energy Institute (NEI) issued NEI-00-02 (Ref. 11), which documents one such process:
* On August 16, 2002, NEI submitted draft industry guidance for self-assessments (Ref. 11) to address the use of industry peer review results in demonstrating conformance with the ASME PRA Standard. This additional guidance, which is intended to be incorporated into a revision of NEI-00-02 (per NEI, Ref. 11), contains the following:
        <        Self-assessment guidance document
        <        Appendix 1 actions for industry self-assessment
        <        Appendix 2 industry peer review subtier criteria
* On May 19, 2006, NEI issued a revision to the self-assessment guidance incorporated in NEI-00-02, to satisfy the peer review requirement(s) of the ASME PRA Standard (ASME-RA-Sa-2003) as endorsed/modified by the NRC and updated by Addendum B of the ASME PRA Standard (Ref. 11).
* In August 2006, NEI issued NEI-05-04, Process for Performing Follow-On PRA Peer Reviews Using the ASME PRA Standard. This document provides guidance for conducting and documenting a follow-on peer review for PRAs using the ASME PRA Standard (Ref. 12).
SECY-00-0162 (Ref. 13) describes an approach for addressing PRA quality in risk-informed activities, including identification of the scope and minimal functional attributes of a technically acceptable PRA.
Regulatory Guide 1.201, Guidelines for Categorizing Structures, Systems, and Components in Nuclear Power Plants According to their Safety Significance (Ref. 14), discusses an approach, along with References 8 and 11, to support the new rule established as Title 10, Section 50.69, of the Code of Federal Regulations (10 CFR 50.69), Risk-informed categorization and treatment of structures, systems, and components for nuclear power reactors (Ref. 15).
SECY-04-0118, Plan for the Implementation of the Commissions Phased Approach to PRA Quality (Ref. 16), presents the staffs approach to defining the needed PRA quality for current or anticipated applications, as well as the process for achieving this quality, while allowing risk-informed decisions to be made using currently available methods until all of the necessary guidance documents are developed and implemented.
Purposes of this Regulatory Guide The purposes of this regulatory guide are to provide guidance to licensees for use in determining the technical adequacy of a PRA used in a risk-informed regulatory activity, and to endorse standards and industry guidance. Toward that end, this regulatory guide provides guidance in four areas:
(1)     a minimal set of functional requirements of a technically acceptable PRA (2)     the NRCs position on PRA consensus standards and industry PRA program documents (3)     demonstration that the PRA (in total or specific parts) used in regulatory applications is of sufficient technical adequacy (4)     documentation to support a regulatory submittal DG-1161, Page 4
 
This regulatory guide provides more detailed guidance, relative to RG 1.174, on PRA technical adequacy in a risk-informed integrated decision-making process. It does not provide guidance on how PRA results are used in application-specific decision-making processes; that guidance is provided in such documents as References 5 - 8.
The regulatory guides that address specific applications, such as RG 1.201, allow for the use of PRAs that are not full-scope (e.g., do not include contributions from external initiating events or low-power and shutdown modes of operation). Those regulatory guides do, however, state that the missing scope items are to be addressed in some way, such as by using bounding analyses.
This regulatory guide does not address such alternative methods to the evaluation of risk contributions; rather, this guide only addresses PRA methods.
Relationship to Other Guidance Documents This regulatory guide is a supporting document to other NRC regulatory guides that address risk-informed activities. At a minimum, these guides include (1) RG 1.174 and SRP Section 19, which provide general guidance on applications that address changes to the licensing basis; (2) the regulatory guides for specific applications such as for inservice testing, inservice inspection, quality assurance, and technical specifications (Refs. 4-7); and (3) regulatory guides associated with implementation of certain regulations, particularly those that rely on a plant-specific PRA to implement the rule.
In addition, the NRC has prepared corresponding SRP chapters for the application-specific guides.
In addition, the NRC has prepared corresponding SRP chapters for the application-specific guides.
Figure 1 shows the relationship of this new regulatory guide and risk-informed activities, application-specific guidance, consensus PRA standards, and industry programs (e.g., NEI-00-02).Figure 1. Relationship of Regulatory Guide 1.200 to Other Risk-Informed Guidance 2Some applications may involve the plant at the design certification or combined operating license stage, where the plantis not built or operated. At these stages, the intent is for the PRA model to reflect the as-designed plant.DG-1161, Page 6C. REGULATORY POSITION1.Functional Requirements of a Technically Acceptable PRAThis section describes one acceptable approach for defining the technical adequacy ofan acceptable PRA of a commercial nuclear power plant. PRAs used in risk-informed activities may vary in scope and level of detail, depending on the specific application. However, the PRA results used to support an application must be derived from a PRA model that represents the as-built, as-operated plant 2to the extent needed to support the applicationIn this section, the guidance provided is for a full-scope PRA. The scope is defined in terms of(1) the metrics used to characterize risk, (2) the plant operating states for which the risk is to be evaluated, and (3) the types of initiating events that can potentially challenge and disrupt the normal operation of the plant and, if not prevented or mitigated, would eventually result in core damage and/or a large release.The level of detail required of the PRA model is ultimately determined by the application. Nonetheless, a minimal level of detail is necessary to ensure that the impacts of designed-in dependencies (e.g., support system dependencies, functional dependencies, and dependencies on operator actions) are correctly captured and the PRA represents the as-built, as-operated plant. This minimal level of detail is implicit in the technical characteristics and attributes discussed in this section. Consequently, this section provides guidance in four areas, in accordance with SECY-00-0162:(1)definition of the scope of a PRA(2)technical elements of a full-scope PRA (3)attributes and characteristics for technical elements of a PRA (4)development, maintenance, and upgrade of a PRA1.1Scope of PRAThe scope of a PRA is defined by the challenges included in the analysis and the level of analysisperformed. Specifically, the scope is defined in the following terms:*metrics used in characterizing the risk
Figure 1 shows the relationship of this new regulatory guide and risk-informed activities, application-specific guidance, consensus PRA standards, and industry programs (e.g., NEI-00-02).
*plant operating states for which the risk is to be evaluated
Figure 1. Relationship of Regulatory Guide 1.200 to Other Risk-Informed Guidance DG-1161, Page 5
*types of initiating events that can potentially challenge and disrupt the normal operationof the plant DG-1161, Page 7Risk characterization is typically expressed by metrics of core damage frequency (CDF)and large early release frequency (LERF) (as surrogates for latent and early fatality risks, respectively, for light-water reactors). These are defined in a functional sense as follows:
 
*Core damage frequency is defined as the sum of the frequencies of those accidents that result inuncovery and heatup of the reactor core to the point at which prolonged oxidation and severe fuel damage involving a large fraction of the core (i.e., sufficient, if released from containment, to have the potential for causing offsite health effects) is anticipated.
C. REGULATORY POSITION
*Large early release frequency is defined as the frequency of those accidents leading tosignificant, unmitigated releases from containment in a time frame prior to effective evacuation of the close-in population such that there is the potential for early health effects. Such accidents generally include unscrubbed releases associated with early containment failure shortly after vessel breach, containment bypass events, and loss of containment isolationIssues related to the reliability of barriers (in particular, containment integrity and consequencemitigation) are addressed through other parts of the decision-making process, such as consideration of defense-in-depth. To provide the risk perspective for use in decision-making, a Level 1 PRA is required to provide CDF. A limited Level 2 PRA is needed to address LERF.Plant operating states (POSs) are used to subdivide the plant operating cycle into unique states,such that the plant response can be assumed to be the same for all subsequent accident initiating events.
: 1.       Functional Requirements of a Technically Acceptable PRA This section describes one acceptable approach for defining the technical adequacy of an acceptable PRA of a commercial nuclear power plant. PRAs used in risk-informed activities may vary in scope and level of detail, depending on the specific application. However, the PRA results used to support an application must be derived from a PRA model that represents the as-built, as-operated plant2 to the extent needed to support the application In this section, the guidance provided is for a full-scope PRA. The scope is defined in terms of (1) the metrics used to characterize risk, (2) the plant operating states for which the risk is to be evaluated, and (3) the types of initiating events that can potentially challenge and disrupt the normal operation of the plant and, if not prevented or mitigated, would eventually result in core damage and/or a large release.
The level of detail required of the PRA model is ultimately determined by the application.
Nonetheless, a minimal level of detail is necessary to ensure that the impacts of designed-in dependencies (e.g., support system dependencies, functional dependencies, and dependencies on operator actions) are correctly captured and the PRA represents the as-built, as-operated plant. This minimal level of detail is implicit in the technical characteristics and attributes discussed in this section. Consequently, this section provides guidance in four areas, in accordance with SECY-00-0162:
(1)     definition of the scope of a PRA (2)     technical elements of a full-scope PRA (3)     attributes and characteristics for technical elements of a PRA (4)     development, maintenance, and upgrade of a PRA 1.1      Scope of PRA The scope of a PRA is defined by the challenges included in the analysis and the level of analysis performed. Specifically, the scope is defined in the following terms:
* metrics used in characterizing the risk
* plant operating states for which the risk is to be evaluated
* types of initiating events that can potentially challenge and disrupt the normal operation of the plant 2
Some applications may involve the plant at the design certification or combined operating license stage, where the plant is not built or operated. At these stages, the intent is for the PRA model to reflect the as-designed plant.
DG-1161, Page 6
 
Risk characterization is typically expressed by metrics of core damage frequency (CDF) and large early release frequency (LERF) (as surrogates for latent and early fatality risks, respectively, for light-water reactors). These are defined in a functional sense as follows:
* Core damage frequency is defined as the sum of the frequencies of those accidents that result in uncovery and heatup of the reactor core to the point at which prolonged oxidation and severe fuel damage involving a large fraction of the core (i.e., sufficient, if released from containment, to have the potential for causing offsite health effects) is anticipated.
* Large early release frequency is defined as the frequency of those accidents leading to significant, unmitigated releases from containment in a time frame prior to effective evacuation of the close-in population such that there is the potential for early health effects. Such accidents generally include unscrubbed releases associated with early containment failure shortly after vessel breach, containment bypass events, and loss of containment isolation Issues related to the reliability of barriers (in particular, containment integrity and consequence mitigation) are addressed through other parts of the decision-making process, such as consideration of defense-in-depth. To provide the risk perspective for use in decision-making, a Level 1 PRA is required to provide CDF. A limited Level 2 PRA is needed to address LERF.
Plant operating states (POSs) are used to subdivide the plant operating cycle into unique states, such that the plant response can be assumed to be the same for all subsequent accident initiating events.
Operational characteristics (such as reactor power level; in-vessel temperature, pressure, and coolant level; equipment operability; and changes in decay heat load or plant conditions that allow new success criteria) are examined to identify those relevant to defining POSs. These characteristics are used to define the states, and the fraction of time spent in each state is estimated using plant-specific information.
Operational characteristics (such as reactor power level; in-vessel temperature, pressure, and coolant level; equipment operability; and changes in decay heat load or plant conditions that allow new success criteria) are examined to identify those relevant to defining POSs. These characteristics are used to define the states, and the fraction of time spent in each state is estimated using plant-specific information.
The risk perspective is based on the total risk associated with the operation of the reactor, which includes not only full-power operation, but also low-power and shutdown conditions. For some applications, the risk impact may affect some modes of operation, but not others.Initiating events are the events that have the ability to challenge the condition of the plant. These events include failure of equipment from either internal plant causes (such as hardware faults, operator actions, floods, or fires), or external plant causes (such as earthquakes or high winds). The risk perspective is based on a consideration of the total risk, which includes events attributable to both internal and external sources.1.2Technical Elements of PRATable 1 provides the list of general technical elements that are necessary for a PRA. A PRA thatis missing one or more of these elements would not be considered a complete PRA. The following briefly discusses the objective of each element.
The risk perspective is based on the total risk associated with the operation of the reactor, which includes not only full-power operation, but also low-power and shutdown conditions. For some applications, the risk impact may affect some modes of operation, but not others.
DG-1161, Page 8Table 1. Technical Elements of a PRAScope ofAnalysisTechnical ElementLevel 1*Initiating event analysis*Parameter estimation analysis*Success criteria analysis*Human reliability analysis*Accident sequence analysis*Quantification*Systems analysisLevel 2*Plant damage state analysis*Quantification*Accident progression analysisInterpretation of results and documentation are elements of both Level 1 and Level 2 PRAs.These technical elements are equally applicable to the PRA models constructed to address eachof the contributors to risk (i.e., internal and external initiating events) for each of the POSs. Because additional analyses are required to characterize their impact on the plant in terms of initiating events caused and mitigating equipment failed, internal floods, internal fires, and external hazards are discussed separately in Regulatory Positions 1.2.3, 1.2.4, and 1.2.5, respectively. Further, to understand the results, it is important to examine the different contributors on both an individual and relative basis. Therefore, this element, interpretation of results, is discussed separately in Regulatory Position 1.2.6. Another major element that is common to all of the technical elements is documentation; it is also discussed separately, in Regulatory Position 1.2.7.1.2.1Level 1 Technical ElementsInitiating event analysis identifies and characterizes the events that both challenge normal plantoperation during power or shutdown conditions and require successful mitigation by plant equipment and personnel to prevent core damage from occurring. Events that have occurred at the plant and those that have a reasonable probability of occurring are identified and characterized. An understanding of the nature of the events is performed such that a grouping of the events into event classes, with the classes defined by similarity of system and plant responses (based on the success criteria), may be performed to manage the large number of potential events that can challenge the plant.Success criteria analysis determines the minimum requirements for each function (andultimately the systems used to perform the functions) to prevent core damage (or to mitigate a release) given an initiating event. The requirements defining the success criteria are based on acceptable engineering analyses that represent the design and operation of the plant under consideration. For a function to be successful, the criteria are dependent on the initiator and the conditions created by the initiator. The computer codes used to perform the analyses for developing the success criteria are validated and verified for both technical integrity and suitability to assess plant conditions for the reactor pressure, temperature, and flow range of interest, and they accurately analyze the phenomena of interest.
Initiating events are the events that have the ability to challenge the condition of the plant.
These events include failure of equipment from either internal plant causes (such as hardware faults, operator actions, floods, or fires), or external plant causes (such as earthquakes or high winds). The risk perspective is based on a consideration of the total risk, which includes events attributable to both internal and external sources.
1.2      Technical Elements of PRA Table 1 provides the list of general technical elements that are necessary for a PRA. A PRA that is missing one or more of these elements would not be considered a complete PRA. The following briefly discusses the objective of each element.
DG-1161, Page 7
 
Table 1. Technical Elements of a PRA Scope of                                                Technical Element Analysis Level 1
* Initiating event analysis
* Parameter estimation analysis
* Success criteria analysis
* Human reliability analysis
* Accident sequence analysis
* Quantification
* Systems analysis Level 2
* Plant damage state analysis
* Quantification
* Accident progression analysis Interpretation of results and documentation are elements of both Level 1 and Level 2 PRAs.
These technical elements are equally applicable to the PRA models constructed to address each of the contributors to risk (i.e., internal and external initiating events) for each of the POSs. Because additional analyses are required to characterize their impact on the plant in terms of initiating events caused and mitigating equipment failed, internal floods, internal fires, and external hazards are discussed separately in Regulatory Positions 1.2.3, 1.2.4, and 1.2.5, respectively. Further, to understand the results, it is important to examine the different contributors on both an individual and relative basis. Therefore, this element, interpretation of results, is discussed separately in Regulatory Position 1.2.6. Another major element that is common to all of the technical elements is documentation; it is also discussed separately, in Regulatory Position 1.2.7.
1.2.1    Level 1 Technical Elements Initiating event analysis identifies and characterizes the events that both challenge normal plant operation during power or shutdown conditions and require successful mitigation by plant equipment and personnel to prevent core damage from occurring. Events that have occurred at the plant and those that have a reasonable probability of occurring are identified and characterized. An understanding of the nature of the events is performed such that a grouping of the events into event classes, with the classes defined by similarity of system and plant responses (based on the success criteria), may be performed to manage the large number of potential events that can challenge the plant.
Success criteria analysis determines the minimum requirements for each function (and ultimately the systems used to perform the functions) to prevent core damage (or to mitigate a release) given an initiating event. The requirements defining the success criteria are based on acceptable engineering analyses that represent the design and operation of the plant under consideration. For a function to be successful, the criteria are dependent on the initiator and the conditions created by the initiator. The computer codes used to perform the analyses for developing the success criteria are validated and verified for both technical integrity and suitability to assess plant conditions for the reactor pressure, temperature, and flow range of interest, and they accurately analyze the phenomena of interest.
Calculations are performed by personnel who are qualified to perform the types of analyses of interest and are well trained in the use of the codes.
Calculations are performed by personnel who are qualified to perform the types of analyses of interest and are well trained in the use of the codes.
3Significant accident sequence:  A significant sequence is one of the set of sequences, defined at the functional orsystemic level that, when ranked, compose 95% of the CDF or the LERF, or that individually contribute more than~1% to the CDF or LERF.Significant basic event/contributor:  The basic events (i.e., equipment unavailabilities and human failure events) thathave a Fussell-Vesely importance greater than 0.005 or a risk-achievement worth greater than 2.DG-1161, Page 9Accident sequence development analysis models, chronologically (to the extent practical), thedifferent possible progressions of events (i.e., accident sequences) that can occur from the start of the initiating event to either successful mitigation or core damage. The accident sequences account for the systems that are used (and available) and operator actions performed to mitigate the initiator based on the defined success criteria and plant operating procedures (e.g., plant emergency and abnormal operating procedures) and training. The availability of a system includes consideration of the functional, phenomenological, and operational dependencies and interfaces between the various systems and operator actions during the course of the accident progression.Systems analysis identifies the various combinations of failures that can prevent the system fromperforming its function as defined by the success criteria. The model representing the various failure combinations includes, from an as-built and as-operated perspective, the system hardware and instrumentation (and their associated failure modes) and human failure events that would prevent the system from performing its defined function. The basic events representing equipment and human failures are developed in sufficient detail in the model to account for dependencies among the various systems and to distinguish the specific equipment or human events that have a major impact on the system's ability to perform its function.Parameter estimation analysis quantifies the frequencies of the initiating events, as well as theequipment failure probabilities and equipment unavailabilities of the modeled systems. The estimation process includes a mechanism for addressing uncertainties and has the ability to combine different sources of data in a coherent manner, including the actual operating history and experience of the plant when it is of sufficient quality, as well as applicable generic experience.Human reliability analysis identifies and provides probabilities for the human failure eventsthat can negatively impact normal or emergency plant operations. The human failure events associated with normal plant operation include the events that leave the system (as defined by the success criteria) in an unrevealed, unavailable state. The human failure events associated with emergency plant operation include the events that, if not performed, do not allow the needed system to function. Quantification of the probabilities of these human failure events is based on plant- and accident-specific conditions, where applicable, including any dependencies among actions and conditions.Quantification provides an estimation of the CDF given the design, operation, and maintenanceof the plant. This CDF is based on the summation of the estimated CDF from each accident sequence for each initiator class. If truncation of accident sequences and cutsets is applied, truncation limits are set so that the overall model results are not impacted in such a way that significant accident sequences or contributors 3 are not eliminated. Therefore, the truncation limit can vary for each accident sequence. Consequently, the truncation value is selected so that the accident sequence CDF is stable with respect to further reduction in the truncation value.
DG-1161, Page 8
DG-1161, Page 101.2.2Level 2 Technical ElementsPlant damage state analysis groups similar core damage scenarios together to allow a practicalassessment of the severe accident progression and containment response resulting from the full spectrum of core damage accidents identified in the Level 1 analysis. The plant damage state analysis defines the attributes of the core damage scenarios that represent boundary conditions to the assessment of severe accidents progression and containment response that ultimately affect the resulting radionuclide releases.
 
The attributes address the dependencies between the containment systems modeled in the Level 2 analysis with the core damage accident sequence models to fully account for mutual dependencies. Core damage scenarios with similar attributes are grouped together to allow for efficient evaluation of the Level 2 response.Severe accident progression analysis models the different series of events that challengecontainment integrity for the core damage scenarios represented in the plant damage states. The accident progressions account for interactions among severe accident phenomena and system and human responses to identify credible containment failure modes, including failure to isolate the containment.
Accident sequence development analysis models, chronologically (to the extent practical), the different possible progressions of events (i.e., accident sequences) that can occur from the start of the initiating event to either successful mitigation or core damage. The accident sequences account for the systems that are used (and available) and operator actions performed to mitigate the initiator based on the defined success criteria and plant operating procedures (e.g., plant emergency and abnormal operating procedures) and training. The availability of a system includes consideration of the functional, phenomenological, and operational dependencies and interfaces between the various systems and operator actions during the course of the accident progression.
Systems analysis identifies the various combinations of failures that can prevent the system from performing its function as defined by the success criteria. The model representing the various failure combinations includes, from an as-built and as-operated perspective, the system hardware and instrumentation (and their associated failure modes) and human failure events that would prevent the system from performing its defined function. The basic events representing equipment and human failures are developed in sufficient detail in the model to account for dependencies among the various systems and to distinguish the specific equipment or human events that have a major impact on the systems ability to perform its function.
Parameter estimation analysis quantifies the frequencies of the initiating events, as well as the equipment failure probabilities and equipment unavailabilities of the modeled systems. The estimation process includes a mechanism for addressing uncertainties and has the ability to combine different sources of data in a coherent manner, including the actual operating history and experience of the plant when it is of sufficient quality, as well as applicable generic experience.
Human reliability analysis identifies and provides probabilities for the human failure events that can negatively impact normal or emergency plant operations. The human failure events associated with normal plant operation include the events that leave the system (as defined by the success criteria) in an unrevealed, unavailable state. The human failure events associated with emergency plant operation include the events that, if not performed, do not allow the needed system to function. Quantification of the probabilities of these human failure events is based on plant- and accident-specific conditions, where applicable, including any dependencies among actions and conditions.
Quantification provides an estimation of the CDF given the design, operation, and maintenance of the plant. This CDF is based on the summation of the estimated CDF from each accident sequence for each initiator class. If truncation of accident sequences and cutsets is applied, truncation limits are set so that the overall model results are not impacted in such a way that significant accident sequences or contributors3 are not eliminated. Therefore, the truncation limit can vary for each accident sequence.
Consequently, the truncation value is selected so that the accident sequence CDF is stable with respect to further reduction in the truncation value.
3 Significant accident sequence: A significant sequence is one of the set of sequences, defined at the functional or systemic level that, when ranked, compose 95% of the CDF or the LERF, or that individually contribute more than
        ~1% to the CDF or LERF.
Significant basic event/contributor: The basic events (i.e., equipment unavailabilities and human failure events) that have a Fussell-Vesely importance greater than 0.005 or a risk-achievement worth greater than 2.
DG-1161, Page 9
 
1.2.2    Level 2 Technical Elements Plant damage state analysis groups similar core damage scenarios together to allow a practical assessment of the severe accident progression and containment response resulting from the full spectrum of core damage accidents identified in the Level 1 analysis. The plant damage state analysis defines the attributes of the core damage scenarios that represent boundary conditions to the assessment of severe accidents progression and containment response that ultimately affect the resulting radionuclide releases.
The attributes address the dependencies between the containment systems modeled in the Level 2 analysis with the core damage accident sequence models to fully account for mutual dependencies. Core damage scenarios with similar attributes are grouped together to allow for efficient evaluation of the Level 2 response.
Severe accident progression analysis models the different series of events that challenge containment integrity for the core damage scenarios represented in the plant damage states. The accident progressions account for interactions among severe accident phenomena and system and human responses to identify credible containment failure modes, including failure to isolate the containment.
The timing of major accident events and the subsequent loadings produced on the containment are evaluated against the capacity of the containment to withstand the potential challenges. The containment performance during the severe accident is characterized by the timing (e.g., early versus late), size (e.g.,
The timing of major accident events and the subsequent loadings produced on the containment are evaluated against the capacity of the containment to withstand the potential challenges. The containment performance during the severe accident is characterized by the timing (e.g., early versus late), size (e.g.,
catastrophic versus bypass), and location of any containment failures. The codes used to perform the analysis are validated and verified for both technical integrity and suitability. Calculations are performed by personnel qualified to perform the types of analyses of interest and well-trained in the use of the codes.Source term analysis characterizes the radiological release to the environment resulting fromeach severe accident sequence leading to containment failure or bypass. The characterization includes the time, elevation, and energy of the release and the amount, form, and size of the radioactive material that is released to the environment. The source term analysis is sufficient to determine whether a large early release or a large late release occurs. A large early release is one involving the rapid, unmitigated release of airborne fission products from the containment to the environment occurring before the effective implementation of offsite emergency response and protective actions such that there is a potential for early health effects. Such accidents generally include unscrubbed releases associated with early containment failure at or shortly after vessel breach, containment bypass events, and loss of containment isolation. With large late release, unmitigated release from containment occurs in a time frame that allows effective evacuation of the close-in population such that early fatalities are unlikely.Quantification integrates the accident progression models and source term evaluation to provideestimates of the frequency of radionuclide releases that could be expected following the identified core damage accidents. This quantitative evaluation reflects the different magnitudes and timing of radionuclide releases and specifically allows for identification of the LERF and the probability of a large late release.
catastrophic versus bypass), and location of any containment failures. The codes used to perform the analysis are validated and verified for both technical integrity and suitability. Calculations are performed by personnel qualified to perform the types of analyses of interest and well-trained in the use of the codes.
DG-1161, Page 111.2.3Internal Floods Technical ElementsPRA models of internal floods are based on the internal events PRA model, modified to includethe impact of the identified flood scenarios in terms of causing initiating events, and failing equipmentused to respond to initiating events. These flood scenarios are developed during the flood identificationanalysis and the flood evaluation analysis. The quantification task specific to internal floods is similarin nature to that for the internal events. Because of its dependence on the internal events model, the flooding analysis incorporates the elements of Sections 1.2.1 and 1.2.2 as necessary.Flood identification analysis identifies the plant areas where flooding could result in significantaccident sequences. Flooding areas are defined on the basis of physical barriers, mitigation features, and propagation pathways. For each flooding area, flood sources that are attributable to equipment (e.g.,
Source term analysis characterizes the radiological release to the environment resulting from each severe accident sequence leading to containment failure or bypass. The characterization includes the time, elevation, and energy of the release and the amount, form, and size of the radioactive material that is released to the environment. The source term analysis is sufficient to determine whether a large early release or a large late release occurs. A large early release is one involving the rapid, unmitigated release of airborne fission products from the containment to the environment occurring before the effective implementation of offsite emergency response and protective actions such that there is a potential for early health effects. Such accidents generally include unscrubbed releases associated with early containment failure at or shortly after vessel breach, containment bypass events, and loss of containment isolation. With large late release, unmitigated release from containment occurs in a time frame that allows effective evacuation of the close-in population such that early fatalities are unlikely.
piping, valves, pumps) and other sources internal to the plant (e.g., tanks) are identified along with the affected structures, systems, and components (SSCs). Flooding mechanisms examined include failure modes of components, human-induced mechanisms, and other water-releasing events. Flooding types (e.g., leak, rupture, spray) and flood sizes are determined. Plant walkdowns are performed to verify the accuracy of the information.Flood evaluation analysis identifies the potential flooding scenarios for each flood source byidentifying flood propagation paths of water from the flood source to its accumulation point (e.g., pipe and cable penetrations, doors, stairwells, failure of doors or walls). Plant design features or operator actions that have the ability to terminate the flood are identified. The susceptibility of each SSC in a flood area to flood-induced mechanisms is examined (e.g., submerge, spray, pipe whip, and jet impingement). Flood scenarios are developed by examining the potential for propagation and giving credit for flood mitigation. Flood scenarios can be eliminated on the basis of screening criteria. The screening criteria used are well-defined and justified.Quantification provides an estimation of the CDF of the plant that includes internal floods. Thefrequency of flooding-induced initiating events that represent the design, operation, and experience of the plant are quantified. The Level 1 models are modified and the internal flood accident sequences quantified to (1) modify accident sequence models to address flooding phenomena, (2) perform necessary calculations to determine success criteria for flooding mitigation, (3) perform parameter estimation analysis to include flooding as a failure mode, (4) perform human reliability analysis to account for performance shaping factors that are attributable to flooding, and (5) quantify internal flood accident sequence CDF. Modifications of the Level 1 models are performed consistent with the appropriate boundary for Level 1 elements for transients and loss of coolant accidents (LOCAs).1.2.4Internal Fire Technical ElementsPRA models of internal fires are based on the internal events PRA model, modified to includethe impact of the identified fire scenarios in terms of causing initiating events (plant transients and LOCAs), and failing equipment used to respond to initiating events. These fire scenarios are developedduring the screening analysis, fire initiation analysis, and the fire damage analysis. The plantresponse and quantification that is specific to internal fires is similar in nature to that for the internalevents. Because of its dependence on the internal events model, the internal fire analysis incorporates the elements of Sections 1.2.1 and 1.2.2 as necessary DG-1161, Page 12Screening analysis identifies fire areas where fires could result in significant accidentsequences. Fire areas that cannot result in significant accident sequences can be "screened out" from further consideration in the PRA analysis. Both qualitative and quantitative screening criteria can be used. The former address whether an unsuppressed fire in the area poses a nuclear safety challenge; the latter are compared against a bounding assessment of the fire-induced core damage frequency for the area. Plant walkdowns are performed where possible to verify the accuracy of the information used in the screening analysis. Key screening analysis assumptions and results [e.g., the area-specific conditional core damage probabilities (assuming fire-induced loss of all equipment in the area)] are documented.Fire initiation analysis determines the frequency and physical characteristics of the detailed(within-area) fire scenarios analyzed for the unscreened fire areas. The analysis identifies a range of scenarios that will be used to represent all possible scenarios in the area. The possibility of seismically induced fires is considered. The scenario frequencies reflect plant-specific experience, to the extent available and supplemented with industry fire information, and quantified in a manner that is consistent with its use in the subsequent fire damage analysis (discussed below). Each scenario is physically characterized in terms that will support the fire damage analysis (especially with respect to firemodeling).Fire damage analysis determines the conditional probability that sets of potentially significantcontributors (i.e., components including cables) will be damaged in a particular mode, given a specified fire scenario. The analysis addresses components whose failure will cause an initiating event, affect the plant's ability to mitigate an initiating event, or affect potentially significant contributors (i.e.,
Quantification integrates the accident progression models and source term evaluation to provide estimates of the frequency of radionuclide releases that could be expected following the identified core damage accidents. This quantitative evaluation reflects the different magnitudes and timing of radionuclide releases and specifically allows for identification of the LERF and the probability of a large late release.
equipment), such as through suppression system actuation. Damage from heat, smoke, and exposure to suppressants is considered. If fire models are used to predict fire-induced damage, compartment-specific features (e.g., ventilation, geometry) and target-specific features (e.g., cable location relative to the fire) are addressed. The fire suppression analysis accounts for the scenario-specific time to detect, respond to,and suppress the fire. The models and data used to analyze fire growth, fire suppression, and fire-induced component damage are consistent with experience from actual nuclear power plant fires, as well as experiments.Plant response analysis and quantification involves the modification of appropriate planttransient and LOCA PRA models to determine the conditional core damage probability, given damage to the sets of components defined in the fire damage analysis. All potentially fire-induced initiating events that can result in significant accident sequences, including such "special" events as loss of plant support systems and interactions between multiple nuclear units during a fire event, are addressed. The analysis addresses the availability of non-fire-affected equipment (including control) and any required manual actions. The human reliability analysis of operator actions addresses fire effects on operators (e.g., heat, smoke, loss of lighting, effect on instrumentation) and fire-specific operational issues (e.g., fire response operating procedures, training on these procedures, potential complications in coordinating activities).1.2.5External Hazards Technical ElementsPRA models of external hazards, when required, are based on the internal events PRA model,which are modified to include the impact of the identified external event scenarios in terms of causing initiating events(plant transients and LOCAs), and failing equipment used to respond to initiating events. However, it is prudent to perform a screening and bounding analysis to screen out those external eventsthat have an insignificant impact on risk. When external events are modeled in detail, the external eventscenarios are developed during the hazard analysis and the fragility analysis as discussed below. Thequantification task specific to external events is similar in nature to that for the internal events. Because of its dependence on the internal events model, the external events analysis incorporates the elements of Sections 1.2.1 and 1.2.2 as necessary.
DG-1161, Page 10
DG-1161, Page 13Screening and bounding analysis identifies external events other than earthquakes (such asriver-induced flooding) that may challenge plant operations and require successful mitigation by plant equipment and personnel to prevent core damage from occurring. The term "screening out" is used here for the process whereby an external event is excluded from further consideration in the PRA analysis.
 
There are two fundamental screening criteria embedded here. An event can be screened out if either (1) it meets the design criteria, or (2) it can be shown using an analysis that the mean value of the design-basis hazard used in the plant design is less than 10
1.2.3    Internal Floods Technical Elements PRA models of internal floods are based on the internal events PRA model, modified to include the impact of the identified flood scenarios in terms of causing initiating events, and failing equipment used to respond to initiating events. These flood scenarios are developed during the flood identification analysis and the flood evaluation analysis. The quantification task specific to internal floods is similar in nature to that for the internal events. Because of its dependence on the internal events model, the flooding analysis incorporates the elements of Sections 1.2.1 and 1.2.2 as necessary.
-5/year and that the conditional core-damageprobability is less than 10
Flood identification analysis identifies the plant areas where flooding could result in significant accident sequences. Flooding areas are defined on the basis of physical barriers, mitigation features, and propagation pathways. For each flooding area, flood sources that are attributable to equipment (e.g.,
-1, given the occurrence of the design-basis hazard. An external event thatcannot be screened out using either of these criteria is subjected to the detailed analysis.Hazard analysis characterizes non-screened external events and seismic events, generally, asfrequencies of occurrence of different sizes of events (e.g., earthquakes with various peak ground accelerations, hurricanes with various maximum wind speeds) at the site. The external events are site-specific and the hazard characterization addresses both aleatory and epistemic uncertainties.Fragility analysis characterizes conditional probability of failure of SSCs whose failure maylead to unacceptable damage to the plant (e.g., core damage) given occurrence of an external event. For significant contributors (i.e., SSCs), the fragility analysis is realistic and plant-specific. The fragility analysis is based on extensive plant walkdowns reflecting as-built, as-operated conditions.Plant response analysis and quantification involves the modification of appropriate planttransient and LOCA PRA models to determine the conditional core damage probability, given damage to the sets of components identified. The external events PRA model includes initiating events resulting from the external events, external-event-induced SSC failures, non-external-event-induced failures (random failures), and human errors. The system analysis is well-coordinated with the fragility analysis and is based on plant walkdowns. The results of the external event hazard analysis, fragility analysis, and system models are assembled to estimate frequencies of core damage and large early release.1.2.6Interpretation of ResultsThe results of the Level 1 PRA are examined to identify the contributors sorted by initiatingevents, accident sequences, equipment failures, and human errors. Methods such as importance measure calculations (e.g., Fussell-Vesely Importance, risk achievement worth, risk reduction worth, and Birnbaum Importance) are used to identify the contributions of various events to the estimation of CDF for both individual sequences and the total CDF [that is, both contributors to the total CDF, including the contribution from the different initiators (i.e., internal and external events) and different operating modes (i.e., full- and low-power and shutdown) and contributors to each contributing sequence are identified].The results of the Level 2 PRA are examined to identify the contributions of various events to themodel estimation of LERF and large late release probability for both individual sequences and the model as a total, using such tools as importance measure calculations (e.g., Fussell-Vesely Importance, risk achievement worth, risk reduction worth, and Birnbaum Importance).
piping, valves, pumps) and other sources internal to the plant (e.g., tanks) are identified along with the affected structures, systems, and components (SSCs). Flooding mechanisms examined include failure modes of components, human-induced mechanisms, and other water-releasing events. Flooding types (e.g., leak, rupture, spray) and flood sizes are determined. Plant walkdowns are performed to verify the accuracy of the information.
4A key source of uncertainty is one that is related to an issue in which there is no consensus approach or model andwhere the choice of approach or model is known to have an impact on the risk profile (e.g., total CDF and total LERF,the set of initiating events and accident sequences that contribute most to CDF and to LERF) or a decision being made using the PRA. Such an impact might occur, for example, by introducing new functional accident sequence or a change to the overall CDF or LERF estimates significant enough to affect insights gained from the PRA.
Flood evaluation analysis identifies the potential flooding scenarios for each flood source by identifying flood propagation paths of water from the flood source to its accumulation point (e.g., pipe and cable penetrations, doors, stairwells, failure of doors or walls). Plant design features or operator actions that have the ability to terminate the flood are identified. The susceptibility of each SSC in a flood area to flood-induced mechanisms is examined (e.g., submerge, spray, pipe whip, and jet impingement). Flood scenarios are developed by examining the potential for propagation and giving credit for flood mitigation. Flood scenarios can be eliminated on the basis of screening criteria. The screening criteria used are well-defined and justified.
5A key assumption is one that is made in response to a key source of uncertainty in the knowledge that a differentreasonable alternative assumption would produce different results, or an assumption that results in an approximation made for modeling convenience in the knowledge that a more detailed model would produce different results. For the base PRA, the term "different results" refers to a change in the risk profile and the associated changes in insightsderived from the changes in the risk profile. A "reasonable alternative" assumption is one that has broad acceptance within the technical community and for which the technical basis for consideration is at least as sound as that of theassumption being challenged.DG-1161, Page 14An important aspect in understanding the PRA results is understanding the associateduncertainties. Key sources of uncertainty 4 are identified and their impact on the results analyzed. Thepotential conservatism associated with the successive screening approach used for the analysis of specific scope items such as fire, flooding, or seismic initiating events is assessed. The sensitivity of the model results to model boundary conditions and other key assumptions 5 is evaluated using sensitivity analysesto look at key assumptions both individually or in logical combinations. The combinations analyzed arechosen to account for interactions among the variables.1.2.7DocumentationTraceability and defensibility provide the necessary information such that the results can easilybe reproduced and justified. The sources of information used in the PRA are both referenced and retrievable. The methodology used to perform each aspect of the work is described either through documenting the actual process or through reference to existing methodology documents. Key sources of uncertainty are identified and their impact on the results assessed. Key assumptions made in performing the analyses are identified and documented along with their justification to the extent that the context of the assumption is understood. The results (e.g., products and outcomes) from the various analyses are documented. A key source of uncertainty is one that is related to an issue where there is no consensus approach or model (e.g., choice of data source, success criteria, reactor coolant pressure (RCP) seal LOCA model, human reliability model) and where the choice of approach or model is known to have an impact on the PRA results in terms of introducing new accident sequences, changing the relative importance of sequences, or affecting the overall CDF or LERF estimates that might have an impact on the use of the PRA in decision-making. A key assumption is one that is made in response to a key source of uncertainty.1.3Attributes and Characteristics of the PRA Technical ElementsTables 2 and 3 describe, for each technical element of a PRA, the technical characteristics andattributes that provide one acceptable approach for determining the technical adequacy of the PRA such that the goals and purposes, defined in Regulatory Position 1.2, are accomplished.For each given technical element, the level of detail may vary. The detail may vary from thedegree to which (1) plant design and operation is modeled, (2) specific plant experience is incorporated into the model, and (3) realism is incorporated into the analyses that reflect the expected plant response.
Quantification provides an estimation of the CDF of the plant that includes internal floods. The frequency of flooding-induced initiating events that represent the design, operation, and experience of the plant are quantified. The Level 1 models are modified and the internal flood accident sequences quantified to (1) modify accident sequence models to address flooding phenomena, (2) perform necessary calculations to determine success criteria for flooding mitigation, (3) perform parameter estimation analysis to include flooding as a failure mode, (4) perform human reliability analysis to account for performance shaping factors that are attributable to flooding, and (5) quantify internal flood accident sequence CDF. Modifications of the Level 1 models are performed consistent with the appropriate boundary for Level 1 elements for transients and loss of coolant accidents (LOCAs).
1.2.4    Internal Fire Technical Elements PRA models of internal fires are based on the internal events PRA model, modified to include the impact of the identified fire scenarios in terms of causing initiating events (plant transients and LOCAs), and failing equipment used to respond to initiating events. These fire scenarios are developed during the screening analysis, fire initiation analysis, and the fire damage analysis. The plant response and quantification that is specific to internal fires is similar in nature to that for the internal events. Because of its dependence on the internal events model, the internal fire analysis incorporates the elements of Sections 1.2.1 and 1.2.2 as necessary DG-1161, Page 11
 
Screening analysis identifies fire areas where fires could result in significant accident sequences. Fire areas that cannot result in significant accident sequences can be screened out from further consideration in the PRA analysis. Both qualitative and quantitative screening criteria can be used. The former address whether an unsuppressed fire in the area poses a nuclear safety challenge; the latter are compared against a bounding assessment of the fire-induced core damage frequency for the area. Plant walkdowns are performed where possible to verify the accuracy of the information used in the screening analysis. Key screening analysis assumptions and results [e.g., the area-specific conditional core damage probabilities (assuming fire-induced loss of all equipment in the area)] are documented.
Fire initiation analysis determines the frequency and physical characteristics of the detailed (within-area) fire scenarios analyzed for the unscreened fire areas. The analysis identifies a range of scenarios that will be used to represent all possible scenarios in the area. The possibility of seismically induced fires is considered. The scenario frequencies reflect plant-specific experience, to the extent available and supplemented with industry fire information, and quantified in a manner that is consistent with its use in the subsequent fire damage analysis (discussed below). Each scenario is physically characterized in terms that will support the fire damage analysis (especially with respect to fire modeling).
Fire damage analysis determines the conditional probability that sets of potentially significant contributors (i.e., components including cables) will be damaged in a particular mode, given a specified fire scenario. The analysis addresses components whose failure will cause an initiating event, affect the plants ability to mitigate an initiating event, or affect potentially significant contributors (i.e.,
equipment), such as through suppression system actuation. Damage from heat, smoke, and exposure to suppressants is considered. If fire models are used to predict fire-induced damage, compartment-specific features (e.g., ventilation, geometry) and target-specific features (e.g., cable location relative to the fire) are addressed. The fire suppression analysis accounts for the scenario-specific time to detect, respond to, and suppress the fire. The models and data used to analyze fire growth, fire suppression, and fire-induced component damage are consistent with experience from actual nuclear power plant fires, as well as experiments.
Plant response analysis and quantification involves the modification of appropriate plant transient and LOCA PRA models to determine the conditional core damage probability, given damage to the sets of components defined in the fire damage analysis. All potentially fire-induced initiating events that can result in significant accident sequences, including such special events as loss of plant support systems and interactions between multiple nuclear units during a fire event, are addressed. The analysis addresses the availability of non-fire-affected equipment (including control) and any required manual actions. The human reliability analysis of operator actions addresses fire effects on operators (e.g., heat, smoke, loss of lighting, effect on instrumentation) and fire-specific operational issues (e.g., fire response operating procedures, training on these procedures, potential complications in coordinating activities).
1.2.5    External Hazards Technical Elements PRA models of external hazards, when required, are based on the internal events PRA model, which are modified to include the impact of the identified external event scenarios in terms of causing initiating events(plant transients and LOCAs), and failing equipment used to respond to initiating events.
However, it is prudent to perform a screening and bounding analysis to screen out those external events that have an insignificant impact on risk. When external events are modeled in detail, the external event scenarios are developed during the hazard analysis and the fragility analysis as discussed below. The quantification task specific to external events is similar in nature to that for the internal events. Because of its dependence on the internal events model, the external events analysis incorporates the elements of Sections 1.2.1 and 1.2.2 as necessary.
DG-1161, Page 12
 
Screening and bounding analysis identifies external events other than earthquakes (such as river-induced flooding) that may challenge plant operations and require successful mitigation by plant equipment and personnel to prevent core damage from occurring. The term screening out is used here for the process whereby an external event is excluded from further consideration in the PRA analysis.
There are two fundamental screening criteria embedded here. An event can be screened out if either (1) it meets the design criteria, or (2) it can be shown using an analysis that the mean value of the design-basis hazard used in the plant design is less than 10-5/year and that the conditional core-damage probability is less than 10-1, given the occurrence of the design-basis hazard. An external event that cannot be screened out using either of these criteria is subjected to the detailed analysis.
Hazard analysis characterizes non-screened external events and seismic events, generally, as frequencies of occurrence of different sizes of events (e.g., earthquakes with various peak ground accelerations, hurricanes with various maximum wind speeds) at the site. The external events are site-specific and the hazard characterization addresses both aleatory and epistemic uncertainties.
Fragility analysis characterizes conditional probability of failure of SSCs whose failure may lead to unacceptable damage to the plant (e.g., core damage) given occurrence of an external event. For significant contributors (i.e., SSCs), the fragility analysis is realistic and plant-specific. The fragility analysis is based on extensive plant walkdowns reflecting as-built, as-operated conditions.
Plant response analysis and quantification involves the modification of appropriate plant transient and LOCA PRA models to determine the conditional core damage probability, given damage to the sets of components identified. The external events PRA model includes initiating events resulting from the external events, external-event-induced SSC failures, non-external-event-induced failures (random failures), and human errors. The system analysis is well-coordinated with the fragility analysis and is based on plant walkdowns. The results of the external event hazard analysis, fragility analysis, and system models are assembled to estimate frequencies of core damage and large early release.
1.2.6      Interpretation of Results The results of the Level 1 PRA are examined to identify the contributors sorted by initiating events, accident sequences, equipment failures, and human errors. Methods such as importance measure calculations (e.g., Fussell-Vesely Importance, risk achievement worth, risk reduction worth, and Birnbaum Importance) are used to identify the contributions of various events to the estimation of CDF for both individual sequences and the total CDF [that is, both contributors to the total CDF, including the contribution from the different initiators (i.e., internal and external events) and different operating modes (i.e., full- and low-power and shutdown) and contributors to each contributing sequence are identified].
The results of the Level 2 PRA are examined to identify the contributions of various events to the model estimation of LERF and large late release probability for both individual sequences and the model as a total, using such tools as importance measure calculations (e.g., Fussell-Vesely Importance, risk achievement worth, risk reduction worth, and Birnbaum Importance).
DG-1161, Page 13
 
An important aspect in understanding the PRA results is understanding the associated uncertainties. Key sources of uncertainty4 are identified and their impact on the results analyzed. The potential conservatism associated with the successive screening approach used for the analysis of specific scope items such as fire, flooding, or seismic initiating events is assessed. The sensitivity of the model results to model boundary conditions and other key assumptions5 is evaluated using sensitivity analyses to look at key assumptions both individually or in logical combinations. The combinations analyzed are chosen to account for interactions among the variables.
1.2.7    Documentation Traceability and defensibility provide the necessary information such that the results can easily be reproduced and justified. The sources of information used in the PRA are both referenced and retrievable. The methodology used to perform each aspect of the work is described either through documenting the actual process or through reference to existing methodology documents. Key sources of uncertainty are identified and their impact on the results assessed. Key assumptions made in performing the analyses are identified and documented along with their justification to the extent that the context of the assumption is understood. The results (e.g., products and outcomes) from the various analyses are documented. A key source of uncertainty is one that is related to an issue where there is no consensus approach or model (e.g., choice of data source, success criteria, reactor coolant pressure (RCP) seal LOCA model, human reliability model) and where the choice of approach or model is known to have an impact on the PRA results in terms of introducing new accident sequences, changing the relative importance of sequences, or affecting the overall CDF or LERF estimates that might have an impact on the use of the PRA in decision-making. A key assumption is one that is made in response to a key source of uncertainty.
1.3      Attributes and Characteristics of the PRA Technical Elements Tables 2 and 3 describe, for each technical element of a PRA, the technical characteristics and attributes that provide one acceptable approach for determining the technical adequacy of the PRA such that the goals and purposes, defined in Regulatory Position 1.2, are accomplished.
For each given technical element, the level of detail may vary. The detail may vary from the degree to which (1) plant design and operation is modeled, (2) specific plant experience is incorporated into the model, and (3) realism is incorporated into the analyses that reflect the expected plant response.
Regardless of the level of detail developed in the PRA, the characteristics and attributes provided below are included. That is, each characteristic and attribute is always included, but the degree to which it is included, as described above, may vary.
Regardless of the level of detail developed in the PRA, the characteristics and attributes provided below are included. That is, each characteristic and attribute is always included, but the degree to which it is included, as described above, may vary.
DG-1161, Page 15The level of detail needed is dependent on the application. The application may involve usingthe PRA during different plant "stages" (i.e., design, construction, and operation). Consequently, a PRA used to support a design certification will not have the same level of detail as a PRA of a plant that hasyears of operating experience. While it is recognized that the same level of detail is not needed, each of the technical elements and its attributes has to be addressed.Table 2. Summary of Technical Characteristics and Attributes of a PRAElementTechnical Characteristics and AttributesPRA Full-Power, Low-Power, and Shutdown Level 1 PRA (internal events - transients and LOCAs)InitiatingEventAnalysis*sufficiently detailed identification and characterization of initiators*grouping of individual events according to plant response and mitigating requirements*proper screening of any individual or grouped initiating events SuccessCriteriaAnalysis*based on best-estimate engineering analyses applicable to the actual plant design andoperation*codes developed, validated, and verified in sufficient detailanalyze the phenomena of interestbe applicable in the pressure, temperature, and flow range of interestAccidentSequenceDevelopmentAnalysis*defined in terms of hardware, operator action, and timing requirements and desired endstates [e.g., core damage or plant damage states (PDSs)]*includes necessary and sufficient equipment (safety and non-safety) reasonably expectedto be used to mitigate initiators*includes functional, phenomenological, and operational dependencies and interfacesSystemsAnalysismodels developed in sufficient detail to achieve the following purposes:*reflect the as-built, as-operated plant including how it has performed during the planthistory*reflect the success criteria for the systems to mitigate each identified accident sequence*capture impact of dependencies, including support systems and harsh environmentalimpacts*include both active and passive components and failure modes that impact the functionof the system*include common-cause failures, human errors, unavailability resulting from testand maintenance, etc.ParameterEstimationAnalysis*estimation of parameters associated with initiating event, basic event probability models,recovery actions, and unavailability events using plant-specific and generic data asapplicable*consistent with component boundaries*estimation includes a characterization of the uncertaintyHumanReliabilityAnalysis*identification and definition of the human failure events that would result in initiatingevents or pre- and post-accident human failure events that would impact the mitigation ofinitiating events*quantification of the associated human error probabilities taking into account scenario(where applicable) and plant-specific factors and including appropriate dependencies(both pre- and post-accident)
4 A key source of uncertainty is one that is related to an issue in which there is no consensus approach or model and where the choice of approach or model is known to have an impact on the risk profile (e.g., total CDF and total LERF, the set of initiating events and accident sequences that contribute most to CDF and to LERF) or a decision being made using the PRA. Such an impact might occur, for example, by introducing new functional accident sequence or a change to the overall CDF or LERF estimates significant enough to affect insights gained from the PRA.
Table 2. Summary of Technical Characteristics and Attributes of a PRAElementTechnical Characteristics and AttributesDG-1161, Page 16Quantification*estimation of the CDF for modeled sequences that are not screened as a result oftruncation, given as a mean value*estimation of the accident sequence CDFs for each initiating event group*truncation values set relative to the total plant CDF such that the CDF is stable withrespect to further reduction in the truncation valueLevel 2 PRAPlant DamageState Analysis*identification of the attributes of the core damage scenarios that influence severeaccident progression, containment performance, and any subsequent radionuclidereleases*grouping of core damage scenarios with similar attributes into plant damage states*carryover of relevant information from Level 1 to Level 2SevereAccidentProgressionAnalysis*use of verified, validated codes by qualified trained users with an understanding of thecode limitations and the means for addressing the limitations*assessment of the credible severe accident phenomena via a structured process*assessment of containment system performance including linkage with failure modes onnon-containment systems*establishment of the capacity of the containment to withstand severe accidentenvironments*assessment of accident progression timing, including timing of loss of containmentfailure integrityQuantification *estimation of the frequency of different containment failure modes and resultingradionuclide source termsSource TermAnalysis*assessment of radionuclide releases including appreciation of timing, location, amountand form of release*grouping of radionuclide releases into smaller subsets of representative source termswith emphasis on large early release and large late releaseIn addressing the above elements, because of the nature and impact of internal flood and fire andexternal hazards, their attributes are discussed separately in Table 3. This is because flood, fire, and external hazards analyses are spatial in nature and have the ability to cause initiating events but also have the capability to impact the availability of mitigating systems. Therefore, regarding the PRA model, the impact of flood, fire, and external hazards is to be considered in each of the above technical elements.
5 A key assumption is one that is made in response to a key source of uncertainty in the knowledge that a different reasonable alternative assumption would produce different results, or an assumption that results in an approximation made for modeling convenience in the knowledge that a more detailed model would produce different results. For the base PRA, the term different results refers to a change in the risk profile and the associated changes in insights derived from the changes in the risk profile. A reasonable alternative assumption is one that has broad acceptance within the technical community and for which the technical basis for consideration is at least as sound as that of the assumption being challenged.
DG-1161, Page 17Table 3. Summary of Technical Characteristics and Attributes of an Internal Flood and Fire Analysis and External Hazards AnalysisAreas of AnalysisTechnical Characteristics and Attributes*Internal Flood AnalysisFlood IdentificationAnalysis*sufficiently detailed identification and characterization of the following:flood areas and SSCs located within each areaflood sources and flood mechanismstype of water release and capacitystructures functioning as drains and sumps*verification of the information through plant walkdownsFlood EvaluationAnalysis*identification and evaluation of the following:flood propagation pathsflood mitigating plant design features and operator actionsthe susceptibility of SSCs in each flood area to the different types of floods*elimination of flood scenarios uses well-defined and justified screening criteriaQuantification*identification of flooding-induced initiating events on the basis of a structuredand systematic process*estimation of flooding initiating event frequencies*estimation of CDF for chosen flood sequences*modification of the Level 1 models to account for flooding effects includinguncertaintiesInternal Fire AnalysisScreening Analysis*fire areas are identified and addressed that can result in significant accidentsequences*all credited mitigating components and their cables in each fire area areidentified*screening criteria are defined and justified*necessary walkdowns are performed to confirm the screening decisions*screening process and results are documented*unscreened events areas are subjected to appropriate level of evaluations(including detailed fire PRA evaluations as described below)Initiation Analysis*fire scenarios in each unscreened area are addressed that can result insignificant accident sequence*fire scenario frequencies reflect plant-specific features*fire scenario physical characteristics are defined*bases are provided for screening fire initiatorsDamage Analysis*damage to significant contributors (i.e., components) is addressed, consideringall potential component failure modes*all potentially significant contributors (i.e., damage mechanisms) are identifiedand addressed, and damage criteria are specified*analysis addresses scenario-specific factors affecting fire growth, suppression,and component damage*models and data are consistent with experience from actual fires, as well asexperiments*includes evaluation of propagation of fire and fire effects (e.g., smoke)between fire compartments Table 3. Summary of Technical Characteristics and Attributes of an Internal Flood and Fire Analysis and External Hazards AnalysisAreas of AnalysisTechnical Characteristics and Attributes*DG-1161, Page 18Plant Response Analysis*fire-induced initiating events that can result in significant accident sequencesare addressed so that their bases are included in the model*includes fire scenario impacts on core damage mitigation and containmentsystems, including fire-induced failures*analysis reflects plant-specific safe shutdown strategy*potential circuit interactions that can interfere with safe shutdown areaddressed*human reliability analysis addresses effect of fire scenario-specific conditionson operator performanceQuantification *estimation of fire CDF for chosen fire scenarios*identification of sources of uncertainty and their impact on the results*understanding of the impact of the key assumptions on the CDF*all fire-significant sequences are traceable and reproducibleExternal Hazards AnalysisScreening and BoundingAnalysis*credible external events (natural and man-made) that may affect the site areaddressed*screening and bounding criteria are defined and results are documented*necessary walkdowns are performed*non-screened events are subjected to an appropriate level of evaluationsHazard Analysis*the hazard analysis is site- and plant-specific*the hazard analysis addresses uncertaintiesFragility Analysis*fragility estimates are plant-specific for significant contributors (i.e., SSCs)*walkdowns are conducted to identify plant-unique conditions, failure modes,and as-built conditionsPlant response analysisand quantification *external event caused initiating events that can lead to significant core damageand large early release sequences are included*external event-related unique failures and failure modes are incorporated*equipment failures from other causes and human errors are included. When necessary, human error data are modified to reflect uniquecircumstances related to the external event under consideration*unique aspects of common causes, correlations, and dependencies are included*the systems model reflects as-built, as-operated plant conditions*the integration/quantification accounts for the uncertainties in each of theinputs (i.e., hazard, fragility, system modeling) and final quantitative resultssuch as CDF and LERF*the integration/quantification accounts for all dependencies and correlationsthat affect the resultsIn understanding the results from a PRA, the different initiators and operating states need to beconsidered, in an integrated manner, when examining the results. The attributes for interpretation of the results are discussed separately in Table 4.
DG-1161, Page 14
6It is recognized that at the design certification or combined operating license stage where the plant is not built oroperated, the term "as-built, as-operated" is meant to reflect the as-designed plant assuming operational conditions forthe given design.DG-1161, Page 19Table 4. Summary of Technical Characteristics and Attributes for Interpretation of ResultsElementTechnical Characteristics and AttributesLevel 1 PRA Interpretation ofResults*identification of the key contributors to CDF (initiating events, accident sequences,equipment failures and human errors)*identification of key sources of uncertainty and their impact on the results*understanding of the impact of the key assumptions on the CDF and the identificationof the accident sequence and their contributorsLevel 2 PRAInterpretation ofResults*identification of the contributors to containment failure and resulting source terms*identification of key sources of uncertainty and their impact on the results*understanding of the impact of the key assumptions on Level 2 resultsA significant aspect of the technical acceptability of the PRA is documentation. The attributesfor documentation are discussed separately in Table 5.Table 5. Summary of Technical Characteristics and Attributes for DocumentationElementTechnical Characteristics and AttributesTraceability anddefensibility*the documentation is sufficient to facilitate independent peer reviews*the documentation describes the interim and final results, insights, and key sources ofuncertainties*walkdown process and results are fully described1.4PRA Development, Maintenance, and UpgradeThe PRA results used to support an application are derived from a PRA model that represents theas-built, as-operated plant to the extent needed to support the application. Therefore, a process for developing, maintaining, and upgrading a PRA is established. This process involves identifying and using plant information to develop the original PRA and to modify the PRA. The process is performed such that the plant information identified and used in the PRA reflects the as-built, as-operated plant.
 
6 The information sources include the applicable design, operation, maintenance, and engineering characteristics of the plantFor those SSCs and human actions used in the development of the PRA, the followinginformation is identified, integrated, and used in the PRA:
The level of detail needed is dependent on the application. The application may involve using the PRA during different plant stages (i.e., design, construction, and operation). Consequently, a PRA used to support a design certification will not have the same level of detail as a PRA of a plant that has years of operating experience. While it is recognized that the same level of detail is not needed, each of the technical elements and its attributes has to be addressed.
*plant design information reflecting the normal and emergency configurations of the plant
Table 2. Summary of Technical Characteristics and Attributes of a PRA Element                                    Technical Characteristics and Attributes PRA Full-Power, Low-Power, and Shutdown Level 1 PRA (internal events  transients and LOCAs)
*plant operational information with regard to plant procedures and practices
Initiating
*plant test and maintenance procedures and practices
* sufficiently detailed identification and characterization of initiators Event
*engineering aspects of the plant design DG-1161, Page 20Further, plant walkdowns are conducted to ensure that information sources being used actuallyreflects the plant's as-built, as-operated condition. In some cases, corroborating information obtained from the documented information sources for the plant and other information may only be gained by direct observations.Table 6 describes the characteristics and attributes that need to be included for the above types ofinformation.Table 6. Summary of Attributes and Characteristics for Information Sources Used in PRA DevelopmentType ofInformationAttributes and CharacteristicsDesign*the safety functions required to maintain the plant in a safe stable state and prevent coreor containment damage*identification of those SSCs that are credited in the PRA to perform the above functions*the functional relationships among the SSCs including both functional and hardwaredependencies*the normal and emergency configurations of the SSCs*the automatic and manual (human interface) aspects of equipment initiation, actuation,operation, as well as isolation and termination*the SSC's capabilities (flows, pressures, actuation timing, environmental operatinglimits)*spatial layout, sizing, and accessibility information related to the credited SSCs*other design information needed to support the PRA modeling of the plantOperational*that information needed to reflect the actual operating procedures and practices used atthe plant including when and how operators interface with plant equipment as well ashow plant staff monitor equipment operation and status*that information needed to reflect the operating history of the plant as well as anyevents involving significant human interactionMaintenance*that information needed to reflect planned and typical unplanned tests and maintenanceactivities and their relationship to the status, timing, and duration of the availability ofequipment*historical information related to the maintenance practices and experience at the plantEngineering*the design margins in the capabilities of the SSCs*operating environmental limits of the equipment*expected thermal hydraulic plant response to different states of equipment (such as forestablishing success criteria)*other engineering information needed to support the PRA modeling of the plantAs a plant operates over time, its associated risk may change. This change may occur for thefollowing reasons:*The PRA model may change as a result of improved methods or techniques.
* grouping of individual events according to plant response and mitigating requirements Analysis
*Operating data may change the availability or reliability of the plant's structures, systems andcomponents.*Plant design or operation may change.
* proper screening of any individual or grouped initiating events Success
DG-1161, Page 21Therefore, to ensure that the PRA represents the risk of the current as-built and as-operated plant,the PRA needs to be maintained and upgraded over time. Table 7 provides the attributes and characteristics of an acceptable process.Table 7. Summary of Characteristics and Attributes for PRA Maintenance and UpgradeCharacteristics and Attributes*Monitor PRA inputs and collect new information*Ensure cumulative impact of pending plant changes are considered*Maintain configuration control of the computer codes used in the PRA*Identify when PRA needs to be updated based on new information or new models/techniques/tools*Ensure peer review is performed on PRA upgrades2.Consensus PRA Standards and Industry PRA ProgramsOne acceptable approach to demonstrate conformance with Regulatory Position 1 is to use anindustry consensus PRA standard or standards that address the scope of the PRA used in the decision-making; an alternative acceptable approach to using an industry consensus PRA standard is to use an industry-developed peer review program.If PRA consensus standards or industry-developed peer review programs are used to demonstrateconformance with Regulatory Position 1, the staff position on these documents needs to be taken into account. If other sources are used (e.g., in the standard) as an acceptable means for meeting the standard, those references are only acceptable if the staff has endorsed that specific requirement. That is, documents referenced in the standard are acceptable if they are associated with a specific requirement that has been endorsed by the staff.2.1Consensus PRA StandardsIn general, if a PRA standard is used to demonstrate conformance with Regulatory Position 1, thestandard should be based on a set of principles and objectives. Table 8 provides an acceptable set of principles and objectives that were established and used by ASME. Principle 3 recognizes that the various parts of a PRA can be, and are generally, performed to different "capabilities."  In developing the various models in the PRA, the different capabilities are distinguished by three attributes, determined by the degree to which the following criteria are met:(1)The scope and level of detail that reflects the plant design, operation, and maintenance may vary.
* based on best-estimate engineering analyses applicable to the actual plant design and Criteria            operation Analysis
(2)Plant-specific information versus generic information is used, such that the as-built and as-operated plant is addressed.(3)Realism is incorporated, such that the expected response of the plant is addressed.It is recognized that the various parts of a PRA will not be to the same capability category. Which part of the PRA meets what capability category is dependent on the specific application.
* codes developed, validated, and verified in sufficient detail
DG-1161, Page 22Table 8. Principles and Objectives of a Standard1.The PRA standard provides well-defined criteria against which the strengths and weaknesses of the PRAmay be judged so that decision-makers can determine the degree of reliance that can be placed on the PRAresults of interest.2.The standard is based on current good practices(see Note below) as reflected in publicly available documents. The need for the documentation to be publicly available follows from the fact that the standard may be usedto support safety decisions.3.To facilitate the use of the standard for a wide range of applications, categories can be defined to aid indetermining the applicability of the PRA for various types of applications.4.The standard thoroughly and completely defines what is technically required and should, where appropriate,identify one or more acceptable methods.5.The standard requires a peer review process that identifies and assesses where the technical requirements ofthe standard are not met. The standard needs to ensure that the peer review process meets the followingcriteria:determines whether methods identified in the standard have been used appropriatelydetermines that, when acceptable methods are not specified in the standard, or when alternative methodsare used in lieu of those identified in the standard, the methods used are adequate to meet therequirements of the standardassesses the significance of the results and insights gained from the PRA of not meeting the technicalrequirements in the standardhighlights key [emphasis added] assumptions that may significantly [emphasis removed] impact theresults and provides an assessment of the reasonableness of the assumptionsis flexible and accommodates alternative peer review approachesincludes a peer review team that is composed of members who are knowledgeable in the technicalelements of a PRA, are familiar with the plant design and operation, and are independent with noconflicts of interest that may influence the outcome of the peer review [this clause was not in the ASMEdefinition]6.The standard addresses the maintenance and update of the PRA to incorporate changes that cansubstantially impact the risk profile so that the PRA adequately represents the current as-built and as-operated plant.7.The standard is a living document. Consequently, it should not impede research. It is structured so that,when improvements in the state of knowledge occur, the standard can easily be updated.Note:Current good practices are those practices that are generally accepted throughout the industry and haveshown to be technically acceptable in documented analyses or engineering assessments.  [No definitionwas provided for these terms by ASME.]The standards are written in terms of "requirements.These requirements will be either"process" in nature, or technical in nature. The process type requirements address the process for application, development, maintenance and upgrade, and peer review. The technical requirements address the technical elements of the PRA and what is necessary to adequately perform that element.
                      < analyze the phenomena of interest
                      < be applicable in the pressure, temperature, and flow range of interest Accident
* defined in terms of hardware, operator action, and timing requirements and desired end Sequence            states [e.g., core damage or plant damage states (PDSs)]
Development
* includes necessary and sufficient equipment (safety and non-safety) reasonably expected Analysis            to be used to mitigate initiators
* includes functional, phenomenological, and operational dependencies and interfaces Systems          models developed in sufficient detail to achieve the following purposes:
Analysis
* reflect the as-built, as-operated plant including how it has performed during the plant history
* reflect the success criteria for the systems to mitigate each identified accident sequence
* capture impact of dependencies, including support systems and harsh environmental impacts
* include both active and passive components and failure modes that impact the function of the system
* include common-cause failures, human errors, unavailability resulting from test and maintenance, etc.
Parameter
* estimation of parameters associated with initiating event, basic event probability models, Estimation          recovery actions, and unavailability events using plant-specific and generic data as Analysis             applicable
* consistent with component boundaries
* estimation includes a characterization of the uncertainty Human
* identification and definition of the human failure events that would result in initiating Reliability          events or pre- and post-accident human failure events that would impact the mitigation of Analysis            initiating events
* quantification of the associated human error probabilities taking into account scenario (where applicable) and plant-specific factors and including appropriate dependencies (both pre- and post-accident)
DG-1161, Page 15
 
Table 2. Summary of Technical Characteristics and Attributes of a PRA Element                                  Technical Characteristics and Attributes Quantification
* estimation of the CDF for modeled sequences that are not screened as a result of truncation, given as a mean value
* estimation of the accident sequence CDFs for each initiating event group
* truncation values set relative to the total plant CDF such that the CDF is stable with respect to further reduction in the truncation value Level 2 PRA Plant Damage
* identification of the attributes of the core damage scenarios that influence severe State Analysis      accident progression, containment performance, and any subsequent radionuclide releases
* grouping of core damage scenarios with similar attributes into plant damage states
* carryover of relevant information from Level 1 to Level 2 Severe
* use of verified, validated codes by qualified trained users with an understanding of the Accident            code limitations and the means for addressing the limitations Progression
* assessment of the credible severe accident phenomena via a structured process Analysis
* assessment of containment system performance including linkage with failure modes on non-containment systems
* establishment of the capacity of the containment to withstand severe accident environments
* assessment of accident progression timing, including timing of loss of containment failure integrity Quantification
* estimation of the frequency of different containment failure modes and resulting radionuclide source terms Source Term
* assessment of radionuclide releases including appreciation of timing, location, amount Analysis            and form of release
* grouping of radionuclide releases into smaller subsets of representative source terms with emphasis on large early release and large late release In addressing the above elements, because of the nature and impact of internal flood and fire and external hazards, their attributes are discussed separately in Table 3. This is because flood, fire, and external hazards analyses are spatial in nature and have the ability to cause initiating events but also have the capability to impact the availability of mitigating systems. Therefore, regarding the PRA model, the impact of flood, fire, and external hazards is to be considered in each of the above technical elements.
DG-1161, Page 16
 
Table 3. Summary of Technical Characteristics and Attributes of an Internal Flood and Fire Analysis and External Hazards Analysis Areas of Analysis                            Technical Characteristics and Attributes*
Internal Flood Analysis Flood Identification
* sufficiently detailed identification and characterization of the following:
Analysis                    < flood areas and SSCs located within each area
                            < flood sources and flood mechanisms
                            < type of water release and capacity
                            < structures functioning as drains and sumps
* verification of the information through plant walkdowns Flood Evaluation
* identification and evaluation of the following:
Analysis                     < flood propagation paths
                            < flood mitigating plant design features and operator actions
                            < the susceptibility of SSCs in each flood area to the different types of floods
* elimination of flood scenarios uses well-defined and justified screening criteria Quantification
* identification of flooding-induced initiating events on the basis of a structured and systematic process
* estimation of flooding initiating event frequencies
* estimation of CDF for chosen flood sequences
* modification of the Level 1 models to account for flooding effects including uncertainties Internal Fire Analysis Screening Analysis
* fire areas are identified and addressed that can result in significant accident sequences
* all credited mitigating components and their cables in each fire area are identified
* screening criteria are defined and justified
* necessary walkdowns are performed to confirm the screening decisions
* screening process and results are documented
* unscreened events areas are subjected to appropriate level of evaluations (including detailed fire PRA evaluations as described below)
Initiation Analysis
* fire scenarios in each unscreened area are addressed that can result in significant accident sequence
* fire scenario frequencies reflect plant-specific features
* fire scenario physical characteristics are defined
* bases are provided for screening fire initiators Damage Analysis
* damage to significant contributors (i.e., components) is addressed, considering all potential component failure modes
* all potentially significant contributors (i.e., damage mechanisms) are identified and addressed, and damage criteria are specified
* analysis addresses scenario-specific factors affecting fire growth, suppression, and component damage
* models and data are consistent with experience from actual fires, as well as experiments
* includes evaluation of propagation of fire and fire effects (e.g., smoke) between fire compartments DG-1161, Page 17
 
Table 3. Summary of Technical Characteristics and Attributes of an Internal Flood and Fire Analysis and External Hazards Analysis Areas of Analysis                              Technical Characteristics and Attributes*
Plant Response Analysis
* fire-induced initiating events that can result in significant accident sequences are addressed so that their bases are included in the model
* includes fire scenario impacts on core damage mitigation and containment systems, including fire-induced failures
* analysis reflects plant-specific safe shutdown strategy
* potential circuit interactions that can interfere with safe shutdown are addressed
* human reliability analysis addresses effect of fire scenario-specific conditions on operator performance Quantification
* estimation of fire CDF for chosen fire scenarios
* identification of sources of uncertainty and their impact on the results
* understanding of the impact of the key assumptions on the CDF
* all fire-significant sequences are traceable and reproducible External Hazards Analysis Screening and Bounding
* credible external events (natural and man-made) that may affect the site are Analysis                      addressed
* screening and bounding criteria are defined and results are documented
* necessary walkdowns are performed
* non-screened events are subjected to an appropriate level of evaluations Hazard Analysis
* the hazard analysis is site- and plant-specific
* the hazard analysis addresses uncertainties Fragility Analysis
* fragility estimates are plant-specific for significant contributors (i.e., SSCs)
* walkdowns are conducted to identify plant-unique conditions, failure modes, and as-built conditions Plant response analysis
* external event caused initiating events that can lead to significant core damage and quantification            and large early release sequences are included
* external event-related unique failures and failure modes are incorporated
* equipment failures from other causes and human errors are included.
When necessary, human error data are modified to reflect unique circumstances related to the external event under consideration
* unique aspects of common causes, correlations, and dependencies are included
* the systems model reflects as-built, as-operated plant conditions
* the integration/quantification accounts for the uncertainties in each of the inputs (i.e., hazard, fragility, system modeling) and final quantitative results such as CDF and LERF
* the integration/quantification accounts for all dependencies and correlations that affect the results In understanding the results from a PRA, the different initiators and operating states need to be considered, in an integrated manner, when examining the results. The attributes for interpretation of the results are discussed separately in Table 4.
DG-1161, Page 18
 
Table 4. Summary of Technical Characteristics and Attributes for Interpretation of Results Element                                                Technical Characteristics and Attributes Level 1 PRA Interpretation of
* identification of the key contributors to CDF (initiating events, accident sequences, Results                      equipment failures and human errors)
* identification of key sources of uncertainty and their impact on the results
* understanding of the impact of the key assumptions on the CDF and the identification of the accident sequence and their contributors Level 2 PRA Interpretation of
* identification of the contributors to containment failure and resulting source terms Results
* identification of key sources of uncertainty and their impact on the results
* understanding of the impact of the key assumptions on Level 2 results A significant aspect of the technical acceptability of the PRA is documentation. The attributes for documentation are discussed separately in Table 5.
Table 5. Summary of Technical Characteristics and Attributes for Documentation Element                                                Technical Characteristics and Attributes Traceability and
* the documentation is sufficient to facilitate independent peer reviews defensibility
* the documentation describes the interim and final results, insights, and key sources of uncertainties
* walkdown process and results are fully described 1.4      PRA Development, Maintenance, and Upgrade The PRA results used to support an application are derived from a PRA model that represents the as-built, as-operated plant to the extent needed to support the application. Therefore, a process for developing, maintaining, and upgrading a PRA is established. This process involves identifying and using plant information to develop the original PRA and to modify the PRA. The process is performed such that the plant information identified and used in the PRA reflects the as-built, as-operated plant.6 The information sources include the applicable design, operation, maintenance, and engineering characteristics of the plant For those SSCs and human actions used in the development of the PRA, the following information is identified, integrated, and used in the PRA:
* plant design information reflecting the normal and emergency configurations of the plant
* plant operational information with regard to plant procedures and practices
* plant test and maintenance procedures and practices
* engineering aspects of the plant design 6
It is recognized that at the design certification or combined operating license stage where the plant is not built or operated, the term as-built, as-operated is meant to reflect the as-designed plant assuming operational conditions for the given design.
DG-1161, Page 19
 
Further, plant walkdowns are conducted to ensure that information sources being used actually reflects the plants as-built, as-operated condition. In some cases, corroborating information obtained from the documented information sources for the plant and other information may only be gained by direct observations.
Table 6 describes the characteristics and attributes that need to be included for the above types of information.
Table 6. Summary of Attributes and Characteristics for Information Sources Used in PRA Development Type of          Attributes and Characteristics Information Design
* the safety functions required to maintain the plant in a safe stable state and prevent core or containment damage
* identification of those SSCs that are credited in the PRA to perform the above functions
* the functional relationships among the SSCs including both functional and hardware dependencies
* the normal and emergency configurations of the SSCs
* the automatic and manual (human interface) aspects of equipment initiation, actuation, operation, as well as isolation and termination
* the SSCs capabilities (flows, pressures, actuation timing, environmental operating limits)
* spatial layout, sizing, and accessibility information related to the credited SSCs
* other design information needed to support the PRA modeling of the plant Operational
* that information needed to reflect the actual operating procedures and practices used at the plant including when and how operators interface with plant equipment as well as how plant staff monitor equipment operation and status
* that information needed to reflect the operating history of the plant as well as any events involving significant human interaction Maintenance
* that information needed to reflect planned and typical unplanned tests and maintenance activities and their relationship to the status, timing, and duration of the availability of equipment
* historical information related to the maintenance practices and experience at the plant Engineering
* the design margins in the capabilities of the SSCs
* operating environmental limits of the equipment
* expected thermal hydraulic plant response to different states of equipment (such as for establishing success criteria)
* other engineering information needed to support the PRA modeling of the plant As a plant operates over time, its associated risk may change. This change may occur for the following reasons:
* The PRA model may change as a result of improved methods or techniques.
* Operating data may change the availability or reliability of the plants structures, systems and components.
* Plant design or operation may change.
DG-1161, Page 20
 
Therefore, to ensure that the PRA represents the risk of the current as-built and as-operated plant, the PRA needs to be maintained and upgraded over time. Table 7 provides the attributes and characteristics of an acceptable process.
Table 7. Summary of Characteristics and Attributes for PRA Maintenance and Upgrade Characteristics and Attributes
* Monitor PRA inputs and collect new information
* Ensure cumulative impact of pending plant changes are considered
* Maintain configuration control of the computer codes used in the PRA
* Identify when PRA needs to be updated based on new information or new models/techniques/tools
* Ensure peer review is performed on PRA upgrades
: 2.       Consensus PRA Standards and Industry PRA Programs One acceptable approach to demonstrate conformance with Regulatory Position 1 is to use an industry consensus PRA standard or standards that address the scope of the PRA used in the decision-making; an alternative acceptable approach to using an industry consensus PRA standard is to use an industry-developed peer review program.
If PRA consensus standards or industry-developed peer review programs are used to demonstrate conformance with Regulatory Position 1, the staff position on these documents needs to be taken into account. If other sources are used (e.g., in the standard) as an acceptable means for meeting the standard, those references are only acceptable if the staff has endorsed that specific requirement. That is, documents referenced in the standard are acceptable if they are associated with a specific requirement that has been endorsed by the staff.
2.1     Consensus PRA Standards In general, if a PRA standard is used to demonstrate conformance with Regulatory Position 1, the standard should be based on a set of principles and objectives. Table 8 provides an acceptable set of principles and objectives that were established and used by ASME. Principle 3 recognizes that the various parts of a PRA can be, and are generally, performed to different capabilities. In developing the various models in the PRA, the different capabilities are distinguished by three attributes, determined by the degree to which the following criteria are met:
(1)      The scope and level of detail that reflects the plant design, operation, and maintenance may vary.
(2)      Plant-specific information versus generic information is used, such that the as-built and as-operated plant is addressed.
(3)     Realism is incorporated, such that the expected response of the plant is addressed.
It is recognized that the various parts of a PRA will not be to the same capability category.
Which part of the PRA meets what capability category is dependent on the specific application.
DG-1161, Page 21
 
Table 8. Principles and Objectives of a Standard
: 1. The PRA standard provides well-defined criteria against which the strengths and weaknesses of the PRA may be judged so that decision-makers can determine the degree of reliance that can be placed on the PRA results of interest.
: 2. The standard is based on current good practices(see Note below) as reflected in publicly available documents.
The need for the documentation to be publicly available follows from the fact that the standard may be used to support safety decisions.
: 3. To facilitate the use of the standard for a wide range of applications, categories can be defined to aid in determining the applicability of the PRA for various types of applications.
: 4. The standard thoroughly and completely defines what is technically required and should, where appropriate, identify one or more acceptable methods.
: 5. The standard requires a peer review process that identifies and assesses where the technical requirements of the standard are not met. The standard needs to ensure that the peer review process meets the following criteria:
      <  determines whether methods identified in the standard have been used appropriately
      <  determines that, when acceptable methods are not specified in the standard, or when alternative methods are used in lieu of those identified in the standard, the methods used are adequate to meet the requirements of the standard
      <  assesses the significance of the results and insights gained from the PRA of not meeting the technical requirements in the standard
      <  highlights key [emphasis added] assumptions that may significantly [emphasis removed] impact the results and provides an assessment of the reasonableness of the assumptions
      <  is flexible and accommodates alternative peer review approaches
      <  includes a peer review team that is composed of members who are knowledgeable in the technical elements of a PRA, are familiar with the plant design and operation, and are independent with no conflicts of interest that may influence the outcome of the peer review [this clause was not in the ASME definition]
: 6. The standard addresses the maintenance and update of the PRA to incorporate changes that can substantially impact the risk profile so that the PRA adequately represents the current as-built and as-operated plant.
: 7. The standard is a living document. Consequently, it should not impede research. It is structured so that, when improvements in the state of knowledge occur, the standard can easily be updated.
Note:    Current good practices are those practices that are generally accepted throughout the industry and have shown to be technically acceptable in documented analyses or engineering assessments. [No definition was provided for these terms by ASME.]
The standards are written in terms of requirements. These requirements will be either process in nature, or technical in nature. The process type requirements address the process for application, development, maintenance and upgrade, and peer review. The technical requirements address the technical elements of the PRA and what is necessary to adequately perform that element.
Therefore, when a standard is used to demonstrate conformance with Regulatory Position 1, the requirements in the standard will need to be met. As a general rule, a requirement of a standard is met when it is demonstrated that there is clear evidence of an intent to meet the requirement.
Therefore, when a standard is used to demonstrate conformance with Regulatory Position 1, the requirements in the standard will need to be met. As a general rule, a requirement of a standard is met when it is demonstrated that there is clear evidence of an intent to meet the requirement.
DG-1161, Page 23For process requirements, the intent, is generally straightforward and the requirement is eithermet or not met. For the technical requirements, it s
DG-1161, Page 22
 
For process requirements, the intent, is generally straightforward and the requirement is either met or not met. For the technical requirements, it s not always as straightforward. Many of the technical requirements in a standard apply to several parts of the PRA model. For example, the requirements for systems analysis apply to all systems modeled, and certain of the data requirements apply to all parameters for which estimates are provided. If among these systems or parameter estimates there are a few examples in which a specific requirement has not been met, it is not necessarily indicative that this requirement has not been met. If, the requirement has been met for the majority of the systems or parameter estimates, and the few examples can be put down to mistakes or oversights, the requirement would be considered to be met. If, however, there is a systematic failure to address the requirement (e.g., component boundaries have not been defined anywhere), then the requirement has not been complied with. In either case, the examples of noncompliance are to be (1) rectified or demonstrated not to be relevant to the application, and (2) documented.
Further, the technical requirements may be defined at two different levels: (1) high-level requirements, and (2) supporting requirements. High-level requirements are defined for each technical element and capture the objective of the technical element. These high-level requirements are defined in general terms, need to be met regardless of the capability category, and accommodate different approaches. Supporting requirements are defined for each high-level requirement. These supporting requirements are those minimal requirements needed to satisfy the high-level requirement.
Consequently, determination of whether a high-level requirement is met, is based on whether the associated supporting requirements are met. Whether or not every supporting requirement is needed for a high-level requirement is application-dependent and is determined by the application process requirements.
One example of an industry consensus PRA standard is the ASME standard, with a scope for a PRA for Level 1 and limited Level 2 (LERF) for full-power operation and internal events (excluding internal fires). The staff regulatory position regarding this document is provided in Appendix A to this regulatory guide. If it is demonstrated that the parts of a PRA that are used to support an application comply with the ASME standard, when supplemented to account for the staffs regulatory positions contained in Appendix A, it is considered that the PRA is adequate to support that risk-informed regulatory application.
Additional appendices will be added in future updates to this regulatory guide to address PRA standards for other risk contributors, such as accidents caused by external hazards or internal fire or caused during the low-power and shutdown modes of operation.
2.2      Industry Peer Review Program An acceptable approach that can be used to ensure technical adequacy is to perform a peer review of the PRA. A peer review process can be used to identify the strengths and weaknesses in the PRA and their importance to the confidence in the PRA results. A peer review process is provided in the ASME standard and in the industry-developed peer review program (i.e., NEI-00-02, Ref. 9). The staff regulatory position on the process in the ASME PRA Standard and in NEI-00-02 is provided in Appendices A and B, respectively, to this regulatory guide. When the staffs regulatory positions contained in Appendices A and B are taken into account, use of these processes can be used to demonstrate that the PRA is adequate to support a risk-informed application.
DG-1161, Page 23
 
The peer review is to be performed against established standards (e.g., ASME PRA Standard).
If different criteria are used than in the established standard, then it needs to be demonstrated that these different criteria are consistent with the established standards, as endorsed by the NRC. NEI-00-02 provides separate criteria for a peer review of a Level 1/LERF PRA at full-power for internal events, excluding internal flood and fire and external events. NEI-00-02 also provides guidance for resolution of the differences between the established standards, as endorsed by the NRC (i.e., ASME PRA Standard and Appendix A to this guide) and its peer review criteria. The staff position on this guidance (referred to as the Licensee Self-Assessment Guidance), is provided in Appendix B to this guide. When the staffs regulatory positions contained in Appendix B are taken into account, use of the peer reviews performed using NEI-00-02 can be used to demonstrate that the PRA is adequate to support a risk-informed application, with regard to a Level 1/LERF PRA for full-power for internal events (excluding internal floods and fires and external events).
If a peer review process is used to demonstrate conformance with Regulatory Position 1, an acceptable peer review approach is one that is performed by qualified personnel and, according to an established process that compares the PRA against the characteristics and attributes, documents the results and identifies both strengths and weaknesses of the PRA.
The team qualifications determine the credibility


1998.8.Regulatory Guide 1.177, "An Approach for Plant-Specific, Risk-Informed Decisionmaking: Technical Specifications," U.S. Nuclear Regulatory Commission, Washington, DC, August 1998.
Table B-5. NRC Regulatory Position on NEI 05-04 Report Section  Regulatory                                  Commentary/Resolution Position APPENDICES Appendix A      No objection  ------------------------------------
9.ASME RA-S-2002, "Standard for Probabilistic Risk Assessment for Nuclear Power PlantApplications," ASME, New York, New York, April 5, 2002.
Sample Fact and Observation Form Appendix B      No objection  ------------------------------------
10ASME RA-Sa-2003, "Standard for Probabilistic Risk Assessment for Nuclear Power PlantApplications," Addendum A to ASME RA-S-2002, ASME, New York, New York, December 5, 2003.ASME RA-Sb-2005, "Standard for Probabilistic Risk Assessment for Nuclear Power PlantApplications," Addendum B to ASME RA-S-2002, ASME, New York, New York, December 30, 2005.10.ANSI/ANS-58.21-2003, "American National Standard External-Events PRA Methodology,"American Nuclear Society, La Grange Park, Illinois, December 2003.
Sample Summary Tables Appendix C      No objection   ---------------------------------
11 11.NEI-00-02, "Probabilistic Risk Assessment Peer Review Process Guidance," Revision A3,Nuclear Energy Institute, Washington, DC, March 20, 2000.
Maintenance and Update Process Review Checklist Appendix B to DG-1161, Page B-64}}
12Nuclear Energy Institute, Letter from Anthony Pietrangelo, Director of Risk- and Performance-Based Regulation Nuclear Generation, Nuclear Energy Institute, to Ashok Thadani, Director of Office of Nuclear Regulatory Research, U.S. Nuclear Regulatory Commission, Washington, DC, December 18, 2001.NEI-00-02, "Probabilistic Risk Assessment Peer Review Process Guidance," Revision 1,Nuclear Energy Institute, Washington, DC, May 2006.
12.NEI-05-04, "Process for Performing Follow-on PRA Peer Reviews Using the ASME PRAStandard," Nuclear Energy Institute, Washington, DC, January 2005 (Available in ADAMS under Accession #ML062150115).
13All Commission papers (SECYs) listed herein were published by the U.S. Nuclear Regulatory Commission, and areavailable electronically through the Public Electronic Reading Room on the NRC's public Web site, at http://www.nrc.gov/reading-rm/doc-collections/commission/secys/. Copies are also available for inspectionor copying for a fee from the NRC's Public Document Room at 11555 Rockville Pike, Rockville, MD; the PDR'smailing address is USNRC PDR, Washington, DC 20555; telephone (301) 415-4737 or (800) 397-4209;fax (301) 415-3548; email PDR@nrc.gov
.DG-1161, Page 33 13.SECY-00-0162, "Addressing PRA Quality In Risk-Informed Activities," U.S. NuclearRegulatory Commission, Washington, DC, July 28, 2000.
13 14.Regulatory Guide 1.201, "Guidelines for Categorizing Structures, Systems, and Components inNuclear Power Plants According to Their Safety Significance," U.S. Nuclear Regulatory Commission, Washington, DC, May 2006.
15.SECY-02-0176, "Proposed Rulemaking to Add New Section 10 CFR 50.69, 'Risk-InformedCategorization and Treatment of Structures, Systems, and Components'," WITS 199900061, U.S. Nuclear Regulatory Commission, Washington, DC, September 30, 2002.
16.SECY-04-0118, "Plan for the Implementation of the Commission's Phased Approach to PRAQuality," U.S. Nuclear Regulatory Commission, Washington, DC, July 13, 2004.
Appendix A to DG-1161, Page A-1APPENDIX ANRC REGULATORY POSITION ON ASME PRA STANDARDIntroductionThe American Society of Mechanical Engineers (ASME) has published ASME RA-S-2002,"Standard for Probabilistic Risk Assessment for Nuclear Power Plant Applications" (April 5, 2002),Addendum A to this standard (ASME RA-Sa-2003, December 5, 2003), and Addendum B to this standard (ASME RA-Sb-2005, December 30, 2005). The standard states that it "sets forth requirements for probabilistic risk assessments (PRAs) used to support risk-informed decision for commercial nuclearpower plants, and describes a method for applying these requirements for specific applications."  The NRC staff has reviewed ASME RA-S-2002, RA-Sb-2003, and RA-Sb-2005 against the characteristics and attributes for a technically acceptable PRA as discussed in Regulatory Position 3 of this regulatory guide. The staff's position on each requirement (referred to in the standard as a requirement, a high-level requirement, or a supporting requirement) in ASME RA-S-2002, RA-Sb-2003, and RA-Sb-2005 is categorized as "no objection," "no objection with clarification," or "no objection subject to the following qualification," and defined as follows:
*No objection. The staff has no objection to the requirement.
*No objection with clarification. The staff has no objection to the requirement. However,certain requirements, as written, are either unclear or ambiguous, and therefore the staff has provided its understanding of these requirements.
*No objection subject to the following qualification. The staff has a technical concern with therequirement and has provided a qualification to resolve the concern.Table A-1 provides the staff's position on each requirement in ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005. A discussion of the staff's concern (issue) and the staff proposed resolution is provided. In the proposed staff resolution, the staff clarification or qualification to therequirement is indicated in either bolded text (i.e., bold) or strikeout text (i.e., strikeout); that is, thenecessary additions or deletions to the requirement (as written in the ASME standard) for the staff to have no objection are provided.
Appendix A to DG-1161, Page A-2Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005Index NoIssuePositionResolutionGlobal----Use of references, the variousreferences, may be acceptable,in general; however, there maybe aspects that are notapplicable or not acceptable.ClarificationFor every reference
:No staff position is provided on thisreference. The staff neither approves ordisapproves of information contained inthe referenced document.Chapter 11.1The standard is only for currentgeneration light-water reactors;the requirements may not besufficient or adequate for othertypes of reactors.ClarificationThis Standard sets forth requirements forProbabilistic Risk Assessments (PRAs) usedto support risk-informed decisions forcurrent commercial light-water reactornuclear power plants, and prescribes amethod for applying these requirements forspecific applications (additional or revisedrequirements may be needed for otherreactor designs).1.2 - 1.7-----------------No objection----------------------------Chapter 22.1-----------------No objection----------------------------2.2Core damageThe use of the term "a largefraction of the core" should beconsistent with the definitionof "large" used in the LERFdefinition.Clarificationcore damage:  -involving a large fractionof the core (i.e., sufficient, if released fromcontainment, has the potential to cause offsite health effects) is anticipated.Extremelyrare eventA frequency cutoff should beprovided as part of thisdefinition.Clarificationextremely rare event:  one that would not beexpected to occur even once throughout theworld nuclear industry over many years (e.g., <1E-6/yr)
.Internal eventInternal fire is an internalevent, and not an externalevent.Qualificationinternal event:  -By convention, loss ofoffsite power is considered to be an internalevent, and internal fire is considered to be anexternal event
.PRA upgradeSee the issue discussed ondefinition of "Accidentsequence, dominant."ClarificationPRA upgrade:  The incorporation into aPRA model of a new methodology orsignificant changes in scope or capabilitythat have the potential to impact the significant sequences. This could-.
Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005Index NoIssuePositionResolutionAppendix A to DG-1161, Page A-3Rare eventA frequency cutoff should beprovided as part of thisdefinition.Clarificationrare event:  one that might be expected tooccur only a few times throughout the worldnuclear industry over many years (e.g., <1E-4/yr).Reactor-yearThis term references the wrongfootnote and could moreaccurately reference the righttable in Section 4.5.Clarificationreactor year:  a calender year in theoperating life of one reactor, regardless ofpower level. See Note 2 3 in Table 4.5.1-2(c).Reactor-operating-state-yearThis term references the wrongfootnote and could moreaccurately reference the righttable in Section 4.5.Clarification-See Note 2 3 in Table 4.5.1-2 (c).ResourceexpertSee the issue discussed ondefinition of "Accidentsequence, dominant."Clarificationresource expert:  A technical expert withknowledge of a particular technical areas ofimportance to a PRA.SignificantcontributorThis term is used in thestandard and a definition isnecessary.Clarificationsignificant contributor:  (a) in the contextof an accident sequence, a significantbasic event or an initiating event thatcontributes to a significant sequence; (b)in the context of an accident progressionsequence, a contributor which is anessential characteristic (e.g., containmentfailure mode, physical phenomena) of asignificant accident progression sequence,and if not modeled would lead to theomission of the sequence; for example,not modeling hydrogen detonation in anice condenser plant would result in asignificant LERF sequence not beingmodeled.OtherDefinitions-----------------No objection----------------------------
Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005Index NoIssuePositionResolutionAppendix A to DG-1161, Page A-4Chapter 33.1 - 3.4-----------------No objection----------------------------3.5Use of the word "significant"should match definitionsprovided in Section 2.2.Clarification2 nd paragraph
:If the PRA does not satisfy a SR for theappropriate Capability Category, then determine if the difference is relevant orsignificant-. Acceptable requirements fordetermining the significance of thisdifference differences include thefollowing:(a) The difference is not relevant if it is notapplicable or does not affect thequantification-.
(b) The difference is not significant if the m Modeled accident sequences accountingfor at least 90% of CDF/LERF, asapplicable-.These determinations Determination ofsignificance will depend-.If the difference is not relevant orsignificant, then the PRA is acceptable for the application. If the difference is relevant or significant, then-.3.6Use of the word "safety" is notneeded.ClarificationSecond example of supplementaryrequirements
:It is desired to rank the snubbers in a plantaccording to their risk significance for-snubbers are considered safety-related, -the safety significance of snubbers can beapproximated by the safety significance ofthe components that they support for theevents in which the snubbers are safetysignificant and - to rank the safetyimportance of the snubbers.
Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005Index NoIssuePositionResolutionAppendix A to DG-1161, Page A-5Chapter 44.1,4.2-----------------No objection----------------------------4.34.3.1, 4.3.2-----------------No objection----------------------------4.3.3The use of the word "should"does not provide a minimumrequirement.Clarification-The PRA analysis team shall should useoutside experts, even when-.4.3.4 thru4.3.7-----------------No objection---------------------------4.4,4.5-----------------No objection----------------------------4.5.1 - IE4.5.1.1-----------------No objection----------------------------Table 4.5.1-1-----------------No objection----------------------------Tables 4.5.1-2(a) thru 4.5.1-2(d)IE-A1 thruIE-A3a-----------------No objection----------------------------IE-A4The search for initiators shouldgo down to the subsystem/trainlevel.Capability Category III shouldconsider the use of "othersystematic processes."ClarificationCat I and II
:PERFORM a systematic evaluation of each system down to the subsystem/train level
,including support systems-.Cat III:PERFORM a systematic evaluation of eachsystem down to the subsystem/train level
,including support systems-.PERFORM an FMEA (failure modes and effects analysis) or other systematicprocess to assess-.IE-A4aInitiating events from commoncause or from both routine andnon-routine system alignmentsshould be considered.ClarificationCat II and III
:-resulting from multiple failures, if theequipment failures result from a commoncause, and from routine and non-routine(e.g., temporary alignments during maintenance) system alignments.
Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005Index NoIssuePositionResolutionAppendix A to DG-1161, Page A-6IE-A5 thru IE-A10-----------------No objection----------------------------IE-B1 thru IE-B2-----------------No objection--------------------------IE-B3The action verb AVOID isambiguous.ClarificationCat II
:AVOID subsuming DO NOT SUBSUMEscenarios into a group-.IE-B4 thruIE-B5-----------------No objection--------------------------IE-C1 thruIE-C9-----------------No objection--------------------------IE-C10Providing a list of generic datasources would be consistentwith other SRs related to data.ClarificationCOMPARE results and EXPLAINdifferences in the initiating event analysiswith generic data sources to provide areasonable check of the results.Pertinent generic data sources includeNUREG/CR-5750 [Note (1)].IE-C11Definitions of rare andextremely rare events can bedeleted from this SR since theyhave been added to Chapter 2.How plant-specific features areincluded in the use of genericdata for establishing rare eventfrequencies requiresclarification.ClarificationCC I and II
:For rare initiating events, USE industrygeneric data and INCLUDE plant-specificfunctions features in deciding whichgeneric data is most applicable
.IE-C12The size of relief valves is animportant consideration whenevaluating ISLOCAs.ClarificationCC I and II
:(a) configuration of potential pathwaysincluding numbers and types of valuesvalves and their relevant failure modes, andthe existence, size, and positioning of reliefvalvesIE-C13-----------------No objection--------------------------
Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005Index NoIssuePositionResolutionAppendix A to DG-1161, Page A-7Footnote 3 toTable 4.5.1-2(c)The first example makes anassumption that the hourlyfailure rate is applicable for alloperating conditions.Clarification-Thus, fbus at power = 1x10-7/hr
* 8760 hrs/yr *0.90 =7.9x10-4/reactor year.In the above example, it is assumed thebus failure rate is applicable for at-powerconditions. It should be noted thatinitiating event frequencies may bevariable from one operating state toanother due to various factors. In suchcases, the contribution from eventsoccurring only during at-powerconditions should be utilized.IE-D1 thruIE-D3-----------------No objection----------------------------4.5.2 - AS4.5.2.1The  and associated SRsare written for CDF and notLERF; therefore, references toLERF are not appropriate.Clarification4.5.2.1 Objectives. The objectives-reflected in the assessment of CDF andLERF is such a way that-.Table 4.5.2-1-----------------No objection---------------------------
Tables 4.5.2-2(a) thru 4.5.2-2(c)AS-A1 thruAS-A8-----------------No objection----------------------------AS-A9The code requirements foracceptability need to be stated.ClarificationCat II and III
:-affect the operability of the mitigatingsystems.  (See SC-B4.)AS-A10The modifier "significant" doesnot have a clear definition. Examples provide a clearunderstanding.ClarificationCat II
:-INCLUDE for each modeled initiatingevent, sufficient detail that significantdifferences in requirements on systems andrequired operator responses interactions(e.g., systems initiations or valvealignments) are captured.AS-A11-----------------No objection----------------------------AS-B1 thruAS-B6-----------------No objection----------------------------AS-C1 thruAS-C3-----------------No objection----------------------------
Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005Index NoIssuePositionResolutionAppendix A to DG-1161, Page A-84.5.3 - SC4.5.3.1The HLR and associated SRsare written for CDF and notLERF; therefore, references toLERF are not appropriate.Clarification(a) overall success criteria are defined (i.e.,core damage and large early release
)Table 4.5.3-1-----------------No objection----------------------------Tables 4.5.3-2(a) thru 4.5.3-2(c)SC-A1,SC-A2-----------------Note:  SC-A3 was deleted inAddendum B.No objection----------------------------SC-A4 thruSC-A6-----------------No objection----------------------------SC-B1Requirements concerning theuse of thermal/hydraulic codesshould be cross-referenced.ClarificationCat II and III
:-for thermal/hydraulic, -requiring detailed computer modeling.  (See SC-B4.) -.SC-B2 thruSC-B5-----------------No objection----------------------------SC-C1 thruSC-C3-----------------No objection----------------------------4.5.4 - SY4.5.4.1-----------------No objection----------------------------Table 4.5.4-1-----------------No objection----------------------------Tables 4.5.4-2(a) thru 4.5.4-2(c)SY-A1 thruSY-A21-----------------No objection----------------------------SY-A22There are no commonly usedanalysis methods for recoveryin the sense of repair, otherthan use of actuarial data.Clarification-is justified through an adequate analysisor examination of data collected inaccordance with DA-C14 and estimatedin accordance with DA-D8. (See DA-C14.)SY-B1 thruSY-B8-----------------Note:  SY-B9 was deleted inAddendum BNo objection----------------------------
Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005Index NoIssuePositionResolutionAppendix A to DG-1161, Page A-9SY-B10References wrong SR.Clarification-required mission time (see also A SY-A6).Examples of support systems include:SY-B11 thruSY-B14-----------------No objection----------------------------SY-B15Containment vent and failurecan cause more than NPSHproblems (e.g., harshenvironments).ClarificationExamples of degraded environments include:(h) harsh environments induced bycontainment venting or failureSY-B16-----------------No objection----------------------------SY-C1 thruSY-C3-----------------No objection----------------------------4.5.5 - HR4.5.5.1-----------------No objection----------------------------Table 4.5.5-1-----------------No objection----------------------------Tables 4.5.5-2(a) thru 4.5.5-2(I)HR-A1Inspection may implicitly beincluded using 'test andmaintenance', but explicit useof inspection term mayeliminate interpretation errors(e.g., inspection may requireactions to gain access toequipment, which couldinadvertently cause a pre-initiator problem).ClarificationFor equipment modeled in the PRA,IDENTIFY, through a review of proceduresand practices, those test and maintenance(including inspection) activities that requirerealignment of equipment outside its normaloperational or standby status.HR-A2,HR-A3-----------------No objection----------------------------HR-B1, HR-B2-----------------No objection----------------------------HR-C1 thruHR-C3-----------------No objection----------------------------HR-D1,HR-D2-----------------No objection----------------------------
Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005Index NoIssuePositionResolutionAppendix A to DG-1161, Page A-10HR-D3Add examples for what ismeant by quality in items (a)and (b) of Cat II, III.ClarificationCat II,III(a) the quality (including format, logicalstructure, ease of use, potential forconfusion, and comprehensiveness) ofwritten procedures and the quality (e.g.,configuration control, technical review process, training processes, andmanagement emphasis on adherence toprocedures) of administrative controls (forindependent review)(b) the quality (e.g., adherence to humanfactors guidelines [Note (3)] and results of any quantitative evaluations ofperformance per functionalrequirements) of the human-machineinterface, including both the equipmentconfiguration, and instrumentation andcontrol layoutHR-D4 thruHR-D7-----------------No objection----------------------------Notes toTable 4.5.5-2(d)Additional references cited inclarification to HR-D3.ClarificationNOTES:
-
(3) NUREG-0700, Rev. 2, Human-SystemInterface Design Review Guidelines;J.M. O'Hara, W.S. Brown, P.M. Lewis,and J.J. Persensky, May 2002.HR-E1-----------------No objection----------------------------HR-E2Need to explicitly state theneed for some level ofdiagnosis in identifying thefailure(s).Clarification(b) those actions performed by the controlroom staff either in response to proceduraldirection or as skill-of-the-craft to diagnoseand then recover a failed function, systemor component that is used in the performanceof a response action as identified in HR-H1.HR-E3,HR-E4-----------------No objection----------------------------HR-F1, HR-F2-----------------Clarification----------------------------HR-G1,HR-G2-----------------No objection----------------------------
Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005Index NoIssuePositionResolutionAppendix A to DG-1161, Page A-11HR-G3In item (d) of CC II, III, clarifythat "clarity' refers themeaning of the cues, etc.In item (a) of CC I and item (g)of CC II, III, clarify thatcomplexity refers to bothdetermining the need for andexecuting the requiredresponse.ClarificationCC II, III(d) degree of clarity of the meaning ofcues/indications(g) complexity of determining the need forand executing the required response.HR-G4Requirements concerning theuse of thermal/hydraulic codesshould be cross-referenced.ClarificationCat I, II, and III
:BASE-. (See SC-B4.)  SPECIFY the pointin time-.HR-G5 thruHR-G9-----------------No objection----------------------------HR-H1 thru HR-H3-----------------No objection----------------------------HR-I1 thru HR-I3-----------------No objection ----------------------------4.5.6 - DA4.5.6.1-----------------No objection ----------------------------Table 4.5.6-1-----------------No objection ----------------------------Tables 4.5.6-2(a) thru 4.5.6-2(e)DA-A1 thruDA-A3-----------------No objection----------------------------DA-B1, DA-B2-----------------No objection----------------------------DA-C1The list of data sources needsto be updated.ClarificationExamples of parameter estimates andassociated sources include:(a) component failure rates and probabilities: NUREG/CR-4639 [Note (1)], NUREG/CR-4550 [Note (2)], NUREG-1715 [Note 7]
-See NUREG/CR-6823 [Note 8] for lists ofadditional data sources.DA-C2 thruDA-C13-----------------No objection----------------------------
Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005Index NoIssuePositionResolutionAppendix A to DG-1161, Page A-12DA-C14This SR provides a justificationfor crediting equipment repair(SY-A22). As written, it couldbe interpreted as allowingplant-specific data to bediscounted in favor of industrydata. In reality, for suchcomponents as pumps, plant-specific data is likely to beinsufficient and a broader baseis necessary.Qualification-IDENTIFY instances of plant-specific orand, when that is insufficient to meetrequirement DA-D8, applicable industryexperience and for each repair,COLLECT-.DA-C15-----------------No objection----------------------------Notes toTable 4.5.6-2(c)Additional references cited inthe clarification to DA-C.ClarificationNOTES:
-(7) NUREG-1715, Component performancestudy, 1987-1998, Vols. 1-4.(8) NUREG/CR-6823, Handbook ofParameter Estimation for Probabilistic RiskAssessment, USNRC, September 2003.DA-D1Other approved statisticalprocesses for combining plant-specific and generic data arenot available.ClarificationCC II and III-USE a Bayes update process or equivalentstatistical process that assigns that assignsappropriate weight to the statisticalsignificance of the generic and plant specificevidence and provides an appropriatecharacterization of the uncertainty. CHOOSE-.DA-D2 thruDA-D5-----------------No objection----------------------------DA-D6 For consistency with Table1.3-1 and DA-D1, the Cat IIIrequirement is to apply to allcommon-cause events.ClarificationCat III
:USE realistic common-cause failureprobabilities- for significant common-cause basic events. An example-.DA-D6a,DA-D7-----------------No objection----------------------------
Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005Index NoIssuePositionResolutionAppendix A to DG-1161, Page A-13DA-D8New requirement needed, DA-C14 was incomplete, onlyprovided for data collection,not quantification of repair. (See SY-A22.)QualificationCat I, II, and III
:For each SSC for which repair is to be modeled, ESTIMATE, based on the datacollected in DA-C14, the probability offailure to repair the SSC in time toprevent core damage as a function of theaccident sequence in which the SSCfailure appears.DA-E1 thruDA-E3-----------------No objection----------------------------4.5.7 - IF4.5.7.1-----------------No objection----------------------------Table 4.5.7-1-----------------No objection----------------------------Tables 4.5.7-2(a) thru 4.5.7-2(f)IF-A1 thru IF-A4-----------------No objection----------------------------IF-B1The list of fluid systems shouldbe expanded to include fireprotection systems.ClarificationFor each flood area-. INCLUDE:(a) equipment (e.g., piping, valves, pumps)located in the area that are connected to fluidsystems (e.g., circulating water system, service water system, -fire protectionsystem-.IF-B1a thruIF-B2-----------------No objection----------------------------IF-B3It is necessary to consider arange of flow rates foridentified flooding sources,each having a unique frequencyof occurrence. For example,small leaks that only causespray are more likely than largeleaks that may cause equipmentsubmergence.Clarification(b) range of flow rate s of waterIF-B3a-----------------Note:  IF-B4 was deleted inAddendum BNo objection----------------------------
Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005Index NoIssuePositionResolutionAppendix A to DG-1161, Page A-14IF-C1For a given flood source, theremay be multiple propagationpaths and areas ofaccumulation.ClarificationFor each defined flood area and each floodsource, IDENTIFY the propagation path sfrom the flood source area to the area s ofaccumulation.IF-C2 thruIF-C2b-----------------No objection----------------------------IF-C2cThere is circular logic betweenthis SR and IF-C5. This SRrequires identifying SSCs forflood areas not screened out inIF-C5. A listed reason forscreening a flood area in IF-C5is that it does not containSSCs.ClarificationFor each flood area not screened out usingthe requirements under other InternalFlooding supporting requirements (e.g., IF-B1b and IFC5),-.IF-C3For Cat II, it is not acceptableto just note that a flood-induced failure mechanism isnot included in the scope of theinternal flooding analysis. Some level of assessment isrequired.QualificationCat I
:INCLUDE failure by submergence andspray in the identification process.EITHER:
(a) ASSESS- by using conservativeassumptions; OR(b) NOTE that these mechanisms are notincluded in the scope of the evaluation.Cat II:INCLUDE failure by submergence andspray in the identification process.ASSESS qualitatively the impact of flood-induced mechanisms that are notformally addressed (e.g., using themechanisms listed under CapabilityCategory III of this requirement), byusing conservative assumptions.IF-C3a-----------------No objection----------------------------IF-C3bBoth a Capability Category IIand III PRA should include thepotential for maintenance-induced unavailability ofbarriers.QualificationCat II, III
:IDENTIFY inter-area-.INCLUDE potential for structural failure(e.g., of doors or walls) due to flooding loads and the potential for barrierunavailability, including maintenanceactivities
.
Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005Index NoIssuePositionResolutionAppendix A to DG-1161, Page A-15IF-C3c thruIF-C9-----------------No objection----------------------------IF-D1IF-D1 incorrectly referencesTable 4.5.7-1 when it shouldcite Table 4.5.1-2(b).Note that IF-D2 was deleted inAddendum B.Clarification-IDENTIFY the corresponding plantinitiating event group identified per Table4.5.7-1 4.5.1-2(b)
-.IF-D3The action verb AVOID isambiguous.ClarificationCat II
:AVOID subsuming DO NOT SUBSUMEscenarios into a group-.IF-D3a thruIF-D7-----------------No objection----------------------------IF-E1 thruIF-E6-----------------No objection----------------------------IF-E6aThis supporting requirementshould indicate the need toadjust the definition ofcommon-cause failure groupswhile doing the internalflooding analysis.ClarificationINCLUDE, in the quantification,-unavailability due to maintenance, common-cause failures (adjusted, if necessary, toaccount for the internal flooding modeling),and other credible causes.IF-E6b thruIF-E8-----------------No objection----------------------------IF-F1 thruIF-F3-----------------No objection----------------------------4.5.8 - QU4.5.8.1SRs for LERF quantificationreference the SRs in 4.5.8, andtherefore, need to beacknowledged in 4.5.8.ClarificationThe objectives of the quantification elementare to provide an estimate of CDF (andsupport the quantification of LERF)based upon the plant-specific-.(b) significant contributors to CDF (andLERF) are identified such as initiatingevents-.Table 4.5.8-1HLR-QU-AthruHLR-QU-C-----------------No objection----------------------------
Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005Index NoIssuePositionResolutionAppendix A to DG-1161, Page A-16Table 4.5.8-1HLR-QU-DSRs for LERF quantificationreference the SRs in 4.5.8 and,therefore, need to beacknowledged in 4.5.8.Clarification-significant contributors to CDF (andLERF), such as initiating events, accidentsequences-.Table 4.5.8-1HLR-QU-E,HLR-QU-F-----------------No objection----------------------------Tables 4.5.8-2(a) thru 4.5.8-2(f)QU-A1,QU-A2a-----------------No objection----------------------------QU-A2bThe state-of-knowledgecorrelation should beaccounted for all eventprobabilities.ClarificationESTIMATE the mean CDF from internalevents, accounting for the "state-of-knowledge" correlation between eventprobabilities when significant (see NOTE 1).QU-A3, QU-A4-----------------No objection----------------------------QU-B1 thruQU-B9-----------------No objection----------------------------QU-C1 thruQU-C3-----------------No objection----------------------------Table 4.5.8-2(d)HLR-QU-D and Table 4.5.8-2(d) objective statement justbefore table need to agree; SRsfor LERF quantificationreference the SRs in 4.5.8 and,therefore, need to beacknowledged in 4.5.8.Clarification-significant contributors to CDF (andLERF), such as initiating events, accidentsequences-.QU-D1a thruQU-D5b-----------------No objection----------------------------QU-E1 thruQU-E3-----------------No objection----------------------------QU-E4Understanding of the keymodel uncertainties andassumptions is an essentialaspect of uncertainty analysis.ClarificationCat I
:PROVIDE an assessment of the impact ofthe key model uncertainties andassumptions on the results of the PRA.QU-F1-----------------No objection----------------------------QU-F2SR needs to use defined term"significant" instead of"dominant."Clarification (g) the significant basic events equipmentor human actions that are the key factors incausing the accidents sequences to be non-dominant non-significant.
Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005Index NoIssuePositionResolutionAppendix A to DG-1161, Page A-17QU-F3 thruQU-F6-----------------No objection----------------------------4.5.9 - LE4.5.9.1-----------------No objection----------------------------Table 4.5.9-1-----------------No objection----------------------------Tables 4.5.9-2(a) thru 4.5.9-2(g)LE-A1 thruLE-A5-----------------No objection----------------------------LE-B1 thruLE-B3-----------------No objection----------------------------LE-C1The SR for CapabilityCategory II contains thestatement:  "NUREG/CR-6595,Appendix A provides anacceptable definition of LERFsource terms."  In fact, theappendix contains threepossible definitions of LERF.ClarificationNUREG/CR-6595, Appendix A provides adiscussion and examples an acceptabledefinition of LERF source terms.LE-C2a thruLE-C10-----------------No objection----------------------------LE-D1 thruLE-D6-----------------No objection----------------------------LE-E1 thruLE-E4-----------------No objection----------------------------LE-F1a thruLE-F3-----------------No objection----------------------------LE-G1 thruLE-G6-----------------No objection----------------------------Chapter 55.1-----------------No objection----------------------------5.2-----------------No objection----------------------------5.3-----------------No objection----------------------------5.4See the issue discussed ondefinition of "Accidentsequence, dominant."Clarification2 nd para:  -Changes that would impact risk-informed decisions should be prioritized toensure that the most significant changes areincorporated as soon as practical.
Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005Index NoIssuePositionResolutionAppendix A to DG-1161, Page A-185.5, 5.6-----------------No objection----------------------------5.7-----------------No objection----------------------------5.8 (a)-(d)-----------------No objection----------------------------5.8 (e)It is unclear what is to bedocumented from the peerreview.Clarification"(e) record of the performance and results ofthe appropriated PRA reviews (consistentwith the requirements of Section 6.6)
"5.8 (f), 5.8(g)-----------------No objection----------------------------
Chapter 66.1The purpose, as written,implies that it is solely an auditagainst the requirements ofSection 4. A key objective ofthe peer review is to ensurewhen evaluating the PRAagainst the requirements inSection 4, the "quality" (i.e.,strengths and weaknesses) ofthe PRA; this goal is to beclearly understood by the peerreview team.See the issue discussed ondefinition of "Accidentsequence, dominant."Clarification"-The peer review shall assess the PRA tothe extent necessary to determine if themethodology and its implementation meetthe requirements of this Standard todetermine the strengths and weaknesses in the PRA. Therefore, the peer review shallalso assess the appropriateness of the keyassumptions. The peer review need notassess-."6.1.1-----------------No objection----------------------------6.1.2-----------------No objection----------------------------6.26.2.1, 6.2.2,6.2.3-----------------No objection----------------------------
Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005Index NoIssuePositionResolutionAppendix A to DG-1161, Page A-196.3As written, there does notappear to be a minimum set. The requirement as writtenprovides "suggestions."  Aminimal set of items is to beprovided; the peer reviewershave flexibility in deciding onthe scope and level of detail foreach of the minimal items.Clarification "The peer review team shall use therequirements- of this Standard. For eachPRA element, a set of review topicsrequired for the peer review team areprovided in the subparagraphs of para.6.3. Some subparagraphs of para. 6.3contain specific suggestions for the reviewteam to consider during the review.
Additional material for those Elements maybe reviewed depending on the resultsobtained. These suggestions are notintended to be a minimum or comprehensivelist of requirements. The judgment of thereviewer shall be used to determine thespecific scope and depth of the review ineach of each review topic for each PRAelement."6.3.1 thru6.3.9-----------------No objection----------------------------6.3.9.1-----------------No objection----------------------------6.3.9.2See the issue discussed ondefinition of "Accidentsequence, dominant."Clarification(I) the containment response calculations,performed specifically for the PRA, for thedominant significant plant damage states6.4-----------------No objection----------------------------6.5-----------------No objection----------------------------6.66.6.1As written, it is not clearwhether certain essential itemsare included in thedocumentation requirementsthat are necessary toaccomplish the goal of the peerreview.Clarification"(I) identification of the strengths andweaknesses that have a significant impact onthe PRA (k) assessment of the key assumptions (l) an assessment of the capabilitycategory of the SRs (or equivalent PeerReview grade)"6.6.2-----------------No objection----------------------------
Appendix B to DG-1161, Page B-1APPENDIX BNRC POSITION ON THE NEI PEER REVIEW PROCESS (NEI-00-02)IntroductionThe Nuclear Energy Institute (NEI) Peer Review Process is documented in NEI 00-02, Revision 1. It provides guidance for the peer review of probabilistic risk assessments (PRAs) and the grading of the PRA subelements into one of four capability categories. This document includes the NEI subtier criteria for assigning a grade to each PRA subelement. The NEI subtier criteria for a Grade 3 PRA have been compared by NEI to the requirements in the American Society of Mechanical Engineers (ASME) PRA Standard (ASME RA-Sb-2005) listed for a Capability Category II PRA. A comparison of the criteria forother grades/categories of PRAs was not performed since NEI contends that the results of the peer review process generally indicate the reviewed PRAs are consistent with the Grade 3 criteria in NEI 00-02.
However, the PRAs reviewed have contained a number of Grade 2, and even Grade 4 elements. The comparison of the NEI subtier criteria with the ASME PRA Standard has indicated that some of the Capability Category II ASME PRA Standard requirements are not addressed in the NEI Grade 3 PRA subtier criteria. Thus, NEI has provided guidance to the licensees to perform a self-assessment of their PRAs against the criteria in the ASME PRA Standard that were not addressed during the NEI peer review of their PRA. A self-assessment is likely to be performed in support of risk-informed applications. This self-assessment guidance is also included in NEI 00-02, Revision 1.This appendix provides the staff's position on the NEI Peer Review Process (i.e., NEI 00-02), theproposed self-assessment process, and the self-assessment actions. The staff's positions are categorized as following:
*No objection. The staff has no objection to the requirement.
*No objection with clarification. The staff has no objection to the requirement. However,certain requirements, as written, are either unclear or ambiguous, and therefore the staff has provided its understanding of these requirements.
*No objection subject to the following qualification. The staff has a technical concern with therequirement and has provided a qualification to resolve the concern.In the proposed staff resolution, the staff clarification or qualification that is needed for the staffto have no objection are provided.NRC Position on NEI 00-02Table B-1 provides the NRC position on the NEI Peer Review Process documented in NEI 00-02,Revision 1. The stated positions are based on the historical use of NEI 00-02 and on the performance of a self-assessment to address those requirements in the ASME PRA Standard and Addenda A and B (ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005) that are not included in the NEI subtier criteria.
Appendix B to DG-1161, Page B-2Table B-1. NRC Regulatory Position on NEI 00-02ReportSectionRegulatoryPositionCommentary/ResolutionSection 1. INTRODUCTION1.1 Overviewand PurposeClarificationThe NEI process uses "a set of checklists as a framework within which toevaluate the scope, comprehensiveness, completeness, and fidelity of the PRAbeing reviewed."  The checklists by themselves are insufficient to provide thebasis for a peer review since they do not provide the criteria that differentiatethe different grades of PRA. The NEI subtier criteria provide a means todifferentiate between grades of PRA.The ASME PRA Standard (with the staff's position provided in Appendix Ato this regulatory guide) can provide an adequate basis for a peer review of anat-power, internal events PRA (including internal flooding) that would beacceptable to the staff. Since the NEI subtier criteria do not address all of therequirements in the ASME PRA Standard, the staff's position is that a peerreview based on these criteria is incomplete. The PRA standard requirementsthat are not included in the NEI subtier criteria (identified for a Grade 3 PRAin Table B-3) need to be addressed in the NEI self-assessment process asendorsed by the staff in this appendix.1.1 ScopeClarificationThis section states that the NEI peer review process is a one-time evaluationprocess but indicates that additional peer review may be required if substantialchanges are made to the PRA models or methodology. The staff position onadditional peer reviews is to follow the guidance in Section 5 of the ASMEPRA Standard which requires a peer review for PRA upgrades (PRAmethodology changes).1.2 HistoricalPerspectiveNo objection-------------------------------------1.3 ProcessClarificationFigure 1-3 indicates in several locations that the checklists included in NEI00-02 are used in the peer review process. As indicated in the comment onSection 1.1 of NEI 00-02, the staff's position is that a peer review based onthe checklists and supplemental subtier criteria is incomplete. The NEI self-assessment process, as endorsed by the staff in this appendix, is needed.1.4 PRA PeerReviewCriteria andGradesClarificationThe NEI peer review process provides a summary grade for each PRAelement. The use of a PRA for risk-informed applications needs to bedetermined at the subelement level. The staff does not agree with the use ofan overall PRA element grade in the assessment of a PRA.ClarificationThis section indicates that "the process requires that the existing PRA meet theprocess criteria or that enhancements necessary to meet the criteria have beenspecifically identified by the peer reviewers and committed to by the hostutility."  Thus, the assigned grade for a subelement can be contingent on theutility performing the prescribed enhancement. An application submittal thatutilizes the NEI peer review results needs to identify any of the prescribedenhancements that were not performed.
Table B-1. NRC Regulatory Position on NEI 00-02ReportSectionRegulatoryPositionCommentary/ResolutionAppendix B to DG-1161, Page B-3ClarificationThe staff believes that the use of PRA in a specific application should be ofsufficient quality to support its use by the decision-makers for that application. The NEI peer review process does not require the documentation of the basisfor assigning a grade for each specific subtier criterion. However, the staffposition is that assignment of a grade for a specific PRA subelement impliesthat all of the requirements listed in the NEI subtier criteria have been met.1.5No Objection-------------------------------------Section 2. PEER REVIEW PROCESS2.1 ObjectivesClarificationSee comment for Section 1.1.2.2 ProcessDescriptionClarificationThe ASME PRA Standard (with the staff's position provided in Appendix Ato this regulatory guide) can provide an adequate basis for a peer review of anat-power, internal events PRA (including internal flooding) that would beacceptable to the staff. Since the NEI subtier criteria do not address all of therequirements in the ASME PRA Standard, the staff's position is that a peerreview based on these criteria is incomplete. The PRA standard requirementsthat are not included in the NEI subtier criteria (identified for a Grade 3 PRAin Table B-3) need to be addressed in the NEI self-assessment process asendorsed by the staff in this appendix.Steps 4, 7, & 8ClarificationSee previous comment.2.3 PRA PeerReview TeamClarificationThe peer reviewer qualifications do not appear to be consistent with thefollowing requirements specified in Section 6.2 of the ASME PRA Standard:*the need for familiarity with the plant design and operation *the need for each person to have knowledge of the specific areas theyreview*the need for each person to have knowledge of the specific methods, codes,and approaches used in the PRAThe NEI self-assessment process needs to address the peer reviewerqualifications with regard to these factors.2.4 and 2.5No objection Table B-1. NRC Regulatory Position on NEI 00-02ReportSectionRegulatoryPositionCommentary/ResolutionAppendix B to DG-1161, Page B-4Section 3. PRA PEER REVIEW PROCESS ELEMENTS AND GUIDANCE3.1No objection-------------------------------------
3.2 Criteriaand3.3 GradingClarificationSee comment for Section 1.1.3.3 GradingClarificationThe NEI peer review process grades each PRA element from 1 to 4, while theASME PRA Standard uses Capability Categories I, II, and III. The staffinterpretation of Grades 2, 3, and 4 is that, they correspond broadly toCapability Categories I, II, and III respectively. This statement is not meant toimply that the supporting requirements, for example, for Category I areequally addressed by Grade 2 of NEI-00-02. The review of the supportingrequirement for Category II against Grade 3 of NEI-00-02 indicateddiscrepancies and consequently the need for a self-assessment. The existenceof these discrepancies would indicate that it would not be appropriate toassume that there are not discrepancies between Category I and Grade 2. Acomparison between the other grades and categories has not been performed. The implications of this are addressed in item 7a on Table B-2.QualificationThe staff believes that different applications of a PRA can require differentPRA subelement grades. The NEI peer review process is performed at thesubelement level and does not provide an overall PRA grade. Therefore, it isinappropriate to suggest an overall PRA grade for the specific applicationslisted in this section. The staff does not agree with the assigned overall PRAgrades provided for the example applications listed in this section of NEI 00-02.3.4 AdditionalGuidance onthe TechnicalElementsReviewClarificationThe general use and interpretation of the checklists in the grading of PRAsubelements is addressed in this section. The subtier criteria provide a moresubstantial documentation of the interpretations of the "criteria" listed in thechecklists. However, as previously indicated, the subtier criteria do not fullyaddress all of the PRA standard requirements. The PRA standardrequirements that are not included in the NEI subtier criteria (identified for aGrade 3 PRA in Table B-3) need to be addressed in the NEI self-assessmentprocess as endorsed by the staff in this appendix.
Table B-1. NRC Regulatory Position on NEI 00-02ReportSectionRegulatoryPositionCommentary/ResolutionAppendix B to DG-1161, Page B-5Section 4. PEER REVIEW PROCESS RESULTS AND DOCUMENTATION4.1 ReportClarificationA primary function of a peer review is to identify those assumptions andmodels that have a significant impact on the results of a PRA and to passjudgment on the validity and appropriateness of the assumptions. The peerreview requirements in the ASME PRA Standard requires analysis of keyassumptions. A review of the NEI 00-02 and the subtier criteria section onquantification and results interpretation failed to identify specific wording inany requirements to review the impact of key assumptions on the results. However, there are requirements to "identify unique or unusual sources ofuncertainty not present in typical or generic plant analyses."  Since theevaluation of the impact of assumptions is critical to the evaluation of a PRAand its potential uses, the NEI peer review process need to address all keyassumptions, not just those that are unique or unusual. The NEI self-assessment process needs to address those assumptions not reviewed in theNEI peer review process.QualificationThe NEI peer review report provides a summary grade for each PRA element. The use of a PRA for risk-informed applications needs to be determined at thesubelement level. The staff does not agree with the use of an overall PRAelement grade in the assessment of a PRA.4.2 and 4.3No objection-------------------------------------
Appendix A. PREPARATION MATERIAL FOR THE PEER TEAM REVIEWA.1 throughA.6No objection-------------------------------------A.7 SensitivityCalculationsClarificationA list of sensitivity calculations that a utility can perform prior to the peerreview is provided. Additional or alternative sensitivities can be identified bythe utility. Sensitivity calculations that address key assumptions that maysignificantly impact the risk-informed applications results need to beconsidered in the NEI self-assessment process.A.8 throughA.10No objection-------------------------------------Appendix B. TECHNICAL ELEMENT CHECKLISTSChecklisttablesNo objectionAs previously stated, the staff position is that the checklists by themselves areinsufficient to provide the basis for a peer review.  (See the comment forSection 1.1.)  Because of this, the staff has not reviewed the contents or theassigned grades in these checklists. However, the staff position on thecomparison of the Grade 3 NEI subtier criteria to the Capability Category IIrequirements in the ASME PRA Standard is documented in Table B-3.
Table B-1. NRC Regulatory Position on NEI 00-02ReportSectionRegulatoryPositionCommentary/Resolution 14The NEI comparison between NEI 00-02 criteria and the ASME requirements utilized the original standard as modifiedby subsequent addenda (A and B).Appendix B to DG-1161, Page B-6Appendix C. GUIDANCE FOR THE PEER REVIEW TEAMC.1 PurposeNo objection-------------------------------------
C.2 PeerReview TeamMode ofOperationNo objection-------------------------------------C.3RecommendedApproach toCompletingthe ReviewClarificationSee comment for Section 4.1.C.4 GradingClarification/QualificationSee the two comments on Section 3.3.C.5 PeerReview TeamGood PracticeListNo objection-------------------------------------C.6 OutputQualificationSee the comments on Section 4.1.C.7 FormsClarificationThe staff does not agree with the use of an overall PRA element grade(documented in Tables C.7-5 & C.7-6) in the assessment of a PRA.NRC Position on the Self-Assessment ProcessThe staff position on the self-assessment process proposed by NEI to address the requirements inthe ASME PRA Standard and Addenda A and B (ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005) that are not included in the NEI subtier criteria are addressed in this section. Both the self-assessment process and the specific actions recommended by NEI to address missing ASME standard requirements are addressed.
14Table B-2 provides the NRC position on the NEI self-assessment process documented inAppendix D1 to NEI 00-02, Revision 1. The staff's position on specific aspects of this process uses the categories provided in Section B.2 of this regulatory guide.
Appendix B to DG-1161, Page B-7Table B-2. NRC Regulatory Position on NEI Self-Assessment ProcessReport SectionRegulatoryPositionCommentary/ResolutionSummaryNo objection-------------------------------------RegulatoryFrameworkNo objection-------------------------------------Industry PRAPeer ReviewProcessClarificationSee the staff comments on the NEI peer review process provided in TableB-1.ASME PRAStandardClarificationSee the staff comments on the ASME PRA Standard and Addenda A andB, provided in Appendix A to this regulatory guide.Comparison ofNEI 00-02 and ASMEStandardClarificationThe NRC position is that the performance of the existing peer reviews assupplemented by the NEI self-assessment process, as clarified inRegulatory Guide 1.200, meets the NRC requirements for a peer review.The staff does not agree or disagree with the number of supportingrequirements of the ASME PRA Standard that are addressed (completelyor partially) in the NEI subtier criteria. The staff's focus is on ensuringthat the self-assessment addresses important aspects of a PRA that arenot explicitly addressed in the NEI subtier criteria.The staff takes exception to the statement that the "Industry has reviewedand compared the technical contents of the peer review process and theASME PRA Standard Addendum B as augmented by NRC comments inRG 1.200."  Since the NRC comments on Addendum B were notpublished at the time NEI 00-02, Revision 1 was generated, this ispremature. The NEI Self-Assessment document should state that the"Industry has reviewed and compared the technical contents of the peerreview process and the ASME PRA Standard (ASME-RA-Sa-2003) asendorsed/modified by the NRC and updated by Addendum B of theASME Standard."ClarificationIt is stated that "-If, - the PRS is upgraded-, new peer reviews maybe required to meet paragraph 5.4 of the ASME standard-. NEI-05-04,"Process for Performing Follow-on PRA Peer Reviews Using the ASMEPRA Standard," provides guidance in this regard. NRC has not endorsedNEI-05-04."  The staff has reviewed NEI-05-04, and the staff's positionis provided in Table B-5 of this appendix.
Table B-2. NRC Regulatory Position on NEI Self-Assessment ProcessReport SectionRegulatoryPositionCommentary/ResolutionAppendix B to DG-1161, Page B-8General Notes for Self-Assessment Process1No objection-------------------------------------
2ClarificationCertain ASME PRA Standard requirements, although not explicitly listedin the NEI subtier criteria, may generally be included as good PRApractice. Credit may be taken for meeting these ASME requirementssubject to confirmation in the self-assessment that the requirements werein fact addressed by the peer review. Table B-4 identifies the ASMEPRA Standard requirements not explicitly addressed in the NEI subtiercriteria that the staff believes needs to be addressed in the NEI self-assessment process.3ClarificationThe staff takes exception to the statement that NEI 00-02 Appendix D2"is a comparison of the peer review process to the ASME PRA StandardAddendum B, as endorsed/modified by NRC in RG 1.200."  Since theNRC comments on Addendum B were not published at the time NEI 00-02, Revision 1 was generated, this statement is incorrect. The NEI Self-Assessment document should state that the "Industry has reviewed andcompared the technical contents of the peer review process and theASME PRA Standard (ASME-RA-Sa-2003) as endorsed/modified by theNRC and updated by Addendum B of the ASME Standard."  The self-assessment process should consider the clarifications and qualificationson Addendum B that will be provided Appendix A to RG 1.200, Rev. 1.Self-AssessmentProcessAttributesNo objection-------------------------------------Overall PeerReview Processand DecisionNo objection------------------------------------------Self-Assessment Process Steps1. thru 6.No objection-------------------------------------------
7.aClarificationFor the PRA subelements assigned a grade other than a Grade 3 in theNEI peer review (i.e., Grade 1, 2, or 4), a self-assessment of those PRAsubelements required for the application against the Capability Categoryrequirements (of the ASME PRA Standard as qualified in Appendix A tothis regulatory guide) determined to be applicable for the applicationneeds to be performed and documented.7.b thru 8.No objection-------------------------------------9.ClarificationThe list of items subject to a self-assessment action and documentationneeds to always include those requirements where "Yes" is listed in the"Addressed by NEI" column and there are actions listed in the "IndustrySelf-Assessment Actions" column.
Table B-2. NRC Regulatory Position on NEI Self-Assessment ProcessReport SectionRegulatoryPositionCommentary/Resolution 15The NEI self-assessment process was revised to address the requirements in Addendum B of the ASME standard.Appendix B to DG-1161, Page B-910. thru 13.No objection-------------------------------------14.ClarificationThe staff's comments on which ASME PRA requirements need to beaddressed in the self-assessment, and on the suggested actions (AppendixD2 to NEI 00-02, Rev. 1) are provided in Table B-3. In addition, thestaff's position on the ASME PRA Standard, as documented in AppendixA to this regulatory guide, needs to be included in the self-assessment ofthe PRA subelements.Tables B-3 and B-4 provide the staff position on the NEI comparison of NEI 00-02 (including thesubtier criteria) to the ASME PRA Standard Addendum B and the self-assessment actions provided in Appendix D2 to NEI 00-02, Revision 1.
15  The staff's position on the ASME PRA Standard (AddendumB) documented in Appendix A to this regulatory guide was considered in the comparison. The review of the NEI comparison and proposed actions was performed under the assumption that all of the requirements in the NEI subtier criteria were treated as mandatory. Thus, the staff position is predicated on the requirement that all of the requirements in the NEI subtier criteria are interpreted as "shall" being required.Table B-3 provides the staff position of the "explanatory" table preceding the comparison andself-assessment actions table provided in Appendix D2. The first two columns are taken directly from the table in Appendix D2.Table B-3. NRC Regulatory Positions on Actions Utilities Need to Take in Self-Assessment ActionsTextUtility ActionsRegulatoryPositionComment/ResolutionYES and NONE inAction columnNoneNo objection-------------------------------------YES andclarificationsincluded in ActioncolumnReview comment. It isbelieved that the PeerReview Process addressedthe requirements. Unless itis suspected that a problemexists, no further action isrequired.ClarificationAs written, no action may be taken,which is in conflict with the actionsspecified in the table providing theindustry self-assessment actions. Itis assumed that the actions providedin that table will be taken.PARTIALTake action(s) specified inComments column.No Objection-------------------------------------NOTake action(s) specified inComments column.No Objection-------------------------------------
Appendix B to DG-1161, Page B-10In Table B-4, the "NEI Assessment" includes, for each supporting requirement in the ASMEstandard (column heading:  ASME SR):*whether NEI's assessment of each SR is addressed in NEI 00-02 (column heading:  Addressed byNEI 00-02)*if it is addressed in NEI 00-02, then where it is addressed is identified (column heading: Applicable NEI 00-02 Elements)*whether NEI recommends any self-assessment by the licensee (column heading:  Industry Self-Assessment Actions)Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsINITIATING EVENTS IE-A1YesIE-7, IE-8, IE-9, IE-10NoneNo objectionIE-A2YesIE-5, IE-7, IE-9, IE-10Confirm that the initiators[including human-inducedinitiators, and steamgenerator tube rupture(PWRs)] were included. This can be done by citingeither peer reviewdocumentation/conclusionsor examples from yourmodel. NEI 00-02 doesnot explicitly mentionhuman-induced initiators;however, in practice, peerreviews have addressedthis.No objection; the definition ofactive component provided inthe Addendum B of the ASMEstandard needs to be usedwhen verifying ISLOCAs weremodeled; 1E-7 is theapplicable NEI 00-02 element.IE-A3YesIE-8, IE-9NoneNo objection; IE-8 is theapplicable NEI 00-02 element.IE-A3a(1)YesIE-8, IE-9NoneNo objection; IE-8 is theapplicable NEI 00-02 element.IE-A4PartialIE-5, IE-7, IE-9, IE-10Check for initiating eventsthat can be caused by atrain failure or a systemfailure.No objection; IE-10 is theapplicable NEI 00-02 element.
Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-11IE-A4a(1)PartialIE-5, IE-7, IE-9, IE-10Check for initiating eventsthat can be caused bymultiple failures, if theequipment failures resultfrom a common cause orfrom routine systemalignments.No objectionIE-A5YesIE-8Confirm requirement met. Identification of low-powerand shutdown events notexplicitly addressed in NEI00-02, but in practice, thepeer reviews haveaddressed events resultingin a controlled shutdownthat include a scram priorto reaching low power.No objectionIE-A6YesIE-16Confirm requirement met. Specifying plant operations(etc.) review andparticipation is notexplicitly addressed in NEI00-02, but in practice, thepeer reviews haveaddressed the need forexamination of plantexperience (e.g., LERs),and input fromknowledgeable plantpersonnel. Interviewsconducted at similar plantsare not acceptable.No objection with clarification: IE-16 does not address thisissue.IE-A7YesIE-16, IE-10NoneNo objection; IE-10 is theapplicable NEI 00-02 element.IE-A8Deleted fromASME PRAStandard------IE-A9Deleted fromASME PRAStandard------IE-A10YesIE-6NoneNo objectionIE-B1YesAS-4, IE-4NoneNo objectionIE-B2YesIE-4, IE-7NoneNo objectionIE-B3YesIE-4, IE-12Confirm that the groupingdoes not impact significantaccident sequences.No objectionIE-B4YesIE-4NoneNo objectionIE-B5(3)YesIE-6NoneNo objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-12IE-C1YesIE-13, IE-15,IE-16, IE-17NoneNo objection; IE-16 is theapplicable NEI 00-02 element.IE-C1a(1)YesIE-13, IE-15,IE-16, IE-17NoneNo objection; IE-16 is theapplicable NEI 00-02 element.IE-C1b(1)YesIE-13, IE-15,IE-16, IE-17Justify recovery credit asevidenced by procedures ortraining.No objectionIE-C2YesIE-13, IE-16Justify informative priorsused in Bayesian update.No objection IE-C3NoDocument that the ASMEstandard requirements weremet. NEI 00-02 does notaddress this supportingrequirement.No objectionIE-C4NoDocument that the ASMEstandard requirements weremet. Specific screeningcriteria were not used inNEI 00-02, but bases forscreening of events wereexamined in the peerreviews. The text of theASME standard needs tobe assessed.No objection; acceptablecriteria for dismissing IEs arelisted in IE-C4 in the ASMEPRA Standard.IE-C5Norequirementfor Category IIN/ANo objection; the ASME PRAStandard only requires timetrend analysis for a CategoryIII PRA.IE-C6YesIE-15, IE-17Check that fault treeanalysis, when used toquantify IEs, meets theappropriate systemsanalysis requirements.No objectionIE-C7NoDocument that the ASMEstandard requirements weremet. NEI 00-02 does notaddress this supportingrequirement.No objectionIE-C8NoDocument that the ASMEstandard requirements weremet. NEI 00-02 does notaddress this supportingrequirement.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-13IE-C9YesIE-15, IE-16Check that the recoveryevents included in the IEfault trees meet theappropriate recoveryanalysis requirements. This can be done by citingeither peer review F&Os orexamples from your model.No objection with clarification: -This can be done by citingeither peer review documentation/conclusionsor examples from your model.IE-C10YesIE-13NoneNo objectionIE-C11YesIE-12, IE-13,IE-15Check that the expertelicitation requirements inthe ASME PRA Standardwere used when expertjudgment was applied toquantifying extremely rareevents.No objection; IE-15 is theapplicable NEI 00-02 element.IE-C12YesIE-14Confirm that secondarypipe system capability andisolation capability underhigh flow or differentialpressures are included.No objectionIE-C13(3)NoNoneConfirm IE-C13 is met.No objectionIE-D1PartialIE-9, IE-18, IE-19, IE-20Action is to confirmavailability ofdocumentation. In general,specified documentationitems not explicitlyaddressed in NEI 00-02checklists were addressedby the peer review teams. If not available,documentation may need tobe generated to supportparticular applications orrespond to NRC requestsfor additional information(RAIs) regardingapplications.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-14IE-D2PartialIE-9, IE-18, IE-19, IE-20Action is to confirmavailability ofdocumentation. In general,specified documentationitems not explicitlyaddressed in NEI 00-02checklists were addressedby the peer review teams. If not available,documentation may need tobe generated to supportparticular applications orrespond to NRC RAIsregarding applications.No objectionIE-D3PartialQU-27, QU-28,QU-29, QU-34Confirm that the keyassumptions and keysources of uncertaintyconsistent with thedefinitions of the ASMEPRA Standard aredocumented.No objectionIE-D4Deleted fromASME PRAStandard------ACCIDENT SEQUENCE ANALYSISAS-A1YesAS-4, AS-8NoneNo objectionAS-A2YesAS-6, AS-7,AS-8, AS-9,AS-17NoneNo objection; AS-6 is theapplicable NEI 00-02 element.AS-A3YesAS-7, SY-17,AS-17NoneNo objection; AS-17 is theapplicable NEI 00-02 element.AS-A4YesAS-19, SY-5NoneNo objection; AS-19 is theapplicable NEI 00-02 element.AS-A5YesAS-5, AS-18,AS-19, SY-5NoneNo objectionAS-A6YesAS-8, AS-13,AS-4NoneNo objectionAS-A7YesAS-4, AS-5,AS-6, AS-7,AS-8, AS-9NoneNo objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-15AS-A8PartialAS-20, AS-21,AS-22, AS-23Since there is no explicitrequirement for steadystate condition for end statein NEI 00-02 checklists,this should be evaluatedeven though this was anidentified issue in somereviews. This can also bedone by citing either peerreviewdocumentation/conclusionsor examples from yourmodel. Refer to SC-A5.No objectionAS-A9YesAS-18, TH-4Verify AS-A9 is met. Notethat AS-A9 is related to theenvironmental conditionschallenging the equipmentduring the accidentsequence, AS-18 and TH-4are focused on the initialsuccess criteria.No objectionAS-A10YesAS-4, AS-5,AS-6, AS-7,AS-8, AS-9,AS-19, SY-5,SY-8, HR-23NoneNo objection; AS-4 and AS-7are the applicable NEI 00-02elements.AS-A11YesAS-8, AS-10,AS-15, DE-6,AS ChecklistNote 8The guidance in AS-15must be followed. AS-8states that transfers may betreated quantitatively orqualitatively while AS-15states that transfersbetween event trees shouldbe explicitly treated in thequantification.No objectionAS-B1YesIE-4, IE-5, IE-10, AS-4, AS-5,AS-6, AS-7,AS-8, AS-9,AS-10, AS-11,DE-5NoneNo objection; AS-4 is theapplicable NEI 00-02 element.AS-B2YesAS-10, AS-11,DE-4, DE-5,DE-6 NoneNo objection; AS-10 and AS-11 are the applicable NEI 00-02 elements.AS-B3YesDE-10, SY-11,TH-8, AS-10NoneNo objection; AS-10 and SY-11 are the applicable NEI 00-02 elements.
Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-16AS-B4YesAS-8, AS-9,AS-10, AS-11Confirm requirement met.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-17AS-B5YesDE-4, DE-5,DE-6, AS-10,AS-11, QU-25NoneNo objection; AS-10, AS-11,DE-6, QU-25 are theapplicable NEI 00-02elements.AS-B5a(1)YesDE-4, DE-5,DE-6, AS-10,AS-11, QU-25Confirm that systemalignments that may affectdependencies amongsystems or functions aremodeled.No objectionAS-B6YesAS-13NoneNo objectionAS-C1(2)YesAS-11, AS-24,AS-25, AS-26NoneNo objectionAS-C2(2)PartialAS-11, AS-24,AS-25, AS-26Action is to confirmavailability ofdocumentation. In general,specified documentationitems not explicitlyaddressed in NEI 00-02checklists were addressedby the peer review teams. If not available,documentation may need tobe generated to supportparticular applications orrespond to NRC RAIsregarding applications.No objection; AS-26 is theapplicable NEI 00-02 element.AS-C3(2)PartialQU-27, QU-28,QU-29, QU-34Confirm that the keyassumptions and keysources of uncertaintyconsistent with thedefinitions of the ASMEPRA Standard aredocumented.No objectionAS-C4Deleted fromASME PRAStandard------
Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-18SUCCESS CRITERIASC-A1YesAS-20, AS-22, ASFOOTNOTE 4NoneNo objectionSC-A2YesTH-4, TH-5,TH-7, AS-22, ASFOOTNOTE 4NoneNo objectionSC-A3Deleted fromASME PRAStandard------SC-A4YesAS-7, AS-17,AS-18, SY-17,TH-9, IE-6,DE-5, SY-8NoneNo objectionSC-A4a(1)YesIE-6, DE-5Confirm that thisrequirement is met. Thiscan be done by citing eitherpeer review documentationconclusions or examplesfrom your model. Although there is noexplicit requirement in NEI00-02 that mitigatingsystems shared betweenunits be identified, inpractice, review teams haveevaluated this.No objection SC-A5PartialAS-21, AS-23,AS-20Ensure mission times areadequately discussed as perthe ASME PRA Standard. Since there are no explicitrequirements for steadystate condition for endstate, refer to the ASMEPRA Standard forrequirements or cite peerreviewdocumentation/conclusionsor examples from yourmodel. Refer to AS-A8.No objectionSC-A6YesAS-5, AS-18,AS-19, TH-4,TH-5, TH-6,TH-8, ST-4,ST-5, ST-7, ST-9, SY-5NoneNo objection; TH-5 is theapplicable NEI 00-02 element.
Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-19SC-B1YesAS-18, SY-17,TH-4, TH-6,TH-7NoneNo objectionSC-B2NoTH-4, TH-8NEI 00-02 does notaddress this supportingrequirement. Use theASME standard forrequirements. Refer to SC-C2.No objection SC-B3YesAS-18, TH-4,TH-5, TH-6,TH-7NoneNo objectionSC-B4YesAS-18, TH-4,TH-6, TH-7NoneNo objectionSC-B5YesTH-9, TH-7NoneNo objection; TH-7 is theapplicable NEI 00-02 element.SC-B6Deleted fromASME PRAStandard------SC-C1(2)YesST-13, SY-10,SY-17, SY-27,TH-8, TH-9,TH-10, AS-17,AS-18, AS-24,HR-30NoneNo objectionSC-C2(2)PartialST-13, SY-10,SY-17, SY-27,TH-8, TH-9,TH-10, AS-17,AS-18, AS-24,HR-30Action is to confirmavailability ofdocumentation. In general,specified documentationitems not explicitlyaddressed in NEI 00-02checklists were addressedby the peer review teams. If not available,documentation may need tobe generated to supportparticular applications orrespond to NRC RAIsregarding applications.No objection; TH-9 and TH-10are the applicable NEI 00-02elements.SC-C3(2)PartialQU-27, QU-28,QU-29, QU-34Confirm that the keyassumptions and keysources of uncertaintyconsistent with thedefinitions of the ASMEPRA Standard aredocumented.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-20SC-C4Deleted fromASME PRAStandard------
Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-21SYSTEMS ANALYSISSY-A1YesSY-4, SY-19NoneNo objection; SY-19 is theapplicable NEI 00-02 elementSY-A2YesAS-19, SY-5,SY-13, SY-16NoneNo objection; SY-5 and SY-16are the applicable NEI 00-02elements SY-A3YesSY-5, SY-6,SY-8, SY-12,SY-14None. Although there areno explicit requirements inNEI 00-02 that match SY-A3, performance of thesystems analysis wouldrequire a review of plant-specific informationsourcesNo objectionSY-A4PartialDE-11, SY-10, SYFOOTNOTE 5Confirm that thisrequirement is met. Thiscan be done by citing eitherpeer review results orexample documentation. NEI 00-02 does notaddress interviews withsystem engineers and plantoperators to confirm thatthe model reflects the as-built, as-operated plant.No objectionSY-A5PartialQU-12, QU-13,SY-8, SY-11Confirm this requirement ismet, and that the PRAconsidered both normaland abnormal systemalignments. This can bedone by citing either peerreview results or exampledocumentation. AlthoughNEI 00-02 does notexplicitly address bothnormal and abnormalalignments, their impactsare generally captured inthe peer review of thelisted elements.No objectionSY-A6YesSY-7, SY-8,SY-12, SY-13,SY-14NoneNo objectionSY-A7YesSY-6, SY-7,SY-8, SY-9,SY-19Check for simplifiedsystem modeling asaddressed in SY-A7.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-22SY-A8PartialSY-6, SY-9Check to ensure boundariesare properly established. This can be done by citingeither peer review resultsor example documentation. NEI 00-02 does notaddress componentboundaries except forEDGs. There is no explicitrequirement that addressesmodeling shared portionsof a component boundary. In practice, the peerreviews have examinedconsistency of componentand data analysisboundaries.No objectionSY-A9Deleted fromASME PRAStandard------SY-A10PartialSY-9Action is to determine ifthe requirements of theASME standard are met. NEI 00-02 does notaddress all aspects ofmodularization.No objectionSY-A11YesAS-10, AS-13,AS-16, AS-17,AS-18, SY-12,SY-13, SY-17,SY-23NoneNo objection SY-A12PartialSY-6, SY-7,SY-8, SY-9,SY-12, SY-13,SY-14Document that modeling isconsistent with exclusionsprovided in SY-A14. Consistent with subelementSY-A12 of the ASMEPRA Standard, criticalpassive components whosefailure affects systemoperability should beincluded in system models.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-23 SY-A12a(1)PartialSY-6, SY-7,SY-8, SY-9,SY-12, SY-13,SY-14Document that modeling isconsistent with exclusionsprovided in SY-A12a. Thecriteria in SY-7 states thatpassive components shouldbe included in a Grade 3PRA if they influence theCDF or LERF. Nodefinition of the word influence is provided.No objection with clarification: Delete the sentences:  Thecriteria in SY-7 states thatpassive components should beincluded in a Grade 3 PRA if they influence the CDF orLERF. No definition of the word influence is provided.
SY-A12b(3)PartialSY-15, SY-17Document that modelingincorporates flow diversionfailure modes.No objectionSY-A13YesDA-4, SY-15,SY-16NoneNo objectionSY-A14NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionSY-A15YesSY-8, HR-4,HR-5, HR-7NoneNo objection; SY-8 and HR-4are the applicable NEI 00-02elements.SY-A16YesSY-8, HR-8,HR-9, HR-10NoneNo objection; SY-8 and HR-8are the applicable NEI 00-02elements.
Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-24SY-A17YesAS-13, SY-10,SY-11, SY-13,SY-17None. SY-A17 isevaluated in the NEI 00-02PRA Peer Review asfollows:SY-10Failures or systemtermination (trip) due tospatial or environmentaleffects.SY-11Failure modesinduced by accidentconditions.SY-13SystemTermination (failure ortrip) due to exhaustion ofinventory (water, air).SY-17Success Criteriaevaluation determined byplant-specific analysis thatincludes system trips orisolations on plantparameters.AS-13Failure of systemsdue to time phased effectssuch as loss of batteryvoltage.No objectionSY-A18YesDA-7, SY-8,SY-22NoneNo objection; DA-7 is theapplicable NEI 00-02 element.
SY-A18a(3)NoConfirm this is accountedfor in the PRA. NEI 00-02does not explicitly identifythe criteria for tracking andmodeling of coincidentmaintenance actions thatmay lead to unavailabilityof multiple redundanttrains or systems.No objectionSY-A19YesAS-18, DE-10,SY-11, SY-13,SY-17, TH-8Verify SY-A19 has beenmet. Ensure there is adocumented basis(engineering calculationsare not necessary) formodeling of the conditionsaddressed. NEI 00-02focuses on environmentallimitations.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-25SY-A20PartialAS-19, SY-5,SY-11, SY-13,SY-22, TH-8Document componentcapabilities whereapplicable. NEI 00-02does not explicitly requirea check for creditingcomponents beyond theirdesign basis.No objection; SY-11 is theapplicable NEI 00-02 element.SY-A21YesSY-18None. Comment: Footnote to SY-18 explainslack of Grade provision forthis sub-element.No objection SY-A22YesSY-24, DA-15,QU-18, SY-12NoneNo objection; SY-12 is theapplicable NEI 00-02 element(wording in this element isvague and may not beinterpreted as addressingsupport states).SY-A23Deleted fromASME PRAStandard------SY-B1YesDA-8, DA-14,DE-8, DE-9,SY-8NoneNo objectionSY-B2Not requiredfor CapabilityCategory II NoneNo objectionSY-B3YesDE-8, DE-9,DA-10, DA-12NoneNo objectionSY-B4YesDA-8, DA-10,DA-11, DA-12,DA-13, DA-14,DE-8, DE-9,QU-9, SY-8NoneNo objection; DA-8 is theapplicable NEI 00-02 element.SY-B5YesDE-4, DE-5,DE-6, SY-12, NoneNo objectionSY-B6YesSY-12, SY-13Self-assessment needs toconfirm that the supportsystem success criteriareflect the variability in theconditions that may bepresent during postulatedaccidents.No objectionSY-B7YesAS-18, SY-13,SY-17, TH-7,TH-8NoneNo objectionSY-B8YesDE-11, SY-10NoneNo objection; SY-10 is theapplicable NEI 00-02 element.
Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-26SY-B9Deleted fromASME PRAStandard------SY-B10YesSY-12, SY-13NoneNo objectionSY-B11YesSY-8, SY-12,SY-13Confirm by citing eitherpeer reviewdocumentation/conclusionsor examples from yourmodel. NEI 00-02 doesnot explicitly addresspermissives and controllogic. In practice, the itemsin SY-B11 have generallybeen examined in the peerreviews.No objectionSY-B12YesSY-13NoneNo objectionSY-B13NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionSY-B14PartialDE-6, AS-6Confirm by citing eitherpeer reviewdocumentation/conclusionsor examples from yourmodel. Ensure thatmodeling includessituations where onecomponent can disablemore than one system.No objectionSY-B15YesSY-11NoneNo objectionSY-B16YesSY-8NoneNo objectionSY-C1(2)YesSY-5, SY-6,SY-9, SY-18,SY-23, SY-25,SY-26, SY-27NoneNo objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-27SY-C2(2)PartialSY-5, SY-6,SY-9, SY-18,SY-23, SY-25,SY-26, SY-27Action is to confirmavailability ofdocumentation. In general,specified documentationitems not explicitlyaddressed in NEI 00-02checklists were addressedby the peer review teams. If not available,documentation may need tobe generated to supportparticular applications orrespond to NRC RAIsregarding applications.Comment:  Footnote toSY-18 explains lack ofGrade provision for thissub-element.No objectionSY-C3(2)PartialQU-27, QU-28,QU-29, QU-34Confirm that the keyassumptions and keysources of uncertaintyconsistent with thedefinitions of the ASMEPRA Standard aredocumented.No objection HUMAN RELIABILITY ANALYSISHR-A1YesHR-4, HR-5Determine if analysis hasincluded and documentedfailure to restore equipmentfollowing test ormaintenance.No objectionHR-A2YesHR-4, HR-5NoneNo objectionHR-A3YesDE-7, HR-5NoneNo objectionHR-B1YesHR-5, HR-6NoneNo objection; HR-6 is theapplicable NEI 00-02 element.HR-B2PartialHR-5, HR-6,HR-7, HR-26,DA-5, DA-6 Ensure single actions withmultiple trainconsequences are evaluatedin pre-initiators, since thescreening rules in HR-6 donot preclude screening ofactivities that can affectmultiple trains of a system.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-28HR-C1YesHR-27, SY-8,SY-9NoneNo objectionHR-C2YesHR-7, HR-27,SY-8, SY-9Confirm that thisrequirement is met. Thespecific list of impacts inHR-C2 is not included inNEI 00-02; however, inpractice, the peer reviewers(in reviewing sub-elementsHR-7 and related sub-elements) addressed theseitems.No objectionHR-C3YesHR-5, HR-27,SY-8, SY-9NoneNo objectionHR-D1YesHR-6NoneNo objectionHR-D2YesHR-6NoneNo objectionHR-D3NoAction is to confirm thatHR-D3 is met. This item isimplicitly included in thepeer review of HRA byvirtue of the assessment ofthe crew's ability toimplement the procedure inan effective and controlledmanner. The pre-initiatorHRA adequacy isdetermined reasonable andrepresentative consideringthe procedure quality.No objectionHR-D4PartialHR-6Use the ASME standardfor requirements. NEI 00-02 does not explicitly citethe treatment of recoveryactions for pre-initiators. PRA implementationvaried among utilities withsome using screeningvalues and othersincorporating recovery. The Peer Review teamexamines this treatment.No objectionHR-D5YesDE-7, HR-26,HR-27NoneNo objection; HR-26 is theapplicable NEI 00-02 element.HR-D6NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-29HR-D7Not requiredfor CapabilityCategory IINoneNo objectionHR-E1YesAS-19, HR-9,HR-10, HR-16,SY-5NoneNo objection; the exampleprocess in HR-9 for a Grade 3PRA (i.e., identify thoseoperator actions identified byothers) is not good practice andcontrary to HR-10, which isthe process recommended inHR-E1.HR-E2YesHR-8, HR-9,HR-10, HR-21,HR-22, HR-23,HR-25NoneNo objection (HR-9 and HR-10 do not appear to matchsubject matter but HR-8 does).HR-E3PartialHR-10, HR-14,HR-20The ASME standardsupporting requirementsare to be used during theself-assessment to confirmthat the ASME intent ismet for this requirement. NEI 00-02 does notexplicitly specify the samelevel of detail that isincluded in the ASMEstandard. The peer reviewteam experience is reliedupon to investigate thePRA given generalguidance and criteria.No objectionHR-E4PartialHR-14, HR-16The ASME standardsupporting requirementsare to be used during theself-assessment to confirmthat the ASME intent ismet for this requirement. NEI 00-02 does notexplicitly specify the samelevel of detail that isincluded in the ASMEstandard. The peer reviewteam experience is reliedupon to investigate thePRA given generalguidance and criteria.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-30HR-F1YesAS-19, HR-16,SY-5NoneNo objectionHR-F2PartialAS-19, HR-11,HR-16, HR-17,HR-19, HR-20,SY-5 Determine whether therequirements of the ASMEstandard are met. HR-F2 isgenerally addressed by NEI00-02 and the PRA PeerReview. One additionalitem is highlighted to bechecked. NEI 00-02 doesnot explicitly citeindication for detection andevaluation. However, byinvoking the standard HRAmethodologies thetreatment of cues and otherindications for detectingthe need for action areincluded.No objectionHR-G1YesHR-15, HR-17,HR-18NoneNo objectionHR-G2YesHR-2, HR-11None. NEI 00-02 criteriafor Grade 3 require amethodology that isconsistent with industrypractice. This includes theincorporation of both thecognitive and executionhuman error probabilities(HEPs) in the HEPassessment. HR-11provides further criteria toensure that the cognitiveportion of the HEP uses thecorrect symptoms toformulate the crew'sresponse.No objection withqualification:  Self-assessmentneeds to document if bothcognitive and execution errorsare included in the evaluationof HEPs.
Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-31HR-G3PartialHR-17, HR-18The ASME standardsupporting requirementsare to be used during theself-assessment to confirmthat the ASME intent ismet for this requirement. NEI 00-02 does notexplicitly enumerate thesame level of detail that isincluded in the ASMEstandard. However, byinvoking the standard HRAmethodologies theperformance shape factorsare necessarily evaluated. The peer review teamexperience is relied upon toinvestigate the PRA givengeneral guidance andcriteria.No objectionHR-G4PartialAS-13, HR-18,HR-19, HR-20The ASME standardsupporting requirementsare to be used during theself-assessment to confirmthat the ASME intent ismet for this requirement. NEI 00-02 does notexplicitly cite the necessityto define the time at whichoperators are expected toreceive indications. However, invoking thestandard HRA methodsleads to the necessity forthe analysts to define thisinput to the HRA. Thepeer review teamexperience is relied upon toinvestigate the PRA givengeneral guidance andcriteria.No objection; HR-19 is theapplicable NEI 00-02 element.
Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-32HR-G5PartialHR-16, HR-18,HR-20Evaluate proper inputs perthe ASME standard or citepeer review F&Os orexamples from your model. NEI 00-02 explicitlyaddresses observations andoperations staff input fortime required. ASME PRAStandard requires timemeasurements.No objection with clarification:Action should state "Evaluateproper inputs per the ASMEstandard or cite peer reviewF&Osdocumentation/conclusionsor examples from your model."HR-G6YesHR-12Check to ensure they aremet by citing peer reviewdocumentation/conclusionsor examples from yourmodel. HR-12 does notexplicitly address all theitems of the ASMEstandard list. In practice,peer reviews addressedthese items.No objection.HR-G7PartialDE-7, HR-26Check to see if factors thatare typically assumed tolead to dependence wereincluded (e.g., use ofcommon indications and/orcues to alert control roomstaff to need for action),and a common proceduraldirection that leads to theactions. This can also bedone by citing either peerreviewdocumentation/conclusionsor examples from yourmodel. NEI 00-02 doesnot provide explicit criteriathat address the degree ofdependence between HFEsthat appear in the sameaccident sequence cutset. However, invoking thestandard HRA methodsleads to the necessity forthe analysts to define thisinput to the HRA. Ingeneral, the peer reviewsaddressed this. See alsoQU-C2.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-33HR-G8Not requiredfor CapabilityCategory II---- --HR-G9NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionHR-H1YesHR-21, HR-22,HR-23NoneNo objection with clarification: The self-assessment needs toconfirm that the requirementsin HR-H1 in the ASMEstandard were addressed in theHRA.HR-H2YesHR-22, HR-23NoneNo objection withqualification:  The self-assessment needs to confirmthat all the requirements ofHR-H2 in the ASME standardwere included in the HRA.HR-H3YesHR-26NoneNo objectionHR-I1(2)PartialHR-28, HR-30NoneNo objectionHR-I2(2)PartialHR-28, HR-30Action is to confirmavailability ofdocumentation. In general,specified documentationitems not explicitlyaddressed in NEI 00-02checklists were addressedby the peer review teams. If not available,documentation may need tobe generated to supportparticular applications orrespond to NRC RAIsregarding applications.No objectionHR-I3(2)PartialQU-27, QU-28,QU-29, QU-34Confirm that the keyassumptions and keysources of uncertaintyconsistent with thedefinitions of the ASMEPRA Standard aredocumented.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-34DATA ANALYSISDA-A1YesDA-4, DA-5,DA-15, SY-8,SY-14NoneNo objection DA-A1a(1)NoConfirm that thecomponent boundary isconsistent with the dataapplied.No objectionDA-A2NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionDA-A3YesDA-4, DA-5,DA-6, DA-7,SY-8NoneNo objection withqualification:  The subjectmatter in DA-A3 is notexplicitly addressed in NEI 00-002 (not a critical requirementsince identification of theneeded parameters would be anatural part of the dataanalysis).DA-B1YesDA-5NoneNo objectionDA-B2YesDA-5, DA-6Confirm that thisrequirement is met. NRCcomment:  Groupingcriteria listed in DA-5should be supplementedwith a caution to look forunique components and/oroperating conditions and toavoid grouping them. PeerReview Teams werecareful to assess plant-specific data evaluations toidentify cases where outlierdata values or componentswere not properlyaccounted for.No objectionDA-C1YesDA-4, DA-7,DA-9, DA-19,DA-20NoneNo objectionDA-C2YesDA-4, DA-5,DA-6, DA-7,DA-14, DA-15,DA-19, DA-20,MU-5NoneNo objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-35DA-C3PartialDA-4, DA-5,DA-6, DA-7,MU-5Use the ASME standardfor requirements. NEI 00-02 does not enumerate theitems consideredappropriate in a plant-specific data analysis.No objectionDA-C4NoNEI 00-02 does notexplicitly cite thisdefinition of failure anddegraded state. Use theASME standard forrequirements.No objectionDA-C5NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionDA-C6YesDA-6, DA-7Confirm that thisrequirement is met. NEI00-02 addresses data needswhen the standby failurerate model is used fordemands. There are nostated criteria for thedemand failure model;however, in practice, thiswas addressed during peerreviews.No objectionDA-C7YesDA-6, DA-7NoneNo objectionDA-C8YesDA-4, DA-6,DA-7Confirm that thisrequirement is met. Although there are nospecific criteria fordetermining operationaltime of components inoperation or in standby, thedevelopment needs toinclude these times. Theseissues were addressedduring peer reviews.No objection withqualification:  None of thecited NEI 00-02 elements areapplicable.
Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-36DA-C9YesDA-4, DA-6,DA-7Confirm that thisrequirement is met. Although there are nospecific criteria fordetermining operationaltime of components inoperation or in standby, thedevelopment needs toinclude these times. Theseissues were addressedduring peer reviews.No objection DA-C10NoNEI 00-02 does notaddress this supportingrequirement. Use theASME standard forrequirements.No objectionDA-C11NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objection DA-C11a(3)NoUse the ASME PRAStandard for requirements. PRA Peer Review Teamsfound that support systemunavailabilities are treatedwithin the support systemand not within theassociated frontline system.No objectionDA-C12NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionDA-C13NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionDA-C14YesDA-15, AS-16,SY-24NoneNo objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-37DA-C15YesIE-13, IE-15,IE-16, AS-16,DA-15, SY-24,QU-18 Confirm that thisrequirement is met. Although, it is relativelyrare to see credit taken forrepair of failed equipmentin PRAs (except inmodeling of support systeminitiating events), anycredit taken for repairshould be well-justified,based on ease of diagnosis,the feasibility of repair,ease of repair, andavailability of resources,time to repair and actualdata. This can be done byciting either peer reviewresults or exampledocumentation.No objectionDA-D1NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionDA-D2NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionDA-D3PartialQU-30The guidance in thequalification of DA-D3provided in Reg Guide1.200 Appendix A shouldbe followed. Arequirement forestablishing the parameterdistributions is not in thedata analysis section butcould be inferred from QU-30. QU-30 does notprovide guidance on whichevents to include in theuncertainty analysis.No objection withqualification:  Verify that SRDA-D3 has been met. There isno qualification of DA-D3 inReg Guide 1.200 Appendix A. No change.
Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-38DA-D4NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement. This was performed as partof the Peer Review Teamimplementation of NEI 00-02.  (See DE-9.)No objectionDA-D5PartialDE-9, DA-8,DA-9, DA-10,DA-11, DA-12,DA-13, DA-14Check for acceptablecommon-cause failuremodels. This can be doneby citing either peer reviewdocumentation/conclusionsor example documentation. This was performed as partof the Peer Review Teamimplementation of NEI 00-02 (See DE-9). Thecriteria for NEI 00-02elements DA-13 & DA-14only apply to Grade 4.No objectionDA-D6PartialDE-9, DA-8,DA-9, DA-10,DA-11, DA-12,DA-13, DA-14NoneNo objection; DA-8 and DA-9are the applicable NEI 00-02elements.DA-D6a(3)Not required for CapabilityCategory IIDA-14DA-D6a is not an SR thatis required to beimplemented. However, ifthis approach is used, DA-D6a should be confirmedto be met. If it isperformed, see DE-9 fromNEI 00-02.No objection with clarification:DA-D6a is required to be metwhenever the plant-specificscreening and mapping ofindustry-wide data isperformed as stated in theindustry self-assessmentactions. Therefore thestatement "Not required forCapability Category II" is notaccurate and may bemisleading. It is more accurateto say that the plant-specificscreening and mapping ofindustry-wide data is notrequired for CapabilityCategory II.DA-D7NoUse the ASME standardfor requirements. NEI 00-02 does not specificallyaddress how to deal withdata for equipment that hasbeen changed.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-39DA-E1(2)PartialDA-1, DA-19,DA-20, DE-9NoneNo objectionDA-E2(2)PartialDA-1, DA-19,DA-20, DE-9Action is to confirmavailability ofdocumentation. In general,specified documentationitems not explicitlyaddressed in NEI 00-02checklists were addressedby the peer review teams. If not available,documentation may need tobe generated to supportparticular applications orrespond to NRC RAIsregarding applications.No objectionDA-E3(2)PartialQU-27, QU-28,QU-29, QU-34Confirm that the keyassumptions and keysources of uncertaintyconsistent with thedefinitions of the ASMEPRA Standard aredocumented.No objectionINTERNAL FLOODINGIF-A1NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-A1a(1)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-A1b(1)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-A2Deleted fromASME PRAStandard----IF-A3NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-A4NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-40IF-B1NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-B1a(4)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-B1b(3)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-B2NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-B3NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-B3a(3)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-B4Deleted fromASME PRAStandard----IF-C1NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-C2NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-C2a(1)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-C2b(2)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-C2c(5)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-41IF-C3NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-C3a(1)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-C3b(3)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-C3c(6)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-C4NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-C4a(4)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-C5NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-C5a(1)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-C6NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-C7(3)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-42IF-C8(3)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-C9(3)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-D1NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-D2NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-D3NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-D3a(3)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-D4NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-D5NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-D5a(1)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-D6(3)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-D7(3)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-43IF-E1NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-E2Deleted fromASME PRAStandard ----IF-E3NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-E3a(3)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-E4NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-E5NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-E5a(1)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-E6NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-E6a(1)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-E6b(1)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-E7NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-E8(3)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-44IF-F1(2)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-F2(2)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionIF-F3(2)NoUse the ASME standardfor requirements. NEI 00-02 does not address thissupporting requirement.No objectionQUANTIFICATION ANALYSISQU-A1YesAS-4, AS-5,AS-6, AS-7,AS-8, AS-9,AS-10, AS-19NoneNo objection; the requirementin QU-A1 is not explicitlystated in any element but isachieved by compliance withother NEI 00-02 elements.QU-A2aYesQU-8NoneNo objectionQU-A2b(1)NoASME PRA Standard SRshould be addressed. "State of knowledgecorrelation" is notexplicitly cited in NEI 00-02 to be checked.No objectionQU-A3YesQU-4, QU-8,QU-9, QU-10,QU-11, QU-12,QU-13NoneNo objection; the requirementin QU-A3 is not explicitlystated in any element but isachieved by compliance withother NEI 00-02 elements.QU-A4YesQU-18, QU-19NoneNo objectionQU-B1YesQU-6NoneNo objectionQU-B2YesQU-21, QU-22,QU-23, QU-24Confirm that thisrequirement is met. Inpractice, the industry peerreviews have generallyused the stated guidance asa check on the final cutsetlevel quantificationtruncation limit applied inthe PRA.No objection; QU-21 and QU-23 are the relevant elementsthat address the requirementsin QU-B2 while the remainingNEI 00-02 elements provideadditional guidance ontruncation. It is not clear whatevents and failure modes arebeing addressed in QU-22. Ifthe element is referring to acutset truncation limit, then thevalues presented arereasonable.
Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-45QU-B3PartialQU-21, QU-22,QU-23, QU-24The self-assessment shouldconfirm that the finaltruncation limit is such thatconvergence toward astable CDF is achieved.No objectionQU-B4YesQU-4NoneNo objection. Although thestated purpose of the criterionfor QU-4 is to verify that "thebase computer code and itsinputs have been tested anddemonstrated to producereasonable results," the subtiercriteria do not address thiscriterion, but instead providessome do's and don'ts forquantification.QU-B5YesQU-14NoneNo objectionQU-B6YesAS-8, AS-9,QU-4, QU-20,QU-25Check for properaccounting of successterms. The NEI 00-02guidance adequatelyaddresses this requirement,but QU-25 should not berestricted to addressing justdelete terms.No objectionQU-B7aYesQU-26NoneNo objectionQU-B7b(1)YesQU-26NoneNo objectionQU-B8NoUse the ASME standardfor requirements. NEI 00-02 does not explicitly citethe details of Boolean logiccode implementation.No objectionQU-B9PartialSY-9The warnings in SY-A10must be considered in themodularization process. SY-9 addresses thetraceability of basic eventsin modules but does notaddress the correctformulation of modulesthat are truly independent.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-46QU-C1YesQU-10, QU-17,HR-26, HR-27NoneNo objectionQU-C2YesQU-10, QU-17Verify dependencies incutsets/sequences areassessed.No objection with clarification: Verify that dependencebetween the HFEs in a cutsetor sequence is assessed inaccordance with ASME SRsHR-D5 and HR-G7.QU-C3YesQU-20Confirm that thisrequirement is met. QU-20does not explicitly requirethat the criticalcharacteristic, not just thefrequency, be transferred;however, in practice, thiswas addressed during peerreviews.No objectionQU-D1aYesQU-8, QU-9,QU-10, QU-11,QU-12, QU-13,QU-14, QU-15,QU-16, QU-17NoneNo objection; the requirementsin QU-D1 are addressedprimarily in QU-8. Therequirements in QU-9, QU-10,QU-14, QU-16, and QU-17appear to be focused onmodeling and notinterpretation of results. Assuch, they are redundant toelements in the data, dependentfailure, and HRA sections.QU-D1b(1)YesQU-8, QU-9,QU-10, QU-11,QU-12, QU-13,QU-14, QU-15,QU-16, QU-17,QU-23NoneNo objection; the requirementsin QU-D1 are addressedprimarily in QU-8. Therequirements in QU-9, QU-10,QU-14, QU-16, and QU-17appear to be focused onmodeling and notinterpretation of results. Assuch, they are redundant toelements in the data, dependentfailure, and HRA sections.
Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-47QU-D1c(1)YesQU-8, QU-9,QU-10, QU-11,QU-12, QU-13,QU-14, QU-15,QU-16, QU-17NoneNo objection; the requirementsin QU-D1 are addressedprimarily in QU-8. Therequirements in QU-9, QU-10,QU-14, QU-16, and QU-17appear to be focused onmodeling and notinterpretation of results. Assuch, they are redundant toelements in the data, dependentfailure, and HRA sections.QU-D2Deleted fromASME PRAStandard------QU-D3YesQU-8, QU-11,QU-31NoneNo objection; consistency withother PRA results is addressedin QU-11 and QU-31.QU-D4YesQU-15NoneNo objectionQU-D5aYesQU-8, QU-31Confirm that thisrequirement is met. Thesubject matter in QU-D5ais partially addressed inNEI 00-02 in element QU-31 (QU-8 checks thereasonableness of theresults). The contributionsfrom IEs, componentfailures, common-causefailures, and human errorsare not addressed. Inpractice, these wereaddressed during peerreviews.No objectionQU-D5b(5)NoConfirm that thisrequirement is met.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-48QU-E1YesQU-27, QU-28,QU-30Confirm that QU-E1 isaddressed. The definitionof the key sources of modeluncertainty is provided bythe ASME PRA StandardAddendum B. Thisnomenclature was notavailable when NEI 00-02was implemented. ThePRA Peer Review didexamine the PRAs to see ifmodeling uncertaintieswere addressedappropriately.No objection with clarification: QU-30 does not provideguidance on sources ofuncertainty.QU-E2YesQU-27, QU-28,QU-30Confirm that thisrequirement is met. QU-27and QU-28 focus on theassumptions and unusualsources of uncertainty. Assumptions and unusualsources of uncertaintycorrespond to plant-specific hardware,procedural, orenvironmental issues thatwould significantly alterthe degree of uncertaintyrelative to plants that havebeen assessed previously,such as NUREG-1150 or. Unusual sourcesof uncertainty could alsobe introduced by the PRAmethods and assumptions.In practice, when applyingNEI 00-02 sub-elementsQU-27 and QU-28, thereviewers considered theappropriateness of theassumptions.No objection.
Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-49QU-E3PartialQU-30The uncertainty bandassociated with each riskmetric is to be estimated.The parametric uncertaintyband is to be estimatedtaking into account the"state of knowledgecorrelation."  This was tobe checked by the PeerReview team.No objectionQU-E4PartialQU-28, QU-29,QU-30Use the ASME standardfor requirements. NEI 00-02 does not explicitlyspecify that sensitivitystudies of logicalcombinations ofassumptions andparameters be evaluated.No objectionQU-F1(2)PartialQU-31, QU-32,QU-34NoneNo objectionQU-F2(2)YesMU-7, QU-4,QU-12, QU-13,QU-27, QU-28,QU-31, QU-32No action required for (m). Normal industry practicerequires documentation ofcomputer code capabilities.No objection withqualification:  Confirmavailability of documentation. If not available, documentationmay need to be generated tosupport particular applicationsor respond to NRC RAIsregarding applications. Self-assessment also needs toconfirm computer code hasbeen sufficiently verified suchthat there is confidence in theresults.QU-F3(2)PartialQU-31Use the ASME standardfor requirements at the timeof doing an application.No objectionQU-F4(2)NoQU-27, QU-28,QU-32Use the ASME standardfor requirements at the timeof doing an application. NEI 00-02 does notaddress this supportingrequirement.No objectionQU-F5(2)NoUse the ASME standardfor requirements at the timeof doing an application. NEI 00-02 does notaddress this supportingrequirement.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-50QU-F6(3)NoUse the ASME standardfor requirements at the timeof doing an application. NEI 00-02 does notaddress this supportingrequirement.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-51LERF ANALYSISLE-A1PartialAS-14,AS-21,AS-23, L2-7Confirm that the specificsidentified in LE-A1 areincluded in the PRA.NUREG/CR-6595methodology is notadequate for CapabilityCategory II and III.It is further noted that NEI00-02 does not addresscriteria for the groupinginto plant damage states(PDSs) (i.e., there are nocriteria provided as to whatinformation has to betransferred from the Level1 to the Level 2 analysis). L2-7 states the transferfrom Level 1 to Level 2should be done tomaximize the transfer ofrelevant information, butdoes not specificallyidentify the type ofinformation that must betransferred. L2-7 doesrefer to grouping sequenceswith similar characteristicsand cautions care intransferring dependencieson accident conditions,equipment status andoperator errors. Inpractice, this step includedreview of the process fordeveloping and binning thePDSs and ensuringconsistency between thePDSs and the plant state.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-52LE-A2PartialL2-7, L2-8, AS-21Confirm that the specificsidentified in LE-A2 areincluded in the PRA.NUREG/CR-6595methodology is notadequate for CapabilityCategory II and III.It is noted that NEI 00-02does not address criteriafor the grouping into PDSs(i.e., there are no criteriaprovided as to whatinformation has to betransferred from the Level1 to the Level 2 analysis). L2-7 states the transferfrom Level 1 to Level 2should be done tomaximize the transfer ofrelevant information, butdoes not identify the typeof information that must betransferred.No objectionLE-A3PartialL2-7, L2-8Confirm that the specificsidentified in LE-A3 areincluded in the PRA.NUREG/CR-6595methodology is notadequate for CapabilityCategory II and III.It is further noted that NEI00-02 does not addresscriteria for the groupinginto PDSs (i.e., there are nocriteria provided as to whatinformation has to betransferred from the Level1 to the Level 2 analysis). L2-7 states the transferfrom Level 1 to Level 2should be done tomaximize the transfer ofrelevant information, butdoes not identify the typeof information that must betransferred.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-53LE-A4PartialL2-7,L2-8, L2-9, L2-24, L2-25Confirm that the specificsidentified in LE-A4 areincluded in the PRA.NUREG/CR-6595methodology is notadequate for CapabilityCategory II and III.It is further noted that NEI00-02 does not addresscriteria for the groupinginto PDSs (i.e., there are nocriteria provided as to whatinformation has to betransferred from the Level1 to the Level 2 analysis). L2-7 states the transferfrom Level 1 to Level 2should be done tomaximize the transfer ofrelevant information, butdoes not identify the typeof information that must betransferred.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-54LE-A5PartialL2-7 L2-8, L2-9, L2-24, L2-25Confirm that the specificsidentified in LE-A5 areincluded in the PRA.NUREG/CR-6595methodology is notadequate for CapabilityCategory II and III.It is further noted that NEI00-02 does not addresscriteria for the groupinginto PDSs (i.e., there are nocriteria provided as to whatinformation has to betransferred from the Level1 to the Level 2 analysis). L2-7 states the transferfrom Level 1 to Level 2should be done tomaximize the transfer ofrelevant information, butdoes not identify the typeof information that must betransferred.L2-24 and L2-25 clearlyindicate that thedependencies of systems,crew actions, andphenomena in the entirePRA need to be integratedinto the model.No objectionLE-B1YesL2-8, L2-10,L2-15, L2-16,L2-17, L2-19NoneNo objectionLE-B2YesL2-13, L2-14NoneNo objectionLE-B3(3)NoNEI 00-02 does notaddress this supportingrequirement. Use theASME PRA Standard forrequirements.No objectionLE-C1YesL2-24, L2-5,L2-8, L2-13,L2-14, L2-15, L2-16, L2-17,L2-19, L2-20Confirm that the specificsidentified in LE-C1 withregard to the basis forassigning sequences to theLERF and non-LERFcategory meet the intent ofLE-C1.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-55LE-C2aYesL2-9, l2-12, L2-25Confirm that the actionscredited are supported byAOPs, EOPs, SAMGs,TSC guidance or otherprocedural or guidanceinformation as noted in LE-C2a.No objectionLE-C2b(1)PartialL2-9, L2-12,L2-25 Confirm that the specificsidentified in LE-C2b areincluded in the PRA.Repair of equipment wouldbe subsumed underrecovery actions in L2-9and L2-5. If credit wastaken for repair, actual dataand sufficient time must beavailable and justified.No objectionLE-C3PartialL2-8, L2-24,L2-25Confirm that thejustification for inclusionof any of the features listedin LE-C3 meet the revisedrequirements of LE-C3 inAddendum B of the ASMEstandard.No objectionLE-C4PartialL2-4, L2-5,L2-6The self-assessment needsto confirm the revisedrequirements of LE-C4 inAddendum B of the ASMEstandard.No objectionLE-C5YesAS-20, AS-21,L2-7, L2-11,L2-25NoneNo objectionLE-C6YesL2-12, L2-24,L2-25NoneNo objectionLE-C7PartialL2-7, L2-11,L2-12, L2-24Confirm that therequirements in LE-C7 areincluded in the PRA.No objectionLE-C8aPartialL2-11, L2-12Confirm that the treatmentof environmental impactsmeets the revisedrequirements in LE-C8a inAddendum B of the ASMEstandard.No objectionLE-C8b(1)PartialL2-11, L2-12Confirm requirements ofLE-C8b are implementedin the PRA.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-56LE-C9aPartialAS-20, L2-11,L2-12, L2-16,L2-24, L2-25Confirm that the treatmentof environmental impactsmeets the revisedrequirements of LE-C9a inAddendum B of the ASMEstandard.NEI 00-02 does notdifferentiate betweencontainment harshenvironments andcontainment failure effectson systems and operators. This was typicallyaddressed during peerreviews.No objectionLE-C9b(1)PartialAS-20, L2-11,L2-12, L2-16,L2-24, L2-25Confirm the treatment ofcontainment failure meetsthe revised requirements ofLE-C9b.NEI 00-02 includes theeffects of containmentharsh environments andcontainment failure effectson systems and operators. This was typically verifiedduring peer reviews.No objectionLE-C10PartialL2-7, L2-8, L2-13, L2-24, L2-25The revised requirementsof LE-C10 in Addendum Bof the ASME standardneed to be considered inthe self-assessment.Containment bypass isexplicitly identified in thefailure modes addressed bythe LERF analysis.No objectionLE-D1aPartialL2-14, L2-15,L2-16, L2-17,L2-18, L2-19,L2-20, ST-5,ST-6Confirm that thecontainment performanceanalysis meets the revisedrequirements of LE-D1a inAddendum B of the ASMEstandard.No objectionLE-D1b(1)PartialL2-14, L2-15,L2-16, L2-17,L2-18, L2-19,L2-20, ST-5,ST-6Confirm requirements ofLE-D1b are implemented.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-57LE-D2PartialL2-14, L2-19Confirm the requirementsof LE-D2 are implemented.NEI 00-02 does notexplicitly enumerate thissupporting requirement. However, the containmentfailure analysis includes byits nature for CapabilityCategory II the location ofthe failure mode. Therefore, both theanalysis and the peerreview have typicallyaddressed this SR.No objectionLE-D3PartialIE-14, ST-9Confirm the requirementsof LE-D3 are implementedin accordance withAddendum B.In practice, peer reviewteams evaluated theISLOCA frequencycalculation. F&Os underIE and AS would bewritten if this was notadequate.No objectionLE-D4NoNEI 00-02 does notaddress this supportingrequirement. Use theASME standard forSupporting RequirementLE-D4.No objectionLE-D5NoNEI 00-02 does notaddress this supportingrequirement. Use theASME standard forSupporting RequirementLE-D5.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-58LE-D6PartialL2-16, L2-18,L2-19, L2-24,L2-25Confirm that thecontainment isolationtreatment meets the revisedrequirements of LE-D6 inAddendum B of the ASMEstandard.The guidance provided inNEI 00-02 does notexplicitly enumerate therequirements in LE-D6. However, the PRAs wereconstructed to address therequirements of NUREG-1335, which explicitlyrequired containmentisolation evaluation. Therefore, the PRAs andthe Peer Reviews havetypically addressed this SR.No objectionLE-E1YesL2-11, L2-12NoneNo objectionLE-E2PartialDA-4, HR-15,L2-12, L2-13,L2-17, L2-18,L2-19, L2-20Confirm that therequirements of LE-E2 ofAddendum B are met.No objectionLE-E3(3)NoNEI 00-02 does notaddress this supportingrequirement. Use theASME PRA Standard forSupporting RequirementLE-E3. No objectionLE-E4(7)PartialQU sub-elementsapplicable toLERF The self-assessment needsto confirm that theparameter estimation meetsthe revised requirements ofLE-E4 in Addendum B ofthe ASME standard.No objectionLE-F1aYesQU-8, QU-9,QU-10, QU-11,QU-31, L2-26NoneNo objectionLE-F1b(1)YesL2-26NoneNo objectionLE-F2NoQU-27, L2-26NEI 00-02 does notaddress this supportingrequirement. Use theASME standard forSupporting RequirementLE-F2.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-59LE -F3(3)NoNEI 00-02 does notaddress this supportingrequirement. Use theASME standard forSupporting RequirementLE-F3No objectionLE-G1(2)YesL2-26, L2-27,L2-28NoneNo objectionLE-G2(2)PartialL2-26, L2-27,L2-28In general, specifieddocumentation items notexplicitly addressed in NEI00-02 checklists wereaddressed by the peerreview teams. Action is toconfirm availability ofdocumentation. If notavailable, documentationmay need to be generatedto support particularapplications or respond toNRC RAIs regardingapplications.No objectionLE-G3(2)PartialL2-26, L2-27,L2-28In general, specifieddocumentation items notexplicitly addressed in NEI00-02 checklists wereaddressed by the peerreview teams. Action is toconfirm availability ofdocumentation. If notavailable, documentationmay need to be generatedto support particularapplications or respond toNRC RAIs regardingapplications.No objectionLE-G4(2)PartialQU-27, QU-28,QU-29, QU-34Confirm that the keyassumptions and keysources of uncertaintyconsistent with thedefinitions of the ASMEPRA Standard aredocumented.No objection Table B-4. NRC Regulatory Position on Industry Self-Assessment ActionsNEI AssessmentRegulatory PositionASMESTD SRAddressed by NEI 00-02?ApplicableNEI 00-02ElementsIndustry Self-AssessmentActionsAppendix B to DG-1161, Page B-60LE-G5(2)PartialL2-26, L2-27,L2-28In general, specifieddocumentation items notexplicitly addressed in NEI00-02 checklists wereaddressed by the peerreview teams. Action is toconfirm availability ofdocumentation. If notavailable, documentationmay need to be generatedto support particularapplications or respond toNRC RAIs regardingapplications.No objectionLE-G6(3)NoNEI 00-02 does notaddress this supportingrequirement. Use ASMEPRA Standard AddendumB SR LE-G6 forrequirements.No objectionNotes from NEI 00-02 Appendix D2
:(1)Subdivided from a previous SR in Addendum A of the ASME PRA Standard. It is noted that AddendumB of the ASME PRA Standard has subdivided a number of SRs for the purpose of clarifying andseparating the assignment of Capability Category of the SR in a clearly delineated fashion.(2)Revised to reflect new format for documentation section and SRs.(3)New SR added.
(4)SR added to address multi-unit sites.
(5)Formerly IF-A2.(6)Formerly IF-E2.(7)Formerly LE-E3.NRC regulatory position on NEI-05-04, "Process for Performing Follow-On PRA Peer Review Using theASME PRA Standard," is provided below in Table B.5.
Appendix B to DG-1161, Page B-61Table B-5. NRC Regulatory Position on NEI 05-04Report SectionRegulatoryPositionCommentary/ResolutionSection 1.0. INTRODUCTION1.1 PurposeNo objection-----------------------------------1.2 BackgroundNo objection-----------------------------------1.3 ScopeNo objectionSection 2.0. GENERAL OVERVIEW OF PEER REVIEW PROCESS 1 st paragraphClarificationA follow-on peer review of an at-power, internal events PRA (includinginternal flooding) that uses as criteria the supporting requirements ofChapter 4 of the ASME PRA Standard needs to address the staff's positionprovided in Appendix A to this regulatory guide to be acceptable to the stafffor a regulatory application.
4 th paragraphClarificationPer Section 6.3 of the ASME PRA Standard, the staff position is that, inaddition to the results of the PRA, the follow-on peer review must reviewthe PRA models and assumptions related to the PRA upgrade to determinetheir reasonableness given the design and operation of the plant.Section 3.0. GRADING PROCESS 1 st paragraphClarificationNEI 05-04 indicates that one of the outcomes of the follow-on peer reviewprocess is the assignment of grades for each SR that are used to indicate therelative capability level of each PRA technical element. Since the use of aPRA for risk-informed applications needs to be determined at the SR level,the staff does not utilize an overall PRA technical element capability levelin the assessment of a PRA for specific applications.
2 nd paragraphClarificationNEI states that it is essential to focus the peer review on the specificconclusions of the PRA to ensure that the review directly addressesintended plant applications. The staff position is that the follow-on peerreview must also review the PRA models and assumptions related to thePRA upgrade in addition to the results of the PRA in order to ensure thePRA can be used for specific applications.3.1 GradingProcess for PeerReviews AgainstASME PRAStandard 2 nd paragraphClarificationA follow-on peer review of an at-power, internal events PRA (includinginternal flooding) that uses as criteria the supporting requirements ofChapter 4, and the requirements of Chapter 5 of the ASME PRA Standardneeds to address the staff's position provided in Appendix A to thisregulatory guide to be acceptable to the staff for a regulatory application.
5 th paragraphClarificationNEI 05-04 indicates that although no grades are assigned to HLRs, aqualitative assessment of the HLRs will be made based on the associated SRgrades. The staff's position is consistent with the ASME PRA Standard,which indicates that a PRA reviewed against the standard must satisfy allHLRs. To meet an HLR, all SRs under that HLR must meet therequirements of one of the three Capability Categories.
Table B-5. NRC Regulatory Position on NEI 05-04Report SectionRegulatoryPositionCommentary/ResolutionAppendix B to DG-1161, Page B-623.2 ComparisonAgainst GradingProcess for NEI 00-02ClarificationThe NEI 00-02 process uses "a set of checklists as a framework withinwhich to evaluate the scope, comprehensiveness, completeness, and fidelityof the PRA being reviewed."  The checklists by themselves are insufficientto provide the basis for a peer review since they do not provide the criteriathat differentiate the various grades of PRA. The NEI subtier criteriaprovide a means to differentiate between grades of PRA. However, sincethe NEI subtier criteria do not address all of the requirements in the ASMEPRA Standard, the staff's position is that a peer review based on thesecriteria is incomplete. The PRA standard requirements that are not includedin the NEI 00-02 subtier criteria (identified for a Grade 3 PRA in Table B-3) need to be addressed in the NEI 00-02 self-assessment process asendorsed by the staff in this appendix.  (Staff comment on section 1.1 onNEI 00-02)ClarificationThe NEI 00-02 peer review process grades each PRA element from 1 to 4,while the ASME PRA Standard uses Capability Categories I, II, and III. The staff interpretation of Grades 2, 3, and 4 is that, they correspondbroadly to Capability Categories I, II, and III respectively. This statement isnot meant to imply that the supporting requirements, for example, forCategory I are equally addressed by Grade 2 of NEI 00-02. The review ofthe supporting requirement for Category II against Grade 3 of NEI 00-02indicated discrepancies and consequently the need for a self-assessment. The existence of these discrepancies would indicate that it would not beappropriate to assume that there are not discrepancies between Category Iand Grade 2. A comparison between the other grades and categories has notbeen performed. The implications of this are addressed in item 7 of TableB-2.  (Staff comment on section 3.3 on NEI 00-02)QualificationThe staff believes that different applications of a PRA can require differentPRA subelement grades. The NEI peer review process is performed at thesubelement level and does not provide an overall PRA grade. Therefore, itis inappropriate to suggest an overall PRA grade for the specificapplications listed in this section. The staff does not agree with the assignedoverall PRA grades provided for the example applications listed in thissection of NEI 05-04.  (Staff comment on Section 3.3 on NEI 00-02)Section 4.0. FOLLOW-ON PEER REVIEW:  ASME PRA STANDARD SCOPE4.1 ScopeClarificationThe staff accepts that in addition to performing a follow-on peer review of aPRA update, the process in NEI 05-04 can be used to validate the self-assessment performed under NEI 00-02 Appendix D guidance (referred toin NEI 05-04 as a gap-analysis), as endorsed in this appendix. The use ofthe results of the NEI 00-02 self-assessment can be used to focus such areview. However, for a follow-on peer review of a PRA upgrade, the staff'sposition is that all pertinent SRs must be reviewed.4.2 Host UtilityRequirementsNo objection---------------------------------
Table B-5. NRC Regulatory Position on NEI 05-04Report SectionRegulatoryPositionCommentary/ResolutionAppendix B to DG-1161, Page B-634.3 Self-AssessmentClarificationThe staff interpretation of NEI 00-02 Grades 2, 3, and 4 is that, theycorrespond broadly to the ASME PRA Standard Capability Categories I, II,and III respectively. This statement is not meant to imply that thesupporting requirements, for example, for Category I are equally addressedby Grade 2 of NEI 00-02. The review of the supporting requirement forCategory II against Grade 3 of NEI 00-02 indicated discrepancies andconsequently the need for a self-assessment. The existence of thesediscrepancies would indicate that it would not be appropriate to assume thatthere are not discrepancies between Category I and Grade 2. A comparisonbetween the other grades and categories has not been performed. Thus,although it is reasonable to assign an SR that received a Grade 3 or 4 in theNEI 00-02 review as a Capability Category II, it is not reasonable to assumea Grade 2 corresponds to Capability Category I.  (Staff comment on Section3.3 on NEI 00-02)4.5 Peer ReviewScheduleNo objection------------------------------------------4.6 Peer ReviewProcess 4 th paragraphQualificationNEI 05-04 states that a reviewer's assessment whether each SR meets theASME PRA Standard should be derived from what is in the standard andnot based on the staffs clarifications and qualifications of the SRs providedin Appendix A to this regulatory guide. The staff's position is that, whenused to support a regulatory application, the assigned SR grades accepted bythe NRC for a specific application will include consideration of theclarifications and qualifications to the ASME PRA Standard provided inAppendix A.
9 th and 10 thparagraphsClarificationSection 6.1 of the ASME PRA Standard indicates that the peer review neednot assess all aspects of the PRA against all of the Section 4 requirements. The NEI 05-04 process interpretation of this statement allows for skippingreview of selected SRs if the reviewers determine they can achieveconsensus on the adequacy of the PRA with respect to the HLR associatedwith the SRs that are not reviewed. The staff's position is that the statementquoted refers to the scope of the models being reviewed and not the scopeof the SRs to be reviewed. The staff's position is that all SRs pertinent tothe PRA upgrade must be reviewed against a sufficient number and varietyof models in the PRA (e.g., selected fault and event trees) to determine theSR capability categories. Without a review, the capability category forskipped SRs cannot be determined.
Table B-5. NRC Regulatory Position on NEI 05-04Report SectionRegulatoryPositionCommentary/ResolutionAppendix B to DG-1161, Page B-64APPENDICES Appendix ASample Fact andObservationFormNo objection------------------------------------Appendix BSampleSummary TablesNo objection------------------------------------Appendix CMaintenance andUpdate ProcessReviewChecklistNo objection---------------------------------}}

Latest revision as of 02:05, 14 March 2020

Draft Regulatory Guide DG-1161, an Approach for Determining the Technical Adequacy of Probabilistic Risk Assessment Results for Risk-informed Activities (Proposed Revision 1 of Regulatory Guide 1.200, Dated February 2004)
ML062480134
Person / Time
Issue date: 09/05/2006
From: Mary Drouin
NRC/RES/DRASP/DDPRA/RASP
To:
Drouin M (301)415-6675
References
DG-1161 RG-1.200, Rev 1
Download: ML062480134 (115)


Text

U.S. NUCLEAR REGULATORY COMMISSION September 2006 OFFICE OF NUCLEAR REGULATORY RESEARCH Division 1 DRAFT REGULATORY GUIDE

Contact:

M.T. Drouin (301) 415-6675 DRAFT REGULATORY GUIDE DG-1161 (Proposed Revision 1 of Regulatory Guide 1.200, dated February 2004)

AN APPROACH FOR DETERMINING THE TECHNICAL ADEQUACY OF PROBABILISTIC RISK ASSESSMENT RESULTS FOR RISK-INFORMED ACTIVITIES A. INTRODUCTION In 1995, the U.S. Nuclear Regulatory Commission (NRC) issued a Policy Statement (Ref. 1) on the use of probabilistic risk analysis (PRA), encouraging its use in all regulatory matters. That Policy Statement states that the use of PRA technology should be increased to the extent supported by the state-of-the-art in PRA methods and data and in a manner that complements the NRCs deterministic approach. Since that time, many uses have been implemented or undertaken, including modification of the NRCs reactor safety inspection program and initiation of work to modify reactor safety regulations.

Consequently, confidence in the information derived from a PRA is an important issue, in that the accuracy of the technical content must be sufficient to justify the specific results and insights that are used to support the decision under consideration.

This regulatory guide describes one acceptable approach for determining whether the quality of the PRA, in total or the parts that are used to support an application, is sufficient to provide confidence in the results, such that the PRA can be used in regulatory decision-making for light-water reactors.

This guidance is intended to be consistent with the NRCs PRA Policy Statement and subsequent, more detailed, guidance in Regulatory Guide 1.174 (Ref. 2). It is also intended to reflect and endorse guidance provided by standards-setting and nuclear industry organizations.

This regulatory guide is being issued in draft form to involve the public in the early stages of the development of a regulatory position in this area. It has not received staff review or approval and does not represent an official NRC staff position.

Public comments are being solicited on this draft guide (including any implementation schedule) and its associated regulatory analysis or value/impact statement. Comments should be accompanied by appropriate supporting data. Written comments may be submitted to the Rules and Directives Branch, Office of Administration, U.S. Nuclear Regulatory Commission, Washington, DC 20555-0001. Comments may be submitted electronically through the NRCs interactive rulemaking Web page at http://www.nrc.gov/what-we-do/regulatory/rulemaking.html. Copies of comments received may be examined at the NRCs Public Document Room, 11555 Rockville Pike, Rockville, MD. Comments will be most helpful if received by October 14, 2006.

Requests for single copies of draft or active regulatory guides (which may be reproduced) or placement on an automatic distribution list for single copies of future draft guides in specific divisions should be made to the U.S. Nuclear Regulatory Commission, Washington, DC 20555, Attention: Reproduction and Distribution Services Section, or by fax to (301)415-2289; or by email to Distribution@nrc.gov. Electronic copies of this draft regulatory guide are available through the NRCs interactive rulemaking Web page (see above); the NRCs public Web site under Draft Regulatory Guides in the Regulatory Guides document collection of the NRCs Electronic Reading Room at http://www.nrc.gov/reading-rm/doc-collections/; and the NRCs Agencywide Documents Access and Management System (ADAMS) at http://www.nrc.gov/reading-rm/adams.html, under Accession No. ML062480134.

When used in support of an application, this regulatory guide will obviate the need for an in-depth review of the base PRA by NRC reviewers, allowing them to focus their review on key assumptions and areas identified by peer reviewers as being of concern and relevant to the application.

Consequently, this guide will provide for a more focused and consistent review process. In this regulatory guide, as in RG 1.174, the quality of a PRA analysis used to support an application is measured in terms of its appropriateness with respect to scope, level of detail, and technical acceptability.

This regulatory guide was issued for trial use in February of 2004, and five trial applications were conducted. This revision incorporates lessons learned from those pilot applications (Ref. 3).

In addition, the appendices to this regulatory guide have been revised to address the changes made in the professional society PRA standards and industry PRA guidance documents.

The NRC issues regulatory guides to describe to the public methods that the staff considers acceptable for use in implementing specific parts of the agencys regulations, to explain techniques that the staff uses in evaluating specific problems or postulated accidents, and to provide guidance to applicants. Regulatory guides are not substitutes for regulations, and compliance with regulatory guides is not required. The NRC issues regulatory guides in draft form to solicit public comment and involve the public in developing the agencys regulatory positions. Draft regulatory guides have not received complete staff review and, therefore, they do not represent official NRC staff positions.

This regulatory guide contains information collections that are covered by the requirements of 10 CFR Part 50 which the Office of Management and Budget (OMB) approved under OMB control number 3150-0011. The NRC may neither conduct nor sponsor, and a person is not required to respond to, an information collection request or requirement unless the requesting document displays a currently valid OMB control number.

DG-1161, Page 2

B. DISCUSSION Existing Guidance Related to the Use of PRA in Reactor Regulatory Activities Since the NRC issued its PRA Policy Statement, a number of risk-informed regulatory activities have been implemented and the necessary technical documents are being developed to provide guidance on the use of PRA information.

One specific regulatory guide and its associated standard review plan (SRP) is RG 1.174 and SRP Section 19 (Ref. 4), which provide general guidance on applications that address changes to the licensing basis. Key aspects of this document include the following:

  • It describes a risk-informed integrated decision-making process that characterizes how risk information is used and, more specifically, it clarifies that such information is one element of the decision-making process. That is, decisions are expected to be reached in an integrated fashion, considering traditional engineering and risk information, and may be based on qualitative factors as well as quantitative analyses and information.
  • It reflects the staffs recognition that the PRA needed to support regulatory decisions can vary (i.e., that the scope, level of detail, and quality of the PRA is to be commensurate with the application for which it is intended and the role the PRA results play in the integrated decision process). For some applications and decisions, only particular parts1 of the PRA need to be used. In other applications, a full-scope PRA is needed. General guidance regarding scope, level of detail, and quality for a PRA is provided in the application-specific documents.
  • While this document is written in the context of one reactor regulatory activity (license amendments), the underlying philosophy and principles are applicable to a broad spectrum of reactor regulatory activities.

In addition, separate regulatory guides provide guidance for such specific applications as inservice testing (Ref. 5), inservice inspection (Ref. 6), quality assurance (Ref. 7), and technical specifications (Ref. 8). The NRC has also prepared SRP sections for each of the application-specific regulatory guides, with the exception of quality assurance.

PRA standards have also been under development by the American Society of Mechanical Engineers (ASME) and the American Nuclear Society (ANS):

  • On April 5, 2002, ASME issued a standard for a full-power, internal events (excluding fire)

Level 1 PRA and a limited Level 2 PRA, and subsequently issued Addenda A and B to that standard on December 5, 2003, and December 30, 2005, respectively (Ref. 9). ASME issued Addendum B in response to the NRC staffs position on Addendum A, lessons learned from the pilots, and other public comments provided to ASME.

  • In December 2003, ANS issued a standard for external events (Ref. 10).
  • ASME and ANS are developing Level 1 PRA standards for internal fire, external events, and low-power shutdown operating mode, as well as Level 2 and Level 3 PRA standards.

1 In this regulatory guide, a part of a PRA can be understood to be equivalent to that piece of the analysis for which an applicable PRA standard identifies a supporting level requirement.

DG-1161, Page 3

Reactor owners groups have been developing and applying a PRA peer review program for several years. The Nuclear Energy Institute (NEI) issued NEI-00-02 (Ref. 11), which documents one such process:

  • On August 16, 2002, NEI submitted draft industry guidance for self-assessments (Ref. 11) to address the use of industry peer review results in demonstrating conformance with the ASME PRA Standard. This additional guidance, which is intended to be incorporated into a revision of NEI-00-02 (per NEI, Ref. 11), contains the following:

< Self-assessment guidance document

< Appendix 1 actions for industry self-assessment

< Appendix 2 industry peer review subtier criteria

  • On May 19, 2006, NEI issued a revision to the self-assessment guidance incorporated in NEI-00-02, to satisfy the peer review requirement(s) of the ASME PRA Standard (ASME-RA-Sa-2003) as endorsed/modified by the NRC and updated by Addendum B of the ASME PRA Standard (Ref. 11).
  • In August 2006, NEI issued NEI-05-04, Process for Performing Follow-On PRA Peer Reviews Using the ASME PRA Standard. This document provides guidance for conducting and documenting a follow-on peer review for PRAs using the ASME PRA Standard (Ref. 12).

SECY-00-0162 (Ref. 13) describes an approach for addressing PRA quality in risk-informed activities, including identification of the scope and minimal functional attributes of a technically acceptable PRA.

Regulatory Guide 1.201, Guidelines for Categorizing Structures, Systems, and Components in Nuclear Power Plants According to their Safety Significance (Ref. 14), discusses an approach, along with References 8 and 11, to support the new rule established as Title 10, Section 50.69, of the Code of Federal Regulations (10 CFR 50.69), Risk-informed categorization and treatment of structures, systems, and components for nuclear power reactors (Ref. 15).

SECY-04-0118, Plan for the Implementation of the Commissions Phased Approach to PRA Quality (Ref. 16), presents the staffs approach to defining the needed PRA quality for current or anticipated applications, as well as the process for achieving this quality, while allowing risk-informed decisions to be made using currently available methods until all of the necessary guidance documents are developed and implemented.

Purposes of this Regulatory Guide The purposes of this regulatory guide are to provide guidance to licensees for use in determining the technical adequacy of a PRA used in a risk-informed regulatory activity, and to endorse standards and industry guidance. Toward that end, this regulatory guide provides guidance in four areas:

(1) a minimal set of functional requirements of a technically acceptable PRA (2) the NRCs position on PRA consensus standards and industry PRA program documents (3) demonstration that the PRA (in total or specific parts) used in regulatory applications is of sufficient technical adequacy (4) documentation to support a regulatory submittal DG-1161, Page 4

This regulatory guide provides more detailed guidance, relative to RG 1.174, on PRA technical adequacy in a risk-informed integrated decision-making process. It does not provide guidance on how PRA results are used in application-specific decision-making processes; that guidance is provided in such documents as References 5 - 8.

The regulatory guides that address specific applications, such as RG 1.201, allow for the use of PRAs that are not full-scope (e.g., do not include contributions from external initiating events or low-power and shutdown modes of operation). Those regulatory guides do, however, state that the missing scope items are to be addressed in some way, such as by using bounding analyses.

This regulatory guide does not address such alternative methods to the evaluation of risk contributions; rather, this guide only addresses PRA methods.

Relationship to Other Guidance Documents This regulatory guide is a supporting document to other NRC regulatory guides that address risk-informed activities. At a minimum, these guides include (1) RG 1.174 and SRP Section 19, which provide general guidance on applications that address changes to the licensing basis; (2) the regulatory guides for specific applications such as for inservice testing, inservice inspection, quality assurance, and technical specifications (Refs. 4-7); and (3) regulatory guides associated with implementation of certain regulations, particularly those that rely on a plant-specific PRA to implement the rule.

In addition, the NRC has prepared corresponding SRP chapters for the application-specific guides.

Figure 1 shows the relationship of this new regulatory guide and risk-informed activities, application-specific guidance, consensus PRA standards, and industry programs (e.g., NEI-00-02).

Figure 1. Relationship of Regulatory Guide 1.200 to Other Risk-Informed Guidance DG-1161, Page 5

C. REGULATORY POSITION

1. Functional Requirements of a Technically Acceptable PRA This section describes one acceptable approach for defining the technical adequacy of an acceptable PRA of a commercial nuclear power plant. PRAs used in risk-informed activities may vary in scope and level of detail, depending on the specific application. However, the PRA results used to support an application must be derived from a PRA model that represents the as-built, as-operated plant2 to the extent needed to support the application In this section, the guidance provided is for a full-scope PRA. The scope is defined in terms of (1) the metrics used to characterize risk, (2) the plant operating states for which the risk is to be evaluated, and (3) the types of initiating events that can potentially challenge and disrupt the normal operation of the plant and, if not prevented or mitigated, would eventually result in core damage and/or a large release.

The level of detail required of the PRA model is ultimately determined by the application.

Nonetheless, a minimal level of detail is necessary to ensure that the impacts of designed-in dependencies (e.g., support system dependencies, functional dependencies, and dependencies on operator actions) are correctly captured and the PRA represents the as-built, as-operated plant. This minimal level of detail is implicit in the technical characteristics and attributes discussed in this section. Consequently, this section provides guidance in four areas, in accordance with SECY-00-0162:

(1) definition of the scope of a PRA (2) technical elements of a full-scope PRA (3) attributes and characteristics for technical elements of a PRA (4) development, maintenance, and upgrade of a PRA 1.1 Scope of PRA The scope of a PRA is defined by the challenges included in the analysis and the level of analysis performed. Specifically, the scope is defined in the following terms:

  • metrics used in characterizing the risk
  • plant operating states for which the risk is to be evaluated
  • types of initiating events that can potentially challenge and disrupt the normal operation of the plant 2

Some applications may involve the plant at the design certification or combined operating license stage, where the plant is not built or operated. At these stages, the intent is for the PRA model to reflect the as-designed plant.

DG-1161, Page 6

Risk characterization is typically expressed by metrics of core damage frequency (CDF) and large early release frequency (LERF) (as surrogates for latent and early fatality risks, respectively, for light-water reactors). These are defined in a functional sense as follows:

  • Core damage frequency is defined as the sum of the frequencies of those accidents that result in uncovery and heatup of the reactor core to the point at which prolonged oxidation and severe fuel damage involving a large fraction of the core (i.e., sufficient, if released from containment, to have the potential for causing offsite health effects) is anticipated.
  • Large early release frequency is defined as the frequency of those accidents leading to significant, unmitigated releases from containment in a time frame prior to effective evacuation of the close-in population such that there is the potential for early health effects. Such accidents generally include unscrubbed releases associated with early containment failure shortly after vessel breach, containment bypass events, and loss of containment isolation Issues related to the reliability of barriers (in particular, containment integrity and consequence mitigation) are addressed through other parts of the decision-making process, such as consideration of defense-in-depth. To provide the risk perspective for use in decision-making, a Level 1 PRA is required to provide CDF. A limited Level 2 PRA is needed to address LERF.

Plant operating states (POSs) are used to subdivide the plant operating cycle into unique states, such that the plant response can be assumed to be the same for all subsequent accident initiating events.

Operational characteristics (such as reactor power level; in-vessel temperature, pressure, and coolant level; equipment operability; and changes in decay heat load or plant conditions that allow new success criteria) are examined to identify those relevant to defining POSs. These characteristics are used to define the states, and the fraction of time spent in each state is estimated using plant-specific information.

The risk perspective is based on the total risk associated with the operation of the reactor, which includes not only full-power operation, but also low-power and shutdown conditions. For some applications, the risk impact may affect some modes of operation, but not others.

Initiating events are the events that have the ability to challenge the condition of the plant.

These events include failure of equipment from either internal plant causes (such as hardware faults, operator actions, floods, or fires), or external plant causes (such as earthquakes or high winds). The risk perspective is based on a consideration of the total risk, which includes events attributable to both internal and external sources.

1.2 Technical Elements of PRA Table 1 provides the list of general technical elements that are necessary for a PRA. A PRA that is missing one or more of these elements would not be considered a complete PRA. The following briefly discusses the objective of each element.

DG-1161, Page 7

Table 1. Technical Elements of a PRA Scope of Technical Element Analysis Level 1

  • Initiating event analysis
  • Parameter estimation analysis
  • Success criteria analysis
  • Human reliability analysis
  • Accident sequence analysis
  • Quantification
  • Systems analysis Level 2
  • Plant damage state analysis
  • Quantification
  • Accident progression analysis Interpretation of results and documentation are elements of both Level 1 and Level 2 PRAs.

These technical elements are equally applicable to the PRA models constructed to address each of the contributors to risk (i.e., internal and external initiating events) for each of the POSs. Because additional analyses are required to characterize their impact on the plant in terms of initiating events caused and mitigating equipment failed, internal floods, internal fires, and external hazards are discussed separately in Regulatory Positions 1.2.3, 1.2.4, and 1.2.5, respectively. Further, to understand the results, it is important to examine the different contributors on both an individual and relative basis. Therefore, this element, interpretation of results, is discussed separately in Regulatory Position 1.2.6. Another major element that is common to all of the technical elements is documentation; it is also discussed separately, in Regulatory Position 1.2.7.

1.2.1 Level 1 Technical Elements Initiating event analysis identifies and characterizes the events that both challenge normal plant operation during power or shutdown conditions and require successful mitigation by plant equipment and personnel to prevent core damage from occurring. Events that have occurred at the plant and those that have a reasonable probability of occurring are identified and characterized. An understanding of the nature of the events is performed such that a grouping of the events into event classes, with the classes defined by similarity of system and plant responses (based on the success criteria), may be performed to manage the large number of potential events that can challenge the plant.

Success criteria analysis determines the minimum requirements for each function (and ultimately the systems used to perform the functions) to prevent core damage (or to mitigate a release) given an initiating event. The requirements defining the success criteria are based on acceptable engineering analyses that represent the design and operation of the plant under consideration. For a function to be successful, the criteria are dependent on the initiator and the conditions created by the initiator. The computer codes used to perform the analyses for developing the success criteria are validated and verified for both technical integrity and suitability to assess plant conditions for the reactor pressure, temperature, and flow range of interest, and they accurately analyze the phenomena of interest.

Calculations are performed by personnel who are qualified to perform the types of analyses of interest and are well trained in the use of the codes.

DG-1161, Page 8

Accident sequence development analysis models, chronologically (to the extent practical), the different possible progressions of events (i.e., accident sequences) that can occur from the start of the initiating event to either successful mitigation or core damage. The accident sequences account for the systems that are used (and available) and operator actions performed to mitigate the initiator based on the defined success criteria and plant operating procedures (e.g., plant emergency and abnormal operating procedures) and training. The availability of a system includes consideration of the functional, phenomenological, and operational dependencies and interfaces between the various systems and operator actions during the course of the accident progression.

Systems analysis identifies the various combinations of failures that can prevent the system from performing its function as defined by the success criteria. The model representing the various failure combinations includes, from an as-built and as-operated perspective, the system hardware and instrumentation (and their associated failure modes) and human failure events that would prevent the system from performing its defined function. The basic events representing equipment and human failures are developed in sufficient detail in the model to account for dependencies among the various systems and to distinguish the specific equipment or human events that have a major impact on the systems ability to perform its function.

Parameter estimation analysis quantifies the frequencies of the initiating events, as well as the equipment failure probabilities and equipment unavailabilities of the modeled systems. The estimation process includes a mechanism for addressing uncertainties and has the ability to combine different sources of data in a coherent manner, including the actual operating history and experience of the plant when it is of sufficient quality, as well as applicable generic experience.

Human reliability analysis identifies and provides probabilities for the human failure events that can negatively impact normal or emergency plant operations. The human failure events associated with normal plant operation include the events that leave the system (as defined by the success criteria) in an unrevealed, unavailable state. The human failure events associated with emergency plant operation include the events that, if not performed, do not allow the needed system to function. Quantification of the probabilities of these human failure events is based on plant- and accident-specific conditions, where applicable, including any dependencies among actions and conditions.

Quantification provides an estimation of the CDF given the design, operation, and maintenance of the plant. This CDF is based on the summation of the estimated CDF from each accident sequence for each initiator class. If truncation of accident sequences and cutsets is applied, truncation limits are set so that the overall model results are not impacted in such a way that significant accident sequences or contributors3 are not eliminated. Therefore, the truncation limit can vary for each accident sequence.

Consequently, the truncation value is selected so that the accident sequence CDF is stable with respect to further reduction in the truncation value.

3 Significant accident sequence: A significant sequence is one of the set of sequences, defined at the functional or systemic level that, when ranked, compose 95% of the CDF or the LERF, or that individually contribute more than

~1% to the CDF or LERF.

Significant basic event/contributor: The basic events (i.e., equipment unavailabilities and human failure events) that have a Fussell-Vesely importance greater than 0.005 or a risk-achievement worth greater than 2.

DG-1161, Page 9

1.2.2 Level 2 Technical Elements Plant damage state analysis groups similar core damage scenarios together to allow a practical assessment of the severe accident progression and containment response resulting from the full spectrum of core damage accidents identified in the Level 1 analysis. The plant damage state analysis defines the attributes of the core damage scenarios that represent boundary conditions to the assessment of severe accidents progression and containment response that ultimately affect the resulting radionuclide releases.

The attributes address the dependencies between the containment systems modeled in the Level 2 analysis with the core damage accident sequence models to fully account for mutual dependencies. Core damage scenarios with similar attributes are grouped together to allow for efficient evaluation of the Level 2 response.

Severe accident progression analysis models the different series of events that challenge containment integrity for the core damage scenarios represented in the plant damage states. The accident progressions account for interactions among severe accident phenomena and system and human responses to identify credible containment failure modes, including failure to isolate the containment.

The timing of major accident events and the subsequent loadings produced on the containment are evaluated against the capacity of the containment to withstand the potential challenges. The containment performance during the severe accident is characterized by the timing (e.g., early versus late), size (e.g.,

catastrophic versus bypass), and location of any containment failures. The codes used to perform the analysis are validated and verified for both technical integrity and suitability. Calculations are performed by personnel qualified to perform the types of analyses of interest and well-trained in the use of the codes.

Source term analysis characterizes the radiological release to the environment resulting from each severe accident sequence leading to containment failure or bypass. The characterization includes the time, elevation, and energy of the release and the amount, form, and size of the radioactive material that is released to the environment. The source term analysis is sufficient to determine whether a large early release or a large late release occurs. A large early release is one involving the rapid, unmitigated release of airborne fission products from the containment to the environment occurring before the effective implementation of offsite emergency response and protective actions such that there is a potential for early health effects. Such accidents generally include unscrubbed releases associated with early containment failure at or shortly after vessel breach, containment bypass events, and loss of containment isolation. With large late release, unmitigated release from containment occurs in a time frame that allows effective evacuation of the close-in population such that early fatalities are unlikely.

Quantification integrates the accident progression models and source term evaluation to provide estimates of the frequency of radionuclide releases that could be expected following the identified core damage accidents. This quantitative evaluation reflects the different magnitudes and timing of radionuclide releases and specifically allows for identification of the LERF and the probability of a large late release.

DG-1161, Page 10

1.2.3 Internal Floods Technical Elements PRA models of internal floods are based on the internal events PRA model, modified to include the impact of the identified flood scenarios in terms of causing initiating events, and failing equipment used to respond to initiating events. These flood scenarios are developed during the flood identification analysis and the flood evaluation analysis. The quantification task specific to internal floods is similar in nature to that for the internal events. Because of its dependence on the internal events model, the flooding analysis incorporates the elements of Sections 1.2.1 and 1.2.2 as necessary.

Flood identification analysis identifies the plant areas where flooding could result in significant accident sequences. Flooding areas are defined on the basis of physical barriers, mitigation features, and propagation pathways. For each flooding area, flood sources that are attributable to equipment (e.g.,

piping, valves, pumps) and other sources internal to the plant (e.g., tanks) are identified along with the affected structures, systems, and components (SSCs). Flooding mechanisms examined include failure modes of components, human-induced mechanisms, and other water-releasing events. Flooding types (e.g., leak, rupture, spray) and flood sizes are determined. Plant walkdowns are performed to verify the accuracy of the information.

Flood evaluation analysis identifies the potential flooding scenarios for each flood source by identifying flood propagation paths of water from the flood source to its accumulation point (e.g., pipe and cable penetrations, doors, stairwells, failure of doors or walls). Plant design features or operator actions that have the ability to terminate the flood are identified. The susceptibility of each SSC in a flood area to flood-induced mechanisms is examined (e.g., submerge, spray, pipe whip, and jet impingement). Flood scenarios are developed by examining the potential for propagation and giving credit for flood mitigation. Flood scenarios can be eliminated on the basis of screening criteria. The screening criteria used are well-defined and justified.

Quantification provides an estimation of the CDF of the plant that includes internal floods. The frequency of flooding-induced initiating events that represent the design, operation, and experience of the plant are quantified. The Level 1 models are modified and the internal flood accident sequences quantified to (1) modify accident sequence models to address flooding phenomena, (2) perform necessary calculations to determine success criteria for flooding mitigation, (3) perform parameter estimation analysis to include flooding as a failure mode, (4) perform human reliability analysis to account for performance shaping factors that are attributable to flooding, and (5) quantify internal flood accident sequence CDF. Modifications of the Level 1 models are performed consistent with the appropriate boundary for Level 1 elements for transients and loss of coolant accidents (LOCAs).

1.2.4 Internal Fire Technical Elements PRA models of internal fires are based on the internal events PRA model, modified to include the impact of the identified fire scenarios in terms of causing initiating events (plant transients and LOCAs), and failing equipment used to respond to initiating events. These fire scenarios are developed during the screening analysis, fire initiation analysis, and the fire damage analysis. The plant response and quantification that is specific to internal fires is similar in nature to that for the internal events. Because of its dependence on the internal events model, the internal fire analysis incorporates the elements of Sections 1.2.1 and 1.2.2 as necessary DG-1161, Page 11

Screening analysis identifies fire areas where fires could result in significant accident sequences. Fire areas that cannot result in significant accident sequences can be screened out from further consideration in the PRA analysis. Both qualitative and quantitative screening criteria can be used. The former address whether an unsuppressed fire in the area poses a nuclear safety challenge; the latter are compared against a bounding assessment of the fire-induced core damage frequency for the area. Plant walkdowns are performed where possible to verify the accuracy of the information used in the screening analysis. Key screening analysis assumptions and results [e.g., the area-specific conditional core damage probabilities (assuming fire-induced loss of all equipment in the area)] are documented.

Fire initiation analysis determines the frequency and physical characteristics of the detailed (within-area) fire scenarios analyzed for the unscreened fire areas. The analysis identifies a range of scenarios that will be used to represent all possible scenarios in the area. The possibility of seismically induced fires is considered. The scenario frequencies reflect plant-specific experience, to the extent available and supplemented with industry fire information, and quantified in a manner that is consistent with its use in the subsequent fire damage analysis (discussed below). Each scenario is physically characterized in terms that will support the fire damage analysis (especially with respect to fire modeling).

Fire damage analysis determines the conditional probability that sets of potentially significant contributors (i.e., components including cables) will be damaged in a particular mode, given a specified fire scenario. The analysis addresses components whose failure will cause an initiating event, affect the plants ability to mitigate an initiating event, or affect potentially significant contributors (i.e.,

equipment), such as through suppression system actuation. Damage from heat, smoke, and exposure to suppressants is considered. If fire models are used to predict fire-induced damage, compartment-specific features (e.g., ventilation, geometry) and target-specific features (e.g., cable location relative to the fire) are addressed. The fire suppression analysis accounts for the scenario-specific time to detect, respond to, and suppress the fire. The models and data used to analyze fire growth, fire suppression, and fire-induced component damage are consistent with experience from actual nuclear power plant fires, as well as experiments.

Plant response analysis and quantification involves the modification of appropriate plant transient and LOCA PRA models to determine the conditional core damage probability, given damage to the sets of components defined in the fire damage analysis. All potentially fire-induced initiating events that can result in significant accident sequences, including such special events as loss of plant support systems and interactions between multiple nuclear units during a fire event, are addressed. The analysis addresses the availability of non-fire-affected equipment (including control) and any required manual actions. The human reliability analysis of operator actions addresses fire effects on operators (e.g., heat, smoke, loss of lighting, effect on instrumentation) and fire-specific operational issues (e.g., fire response operating procedures, training on these procedures, potential complications in coordinating activities).

1.2.5 External Hazards Technical Elements PRA models of external hazards, when required, are based on the internal events PRA model, which are modified to include the impact of the identified external event scenarios in terms of causing initiating events(plant transients and LOCAs), and failing equipment used to respond to initiating events.

However, it is prudent to perform a screening and bounding analysis to screen out those external events that have an insignificant impact on risk. When external events are modeled in detail, the external event scenarios are developed during the hazard analysis and the fragility analysis as discussed below. The quantification task specific to external events is similar in nature to that for the internal events. Because of its dependence on the internal events model, the external events analysis incorporates the elements of Sections 1.2.1 and 1.2.2 as necessary.

DG-1161, Page 12

Screening and bounding analysis identifies external events other than earthquakes (such as river-induced flooding) that may challenge plant operations and require successful mitigation by plant equipment and personnel to prevent core damage from occurring. The term screening out is used here for the process whereby an external event is excluded from further consideration in the PRA analysis.

There are two fundamental screening criteria embedded here. An event can be screened out if either (1) it meets the design criteria, or (2) it can be shown using an analysis that the mean value of the design-basis hazard used in the plant design is less than 10-5/year and that the conditional core-damage probability is less than 10-1, given the occurrence of the design-basis hazard. An external event that cannot be screened out using either of these criteria is subjected to the detailed analysis.

Hazard analysis characterizes non-screened external events and seismic events, generally, as frequencies of occurrence of different sizes of events (e.g., earthquakes with various peak ground accelerations, hurricanes with various maximum wind speeds) at the site. The external events are site-specific and the hazard characterization addresses both aleatory and epistemic uncertainties.

Fragility analysis characterizes conditional probability of failure of SSCs whose failure may lead to unacceptable damage to the plant (e.g., core damage) given occurrence of an external event. For significant contributors (i.e., SSCs), the fragility analysis is realistic and plant-specific. The fragility analysis is based on extensive plant walkdowns reflecting as-built, as-operated conditions.

Plant response analysis and quantification involves the modification of appropriate plant transient and LOCA PRA models to determine the conditional core damage probability, given damage to the sets of components identified. The external events PRA model includes initiating events resulting from the external events, external-event-induced SSC failures, non-external-event-induced failures (random failures), and human errors. The system analysis is well-coordinated with the fragility analysis and is based on plant walkdowns. The results of the external event hazard analysis, fragility analysis, and system models are assembled to estimate frequencies of core damage and large early release.

1.2.6 Interpretation of Results The results of the Level 1 PRA are examined to identify the contributors sorted by initiating events, accident sequences, equipment failures, and human errors. Methods such as importance measure calculations (e.g., Fussell-Vesely Importance, risk achievement worth, risk reduction worth, and Birnbaum Importance) are used to identify the contributions of various events to the estimation of CDF for both individual sequences and the total CDF [that is, both contributors to the total CDF, including the contribution from the different initiators (i.e., internal and external events) and different operating modes (i.e., full- and low-power and shutdown) and contributors to each contributing sequence are identified].

The results of the Level 2 PRA are examined to identify the contributions of various events to the model estimation of LERF and large late release probability for both individual sequences and the model as a total, using such tools as importance measure calculations (e.g., Fussell-Vesely Importance, risk achievement worth, risk reduction worth, and Birnbaum Importance).

DG-1161, Page 13

An important aspect in understanding the PRA results is understanding the associated uncertainties. Key sources of uncertainty4 are identified and their impact on the results analyzed. The potential conservatism associated with the successive screening approach used for the analysis of specific scope items such as fire, flooding, or seismic initiating events is assessed. The sensitivity of the model results to model boundary conditions and other key assumptions5 is evaluated using sensitivity analyses to look at key assumptions both individually or in logical combinations. The combinations analyzed are chosen to account for interactions among the variables.

1.2.7 Documentation Traceability and defensibility provide the necessary information such that the results can easily be reproduced and justified. The sources of information used in the PRA are both referenced and retrievable. The methodology used to perform each aspect of the work is described either through documenting the actual process or through reference to existing methodology documents. Key sources of uncertainty are identified and their impact on the results assessed. Key assumptions made in performing the analyses are identified and documented along with their justification to the extent that the context of the assumption is understood. The results (e.g., products and outcomes) from the various analyses are documented. A key source of uncertainty is one that is related to an issue where there is no consensus approach or model (e.g., choice of data source, success criteria, reactor coolant pressure (RCP) seal LOCA model, human reliability model) and where the choice of approach or model is known to have an impact on the PRA results in terms of introducing new accident sequences, changing the relative importance of sequences, or affecting the overall CDF or LERF estimates that might have an impact on the use of the PRA in decision-making. A key assumption is one that is made in response to a key source of uncertainty.

1.3 Attributes and Characteristics of the PRA Technical Elements Tables 2 and 3 describe, for each technical element of a PRA, the technical characteristics and attributes that provide one acceptable approach for determining the technical adequacy of the PRA such that the goals and purposes, defined in Regulatory Position 1.2, are accomplished.

For each given technical element, the level of detail may vary. The detail may vary from the degree to which (1) plant design and operation is modeled, (2) specific plant experience is incorporated into the model, and (3) realism is incorporated into the analyses that reflect the expected plant response.

Regardless of the level of detail developed in the PRA, the characteristics and attributes provided below are included. That is, each characteristic and attribute is always included, but the degree to which it is included, as described above, may vary.

4 A key source of uncertainty is one that is related to an issue in which there is no consensus approach or model and where the choice of approach or model is known to have an impact on the risk profile (e.g., total CDF and total LERF, the set of initiating events and accident sequences that contribute most to CDF and to LERF) or a decision being made using the PRA. Such an impact might occur, for example, by introducing new functional accident sequence or a change to the overall CDF or LERF estimates significant enough to affect insights gained from the PRA.

5 A key assumption is one that is made in response to a key source of uncertainty in the knowledge that a different reasonable alternative assumption would produce different results, or an assumption that results in an approximation made for modeling convenience in the knowledge that a more detailed model would produce different results. For the base PRA, the term different results refers to a change in the risk profile and the associated changes in insights derived from the changes in the risk profile. A reasonable alternative assumption is one that has broad acceptance within the technical community and for which the technical basis for consideration is at least as sound as that of the assumption being challenged.

DG-1161, Page 14

The level of detail needed is dependent on the application. The application may involve using the PRA during different plant stages (i.e., design, construction, and operation). Consequently, a PRA used to support a design certification will not have the same level of detail as a PRA of a plant that has years of operating experience. While it is recognized that the same level of detail is not needed, each of the technical elements and its attributes has to be addressed.

Table 2. Summary of Technical Characteristics and Attributes of a PRA Element Technical Characteristics and Attributes PRA Full-Power, Low-Power, and Shutdown Level 1 PRA (internal events transients and LOCAs)

Initiating

  • sufficiently detailed identification and characterization of initiators Event
  • grouping of individual events according to plant response and mitigating requirements Analysis
  • based on best-estimate engineering analyses applicable to the actual plant design and Criteria operation Analysis
  • codes developed, validated, and verified in sufficient detail

< analyze the phenomena of interest

< be applicable in the pressure, temperature, and flow range of interest Accident

  • defined in terms of hardware, operator action, and timing requirements and desired end Sequence states [e.g., core damage or plant damage states (PDSs)]

Development

  • includes necessary and sufficient equipment (safety and non-safety) reasonably expected Analysis to be used to mitigate initiators
  • includes functional, phenomenological, and operational dependencies and interfaces Systems models developed in sufficient detail to achieve the following purposes:

Analysis

  • reflect the as-built, as-operated plant including how it has performed during the plant history
  • reflect the success criteria for the systems to mitigate each identified accident sequence
  • capture impact of dependencies, including support systems and harsh environmental impacts
  • include both active and passive components and failure modes that impact the function of the system
  • include common-cause failures, human errors, unavailability resulting from test and maintenance, etc.

Parameter

  • estimation of parameters associated with initiating event, basic event probability models, Estimation recovery actions, and unavailability events using plant-specific and generic data as Analysis applicable
  • consistent with component boundaries
  • estimation includes a characterization of the uncertainty Human
  • identification and definition of the human failure events that would result in initiating Reliability events or pre- and post-accident human failure events that would impact the mitigation of Analysis initiating events
  • quantification of the associated human error probabilities taking into account scenario (where applicable) and plant-specific factors and including appropriate dependencies (both pre- and post-accident)

DG-1161, Page 15

Table 2. Summary of Technical Characteristics and Attributes of a PRA Element Technical Characteristics and Attributes Quantification

  • estimation of the CDF for modeled sequences that are not screened as a result of truncation, given as a mean value
  • estimation of the accident sequence CDFs for each initiating event group
  • truncation values set relative to the total plant CDF such that the CDF is stable with respect to further reduction in the truncation value Level 2 PRA Plant Damage
  • identification of the attributes of the core damage scenarios that influence severe State Analysis accident progression, containment performance, and any subsequent radionuclide releases
  • grouping of core damage scenarios with similar attributes into plant damage states
  • carryover of relevant information from Level 1 to Level 2 Severe
  • use of verified, validated codes by qualified trained users with an understanding of the Accident code limitations and the means for addressing the limitations Progression
  • assessment of the credible severe accident phenomena via a structured process Analysis
  • assessment of containment system performance including linkage with failure modes on non-containment systems
  • establishment of the capacity of the containment to withstand severe accident environments
  • assessment of accident progression timing, including timing of loss of containment failure integrity Quantification
  • estimation of the frequency of different containment failure modes and resulting radionuclide source terms Source Term
  • assessment of radionuclide releases including appreciation of timing, location, amount Analysis and form of release
  • grouping of radionuclide releases into smaller subsets of representative source terms with emphasis on large early release and large late release In addressing the above elements, because of the nature and impact of internal flood and fire and external hazards, their attributes are discussed separately in Table 3. This is because flood, fire, and external hazards analyses are spatial in nature and have the ability to cause initiating events but also have the capability to impact the availability of mitigating systems. Therefore, regarding the PRA model, the impact of flood, fire, and external hazards is to be considered in each of the above technical elements.

DG-1161, Page 16

Table 3. Summary of Technical Characteristics and Attributes of an Internal Flood and Fire Analysis and External Hazards Analysis Areas of Analysis Technical Characteristics and Attributes*

Internal Flood Analysis Flood Identification

  • sufficiently detailed identification and characterization of the following:

Analysis < flood areas and SSCs located within each area

< flood sources and flood mechanisms

< type of water release and capacity

< structures functioning as drains and sumps

  • verification of the information through plant walkdowns Flood Evaluation
  • identification and evaluation of the following:

Analysis < flood propagation paths

< flood mitigating plant design features and operator actions

< the susceptibility of SSCs in each flood area to the different types of floods

  • elimination of flood scenarios uses well-defined and justified screening criteria Quantification
  • identification of flooding-induced initiating events on the basis of a structured and systematic process
  • estimation of flooding initiating event frequencies
  • estimation of CDF for chosen flood sequences
  • modification of the Level 1 models to account for flooding effects including uncertainties Internal Fire Analysis Screening Analysis
  • fire areas are identified and addressed that can result in significant accident sequences
  • all credited mitigating components and their cables in each fire area are identified
  • screening criteria are defined and justified
  • necessary walkdowns are performed to confirm the screening decisions
  • screening process and results are documented
  • unscreened events areas are subjected to appropriate level of evaluations (including detailed fire PRA evaluations as described below)

Initiation Analysis

  • fire scenarios in each unscreened area are addressed that can result in significant accident sequence
  • fire scenario frequencies reflect plant-specific features
  • fire scenario physical characteristics are defined
  • bases are provided for screening fire initiators Damage Analysis
  • damage to significant contributors (i.e., components) is addressed, considering all potential component failure modes
  • all potentially significant contributors (i.e., damage mechanisms) are identified and addressed, and damage criteria are specified
  • analysis addresses scenario-specific factors affecting fire growth, suppression, and component damage
  • models and data are consistent with experience from actual fires, as well as experiments
  • includes evaluation of propagation of fire and fire effects (e.g., smoke) between fire compartments DG-1161, Page 17

Table 3. Summary of Technical Characteristics and Attributes of an Internal Flood and Fire Analysis and External Hazards Analysis Areas of Analysis Technical Characteristics and Attributes*

Plant Response Analysis

  • fire-induced initiating events that can result in significant accident sequences are addressed so that their bases are included in the model
  • includes fire scenario impacts on core damage mitigation and containment systems, including fire-induced failures
  • potential circuit interactions that can interfere with safe shutdown are addressed
  • human reliability analysis addresses effect of fire scenario-specific conditions on operator performance Quantification
  • estimation of fire CDF for chosen fire scenarios
  • identification of sources of uncertainty and their impact on the results
  • understanding of the impact of the key assumptions on the CDF
  • all fire-significant sequences are traceable and reproducible External Hazards Analysis Screening and Bounding
  • credible external events (natural and man-made) that may affect the site are Analysis addressed
  • screening and bounding criteria are defined and results are documented
  • necessary walkdowns are performed
  • non-screened events are subjected to an appropriate level of evaluations Hazard Analysis
  • the hazard analysis is site- and plant-specific
  • the hazard analysis addresses uncertainties Fragility Analysis
  • fragility estimates are plant-specific for significant contributors (i.e., SSCs)
  • walkdowns are conducted to identify plant-unique conditions, failure modes, and as-built conditions Plant response analysis
  • external event caused initiating events that can lead to significant core damage and quantification and large early release sequences are included
  • external event-related unique failures and failure modes are incorporated
  • equipment failures from other causes and human errors are included.

When necessary, human error data are modified to reflect unique circumstances related to the external event under consideration

  • unique aspects of common causes, correlations, and dependencies are included
  • the systems model reflects as-built, as-operated plant conditions
  • the integration/quantification accounts for the uncertainties in each of the inputs (i.e., hazard, fragility, system modeling) and final quantitative results such as CDF and LERF
  • the integration/quantification accounts for all dependencies and correlations that affect the results In understanding the results from a PRA, the different initiators and operating states need to be considered, in an integrated manner, when examining the results. The attributes for interpretation of the results are discussed separately in Table 4.

DG-1161, Page 18

Table 4. Summary of Technical Characteristics and Attributes for Interpretation of Results Element Technical Characteristics and Attributes Level 1 PRA Interpretation of

  • identification of the key contributors to CDF (initiating events, accident sequences, Results equipment failures and human errors)
  • identification of key sources of uncertainty and their impact on the results
  • understanding of the impact of the key assumptions on the CDF and the identification of the accident sequence and their contributors Level 2 PRA Interpretation of
  • identification of the contributors to containment failure and resulting source terms Results
  • identification of key sources of uncertainty and their impact on the results
  • understanding of the impact of the key assumptions on Level 2 results A significant aspect of the technical acceptability of the PRA is documentation. The attributes for documentation are discussed separately in Table 5.

Table 5. Summary of Technical Characteristics and Attributes for Documentation Element Technical Characteristics and Attributes Traceability and

  • the documentation is sufficient to facilitate independent peer reviews defensibility
  • the documentation describes the interim and final results, insights, and key sources of uncertainties
  • walkdown process and results are fully described 1.4 PRA Development, Maintenance, and Upgrade The PRA results used to support an application are derived from a PRA model that represents the as-built, as-operated plant to the extent needed to support the application. Therefore, a process for developing, maintaining, and upgrading a PRA is established. This process involves identifying and using plant information to develop the original PRA and to modify the PRA. The process is performed such that the plant information identified and used in the PRA reflects the as-built, as-operated plant.6 The information sources include the applicable design, operation, maintenance, and engineering characteristics of the plant For those SSCs and human actions used in the development of the PRA, the following information is identified, integrated, and used in the PRA:
  • plant design information reflecting the normal and emergency configurations of the plant
  • plant operational information with regard to plant procedures and practices
  • plant test and maintenance procedures and practices
  • engineering aspects of the plant design 6

It is recognized that at the design certification or combined operating license stage where the plant is not built or operated, the term as-built, as-operated is meant to reflect the as-designed plant assuming operational conditions for the given design.

DG-1161, Page 19

Further, plant walkdowns are conducted to ensure that information sources being used actually reflects the plants as-built, as-operated condition. In some cases, corroborating information obtained from the documented information sources for the plant and other information may only be gained by direct observations.

Table 6 describes the characteristics and attributes that need to be included for the above types of information.

Table 6. Summary of Attributes and Characteristics for Information Sources Used in PRA Development Type of Attributes and Characteristics Information Design

  • the safety functions required to maintain the plant in a safe stable state and prevent core or containment damage
  • identification of those SSCs that are credited in the PRA to perform the above functions
  • the functional relationships among the SSCs including both functional and hardware dependencies
  • the normal and emergency configurations of the SSCs
  • the automatic and manual (human interface) aspects of equipment initiation, actuation, operation, as well as isolation and termination
  • the SSCs capabilities (flows, pressures, actuation timing, environmental operating limits)
  • spatial layout, sizing, and accessibility information related to the credited SSCs
  • other design information needed to support the PRA modeling of the plant Operational
  • that information needed to reflect the actual operating procedures and practices used at the plant including when and how operators interface with plant equipment as well as how plant staff monitor equipment operation and status
  • that information needed to reflect the operating history of the plant as well as any events involving significant human interaction Maintenance
  • that information needed to reflect planned and typical unplanned tests and maintenance activities and their relationship to the status, timing, and duration of the availability of equipment
  • historical information related to the maintenance practices and experience at the plant Engineering
  • the design margins in the capabilities of the SSCs
  • operating environmental limits of the equipment
  • expected thermal hydraulic plant response to different states of equipment (such as for establishing success criteria)
  • other engineering information needed to support the PRA modeling of the plant As a plant operates over time, its associated risk may change. This change may occur for the following reasons:
  • The PRA model may change as a result of improved methods or techniques.
  • Operating data may change the availability or reliability of the plants structures, systems and components.
  • Plant design or operation may change.

DG-1161, Page 20

Therefore, to ensure that the PRA represents the risk of the current as-built and as-operated plant, the PRA needs to be maintained and upgraded over time. Table 7 provides the attributes and characteristics of an acceptable process.

Table 7. Summary of Characteristics and Attributes for PRA Maintenance and Upgrade Characteristics and Attributes

  • Monitor PRA inputs and collect new information
  • Ensure cumulative impact of pending plant changes are considered
  • Maintain configuration control of the computer codes used in the PRA
  • Identify when PRA needs to be updated based on new information or new models/techniques/tools
  • Ensure peer review is performed on PRA upgrades
2. Consensus PRA Standards and Industry PRA Programs One acceptable approach to demonstrate conformance with Regulatory Position 1 is to use an industry consensus PRA standard or standards that address the scope of the PRA used in the decision-making; an alternative acceptable approach to using an industry consensus PRA standard is to use an industry-developed peer review program.

If PRA consensus standards or industry-developed peer review programs are used to demonstrate conformance with Regulatory Position 1, the staff position on these documents needs to be taken into account. If other sources are used (e.g., in the standard) as an acceptable means for meeting the standard, those references are only acceptable if the staff has endorsed that specific requirement. That is, documents referenced in the standard are acceptable if they are associated with a specific requirement that has been endorsed by the staff.

2.1 Consensus PRA Standards In general, if a PRA standard is used to demonstrate conformance with Regulatory Position 1, the standard should be based on a set of principles and objectives. Table 8 provides an acceptable set of principles and objectives that were established and used by ASME. Principle 3 recognizes that the various parts of a PRA can be, and are generally, performed to different capabilities. In developing the various models in the PRA, the different capabilities are distinguished by three attributes, determined by the degree to which the following criteria are met:

(1) The scope and level of detail that reflects the plant design, operation, and maintenance may vary.

(2) Plant-specific information versus generic information is used, such that the as-built and as-operated plant is addressed.

(3) Realism is incorporated, such that the expected response of the plant is addressed.

It is recognized that the various parts of a PRA will not be to the same capability category.

Which part of the PRA meets what capability category is dependent on the specific application.

DG-1161, Page 21

Table 8. Principles and Objectives of a Standard

1. The PRA standard provides well-defined criteria against which the strengths and weaknesses of the PRA may be judged so that decision-makers can determine the degree of reliance that can be placed on the PRA results of interest.
2. The standard is based on current good practices(see Note below) as reflected in publicly available documents.

The need for the documentation to be publicly available follows from the fact that the standard may be used to support safety decisions.

3. To facilitate the use of the standard for a wide range of applications, categories can be defined to aid in determining the applicability of the PRA for various types of applications.
4. The standard thoroughly and completely defines what is technically required and should, where appropriate, identify one or more acceptable methods.
5. The standard requires a peer review process that identifies and assesses where the technical requirements of the standard are not met. The standard needs to ensure that the peer review process meets the following criteria:

< determines whether methods identified in the standard have been used appropriately

< determines that, when acceptable methods are not specified in the standard, or when alternative methods are used in lieu of those identified in the standard, the methods used are adequate to meet the requirements of the standard

< assesses the significance of the results and insights gained from the PRA of not meeting the technical requirements in the standard

< highlights key [emphasis added] assumptions that may significantly [emphasis removed] impact the results and provides an assessment of the reasonableness of the assumptions

< is flexible and accommodates alternative peer review approaches

< includes a peer review team that is composed of members who are knowledgeable in the technical elements of a PRA, are familiar with the plant design and operation, and are independent with no conflicts of interest that may influence the outcome of the peer review [this clause was not in the ASME definition]

6. The standard addresses the maintenance and update of the PRA to incorporate changes that can substantially impact the risk profile so that the PRA adequately represents the current as-built and as-operated plant.
7. The standard is a living document. Consequently, it should not impede research. It is structured so that, when improvements in the state of knowledge occur, the standard can easily be updated.

Note: Current good practices are those practices that are generally accepted throughout the industry and have shown to be technically acceptable in documented analyses or engineering assessments. [No definition was provided for these terms by ASME.]

The standards are written in terms of requirements. These requirements will be either process in nature, or technical in nature. The process type requirements address the process for application, development, maintenance and upgrade, and peer review. The technical requirements address the technical elements of the PRA and what is necessary to adequately perform that element.

Therefore, when a standard is used to demonstrate conformance with Regulatory Position 1, the requirements in the standard will need to be met. As a general rule, a requirement of a standard is met when it is demonstrated that there is clear evidence of an intent to meet the requirement.

DG-1161, Page 22

For process requirements, the intent, is generally straightforward and the requirement is either met or not met. For the technical requirements, it s not always as straightforward. Many of the technical requirements in a standard apply to several parts of the PRA model. For example, the requirements for systems analysis apply to all systems modeled, and certain of the data requirements apply to all parameters for which estimates are provided. If among these systems or parameter estimates there are a few examples in which a specific requirement has not been met, it is not necessarily indicative that this requirement has not been met. If, the requirement has been met for the majority of the systems or parameter estimates, and the few examples can be put down to mistakes or oversights, the requirement would be considered to be met. If, however, there is a systematic failure to address the requirement (e.g., component boundaries have not been defined anywhere), then the requirement has not been complied with. In either case, the examples of noncompliance are to be (1) rectified or demonstrated not to be relevant to the application, and (2) documented.

Further, the technical requirements may be defined at two different levels: (1) high-level requirements, and (2) supporting requirements. High-level requirements are defined for each technical element and capture the objective of the technical element. These high-level requirements are defined in general terms, need to be met regardless of the capability category, and accommodate different approaches. Supporting requirements are defined for each high-level requirement. These supporting requirements are those minimal requirements needed to satisfy the high-level requirement.

Consequently, determination of whether a high-level requirement is met, is based on whether the associated supporting requirements are met. Whether or not every supporting requirement is needed for a high-level requirement is application-dependent and is determined by the application process requirements.

One example of an industry consensus PRA standard is the ASME standard, with a scope for a PRA for Level 1 and limited Level 2 (LERF) for full-power operation and internal events (excluding internal fires). The staff regulatory position regarding this document is provided in Appendix A to this regulatory guide. If it is demonstrated that the parts of a PRA that are used to support an application comply with the ASME standard, when supplemented to account for the staffs regulatory positions contained in Appendix A, it is considered that the PRA is adequate to support that risk-informed regulatory application.

Additional appendices will be added in future updates to this regulatory guide to address PRA standards for other risk contributors, such as accidents caused by external hazards or internal fire or caused during the low-power and shutdown modes of operation.

2.2 Industry Peer Review Program An acceptable approach that can be used to ensure technical adequacy is to perform a peer review of the PRA. A peer review process can be used to identify the strengths and weaknesses in the PRA and their importance to the confidence in the PRA results. A peer review process is provided in the ASME standard and in the industry-developed peer review program (i.e., NEI-00-02, Ref. 9). The staff regulatory position on the process in the ASME PRA Standard and in NEI-00-02 is provided in Appendices A and B, respectively, to this regulatory guide. When the staffs regulatory positions contained in Appendices A and B are taken into account, use of these processes can be used to demonstrate that the PRA is adequate to support a risk-informed application.

DG-1161, Page 23

The peer review is to be performed against established standards (e.g., ASME PRA Standard).

If different criteria are used than in the established standard, then it needs to be demonstrated that these different criteria are consistent with the established standards, as endorsed by the NRC. NEI-00-02 provides separate criteria for a peer review of a Level 1/LERF PRA at full-power for internal events, excluding internal flood and fire and external events. NEI-00-02 also provides guidance for resolution of the differences between the established standards, as endorsed by the NRC (i.e., ASME PRA Standard and Appendix A to this guide) and its peer review criteria. The staff position on this guidance (referred to as the Licensee Self-Assessment Guidance), is provided in Appendix B to this guide. When the staffs regulatory positions contained in Appendix B are taken into account, use of the peer reviews performed using NEI-00-02 can be used to demonstrate that the PRA is adequate to support a risk-informed application, with regard to a Level 1/LERF PRA for full-power for internal events (excluding internal floods and fires and external events).

If a peer review process is used to demonstrate conformance with Regulatory Position 1, an acceptable peer review approach is one that is performed by qualified personnel and, according to an established process that compares the PRA against the characteristics and attributes, documents the results and identifies both strengths and weaknesses of the PRA.

The team qualifications determine the credibility and adequacy of the peer reviewers. To avoid any perception of a technical conflict of interest, the peer reviewers will not have performed any actual work on the PRA. Each member of the peer review team must have technical expertise in the PRA elements he or she reviews, including experience in the specific methods that are used to perform the PRA elements. This technical expertise includes experience in performing (not just reviewing) the work in the element assigned for review. Knowledge of the key features specific to the plant design and operation is essential. Finally, each member of the peer review team must be knowledgeable in the peer review process, including the desired characteristics and attributes used to assess the adequacy of the PRA.

The peer review process includes a documented procedure used to direct the team in evaluating the adequacy of a PRA. The review process compares the PRA against desired PRA characteristics and attributes such as those provided in Regulatory Position 1.3 and elaborated on in a PRA standard. In addition to reviewing the methods used in the PRA, the peer review determines whether the methods were applied correctly. The PRA models are compared against the plant design and procedures to validate that they reflect the as-built and as-operated plant. Key assumptions are reviewed to determine if they are appropriate and to assess their impact on the PRA results. The PRA results are checked for fidelity with the model structure and for consistency with the results from PRAs for similar plants based on the peer reviewers knowledge. Finally, the peer review process examines the procedures or guidelines in place for updating the PRA to reflect changes in plant design, operation, or experience.

Consequently, over time, additional peer review may be needed (see Regulatory Position 1.4).

Documentation provides the necessary information such that the peer review process and the findings are both traceable and defensible. Descriptions of the qualifications of the peer review team members and the peer review process are documented. The results of the peer review for each technical element and the PRA update process are described, including the areas in which the PRA does not meet or exceed the desired characteristics and attributes used in the review process. This includes an assessment of the importance of any identified deficiencies on the PRA results and potential uses and how these deficiencies were addressed and resolved.

Table 9 provides a summary of the characteristics and attributes of a peer review.

DG-1161, Page 24

Table 9. Summary of the Characteristics and Attributes of a Peer Review Element Characteristics and Attributes Team

  • independent with no conflicts of interest Qualifications
  • collectively represent expertise in all the technical elements of a PRA including integration
  • expertise in the technical element assigned to review
  • knowledge of the plant design and operation
  • knowledge of the peer review process Peer Review
  • uses documented process Process
  • uses as a basis for review a set of desired PRA characteristics and attributes
  • uses a minimum list of review topics to ensure coverage, consistency, and uniformity
  • reviews PRA methods
  • reviews application of methods
  • reviews key assumptions and assesses their validity and appropriateness
  • determines if PRA represents as-built and as-operated plant
  • reviews results of each PRA technical element for reasonableness
  • reviews PRA maintenance and update process
  • reviews PRA modification attributable to use of different model, techniques, or tools Documentation
  • describes the peer review team qualifications
  • describes the peer review process
  • documents where PRA does not meet desired characteristics and attributes
  • assesses and documents significance of deficiencies
3. Demonstrating the Technical Adequacy of a PRA Used to Support a Regulatory Application This section of the regulatory guide addresses the third purpose identified above, namely, to provide guidance to licensees on an approach acceptable to the NRC staff to demonstrate that the quality of the PRA used, in total or the parts that are used to support a regulatory application, is sufficient to support the analysis.

The application-specific regulatory guides identify the specific PRA results to support the decision-making and the analysis needed to provide those results. The parts of the PRA to support that analysis must be identified, and it is for these elements that the guidance in this regulatory guide is applied. Regulatory Positions 3.1 and 3.2 summarize the expected outcome of the application of the application-specific regulatory guides in determining the scope of application of this regulatory guide.

3.1 Identification of Parts of a PRA Used To Support the Application When using this regulatory guide, it is anticipated that the licensees description of the application will include the following:

  • SSCs, operator actions, and plant operational characteristics affected by the application
  • a description of the cause-effect relationships among the change and the above SSCs, operator actions, and plant operational characteristics
  • mapping of the cause-effect relationships onto PRA model elements DG-1161, Page 25
  • a definition of the acceptance criteria:

< identification of the PRA results that will be used to compare against the acceptance criteria or guidelines and how the comparison is to be made

< the scope of risk contributors to support the decision Based on an understanding of how the PRA model is to be used to achieve the desired results, the licensee will have identified the parts of the PRA required to support a specific application. These include (1) the logic model events onto which the cause-effect relationships are mapped (i.e., those directly affected by the application), (2) all the events that appear in the accident sequences in which the first group of elements appear, and (3) the parts of the analysis required to evaluate the necessary results.

For some applications, this may be a limited set, but for others (e.g., risk-informing the scope of special treatment requirements), all parts of the PRA model are relevant.

3.2 Scope of Risk Contributors Addressed by the PRA Model Based on the definition of the application, and in particular the acceptance criteria or guidelines, the scope of risk contributors (internal and external initiating events and modes of plant operation) for the PRA is identified. For example, if the application is designed around using the acceptance guidelines of RG 1.174, the evaluations of CDF, CDF, LERF, and LERF should be performed with a full-scope PRA, including external initiating events and all modes of operation. However, since most PRAs do not address this full scope, the decision-makers must make allowances for these omissions. Examples of approaches to making allowances include the introduction of compensatory measures, restriction of the implementation of the proposed change to those aspects of the plant covered by the risk model, and use of bounding arguments to cover the risk contributions not addressed by the model. This regulatory guide does not address this aspect of decision-making, but it is focused specifically on the quality of the PRA information used.

The PRA standards and industry PRA programs that have been, or are in the process of being, developed address a specific scope. For example, the ASME PRA Standard addresses internal events at full-power for a limited Level 2 PRA analysis. Similarly NEI-00-02 is a peer review process for the same scope (with the exception of internal flooding, which is not considered in NEI-00-02). Neither addresses external (including internal fire) initiating events or the low-power and shutdown modes of operation.

The different PRA standards or industry PRA programs are addressed separately in appendices to this regulatory guide. In using this regulatory guide, the applicant will identify which of these appendices is applicable to the PRA analysis.

3.3 Demonstration of Technical Adequacy of the PRA There are two aspects to demonstrating the technical adequacy of the parts of the PRA to support an application. The first aspect is the assurance that the parts of the PRA used in the application have been performed in a technically correct manner, and the second aspect is the assurance that the assumptions and approximations used in developing the PRA are appropriate.

DG-1161, Page 26

For the first, assurance that the parts of the PRA used in the application have been performed in a technically correct manner implies that (1) the PRA model, or those parts of the model required to support the application, represents the as-built and as-operated plant, which, in turn, implies that the PRA is up to date and reflects the current design and operating practices, (2) the PRA logic model has been developed in a manner consistent with industry good practice (see footnote to Table 8) and that it correctly reflects the dependencies of systems and components on one another and on operator actions, and (3) the probabilities and frequencies used are estimated consistently with the definitions of the corresponding events of the logic model.

For the second, the current state of the art in PRA technology is that there are issues for which there is no consensus on methods of analysis. Furthermore, PRAs are models, and in that sense the developers of those models rely on certain approximations to make the models tractable and on certain assumptions to address uncertainties as to how to model specific issues. This is recognized in RG 1.174, which gives guidance on how to address the uncertainties. In accordance with that guidance, the impact of these assumptions and approximations on the results of interest to the application needs to be understood.

3.3.1 Assessment that the PRA Model is Technically Correct When using risk insights based on a PRA model, the applicant must ensure that the PRA model, or at least those parts of it needed to provide the results, is technically correct as discussed above.

The licensee is to demonstrate that the model is up to date in that it represents the current plant design and configuration and represents current operating practices to the extent required to support the application. This demonstration can be achieved through a PRA maintenance plan that includes a commitment to update the model periodically to reflect changes that impact the significant accident sequences.

The various consensus PRA standards and industry PRA programs that provide guidance on the performance of, or reviews of, PRAs are addressed individually in the appendices to this regulatory guide. These appendices document the staffs regulatory position on each of these standards or programs.

When the issues raised by the staff are taken into account, the standard or program in question may be interpreted to be adequate for the purpose for which it was intended. If the parts of the PRA can be shown to have met the requirements of these documents, with attention paid to the NRCs clarifications or qualifications, it can be assumed that the analysis is technically correct. Therefore, other than an audit, a detailed review by NRC staff of the base model PRA will not be necessary. When deviations from these documents exist, the applicant must demonstrate either that its approach is equivalent or that the influence on the results used in the application are such that no changes occur in the significant accident sequences or contributors.

DG-1161, Page 27

3.3.2 Assessment of Assumptions and Approximations Since the standards and industry PRA programs are not (or are not expected to be) prescriptive, there is some freedom on how to model certain phenomena or processes in the PRA; different analysts may make different assumptions and still be consistent with the requirements of the standard or the assumptions may be acceptable under the guidelines of the peer review process. The choice of a specific assumption or a particular approximation may, however, influence the results of the PRA. For each application that calls upon this regulatory guide, the applicant identifies the key assumptions and approximations relevant to that application. This will be used to identify sensitivity studies as input to the decision-making associated with the application. Each of the documents addressed in the appendices either requires, or in the case of the industry peer review program, represents, a peer review. One of the functions of the peer review is to address the assumptions and make judgments as to their appropriateness. This in turn provides a basis for the sensitivity studies.

4. Documentation to Support a Regulatory Submittal The licensee develops documentation of the PRA model and the analyses performed to support the risk-informed regulatory activity. This documentation comprises both archival (i.e., available for audit) and submittal (i.e., submitted as part of the risk-informed request) documentation. The former may be required on an as needed basis to facilitate the NRC staffs review of the risk-informed submittal.

4.1 Archival Documentation Archival documentation associated with the base PRA includes the following:

  • A detailed description of the process used to determine the adequacy of the PRA.
  • The results of the peer review and/or self-assessment, and a description of the resolution of all the peer review or self-assessment findings and observations. The results are documented in such a manner that it is clear why each requirement is considered to have been met. This can be done, for example, by providing a reference to the appropriate section of the PRA model documentation.
  • The complete documentation of the PRA model. If the staff elects to perform an audit on all or any parts of the PRA used in the risk-informed application, the documentation maintained by the licensee must be legible, retrievable (i.e., traceable), and of sufficient detail that the staff can comprehend the bases supporting the results used in the application. Regulatory Position 1.3 of this guide provides the attributes and characteristics of archival documentation associated with the base PRA.
  • A description of the process for maintenance and upgrade of the PRA. The history of the maintenance and upgrade activities are maintained, and include the results of any peer reviews that were performed to as a result of maintenance or upgrade.

The archival documentation associated with a specific application is expected to include enough information to demonstrate that the scope of the review of the base PRA is sufficient to support the application. This includes the following information:

  • the impact of the application on the plant design, configuration, or operational practices
  • the risk assessment, including a description of the methodology used to assess the risk of the application, how the base PRA model was modified to appropriately model the risk impact of the application, and details of quantification and the results DG-1161, Page 28
  • the acceptance guidelines and method of comparison
  • the scope of the risk assessment in terms of initiating events and operating modes modeled
  • the parts of the PRA required to provide the results needed to support comparison with the acceptance guidelines 4.2 Licensee Submittal Documentation To demonstrate that the technical adequacy of the PRA used in an application is of sufficient quality, the staff expects the following information will be submitted to the NRC. Previously submitted documentation may be referenced if it is adequate for the subject submittal:
  • To address the need for the PRA model to represent the as-built, as-operated plant, identification of permanent plant changes (such as design or operational practices) that have an impact on those things modeled in the PRA but have not been incorporated in the baseline PRA model.

If a plant change has not been incorporated, the licensee provides a justification of why the change does not impact the PRA results used to support the application. This justification can be in the form of a sensitivity study that demonstrates the accident sequences or contributors significant to the application were not impacted (remained the same).

  • Documentation that the parts of the PRA required to produce the results used in the decision are performed consistently with the standard as endorsed in the appendices of this regulatory guide.

If a requirement of the standard (as endorsed in the appendix to this guide) has not been met, the licensee is to provide a justification of why it is acceptable that the requirement has not been met.

This justification should be in the form of a sensitivity study that demonstrates the accident sequences or contributors significant to the application were not impacted (remained the same).

  • A summary of the risk assessment methodology used to assess the risk of the application, including how the base PRA model was modified to appropriately model the risk impact of the application and results. (Note that this is the same as that required in the application-specific regulatory guides.)
  • Identification of the key assumptions and approximations relevant to the results used in the decision-making process. Also, include the peer reviewers assessment of those assumptions.

These assessments provide information to the NRC staff in their determination of whether the use of these assumptions and approximations is appropriate for the application, or whether sensitivity studies performed to support the decision are appropriate.

  • A discussion of the resolution of the peer review or self-assessment findings and observations that are applicable to the parts of the PRA required for the application. This may take the following forms:

< a discussion of how the PRA model has been changed

< a justification in the form of a sensitivity study that demonstrates the accident sequences or contributors significant to the application were not impacted (remained the same) by the particular issue

  • The standards or peer review process documents may recognize different capability categories or grades that are related to level of detail, degree of plant specificity, and degree of realism. The licensees documentation is to identify the use of the parts of the PRA that conform to the lower capability categories or grades, if they lead to limitations on the implementation of the licensing change.

DG-1161, Page 29

D. IMPLEMENTATION The purpose of this section is to provide information to applicants and licensees regarding the NRC staffs plans for using this draft regulatory guide. No backfitting is intended or approved in connection with its issuance.

The NRC has issued this draft guide to encourage public participation in its development.

Except in those cases in which an applicant or licensee proposes or has previously established an acceptable alternative method for complying with specified portions of the NRCs regulations, the methods to be described in the active guide will reflect public comments and will be used in evaluating (1) submittals in connection with applications for construction permits, standard plant design certifications, operating licenses, early site permits, and combined licenses, and (2) submittals from operating reactor licensees who voluntarily propose to initiate system modifications if there is a clear nexus between the proposed modifications and the subject for which guidance is provided herein.

REGULATORY ANALYSIS A draft regulatory analysis was published with the draft of this guide when it was originally published for public comment as Draft Regulatory Guide DG-1122. That draft regulatory analysis required no changes, so the NRC staff did not prepare a separate analysis for this proposed Revision 1 of Regulatory Guide 1.200. A copy of the draft regulatory analysis is available for inspection or copying for a fee in the NRCs Public Document Room at 11555 Rockville Pike, Rockville, MD; the PDRs mailing address is USNRC PDR, Washington, DC 20555; telephone (301) 415-4737 or (800)-397-4209; fax (301) 415-3548; email PDR@nrc.gov.

DG-1161, Page 30

REFERENCES

1. U.S. Nuclear Regulatory Commission, Use of Probabilistic Risk Assessment Methods in Nuclear Activities: Final Policy Statement, Federal Register, Vol. 60, August 16, 1995,
p. 42622 (60 FR 42622).7
2. Regulatory Guide 1.174, An Approach for Using Probabilistic Risk Assessment in Risk-Informed Decisions on Plant-Specific Changes to the Licensing Basis, Revision 1, U.S. Nuclear Regulatory Commission, Washington, DC, November 2002.8
3. U.S. Nuclear Regulatory Commission, Letter from M. Tschiltz to D. Lew, Resolution of the Regulatory Guide (RG) 1.200 Implementation Pilot Program, June 8, 2005 (available in ADAMS under Accession #ML05590519).
4. NUREG-0800, Standard Review Plan for the Review of the Safety Analysis Reports for Nuclear Power Plants, Section 19, Use of Probabilistic Risk Assessment in Plant-Specific, Risk-Informed Decisionmaking: General Guidance, Revision 1, U.S. Nuclear Regulatory Commission, Washington, DC, November 2002.9
5. Regulatory Guide 1.175, An Approach for Plant-Specific, Risk-Informed Decisionmaking:

Inservice Testing, U.S. Nuclear Regulatory Commission, Washington, DC, August 1998.

7 All Federal Register notices listed herein were issued by the U.S. Nuclear Regulatory Commission, and are available electronically through the Federal Register Main Page of the public GPOAccess Web site, which the U.S. Government Printing Office maintains at http://www.gpoaccess.gov/fr/index.html. Copies are also available for inspection or copying for a fee from the NRCs Public Document Room at 11555 Rockville Pike, Rockville, MD; the PDRs mailing address is USNRC PDR, Washington, DC 20555; telephone (301) 415-4737 or (800) 397-4209; fax (301) 415-3548; email PDR@nrc.gov.

8 All regulatory guides listed herein were published by the U.S. Nuclear Regulatory Commission. Where an ADAMS accession number is identified, the specified regulatory guide is available electronically through the NRCs Agencywide Documents Access and Management System (ADAMS) at http://www.nrc.gov/reading-rm/adams.html.

All other regulatory guides are available electronically through the Public Electronic Reading Room on the NRCs public Web site, at http://www.nrc.gov/reading-rm/doc-collections/reg-guides/. Single copies of regulatory guides may also be obtained free of charge by writing the Reproduction and Distribution Services Section, ADM, USNRC, Washington, DC 20555-0001, or by fax to (301)415-2289, or by email to DISTRIBUTION@nrc.gov. Active guides may also be purchased from the National Technical Information Service (NTIS)on a standing order basis. Details on this service may be obtained by contacting NTIS at 5285 Port Royal Road, Springfield, Virginia 22161, online at http://www.ntis.gov, or by telephone at (703) 487-4650. Copies are also available for inspection or copying for a fee from the NRCs Public Document Room (PDR), which is located at 11555 Rockville Pike, Rockville, Maryland; the PDRs mailing address is USNRC PDR, Washington, DC 20555-0001. The PDR can also be reached by telephone at (301) 415-4737 or (800) 397-4205, by fax at (301) 415-3548, and by email to PDR@nrc.gov.

9 All NUREG-series reports listed herein were published by the U.S. Nuclear Regulatory Commission, and are available electronically through the Public Electronic Reading Room on the NRCs public Web site, at http://www.nrc.gov/

reading-rm/doc-collections/nuregs/. Copies are also available for inspection or copying for a fee from the NRCs Public Document Room at 11555 Rockville Pike, Rockville, MD; the PDRs mailing address is USNRC PDR, Washington, DC 20555; telephone (301) 415-4737 or (800) 397-4209; fax (301) 415-3548; email PDR@nrc.gov.

In addition, copies are available at current rates from the U.S. Government Printing Office, P.O. Box 37082, Washington, DC 20402-9328, telephone (202) 512-1800; or from the NTIS at 5285 Port Royal Road, Springfield, Virginia 22161, online at http://www.ntis.gov, or by telephone at (703) 487-4650.

DG-1161, Page 31

6. Regulatory Guide 1.178, An Approach for Plant-Specific, Risk-Informed Decisionmaking:

Inservice Inspection of Piping, Revision 1, U.S. Nuclear Regulatory Commission, Washington, DC, September 2003.

7. Regulatory Guide 1.176, An Approach for Plant-Specific, Risk-Informed Decisionmaking:

Graded Quality Assurance, U.S. Nuclear Regulatory Commission, Washington, DC, August 1998.

8. Regulatory Guide 1.177, An Approach for Plant-Specific, Risk-Informed Decisionmaking:

Technical Specifications, U.S. Nuclear Regulatory Commission, Washington, DC, August 1998.

9. ASME RA-S-2002, Standard for Probabilistic Risk Assessment for Nuclear Power Plant Applications, ASME, New York, New York, April 5, 2002.10 ASME RA-Sa-2003, Standard for Probabilistic Risk Assessment for Nuclear Power Plant Applications, Addendum A to ASME RA-S-2002, ASME, New York, New York, December 5, 2003.

ASME RA-Sb-2005, Standard for Probabilistic Risk Assessment for Nuclear Power Plant Applications, Addendum B to ASME RA-S-2002, ASME, New York, New York, December 30, 2005.

10. ANSI/ANS-58.21-2003, American National Standard External-Events PRA Methodology, American Nuclear Society, La Grange Park, Illinois, December 2003.11
11. NEI-00-02, Probabilistic Risk Assessment Peer Review Process Guidance, Revision A3, Nuclear Energy Institute, Washington, DC, March 20, 2000.12 Nuclear Energy Institute, Letter from Anthony Pietrangelo, Director of Risk- and Performance-Based Regulation Nuclear Generation, Nuclear Energy Institute, to Ashok Thadani, Director of Office of Nuclear Regulatory Research, U.S. Nuclear Regulatory Commission, Washington, DC, December 18, 2001.

NEI-00-02, Probabilistic Risk Assessment Peer Review Process Guidance, Revision 1, Nuclear Energy Institute, Washington, DC, May 2006.

12. NEI-05-04, Process for Performing Follow-on PRA Peer Reviews Using the ASME PRA Standard, Nuclear Energy Institute, Washington, DC, January 2005 (Available in ADAMS under Accession #ML062150115).

10 Copies of ASME standards and documents may be obtained from the American Society of Mechanical Engineers, Three Park Avenue, New York, NY 10016-5990; phone (212)591-8500.

11 Copies may be obtained from the American Nuclear Society, 555 N. Kensington Avenue, La Grange, Illinois 60526; phone (708)352-6611.

12 All NEI documents may be obtained from the Nuclear Energy Institute, Attn: Mr. Biff Bradley, Suite 400, 1776 I Street, NW, Washington, DC 20006-3708; phone (202) 739-8083.

DG-1161, Page 32

13. SECY-00-0162, Addressing PRA Quality In Risk-Informed Activities, U.S. Nuclear Regulatory Commission, Washington, DC, July 28, 2000.13
14. Regulatory Guide 1.201, Guidelines for Categorizing Structures, Systems, and Components in Nuclear Power Plants According to Their Safety Significance, U.S. Nuclear Regulatory Commission, Washington, DC, May 2006.
15. SECY-02-0176, Proposed Rulemaking to Add New Section 10 CFR 50.69, Risk-Informed Categorization and Treatment of Structures, Systems, and Components, WITS 199900061, U.S. Nuclear Regulatory Commission, Washington, DC, September 30, 2002.
16. SECY-04-0118, Plan for the Implementation of the Commissions Phased Approach to PRA Quality, U.S. Nuclear Regulatory Commission, Washington, DC, July 13, 2004.

13 All Commission papers (SECYs) listed herein were published by the U.S. Nuclear Regulatory Commission, and are available electronically through the Public Electronic Reading Room on the NRCs public Web site, at http://www.nrc.gov/reading-rm/doc-collections/commission/secys/. Copies are also available for inspection or copying for a fee from the NRCs Public Document Room at 11555 Rockville Pike, Rockville, MD; the PDRs mailing address is USNRC PDR, Washington, DC 20555; telephone (301) 415-4737 or (800) 397-4209; fax (301) 415-3548; email PDR@nrc.gov.

DG-1161, Page 33

APPENDIX A NRC REGULATORY POSITION ON ASME PRA STANDARD Introduction The American Society of Mechanical Engineers (ASME) has published ASME RA-S-2002, Standard for Probabilistic Risk Assessment for Nuclear Power Plant Applications (April 5, 2002),

Addendum A to this standard (ASME RA-Sa-2003, December 5, 2003), and Addendum B to this standard (ASME RA-Sb-2005, December 30, 2005). The standard states that it sets forth requirements for probabilistic risk assessments (PRAs) used to support risk-informed decision for commercial nuclear power plants, and describes a method for applying these requirements for specific applications. The NRC staff has reviewed ASME RA-S-2002, RA-Sb-2003, and RA-Sb-2005 against the characteristics and attributes for a technically acceptable PRA as discussed in Regulatory Position 3 of this regulatory guide. The staffs position on each requirement (referred to in the standard as a requirement, a high-level requirement, or a supporting requirement) in ASME RA-S-2002, RA-Sb-2003, and RA-Sb-2005 is categorized as no objection, no objection with clarification, or no objection subject to the following qualification, and defined as follows:

  • No objection. The staff has no objection to the requirement.
  • No objection with clarification. The staff has no objection to the requirement. However, certain requirements, as written, are either unclear or ambiguous, and therefore the staff has provided its understanding of these requirements.
  • No objection subject to the following qualification. The staff has a technical concern with the requirement and has provided a qualification to resolve the concern.

Table A-1 provides the staffs position on each requirement in ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005. A discussion of the staffs concern (issue) and the staff proposed resolution is provided. In the proposed staff resolution, the staff clarification or qualification to the requirement is indicated in either bolded text (i.e., bold) or strikeout text (i.e., strikeout); that is, the necessary additions or deletions to the requirement (as written in the ASME standard) for the staff to have no objection are provided.

Appendix A to DG-1161, Page A-1

Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005 Index No Issue Position Resolution Global


Use of references, the various Clarification For every reference:

references, may be acceptable, No staff position is provided on this in general; however, there may reference. The staff neither approves or be aspects that are not disapproves of information contained in applicable or not acceptable. the referenced document.

Chapter 1 1.1 The standard is only for current Clarification This Standard sets forth requirements for generation light-water reactors; Probabilistic Risk Assessments (PRAs) used the requirements may not be to support risk-informed decisions for sufficient or adequate for other current commercial light-water reactor types of reactors. nuclear power plants, and prescribes a method for applying these requirements for specific applications (additional or revised requirements may be needed for other reactor designs).

1.2 - 1.7 ----------------- No objection ----------------------------

Chapter 2 2.1 ----------------- No objection ----------------------------

2.2 Core damage The use of the term a large Clarification core damage: involving a large fraction fraction of the core should be of the core (i.e., sufficient, if released from consistent with the definition containment, has the potential to cause of large used in the LERF offsite health effects) is anticipated.

definition.

Extremely A frequency cutoff should be Clarification extremely rare event: one that would not be rare event provided as part of this expected to occur even once throughout the definition. world nuclear industry over many years (e.g., <1E-6/yr).

Internal event Internal fire is an internal Qualification internal event: By convention, loss of event, and not an external offsite power is considered to be an internal event. event, and internal fire is considered to be an external event.

PRA upgrade See the issue discussed on Clarification PRA upgrade: The incorporation into a definition of Accident PRA model of a new methodology or sequence, dominant. significant changes in scope or capability that have the potential to impact the significant sequences. This could.

Appendix A to DG-1161, Page A-2

Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005 Index No Issue Position Resolution Rare event A frequency cutoff should be Clarification rare event: one that might be expected to provided as part of this occur only a few times throughout the world definition. nuclear industry over many years (e.g., <1E-4/yr).

Reactor-year This term references the wrong Clarification reactor year: a calender year in the footnote and could more operating life of one reactor, regardless of accurately reference the right power level. See Note 2 3 in Table 4.5.1-2 table in Section 4.5. (c).

Reactor- This term references the wrong Clarification See Note 2 3 in Table 4.5.1-2 (c).

operating- footnote and could more state-year accurately reference the right table in Section 4.5.

Resource See the issue discussed on Clarification resource expert: A technical expert with expert definition of Accident knowledge of a particular technical areas of sequence, dominant. importance to a PRA.

Significant This term is used in the Clarification significant contributor: (a) in the context contributor standard and a definition is of an accident sequence, a significant necessary. basic event or an initiating event that contributes to a significant sequence; (b) in the context of an accident progression sequence, a contributor which is an essential characteristic (e.g., containment failure mode, physical phenomena) of a significant accident progression sequence, and if not modeled would lead to the omission of the sequence; for example, not modeling hydrogen detonation in an ice condenser plant would result in a significant LERF sequence not being modeled.

Other ----------------- No objection ----------------------------

Definitions Appendix A to DG-1161, Page A-3

Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005 Index No Issue Position Resolution Chapter 3 3.1 - 3.4 ----------------- No objection ----------------------------

3.5 Use of the word significant Clarification 2nd paragraph:

should match definitions If the PRA does not satisfy a SR for the provided in Section 2.2. appropriate Capability Category, then determine if the difference is relevant or significant. Acceptable requirements for determining the significance of this difference differences include the following:

(a) The difference is not relevant if it is not applicable or does not affect the quantification.

(b) The difference is not significant if the mModeled accident sequences accounting for at least 90% of CDF/LERF, as applicable.

These determinations Determination of significance will depend.

If the difference is not relevant or significant, then the PRA is acceptable for the application. If the difference is relevant or significant, then.

3.6 Use of the word safety is not Clarification Second example of supplementary needed. requirements:

It is desired to rank the snubbers in a plant according to their risk significance for snubbers are considered safety-related, the safety significance of snubbers can be approximated by the safety significance of the components that they support for the events in which the snubbers are safety significant and to rank the safety importance of the snubbers.

Appendix A to DG-1161, Page A-4

Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005 Index No Issue Position Resolution Chapter 4 4.1, ----------------- No objection ----------------------------

4.2 4.3 4.3.1, ----------------- No objection ----------------------------

4.3.2 4.3.3 The use of the word should Clarification The PRA analysis team shall should use does not provide a minimum outside experts, even when.

requirement.

4.3.4 thru ----------------- No objection ---------------------------

4.3.7 4.4, ----------------- No objection ----------------------------

4.5 4.5.1 - IE 4.5.1.1 ----------------- No objection ----------------------------

Table 4.5.1-1 ----------------- No objection ----------------------------

Tables 4.5.1-2(a) thru 4.5.1-2(d)

IE-A1 thru ----------------- No objection ----------------------------

IE-A3a IE-A4 The search for initiators should Clarification Cat I and II:

go down to the subsystem/train PERFORM a systematic evaluation of each level. system down to the subsystem/train level, including support systems.

Capability Category III should consider the use of other Cat III:

systematic processes. PERFORM a systematic evaluation of each system down to the subsystem/train level, including support systems.

PERFORM an FMEA (failure modes and effects analysis) or other systematic process to assess.

IE-A4a Initiating events from common Clarification Cat II and III:

cause or from both routine and resulting from multiple failures, if the non-routine system alignments equipment failures result from a common should be considered. cause, and from routine and non-routine (e.g., temporary alignments during maintenance) system alignments.

Appendix A to DG-1161, Page A-5

Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005 Index No Issue Position Resolution IE-A5 thru ----------------- No objection ----------------------------

IE-A10 IE-B1 thru ----------------- No objection --------------------------

IE-B2 IE-B3 The action verb AVOID is Clarification Cat II:

ambiguous.

AVOID subsuming DO NOT SUBSUME scenarios into a group.

IE-B4 thru ----------------- No objection --------------------------

IE-B5 IE-C1 thru ----------------- No objection --------------------------

IE-C9 IE-C10 Providing a list of generic data Clarification COMPARE results and EXPLAIN sources would be consistent differences in the initiating event analysis with other SRs related to data. with generic data sources to provide a reasonable check of the results.

Pertinent generic data sources include NUREG/CR-5750 [Note (1)].

IE-C11 Definitions of rare and Clarification CC I and II:

extremely rare events can be For rare initiating events, USE industry deleted from this SR since they generic data and INCLUDE plant-specific have been added to Chapter 2. functions features in deciding which generic data is most applicable.

How plant-specific features are included in the use of generic data for establishing rare event frequencies requires clarification.

IE-C12 The size of relief valves is an Clarification CC I and II:

important consideration when (a) configuration of potential pathways evaluating ISLOCAs. including numbers and types of values valves and their relevant failure modes, and the existence, size, and positioning of relief valves IE-C13 ----------------- No objection --------------------------

Appendix A to DG-1161, Page A-6

Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005 Index No Issue Position Resolution Footnote 3 to The first example makes an Clarification Thus, Table 4.5.1- assumption that the hourly 2(c) failure rate is applicable for all fbus at power = 1x10-7/hr

  • 8760 hrs/yr *0.90 =

operating conditions. 7.9x10-4/reactor year.

In the above example, it is assumed the bus failure rate is applicable for at-power conditions. It should be noted that initiating event frequencies may be variable from one operating state to another due to various factors. In such cases, the contribution from events occurring only during at-power conditions should be utilized.

IE-D1 thru ----------------- No objection ----------------------------

IE-D3 4.5.2 - AS 4.5.2.1 The and associated SRs Clarification 4.5.2.1 Objectives. The objectives are written for CDF and not reflected in the assessment of CDF and LERF; therefore, references to LERF is such a way that.

LERF are not appropriate.

Table 4.5.2-1 ----------------- No objection ---------------------------

Tables 4.5.2-2(a) thru 4.5.2-2(c)

AS-A1 thru ----------------- No objection ----------------------------

AS-A8 AS-A9 The code requirements for Clarification Cat II and III:

acceptability need to be stated. affect the operability of the mitigating systems. (See SC-B4.)

AS-A10 The modifier significant does Clarification Cat II:

not have a clear definition. INCLUDE for each modeled initiating Examples provide a clear event, sufficient detail that significant understanding. differences in requirements on systems and required operator responses interactions (e.g., systems initiations or valve alignments) are captured.

AS-A11 ----------------- No objection ----------------------------

AS-B1 thru ----------------- No objection ----------------------------

AS-B6 AS-C1 thru ----------------- No objection ----------------------------

AS-C3 Appendix A to DG-1161, Page A-7

Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005 Index No Issue Position Resolution 4.5.3 - SC 4.5.3.1 The HLR and associated SRs Clarification (a) overall success criteria are defined (i.e.,

are written for CDF and not core damage and large early release)

LERF; therefore, references to LERF are not appropriate.

Table 4.5.3-1 ----------------- No objection ----------------------------

Tables 4.5.3-2(a) thru 4.5.3-2(c)

SC-A1, ----------------- No objection ----------------------------

SC-A2 Note: SC-A3 was deleted in Addendum B.

SC-A4 thru ----------------- No objection ----------------------------

SC-A6 SC-B1 Requirements concerning the Clarification Cat II and III:

use of thermal/hydraulic codes for thermal/hydraulic, requiring detailed should be cross-referenced. computer modeling. (See SC-B4.) .

SC-B2 thru ----------------- No objection ----------------------------

SC-B5 SC-C1 thru ----------------- No objection ----------------------------

SC-C3 4.5.4 - SY 4.5.4.1 ----------------- No objection ----------------------------

Table 4.5.4-1 ----------------- No objection ----------------------------

Tables 4.5.4-2(a) thru 4.5.4-2(c)

SY-A1 thru ----------------- No objection ----------------------------

SY-A21 SY-A22 There are no commonly used Clarification is justified through an adequate analysis analysis methods for recovery or examination of data collected in in the sense of repair, other accordance with DA-C14 and estimated than use of actuarial data. in accordance with DA-D8. (See DA-C14.)

SY-B1 thru ----------------- No objection ----------------------------

SY-B8 Note: SY-B9 was deleted in Addendum B Appendix A to DG-1161, Page A-8

Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005 Index No Issue Position Resolution SY-B10 References wrong SR. Clarification required mission time (see also ASY-A6).

Examples of support systems include:

SY-B11 thru ----------------- No objection ----------------------------

SY-B14 SY-B15 Containment vent and failure Clarification Examples of degraded environments include:

can cause more than NPSH problems (e.g., harsh (h) harsh environments induced by environments). containment venting or failure SY-B16 ----------------- No objection ----------------------------

SY-C1 thru ----------------- No objection ----------------------------

SY-C3 4.5.5 - HR 4.5.5.1 ----------------- No objection ----------------------------

Table 4.5.5-1 ----------------- No objection ----------------------------

Tables 4.5.5-2(a) thru 4.5.5-2(I)

HR-A1 Inspection may implicitly be Clarification For equipment modeled in the PRA, included using test and IDENTIFY, through a review of procedures maintenance, but explicit use and practices, those test and maintenance of inspection term may (including inspection) activities that require eliminate interpretation errors realignment of equipment outside its normal (e.g., inspection may require operational or standby status.

actions to gain access to equipment, which could inadvertently cause a pre-initiator problem).

HR-A2, ----------------- No objection ----------------------------

HR-A3 HR-B1, ----------------- No objection ----------------------------

HR-B2 HR-C1 thru ----------------- No objection ----------------------------

HR-C3 HR-D1, ----------------- No objection ----------------------------

HR-D2 Appendix A to DG-1161, Page A-9

Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005 Index No Issue Position Resolution HR-D3 Add examples for what is Clarification Cat II,III meant by quality in items (a) (a) the quality (including format, logical and (b) of Cat II, III. structure, ease of use, potential for confusion, and comprehensiveness) of written procedures and the quality (e.g.,

configuration control, technical review process, training processes, and management emphasis on adherence to procedures) of administrative controls (for independent review)

(b) the quality (e.g., adherence to human factors guidelines [Note (3)] and results of any quantitative evaluations of performance per functional requirements) of the human-machine interface, including both the equipment configuration, and instrumentation and control layout HR-D4 thru ----------------- No objection ----------------------------

HR-D7 Notes to Additional references cited in Clarification NOTES:

Table 4.5.5- clarification to HR-D3.

2(d) (3) NUREG-0700, Rev. 2, Human-System Interface Design Review Guidelines; J.M. OHara, W.S. Brown, P.M. Lewis, and J.J. Persensky, May 2002.

HR-E1 ----------------- No objection ----------------------------

HR-E2 Need to explicitly state the Clarification (b) those actions performed by the control need for some level of room staff either in response to procedural diagnosis in identifying the direction or as skill-of-the-craft to diagnose failure(s). and then recover a failed function, system or component that is used in the performance of a response action as identified in HR-H1.

HR-E3, ----------------- No objection ----------------------------

HR-E4 HR-F1, ----------------- Clarification ----------------------------

HR-F2 HR-G1, ----------------- No objection ----------------------------

HR-G2 Appendix A to DG-1161, Page A-10

Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005 Index No Issue Position Resolution HR-G3 In item (d) of CC II, III, clarify Clarification CC II, III that clarity refers the (d) degree of clarity of the meaning of meaning of the cues, etc. cues/indications In item (a) of CC I and item (g) (g) complexity of determining the need for of CC II, III, clarify that and executing the required response.

complexity refers to both determining the need for and executing the required response.

HR-G4 Requirements concerning the Clarification Cat I, II, and III:

use of thermal/hydraulic codes BASE. (See SC-B4.) SPECIFY the point should be cross-referenced. in time.

HR-G5 thru ----------------- No objection ----------------------------

HR-G9 HR-H1 thru ----------------- No objection ----------------------------

HR-H3 HR-I1 thru ----------------- No objection ----------------------------

HR-I3 4.5.6 - DA 4.5.6.1 ----------------- No objection ----------------------------

Table 4.5.6-1 ----------------- No objection ----------------------------

Tables 4.5.6-2(a) thru 4.5.6-2(e)

DA-A1 thru ----------------- No objection ----------------------------

DA-A3 DA-B1, ----------------- No objection ----------------------------

DA-B2 DA-C1 The list of data sources needs Clarification Examples of parameter estimates and to be updated. associated sources include:

(a) component failure rates and probabilities:

NUREG/CR-4639 [Note (1)], NUREG/CR-4550 [Note (2)], NUREG-1715 [Note 7]

See NUREG/CR-6823 [Note 8] for lists of additional data sources.

DA-C2 thru ----------------- No objection ----------------------------

DA-C13 Appendix A to DG-1161, Page A-11

Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005 Index No Issue Position Resolution DA-C14 This SR provides a justification Qualification IDENTIFY instances of plant-specific or for crediting equipment repair and, when that is insufficient to meet (SY-A22). As written, it could requirement DA-D8, applicable industry be interpreted as allowing experience and for each repair, plant-specific data to be COLLECT.

discounted in favor of industry data. In reality, for such components as pumps, plant-specific data is likely to be insufficient and a broader base is necessary.

DA-C15 ----------------- No objection ----------------------------

Notes to Additional references cited in Clarification NOTES:

Table 4.5.6- the clarification to DA-C.

2(c) (7) NUREG-1715, Component performance study, 1987-1998, Vols. 1-4.

(8) NUREG/CR-6823, Handbook of Parameter Estimation for Probabilistic Risk Assessment, USNRC, September 2003.

DA-D1 Other approved statistical Clarification CC II and III processes for combining plant- USE a Bayes update process or equivalent specific and generic data are statistical process that assigns that assigns not available. appropriate weight to the statistical significance of the generic and plant specific evidence and provides an appropriate characterization of the uncertainty.

CHOOSE.

DA-D2 thru ----------------- No objection ----------------------------

DA-D5 DA-D6 For consistency with Table Clarification Cat III:

1.3-1 and DA-D1, the Cat III USE realistic common-cause failure requirement is to apply to all probabilities for significant common-common-cause events. cause basic events. An example.

DA-D6a, ----------------- No objection ----------------------------

DA-D7 Appendix A to DG-1161, Page A-12

Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005 Index No Issue Position Resolution DA-D8 New requirement needed, DA- Qualification Cat I, II, and III:

C14 was incomplete, only For each SSC for which repair is to be provided for data collection, modeled, ESTIMATE, based on the data not quantification of repair. collected in DA-C14, the probability of (See SY-A22.) failure to repair the SSC in time to prevent core damage as a function of the accident sequence in which the SSC failure appears.

DA-E1 thru ----------------- No objection ----------------------------

DA-E3 4.5.7 - IF 4.5.7.1 ----------------- No objection ----------------------------

Table 4.5.7-1 ----------------- No objection ----------------------------

Tables 4.5.7-2(a) thru 4.5.7-2(f)

IF-A1 thru ----------------- No objection ----------------------------

IF-A4 IF-B1 The list of fluid systems should Clarification For each flood area. INCLUDE:

be expanded to include fire protection systems. (a) equipment (e.g., piping, valves, pumps) located in the area that are connected to fluid systems (e.g., circulating water system, service water system, fire protection system.

IF-B1a thru ----------------- No objection ----------------------------

IF-B2 IF-B3 It is necessary to consider a Clarification (b) range of flow rates of water range of flow rates for identified flooding sources, each having a unique frequency of occurrence. For example, small leaks that only cause spray are more likely than large leaks that may cause equipment submergence.

IF-B3a ----------------- No objection ----------------------------

Note: IF-B4 was deleted in Addendum B Appendix A to DG-1161, Page A-13

Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005 Index No Issue Position Resolution IF-C1 For a given flood source, there Clarification For each defined flood area and each flood may be multiple propagation source, IDENTIFY the propagation paths paths and areas of from the flood source area to the areas of accumulation. accumulation.

IF-C2 thru ----------------- No objection ----------------------------

IF-C2b IF-C2c There is circular logic between Clarification For each flood area not screened out using this SR and IF-C5. This SR the requirements under other Internal requires identifying SSCs for Flooding supporting requirements (e.g., IF-flood areas not screened out in B1b and IFC5),.

IF-C5. A listed reason for screening a flood area in IF-C5 is that it does not contain SSCs.

IF-C3 For Cat II, it is not acceptable Qualification Cat I:

to just note that a flood- INCLUDE failure by submergence and induced failure mechanism is spray in the identification process.

not included in the scope of the internal flooding analysis. EITHER:

Some level of assessment is required. (a) ASSESS by using conservative assumptions; OR (b) NOTE that these mechanisms are not included in the scope of the evaluation.

Cat II:

INCLUDE failure by submergence and spray in the identification process.

ASSESS qualitatively the impact of flood-induced mechanisms that are not formally addressed (e.g., using the mechanisms listed under Capability Category III of this requirement), by using conservative assumptions.

IF-C3a ----------------- No objection ----------------------------

IF-C3b Both a Capability Category II Qualification Cat II, III:

and III PRA should include the IDENTIFY inter-area.

potential for maintenance-induced unavailability of INCLUDE potential for structural failure barriers. (e.g., of doors or walls) due to flooding loads and the potential for barrier unavailability, including maintenance activities.

Appendix A to DG-1161, Page A-14

Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005 Index No Issue Position Resolution IF-C3c thru ----------------- No objection ----------------------------

IF-C9 IF-D1 IF-D1 incorrectly references Clarification IDENTIFY the corresponding plant Table 4.5.7-1 when it should initiating event group identified per Table cite Table 4.5.1-2(b). 4.5.7-1 4.5.1-2(b).

Note that IF-D2 was deleted in Addendum B.

IF-D3 The action verb AVOID is Clarification Cat II:

ambiguous.

AVOID subsuming DO NOT SUBSUME scenarios into a group.

IF-D3a thru ----------------- No objection ----------------------------

IF-D7 IF-E1 thru ----------------- No objection ----------------------------

IF-E6 IF-E6a This supporting requirement Clarification INCLUDE, in the quantification, should indicate the need to unavailability due to maintenance, common-adjust the definition of cause failures (adjusted, if necessary, to common-cause failure groups account for the internal flooding modeling),

while doing the internal and other credible causes.

flooding analysis.

IF-E6b thru ----------------- No objection ----------------------------

IF-E8 IF-F1 thru ----------------- No objection ----------------------------

IF-F3 4.5.8 - QU 4.5.8.1 SRs for LERF quantification Clarification The objectives of the quantification element reference the SRs in 4.5.8, and are to provide an estimate of CDF (and therefore, need to be support the quantification of LERF) acknowledged in 4.5.8. based upon the plant-specific.

(b) significant contributors to CDF (and LERF) are identified such as initiating events.

Table 4.5.8-1 ----------------- No objection ----------------------------

HLR-QU-A thru HLR-QU-C Appendix A to DG-1161, Page A-15

Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005 Index No Issue Position Resolution Table 4.5.8-1 SRs for LERF quantification Clarification significant contributors to CDF (and HLR-QU-D reference the SRs in 4.5.8 and, LERF), such as initiating events, accident therefore, need to be sequences.

acknowledged in 4.5.8.

Table 4.5.8-1 ----------------- No objection ----------------------------

HLR-QU-E, HLR-QU-F Tables 4.5.8-2(a) thru 4.5.8-2(f)

QU-A1, ----------------- No objection ----------------------------

QU-A2a QU-A2b The state-of-knowledge Clarification ESTIMATE the mean CDF from internal correlation should be events, accounting for the state-of-accounted for all event knowledge correlation between event probabilities. probabilities when significant (see NOTE 1).

QU-A3, ----------------- No objection ----------------------------

QU-A4 QU-B1 thru ----------------- No objection ----------------------------

QU-B9 QU-C1 thru ----------------- No objection ----------------------------

QU-C3 Table 4.5.8- HLR-QU-D and Table 4.5.8- Clarification significant contributors to CDF (and 2(d) 2(d) objective statement just LERF), such as initiating events, accident before table need to agree; SRs sequences.

for LERF quantification reference the SRs in 4.5.8 and, therefore, need to be acknowledged in 4.5.8.

QU-D1a thru ----------------- No objection ----------------------------

QU-D5b QU-E1 thru ----------------- No objection ----------------------------

QU-E3 QU-E4 Understanding of the key Clarification Cat I:

model uncertainties and PROVIDE an assessment of the impact of assumptions is an essential the key model uncertainties and aspect of uncertainty analysis. assumptions on the results of the PRA.

QU-F1 ----------------- No objection ----------------------------

QU-F2 SR needs to use defined term Clarification (g) the significant basic events equipment significant instead of or human actions that are the key factors in dominant. causing the accidents sequences to be non-dominant non-significant.

Appendix A to DG-1161, Page A-16

Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005 Index No Issue Position Resolution QU-F3 thru ----------------- No objection ----------------------------

QU-F6 4.5.9 - LE 4.5.9.1 ----------------- No objection ----------------------------

Table 4.5.9-1 ----------------- No objection ----------------------------

Tables 4.5.9-2(a) thru 4.5.9-2(g)

LE-A1 thru ----------------- No objection ----------------------------

LE-A5 LE-B1 thru ----------------- No objection ----------------------------

LE-B3 LE-C1 The SR for Capability Clarification NUREG/CR-6595, Appendix A provides a Category II contains the discussion and examples an acceptable statement: NUREG/CR-6595, definition of LERF source terms.

Appendix A provides an acceptable definition of LERF source terms. In fact, the appendix contains three possible definitions of LERF.

LE-C2a thru ----------------- No objection ----------------------------

LE-C10 LE-D1 thru ----------------- No objection ----------------------------

LE-D6 LE-E1 thru ----------------- No objection ----------------------------

LE-E4 LE-F1a thru ----------------- No objection ----------------------------

LE-F3 LE-G1 thru ----------------- No objection ----------------------------

LE-G6 Chapter 5 5.1 ----------------- No objection ----------------------------

5.2 ----------------- No objection ----------------------------

5.3 ----------------- No objection ----------------------------

5.4 See the issue discussed on Clarification 2nd para: Changes that would impact risk-definition of Accident informed decisions should be prioritized to sequence, dominant. ensure that the most significant changes are incorporated as soon as practical.

Appendix A to DG-1161, Page A-17

Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005 Index No Issue Position Resolution 5.5, 5.6 ----------------- No objection ----------------------------

5.7 ----------------- No objection ----------------------------

5.8 (a)-(d) ----------------- No objection ----------------------------

5.8 (e) It is unclear what is to be Clarification (e) record of the performance and results of documented from the peer the appropriated PRA reviews (consistent review. with the requirements of Section 6.6) 5.8 (f), 5.8(g) ----------------- No objection ----------------------------

Chapter 6 6.1 The purpose, as written, Clarification The peer review shall assess the PRA to implies that it is solely an audit the extent necessary to determine if the against the requirements of methodology and its implementation meet Section 4. A key objective of the requirements of this Standard to the peer review is to ensure determine the strengths and weaknesses in when evaluating the PRA the PRA. Therefore, the peer review shall against the requirements in also assess the appropriateness of the key Section 4, the quality (i.e., assumptions. The peer review need not strengths and weaknesses) of assess.

the PRA; this goal is to be clearly understood by the peer review team.

See the issue discussed on definition of Accident sequence, dominant.

6.1.1 ----------------- No objection ----------------------------

6.1.2 ----------------- No objection ----------------------------

6.2 6.2.1, 6.2.2, ----------------- No objection ----------------------------

6.2.3 Appendix A to DG-1161, Page A-18

Table A-1. Staff Position on ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005 Index No Issue Position Resolution 6.3 As written, there does not Clarification The peer review team shall use the appear to be a minimum set. requirements of this Standard. For each The requirement as written PRA element, a set of review topics provides suggestions. A required for the peer review team are minimal set of items is to be provided in the subparagraphs of para.

provided; the peer reviewers 6.3. Some subparagraphs of para. 6.3 have flexibility in deciding on contain specific suggestions for the review the scope and level of detail for team to consider during the review.

each of the minimal items. Additional material for those Elements may be reviewed depending on the results obtained. These suggestions are not intended to be a minimum or comprehensive list of requirements. The judgment of the reviewer shall be used to determine the specific scope and depth of the review in each of each review topic for each PRA element.

6.3.1 thru ----------------- No objection ----------------------------

6.3.9 6.3.9.1 ----------------- No objection ----------------------------

6.3.9.2 See the issue discussed on Clarification (I) the containment response calculations, definition of Accident performed specifically for the PRA, for the sequence, dominant. dominant significant plant damage states 6.4 ----------------- No objection ----------------------------

6.5 ----------------- No objection ----------------------------

6.6 6.6.1 As written, it is not clear Clarification (I) identification of the strengths and whether certain essential items weaknesses that have a significant impact on are included in the the PRA documentation requirements (k) assessment of the key assumptions that are necessary to (l) an assessment of the capability accomplish the goal of the peer category of the SRs (or equivalent Peer review. Review grade) 6.6.2 ----------------- No objection ----------------------------

Appendix A to DG-1161, Page A-19

APPENDIX B NRC POSITION ON THE NEI PEER REVIEW PROCESS (NEI-00-02)

Introduction The Nuclear Energy Institute (NEI) Peer Review Process is documented in NEI 00-02, Revision 1.

It provides guidance for the peer review of probabilistic risk assessments (PRAs) and the grading of the PRA subelements into one of four capability categories. This document includes the NEI subtier criteria for assigning a grade to each PRA subelement. The NEI subtier criteria for a Grade 3 PRA have been compared by NEI to the requirements in the American Society of Mechanical Engineers (ASME) PRA Standard (ASME RA-Sb-2005) listed for a Capability Category II PRA. A comparison of the criteria for other grades/categories of PRAs was not performed since NEI contends that the results of the peer review process generally indicate the reviewed PRAs are consistent with the Grade 3 criteria in NEI 00-02.

However, the PRAs reviewed have contained a number of Grade 2, and even Grade 4 elements. The comparison of the NEI subtier criteria with the ASME PRA Standard has indicated that some of the Capability Category II ASME PRA Standard requirements are not addressed in the NEI Grade 3 PRA subtier criteria. Thus, NEI has provided guidance to the licensees to perform a self-assessment of their PRAs against the criteria in the ASME PRA Standard that were not addressed during the NEI peer review of their PRA. A self-assessment is likely to be performed in support of risk-informed applications. This self-assessment guidance is also included in NEI 00-02, Revision 1.

This appendix provides the staffs position on the NEI Peer Review Process (i.e., NEI 00-02), the proposed self-assessment process, and the self-assessment actions. The staffs positions are categorized as following:

  • No objection. The staff has no objection to the requirement.
  • No objection with clarification. The staff has no objection to the requirement. However, certain requirements, as written, are either unclear or ambiguous, and therefore the staff has provided its understanding of these requirements.
  • No objection subject to the following qualification. The staff has a technical concern with the requirement and has provided a qualification to resolve the concern.

In the proposed staff resolution, the staff clarification or qualification that is needed for the staff to have no objection are provided.

NRC Position on NEI 00-02 Table B-1 provides the NRC position on the NEI Peer Review Process documented in NEI 00-02, Revision 1. The stated positions are based on the historical use of NEI 00-02 and on the performance of a self-assessment to address those requirements in the ASME PRA Standard and Addenda A and B (ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005) that are not included in the NEI subtier criteria.

Appendix B to DG-1161, Page B-1

Table B-1. NRC Regulatory Position on NEI 00-02 Report Regulatory Commentary/Resolution Section Position Section 1. INTRODUCTION 1.1 Overview Clarification The NEI process uses a set of checklists as a framework within which to and Purpose evaluate the scope, comprehensiveness, completeness, and fidelity of the PRA being reviewed. The checklists by themselves are insufficient to provide the basis for a peer review since they do not provide the criteria that differentiate the different grades of PRA. The NEI subtier criteria provide a means to differentiate between grades of PRA.

The ASME PRA Standard (with the staffs position provided in Appendix A to this regulatory guide) can provide an adequate basis for a peer review of an at-power, internal events PRA (including internal flooding) that would be acceptable to the staff. Since the NEI subtier criteria do not address all of the requirements in the ASME PRA Standard, the staffs position is that a peer review based on these criteria is incomplete. The PRA standard requirements that are not included in the NEI subtier criteria (identified for a Grade 3 PRA in Table B-3) need to be addressed in the NEI self-assessment process as endorsed by the staff in this appendix.

1.1 Scope Clarification This section states that the NEI peer review process is a one-time evaluation process but indicates that additional peer review may be required if substantial changes are made to the PRA models or methodology. The staff position on additional peer reviews is to follow the guidance in Section 5 of the ASME PRA Standard which requires a peer review for PRA upgrades (PRA methodology changes).

1.2 Historical No objection -------------------------------------

Perspective 1.3 Process Clarification Figure 1-3 indicates in several locations that the checklists included in NEI 00-02 are used in the peer review process. As indicated in the comment on Section 1.1 of NEI 00-02, the staffs position is that a peer review based on the checklists and supplemental subtier criteria is incomplete. The NEI self-assessment process, as endorsed by the staff in this appendix, is needed.

1.4 PRA Peer Clarification The NEI peer review process provides a summary grade for each PRA Review element. The use of a PRA for risk-informed applications needs to be Criteria and determined at the subelement level. The staff does not agree with the use of Grades an overall PRA element grade in the assessment of a PRA.

Clarification This section indicates that the process requires that the existing PRA meet the process criteria or that enhancements necessary to meet the criteria have been specifically identified by the peer reviewers and committed to by the host utility. Thus, the assigned grade for a subelement can be contingent on the utility performing the prescribed enhancement. An application submittal that utilizes the NEI peer review results needs to identify any of the prescribed enhancements that were not performed.

Appendix B to DG-1161, Page B-2

Table B-1. NRC Regulatory Position on NEI 00-02 Report Regulatory Commentary/Resolution Section Position Clarification The staff believes that the use of PRA in a specific application should be of sufficient quality to support its use by the decision-makers for that application.

The NEI peer review process does not require the documentation of the basis for assigning a grade for each specific subtier criterion. However, the staff position is that assignment of a grade for a specific PRA subelement implies that all of the requirements listed in the NEI subtier criteria have been met.

1.5 No Objection -------------------------------------

Section 2. PEER REVIEW PROCESS 2.1 Objectives Clarification See comment for Section 1.1.

2.2 Process Clarification The ASME PRA Standard (with the staffs position provided in Appendix A Description to this regulatory guide) can provide an adequate basis for a peer review of an at-power, internal events PRA (including internal flooding) that would be acceptable to the staff. Since the NEI subtier criteria do not address all of the requirements in the ASME PRA Standard, the staffs position is that a peer review based on these criteria is incomplete. The PRA standard requirements that are not included in the NEI subtier criteria (identified for a Grade 3 PRA in Table B-3) need to be addressed in the NEI self-assessment process as endorsed by the staff in this appendix.

Steps 4, 7, & 8 Clarification See previous comment.

2.3 PRA Peer Clarification The peer reviewer qualifications do not appear to be consistent with the Review Team following requirements specified in Section 6.2 of the ASME PRA Standard:

  • the need for familiarity with the plant design and operation
  • the need for each person to have knowledge of the specific areas they review
  • the need for each person to have knowledge of the specific methods, codes, and approaches used in the PRA The NEI self-assessment process needs to address the peer reviewer qualifications with regard to these factors.

2.4 and 2.5 No objection Appendix B to DG-1161, Page B-3

Table B-1. NRC Regulatory Position on NEI 00-02 Report Regulatory Commentary/Resolution Section Position Section 3. PRA PEER REVIEW PROCESS ELEMENTS AND GUIDANCE 3.1 No objection -------------------------------------

3.2 Criteria Clarification See comment for Section 1.1.

and 3.3 Grading 3.3 Grading Clarification The NEI peer review process grades each PRA element from 1 to 4, while the ASME PRA Standard uses Capability Categories I, II, and III. The staff interpretation of Grades 2, 3, and 4 is that, they correspond broadly to Capability Categories I, II, and III respectively. This statement is not meant to imply that the supporting requirements, for example, for Category I are equally addressed by Grade 2 of NEI-00-02. The review of the supporting requirement for Category II against Grade 3 of NEI-00-02 indicated discrepancies and consequently the need for a self-assessment. The existence of these discrepancies would indicate that it would not be appropriate to assume that there are not discrepancies between Category I and Grade 2. A comparison between the other grades and categories has not been performed.

The implications of this are addressed in item 7a on Table B-2.

Qualification The staff believes that different applications of a PRA can require different PRA subelement grades. The NEI peer review process is performed at the subelement level and does not provide an overall PRA grade. Therefore, it is inappropriate to suggest an overall PRA grade for the specific applications listed in this section. The staff does not agree with the assigned overall PRA grades provided for the example applications listed in this section of NEI 00-02.

3.4 Additional Clarification The general use and interpretation of the checklists in the grading of PRA Guidance on subelements is addressed in this section. The subtier criteria provide a more the Technical substantial documentation of the interpretations of the criteria listed in the Elements checklists. However, as previously indicated, the subtier criteria do not fully Review address all of the PRA standard requirements. The PRA standard requirements that are not included in the NEI subtier criteria (identified for a Grade 3 PRA in Table B-3) need to be addressed in the NEI self-assessment process as endorsed by the staff in this appendix.

Appendix B to DG-1161, Page B-4

Table B-1. NRC Regulatory Position on NEI 00-02 Report Regulatory Commentary/Resolution Section Position Section 4. PEER REVIEW PROCESS RESULTS AND DOCUMENTATION 4.1 Report Clarification A primary function of a peer review is to identify those assumptions and models that have a significant impact on the results of a PRA and to pass judgment on the validity and appropriateness of the assumptions. The peer review requirements in the ASME PRA Standard requires analysis of key assumptions. A review of the NEI 00-02 and the subtier criteria section on quantification and results interpretation failed to identify specific wording in any requirements to review the impact of key assumptions on the results.

However, there are requirements to identify unique or unusual sources of uncertainty not present in typical or generic plant analyses. Since the evaluation of the impact of assumptions is critical to the evaluation of a PRA and its potential uses, the NEI peer review process need to address all key assumptions, not just those that are unique or unusual. The NEI self-assessment process needs to address those assumptions not reviewed in the NEI peer review process.

Qualification The NEI peer review report provides a summary grade for each PRA element.

The use of a PRA for risk-informed applications needs to be determined at the subelement level. The staff does not agree with the use of an overall PRA element grade in the assessment of a PRA.

4.2 and 4.3 No objection -------------------------------------

Appendix A. PREPARATION MATERIAL FOR THE PEER TEAM REVIEW A.1 through No objection -------------------------------------

A.6 A.7 Sensitivity Clarification A list of sensitivity calculations that a utility can perform prior to the peer Calculations review is provided. Additional or alternative sensitivities can be identified by the utility. Sensitivity calculations that address key assumptions that may significantly impact the risk-informed applications results need to be considered in the NEI self-assessment process.

A.8 through No objection -------------------------------------

A.10 Appendix B. TECHNICAL ELEMENT CHECKLISTS Checklist No objection As previously stated, the staff position is that the checklists by themselves are tables insufficient to provide the basis for a peer review. (See the comment for Section 1.1.) Because of this, the staff has not reviewed the contents or the assigned grades in these checklists. However, the staff position on the comparison of the Grade 3 NEI subtier criteria to the Capability Category II requirements in the ASME PRA Standard is documented in Table B-3.

Appendix B to DG-1161, Page B-5

Table B-1. NRC Regulatory Position on NEI 00-02 Report Regulatory Commentary/Resolution Section Position Appendix C. GUIDANCE FOR THE PEER REVIEW TEAM C.1 Purpose No objection -------------------------------------

C.2 Peer No objection -------------------------------------

Review Team Mode of Operation C.3 Clarification See comment for Section 4.1.

Recommended Approach to Completing the Review C.4 Grading Clarification/ See the two comments on Section 3.3.

Qualification C.5 Peer No objection -------------------------------------

Review Team Good Practice List C.6 Output Qualification See the comments on Section 4.1.

C.7 Forms Clarification The staff does not agree with the use of an overall PRA element grade (documented in Tables C.7-5 & C.7-6) in the assessment of a PRA.

NRC Position on the Self-Assessment Process The staff position on the self-assessment process proposed by NEI to address the requirements in the ASME PRA Standard and Addenda A and B (ASME RA-S-2002, ASME RA-Sa-2003, and ASME RA-Sb-2005) that are not included in the NEI subtier criteria are addressed in this section. Both the self-assessment process and the specific actions recommended by NEI to address missing ASME standard requirements are addressed.14 Table B-2 provides the NRC position on the NEI self-assessment process documented in Appendix D1 to NEI 00-02, Revision 1. The staffs position on specific aspects of this process uses the categories provided in Section B.2 of this regulatory guide.

14 The NEI comparison between NEI 00-02 criteria and the ASME requirements utilized the original standard as modified by subsequent addenda (A and B).

Appendix B to DG-1161, Page B-6

Table B-2. NRC Regulatory Position on NEI Self-Assessment Process Report Section Regulatory Commentary/Resolution Position Summary No objection -------------------------------------

Regulatory No objection -------------------------------------

Framework Industry PRA Clarification See the staff comments on the NEI peer review process provided in Table Peer Review B-1.

Process ASME PRA Clarification See the staff comments on the ASME PRA Standard and Addenda A and Standard B, provided in Appendix A to this regulatory guide.

Comparison of Clarification The NRC position is that the performance of the existing peer reviews as NEI 00-02 and supplemented by the NEI self-assessment process, as clarified in ASME Regulatory Guide 1.200, meets the NRC requirements for a peer review.

Standard The staff does not agree or disagree with the number of supporting requirements of the ASME PRA Standard that are addressed (completely or partially) in the NEI subtier criteria. The staffs focus is on ensuring that the self-assessment addresses important aspects of a PRA that are not explicitly addressed in the NEI subtier criteria.

The staff takes exception to the statement that the Industry has reviewed and compared the technical contents of the peer review process and the ASME PRA Standard Addendum B as augmented by NRC comments in RG 1.200. Since the NRC comments on Addendum B were not published at the time NEI 00-02, Revision 1 was generated, this is premature. The NEI Self-Assessment document should state that the Industry has reviewed and compared the technical contents of the peer review process and the ASME PRA Standard (ASME-RA-Sa-2003) as endorsed/modified by the NRC and updated by Addendum B of the ASME Standard.

Clarification It is stated that If, the PRS is upgraded, new peer reviews may be required to meet paragraph 5.4 of the ASME standard. NEI-05-04, Process for Performing Follow-on PRA Peer Reviews Using the ASME PRA Standard, provides guidance in this regard. NRC has not endorsed NEI-05-04. The staff has reviewed NEI-05-04, and the staffs position is provided in Table B-5 of this appendix.

Appendix B to DG-1161, Page B-7

Table B-2. NRC Regulatory Position on NEI Self-Assessment Process Report Section Regulatory Commentary/Resolution Position General Notes for Self-Assessment Process 1 No objection -------------------------------------

2 Clarification Certain ASME PRA Standard requirements, although not explicitly listed in the NEI subtier criteria, may generally be included as good PRA practice. Credit may be taken for meeting these ASME requirements subject to confirmation in the self-assessment that the requirements were in fact addressed by the peer review. Table B-4 identifies the ASME PRA Standard requirements not explicitly addressed in the NEI subtier criteria that the staff believes needs to be addressed in the NEI self-assessment process.

3 Clarification The staff takes exception to the statement that NEI 00-02 Appendix D2 is a comparison of the peer review process to the ASME PRA Standard Addendum B, as endorsed/modified by NRC in RG 1.200. Since the NRC comments on Addendum B were not published at the time NEI 00-02, Revision 1 was generated, this statement is incorrect. The NEI Self-Assessment document should state that the Industry has reviewed and compared the technical contents of the peer review process and the ASME PRA Standard (ASME-RA-Sa-2003) as endorsed/modified by the NRC and updated by Addendum B of the ASME Standard. The self-assessment process should consider the clarifications and qualifications on Addendum B that will be provided Appendix A to RG 1.200, Rev. 1.

Self- No objection -------------------------------------

Assessment Process Attributes Overall Peer No objection ------------------------------------------

Review Process and Decision Self-Assessment Process Steps

1. thru 6. No objection -------------------------------------------

7.a Clarification For the PRA subelements assigned a grade other than a Grade 3 in the NEI peer review (i.e., Grade 1, 2, or 4), a self-assessment of those PRA subelements required for the application against the Capability Category requirements (of the ASME PRA Standard as qualified in Appendix A to this regulatory guide) determined to be applicable for the application needs to be performed and documented.

7.b thru 8. No objection -------------------------------------

9. Clarification The list of items subject to a self-assessment action and documentation needs to always include those requirements where Yes is listed in the Addressed by NEI column and there are actions listed in the Industry Self-Assessment Actions column.

Appendix B to DG-1161, Page B-8

Table B-2. NRC Regulatory Position on NEI Self-Assessment Process Report Section Regulatory Commentary/Resolution Position

10. thru 13. No objection -------------------------------------
14. Clarification The staffs comments on which ASME PRA requirements need to be addressed in the self-assessment, and on the suggested actions (Appendix D2 to NEI 00-02, Rev. 1) are provided in Table B-3. In addition, the staffs position on the ASME PRA Standard, as documented in Appendix A to this regulatory guide, needs to be included in the self-assessment of the PRA subelements.

Tables B-3 and B-4 provide the staff position on the NEI comparison of NEI 00-02 (including the subtier criteria) to the ASME PRA Standard Addendum B and the self-assessment actions provided in Appendix D2 to NEI 00-02, Revision 1.15 The staffs position on the ASME PRA Standard (Addendum B) documented in Appendix A to this regulatory guide was considered in the comparison. The review of the NEI comparison and proposed actions was performed under the assumption that all of the requirements in the NEI subtier criteria were treated as mandatory. Thus, the staff position is predicated on the requirement that all of the requirements in the NEI subtier criteria are interpreted as shall being required.

Table B-3 provides the staff position of the explanatory table preceding the comparison and self-assessment actions table provided in Appendix D2. The first two columns are taken directly from the table in Appendix D2.

Table B-3. NRC Regulatory Positions on Actions Utilities Need to Take in Self-Assessment Actions Text Utility Actions Regulatory Comment/Resolution Position YES and NONE in None No objection -------------------------------------

Action column YES and Review comment. It is Clarification As written, no action may be taken, clarifications believed that the Peer which is in conflict with the actions included in Action Review Process addressed specified in the table providing the column the requirements. Unless it industry self-assessment actions. It is suspected that a problem is assumed that the actions provided exists, no further action is in that table will be taken.

required.

PARTIAL Take action(s) specified in No Objection -------------------------------------

Comments column.

NO Take action(s) specified in No Objection -------------------------------------

Comments column.

15 The NEI self-assessment process was revised to address the requirements in Addendum B of the ASME standard.

Appendix B to DG-1161, Page B-9

In Table B-4, the NEI Assessment includes, for each supporting requirement in the ASME standard (column heading: ASME SR):

  • whether NEIs assessment of each SR is addressed in NEI 00-02 (column heading: Addressed by NEI 00-02)
  • if it is addressed in NEI 00-02, then where it is addressed is identified (column heading:

Applicable NEI 00-02 Elements)

  • whether NEI recommends any self-assessment by the licensee (column heading: Industry Self-Assessment Actions)

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements INITIATING EVENTS IE-A1 Yes IE-7, IE-8, IE- None No objection 9, IE-10 IE-A2 Yes IE-5, IE-7, IE- Confirm that the initiators No objection; the definition of 9, IE-10 [including human-induced active component provided in initiators, and steam the Addendum B of the ASME generator tube rupture standard needs to be used (PWRs)] were included. when verifying ISLOCAs were This can be done by citing modeled; 1E-7 is the either peer review applicable NEI 00-02 element.

documentation/conclusions or examples from your model. NEI 00-02 does not explicitly mention human-induced initiators; however, in practice, peer reviews have addressed this.

IE-A3 Yes IE-8, IE-9 None No objection; IE-8 is the applicable NEI 00-02 element.

IE-A3a(1) Yes IE-8, IE-9 None No objection; IE-8 is the applicable NEI 00-02 element.

IE-A4 Partial IE-5, IE-7, IE- Check for initiating events No objection; IE-10 is the 9, IE-10 that can be caused by a applicable NEI 00-02 element.

train failure or a system failure.

Appendix B to DG-1161, Page B-10

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements IE-A4a(1) Partial IE-5, IE-7, IE- Check for initiating events No objection 9, IE-10 that can be caused by multiple failures, if the equipment failures result from a common cause or from routine system alignments.

IE-A5 Yes IE-8 Confirm requirement met. No objection Identification of low-power and shutdown events not explicitly addressed in NEI 00-02, but in practice, the peer reviews have addressed events resulting in a controlled shutdown that include a scram prior to reaching low power.

IE-A6 Yes IE-16 Confirm requirement met. No objection with clarification:

Specifying plant operations IE-16 does not address this (etc.) review and issue.

participation is not explicitly addressed in NEI 00-02, but in practice, the peer reviews have addressed the need for examination of plant experience (e.g., LERs),

and input from knowledgeable plant personnel. Interviews conducted at similar plants are not acceptable.

IE-A7 Yes IE-16, IE-10 None No objection; IE-10 is the applicable NEI 00-02 element.

IE-A8 Deleted from -- -- --

ASME PRA Standard IE-A9 Deleted from -- -- --

ASME PRA Standard IE-A10 Yes IE-6 None No objection IE-B1 Yes AS-4, IE-4 None No objection IE-B2 Yes IE-4, IE-7 None No objection IE-B3 Yes IE-4, IE-12 Confirm that the grouping No objection does not impact significant accident sequences.

IE-B4 Yes IE-4 None No objection IE-B5(3) Yes IE-6 None No objection Appendix B to DG-1161, Page B-11

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements IE-C1 Yes IE-13, IE-15, None No objection; IE-16 is the IE-16, IE-17 applicable NEI 00-02 element.

IE-C1a(1) Yes IE-13, IE-15, None No objection; IE-16 is the IE-16, IE-17 applicable NEI 00-02 element.

IE-C1b(1) Yes IE-13, IE-15, Justify recovery credit as No objection IE-16, IE-17 evidenced by procedures or training.

IE-C2 Yes IE-13, IE-16 Justify informative priors No objection used in Bayesian update.

IE-C3 No Document that the ASME No objection standard requirements were met. NEI 00-02 does not address this supporting requirement.

IE-C4 No Document that the ASME No objection; acceptable standard requirements were criteria for dismissing IEs are met. Specific screening listed in IE-C4 in the ASME criteria were not used in PRA Standard.

NEI 00-02, but bases for screening of events were examined in the peer reviews. The text of the ASME standard needs to be assessed.

IE-C5 No N/A No objection; the ASME PRA requirement Standard only requires time for Category II trend analysis for a Category III PRA.

IE-C6 Yes IE-15, IE-17 Check that fault tree No objection analysis, when used to quantify IEs, meets the appropriate systems analysis requirements.

IE-C7 No Document that the ASME No objection standard requirements were met. NEI 00-02 does not address this supporting requirement.

IE-C8 No Document that the ASME No objection standard requirements were met. NEI 00-02 does not address this supporting requirement.

Appendix B to DG-1161, Page B-12

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements IE-C9 Yes IE-15, IE-16 Check that the recovery No objection with clarification:

events included in the IE This can be done by citing fault trees meet the either peer review appropriate recovery documentation/conclusions analysis requirements. or examples from your model.

This can be done by citing either peer review F&Os or examples from your model.

IE-C10 Yes IE-13 None No objection IE-C11 Yes IE-12, IE-13, Check that the expert No objection; IE-15 is the IE-15 elicitation requirements in applicable NEI 00-02 element.

the ASME PRA Standard were used when expert judgment was applied to quantifying extremely rare events.

IE-C12 Yes IE-14 Confirm that secondary No objection pipe system capability and isolation capability under high flow or differential pressures are included.

IE-C13(3) No None Confirm IE-C13 is met. No objection IE-D1 Partial IE-9, IE-18, IE- Action is to confirm No objection 19, IE-20 availability of documentation. In general, specified documentation items not explicitly addressed in NEI 00-02 checklists were addressed by the peer review teams.

If not available, documentation may need to be generated to support particular applications or respond to NRC requests for additional information (RAIs) regarding applications.

Appendix B to DG-1161, Page B-13

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements IE-D2 Partial IE-9, IE-18, IE- Action is to confirm No objection 19, IE-20 availability of documentation. In general, specified documentation items not explicitly addressed in NEI 00-02 checklists were addressed by the peer review teams.

If not available, documentation may need to be generated to support particular applications or respond to NRC RAIs regarding applications.

IE-D3 Partial QU-27, QU-28, Confirm that the key No objection QU-29, QU-34 assumptions and key sources of uncertainty consistent with the definitions of the ASME PRA Standard are documented.

IE-D4 Deleted from -- -- --

ASME PRA Standard ACCIDENT SEQUENCE ANALYSIS AS-A1 Yes AS-4, AS-8 None No objection AS-A2 Yes AS-6, AS-7, None No objection; AS-6 is the AS-8, AS-9, applicable NEI 00-02 element.

AS-17 AS-A3 Yes AS-7, SY-17, None No objection; AS-17 is the AS-17 applicable NEI 00-02 element.

AS-A4 Yes AS-19, SY-5 None No objection; AS-19 is the applicable NEI 00-02 element.

AS-A5 Yes AS-5, AS-18, None No objection AS-19, SY-5 AS-A6 Yes AS-8, AS-13, None No objection AS-4 AS-A7 Yes AS-4, AS-5, None No objection AS-6, AS-7, AS-8, AS-9 Appendix B to DG-1161, Page B-14

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements AS-A8 Partial AS-20, AS-21, Since there is no explicit No objection AS-22, AS-23 requirement for steady state condition for end state in NEI 00-02 checklists, this should be evaluated even though this was an identified issue in some reviews. This can also be done by citing either peer review documentation/conclusions or examples from your model. Refer to SC-A5.

AS-A9 Yes AS-18, TH-4 Verify AS-A9 is met. Note No objection that AS-A9 is related to the environmental conditions challenging the equipment during the accident sequence, AS-18 and TH-4 are focused on the initial success criteria.

AS-A10 Yes AS-4, AS-5, None No objection; AS-4 and AS-7 AS-6, AS-7, are the applicable NEI 00-02 AS-8, AS-9, elements.

AS-19, SY-5, SY-8, HR-23 AS-A11 Yes AS-8, AS-10, The guidance in AS-15 No objection AS-15, DE-6, must be followed. AS-8 AS Checklist states that transfers may be Note 8 treated quantitatively or qualitatively while AS-15 states that transfers between event trees should be explicitly treated in the quantification.

AS-B1 Yes IE-4, IE-5, IE- None No objection; AS-4 is the 10, AS-4, AS-5, applicable NEI 00-02 element.

AS-6, AS-7, AS-8, AS-9, AS-10, AS-11, DE-5 AS-B2 Yes AS-10, AS-11, None No objection; AS-10 and AS-DE-4, DE-5, 11 are the applicable NEI 00-DE-6 02 elements.

AS-B3 Yes DE-10, SY-11, None No objection; AS-10 and SY-TH-8, AS-10 11 are the applicable NEI 00-02 elements.

Appendix B to DG-1161, Page B-15

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements AS-B4 Yes AS-8, AS-9, Confirm requirement met. No objection AS-10, AS-11 Appendix B to DG-1161, Page B-16

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements AS-B5 Yes DE-4, DE-5, None No objection; AS-10, AS-11, DE-6, AS-10, DE-6, QU-25 are the AS-11, QU-25 applicable NEI 00-02 elements.

AS-B5a(1) Yes DE-4, DE-5, Confirm that system No objection DE-6, AS-10, alignments that may affect AS-11, QU-25 dependencies among systems or functions are modeled.

AS-B6 Yes AS-13 None No objection AS-C1(2) Yes AS-11, AS-24, None No objection AS-25, AS-26 AS-C2(2) Partial AS-11, AS-24, Action is to confirm No objection; AS-26 is the AS-25, AS-26 availability of applicable NEI 00-02 element.

documentation. In general, specified documentation items not explicitly addressed in NEI 00-02 checklists were addressed by the peer review teams.

If not available, documentation may need to be generated to support particular applications or respond to NRC RAIs regarding applications.

AS-C3(2) Partial QU-27, QU-28, Confirm that the key No objection QU-29, QU-34 assumptions and key sources of uncertainty consistent with the definitions of the ASME PRA Standard are documented.

AS-C4 Deleted from -- -- --

ASME PRA Standard Appendix B to DG-1161, Page B-17

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements SUCCESS CRITERIA SC-A1 Yes AS-20, AS-22, None No objection AS FOOTNOTE 4 SC-A2 Yes TH-4, TH-5, None No objection TH-7, AS-22, AS FOOTNOTE 4 SC-A3 Deleted from -- -- --

ASME PRA Standard SC-A4 Yes AS-7, AS-17, None No objection AS-18, SY-17, TH-9, IE-6, DE-5, SY-8 SC-A4a(1) Yes IE-6, DE-5 Confirm that this No objection requirement is met. This can be done by citing either peer review documentation conclusions or examples from your model.

Although there is no explicit requirement in NEI 00-02 that mitigating systems shared between units be identified, in practice, review teams have evaluated this.

SC-A5 Partial AS-21, AS-23, Ensure mission times are No objection AS-20 adequately discussed as per the ASME PRA Standard.

Since there are no explicit requirements for steady state condition for end state, refer to the ASME PRA Standard for requirements or cite peer review documentation/conclusions or examples from your model. Refer to AS-A8.

SC-A6 Yes AS-5, AS-18, None No objection; TH-5 is the AS-19, TH-4, applicable NEI 00-02 element.

TH-5, TH-6, TH-8, ST-4, ST-5, ST-7, ST-9, SY-5 Appendix B to DG-1161, Page B-18

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements SC-B1 Yes AS-18, SY-17, None No objection TH-4, TH-6, TH-7 SC-B2 No TH-4, TH-8 NEI 00-02 does not No objection address this supporting requirement. Use the ASME standard for requirements. Refer to SC-C2.

SC-B3 Yes AS-18, TH-4, None No objection TH-5, TH-6, TH-7 SC-B4 Yes AS-18, TH-4, None No objection TH-6, TH-7 SC-B5 Yes TH-9, TH-7 None No objection; TH-7 is the applicable NEI 00-02 element.

SC-B6 Deleted from -- -- --

ASME PRA Standard SC-C1(2) Yes ST-13, SY-10, None No objection SY-17, SY-27, TH-8, TH-9, TH-10, AS-17, AS-18, AS-24, HR-30 SC-C2(2) Partial ST-13, SY-10, Action is to confirm No objection; TH-9 and TH-10 SY-17, SY-27, availability of are the applicable NEI 00-02 TH-8, TH-9, documentation. In general, elements.

TH-10, AS-17, specified documentation AS-18, AS-24, items not explicitly HR-30 addressed in NEI 00-02 checklists were addressed by the peer review teams.

If not available, documentation may need to be generated to support particular applications or respond to NRC RAIs regarding applications.

SC-C3(2) Partial QU-27, QU-28, Confirm that the key No objection QU-29, QU-34 assumptions and key sources of uncertainty consistent with the definitions of the ASME PRA Standard are documented.

Appendix B to DG-1161, Page B-19

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements SC-C4 Deleted from -- -- --

ASME PRA Standard Appendix B to DG-1161, Page B-20

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements SYSTEMS ANALYSIS SY-A1 Yes SY-4, SY-19 None No objection; SY-19 is the applicable NEI 00-02 element SY-A2 Yes AS-19, SY-5, None No objection; SY-5 and SY-16 SY-13, SY-16 are the applicable NEI 00-02 elements SY-A3 Yes SY-5, SY-6, None. Although there are No objection SY-8, SY-12, no explicit requirements in SY-14 NEI 00-02 that match SY-A3, performance of the systems analysis would require a review of plant-specific information sources SY-A4 Partial DE-11, SY-10, Confirm that this No objection SY requirement is met. This FOOTNOTE 5 can be done by citing either peer review results or example documentation.

NEI 00-02 does not address interviews with system engineers and plant operators to confirm that the model reflects the as-built, as-operated plant.

SY-A5 Partial QU-12, QU-13, Confirm this requirement is No objection SY-8, SY-11 met, and that the PRA considered both normal and abnormal system alignments. This can be done by citing either peer review results or example documentation. Although NEI 00-02 does not explicitly address both normal and abnormal alignments, their impacts are generally captured in the peer review of the listed elements.

SY-A6 Yes SY-7, SY-8, None No objection SY-12, SY-13, SY-14 SY-A7 Yes SY-6, SY-7, Check for simplified No objection SY-8, SY-9, system modeling as SY-19 addressed in SY-A7.

Appendix B to DG-1161, Page B-21

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements SY-A8 Partial SY-6, SY-9 Check to ensure boundaries No objection are properly established.

This can be done by citing either peer review results or example documentation.

NEI 00-02 does not address component boundaries except for EDGs. There is no explicit requirement that addresses modeling shared portions of a component boundary.

In practice, the peer reviews have examined consistency of component and data analysis boundaries.

SY-A9 Deleted from -- -- --

ASME PRA Standard SY-A10 Partial SY-9 Action is to determine if No objection the requirements of the ASME standard are met.

NEI 00-02 does not address all aspects of modularization.

SY-A11 Yes AS-10, AS-13, None No objection AS-16, AS-17, AS-18, SY-12, SY-13, SY-17, SY-23 SY-A12 Partial SY-6, SY-7, Document that modeling is No objection SY-8, SY-9, consistent with exclusions SY-12, SY-13, provided in SY-A14.

SY-14 Consistent with subelement SY-A12 of the ASME PRA Standard, critical passive components whose failure affects system operability should be included in system models.

Appendix B to DG-1161, Page B-22

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements SY- Partial SY-6, SY-7, Document that modeling is No objection with clarification:

A12a(1) SY-8, SY-9, consistent with exclusions Delete the sentences: The SY-12, SY-13, provided in SY-A12a. The criteria in SY-7 states that SY-14 criteria in SY-7 states that passive components should be passive components should included in a Grade 3 PRA if be included in a Grade 3 they influence the CDF or PRA if they influence the LERF. No definition of the CDF or LERF. No word influence is provided.

definition of the word influence is provided.

SY- Partial SY-15, SY-17 Document that modeling No objection A12b(3) incorporates flow diversion failure modes.

SY-A13 Yes DA-4, SY-15, None No objection SY-16 SY-A14 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

SY-A15 Yes SY-8, HR-4, None No objection; SY-8 and HR-4 HR-5, HR-7 are the applicable NEI 00-02 elements.

SY-A16 Yes SY-8, HR-8, None No objection; SY-8 and HR-8 HR-9, HR-10 are the applicable NEI 00-02 elements.

Appendix B to DG-1161, Page B-23

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements SY-A17 Yes AS-13, SY-10, None. SY-A17 is No objection SY-11, SY-13, evaluated in the NEI 00-02 SY-17 PRA Peer Review as follows:

SY-10 Failures or system termination (trip) due to spatial or environmental effects.

SY-11 Failure modes induced by accident conditions.

SY-13 System Termination (failure or trip) due to exhaustion of inventory (water, air).

SY-17 Success Criteria evaluation determined by plant-specific analysis that includes system trips or isolations on plant parameters.

AS-13 Failure of systems due to time phased effects such as loss of battery voltage.

SY-A18 Yes DA-7, SY-8, None No objection; DA-7 is the SY-22 applicable NEI 00-02 element.

SY- No Confirm this is accounted No objection A18a(3) for in the PRA. NEI 00-02 does not explicitly identify the criteria for tracking and modeling of coincident maintenance actions that may lead to unavailability of multiple redundant trains or systems.

SY-A19 Yes AS-18, DE-10, Verify SY-A19 has been No objection SY-11, SY-13, met. Ensure there is a SY-17, TH-8 documented basis (engineering calculations are not necessary) for modeling of the conditions addressed. NEI 00-02 focuses on environmental limitations.

Appendix B to DG-1161, Page B-24

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements SY-A20 Partial AS-19, SY-5, Document component No objection; SY-11 is the SY-11, SY-13, capabilities where applicable NEI 00-02 element.

SY-22, TH-8 applicable. NEI 00-02 does not explicitly require a check for crediting components beyond their design basis.

SY-A21 Yes SY-18 None. Comment: No objection Footnote to SY-18 explains lack of Grade provision for this sub-element.

SY-A22 Yes SY-24, DA-15, None No objection; SY-12 is the QU-18, SY-12 applicable NEI 00-02 element (wording in this element is vague and may not be interpreted as addressing support states).

SY-A23 Deleted from -- -- --

ASME PRA Standard SY-B1 Yes DA-8, DA-14, None No objection DE-8, DE-9, SY-8 SY-B2 Not required None No objection for Capability Category II SY-B3 Yes DE-8, DE-9, None No objection DA-10, DA-12 SY-B4 Yes DA-8, DA-10, None No objection; DA-8 is the DA-11, DA-12, applicable NEI 00-02 element.

DA-13, DA-14, DE-8, DE-9, QU-9, SY-8 SY-B5 Yes DE-4, DE-5, None No objection DE-6, SY-12, SY-B6 Yes SY-12, SY-13 Self-assessment needs to No objection confirm that the support system success criteria reflect the variability in the conditions that may be present during postulated accidents.

SY-B7 Yes AS-18, SY-13, None No objection SY-17, TH-7, TH-8 SY-B8 Yes DE-11, SY-10 None No objection; SY-10 is the applicable NEI 00-02 element.

Appendix B to DG-1161, Page B-25

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements SY-B9 Deleted from -- -- --

ASME PRA Standard SY-B10 Yes SY-12, SY-13 None No objection SY-B11 Yes SY-8, SY-12, Confirm by citing either No objection SY-13 peer review documentation/conclusions or examples from your model. NEI 00-02 does not explicitly address permissives and control logic. In practice, the items in SY-B11 have generally been examined in the peer reviews.

SY-B12 Yes SY-13 None No objection SY-B13 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

SY-B14 Partial DE-6, AS-6 Confirm by citing either No objection peer review documentation/conclusions or examples from your model. Ensure that modeling includes situations where one component can disable more than one system.

SY-B15 Yes SY-11 None No objection SY-B16 Yes SY-8 None No objection SY-C1(2) Yes SY-5, SY-6, None No objection SY-9, SY-18, SY-23, SY-25, SY-26, SY-27 Appendix B to DG-1161, Page B-26

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements SY-C2(2) Partial SY-5, SY-6, Action is to confirm No objection SY-9, SY-18, availability of SY-23, SY-25, documentation. In general, SY-26, SY-27 specified documentation items not explicitly addressed in NEI 00-02 checklists were addressed by the peer review teams.

If not available, documentation may need to be generated to support particular applications or respond to NRC RAIs regarding applications.

Comment: Footnote to SY-18 explains lack of Grade provision for this sub-element.

SY-C3(2) Partial QU-27, QU-28, Confirm that the key No objection QU-29, QU-34 assumptions and key sources of uncertainty consistent with the definitions of the ASME PRA Standard are documented.

HUMAN RELIABILITY ANALYSIS HR-A1 Yes HR-4, HR-5 Determine if analysis has No objection included and documented failure to restore equipment following test or maintenance.

HR-A2 Yes HR-4, HR-5 None No objection HR-A3 Yes DE-7, HR-5 None No objection HR-B1 Yes HR-5, HR-6 None No objection; HR-6 is the applicable NEI 00-02 element.

HR-B2 Partial HR-5, HR-6, Ensure single actions with No objection HR-7, HR-26, multiple train DA-5, DA-6 consequences are evaluated in pre-initiators, since the screening rules in HR-6 do not preclude screening of activities that can affect multiple trains of a system.

Appendix B to DG-1161, Page B-27

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements HR-C1 Yes HR-27, SY-8, None No objection SY-9 HR-C2 Yes HR-7, HR-27, Confirm that this No objection SY-8, SY-9 requirement is met. The specific list of impacts in HR-C2 is not included in NEI 00-02; however, in practice, the peer reviewers (in reviewing sub-elements HR-7 and related sub-elements) addressed these items.

HR-C3 Yes HR-5, HR-27, None No objection SY-8, SY-9 HR-D1 Yes HR-6 None No objection HR-D2 Yes HR-6 None No objection HR-D3 No Action is to confirm that No objection HR-D3 is met. This item is implicitly included in the peer review of HRA by virtue of the assessment of the crews ability to implement the procedure in an effective and controlled manner. The pre-initiator HRA adequacy is determined reasonable and representative considering the procedure quality.

HR-D4 Partial HR-6 Use the ASME standard No objection for requirements. NEI 00-02 does not explicitly cite the treatment of recovery actions for pre-initiators.

PRA implementation varied among utilities with some using screening values and others incorporating recovery.

The Peer Review team examines this treatment.

HR-D5 Yes DE-7, HR-26, None No objection; HR-26 is the HR-27 applicable NEI 00-02 element.

HR-D6 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

Appendix B to DG-1161, Page B-28

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements HR-D7 Not required None No objection for Capability Category II HR-E1 Yes AS-19, HR-9, None No objection; the example HR-10, HR-16, process in HR-9 for a Grade 3 SY-5 PRA (i.e., identify those operator actions identified by others) is not good practice and contrary to HR-10, which is the process recommended in HR-E1.

HR-E2 Yes HR-8, HR-9, None No objection (HR-9 and HR-HR-10, HR-21, 10 do not appear to match HR-22, HR-23, subject matter but HR-8 does).

HR-25 HR-E3 Partial HR-10, HR-14, The ASME standard No objection HR-20 supporting requirements are to be used during the self-assessment to confirm that the ASME intent is met for this requirement.

NEI 00-02 does not explicitly specify the same level of detail that is included in the ASME standard. The peer review team experience is relied upon to investigate the PRA given general guidance and criteria.

HR-E4 Partial HR-14, HR-16 The ASME standard No objection supporting requirements are to be used during the self-assessment to confirm that the ASME intent is met for this requirement.

NEI 00-02 does not explicitly specify the same level of detail that is included in the ASME standard. The peer review team experience is relied upon to investigate the PRA given general guidance and criteria.

Appendix B to DG-1161, Page B-29

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements HR-F1 Yes AS-19, HR-16, None No objection SY-5 HR-F2 Partial AS-19, HR-11, Determine whether the No objection HR-16, HR-17, requirements of the ASME HR-19, HR-20, standard are met. HR-F2 is SY-5 generally addressed by NEI 00-02 and the PRA Peer Review. One additional item is highlighted to be checked. NEI 00-02 does not explicitly cite indication for detection and evaluation. However, by invoking the standard HRA methodologies the treatment of cues and other indications for detecting the need for action are included.

HR-G1 Yes HR-15, HR-17, None No objection HR-18 HR-G2 Yes HR-2, HR-11 None. NEI 00-02 criteria No objection with for Grade 3 require a qualification: Self-assessment methodology that is needs to document if both consistent with industry cognitive and execution errors practice. This includes the are included in the evaluation incorporation of both the of HEPs.

cognitive and execution human error probabilities (HEPs) in the HEP assessment. HR-11 provides further criteria to ensure that the cognitive portion of the HEP uses the correct symptoms to formulate the crews response.

Appendix B to DG-1161, Page B-30

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements HR-G3 Partial HR-17, HR-18 The ASME standard No objection supporting requirements are to be used during the self-assessment to confirm that the ASME intent is met for this requirement.

NEI 00-02 does not explicitly enumerate the same level of detail that is included in the ASME standard. However, by invoking the standard HRA methodologies the performance shape factors are necessarily evaluated.

The peer review team experience is relied upon to investigate the PRA given general guidance and criteria.

HR-G4 Partial AS-13, HR-18, The ASME standard No objection; HR-19 is the HR-19, HR-20 supporting requirements applicable NEI 00-02 element.

are to be used during the self-assessment to confirm that the ASME intent is met for this requirement.

NEI 00-02 does not explicitly cite the necessity to define the time at which operators are expected to receive indications.

However, invoking the standard HRA methods leads to the necessity for the analysts to define this input to the HRA. The peer review team experience is relied upon to investigate the PRA given general guidance and criteria.

Appendix B to DG-1161, Page B-31

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements HR-G5 Partial HR-16, HR-18, Evaluate proper inputs per No objection with clarification:

HR-20 the ASME standard or cite Action should state Evaluate peer review F&Os or proper inputs per the ASME examples from your model. standard or cite peer review NEI 00-02 explicitly F&Os addresses observations and documentation/conclusions operations staff input for or examples from your model.

time required. ASME PRA Standard requires time measurements.

HR-G6 Yes HR-12 Check to ensure they are No objection.

met by citing peer review documentation/conclusions or examples from your model. HR-12 does not explicitly address all the items of the ASME standard list. In practice, peer reviews addressed these items.

HR-G7 Partial DE-7, HR-26 Check to see if factors that No objection are typically assumed to lead to dependence were included (e.g., use of common indications and/or cues to alert control room staff to need for action),

and a common procedural direction that leads to the actions. This can also be done by citing either peer review documentation/conclusions or examples from your model. NEI 00-02 does not provide explicit criteria that address the degree of dependence between HFEs that appear in the same accident sequence cutset.

However, invoking the standard HRA methods leads to the necessity for the analysts to define this input to the HRA. In general, the peer reviews addressed this. See also QU-C2.

Appendix B to DG-1161, Page B-32

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements HR-G8 Not required -- -- --

for Capability Category II HR-G9 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

HR-H1 Yes HR-21, HR-22, None No objection with clarification:

HR-23 The self-assessment needs to confirm that the requirements in HR-H1 in the ASME standard were addressed in the HRA.

HR-H2 Yes HR-22, HR-23 None No objection with qualification: The self-assessment needs to confirm that all the requirements of HR-H2 in the ASME standard were included in the HRA.

HR-H3 Yes HR-26 None No objection HR-I1(2) Partial HR-28, HR-30 None No objection HR-I2(2) Partial HR-28, HR-30 Action is to confirm No objection availability of documentation. In general, specified documentation items not explicitly addressed in NEI 00-02 checklists were addressed by the peer review teams.

If not available, documentation may need to be generated to support particular applications or respond to NRC RAIs regarding applications.

HR-I3(2) Partial QU-27, QU-28, Confirm that the key No objection QU-29, QU-34 assumptions and key sources of uncertainty consistent with the definitions of the ASME PRA Standard are documented.

Appendix B to DG-1161, Page B-33

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements DATA ANALYSIS DA-A1 Yes DA-4, DA-5, None No objection DA-15, SY-8, SY-14 DA- No Confirm that the No objection A1a(1) component boundary is consistent with the data applied.

DA-A2 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

DA-A3 Yes DA-4, DA-5, None No objection with DA-6, DA-7, qualification: The subject SY-8 matter in DA-A3 is not explicitly addressed in NEI 00-002 (not a critical requirement since identification of the needed parameters would be a natural part of the data analysis).

DA-B1 Yes DA-5 None No objection DA-B2 Yes DA-5, DA-6 Confirm that this No objection requirement is met. NRC comment: Grouping criteria listed in DA-5 should be supplemented with a caution to look for unique components and/or operating conditions and to avoid grouping them. Peer Review Teams were careful to assess plant-specific data evaluations to identify cases where outlier data values or components were not properly accounted for.

DA-C1 Yes DA-4, DA-7, None No objection DA-9, DA-19, DA-20 DA-C2 Yes DA-4, DA-5, None No objection DA-6, DA-7, DA-14, DA-15, DA-19, DA-20, MU-5 Appendix B to DG-1161, Page B-34

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements DA-C3 Partial DA-4, DA-5, Use the ASME standard No objection DA-6, DA-7, for requirements. NEI 00-MU-5 02 does not enumerate the items considered appropriate in a plant-specific data analysis.

DA-C4 No NEI 00-02 does not No objection explicitly cite this definition of failure and degraded state. Use the ASME standard for requirements.

DA-C5 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

DA-C6 Yes DA-6, DA-7 Confirm that this No objection requirement is met. NEI 00-02 addresses data needs when the standby failure rate model is used for demands. There are no stated criteria for the demand failure model; however, in practice, this was addressed during peer reviews.

DA-C7 Yes DA-6, DA-7 None No objection DA-C8 Yes DA-4, DA-6, Confirm that this No objection with DA-7 requirement is met. qualification: None of the Although there are no cited NEI 00-02 elements are specific criteria for applicable.

determining operational time of components in operation or in standby, the development needs to include these times. These issues were addressed during peer reviews.

Appendix B to DG-1161, Page B-35

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements DA-C9 Yes DA-4, DA-6, Confirm that this No objection DA-7 requirement is met.

Although there are no specific criteria for determining operational time of components in operation or in standby, the development needs to include these times. These issues were addressed during peer reviews.

DA-C10 No NEI 00-02 does not No objection address this supporting requirement. Use the ASME standard for requirements.

DA-C11 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

DA- No Use the ASME PRA No objection C11a(3) Standard for requirements.

PRA Peer Review Teams found that support system unavailabilities are treated within the support system and not within the associated frontline system.

DA-C12 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

DA-C13 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

DA-C14 Yes DA-15, AS-16, None No objection SY-24 Appendix B to DG-1161, Page B-36

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements DA-C15 Yes IE-13, IE-15, Confirm that this No objection IE-16, AS-16, requirement is met.

DA-15, SY-24, Although, it is relatively QU-18 rare to see credit taken for repair of failed equipment in PRAs (except in modeling of support system initiating events), any credit taken for repair should be well-justified, based on ease of diagnosis, the feasibility of repair, ease of repair, and availability of resources, time to repair and actual data. This can be done by citing either peer review results or example documentation.

DA-D1 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

DA-D2 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

DA-D3 Partial QU-30 The guidance in the No objection with qualification of DA-D3 qualification: Verify that SR provided in Reg Guide DA-D3 has been met. There is 1.200 Appendix A should no qualification of DA-D3 in be followed. A Reg Guide 1.200 Appendix A.

requirement for No change.

establishing the parameter distributions is not in the data analysis section but could be inferred from QU-

30. QU-30 does not provide guidance on which events to include in the uncertainty analysis.

Appendix B to DG-1161, Page B-37

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements DA-D4 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

This was performed as part of the Peer Review Team implementation of NEI 00-

02. (See DE-9.)

DA-D5 Partial DE-9, DA-8, Check for acceptable No objection DA-9, DA-10, common-cause failure DA-11, DA-12, models. This can be done DA-13, DA-14 by citing either peer review documentation/conclusions or example documentation.

This was performed as part of the Peer Review Team implementation of NEI 00-02 (See DE-9). The criteria for NEI 00-02 elements DA-13 & DA-14 only apply to Grade 4.

DA-D6 Partial DE-9, DA-8, None No objection; DA-8 and DA-9 DA-9, DA-10, are the applicable NEI 00-02 DA-11, DA-12, elements.

DA-13, DA-14 DA- Not required DA-14 DA-D6a is not an SR that No objection with clarification:

D6a(3) for Capability is required to be DA-D6a is required to be met Category II implemented. However, if whenever the plant-specific this approach is used, DA- screening and mapping of D6a should be confirmed industry-wide data is to be met. If it is performed as stated in the performed, see DE-9 from industry self-assessment NEI 00-02. actions. Therefore the statement Not required for Capability Category II is not accurate and may be misleading. It is more accurate to say that the plant-specific screening and mapping of industry-wide data is not required for Capability Category II.

DA-D7 No Use the ASME standard No objection for requirements. NEI 00-02 does not specifically address how to deal with data for equipment that has been changed.

Appendix B to DG-1161, Page B-38

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements DA-E1(2) Partial DA-1, DA-19, None No objection DA-20, DE-9 DA-E2(2) Partial DA-1, DA-19, Action is to confirm No objection DA-20, DE-9 availability of documentation. In general, specified documentation items not explicitly addressed in NEI 00-02 checklists were addressed by the peer review teams.

If not available, documentation may need to be generated to support particular applications or respond to NRC RAIs regarding applications.

DA-E3(2) Partial QU-27, QU-28, Confirm that the key No objection QU-29, QU-34 assumptions and key sources of uncertainty consistent with the definitions of the ASME PRA Standard are documented.

INTERNAL FLOODING IF-A1 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-A1a(1) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-A1b(1) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-A2 Deleted from -- --

ASME PRA Standard IF-A3 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-A4 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

Appendix B to DG-1161, Page B-39

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements IF-B1 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-B1a(4) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-B1b(3) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-B2 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-B3 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-B3a(3) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-B4 Deleted from -- --

ASME PRA Standard IF-C1 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-C2 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-C2a(1) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-C2b(2) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-C2c(5) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

Appendix B to DG-1161, Page B-40

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements IF-C3 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-C3a(1) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-C3b(3) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-C3c(6) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-C4 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-C4a(4) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-C5 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-C5a(1) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-C6 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-C7(3) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

Appendix B to DG-1161, Page B-41

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements IF-C8(3) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-C9(3) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-D1 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-D2 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-D3 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-D3a(3) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-D4 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-D5 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-D5a(1) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-D6(3) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-D7(3) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

Appendix B to DG-1161, Page B-42

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements IF-E1 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-E2 Deleted from -- --

ASME PRA Standard IF-E3 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-E3a(3) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-E4 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-E5 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-E5a(1) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-E6 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-E6a(1) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-E6b(1) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-E7 No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-E8(3) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

Appendix B to DG-1161, Page B-43

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements IF-F1(2) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-F2(2) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

IF-F3(2) No Use the ASME standard No objection for requirements. NEI 00-02 does not address this supporting requirement.

QUANTIFICATION ANALYSIS QU-A1 Yes AS-4, AS-5, None No objection; the requirement AS-6, AS-7, in QU-A1 is not explicitly AS-8, AS-9, stated in any element but is AS-10, AS-19 achieved by compliance with other NEI 00-02 elements.

QU-A2a Yes QU-8 None No objection QU- No ASME PRA Standard SR No objection A2b(1) should be addressed.

State of knowledge correlation is not explicitly cited in NEI 00-02 to be checked.

QU-A3 Yes QU-4, QU-8, None No objection; the requirement QU-9, QU-10, in QU-A3 is not explicitly QU-11, QU-12, stated in any element but is QU-13 achieved by compliance with other NEI 00-02 elements.

QU-A4 Yes QU-18, QU-19 None No objection QU-B1 Yes QU-6 None No objection QU-B2 Yes QU-21, QU-22, Confirm that this No objection; QU-21 and QU-QU-23, QU-24 requirement is met. In 23 are the relevant elements practice, the industry peer that address the requirements reviews have generally in QU-B2 while the remaining used the stated guidance as NEI 00-02 elements provide a check on the final cutset additional guidance on level quantification truncation. It is not clear what truncation limit applied in events and failure modes are the PRA. being addressed in QU-22. If the element is referring to a cutset truncation limit, then the values presented are reasonable.

Appendix B to DG-1161, Page B-44

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements QU-B3 Partial QU-21, QU-22, The self-assessment should No objection QU-23, QU-24 confirm that the final truncation limit is such that convergence toward a stable CDF is achieved.

QU-B4 Yes QU-4 None No objection. Although the stated purpose of the criterion for QU-4 is to verify that the base computer code and its inputs have been tested and demonstrated to produce reasonable results, the subtier criteria do not address this criterion, but instead provides some dos and donts for quantification.

QU-B5 Yes QU-14 None No objection QU-B6 Yes AS-8, AS-9, Check for proper No objection QU-4, QU-20, accounting of success QU-25 terms. The NEI 00-02 guidance adequately addresses this requirement, but QU-25 should not be restricted to addressing just delete terms.

QU-B7a Yes QU-26 None No objection QU- Yes QU-26 None No objection B7b(1)

QU-B8 No Use the ASME standard No objection for requirements. NEI 00-02 does not explicitly cite the details of Boolean logic code implementation.

QU-B9 Partial SY-9 The warnings in SY-A10 No objection must be considered in the modularization process.

SY-9 addresses the traceability of basic events in modules but does not address the correct formulation of modules that are truly independent.

Appendix B to DG-1161, Page B-45

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements QU-C1 Yes QU-10, QU-17, None No objection HR-26, HR-27 QU-C2 Yes QU-10, QU-17 Verify dependencies in No objection with clarification:

cutsets/sequences are Verify that dependence assessed. between the HFEs in a cutset or sequence is assessed in accordance with ASME SRs HR-D5 and HR-G7.

QU-C3 Yes QU-20 Confirm that this No objection requirement is met. QU-20 does not explicitly require that the critical characteristic, not just the frequency, be transferred; however, in practice, this was addressed during peer reviews.

QU-D1a Yes QU-8, QU-9, None No objection; the requirements QU-10, QU-11, in QU-D1 are addressed QU-12, QU-13, primarily in QU-8. The QU-14, QU-15, requirements in QU-9, QU-10, QU-16, QU-17 QU-14, QU-16, and QU-17 appear to be focused on modeling and not interpretation of results. As such, they are redundant to elements in the data, dependent failure, and HRA sections.

QU- Yes QU-8, QU-9, None No objection; the requirements D1b(1) QU-10, QU-11, in QU-D1 are addressed QU-12, QU-13, primarily in QU-8. The QU-14, QU-15, requirements in QU-9, QU-10, QU-16, QU-17, QU-14, QU-16, and QU-17 QU-23 appear to be focused on modeling and not interpretation of results. As such, they are redundant to elements in the data, dependent failure, and HRA sections.

Appendix B to DG-1161, Page B-46

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements QU- Yes QU-8, QU-9, None No objection; the requirements D1c(1) QU-10, QU-11, in QU-D1 are addressed QU-12, QU-13, primarily in QU-8. The QU-14, QU-15, requirements in QU-9, QU-10, QU-16, QU-17 QU-14, QU-16, and QU-17 appear to be focused on modeling and not interpretation of results. As such, they are redundant to elements in the data, dependent failure, and HRA sections.

QU-D2 Deleted from -- -- --

ASME PRA Standard QU-D3 Yes QU-8, QU-11, None No objection; consistency with QU-31 other PRA results is addressed in QU-11 and QU-31.

QU-D4 Yes QU-15 None No objection QU-D5a Yes QU-8, QU-31 Confirm that this No objection requirement is met. The subject matter in QU-D5a is partially addressed in NEI 00-02 in element QU-31 (QU-8 checks the reasonableness of the results). The contributions from IEs, component failures, common-cause failures, and human errors are not addressed. In practice, these were addressed during peer reviews.

QU- No Confirm that this No objection D5b(5) requirement is met.

Appendix B to DG-1161, Page B-47

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements QU-E1 Yes QU-27, QU-28, Confirm that QU-E1 is No objection with clarification:

QU-30 addressed. The definition QU-30 does not provide of the key sources of model guidance on sources of uncertainty is provided by uncertainty.

the ASME PRA Standard Addendum B. This nomenclature was not available when NEI 00-02 was implemented. The PRA Peer Review did examine the PRAs to see if modeling uncertainties were addressed appropriately.

QU-E2 Yes QU-27, QU-28, Confirm that this No objection.

QU-30 requirement is met. QU-27 and QU-28 focus on the assumptions and unusual sources of uncertainty.

Assumptions and unusual sources of uncertainty correspond to plant-specific hardware, procedural, or environmental issues that would significantly alter the degree of uncertainty relative to plants that have been assessed previously, such as NUREG-1150 or

. Unusual sources of uncertainty could also be introduced by the PRA methods and assumptions.

In practice, when applying NEI 00-02 sub-elements QU-27 and QU-28, the reviewers considered the appropriateness of the assumptions.

Appendix B to DG-1161, Page B-48

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements QU-E3 Partial QU-30 The uncertainty band No objection associated with each risk metric is to be estimated.

The parametric uncertainty band is to be estimated taking into account the state of knowledge correlation. This was to be checked by the Peer Review team.

QU-E4 Partial QU-28, QU-29, Use the ASME standard No objection QU-30 for requirements. NEI 00-02 does not explicitly specify that sensitivity studies of logical combinations of assumptions and parameters be evaluated.

QU-F1(2) Partial QU-31, QU-32, None No objection QU-34 QU-F2(2) Yes MU-7, QU-4, No action required for (m). No objection with QU-12, QU-13, Normal industry practice qualification: Confirm QU-27, QU-28, requires documentation of availability of documentation.

QU-31, QU-32 computer code capabilities. If not available, documentation may need to be generated to support particular applications or respond to NRC RAIs regarding applications. Self-assessment also needs to confirm computer code has been sufficiently verified such that there is confidence in the results.

QU-F3(2) Partial QU-31 Use the ASME standard No objection for requirements at the time of doing an application.

QU-F4(2) No QU-27, QU-28, Use the ASME standard No objection QU-32 for requirements at the time of doing an application.

NEI 00-02 does not address this supporting requirement.

QU-F5(2) No Use the ASME standard No objection for requirements at the time of doing an application.

NEI 00-02 does not address this supporting requirement.

Appendix B to DG-1161, Page B-49

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements QU-F6(3) No Use the ASME standard No objection for requirements at the time of doing an application.

NEI 00-02 does not address this supporting requirement.

Appendix B to DG-1161, Page B-50

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements LERF ANALYSIS LE-A1 Partial AS-14,AS-21, Confirm that the specifics No objection AS-23, L2-7 identified in LE-A1 are included in the PRA.

NUREG/CR-6595 methodology is not adequate for Capability Category II and III.

It is further noted that NEI 00-02 does not address criteria for the grouping into plant damage states (PDSs) (i.e., there are no criteria provided as to what information has to be transferred from the Level 1 to the Level 2 analysis).

L2-7 states the transfer from Level 1 to Level 2 should be done to maximize the transfer of relevant information, but does not specifically identify the type of information that must be transferred. L2-7 does refer to grouping sequences with similar characteristics and cautions care in transferring dependencies on accident conditions, equipment status and operator errors. In practice, this step included review of the process for developing and binning the PDSs and ensuring consistency between the PDSs and the plant state.

Appendix B to DG-1161, Page B-51

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements LE-A2 Partial L2-7, L2-8, AS- Confirm that the specifics No objection 21 identified in LE-A2 are included in the PRA.

NUREG/CR-6595 methodology is not adequate for Capability Category II and III.

It is noted that NEI 00-02 does not address criteria for the grouping into PDSs (i.e., there are no criteria provided as to what information has to be transferred from the Level 1 to the Level 2 analysis).

L2-7 states the transfer from Level 1 to Level 2 should be done to maximize the transfer of relevant information, but does not identify the type of information that must be transferred.

LE-A3 Partial L2-7, L2-8 Confirm that the specifics No objection identified in LE-A3 are included in the PRA.

NUREG/CR-6595 methodology is not adequate for Capability Category II and III.

It is further noted that NEI 00-02 does not address criteria for the grouping into PDSs (i.e., there are no criteria provided as to what information has to be transferred from the Level 1 to the Level 2 analysis).

L2-7 states the transfer from Level 1 to Level 2 should be done to maximize the transfer of relevant information, but does not identify the type of information that must be transferred.

Appendix B to DG-1161, Page B-52

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements LE-A4 Partial L2-7,L2-8, L2- Confirm that the specifics No objection 9, L2-24, L2-25 identified in LE-A4 are included in the PRA.

NUREG/CR-6595 methodology is not adequate for Capability Category II and III.

It is further noted that NEI 00-02 does not address criteria for the grouping into PDSs (i.e., there are no criteria provided as to what information has to be transferred from the Level 1 to the Level 2 analysis).

L2-7 states the transfer from Level 1 to Level 2 should be done to maximize the transfer of relevant information, but does not identify the type of information that must be transferred.

Appendix B to DG-1161, Page B-53

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements LE-A5 Partial L2-7 Confirm that the specifics No objection L2-8, L2-9, L2- identified in LE-A5 are 24, L2-25 included in the PRA.

NUREG/CR-6595 methodology is not adequate for Capability Category II and III.

It is further noted that NEI 00-02 does not address criteria for the grouping into PDSs (i.e., there are no criteria provided as to what information has to be transferred from the Level 1 to the Level 2 analysis).

L2-7 states the transfer from Level 1 to Level 2 should be done to maximize the transfer of relevant information, but does not identify the type of information that must be transferred.

L2-24 and L2-25 clearly indicate that the dependencies of systems, crew actions, and phenomena in the entire PRA need to be integrated into the model.

LE-B1 Yes L2-8, L2-10, None No objection L2-15, L2-16, L2-17, L2-19 LE-B2 Yes L2-13, L2-14 None No objection LE-B3(3) No NEI 00-02 does not No objection address this supporting requirement. Use the ASME PRA Standard for requirements.

LE-C1 Yes L2-24, L2-5, Confirm that the specifics No objection L2-8, L2-13, identified in LE-C1 with L2-14, L2-15, regard to the basis for L2-16, L2-17, assigning sequences to the L2-19, L2-20 LERF and non-LERF category meet the intent of LE-C1.

Appendix B to DG-1161, Page B-54

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements LE-C2a Yes L2-9, l2-12, Confirm that the actions No objection L2-25 credited are supported by AOPs, EOPs, SAMGs, TSC guidance or other procedural or guidance information as noted in LE-C2a.

LE-C2b(1) Partial L2-9, L2-12, Confirm that the specifics No objection L2-25 identified in LE-C2b are included in the PRA.

Repair of equipment would be subsumed under recovery actions in L2-9 and L2-5. If credit was taken for repair, actual data and sufficient time must be available and justified.

LE-C3 Partial L2-8, L2-24, Confirm that the No objection L2-25 justification for inclusion of any of the features listed in LE-C3 meet the revised requirements of LE-C3 in Addendum B of the ASME standard.

LE-C4 Partial L2-4, L2-5, The self-assessment needs No objection L2-6 to confirm the revised requirements of LE-C4 in Addendum B of the ASME standard.

LE-C5 Yes AS-20, AS-21, None No objection L2-7, L2-11, L2-25 LE-C6 Yes L2-12, L2-24, None No objection L2-25 LE-C7 Partial L2-7, L2-11, Confirm that the No objection L2-12, L2-24 requirements in LE-C7 are included in the PRA.

LE-C8a Partial L2-11, L2-12 Confirm that the treatment No objection of environmental impacts meets the revised requirements in LE-C8a in Addendum B of the ASME standard.

LE-C8b(1) Partial L2-11, L2-12 Confirm requirements of No objection LE-C8b are implemented in the PRA.

Appendix B to DG-1161, Page B-55

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements LE-C9a Partial AS-20, L2-11, Confirm that the treatment No objection L2-12, L2-16, of environmental impacts L2-24, L2-25 meets the revised requirements of LE-C9a in Addendum B of the ASME standard.

NEI 00-02 does not differentiate between containment harsh environments and containment failure effects on systems and operators.

This was typically addressed during peer reviews.

LE-C9b(1) Partial AS-20, L2-11, Confirm the treatment of No objection L2-12, L2-16, containment failure meets L2-24, L2-25 the revised requirements of LE-C9b.

NEI 00-02 includes the effects of containment harsh environments and containment failure effects on systems and operators.

This was typically verified during peer reviews.

LE-C10 Partial L2-7, L2-8, L2- The revised requirements No objection 13, L2-24, L2- of LE-C10 in Addendum B 25 of the ASME standard need to be considered in the self-assessment.

Containment bypass is explicitly identified in the failure modes addressed by the LERF analysis.

LE-D1a Partial L2-14, L2-15, Confirm that the No objection L2-16, L2-17, containment performance L2-18, L2-19, analysis meets the revised L2-20, ST-5, requirements of LE-D1a in ST-6 Addendum B of the ASME standard.

LE- Partial L2-14, L2-15, Confirm requirements of No objection D1b(1) L2-16, L2-17, LE-D1b are implemented.

L2-18, L2-19, L2-20, ST-5, ST-6 Appendix B to DG-1161, Page B-56

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements LE-D2 Partial L2-14, L2-19 Confirm the requirements No objection of LE-D2 are implemented.

NEI 00-02 does not explicitly enumerate this supporting requirement.

However, the containment failure analysis includes by its nature for Capability Category II the location of the failure mode.

Therefore, both the analysis and the peer review have typically addressed this SR.

LE-D3 Partial IE-14, ST-9 Confirm the requirements No objection of LE-D3 are implemented in accordance with Addendum B.

In practice, peer review teams evaluated the ISLOCA frequency calculation. F&Os under IE and AS would be written if this was not adequate.

LE-D4 No NEI 00-02 does not No objection address this supporting requirement. Use the ASME standard for Supporting Requirement LE-D4.

LE-D5 No NEI 00-02 does not No objection address this supporting requirement. Use the ASME standard for Supporting Requirement LE-D5.

Appendix B to DG-1161, Page B-57

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements LE-D6 Partial L2-16, L2-18, Confirm that the No objection L2-19, L2-24, containment isolation L2-25 treatment meets the revised requirements of LE-D6 in Addendum B of the ASME standard.

The guidance provided in NEI 00-02 does not explicitly enumerate the requirements in LE-D6.

However, the PRAs were constructed to address the requirements of NUREG-1335, which explicitly required containment isolation evaluation.

Therefore, the PRAs and the Peer Reviews have typically addressed this SR.

LE-E1 Yes L2-11, L2-12 None No objection LE-E2 Partial DA-4, HR-15, Confirm that the No objection L2-12, L2-13, requirements of LE-E2 of L2-17, L2-18, Addendum B are met.

L2-19, L2-20 LE-E3(3) No NEI 00-02 does not No objection address this supporting requirement. Use the ASME PRA Standard for Supporting Requirement LE-E3.

LE-E4(7) Partial QU sub- The self-assessment needs No objection elements to confirm that the applicable to parameter estimation meets LERF the revised requirements of LE-E4 in Addendum B of the ASME standard.

LE-F1a Yes QU-8, QU-9, None No objection QU-10, QU-11, QU-31, L2-26 LE-F1b(1) Yes L2-26 None No objection LE-F2 No QU-27, L2-26 NEI 00-02 does not No objection address this supporting requirement. Use the ASME standard for Supporting Requirement LE-F2.

Appendix B to DG-1161, Page B-58

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements LE -F3(3) No NEI 00-02 does not No objection address this supporting requirement. Use the ASME standard for Supporting Requirement LE-F3 LE-G1(2) Yes L2-26, L2-27, None No objection L2-28 LE-G2(2) Partial L2-26, L2-27, In general, specified No objection L2-28 documentation items not explicitly addressed in NEI 00-02 checklists were addressed by the peer review teams. Action is to confirm availability of documentation. If not available, documentation may need to be generated to support particular applications or respond to NRC RAIs regarding applications.

LE-G3(2) Partial L2-26, L2-27, In general, specified No objection L2-28 documentation items not explicitly addressed in NEI 00-02 checklists were addressed by the peer review teams. Action is to confirm availability of documentation. If not available, documentation may need to be generated to support particular applications or respond to NRC RAIs regarding applications.

LE-G4(2) Partial QU-27, QU-28, Confirm that the key No objection QU-29, QU-34 assumptions and key sources of uncertainty consistent with the definitions of the ASME PRA Standard are documented.

Appendix B to DG-1161, Page B-59

Table B-4. NRC Regulatory Position on Industry Self-Assessment Actions NEI Assessment Regulatory Position ASME Addressed by Applicable Industry Self-Assessment STD SR NEI 00-02? NEI 00-02 Actions Elements LE-G5(2) Partial L2-26, L2-27, In general, specified No objection L2-28 documentation items not explicitly addressed in NEI 00-02 checklists were addressed by the peer review teams. Action is to confirm availability of documentation. If not available, documentation may need to be generated to support particular applications or respond to NRC RAIs regarding applications.

LE-G6(3) No NEI 00-02 does not No objection address this supporting requirement. Use ASME PRA Standard Addendum B SR LE-G6 for requirements.

Notes from NEI 00-02 Appendix D2:

(1) Subdivided from a previous SR in Addendum A of the ASME PRA Standard. It is noted that Addendum B of the ASME PRA Standard has subdivided a number of SRs for the purpose of clarifying and separating the assignment of Capability Category of the SR in a clearly delineated fashion.

(2) Revised to reflect new format for documentation section and SRs.

(3) New SR added.

(4) SR added to address multi-unit sites.

(5) Formerly IF-A2.

(6) Formerly IF-E2.

(7) Formerly LE-E3.

NRC regulatory position on NEI-05-04, Process for Performing Follow-On PRA Peer Review Using the ASME PRA Standard, is provided below in Table B.5.

Appendix B to DG-1161, Page B-60

Table B-5. NRC Regulatory Position on NEI 05-04 Report Section Regulatory Commentary/Resolution Position Section 1.0. INTRODUCTION 1.1 Purpose No objection -----------------------------------

1.2 Background No objection -----------------------------------

1.3 Scope No objection Section 2.0. GENERAL OVERVIEW OF PEER REVIEW PROCESS 1st paragraph Clarification A follow-on peer review of an at-power, internal events PRA (including internal flooding) that uses as criteria the supporting requirements of Chapter 4 of the ASME PRA Standard needs to address the staffs position provided in Appendix A to this regulatory guide to be acceptable to the staff for a regulatory application.

4th paragraph Clarification Per Section 6.3 of the ASME PRA Standard, the staff position is that, in addition to the results of the PRA, the follow-on peer review must review the PRA models and assumptions related to the PRA upgrade to determine their reasonableness given the design and operation of the plant.

Section 3.0. GRADING PROCESS 1st paragraph Clarification NEI 05-04 indicates that one of the outcomes of the follow-on peer review process is the assignment of grades for each SR that are used to indicate the relative capability level of each PRA technical element. Since the use of a PRA for risk-informed applications needs to be determined at the SR level, the staff does not utilize an overall PRA technical element capability level in the assessment of a PRA for specific applications.

2nd paragraph Clarification NEI states that it is essential to focus the peer review on the specific conclusions of the PRA to ensure that the review directly addresses intended plant applications. The staff position is that the follow-on peer review must also review the PRA models and assumptions related to the PRA upgrade in addition to the results of the PRA in order to ensure the PRA can be used for specific applications.

3.1 Grading Clarification A follow-on peer review of an at-power, internal events PRA (including Process for Peer internal flooding) that uses as criteria the supporting requirements of Reviews Against Chapter 4, and the requirements of Chapter 5 of the ASME PRA Standard ASME PRA needs to address the staffs position provided in Appendix A to this Standard regulatory guide to be acceptable to the staff for a regulatory application.

2nd paragraph 5th paragraph Clarification NEI 05-04 indicates that although no grades are assigned to HLRs, a qualitative assessment of the HLRs will be made based on the associated SR grades. The staffs position is consistent with the ASME PRA Standard, which indicates that a PRA reviewed against the standard must satisfy all HLRs. To meet an HLR, all SRs under that HLR must meet the requirements of one of the three Capability Categories.

Appendix B to DG-1161, Page B-61

Table B-5. NRC Regulatory Position on NEI 05-04 Report Section Regulatory Commentary/Resolution Position 3.2 Comparison Clarification The NEI 00-02 process uses a set of checklists as a framework within Against Grading which to evaluate the scope, comprehensiveness, completeness, and fidelity Process for of the PRA being reviewed. The checklists by themselves are insufficient NEI 00-02 to provide the basis for a peer review since they do not provide the criteria that differentiate the various grades of PRA. The NEI subtier criteria provide a means to differentiate between grades of PRA. However, since the NEI subtier criteria do not address all of the requirements in the ASME PRA Standard, the staffs position is that a peer review based on these criteria is incomplete. The PRA standard requirements that are not included in the NEI 00-02 subtier criteria (identified for a Grade 3 PRA in Table B-

3) need to be addressed in the NEI 00-02 self-assessment process as endorsed by the staff in this appendix. (Staff comment on section 1.1 on NEI 00-02)

Clarification The NEI 00-02 peer review process grades each PRA element from 1 to 4, while the ASME PRA Standard uses Capability Categories I, II, and III.

The staff interpretation of Grades 2, 3, and 4 is that, they correspond broadly to Capability Categories I, II, and III respectively. This statement is not meant to imply that the supporting requirements, for example, for Category I are equally addressed by Grade 2 of NEI 00-02. The review of the supporting requirement for Category II against Grade 3 of NEI 00-02 indicated discrepancies and consequently the need for a self-assessment.

The existence of these discrepancies would indicate that it would not be appropriate to assume that there are not discrepancies between Category I and Grade 2. A comparison between the other grades and categories has not been performed. The implications of this are addressed in item 7 of Table B-2. (Staff comment on section 3.3 on NEI 00-02)

Qualification The staff believes that different applications of a PRA can require different PRA subelement grades. The NEI peer review process is performed at the subelement level and does not provide an overall PRA grade. Therefore, it is inappropriate to suggest an overall PRA grade for the specific applications listed in this section. The staff does not agree with the assigned overall PRA grades provided for the example applications listed in this section of NEI 05-04. (Staff comment on Section 3.3 on NEI 00-02)

Section 4.0. FOLLOW-ON PEER REVIEW: ASME PRA STANDARD SCOPE 4.1 Scope Clarification The staff accepts that in addition to performing a follow-on peer review of a PRA update, the process in NEI 05-04 can be used to validate the self-assessment performed under NEI 00-02 Appendix D guidance (referred to in NEI 05-04 as a gap-analysis), as endorsed in this appendix. The use of the results of the NEI 00-02 self-assessment can be used to focus such a review. However, for a follow-on peer review of a PRA upgrade, the staffs position is that all pertinent SRs must be reviewed.

4.2 Host Utility No objection ---------------------------------

Requirements Appendix B to DG-1161, Page B-62

Table B-5. NRC Regulatory Position on NEI 05-04 Report Section Regulatory Commentary/Resolution Position 4.3 Self- Clarification The staff interpretation of NEI 00-02 Grades 2, 3, and 4 is that, they Assessment correspond broadly to the ASME PRA Standard Capability Categories I, II, and III respectively. This statement is not meant to imply that the supporting requirements, for example, for Category I are equally addressed by Grade 2 of NEI 00-02. The review of the supporting requirement for Category II against Grade 3 of NEI 00-02 indicated discrepancies and consequently the need for a self-assessment. The existence of these discrepancies would indicate that it would not be appropriate to assume that there are not discrepancies between Category I and Grade 2. A comparison between the other grades and categories has not been performed. Thus, although it is reasonable to assign an SR that received a Grade 3 or 4 in the NEI 00-02 review as a Capability Category II, it is not reasonable to assume a Grade 2 corresponds to Capability Category I. (Staff comment on Section 3.3 on NEI 00-02) 4.5 Peer Review No objection ------------------------------------------

Schedule 4.6 Peer Review Qualification NEI 05-04 states that a reviewers assessment whether each SR meets the Process ASME PRA Standard should be derived from what is in the standard and not based on the staffs clarifications and qualifications of the SRs provided 4th paragraph in Appendix A to this regulatory guide. The staffs position is that, when used to support a regulatory application, the assigned SR grades accepted by the NRC for a specific application will include consideration of the clarifications and qualifications to the ASME PRA Standard provided in Appendix A.

9th and 10th Clarification Section 6.1 of the ASME PRA Standard indicates that the peer review need paragraphs not assess all aspects of the PRA against all of the Section 4 requirements.

The NEI 05-04 process interpretation of this statement allows for skipping review of selected SRs if the reviewers determine they can achieve consensus on the adequacy of the PRA with respect to the HLR associated with the SRs that are not reviewed. The staffs position is that the statement quoted refers to the scope of the models being reviewed and not the scope of the SRs to be reviewed. The staffs position is that all SRs pertinent to the PRA upgrade must be reviewed against a sufficient number and variety of models in the PRA (e.g., selected fault and event trees) to determine the SR capability categories. Without a review, the capability category for skipped SRs cannot be determined.

Appendix B to DG-1161, Page B-63

Table B-5. NRC Regulatory Position on NEI 05-04 Report Section Regulatory Commentary/Resolution Position APPENDICES Appendix A No objection ------------------------------------

Sample Fact and Observation Form Appendix B No objection ------------------------------------

Sample Summary Tables Appendix C No objection ---------------------------------

Maintenance and Update Process Review Checklist Appendix B to DG-1161, Page B-64