ML18169A160
| ML18169A160 | |
| Person / Time | |
|---|---|
| Issue date: | 06/18/2018 |
| From: | Ed Miller Special Projects and Process Branch |
| To: | Ed Miller Special Projects and Process Branch |
| References | |
| Download: ML18169A160 (33) | |
Text
NRR-DMPSPEm Resource From: Miller, Ed Sent: Monday, June 18, 2018 9:23 AM To: Miller, Ed
Subject:
NRC slides for June 18, 2018, Public Meeting Attachments: new-methods-draft-final_6_18-2018.pdf Subject slides attached.
1
Hearing Identifier: NRR_DMPS Email Number: 429 Mail Envelope Properties (BL0PR0901MB2386768FDDE9C9F0976093AEE9710)
Subject:
NRC slides for June 18, 2018, Public Meeting Sent Date: 6/18/2018 9:22:34 AM Received Date: 6/18/2018 9:22:36 AM From: Miller, Ed Created By: Ed.Miller@nrc.gov Recipients:
"Miller, Ed" <Ed.Miller@nrc.gov>
Tracking Status: None Post Office: BL0PR0901MB2386.namprd09.prod.outlook.com Files Size Date & Time MESSAGE 28 6/18/2018 9:22:36 AM new-methods-draft-final_6_18-2018.pdf 589664 Options Priority: Standard Return Notification: No Reply Requested: No Sensitivity: Normal Expiration Date:
Recipients Received:
Use of New Methods in PRA Models June 18, 2018 Mary Drouin, Sr. Programs Manager, RES\DRA Mehdi Reisi Fard, Team Leader (A), NRR\DRA Stacey Rosenberg, Chief, PRA Licensing Branch A, NRR\DRA Sunil Weerakkody, Sr. Technical Advisor, NRR\DRA 06/18/2018 Public Meeting on New Methods 1
OBJECTIVES
- Discuss the issue of New Methods for TSTF-505 (TS 4B).
- Provide NRC Staff conclusions on NEIs Proposed License Condition.
- Propose a path forward for all risk-informed applications.
06/18/2018 Public Meeting on New Methods 2
OUTLINE
- Status of Risk-Informed LAR Reviews
- Background on New Methods
- NRC Conclusion on Proposed License Condition for TS 4B
- Options for Path-Forward
- Use of Industry Peer-Review
- PRA Acceptability
- Peer Review
- ASME\ANS PRA Standard
- RG 1.200
- Transition and Proposed Next Steps 06/18/2018 Public Meeting on New Methods 3
Status of LAR Review Activities PRA Licensing Branches A & B
- Twelve CFR 50.69 LARs
- Four Tech Spec 4B LARs
- Seven Tech Spec 5B LARs
- Five TMRE\TORMIS LARs
- Three RI-ISI LARs
- Six Miscellaneous other LARs 06/18/2018 Public Meeting on New Methods 4
Status of LAR Reviews (Cntd.)
In summary,
- A total of 51 risk-informed LARs under review
- Eighteen Safety Evaluations issued todate in 2018 06/18/2018 Public Meeting on New Methods 5
BACKGROUND -New Methods Formation of NRC & Industry RISCs (2015)
Vetting Panel process proposed by industry NRC developed staff position (to be integrated into RG 1.200)(2016)
NRC developed internal process to implement Vetting Panel process (2016)
Industry Developed NEI 16-04 to support Vetting Panel Process(2016) 06/18/2018 Public Meeting on New Methods 6
BACKGROUND - New Methods (Contd
- NRC issued letter granting fee-waiver to pilot Vetting Panel process (2016).
- Several public meetings held on process.
- NEI proposes License Condition for Tech Spec 4B (2017).
- NEI submits responses to staff concerns on NEIs proposed license condition (2018).
- NRC issued proposal for Revision 2 to TSTF-505 (2018).
06/18/2018 Public Meeting on New Methods 7
NRC Conclusions on NEI Proposal
- NRC has significant concerns about tacit approval of new methods proposed in NEIs license condition.
- NRCs oversight framework is not amenable to support NEI proposal.
- procedures, resources, training needed for resident inspectors not ready.
- Proposed license condition overlooks key safety attributes of Tech Spec 4B.
06/18/2018 Public Meeting on New Methods 8
NRC Conclusion on NEI Proposal (Contd)
- NEI proposal would allow self-approved changes to methods
- New PRA methods traditionally developed to reduce perceived conservative results
- New methods identified during LAR reviews sometimes apply oversimplified and non-conservative approximations, i.e., realistic can be highly configuration specific and complex
- Could result in plants operating at relatively high instantaneous CDFs.
06/18/2018 Public Meeting on New Methods 9
NRC Conclusion on NEI Proposal (summarized)
In light of direct influence of numbers generated by PRA models to self-approve changes Tech Spec Completion Times which often include exposure to single failure vulnerability and could result in plants operating at relatively high instantaneous CDFs and some challenges associated with the implementation of the peer-review & F&O Closure Processes, NRC staff does not understand how the License Condition proposed by NEI would adequately control PRA methods within the existing licensing and oversight infrastructure.
06/18/2018 Public Meeting on New Methods 10
Forward Path for Tech Spec 4B LAR Reviews
- NRC continues to review four LARs on Tech Spec 4B.
06/18/2018 Public Meeting on New Methods 11
Options for Path Forward
- Development of the Vetting Panel Process.
- NRC still considers this as a viable option
- Need to address staff and industry concerns
- NRC approval of a subset of significant new methods.
- Align on determining the subset of new methods that require prior NRC approval
- Can provide regulatory stability
- Use of industry peer-review and the F&O closure process.
06/18/2018 Public Meeting on New Methods 12
Industry Peer-Review
- Peer-review teams review, document, & report new methods
- Enhancement (guidance) needed for each of these items
- NRC responsibility to accept and/or approve, as appropriate
- Infrastructure (e.g., ASME/ANS PRA Standard, RG 1.200, NEI-17-07) needs enhancement to address missing requirements
- A risk-informed oversight process will complement licensing activities 06/18/2018 Public Meeting on New Methods 13
Use of Industry Peer-Review Process (some pros)
- Consistent with past agency\industry practices and leverages NRC and industry investments
- Creates potential to reduce undue burdens to licensees & NRC staff.
- Creates the potential to mitigate application specific nature of the issue.
06/18/2018 Public Meeting on New Methods 14
Use of Industry Peer Review -Some Key Issues
- What is a New Method?
- What is a Newly Developed Method?
- What are the criteria that needs to be used to review New Methods?
- What are the needed qualifications of the peer-reviewers who would be reviewing New Methods?
- other.
06/18/2018 Public Meeting on New Methods 15
PRA Acceptability - 3 Elements
- All 3 elements Regulatory Guide (RG) 1.200 provides NRC have to work staff position together to PRA PRA Standard ACCEPTABILITY Peer Review demonstrate PRA to demonstrate conformance with staff position to demonstrate conformance with PRA Standard acceptability 06/18/2018 Public Meeting on New Methods 16
ASME/ANS PRA Standard - New PRA Methods and PRA Upgrade vs Maintenance
- Major issue, standard now requires the peer review to address new PRA methods
- Standard did not provide the necessary requirements for the peer review
- No criteria for new method acceptability
- No qualifications for the peer review team members
- Standard silent on resolution of peer review findings
- Standard addresses PRA upgrade versus maintenance in a non-mandatory appendix
- Guidance is unclear and open to different interpretations
- NRC has provided comments with regard to:
- Independent Assessment
- Peer review of new PRA method
- Definitions
- PRA upgrade versus maintenance 06/18/2018 Public Meeting on New Methods 17
NEI 17--07, Performance of PRA Peer Reviews Using the ASME/ANS PRA Standard
- NEI 17-07 replaces NEI 05-04, 07-12, and 12-13 and is to support other developed PRA standards (e.g., Level 2)
- Appendix x (Independent Assessment) to be added to NEI 17-07
- NEI 17-07 includes guidance for peer review of new methods or focused peer review for an PRA upgrade
- NRC staff has initiated its review
- Plans to share staff review in fall of 2018
- Will endorse in Revision 3 to RG 1.200 06/18/2018 Public Meeting on New Methods 18
Regulatory Guide 1.200 - Revision 3 (1/4)
- Numerous changes being considered
- Adding subsection addressing Independent Assessment Process
- Adding staff position as noted in May 2017 letter providing interim approval
- Adding to staff position on peer review of new methods
- Criteria for determining new method
- Needed attributes and characteristics for new method acceptability
- Needed qualifications of the peer reviewer
- Adding to staff position on determining PRA upgrade versus maintenance
- Adding section on definitions; for example:
- PRA, PRA method, new PRA method, PRA upgrade, PRA maintenance 06/18/2018 Public Meeting on New Methods 19
Regulatory Guide 1.200 - Revision 3 (2/4)
- Staff position on new methods, definitions, etc.
- Consistent with staff comments submitted to JCNRM on the new edition to the PRA standard
- For example, staff comment on new method acceptability:
- When reviewing a new method, the analyst shall evaluate:
- How the uncertainties are addressed
- Whether appropriate for the context
- The validity of assumptions
- Input data are relevant and technically sound
- Produces results comparable to similar methods (e.g., bases for differences are understood)
- Representation of the plant
- Based on proven theories 06/18/2018 Public Meeting on New Methods 20
Regulatory Guide 1.200 - Revision 3 (3/4)
- For example, staff comment on definition:
- method: is the compilation of the analyses, tools, assumptions, and data used develop a model that reflects the performance of the entity under consideration. For example, application of the MELCOR code, a system level code which contains engineering analyses and assumptions supported by experimental data, is the method used to develop a response model that predicts the performance of the core during PRA transients.
- new method: if the analyses, tools, assumptions or data associated with the method have fundamentally changed even if the output of the model does not significantly change. Moreover, a method is also new if it is being used in a different application/context that was originally designed. A new method is one that has been: (1) developed separate from an existing method, (2) modified from an existing method, or (3) the method is used in different context that was originally intended.
- PRA upgrade versus maintenance
- Process being developed assesses how the change to the PRA model impacts the technical element(s) 06/18/2018 Public Meeting on New Methods 21
Regulatory Guide 1.200 - Revision 3 (4/4)
- Path Forward:
- Public meeting in late summer to share staff proposed process for new method and PRA upgrade versus maintenance
- Additional public meetings to be scheduled as needed
- To be incorporated into Revision 3 of RG 1.200 06/18/2018 Public Meeting on New Methods 22
TRANSITION
- Work towards empowering peer-reviewers to review, document & report most newly developed methods.
- NRC is not delegating method approval authority to peer-review teams.
- Oversight will be relied to ensure safety 06/18/2018 Public Meeting on New Methods 23
TO ENABLE TRANSITION
- Align on review criteria that will be used by peer reviewers to evaluate new & newly developed methods
- Align on experience of peer-reviewers who will be qualified to review new or newly developed methods
- Align on the timing on how\when to revise models to address peer review findings on new or newly developed methods
- Align on characteristics of the subset of newly developed methods that requires prior NRC approval 06/18/2018 Public Meeting on New Methods 24
PROPOSED NEXT STEPS
- 2018-2019: Planned update to ASME\ANS PRA Standard (e.g., incorporating criteria for reviewing methods)
- 2019-2020: Planned update to RG 1.200 (e.g.,
incorporate clear definition of upgrade vs update)
- Endorsement of new edition to the ASME/ANS standard
- Endorsement of NEI 17-07
- 2019-2020: test and pilot the peer review of new methods
- 2018-2019: Developing a framework for oversight (e.g.,
periodic verifications on acceptable configuration management of PRA models) 06/18/2018 Public Meeting on New Methods 25
BACK-UP SLIDES 06/18/2018 Public Meeting on New Methods 26
NEI-06-09-A (Staff Evaluation of NEI-06-09-A)
As part of its review and approval of a licensees application requesting to implement the RMTS, the NRC staff intends to impose a license condition that will explicitly address the scope of the PRA and non-PRA methods approved by the NRC staff for use in the plant-specific RMTS program. If a licensee wishes to change its methods, and the change is outside the bounds of the license condition, the licensee will need NRC approval, via a license amendment, of the implementation of the new method in its RMTS program. The focus of the NRC staffs review and approval will be on the technical adequacy of the methodology and analyses relied upon for the RMTS application.
06/18/2018 Public Meeting on New Methods 27
License Condition on Vogtle TS 4B The risk assessment approach and methods, shall be acceptable to the NRC, be based on the as-built, as-operated, and maintained plant, and reflect the operating experience of the plant as specified in RG 1.200. Methods to assess the risk from extending the completion times must be PRA methods accepted as part of this license amendment, or other methods approved by the NRC for generic use.
If the licensee wishes to change its methods, and the change is outside the bounds of this license condition, the licensee will seek prior NRC approval, via a license amendment.
06/18/2018 Public Meeting on New Methods 28
Revision 2 of TSTF-505 Section 2.2.2.e of Model SE to TSTF 505 The risk assessment approaches and methods shall be acceptable to the NRC. The plant PRA shall be based on the as-built, as-operated, and maintained plant; and reflect the operating experience at the plant, as specified in Regulatory Guide 1.200, Revision 2. Methods to assess the risk from extending the completion times must be PRA methods used to support this license amendment, or other methods approved by the NRC for generic use; and any change in the PRA methods to assess risk that are outside these approval boundaries require prior NRC approval.
06/18/2018 Public Meeting on New Methods 29
50.69 License Condition Rev. 1 of RG 1.201, (May 2006)
- As part of the NRCs review and approval of a licensees or applicants application requesting to implement §50.69, the NRC staff intends to impose a license condition that will explicitly address the scope of the PRA and non-PRA methods used in the licensees categorization approach. If a licensee or applicant wishes to change its categorization approach and the change is outside the bounds of the NRCs license condition (e.g., switch from a seismic margins analysis to a seismic PRA), the licensee or applicant will need to seek NRC approval, via a license amendment, of the implementation of the new approach in their categorization process. The focus of the NRC staffs review and approval will be on the technical adequacy of the methodology and analyses relied upon for this application (Rev. 1 to RG 1.201).
- Note: LAR is required when there is a change in the categorization approach.
06/18/2018 Public Meeting on New Methods 30
TSTF-505, Rev. 2, Model SE, Section 2.2.2.e (May 2018)
- 2.2.2.e. The risk assessment approaches and methods shall be acceptable to the NRC. The plant PRA shall be based on the as-built, as-operated, and maintained plant; and reflect the operating experience at the plant, as specified in Regulatory Guide 1.200, Revision 2. Methods to assess the risk from extending the completion times must be PRA methods used to support this license amendment, or other methods approved by the NRC for generic use; and any change in the PRA methods to assess risk that are outside these approval boundaries require prior NRC approval.
06/18/2018 Public Meeting on New Methods 31