ML22146A078
| ML22146A078 | |
| Person / Time | |
|---|---|
| Issue date: | 06/01/2022 |
| From: | NRC/OCM |
| To: | |
| Shared Package | |
| ML22138A205 | List: |
| References | |
| M220601 | |
| Download: ML22146A078 (45) | |
Text
Transformation at the NRC -
Sustaining Progress as a Modern, Risk-Informed Regulator June 1, 2022
Daniel Dorman Executive Director for Operations
Aida Rivera-Varona, Acting Deputy Assistant for Operations, Office of the Executive Director for Operations Tim Mossman, EMBARK Venture Studio Managing Director, Office of Nuclear Reactor Regulation Caylee Kenny, Project Manager, Materials Rulemaking and Project Management Branch, Office of Nuclear Material Safety and Safeguards Rebecca Richardson, Chief, Intelligence Liaison & Threat Assessment Branch, Division of AGENDA Security Operations, Office of Nuclear Security and Incident Response Jeffery Wood, Reliability and Risk Analyst, Probabilistic Risk Assessment Branch, Office of Nuclear Regulatory Research Antonios Zoulis, Chief, PRA Oversight Branch, Division of Risk Assessment, Office of Nuclear Reactor Regulation Abby Olarte, Senior IT Program Manager, Financial Systems Branch, Office of the Chief Financial Officer 3
Aida Rivera-Varona Measuring progress and initial responses to external survey
Evolution of Objectives and Key Results (OKRs) 2020 OKRs: Building Transformation Infrastructure 2021 OKRs: Increasing Use of Transformation Tools 2022 OKRs: Sustaining Progress 5
2020 OKRs Drove the Development of Tools
- Major milestones completed in 2020 included:
- Issuance and application of the Be riskSMART decision-making framework;
- Deployment of the IdeaScale innovation platform;
- Deployment of the Career Enhancement tool; and
- Expansion and broad implementation of Office 365 and other collaborative work tools, while over 90% of employees were working remotely during the COVID-19 pandemic.
6
2021 OKRs Produced Greater Familiarity and Application of Transformation Tools
- Successes: ASPIRATIONAL
- Increased application of the Be KEY RESULTS riskSMART framework;
- Used innovation to identify and Met Unmet Undetermined implement several process improvements; 6%
- Modest positive increase in the 2021 31%
Agency Culture Pulse Survey; and
- Increased use of data analytic tools to inform decision-making 63%
7
External Stakeholders Provide Perspectives on Transformation Efforts Respondents
- Survey sought perspectives from various stakeholders 6% 3%
regarding the agencys 33%
transformation efforts. 17%
- Available from September 13, 2021 - March 31, 2022 19%
22%
- Total of 81 responses Nuclear Reactor Nuclear Security Nuclear Materials Radioactive Waste Corporate Support None of the above 8
Respondents are Knowledgeable about Transformation Efforts
- Positive feedback regarding the agencys information sharing and mission performance
- General uncertainty on what the agency means by data analytics and how risk information is used to make timely decisions 9 16
% of external stakeholder respondents who agree that NRCs use of risk information has improved.
(Target: 75%)
RESULT: 44%
Measuring the 2021 % of external stakeholder respondents who agree that NRCs adoption of new approaches and solutions has External improved.
(Target: 75%)
Stakeholder RESULT: 57%
Perspective
% of external stakeholder respondents who agree that NRCs use of technology has improved.
(Target: 75%)
RESULT: 52%
10
Tim Mossman Update on MAP-X module development and deployment
Modernizing Data Transfer
- Transform the way we exchange information with external stakeholders
- Collecting Data instead of Documents
- Exchanging data is a two-way street 12
MAP-X Offers Advantages for NRC and Stakeholders
- Collection of "data"
- Accessible from anywhere
- Readily parsed into internal
- Centralized, flexible, secure, systems personalized
- Potential for greater automation
- Data validation / auto-populated
- Ability to share data to select fields external stakeholders
- Create, edit, preview, submit, confirmation 13
Early Modules Deployed for Use
- Web-Based Relief Requests
- launched April 2021
- Event Notifications -
launched January 2022
- Licensee Event Reports -
expected 3rd Quarter CY22 The MAP-X Portal is Live!
URL: https://mapx.nrc-gateway.gov/
14
Feedback from Stakeholders
- Web-Based Relief Requests
- Some early adopters have continued to use
- Some trials did not result in repeat "business" - challenges with the interface, lack of stakeholder efficiency gains
- Event Notifications
- Working through challenges
- Licensee's Event Notification submitters not credentialed
- Short timelines
- Regulation does not recognize MAP-X as a method to meet requirements 15
Future Modules and Outreach Activities
- Modules
- Licensee Event Reports
- Data exchange with non-reactor community
- Sharing selected NRC data with external stakeholders
- Outreach activities
- Feedback on new modules
- Communications with reactor and materials licensees to explain benefits
- Early marketing and buy-in from stakeholder groups 16
Caylee Kenny Update on improvements and successes in the Rulemaking program
Achieving Results Through Rulemaking Innovation URL: https://www.nrc.gov/docs/ML2019/ML20198M408.pdf 18
Showcasing Successes Engagement Timeliness Agreement State Interactions - Concurrence Process -
Increased participation in petitions Process level improvements realized Public Comment Resolution - Regulatory Basis Process -
Improvements in quality, Expected to save 6-9 months from consistency, and documentation overall rulemaking schedule Agile Concepts -
Rulemaking Summaries -
Petition review board Increased public awareness held 1.5 months ahead and transparency of milestone 19
Sustaining Progress Incremental improvements & incorporation of original efforts into daily work Targeted approach; focusing on most impactful activities Full assessment of concurrence process improvements 20
Reflecting on our Innovation Journey Innovations have provided positive outcomes and results Rulemaking is a deliberative process; there is still room to innovate Continued commitment to improvement 21
Rebecca Richardson Applying the Be riskSMART framework to NRCs security oversight programs
- Note: Step 1, Be clear about the problem, includes What is required?
FRAMEWORK 23
Making Decisions In The Presence Of Uncertainty Be riskSMART allows us to use all The structured available framework of Be information to riskSMART gives us decide how to confidence in approach the making decisions challenge with uncertainties Be riskSMART helps identify uncertain conditions so they can be managed before they become issues Using All Available Information To Make A Decision 24
Conducting Force-on-force Inspections During the COVID-19 PHE How to execute effective oversight during the COVID-19 PHE?
Used the Be riskSMART framework to address challenges.
Developed a plan that balanced protecting the health and safety of our staff while accomplishing our safety and security mission.
25
Cyber Security Inspections How can cyber security inspections be more efficient and performance-based?
Developed multiple options that considered the risk and benefits for each.
Developed an option for performance-based testing and advance submittal of metrics.
26
Reasonable Assurance of Protection Time (RAPT)
How can we provide credit for operator actions and law enforcement response at operating nuclear power plants?
Used Be riskSMART framework to assess the challenges and develop an approach to provide this credit.
Staff developed the RAPT to increase regulatory clarity and enable licensees to refine their protective strategies.
27
Jeffery Wood SPAR-dash, a risk-informed mobile application for applying risk insights to NRC regulatory programs
SPAR-DASH: Tool for Accessing Risk Results Making risk Easy-to-use, information interactive accessible dashboard Communication of Support Be risk insights riskSMART 29
SPAR-DASH: Bypassing Barriers to Risk Insights Innovative data processing approach Interactive dashboard Leverage NRCs SPAR risk models Sample results do not represent actual plant risk 30
What Can SPAR-DASH Do?
Easy access to reference materials Making efficient use of risk results
- Ranking risk importance
- Assessing events &
hazards
- Off-normal conditions
- Plant-to-plant comparisons Sample results do not represent actual plant risk 31
SPAR-DASH Applications Support operating reactor licensing and oversight Sample results do not represent actual plant risk
- Work planning
- Prioritizing reviews
- Emergent issues
- Risk-informed inspection sampling The SPAR-DASH Team:
- Independent risk tool Ching Ng (NRR/DRA) Jinsuo Nie (RES/DE) for NRC staff Qin Pan (RES/DRA) Jeff Wood (RES/DRA) 32
Antonios Zoulis NRCs streamlined review process for very low safety significance issue resolution using the Risk-Informed Process for Evaluations (RIPE)
Transformation in NRR Reduction Plant in Shutdowns Resources Risk-Informed Decision Making Risk-Informed Process for Evaluation 34
Leverage Existing Regulations & Processes Licensing Bases VLSSIR RIPE 35
Leverage Existing Regulations & Processes (cont.)
Identify risk Define management licensing actions as issue necessary Evaluate Assess using IDP cumulative and assess risk plant-specific risk 36
Why RIPE?
Focuses NRC and licensee resources on the most safety significant issues Addresses low safety significant issues in an efficient and predictable manner Leverages existing regulations and risk informed initiatives Incentivizes the further development and use of PRA models and risk-informed applications 37
Application of RIPE Lessons-Learned
- First-of-a-kind
- RIDM exemption * ~ 100 hours0.00116 days <br />0.0278 hours <br />1.653439e-4 weeks <br />3.805e-5 months <br /> of workshops request staff review
- Enhanced
- Identified guidance Successful challenges Continuous Implementation Improvement 38
Building on Progress Effective change management is critical to success of any new initiative Significant step forward in advancement to a modern, risk-informed regulator Expansion to allow technical specifications changes and develop a generic application Reliability and clarity on our regulatory process 39 39
Abby Olarte eBilling Innovation
eBilling: Transforming NRCs Fee Billing Process Heavily Manual Billing Partnership with Licensees Process Modern Electronic Billing During Development Application Previous process was Small group of licensees cumbersome and required Digitized and improved billing provided iterative feedback on significant manual experience for licensees features/user interface intervention 41
eBilling: Key Features Instant Delivery of Invoices Invoices are generated and delivered to licensees on the same day Automated Alerts & User-Friendly Dashboard Dashboard provides a snapshot of licensees invoices Automated and configurable e-mail alerts to notify licensees of invoice activity Streamlined Small Entity Application Process Small Entity Application can now be submitted online Automated alerts when the application is rejected or approved 42
eBilling: New Enhancements New Reporting Features Enhanced reporting features provide the ability to filter for data over time by Docket/CAC/EPID Part 170 Accruals Available Online Licensees can view and export Part 170 charges that are accrued for billing throughout a billing quarter 43
eBilling: Enrollment
% of Dockets Enrolled in eBilling 30%
25%
20%
15%
10%
5%
0%
April 2020 April 2021 April 2022 URL: https://ebilling.nrc-gateway.gov 44
Mission Excellence Modern, Risk-Informed Regulator Highly skilled, adaptable Diverse, Inclusive, &
& engaged workforce Innovative Environment 45