ML22286A183
| ML22286A183 | |
| Person / Time | |
|---|---|
| Issue date: | 06/01/2022 |
| From: | NRC/OCM |
| To: | |
| Shared Package | |
| ML22138A205 | List: |
| References | |
| M220601 | |
| Download: ML22286A183 (56) | |
Text
1 UNITED STATES NUCLEAR REGULATORY COMMISSION
+ + + + +
BRIEFING ON TRANSFORMATION AT THE NRC - SUSTAINING PROGRESS AS A MODERN, RISK-INFORMED REGULATOR
+ + + + +
WEDNESDAY, JUNE 1, 2022
+ + + + +
The Commission met in the Commissioners' Conference Room, First Floor, One White Flint North, Rockville, Maryland, at 10:00 a.m.,
Christopher T. Hanson, Chairman, presiding.
COMMISSION MEMBERS:
CHRISTOPHER T. HANSON, Chairman JEFF BARAN, Commissioner DAVID A. WRIGHT, Commissioner ALSO PRESENT:
BROOKE P. CLARK, Secretary of the Commission MARIAN ZOBLER, General Counsel NRC STAFF:
DANIEL DORMAN, Executive Director for Operations CAYLEE KENNY, Project Manager, Materials Rulemaking and Project Management Branch, Office of Nuclear Material Safety and
2 Safeguards TIM MOSSMAN, Acting EMBARK Venture Studio Managing Director, Office of Nuclear Reactor Regulation ABBY OLARTE, Senior IT Program Manager, Financial System Branch, Office of the Chief Financial Officer REBECCA RICHARDSON,
- Chief, Intelligence Liaison and Threat Assessment Branch, Division of Security Operations, Office of Nuclear Security and Incident Response AIDA RIVERA-VARONA, Acting Deputy Assistant for Operations, Office of the Executive Director for Operations JEFFERY WOOD, Reliability and Risk Analyst, Probabilistic Risk Assessment Branch, Office of Research ANTONIOS ZOULIS, Branch Chief, PRA Oversight Branch
3 P R O C E E D I N G S 1
10:01 a.m.
2 CHAIRMAN HANSON: Good morning, everyone. I 3
convene the Commission's public meeting on NRC transformation efforts.
4 The last meeting on this subject was just about a year ago in June of 2021.
5 I think we've got a great set of presentations lined up this morning, and I 6
really look forward to the discussion.
7 We'll hear from our panel, some of which are here in the 8
room with us in One White Flint in Rockville, Maryland; and the rest will join 9
us online, I understand. We're going to hold questions until the end, and 10 then we'll hear from the commissioners. But before I start, I'll ask if my 11 colleagues have any remarks they'd like to make. Okay.
12 So with that, we'll begin the staff presentations, and we'll 13 be kicked off by our Executive Director for Operations, Dan Dorman.
14 MR. DORMAN: Thank you, Chairman, and good morning, 15 Chairman Hanson, Commissioner Baran, Commissioner Wright. Staff are 16 pleased to have the opportunity this morning to highlight the progress and 17 accomplishments that we have achieved during our transformation journey.
18 As we've discussed in previous meetings, the NRC has 19 been building upon a 2019 Futures Assessment Report, which described 20 four hypothetical future scenarios in which the NRC might be operating in the 21 year 2030 and beyond. That report also flagged opportunities for improving 22 how we do business, regardless of what the future brings.
23 So building on that report, using information we gathered 24 from various efforts but especially the NRC's Futures Jam that we conducted 25 within the NRC in June of 2019, we identified four focus areas: our people, 26
4 use of technology, risk-informed decision making, and innovation. These 1
form the basis for our transformation journey, and within these four focus 2
areas we identified eight initiatives and prioritized them to provide the 3
necessary infrastructure to support our transformation journey.
4 Since then, most of these initiatives have been completed.
5 I'm happy to share with you that we are using the Be riskSMART framework 6
and are more deliberately accepting well-managed risk in our decision 7
making. In addition, we're using technology to work smarter, including 8
using data analytics to highlight areas for regulatory attention and 9
improvement. We are innovating our processes to make timely decisions 10 that take into account different viewpoints and fully explored options. The 11 one area that remains open is our desired agency culture initiative. The 12 Agency Culture Team continues to work towards ensuring that behavioral 13 norms and expectations that align with our leadership model and our vision 14 of being a modern risk-informed regulator are incorporated into sustainable 15 processes that will promote and sustain innovation well into the future.
16 Then we have worked and continue to work very 17 deliberately to have a skilled, adaptable, and engaged workforce ready for 18 the future that is before us today and out into the years ahead. In addition, 19 we recently issued the NRC's Strategic Plan for fiscal years 2022 through 20 2026. The strategic plan provides a blueprint for how the agency will plan, 21 implement, and monitor the work needed to ensure the safe and secure use 22 of radioactive materials. The strategic plan also includes a new focus on 23 the agency's efforts to continue to foster a healthy organization and inspire 24 stakeholder confidence.
25 Taken together, our transformation achievements and the 26
5 strategic plan goals will help ensure that the agency performs as a modern 1
risk-informed regulator, is prepared for an evolving future, and is able to 2
improve performance and achieve mission excellence in a diverse, inclusive, 3
and innovative environment. And our objectives and key results, or OKRs, 4
will keep us focused on ensuring that we sustain all of the progress we have 5
made over the last few years. Last year's OKRs were focused on keeping 6
our momentum for change going and transitioning our transformation efforts 7
from the Office of the EDO to the other offices. We not only empowered the 8
offices but empowered our staff to propose and implement innovative ideas.
9 Today, we'll be providing some updates on our transformation journey and 10 will discuss a few of the many achievements our offices have been making.
11 Now I'd like to introduce my fellow presenters. Next slide, please.
12 First, Aida Rivera-Verona, who is currently serving as the 13 Deputy Assistant for Operations in the Office of the Executive Director for 14 Operations. Aida will discuss how we plan on continuing to drive and 15 measure progress through the OKRs, as well as provide some information 16 on the responses to a survey on transformation that was available to our 17 external stakeholders from last September through March of this year.
18 She will be followed by Tim Mossman who is currently 19 serving as Managing Director for EMBARK Venture Studios in NRR. Tim 20 will discuss how we are using technology to inspire stakeholder confidence 21 in the NRC by engaging stakeholders in NRC activities in an effective and 22 transparent manner using high-quality data and information in our 23 decision-making process. Specifically, he will discuss the external facing 24 Mission Analytics Portal, or MAP-X.
25 Next, Caylee Kenny, who is a Rulemaking Project 26
6 Manager in the Office of NMSS and is currently on rotation in my office, will 1
provide an update on some of the successes we have had with our 2
rulemaking transformation efforts. These efforts are driving towards 3
enhancing the quality and timeliness of our rulemaking products and further 4
strengthening staff and stakeholder engagement.
5 Caylee will be followed by Becca Richardson, Branch 6
Chief in the Office of Nuclear Security and Incident Response. Becca will 7
discuss how we are effectively applying our Be riskSMART framework to the 8
NRC's security oversight program and ensuring that we continue to achieve 9
our important security mission.
10 The next speaker, Jeffery Wood, a Reliability and Risk 11 Analyst in the Office of Nuclear Regulatory Research, will be discussing how 12 we are using SPAR-DASH data dashboards to make risk results for 13 operating nuclear power plants accessible to the NRC staff to better support 14 risk-informed decision-making activities throughout the agency.
15 He will be followed by Antonios Zoulis, Branch Chief in the 16 Office of NRR. Antonios will provide an update on the risk-informed 17 process for evaluations, or RIPE, the NRC's streamlined licensing review 18 process for low safety significance issues. Like so many other things we 19 will discuss today, RIPE is a risk-informed process that helps inform our 20 decision making while still meeting our important safety goals.
21 And, finally, Abby Olarte, a Senior IT Program Manager in 22 the Office of the Chief Financial Officer, will discuss recent enhancements to 23 the eBilling platform to provide our licensees an efficient and transparent 24 process for understanding and paying their fees. This concludes my 25 introductory remarks, and I'll now turn the presentation over to Aida.
26
7 MS. RIVERA-VARONA: Thank you, Dan. Good 1
morning, Chairman and Commissioners. My name is Aida Rivera and for 2
the last two and a half years, I have been leading the futures core team in 3
the Office of the Executive Director for Operations, leading implementation of 4
the overall NRC transformation strategy. Today, I'm here to talk to you about 5
the methodology that we use for measuring our goals, as well as sharing 6
some results of our first external survey. Next slide, please.
7 The staff selected the objective and key results, or OKR, 8
methodology as a transformation performance management tool, as it has 9
been used by highly-performing organizations to set challenges, ambitions, 10 and aspirational goals with measurable results. OKRs are intended to be 11 time bound, both to motivate near-term actions and in recognition of the fact 12 that organization goals evolve in response of internal and external drivers.
13 The staff has adopted an annual cycle where the EDO establishes the 14 agency OKRs at the beginning of the calendar year, evaluates the progress 15 at the end of the year, and then reformulates the OKRs for the following year 16 based on new goals and priorities.
17 In 2020, the principal task was the development of 18 transformation-enabling tools and as such, the agency OKRs were largely 19 oriented to drive actions and measure progress towards this outcome. In 20 2021, the focus was on widespread application of these tools across the 21 agency and the OKRs for this year were reformulated to reflect this 22 aspiration.
23 In developing the 2022 OKRs, we used the results from 24 the 2021 to set aspirational goals for 2022 that will build and maintain and 25 sustain the progress achieved in 2021. The 2022 agency OKRs are 26
8 intended to internalize and increase behaviors that will help sustain 1
transformation progress. Our goal is that with routine practice, these 2
transformation behaviors will become a habit, enabling the agency and its 3
workforce to remain adaptable, agile, and able to meet operational 4
challenges in the future. Next slide.
5 OKR in 2020 were successful in driving and achieving the 6
development of tools and resources to support innovation and improve 7
decision making. We were able to complete significant actions to enable 8
transformation to occur in years to come. Through the innovative team, we 9
were able to issue the Be riskSMART decision-making framework; deploy 10 the IdeaScale innovation platform; deploy the Career Enhancement and 11 Employee Journey tools; and through the technology adoption initiative, had 12 the capability to successfully transition to full-time telework during the 13 pandemic through the implementation of Office 365 and other collaborative 14 work tools. Next slide.
15 Similarly, in 2021, agency-level OKRs were successful in 16 producing the intended effect of encouraging greater familiarity and 17 application of existing transformation tools across the agency. As a result, 18 the agency experienced the following successes: All offices increased the 19 application of the Be riskSMART framework to support key decision making 20 in the technical and corporate areas. We saw more than half of the 582 21 successes captured in IdeaScale resulted in process improvements. The 22 continuing implementation of agency-wide office-level culture improvement 23 activities resulted in a modest positive increase in the 2021 Agency Culture 24 Pulse Survey. And we have seen greater development and application of 25 data analytic tools to inform decision-making. Specifically, from a total of 16 26
9 key results in 2021, five key results were met and 10 were unmet. Although 1
the agency did not achieve the aspiring goal for 10 of those 10 key results, in 2
each of those we saw great progress in a broader use of the different tools 3
and its relation to achieving our mission goals. Next slide.
4 One unique aspect that we added to our OKRs in 2021 5
was to seek external stakeholder perspectives in our transformation efforts.
6 To accomplish and measure this, the staff published as survey to seek 7
external stakeholder perceptions on agency transformation efforts in the 8
areas of risk, innovation, and technology. The survey was a structured so 9
that the external stakeholders can provide feedback regarding how these 10 areas have directly contributed to the agency mission performance, 11 information sharing, quality of decision making, and timeliness of decision 12 making. This survey was open from September 13, 2021, to March 31, 13 2022. NRC staff received a total of 81 survey responses from external 14 stakeholders who responded to the survey from a broad variety of 15 stakeholder groups and supported different business lines, as noted in this 16 graph. Next slide.
17 From the review of these responses, we noted that most of 18 the respondents were knowledgeable about the agency transformation 19 efforts. Overall, respondents acknowledged that a lot of progress has been 20 made, but more work can still be done. One of the areas where 21 respondents felt great progress had been made is in the area of technology, 22 with most impact in information sharing. Respondents felt great access to 23 information through our public web pages and through the utilization of 24 millions of archived documents. Respondents also acknowledged 25 improvements in our mission performance in the areas of licensing and 26
10 rulemaking process. You will hear more about these efforts later today.
1 On the other side, some other survey respondents are 2
seeking more awareness and understanding on how data analytics and risk 3
information are being used in our decision-making. The staff continues to 4
expand the use of data and risk insights, and we know that we will have 5
opportunities in the future to interact with our external stakeholders on how 6
we are doing this.
7 Today, you will hear several examples where the staff 8
continues to apply risk insights in different programs and how we are 9
developing tools to better access data that ultimately help our decision 10 making. Next slide.
11 Using the survey responses, we were able to measure the 12 three external perception OKRs related to risk, innovation, and technology.
13 While we did not meet the 75 aspirational target, the survey results provided 14 NRC staff with useful information and will serve as a baseline for measuring 15 progress going forward. Thank you. And now I will turn it over to Tim 16 Mossman.
17 MR. MOSSMAN: Thank you, Aida. Good morning, 18 Chairman and Commissioners. I am Tim Mossman, the Managing Director 19 of EMBARK Venture Studio in the Office of Nuclear Reactor Regulation.
20 EMBARK is a change catalyst within the agency, and the 21 EMBARK team continues to work with NRC staff from many different offices 22 to remove real and perceived barriers to innovation. We are focused on 23 modernizing information technology tools and systems, improving business 24 processes, enhancing access to data, and improving stakeholder 25 experience. Today, I'm grateful to have the opportunity to discuss our 26
11 Mission Analytics Portal External initiative, also known as MAP-X. I want to 1
note that the Office of the Chief Information Officer has been a very valuable 2
partner in making this initiative a reality. Next slide, please.
3 For the past several years, the NRC has focused on its 4
vision of being a modern risk-informed regulator. Endeavors such as 5
MAP-X represent our efforts to achieve the modern part of that vision.
6 MAP-X is the NRC's initiative to exchange data with our external 7
stakeholders via web-based platforms. MAP-X is an externally-facing portal 8
or website that licensees can use to submit relief requests; event notification 9
worksheets; and later this year, licensee event reports.
10 The NRC is quite adept at collecting and storing 11 documents from external stakeholders, which is essential for us to perform 12 our mission and maintain healthy openness regarding our operations.
13 However, documents are submitted in varying formats, such that harvesting 14 data from them can be labor intensive. MAP-X focuses on having external 15 stakeholders submit data, rather than documents, via the web portal.
16 External stakeholders may submit numerical values, text, and/or selections 17 from pre-populated menus, much like all of us do when ordering goods or 18 services online. Obtaining data directly this way enables us to regularly 19 feed our various internal systems and support data analytics, data 20 visualization, and data-driven decision making.
21 MAP-X also presents the opportunity to share data with 22 external stakeholders. In the future, we may extract data from our own 23 systems and selectively display information, such as status of license 24 amendment reviews, to appropriate external stakeholders. We believe 25 MAP-X can ultimately become a one-stop shop for external stakeholders to 26
12 exchange data with the NRC. We see this as an advantage both to NRC 1
staff and to external stakeholders. Next slide.
2 The advantages of MAP-X for the NRC are fairly 3
straightforward. Receiving data in digestible form makes it much easier for 4
us to sort and integrate information in our existing internal systems. It also 5
creates opportunities to enhance data-driven decision making. For external 6
stakeholders, the MAP-X system can be accessed from anywhere. Once a 7
user is credentialed, they may use any computer to log in and interact with 8
the system. MAP-X modules can incorporate auto-populated fields and 9
data validation logic to minimize potential errors in submissions. Next slide.
10 MAP-X is still in the early stages of development. To 11 date, we have focused on developing low-complexity modules to collect data 12 from external stakeholders. Our initial module was for web-based relief 13 requests, which has been available for approximately a year. In late 14 January, we released a module for reactor licensees to submit event 15 notifications. Next slide.
16 EMBARK has collaborated with NRR's Division of Operator 17 Reactor Licensing to reach out to reactor licensees who have used these 18 modules to solicit feedback. Early results on these modules has been 19 mixed. We have had multiple users of the web-based relief request module 20 but no one has yet used the system to submit an event notification.
21 Regarding the web-based relief request module, we have some early 22 adopters who have had very positive things to say about the system. We 23 have also received very valid feedback regarding features of the system that 24 stakeholders find challenging and/or have dissuaded their use of the system.
25 We are working through a few challenges with the event notification 26
13 module. Event notifications are required to be submitted on a relatively 1
short time line, eight hours per the regulations, and they are often handled 2
by reactor staff who are not the staff on site who currently have credentials 3
to log into and use MAP-X.
4 In addition, our regulations in 10 CFR 50.72 require 5
licensees to call the operations center with their event notifications. So the 6
electronic submission of information via MAP-X will be more of an efficiency 7
for NRC staff than licensee staff. We are actively working with OCIO and 8
the MAP-X contractors to address the feedback we have received and 9
augment our existing modules, as appropriate. We aspire to show our 10 stakeholder community that we have taken their feedback seriously and 11 demonstrate that it has resulted in beneficial changes to the system. Next 12 slide.
13 As noted on an earlier slide, we are actively developing a 14 MAP-X module to allow submission of licensee event reports, or LERs.
15 LERs, like event notifications are required by regulation, but they are not 16 required to be submitted on a tight time line. Licensees have 60 days, as 17 opposed to eight hours. We are also currently reflecting on the feedback 18 received on the existing modules and have been in discussion with multiple 19 NRC offices regarding potential new modules to support different 20 stakeholder communities. To date, our early modules have been focused 21 on use by the reactor licensee community under the premise that they have 22 more infrastructure to be able to adopt use of a new system, such as 23 MAP-X. However, we recognize that there are a much greater number of 24 materials licensees, which represent a potential for larger returns on our 25 investment in collecting and processing data.
26
14 We also recognize that marketing of new modules to 1
potential users is critical to the success of this initiative. While we can 2
readily demonstrate that NRC operations can be made much more efficient 3
with the receipt of data via MAP-X, we need to ensure that our modules offer 4
improvements in efficiency, effectiveness and/or overall user experience for 5
our external stakeholders. This transformation will not happen overnight 6
and will involve continued coordination among various NRC offices and our 7
affected stakeholder communities. We value the lessons gained from our 8
initial efforts, and we will be using that knowledge as we embark on 9
developing future modules. Thank you. I will now turn it over to Caylee 10 Kenny.
11 MS. KENNY: Thank you, Tim. Good morning, Chairman 12 and Commissioners. I am Caylee Kenny, a project manager from the 13 Rulemaking Center of Expertise, or Rulemaking COE, in the Office of 14 Nuclear Material Safety and Safeguards. Today, I will be providing an 15 update on the improvements and successes within the rulemaking program 16 since the inception of our rulemaking process transformation effort. Next 17 slide, please.
18 As a brief recap, in 2019, the COE self-initiated an effort to 19 strengthen the agency's rulemaking process, focused on identifying 20 opportunities to enhance the quality and timeliness of our rulemaking 21 products, and further strengthen stakeholder engagement. We identified 15 22 opportunities for enhancements and organized them into five key 23 enhancement areas, as summarized in this graphic.
24 We issued a publicly-available report about our plan in July 25 2020 and have been implementing and refining the associated action. This 26
15 is a living and continuous effort. At this time, we have completed 13 of the 1
original 15 initiatives and continue to integrate them into our daily work.
2 Next slide, please.
3 We have achieved many successes as part of 4
implementing these changes over the past two to three years. In terms of 5
engagement, I'd like to highlight three improvement areas. First, the COE 6
continues to focus on enhancing Agreement State interactions. We have 7
increased opportunities for Organization of Agreement States, or OAS, 8
members to provide input on issues raised in the petition for rulemaking in 9
advance of a final action, which will inform staff recommendations to the 10 Commission. The COE has received positive feedback from both the OAS, 11 as well as from the NRC's Agreement State program staff about the 12 progress in this area, and we will continue to look for ways to enhance 13 engagement opportunities.
14 Secondly, COE and OGC staff have developed a training 15 course to share efficient and effective approaches for addressing public 16 comments received during the rulemaking process. This course focuses on 17 improving the quality, accuracy, and consistency of NRC responses to 18 comments and the associated documentation for the underlying regulatory 19 decision and providing better documentation and communication of the 20 bases for NRC's rulemaking actions. Overall, this is leading to increased 21 public confidence in NRC's decision making and has greatly enhanced our 22 ability to interact with the public in the rulemaking process.
23 Third, staff continues to create summaries of recent 24 rulemaking actions, their impacts, and the innovations applied during the 25 development process, as appropriate. These are posted to the public 26
16 website, which provides greater public awareness and transparency.
1 In terms of timeliness, I'd also like to highlight three 2
improvement areas. First, a significant portion of document development is 3
spent in the concurrence process, and this has been identified as an 4
important opportunity for improvement. Staff implemented division-level 5
process changes, such as early alignment briefings and parallel 6
concurrence, among many others, that go hand in hand with the recently 7
implemented eConcurrence system, which allows for electronic concurrence, 8
collaboration, integration with ADAMS, and the electronic signing of 9
documents. The COE has been a first adopter of the system and we have 10 already started training other NMSS staff on how to use key features, such 11 as the collaboration tab, and how it supports the parallel concurrence path 12 that we established. This is allowing us to continue to improve our 13 concurrence process and we will look for additional efficiencies as we gain 14 experience with the eConcurrence system.
15 Secondly, the COE has streamlined processes at the 16 pre-rulemaking stage. Specifically, instead of routinely beginning 17 rulemaking with a regulatory basis, the staff now evaluates whether one is 18 needed case-by-case and provides the recommendation regarding the need 19 for a regulatory basis to the Commission. The COE also reevaluated the 20 need to issue a final regulatory basis when one is initiated. Typically, staff 21 now provides the Commission a summary of the results of early stakeholder 22 engagement in the proposed rule. This change is expected to save 23 approximately six to nine months from the overall rulemaking schedule.
24 Third, staff completed a pilot using agile project 25 management concepts in the petition for rulemaking process. The pilot 26
17 proved successful by minimizing the risk of significant redirection late in the 1
development of the project and by improving timeliness, allowing the Petition 2
Review Board to be held 1.5 months sooner than the Milestone B. The 3
COE is continuing to explore the use of agile methods in rulemaking and is 4
adopting the use of an executive level project sponsor, a key agile concept, 5
for the development of an upcoming proposed rule. Next slide, please.
6 We are sustaining progress through incremental 7
improvements, incorporation of the original efforts into our daily work, and 8
we will take a more targeted approach to future transformation efforts. In 9
order to curb innovation fatigue, we are focusing on activities that will have 10 the most impact to staff and our stakeholders. Specifically, the COE is 11 looking back at our original initiatives to see if we produced the gains we 12 thought we would. For example, staff will perform an assessment of the 13 improvements made to our concurrence process to determine if time frames 14 have been shortened and the number of people on concurrence has been 15 streamlined. We will consider how we can enhance the positives of the 16 eConcurrence system and use it to continue to simplify the concurrence 17 process and realize further benefits. Next slide, please.
18
- Overall, these innovations have provided positive 19 outcomes and results. We received encouraging feedback in several areas, 20 including on the use of (audio interference) professional perspectives, has 21 enhanced collaboration and added efficiencies to each phase of the 22 concurrence process. The use of agile project management concepts, 23 especially the use of a project sponsor, has shown to be beneficial to 24 communication, alignment, and quick decision making. And we have 25 received positive feedback on the opportunity for Agreement States to 26
18 participate in working groups and review products earlier in the development 1
process.
2 Rulemaking is, by design, a deliberative process bound by 3
statute and other legal constraints. The COE uses risk-informed processes 4
and adopts IT and other modern innovations whenever possible within the 5
strictures of the federal rulemaking environment. These recent incremental 6
improvements directly align with the agency's strategic plan objective and 7
associated strategies regarding stakeholder confidence and will provide 8
stakeholders with requirements that are well designed on the most optimal 9
schedule possible.
10 Our rulemaking innovation efforts are expected to mature, 11 grow, and adapt over time. NRC's Rulemaking COE is committed to 12 continuously strengthening the agency's rulemaking process and serving as 13 a model of federal rulemaking excellence. I will now turn it over to Becca 14 Richardson. Thank you.
15 MS. RICHARDSON: Thank you, Caylee. And good 16 morning, Chairman Hanson, Commissioner Baran, and Commissioner 17 Wright. For those that don't know me, I'm Becca Richardson, Chief of the 18 Intelligence Liaison and Threat Assessment Branch in the Office of Nuclear 19 Security and Incident Response. Having worked on the Be riskSMART 20 initiative since 2019, it is an honor to be here today to share how my office 21 has been utilizing the Be riskSMART framework in our decision making.
22 Next slide, please.
23 As you know, the NRC has a long history and firm 24 foundation in risk-informed decision making that includes many successful 25 applications of the risk triplet. While we have continuously improved how 26
19 we use risk insights to make better informed decisions to meet our important 1
safety and security mission, risk-informed decision making was not 2
consistently applied across the agency or used for all types of decisions.
3 This slide summarizes the key steps of the Be riskSMART 4
framework. I'm not going to walk through each step here today, but I'm 5
happy to answer any questions you may have. I did want to highlight the 6
importance of the first step, though; that is to be clear about the problem.
7 The problem could range from a simple binary question that one faces on a 8
daily basis to a more complex decision involving multiple individuals or 9
organizations, such as how to enhance a process to more fully realize the 10 NRC's principles of good regulation. I also wanted to note that the 11 framework does not revise or change existing requirements or criteria, such 12 as those supporting oversight or licensing decisions. Rather, it serves as 13 an umbrella to increase consistency, awareness, and usability of existing 14 risk-informed approaches. Next slide, please.
15 The Be riskSMART framework recognizes the multifaceted 16 nature of risk and helps staff consider those systematically and in a 17 transparent manner, whether those risks are technical, programmatic, 18 reputational, information technology, human capital, or others. By doing so, 19 it supports consistent approaches in applying risk insights for all NRC 20 decisions and gives NRC staff confidence in accepting well-managed risk in 21 its decision-making without compromising the NRC's mission.
22 The structured framework of Be riskSMART gives us 23 confidence that we are adequately considering what we need to, even when 24 there's uncertainty about what could happen or how likely it is. What we 25 have found is that it has really improved conversations for us when working 26
20 through challenges we face. It serves as a good platform for discussion 1
between staff on challenges, how to best address those challenges, and 2
why. And this improves conversation on both sides. It has encouraged 3
better conversations by tackling problems together in a systematic approach.
4 By using this Be riskSMART framework in NSIR, we have 5
been able to evaluate problems in a way that when discussing them with 6
others, we are able to explain our perspective on a given issue clearly and 7
concisely. This way, any differences, particularly as a result of the inherent 8
uncertainty in some of the information we use, can be quickly identified and 9
resolved. On the next few slides, I will briefly walk through three examples 10 that demonstrate how NSIR has applied this framework in both security 11 oversight and policy. Next slide, please.
12 As we know, conducting effective oversight supports 13 NRC's critical safety and security mission. The COVID-19 public health 14 emergency presented some unique challenges to completing some of our 15 inspections that support this oversight. The Be riskSMART framework was 16 a perfect tool to address this challenge in NSIR for completing the tri-annual 17 NRC-evaluated force-on-force inspections. For those that don't know what 18 our force-on-force inspections are, these are performance-based inspections 19 to test the licensee strategy for defending against the design basis threats, 20 and they involve a significant amount of people in close proximity in order to 21 properly control, observe, and perform the inspection.
22 Through use of the framework, the staff was able to 23 develop a plan to conduct the inspections while balancing the health and 24 safety of both our inspectors and site personnel. As part of this effort, the 25 staff also developed a matrix that weighed the principles of good regulation 26
21 for each of the options identified in the framework. We have been able to 1
reuse this framework as a model to help us risk inform our decisions in the 2
areas of efficiency, openness, clarity, reliability, and independence. In this 3
case, using the Be riskSMART framework not only help staff identify options 4
to continue to provide effective oversight during the public health emergency, 5
but they also identified additional options that can be considered to better 6
inform the future of the security program. Next slide, please.
7 In 2019, the NRC Office of the Inspector General 8
challenged the staff to consider how cybersecurity inspections could be 9
more efficient and more performance based. The Be riskSMART 10 framework supported the staff's evaluation to address this challenge by 11 weighing the risk and benefits for multiple options for the acceptance of 12 performance metrics from licensees in advance of inspections to inform 13 evaluation of cybersecurity program effectiveness and for improving the 14 inspection process efficiency. By using the Be riskSMART framework, the 15 staff were able to determine a way for licensees to voluntarily submit 16 cybersecurity performance metrics in advance of an inspection. This 17 alleviates some on-site inspection needs and results in a more efficient 18 inspection overall. The staff also developed an option in the inspection 19 procedure to allow for performance-based testing of the licensee's 20 cybersecurity architecture and controls. Next slide, please.
21 Lastly, in 2020, staff provided the Commission with 22 SECY-20-0070, Technical Evaluation of the Security Bounding Time 23 Concept for Operating Nuclear Power Plants. In this Commission paper, we 24 explored ways to provide credit for operator actions, including the use of flex 25 equipment and law enforcement response at operating nuclear power plants.
26
22 The staff were able to apply the Be riskSMART framework throughout the 1
Commission paper to guide the staff's assessment of the challenges and 2
developing viable approaches to provide this credit. For example, each of 3
the staff's recommendations for providing additional credit for elements, such 4
as law enforcement response and flex equipment, consider factors that may 5
impact the likelihood and consequences of an attack. As a result, the 6
reasonable assurance of protection time, or RAPT, was established. RAPT 7
is an eight-hour time frame that recognizes existing layers of protection, both 8
safety and security, that work together to support the site's protective 9
strategy. Industry stakeholders have expressed that the RAPT concept 10 adds a greater level of regulatory clarity because it provides a consistent 11 framework for targets in development. It also enables licensees to refine 12 protective strategies to focus on the most risk significant target sets, while 13 continuing to maintain physical protection of the site. And it risk informs 14 force-on-force exercises by focusing on target sets that are within the 15 eight-hour RAPT. This ensures licensees are continuing to protect all 16 front-line systems and supporting systems with a prompt functional failure 17 that could result in core damage before the eight-hour RAPT.
18 Thank you for the opportunity to present today. And with 19 that, I'll turn it over to Jeffery.
20 MR. WOOD: Thank you, Becca. Good morning, 21 Chairman and Commissioners. I am Jeff Wood, and I am a Reliability and 22 Risk Analyst in NRC's Office of Research. I'm going to be discussing the 23 SPAR-DASH project. Next slide, please.
24 The SPAR-DASH project was developed to make risk 25 assessment results accessible to the NRC staff to help support our 26
23 risk-informed decision-making activities for our operating reactor programs.
1 We believe this tool will have many useful applications for our inspectors and 2
license reviewers for operating reactors. What we want to achieve with this 3
project is to make risk information accessible to the staff in an easy-to-use 4
and interactive dashboard format, support communication of risk insights, 5
and support our Be riskSMART framework. As we're continuing on our path 6
to becoming a modern, risk-informed regulator, we recognize that having 7
access to the right risk information is important, and we need to deliver those 8
risk results to the staff in an innovative way. Next slide, please.
9 The approach we've taken with SPAR-DASH is to develop 10 a series of data dashboards that summarize risk results from the agency's 11 probabilistic risk assessment, or PRA models. SPAR-DASH leverages 12 NRC's existing PRA tools, the SPAR models and Sapphire software; and 13 having these independent risk assessment tools are very important for 14 supporting our risk-informed regulatory programs, and it allows us to be 15 creative in new ways to analyze the results like we're doing with the 16 SPAR-DASH project.
17 The SPAR models are available for the staff to support 18 using risk in their work, and there are many staff that use these models in a 19 routine basis. However, we want to make risk information broadly available 20 to support our reactor oversight and licensing activities, and we recognize 21 that there are some barriers to getting more staff using these complex risk 22 tools. Using these models requires set up and installation of software. It 23 requires specialized knowledge and training to generate and interpret 24 results. With SPAR-DASH, we bypass these barriers to provide easy 25 access to useful risk results.
26
24 The approach we've taken with SPAR-DASH is to first 1
extract the key risk results from the models, then we developed data 2
processing tools to summarize the results in a visual and interactive format.
3 We've automated much of the process. We are handling results from 68 4
site-and plant-specific SPAR models and collecting results in different file 5
formats. We have a few thousand individual file inputs to our process, and 6
our data processing tools allow us to officially collect the key information, 7
format the data, and update the dashboard visuals. This is really an 8
innovation in how we are using the results of our risk models.
9 And this project began as a summer student project in the 10 summer of 2020. And with a small team, we were able to develop the 11 process and the tools, and SPAR-DASH was published for internal use in 12 January 2022. The end result is a visual and interactive data dashboard. It 13 allows the staff to quickly see risk results and help to focus their work on the 14 most risk-significant issues. Next slide, please.
15 So here we see an example of events contributing to a 16 plant's core damage frequency, and this gives our license reviewers, 17 inspectors, and other risk users a quick snapshot of a plant's risk profile and 18 can help to focus users on the types of events that are most risk significant 19 for a specific plant. Types of risk results that we include in SPAR-DASH 20 allow the staff to rank important contributors to a plant's risk, to assess risk 21 associated with different events and types of hazards, to consider off-normal 22 conditions, and to perform plant-to-plant comparisons of risk results.
23 SPAR-DASH also includes embedded links to guidance 24 documents. Users can click on a button right in the tool to access reference 25 material. We are using Nuclepedia, the NRCs knowledge management 26
25 tool. And here we have references to define the PRA-related terms and 1
types of results that are used in the dashboard and guidance on how to 2
interpret results. This provides a very efficient tool for the staff to develop 3
an understanding of risk. SPAR-DASH can be used as one input into our 4
decision making, along with other analyses, technical bases, and accounting 5
for uncertainties. And SPAR-DASH itself is a tool, its not a process, but it 6
can be used to support many of our risk informed processes, such as Be 7
riskSMART or our integrated risk informed decision making for license 8
reviews, and many other NRC risk informed programs.
9 While SPAR-DASH still requires careful interpretation 10 when implying risk results in our work, the accessibility and easy to use 11 visual format provides a great starting point for gaining risk insights and 12 focusing on areas for further investigation and questioning. Next slide 13 please.
14 The SPAR-DASH tool can support improved efficiency in 15 incorporating risk into our operating reactor licensing and oversight work 16 activities. And here we see an example of a comparison of core damage 17 frequency results for different hazard categories, such as fires and seismic 18 events, and users can sort and filter the display to focus on the types of 19 results that relate to their review area or the question they're trying to 20 answer.
21 You see several possible applications for the staff to use 22 SPAR-DASH, and some examples include planning and prioritizing activities 23 to support license amendment reviews, assessing emergent issues and 24 generic safety issues, risk-informed selection of systems and components 25 for inspection, and it provides an independent tool for comparing to 26
26 licensee-provided risk results.
1 And since the initial launch of SPAR-DASH at the end of 2
January of this year, we've already seen some applications of this tool. We 3
have staff that have used this to help inform their licensing reviews, to gather 4
information for dispositioning of proposed generic safety issues, and to help 5
with risk-informed assessment of an emergent issue.
6 SPAR-DASH is currently available internally for the staff to 7
use. And although it's developed for internal use, we think that external 8
stakeholders can also benefit from the staff's efficient use of risk in many of 9
our reactor licensing and oversight activities. We feel that SPAR-DASH is 10 going to be a valuable tool in the agency's continued risk-informed 11 development. Thank you. And I will now turn it over to Antonios Zoulis.
12 MR. ZOULIS: Thanks, Jeff. Good morning, Chairman 13 and Commissioners. I'm Antonios Zoulis, the Branch Chief of the PRA 14 Oversight Branch in the Division of Risk Assessment in the Office of Nuclear 15 Reactor Regulation.
16 Today, I will be discussing with you a new and innovative 17 approach in dispositioning very low safety significant licensing issues using 18 our existing regulatory structure and regulations. This new process helps 19 both licensees and the NRC to focus its time, attention, and resources on 20 issues of greater safety significance. Next slide, please.
21 In an ever-changing environment with plant shutdowns and 22 reduced resources, it was imperative that NRR develop ways to address 23 low-safety significant issues effectively and efficiently in this dynamic 24 environment. As such, staff were tasked to identify transformative 25 approaches in meeting our mission using resources commiserate with the 26
27 safety-significant issue, while leveraging ways to enhance the use of risk 1
insights and risk-informed decision making in our licensing reviews and 2
activities. Thus, the idea of the risk-informed process for evaluations, or 3
RIPE. Next slide, please.
4 Initially, NRC staff were focused on addressing issues that 5
were very low safety significant but not clearly within the licensing basis.
6 Those issues were addressed by the Very Low Safety Significance Issue 7
Resolution process, or VLSSIR. It quickly became apparent that there was 8
also a subset of issues that could be of low safety significance and that were 9
clearly within the licensing basis. In 2021, as an extension of VLSSIR, the 10 NRC developed an innovative and novel process, the risk-informed process 11 for evaluations, to resolve very low safety significant issues commiserate 12 with the risk significance using existing regulations under 10 CFR 50.12 and 13 50.90.
14 The idea for RIPE was born from my work done in support 15 of the risk prioritization initiative and my observation of licensee use of an 16 integrated decision-making panel, or IDP. An IDP leverages a 17 multi-disciplinary team to assess an issue using criteria that is consistent 18 with NRC's key principles of risk-informed decision making under Regulatory 19 Guide 1.174. The RIPE process allowed staff and licensees to develop a 20 method that is objective, scrutable, and repeatable to identify issues that are 21 very low safety significance. It leverages both risk insights and other key 22 engineering principles to evaluate the issue against a defined set of criteria.
23 I'd like to note that when we presented RIPE to the HRS, 24 the committee members were very supportive and complimentary of the 25 process and its novel approach in determining the safety significance of 26
28 issues. In developing a streamlined review process, we leveraged 1
previously-approved risk-informed initiatives, such as TFTF 505 and 425, to 2
determine the quality of the PRA information that would support a 3
risk-informed review. That coupled with the licensee's IDP evaluation of the 4
other key engineering principles together support our integrated 5
decision-making process, which helps characterize the issue and thus inform 6
the level of review for a RIPE submittal. Next slide, please.
7 The licensee is using PRA information from their 8
previously-approved risk-informed initiatives coupled with an approved IDP 9
process: define the issue, evaluate the issue using safety impact 10 characterization guidance developed by staff, identify any risk management 11 actions as applicable, and then assess potential impacts of the change.
12 Once that is completed and the issue is identified to have minimal safety 13 impact, the licensees will then submit the application under the RIPE 14 process to the NRC for a streamlined review.
15 RIPE is a significant change in how the staff conducts their 16 licensing reviews. Only the acceptance review of a RIPE application is 17 conducted by a cross-divisional staff team. If the application is accepted 18 under RIPE, then staff from my branch will conduct the streamlined review of 19 the application, which is commensurate with the fact that the review is of a 20 low safety significant issue. Next slide, please.
21 Why RIPE? RIPE focuses the NRC and licensee 22 resources on the most safety significant issues. It addresses very low 23 safety significant issues in an efficient and particular manner consistent with 24 NRC's principles of good regulation. It leverages existing regulations and 25 risk-informed initiatives, and it also incentivizes the further development and 26
29 use of probabilistic risk assessment models and risk-informed applications.
1 Next slide, please.
2 Earlier this year, staff received the first-of-a-kind exemption 3
request using RIPE. While there were challenges associated with this 4
review, the staff accepted and reviewed the application using the RIPE 5
process within eight weeks and under 100 hours0.00116 days <br />0.0278 hours <br />1.653439e-4 weeks <br />3.805e-5 months <br /> of review time. Staff are in 6
the process of leveraging lessons learned from the first RIPE submittal, 7
which will take the form of future planned workshops on risk-informed 8
decision making that will demonstrate real-world examples that use risk 9
insights to inform a review. The workshops will center on what level of 10 review is needed for low safety significant issues with a focus on 11 defense-in-depth, safety margins, et cetera.
12 Staff are also evaluating guidance updates to provide for 13 additional clarity to staff that leverages the lessons learned from the first 14 RIPE review. These initiatives will facilitate positive change management to 15 support the staff's future views of application using RIPE. Next slide, 16 please.
17 Change is hard and regardless of what process is being 18 implemented for the first time, effective change management is important.
19 Incorporating risk information in our everyday activities is not always easy.
20 However, the more opportunities that we provide to staff in understanding 21 RIPE and the benefits of the process, as well as having additional 22 opportunities and experience in using RIPE, we believe that the staff's 23 confidence in implementing RIPE will increase.
24 Without the review structure provided by RIPE, the review 25 of this low safety significant issue would most likely have taken more time 26
30 and resulted in considerable more hours of fee-billable review time. With 1
RIPE, we overcame the challenges and took one big step toward our journey 2
of becoming a modern risk-informed regulator. RIPE constitutes a 3
significant step forward in NRC's endeavor to advance risk-informed 4
decision-making in our regulatory processes.
5 And plans are underway to expand the use of RIPE.
6 Currently, staff have completed work to allow technical specifications to be 7
within the scope of RIPE reviews. Updated guidance for expanding the use 8
of RIPE for technical specifications was issued last month. Furthermore, 9
staff are participating in workshops and public meetings with industry to 10 support their development of a RIPE-like process that could be used to 11 determine the safety significance of generic issues.
12 RIPE ensures that staff focus their time, attention, and 13 resource on the most safety significant issues, thus ensuring the safe 14 operation of the commercial operating fleet, while also protecting the health 15 and safety of the public and of the environment. With the successful 16 implementation of the first RIPE review, NRC staff continue to demonstrate 17 regulatory certainty and confidence in our regulatory process and pave the 18 way for potentially more low safety significant issues to be reviewed in an 19 efficient and effective manner consistent with our principles of good 20 regulations. I will now turn it over to Abby Olarte. Thank you.
21 MS. OLARTE: Great. Thank you, Antonios. Good 22 morning, Chairman and Commissioners. My name is Abby Olarte from the 23 Office of the Chief Financial Officer and I serve as the project manager for 24 the NRC's electronic billing application, otherwise known as eBilling. Next 25 slide, please.
26
31 eBilling is a public facing online platform through which 1
licensees can receive and view their NRC invoices. It originally launched in 2
FY20 and was a key initiative in the effort to streamline and digitize NRC's 3
license fee billing process, which is consistent with the agency meeting its 4
vision as a modern risk-informed regulator.
5 NRC sends roughly 3800 invoices to our licensees 6
annually. Prior to the implementation of eBilling, the generation of these 7
invoices was an intricate and heavily manual process, requiring NRC staff to 8
print large volumes of paper invoices, stuff them into envelopes, and mail 9
them to thousands of licensees.
10 In order to modernize this process and improve the billing 11 experience for our licensees, the NRC developed the eBilling application in 12 the course of one year. Recognizing the importance of taking a 13 customer-centric approach to build the application, we engaged with a group 14 of licensees throughout the development process, obtaining iterative 15 feedback as the application was built. This approach significantly 16 contributed to the success of the eBilling application, as the insights gained 17 from this collaboration shaped the functionality and user interface of the 18 system. I'd like to now highlight some of the benefits that eBilling provides 19 to our licensees. Next slide, please.
20 Prior to the implementation of eBilling, licensees needed to 21 wait several days to receive their paper invoice in the mail. By receiving 22 their invoices electronically, licensees now have additional time to review 23 their invoices and submit payment before the due date. Another benefit that 24 eBilling offers is its ability to send out automated email alerts to licensees.
25 Licensees are notified immediately when activity has occurred on any of their 26
32 invoices, including when a new invoice is issued or when a payment has 1
been processed. These alerts are completely configurable by the user, 2
allowing them to choose the types of activity that they want to receive 3
notifications for.
4 The eBilling application also provides licensees with a 5
user-friendly dashboard that gives them as snapshot of their invoice statuses 6
and the total amount owed. Keeping licensees aware of these types of 7
activities in a timely manner not only allows them to know the status of their 8
invoices at any given time, but it also reduces the risk of erroneous 9
payments being made to the NRC.
10 Another key feature that benefits our licensees is the 11 digitalization of the small entity application form. Licensees have the ability 12 to submit an application to qualify as a small entity, allowing them to pay 13 reduced fee amounts to the NRC. Prior to eBilling, the small entity 14 application form was mailed to the licensees to be filled out manually and 15 returned to the NRC. With eBilling, the small entity application is now 16 available in an online form.
17 Details pertinent to the invoice, such as the docket number 18 and invoice number, are automatically defaulted for the user, reducing the 19 amount of data entry required from the licensee. Additionally, making the 20 small entity application available online decreases the number of instances 21 where NRC staff are unable to read the handwritten information provided on 22 the paper small entity application. NRC is also able to indicate whether a 23 small entity application is approved or rejected in eBilling, which 24 automatically sends a notification to the licensee of the decision.
25 Incorporating the small entity application into eBilling has gone a long way 26
33 into streamlining the application and decision process. Next slide, please.
1 Now, as the eBilling application continues to evolve and 2
mature, there are two new features I'd like to bring your attention to, as they 3
also provide some additional benefits to our licensees. When eBilling was 4
initially developed, the one feature that licensees requested the most was 5
that they wanted to be able to see their invoice details in Excel format so that 6
they can perform their own analysis. It was understandably difficult to work 7
with a paper invoice. The feature was incorporated in the initial rollout of 8
the application. However, eBilling was recently enhanced to introduce more 9
robust reporting capabilities in which licensees can filter invoice data across 10 a user-specified period of time for specific dockets, cost activity codes, 11 enterprise project IDs, and fee categories for which they were billed. The 12 detailed results can be exported to Excel where the user is provided with the 13 raw detail, as well as a pre-bill pivot table.
14 Providing licensees with their invoice details in an 15 easily-consumable manner, address the key pain point that they previously 16 expressed, and these new reporting features were implemented to make it 17 even easier for them to extract their invoice data. This increases the 18 transparency that we have with our licensees and places more accountability 19 on the oversight work performed by the NRC program offices.
20 Lastly, we recently integrated Part 170 charge accruals 21 into eBilling. In order to provide licensees with an idea of what their Part 22 170 charges are as a billing quarter progresses, NRC previously sent 23 spreadsheets of accrued charges to those licensee organizations that 24 requested the data. These spreadsheets would be sent via email to each 25 individual licensee organization by NRC staff. eBilling was recently 26
34 enhanced to incorporate the Part 170 accruals into the application, allowing 1
licensees to view and download their Part 170 accruals directly from eBilling.
2 By making the Part 170 accruals available to the licensees online, the 3
amount of time and effort on NRC's part to put together spreadsheets and 4
email the licensees is significantly reduced and licensees are able to 5
receive the data the instant that it becomes available.
6 eBilling has facilitated the digital transformation in our 7
licensee fee billing process. Not only does eBilling significantly improve the 8
billing experience for NRC's licensees, but it also strengthens stakeholder 9
confidence in the agency's regulatory processes, as it provides easier 10 access to the details behind the oversight work that the NRC performs. We 11 continue to look for other innovative opportunities to make the invoicing 12 process easier for our licensees. Next slide, please.
13 User adoption of eBilling has steadily increased over time, 14 but we do hope to see additional growth and enrollment. Higher user 15 adoption will allow all of us to realize the full benefits of transforming and 16 modernizing the invoicing process. If a licensee is not yet enrolled in 17 eBilling, we highly encourage them to consider enrolling. We've recently 18 implemented an online registration feature so that the process is easier for 19 an organization to sign up. To do so, licensees can navigate to the URL 20 that you see there on the screen. But should you have any questions at all, 21 you can also submit a support request through the eBilling website.
22 Thank you. And I'll now turn it back to Dan Dorman.
23 MR. DORMAN: Thank you, Abby. And thank you to all 24 of the presenters, to all of the staff involved in these initiatives, as well as so 25 many other initiatives throughout the agency. Next slide, please.
26
35 As you can see, we have done and are doing a lot and are 1
focused on sustaining the progress we have made over the last several 2
years to respond to the dynamic environment in which we operate. Our 3
experience over the last few years, including our ability to transition to 4
mandatory telework in response to the pandemic, has shown us how 5
essential transformation is in preparing us for a complex and uncertain 6
future.
7 We will continue to monitor our external environment, 8
adapt and innovate as needed, in order to ensure we are effectively and 9
efficiently achieving our important safety and security mission. In addition, 10 we established 2022 objectives and key results with the goal of sustaining 11 and pushing forward our transformational efforts and aligning those efforts 12 with our agency strategic plan. We will carry forward the valuable lessons 13 we have learned throughout our transformation journey to best position 14 ourselves for a successful future.
15 As we carry our transformation journey forward, we will do 16 so with many new employees who we are recruiting to join the agency. This 17 will be one of our major challenges in the years ahead, and we are laser 18 focused on ensuring that we have a high-performing, diverse, engaged, and 19 flexible workforce with the skills needed to carry out the NRC's mission now 20 and in the future.
21 We will continue to work towards realizing our desired 22 agency culture, a culture that supports creativity and diversity in all its forms, 23 appreciates the need for change, and helps us to sustain all that we have 24 achieved during our transformation journey so far.
25 This concludes our presentation, and we look forward to 26
36 your questions.
1 CHAIRMAN HANSON: Thanks very much, Dan.
2 Thanks, everyone, for your presentations. We'll begin questions this 3
morning with Commissioner Wright.
4 COMMISSIONER WRIGHT: Thank you so much, Mr.
5 Chairman. And thank you, each of you, for your presentations today and 6
the updates of where we are with everything, and I really personally look 7
forward to hearing from the staff on this every year, especially hearing from 8
those staff who are actually putting boots on the ground to get it done.
9 I've got a few questions that I'm going to ask, but I can't get 10 to everybody, you know. I just can't. So Antonios and Abby and Becca, 11 I'm not going to have any questions for you today, but I may reach out to you 12 separately as we get further into this, but thank you for your presentations. I 13 found them very informative.
14 Caylee, I don't have a question for you, but I do want to 15 call out something that was in your presentation on slide 21, believe it or not, 16 right in the middle, you had a bullet there that highlighted that rulemaking is 17 a deliberative process; there is still room to innovate. I think that's a critical 18 message and something that really resonates with me because innovation 19 and transformation, they don't mean excluding the public or limiting 20 stakeholder feedback or introducing shortcuts to anything to our 21 deliberations or anything like that. So it does mean looking at our 22 processes to see how we can do things better and I really appreciate your 23 message. Thank you for your work in this area and look forward to hearing 24 more and more good things from you. So thank you.
25 So now I'm going to turn over to the questions. So, Dan, 26
37 I'm going to start with you. You know, a critical part of the transformation 1
effort is defining our goal, right, and having a common vision. The staff has 2
indicated that its efforts to have each office and region formulate their own 3
organization-specific OKRs here, objectives and key results, that support the 4
agency-wide OKRs as a way to accomplish that goal, right? So I wanted to 5
get an update on this from you. And have the OKRs been reviewed and 6
compared to each other, and are you seeing alignment the way you thought 7
you might?
8 MR. DORMAN: Thank you, Commissioner. So, you 9
talked about the goal, and you used the word vision, and one of the first 10 things that I did as EDO was to work with the senior leadership team to lay 11 out a vision that as a modern risk informed regulator will achieve mission 12 excellence in a diverse, inclusive, and innovative environment with a highly 13 skilled, adaptable, and engaged workforce.
14 So, you can find all of the focus areas of transformation 15 embedded in that vision, and there's room for all of the organization to find 16 itself and come on board with that, and the key to that is the OKRs. And so 17 we lay out OKRs at the EDO level for the agency, and then share those.
18 We did that in December time frame, shared those out to the offices in the 19 January time frame, and each of the offices then built out their OKRs for the 20 year using that framework to ensure that we are aligning to that vision.
21 But how we achieve, as you heard from so many offices 22 today, and there are so many offices that you didn't hear from today, that are 23
-- how they work their work into that vision is a little different in every 24 program of the agency, but they're all aligned to that goal.
25 COMMISSIONER WRIGHT: Good, I appreciate your 26
38 answer on that. Because with so many parts that are moving, you just want 1
to be sure, and it sounds like you're confident that they are working towards 2
a common purpose.
3 MR. DORMAN: You did ask if we review that, those 4
OKRs do come back to the EDO, and the EDO's transformation team looks 5
through and makes sure that we are achieving that alignment.
6 COMMISSIONER WRIGHT: Okay, thank you. So, the 7
NRC has acknowledged the success in transformation really comes down to 8
a change in our culture, and I agree with that. We need to embrace new 9
ways of doing things, reward innovation, break down barriers, things like 10 that. You noted that the agency culture team is continuing to work to align 11 behavior of norms, and expectations with our leadership model. Can you 12 give me an example, or two in this area, and whether they are having the 13 desired effect?
14 MR. DORMAN: Yeah, so there's a number of things that 15 fall under the umbrella of culture; historically, we've talked a lot about the 16 Federal Employee Viewpoint Survey, and the focus on employee 17 engagement, and environment that we have for our employees. We also 18 have periodically, our Office of Inspector General does a safety culture and 19 climate survey, and a safety culture review.
20 The initiative under transformation was focused on what 21 we called the desired agency culture, and it's a culture that promotes and 22 enables innovation in the organization. And so that initiative, all of those 23 elements of culture are all part of the agency culture transformation. We did 24 establish a culture team within the office of the EDO to support the offices in 25 achieving all of those elements of culture, but particularly the desired agency 26
39 culture.
1 We did a baseline survey of the staff in 2020 for the 2
desired agency culture, and it included both a piece that we're looking at, 3
what is the culture relative to certain measures, as well as where would we 4
like to be to have this innovative environment? So, then we have that yard 5
stick to measure against as we go forward. And we did a follow-on survey 6
in 2021, we showed some progress toward that desired agency culture, but 7
we still have work to do.
8 So, the culture team in the EDO's office works with change 9
agents across the agency, and I'm really excited by the number of people 10 who raised their hand to be a part of this effort, and support the offices in 11 their culture initiatives as well. And identifying again, as you move across 12 the agency, there are different areas of priority, and focus in enhancing the 13 culture. And so that works across the agency, and that's the initiative that 14 we have open because changing culture takes time.
15 COMMISSIONER WRIGHT: Right, and I did pick up on 16 that takes time theme earlier in the presentations. So, that brings me to this 17 question; I think it's an important question, because alignment in your 18 culture, next to initiatives, are really important. There have been some 19 concerns raised both internally, and externally as you know, that there are 20 different cultures at headquarters, and at each of our regions, right? With 21 very different risk appetites evident in some of our new processes, like Be 22 riskSMART, and VLSSIR. I mean obviously it can lead to different 23 applications of the processes, and different outcomes for licensees on 24 similar issues. And I'm interested in your perspective on this and have you 25 found this to be true, or do you see consistency in application of these 26
40 processes at headquarters and across the regions?
1 MR. DORMAN: I think there's always a challenge in a 2
large organization. There's different cultures among the offices in 3
headquarters. It's not a question of where you are, it's a question of where 4
you identify, and what behaviors and norms you identify with. So, we're 5
always working to align the whole agency around those standards. I think 6
it's most visible for some of our licensees who have equities that are subject 7
to oversight by different regions.
8 And so they perceive perhaps differences there. And 9
that's a continuous effort for the program offices working with the regions to 10 ensure that we are aligning across the agency, consistent with risk informed 11 decision making on the most important decisions that we engage. We have 12 management review boards of various types to bring issues to multi office 13 decision makers to make sure that we're applying the standards of the 14 agency in a consistent way where it's most important.
15 COMMISSIONER WRIGHT: Thank you. And I've got 16 about a minute, and a half left. And being a southerner, ladies first, so Tim, 17 I'm going to apologize to you and to Jeff for not being able to get to a 18 question for you. So, it was good to see you and thanks for your 19 presentation. And I appreciate that the staff sought external feedback on 20 how our transformation efforts are going. It's important that we not only 21 self-monitor our efforts, but get feedback from stakeholders, right? I took a 22 look at the dashboard survey from this external feedback, and there were a 23 couple of things. It looked like the stakeholders rated us above seven on 24 information sharing and quality of decision making, and mission 25 performance. But they gave us a six on timeliness for decision making.
26
41 So, could you provide your perspectives - do you agree with that? On the 1
results, and what, if anything, are we doing to improve the timeliness of our 2
decision making?
3 MS. RIVERA-VARONA: Thank you for the question. So, 4
yes, so we did acknowledge, we see that from the external stakeholders, 5
they don't see the improvement of the timeliness of our decision making from 6
our transformation efforts. We don't know what's driving that, we are 7
looking for opportunities to engage with our external stakeholders to learn 8
more, why is that. And finding ways like this Commission meeting that 9
provide us the opportunity to showcase some of the enhancements we have 10 made, and how that has impacted our timeliness of decision making. So, 11 we look forward for more opportunities to learn more and to showcase how 12 we can do better.
13 COMMISSIONER WRIGHT: Thank you so much. Mr.
14 Chairman?
15 CHAIRMAN HANSON: Perfect timing. Thank you, 16 Commissioner Wright. And thank you all for your presentations this 17 morning, I thought this was a really great discussion, and a great way to kind 18 of showcase some really significant successes that the agency has had. I 19 keep talking about transformation in my RIC speeches, because it's 20 genuinely really important to me.
21 I agree, I think it was Margie Doane who said that 22 transformation is really about making better regulatory decisions, and I 23 completely agree with Dan, that it's also about preparing for a range of 24 possible futures. Because we really do have, I think -- I don't want to say a 25 significant amount of uncertainty, but just a range of possible outcomes kind 26
42 of facing the agency depending on where industry goes, and how industry 1
develops.
2 And I think folks are coming in to talk to each of us 3
Commissioners about those possible range of futures, and I look to 4
transformation as being really a key enabler in the agency's ability to meet 5
those future challenges. And I want to emphasize too, that I continue to 6
think of transformation as going hand in hand with the hiring initiative that 7
Dan is spearheading in collaboration with Mary Lamary, and others in the 8
agency for a couple of different reasons.
9 In a lot of ways, transformation has been collateral duty for 10 a lot of people within the agency. They do their regular jobs, and then they 11 do transformation and innovation activities on top of that. And gee, wouldn't 12 it be nice to get a few more people in the door to relieve that burden? I 13 think Dan heard that acutely from some of the branch chiefs earlier in the 14 year when he met them, about how busy and occasionally overwhelmed 15 they are. And we don't want that situation to continue for any real length of 16 time. So, let's get some more folks in here. But also I see transformation 17 as a defense in depth for future hiring initiatives. Hiring is hard right now.
18 We know that there are vendors and utilities, and others who are hiring like 19 crazy too. We're competing with those entities for smart folks.
20 And I think there are a lot of really good reasons to come, 21 and work at the NRC; innovation, and our culture, and the importance of our 22 mission being among them. But our ability to transform and focus on the 23 most mission critical tasks, to focus on the most risk significant and safety 24 significant areas is also really important in the event that not all of the people 25 that we want to have come through the door actually do, down the road.
26
43 And that's going to be a significant journey, although let me 1
just say I understand we're having some success in that area, too, that I 2
want to recognize, and celebrate. So, I think that's all to the good. I 3
wanted to touch on just a couple of things.
4 I think Aida, it was in your presentation, and I think Caylee 5
had something in hers as well about institutionalizing, and sustaining these 6
innovation efforts, and not having change fatigue. I think that was Caylee's 7
turn of phrase that I thought was really eloquent. And that the 8
transformation doesn't become just kind of change for change sake, right?
9 That we're really trying to accomplish, tackle concrete problems, and 10 achieve concrete objectives. And with some of these things, recognizing 11 also that with things like the future's jam, and other initiatives that we had, it 12 followed the 80/20 rule, right? We got a lot of low hanging fruit in that 583 13 initiatives that we've seen, and now we're starting to move into a phase 14 where we're tackling the harder stuff. Although I think things like MAP-X, 15 and RIPE and VLSSIR, MAP-X, SPAR-DASH, that was another one, sorry I 16 said MAP-X twice, are really moving ahead, and tackling some of these 17 bigger things. Rulemaking is another really great example of that.
18 Increasing participation in eBilling is -- that first 30 percent, probably pretty 19 easy, right? Those are the people who wanted to do this already. Moving 20 that up is going to be harder, it's going to have that kind of curve that levels 21 off. And so, I want to encourage everyone to just kind of keep moving 22 ahead and keep thinking about this. Believe it, or not, I do actually have a 23 question, so I'll start with Aida.
24 So, Aida, in SECY-22-0027, we got some of the 25 transformation performance measures. I want to appreciate that those 26
44 performance measures and the OKRs that we've had around transformation 1
are aspirational. We set big goals. I mean 90 percent of -- I've got it here.
2 90 percent of surveyed staff by NRC during 2021 agree that during the past 3
year the agency's use of technology, data analytics has strengthened our 4
decision making, and regulatory processes.
5 Well, we didn't meet that because we had 81 percent, 6
which is pretty good. So, let's recognize that. Even as I think it's important 7
that we have some stability in OKRs, right, so that we're measuring across 8
time, and we're seeing progress, right? As a runner, I appreciate the idea 9
that sometimes direction is more important than speed on some of these 10 things. But maybe, Aida, can you give me a couple of examples? I guess 11 where we're taking a couple of OKRs that are in that red zone, so to speak, 12 right, were not met, and we're having some management attention on those, 13 and whether that's in Be riskSMART, or some other areas.
14 MS. RIVERA-VARONA: So, yes, thank you for the 15 question. So, for 2022, we do take a look at that, and we didn't have -- for 16 2021, we didn't have any baseline. So 2021 became our baseline for the 17 2022. And the way that we are focusing in 2022, some of them are -- you 18 know, we are aspiring for a ten percent increase in some of those survey 19 results so that we can see a progress, but you know we are managing some 20 of that as well.
21 For other OKRs, we turn to, as you said institutional 22 analyzing some of them. And so the action changed from the use of the 23 tool to more embedding some of how we are using the tool in our processes.
24 So, even though we didn't need it in 2021, we are taking an additional step 25 to make it more meaningful going forward for the agency.
26
45 CHAIRMAN HANSON: Okay, thanks. Well, and when it 1
comes to Be riskSMART, and getting that training out, I think at the end of 2
2021 we were at 53 percent, and we really want to be -- I think we've made 3
the training at this point mandatory, but maybe you or Dan, can just talk 4
about institutionalizing Be riskSMART thinking across the agency.
5 I had an interesting conversation with someone from 6
Region III earlier this week about how Be riskSMART kind of provides a 7
baseline in a way. It's kind of a risk thinking 101. But then you have really 8
mature practitioners, you have senior managers, you have corporate support 9
folks. How are we kind of varying our message or our training for those 10 folks so that they get more comfortable in applying risk informed decision 11 making?
12 MR. DORMAN: Just to be clear, for the folks who are not 13 practitioners?
14 CHAIRMAN HANSON: Right, not practitioners, exactly.
15 Some of the people like Antonios, and some of the folks, these guys are kind 16 of black belts. But there are others who maybe are not, or there are senior 17 managers who are going to look at it in a different way.
18 MR. DORMAN: Right. So, I think the key is that Be 19 riskSMART is that 101 framework, so we can apply it to any, I think it was 20 touched on by Becca that it can apply to any decision making, it's 21 reputational risk, it's litigative risk, it's technology investment risks. So, it 22 can be applied to any framework, and that's why we've made it mandatory 23 through the end of this year for everybody to get the training on it.
24 But then it's a question of really management leading the 25 way, and saying hey, we're engaging a decision here, how have we applied 26
46 the riskSMART framework to it? And the great thing about the Be 1
riskSMART framework is it doesn't have to be hugely resource intensive.
2 Yes, we have these very advanced models for core damage frequency, 3
that's appropriate for the decisions we're making there.
4 But this can be a relatively simple framework, but it causes 5
you to consciously think about the risks inherent in the decisions you're 6
considering, both to inform how much effort is worth spending on this 7
decision given the insight of the associated risk, as well as the risk insights 8
associated with the decision itself.
9 So, I think as we get more people trained up on it, and we 10 become more intentional about using it broadly in everything that we do, that 11 will build in that institutional muscle memory.
12 MS. RIVERA-VARONA: Can I add something more?
13 MR. DORMAN: Please.
14 MS. RIVERA-VARONA: Also the Be riskSMART team, 15 even though they completed their work as a team, as an initiative, they 16 continued to also conduct work with ambassadors across the agency. So, 17 they continued to have workshops, they continued to have sharing of the use 18 of Be riskSMART in different aspects, that helps staff get comfortable, 19 understand, and use it in their daily aspects as well.
20 CHAIRMAN HANSON: Okay, very good, thank you.
21 Commissioner Baran?
22 COMMISSIONER BARAN: Thanks. Well, thank you all 23 for your presentations, and for the progress you've made on so many 24 innovation efforts. Jeff, thanks for spending some time talking about 25 SPAR-DASH. The SPAR models are so important to NRC's independent 26
47 oversight role, and the staff is really, I think, taking their usefulness to a 1
whole new level with SPAR-DASH. It's great to see that we're leveraging 2
those models to gain risk insights for our licensing, and oversight work.
3 I know that the staff is just starting to take advantage of 4
this new tool, but can you give us a couple of specific concrete examples of 5
how the staff is using SPAR-DASH?
6 MR. WOOD: Yes, thank you for the question, 7
Commissioner Baran. We do have a few examples, it's still a relatively new 8
product, but we did have recently a risk analyst in NRR perform an 9
evaluation of an emergent issue using their risk informed process. And this 10 was related to the Office of Inspector General's audit of the NRC's oversight 11 of counterfeit and fraudulent parts.
12 And the evaluation used SPAR-DASH to quickly gain some 13 insights on the potential risk impacts associated with some of the systems 14 that could be impacted. And we also have an ongoing proposed safety 15 issue related to emergency diesel generator protected trips, and we're using 16 SPAR-DASH to gather some risk information about the operating reactor 17 fleet in general. And we have several anecdotes of our resident inspectors, 18 and senior resident inspectors viewing the tool. No details on specific 19 applications, but we know it's getting a lot of looks.
20 COMMISSIONER BARAN: That's great. The risk 21 insights from SPAR-DASH are only going to be as good as the underlying 22 models of course, which I think are pretty good. What's the staff's view 23 about the current frequency of SPAR model updates? There have been 24 resource challenges in the past, but should we be updating our SPAR 25 models more often than we are now?
26
48 MR. WOOD: Yes. Well, our current program for 1
updating the models provides sufficient support to meet our needs for the 2
reactor oversight program and our other risk informed program. We are 3
performing six model updates with an extensive bench marking, and a 4
comparison against licensee PRA results. We're performing six of those a 5
year. But we also address model changes as needed, on an as needed 6
basis. We're making multiple updates every month in support of our 7
different risk informed programs.
8 But we do recognize an increase in the use of the SPAR 9
models, and especially with things like SPAR-DASH, we're seeing increased 10 needs. So, we are pursuing increasing the number of models that are 11 updated with that significant bench marking exercise. We're planning to 12 increase that number that are performed each year.
13 We're looking at working with our contractors at the Idaho 14 National Lab and having more NRC staff involved in that process over the 15 next few years. This would reduce the number of those ad hoc model 16 changes that we do, and overall improve our efficiency. And it will also be a 17 great knowledge management development tool for our staff that are 18 involved.
19 COMMISSIONER BARAN: Good, that's good to hear.
20 Caylee, I think the improvements to the rule making process are important 21 and positive. Even with these improvements, rulemaking can still take a 22 very long time at NRC, I think we all realize that. We recently got a 23 rulemaking plan that's pretty typical. It included a time estimate of 57 24 months, if there were no unexpected delays. So, that's about five years, 25 which if we're being honest with ourselves, is just too long. That kind of 26
49 schedule usually involves 16 months to develop a draft proposed rule, and 1
16 months after the public comment period to develop a draft final rule.
2 Those 16 months don't include the public comment periods themselves.
3 We've seen other agencies prepare draft proposed rules, draft final rules in 4
more like a 12 month period, even for complex rule makings.
5 Is the staff looking at ideas for getting to those kinds of 6
shorter time frames, so that an entire rule making can be completed in two, 7
to three years without doing anything that shortens public comment periods?
8 MS. KENNY: Absolutely, thanks for the question, 9
Commissioner Baran. Yeah, so as I mentioned, our original intent was to 10 really take a full holistic look at our rulemaking process, and we did actually 11 benchmark with four other government agencies. So, we gained a lot of 12 ideas from them, and a lot of our original initiatives kind of sprung from the 13 lessons learned, should I say, from the processes that these other agencies 14 use.
15 So, as we continue to institutionalize, and add a lot of 16 these improvements that we've made into our processes, and procedures, 17 they become more ingrained in our day-to-day culture, I think we'll see those 18 time frames start to come down a little bit. As I mentioned, that regulatory 19 basis efficiency is expected to save us about six to nine months from any 20 given rule making depending on the complexity. That was an idea taken 21 from the benchmarking of those other government agencies. Certainly the 22 concurrence process, we can do some work there. As I mentioned, we are 23 going to be doing a review of the improvements that we've made so far to 24 see kind of where we are at compared to our baseline prior to starting our 25 initiative. Certainly we can make some more streamlining there in terms of 26
50 who is actually on concurrence, versus who needs to be there for 1
awareness.
2 Making sure our partners are well aligned, and involved 3
earlier on to preclude any potential rework or show stoppers or whatnot.
4 And as we continue to make use of the agile concept, we know we've seen it 5
in play in the PRM process, where that was ahead of schedule, and it's been 6
really helpful in terms of maintaining alignment, and moving things on 7
throughout the product development process at a smoother pace.
8 So, certainly we are consistently and always looking for 9
ways to do so. We know we can do better. We do think we will see 10 continued improvements as these process changes are more 11 institutionalized, and whatnot. And then we're trying to make it a safe space 12 for staff to voice their new ideas, and ingrain innovation into our culture. So, 13 we're always hoping that they'll bring up new ideas for us to tackle as 14 potential improvements.
15 COMMISSIONER BARAN: Good. Well, I'm glad to see, 16 and hear that the effort overall is making progress, and that the effort to 17 streamline the concurrence process is moving along. I'm looking forward to 18 hearing are we seeing meaningful reductions in the length of time to get 19 through concurrence, as you all look more at that.
20 Antonios, you mentioned that the staff is looking at 21 extending RIPE to technical specification. Can you talk a little bit about 22 that? What's the staff envisioning in this area? Would it be for 23 administrative items, or are you thinking more broadly than that?
24 MR. ZOULIS: Thanks for the question, Commissioner 25 Baran. Right now, what we're looking for, you still need to meet the criteria 26
51 of the RIPE process, essentially the issue still needs to be well represented 1
by the probabilistic risk assessment of the plant licensees. And kind of 2
initially we didn't think the tech specs low safety significance issues, so 3
essentially we excluded that from the RIPE Process.
4 But then we were thinking that there could be opportunities 5
where a licensee may come in for an exemption, for example, where the 6
system may be in tech specs. So, they would come in for the exemption 7
and then also the license amendment change in one fell swoop under the 8
RIPE process. So, that's kind of where we were picturing it. Not for 9
administrative changes at this point. We're still trying to ensure that the risk 10 is well defined, and it's truly a low safety significance issue. Another 11 example could be perhaps a focus, the tech spec IOT extension for some 12 system maybe that is, that for some reason has a higher IOT than the risk 13 represents in the plant. So, maybe they would come in for something of 14 that nature.
15 COMMISSIONER BARAN: A lot of the equipment 16 addressed by tech specs provides defense in depth. How do we make sure 17 that RIPE doesn't result in any kind of whittling away of defense in depth at 18 nuclear power plants over time? Is the staff going to build something into 19 the process that's going to look at the cumulative effect of RIPE changes to 20 tech specs and RIPE changes generally?
21 MR. ZOULIS: That's a great question. So, fundamental 22 to the RIPE process is to evaluate cumulatively. I think I mentioned that in 23 my discussion. So, another beauty of the RIPE process, it's consistent with 24 our application Reg Guide 1.174. And in Reg Guide 1.174, you need to 25 consider cumulative impacts, so that needs to be an evaluation the IDP must 26
52 consider, as well as defense in depth. So, when we're looking at these 1
issues, you need to ensure there's minimal impact to defense in depth, and 2
the risk is low. So, this is truly a risk informed process. It's not just about 3
risk, it's about all the other elements of the risk informed decision making 4
process.
5 COMMISSIONER BARAN: Good. Tim, I see that MAP-X 6
effort is very valuable. It sounds like we're still at the stage right now where 7
it's mostly a portal for applicants, and licensees to provide the agency with 8
information. When do we think stakeholders will be able to obtain more 9
information through the portal, and how do we make sure the information 10 provided by NRC through MAP-X is available to all stakeholders, and not just 11 a subset of stakeholders?
12 MR. MOSSMAN: So, we're working right now with a 13 variety of internal stakeholders in the NRC about what kind of modules they 14 would see as valuable. I think based upon the lessons learned we've gotten 15 to date we want to be very careful about the next modules we take on board.
16 I think even though I would always say I want more, more, more, I want to 17 go as fast as we can on this.
18 I think it's kind of important that we went out at the pace we 19 did. We were able to put out some relatively simple modules, learn some 20 lessons. I think with those lessons now, I think we can make a little more 21 informed decisions about what modules we take on going forward. Given 22 EMBARK's size, we are a change catalyst, so it's very important for us to 23 work with offices. Whether if it's in the materials side, whether that's the 24 NMSS MSST, if it's the reactor side, we have very valuable partners in 25 DORL. It's going to be important for us to hear from them, and be working 26
53 through them from the stakeholder communities, what kind of information 1
both internally we want to share, what the stakeholder communities want to 2
receive.
3 We've got some ideas of things that would be relatively 4
straightforward to share out. Still working on the prioritization of that. The 5
other thing that's kind of important inherent in that, is to make sure that the 6
databases we're pulling from are kind of -- the data is collected, and 7
maintained in a way that it's going to be reliable information we put out.
8 In terms of putting stuff out to a wider variety of 9
stakeholders, like more public stuff, we're not even constrained by MAP-X to 10 do that. We've talked internally about a number of different opportunities, 11 and in our weekly pitch meetings at EMBARK, we talk about some of the 12 things we still publish reports for because we've been doing it for half a 13 century.
14 And there might be opportunities to -- let's do a web 15 representation of that report, and we can put that information out in near real 16 time, and maybe get rid of the need to publish a NUREG every year doing 17 that. But we also need to make sure that again, the database that data is 18 kept in is not only sufficiently robust, but controlled in a way that we don't 19 inadvertently put something out. But we're looking forward to those 20 opportunities going forward. I think that's definitely an area EMBARK wants 21 to be squarely involved in to work with our different internal stakeholders to 22 make more information available.
23 COMMISSIONER BARAN: Great. Well, I want to take 24 just one more minute, and close with a couple of kudos for the staff. First, 25 the eBilling effort that Abby talked about is a terrific development. I 26
54 remember sitting here a few years ago listening to how our billing process 1
was slow, it was prone to errors because it required so much manual effort.
2 We were using traditional mail service. Everyone agreed that it needed to 3
improve, but that it would take a lot of work. And OCFO, OCIO, the staff 4
generally did that work, it resulted in a huge improvement, and the staff 5
really deserves recognition for that. It's really a great accomplishment.
6 In the realm of Be riskSMART, I was struck by a very 7
positive example of using risk to get to a result that was protective of safety 8
recently. And it's one that Becca mentioned actually a little bit in her 9
presentation. The staff was looking at how to make cyber security 10 inspections more efficient. And one idea was to reduce the size of the 11 inspection team if a licensee voluntarily submitted performance metrics in 12 advance. The staff evaluated that idea, realized the potential for significant 13 negative impact on the inspection team if contractor support was dropped, 14 and decided not to reduce the team size. Instead the decision was that 15 inspectors would look at voluntary performance metrics, which could make 16 the inspection more efficient, but they weren't going to reduce the 17 capabilities by shrinking the team. I think that was the right outcome, and 18 it's great to see the decision making process consider all the pros, and cons 19 of a potential change, so good job. Thanks.
20 CHAIRMAN HANSON: Thank you, Commissioner Baran.
21 Since you took a few minutes extra, which I think is a great thing, and I think 22 we could go all day probably on this, and have a good time. I did want to 23 give Commissioner Wright an opportunity to make any closing remarks, or 24 ask any remaining questions, or what have you.
25 COMMISSIONER WRIGHT: You know what they say 26
55 about a politician and a microphone, right? No, I want to echo what 1
Commissioner Baran said. I'm always amazed, I'm a huge EMBARK fan - I 2
promote that anywhere I go. I'm really very proud of everything that the 3
staff is doing, and having done it in this environment even, I mean that's 4
even bigger and better. So, thank you for the opportunity.
5 CHAIRMAN HANSON: Thank you, Commissioner Wright.
6 And thank you both for your questions. I think we just kind of barely 7
scratched the surface here. There's a lot going on. In case folks hadn't 8
noticed, I agree with Colin Powell, who said that optimism is a force 9
multiplier. I think we heard a lot this morning to be optimistic about. I did 10 want to give -- in the spirit of both my colleagues, I did want to give a shout 11 out.
12 There's a new, I don't know what to call it, a video blog.
13 I'm so behind the times. But Taylor Lamb is taking her formidable 14 enthusiasm for innovation and transformation, and whereas in case any of 15 you had missed her TAYtalks around the Agreement State program and so 16 forth, she's now pointing that at transformation. She's got an innovation 17 education series that she started. And the first episode is out with Niav 18 Hughes Green and Audrey Thomas. I think it dropped sometime this week, 19 but it's a whole conversation about IdeaScale, about the power of IdeaScale 20 for capturing transformation and innovation ideas. I thought it was a really 21 good conversation and want to applaud them for exploring these other 22 avenues, and vectors for engaging staff. And for encouraging continued 23 enthusiasm around this even as -- and I think IdeaScale continues to be a 24 really great tool that the staff can use. I think Taylor made a really good 25 point in that conversation when she said, hey, look, if you've got an idea, and 26
56 your manager is onboard, just go do it. You don't have to put it in 1
IdeaScale. I mean that's a good place to capture it, and track it, and lots of 2
other things, it's a great tool. But don't let that constrain you. I think that it's 3
really important, and that's just one area in which I think we all continue to 4
just be impressed by what a creative and engaged workforce can 5
accomplish. And as I think Commissioner Wright just said, in a pretty tough 6
environment in the last two years, and yet it's driven a lot of creativity as 7
well.
8 So, I'm just really glad this morning to have the opportunity 9
to celebrate some of these successes and I continue to be proud of what the 10 agency has done. And with that, thank you, we're adjourned.
11 (Whereupon, the above-entitled matter went off the record 12 at 11:36 a.m.)
13