ML19305D098

From kanterella
Jump to navigation Jump to search
M191029: Transcript - Transformation at the NRC - Becoming a Modern, Risk-Informed Regulator
ML19305D098
Person / Time
Issue date: 11/29/2019
From:
NRC/SECY
To:
Shared Package
ML19297G088 List:
References
M191029
Download: ML19305D098 (89)


Text

UNITED STATES NUCLEAR REGULATORY COMMISSION MEETING ON TRANSFORMATION AT THE NRC - BECOMING A MODERN, RISK-INFORMED REGULATOR

TUESDAY, OCTOBER 29, 2019 ROCKVILLE, MARYLAND The Commission met in the Commissioners' Hearing Room at the Nuclear Regulatory Commission, One White Flint North, 11555 Rockville Pike, at 10:00 a.m., Kristine L. Svinicki, Chairman, presiding.

COMMISSION MEMBERS:

KRISTINE L. SVINICKI, Chairman JEFF BARAN, Commissioner ANNIE CAPUTO, Commissioner DAVID A. WRIGHT, Commissioner

2 ALSO PRESENT:

ANNETTE VIETTI-COOK, Secretary of the Commission MARIAN ZOBLER, General Counsel NRC STAFF:

GREGORY BOWMAN, Deputy Director, Division of Risk Assessment, NRR AMY D'AGOSTINO, Human Performance Analyst, NRR MARGARET DOANE, Executive Director for Operations JENNIFER GOLDER, Deputy Director, OCHCO JONATHAN GREIVES, Chief, Projects Branch 4, R-I/DRP TAYLOR LAMB, NRO/DLSE/CIPB JOHN LUBINSKI, Director, NMSS DAVID NELSON, Chief Information Officer MAUREEN WYLIE, Chief Financial Officer

3 P R O C E E D I N G S 1

(10:01 a.m.)

2 CHAIRMAN SVINICKI: I call the Commission's public 3

meeting this morning to order. Let me begin by saying that we have a nice 4

full room here, and a full table, so it's going to be, I think, a lot of wonderful 5

content that we get through this morning.

6 The Commission is convening in public session this morning 7

to discuss the strategic aspects of transforming the U.S. Nuclear Regulatory 8

Commission to better inform our decisions and prepare us for the future. I 9

would just note that we have had previous meetings on the Agency's 10 transformation effort, and the Commission contemplates that over the course 11 of time, as we proceed with transformation initiatives, that there will be 12 somewhat of a series of public meetings.

13 I think at this point in time it's not really determined. The 14 frequency may be correlated with progress under these initiatives or it may be 15 more routine. I think the Commission will kind of figure out what makes the 16 most sense as we move forward. But this is an exciting opportunity for us to 17 check in.

18 There's been a lot going on. We had an agency-wide 19 dialog. We have had a lot of activities following on from that. And there are 20 a lot of moving pieces. So, I think we'll hear something about that today.

21 I do want to note that among the many wonderful NRC 22 presenters we have today, we do have Ms. Maureen Wylie, who is our Chief 23

4 Financial Officer. And as she will be retiring or separating from federal 1

service at the end of the year, this is likely -- unless something changes that 2

we don't contemplate -- this is likely to be her last opportunity to present and 3

appear before the Commission today.

4 Maureen, you, beyond the contributions you've made here 5

at NRC, you have a long career in federal service. I want to recognize your 6

service to the country and your many years of hard work and the contributions 7

that you've made here as well. And we will have the more appropriate 8

venues to fete and recognize, and perhaps roas,t in a good natured way, --

9 MS. WYLIE: In a good natured way, of course.

10 CHAIRMAN SVINICKI: -- and light-hearted ribbing, and 11 various things from your peers, and members of the Commission, and your 12 colleagues, and others who may join us in that.

13 But thank you, again. And as we always do at NRC, we are 14 sad to see people go but we wish you kind of every happiness for you and 15 your family as you move forward.

16 MS. WYLIE: Thank you.

17 CHAIRMAN SVINICKI: And with that, on that topic or any 18 other, do any of my colleagues would they like to make some opening 19 statements?

20 Commissioner Baran.

21 COMMISSIONER BARAN: I don't know if this falls as a 22 opening statement because it's so brief. But we're really going to miss you, 23

5 Maureen. You've just been so terrific in this role. And it's going to be a real 1

loss for the Agency to see you go.

2 And we'll have more time to, you know, celebrate you and 3

everything you've done. But it sounds like you've already had the forethought 4

to begin structuring your, you know, going away party to avoid that kind of, 5

you know, gentle ribbing that sometimes occurs. And that's pretty smart, so.

6 MS. WYLIE: Well, there's so much material.

7 (Laughter.)

8 CHAIRMAN SVINICKI: Thank you. Anyone else?

9 Okay.

10 All right. Well, with that, so we have one panel at today's 11 meeting comprised of the NRC staff presenters. And we will lead off with 12 Margie Doane, our Executive Director for Operations.

13 Margie, please proceed.

14 MS. DOANE: Okay. Thank you, Chairman and 15 Commissioners. And before I begin my remarks and the introduction I, too, 16 want to thank Maureen. And I want to emphasize what she has meant to the 17 staff of the NRC.

18 She came here from NOAA, and she had great ideas for 19 transformation. And I really believe that her, and Dave Nelson, and some of 20 the other executives that came into the Agency, along with some really 21 forward-thinking at the Agency, executives that were already forward thinkers 22 at the Agency really kicked off our work to become a modern, risk-informed 23

6 regulator.

1 So, not only is she working so hard on these systems that 2

she has transformed within the CFO -- which you're going to hear about -- but 3

she really has been a motivator to help us change our culture in a really 4

positive way. And that's an incredible legacy to leave in such a short amount 5

of time.

6 So, we'll have lots of opportunities, but on behalf of the staff 7

I just wanted to also give our thanks.

8 MS. WYLIE: Thank you.

9 MS. DOANE: Okay. Let me turn to the issues at hand 10 then.

11 So, we're appreciative of this opportunity because we've 12 had some trans -- we've had some innovation meetings but we haven't really 13 been able to show you all the different work that's going on. And this really 14 should be seen as the tip of the iceberg. There is a tremendous amount of 15 work in addition to what you're going to hear about today.

16 So, our goal is to show you kind of a smattering, an array of 17 things that are going on to show you that we are making significant progress 18 to become a modern, risk-informed regulator.

19 So, like most large organizations who reset their work 20 periodically, you don't transform, you don't -- you're not like a chrysalis that 21 becomes a butterfly in a couple months. That's not what transformation is.

22 It really is some -- it's an evolving, an evolution of many small things that go 23

7 on all over the Agency. And that's why we like to say change is happening 1

one decision at a time.

2 But that doesn't mean that we are not making progress and 3

that we're not moving urgently. We are, as you'll see, doing many different 4

things. But it is an evolution as we're carefully making sure that we don't lose 5

sight of our very important mandate to be -- to ensure public health and safety, 6

common defense and security, and protect the environment.

7 A critical step in our evolution is ensuring that we foster a 8

culture that embrace mindsets and behaviors that are consistent with being a 9

modern, risk-informed regulator. We have collectively established -- we have 10 collectively established seven initiatives that we have identified as the next 11 steps of transformation.

12 One of these initiatives is a culture of change. What I mean 13 by a culture is a shared, are shared organizational values, assumptions, 14 beliefs, and behaviors that provide signals about what is accepted and what 15 is expected of our employees. The culture we establish will influence all 16 aspects of innovation and how we approach becoming and making modern 17 regulatory decision, making regulatory decisions with an eye toward becoming 18 a modern, risk-informed regulator.

19 Our efforts in this area are focused on how we should lead 20 during times of change to enable trust, eliminate fear of change, and 21 encourage thinking big across all of the Agency. It includes holding ourselves 22 accountable for meeting our mission; leading by example; meeting milestones 23

8 that we set for ourselves for transformation.

1 Our culture initiatives also include proactively addressing 2

stakeholder needs as they continue to change, by being transparent, 3

performance driver, and focused on our principles of good regulation.

4 Our team lead for this initiative is Patrice Reid. She's been 5

working on these issues for many years at the Agency, and she has been 6

working very hard as we work toward our transformation vision.

7 I wanted to highlight this effort to emphasize that it is our 8

culture that underpins all aspects of transformation and everything we do.

9 One other area that I want to emphasize is why we need to 10 change. Our staff is constantly asking this question. And I think that the 11 Commissioners have provided a lot of guidance to us in this area, as every 12 time the Commission moves on a case by case basis, and when we talk about 13 risk and other issues that underpin, that underpin our transformational efforts 14 it's been very helpful.

15 And the reason that I -- we see as change, and what we've 16 been communicating to the staff at the executive level is that healthy 17 organizations reset the way they do work. They make sure that they are 18 evolving to take advantage of how to work smarter, because every 19 organization meets its mission better when it is working smarter. It uses its 20 resources better, for example.

21 In addition, we make sure that everything that you're doing 22 is leading toward meeting that mission. And this is why we're so focused on 23

9 making sure that we are focused on the most safety-significant issues. It is 1

urgent at this point that we do this because our staff is getting smaller. And 2

we will face that bubble that every other agency in the Government is facing 3

with some urgency.

4 In two to five years over 50 percent of our staff will be eligible 5

to retire. That will be a huge movement in some way. And it might be over 6

a decade, but at any rate it will happen. This transformation must happen 7

with staff. And we have to be able to tell our staff how to focus on the most 8

safety-significant issues, because if they have fewer resources and fewer 9

people they need really -- they need better tools. And so, this is our 10 opportunity to set what we're doing now so that we will be really good at it in 11 the future. So this, this is very urgent, as I see it.

12 And it also, we need to create a culture of innovation 13 because that's what the staff is looking for now, and that's what the staff will 14 be looking for in the future. This is where we haven't kept up with the pace 15 of change.

16 So, now let me turn to you. Let me introduce the speakers 17 and tell you a little bit about what they're going to do.

18 So, all of these speakers will talk about the activities in the 19 Agency that directly feed into the four focus areas and seven initiatives that 20 we have identified as necessary for us to align the Agency. You're going to 21 see -- and I'm also going to put a little, at the end, I'll do more of this -- but 22 we're going to have an expert that's coming up that's also going to have a 23

10 number of initiatives that we're doing.

1 We're doing a lot of different things. And so now is a good 2

time for us to get together and really align the Agency on what we believe are 3

those things that are going to really need to be done. And Greg's going to 4

talk about that.

5 So, we have Greg Bowman, Deputy Director, Division of 6

Risk Assessment, Office of Nuclear Reactor Regulation. He's advisor to the 7

Futures Core Team, advisors to the Futures Core Team director. And he'll 8

provide an overview of how we continue to prepare for the future with our most 9

recent efforts of Futures Jam and Futures Core Team.

10 And this slide shows, shows the different people that will be 11 speaking. I know it's small, so I'm going to go over it.

12 Jennifer Golder, Deputy Director, Office of Chief Human 13 Capital Officer, and SES sponsor of the Career Enhancement Initiative, will 14 describe how we will be describing opportunities for employees to re-skill, 15 broaden, and develop through new experiences, how we will be supporting 16 staff and team agility, and how we are tracking and hiring the workforce of the 17 future.

18 John Lubinski, Director, Office of Nuclear Material Safety 19 and Safeguards, and SES co-sponsor of the Accepting Risk in Decision 20 Making Initiative, will discuss who we will develop a common understanding 21 of what it means to accept risk, how it connects to our transformation vision, 22 and how risk insight should be applied in work that each of us does, be it 23

11 corporate, corporate support, legal, or technical.

1 David Nelson, Chief Information Officer, will discuss how 2

adoption of technology services will enable all staff to easily and efficiently 3

complete their work, and how we plan to increase the use of new and existing 4

technology across the Agency. Dave has been on the Executive Steering 5

Committee. He's been, actually an innovator right from the minute he came 6

in. And he has had to do a lot of work because our systems were very 7

antiquated in many ways. But, in addition, he's been on the Executive 8

Steering Committee for the Futures Assessment, the Jam, and now for turning 9

out the transformation initiatives.

10 And Maureen Wylie, our Chief Financial Officer, will discuss 11 enhancements to the financial process, which are examples of innovation and 12 process simplifications happening organically at the office level. So, you'll 13 see what I mean when I say things are just happening in the offices as we 14 move to become more modern. She's also an executive sponsor on one of 15 our initiatives on signposts and markers.

16 Finally, Amy D'Agostino is a human performance analyst in 17 the Office of Nuclear Regulatory Research, and she's our lead on our 18 Innovation Initiative. And together with Jonathan Greives, Chief, Products 19 Branch for Division of Reactor Projects in Region I, will talk about our new, our 20 new process. We call it "innovateNRC 2.0." And it's how we're going to 21 create and sustain a culture of innovation.

22 So, with that, I'm going to turn it over to Greg.

23

12 MR. BOWMAN: Thank you, Margie. And thank you, 1

Chairman Svinicki and Commissioners, for providing me with the opportunity 2

to brief you today. This morning I'll be giving you an overview of how we 3

develop the transformation initiatives that we'll be using to enact the vision --

4 CHAIRMAN SVINICKI: Can you just move your 5

microphone a little closer. Thank you.

6 MR. BOWMAN: So, I'll be giving you an overview of how 7

we develop the transformation initiatives that we'll be using to enact the vision 8

that Margie discussed.

9 I'll start off with a discussion of the Futures Jam. I'll discuss 10 what we did with all the great feedback we heard from the staff. I'll give you 11 an overview of the approach we're taking to ensure we effectively implement 12 those initiatives. And then I'll turn it over to the other speakers to provide 13 some details on some of their initiatives.

14 Next slide, please.

15 So, it's been a few months since the Futures Jam, and I 16 thought there'd be some benefit to sort of refreshing everyone on what a Jam 17 is and how it was executed here at the NRC.

18 There are a lot of words on this slide. And as you can 19 probably already tell, I'm not a very good orator, so rather than going through 20 all these words with you, we'd like to show you a video.

21 This video was put together by Alysia Bone, who is sitting 22 behind me. And it will walk through how we planned and conducted the Jam 23

13 here at the NRC.

1 So, Doris, if you could role the video.

2 (Video played.)

3 VOICEOVER: -- journey, how planning for our future 4

became an agency-wide conversation.

5 The idea was to tap the collective wisdom of our staff on 6

how to make sure we're ready for the challenges of tomorrow. In the four 7

months between idea conception and implementation we learned how to jam.

8 We researched best practices from those who've jammed 9

before us, used the 2019 Futures Assessment Report as a basis for 10 conversation, and developed a plan to explain the idea and generate energy.

11 We also needed to help folks be comfortable with the idea 12 of sharing candidly, in a forum similar to Facebook. Training on the Microsoft 13 Yammer platform and how to encourage honest, open dialog were critical to 14 helping us get ready 15 To get the strategic thinking flowing, we brought four 16 scenarios of the Futures Assessment to lead staff towards this interactive 17 exhibit and envision the future.

18 We also produced a first-of-its-kind podcast series that 19 focused on the key takeaways of the report. We wanted our communications 20 tool to really feel as different and exciting as the Jam concept itself.

21 To symbolize how every has a voice in the Jam, we built a 22 mural together. With each NRC location tasked with designing circles in their 23

14 assigned colors to create a mosaic of the Jam logo, this activity showed the 1

importance of coming together as one agency to create something unique.

2 We pushed ourselves out of our comfort zone and built the wave of the future.

3 Inspiring the catch phrase for the Jam, "The future starts 4

now," were our future regulators. Our NRC kids did their part by posing for a 5

photo scavenger hunt with the intent of helping us all be even more invested 6

in preparing our agency for the world of 2030 and beyond.

7 They were pretty excited to see themselves in the future as 8

well.

9 On Tuesday, June 18th, our Jam kicked off. The 10 conversation started off with one simple question, and everyone in the Agency 11 had a chance to respond. In no time at all the discussion took off, generating 12 six subgroups. Conversations built on each other, and the discussion was 13 energizing, brave, and respectful.

14 Staff had the opportunity to post at any time to any comment 15 over the course of the 3-day Jam. And the Jam was facilitated by a team of 16 trained facilitators during work hours each day.

17 This was one of four groups that made up the Jam control 18 room. Also in the control room was the data analytics team in charge of 19 monitoring and evaluating conversations at real-time using the Power BI 20 application.

21 The themes team followed the dialog and noted the main 22 themes as the conversation was unfolding.

23

15 The communications team was in charge of providing 1

agency-wide updates twice a day.

2 The control room was abuzz with activity and excitement 3

throughout the three days. But every hour on the hour the room went quiet 4

for a 10-minute report from each of the four teams to keep everyone on the 5

same page. Every day more people joined the conversation.

6 During our research phase we learned that we could expect 7

about 30 percent of an engaged staff to participate in a Jam. For the NRC 8

Futures Jam we saw 73 percent staff participation, and around 30 percent of 9

the staff actively commented. These numbers, as well as the comments 10 throughout the 3-day conversation, underscored how committed our staff is to 11 the mission of our work and the future of our Agency.

12 (Video ends.)

13 MR. BOWMAN: You can go to the next slide.

14 Thanks, Doris and Alicia.

15 So, this slide, if you could pull it up, provides some 16 testimonials from some of our Jam participants. From a personal standpoint 17 I'm generally a skeptic, and to be completely honest, in the days leading up to 18 the Jam I was not expecting us to get very much out of it. However, I learned 19 very early in that my initial skepticism was way off.

20 Almost all the posts and conversations were positive and 21 constructive, and generally geared towards looking for ways to make the NRC 22 a better place to work. People's openness and willingness to share diverse 23

16 and differing views in a collaborative manner really impressed me. I think it 1

was a great demonstration of our values. And it honestly made me proud to 2

be an NRC employee.

3 The Jam proved very useful in providing insights into areas 4

we need to focus on. For example, Margie mentioned agency culture during 5

her opening remarks. We used live polling during the Jam to get feedback 6

on specific topics, culture being one of those topics. And I found the polls on 7

culture to be particularly insightful.

8 For example, we learned that 83 percent of the respondents 9

to one of the polls indicated that we need to change our culture in order for us 10 to be successful in transformation, with 93 percent indicating that they were 11 personally committed to helping shape our future together.

12 So, I think it's clear to me from those statistics that we have 13 a lot of work to do in the area of culture, but the commitment of our staff to our 14 vision and to making it a reality is really impressive to me, and it gives me 15 confidence that we will ultimately be successful.

16 My only complaint about the Jam, and I've heard this from 17 others, is I had a very hard time keeping up with it. If I left my desk to go to 18 a meeting or even to get a drink of water I would very quickly lose track, and 19 it took -- it was difficult to get back into it.

20 So, if we go to the next slide, I'll show you what we did to 21 help address that concern.

22 So, to make the Jam more useful and to help people like me 23

17 who are a little slower than average, staff from our Office of Nuclear 1

Regulatory Research developed what we're calling the Jam Dashboard. The 2

front page of the dashboard is shown on this slide.

3 The dashboard is a really powerful analytical tool that lets 4

you drill down into posts, into by -- you can search by office, by most liked 5

posts, by pretty much anything.

6 I realize it's a little hard to read on this slide. But, for 7

example, on the left side of this, of this slide there's a word cloud. You can 8

click on any of the words in the word cloud and drill down into the specific 9

comments on that, on the cloud. And you can act, interact with the rest of the 10 dashboard in a very similar manner.

11 So, a link to the dashboard was sent out agency-wide. And 12 we have a link to it on our SharePoint side, so it's readily accessible to all NRC 13 staff. In addition to using it for specific transformation initiatives, we've also 14 been able to leverage the Jam Dashboard for more routine work.

15 For example, OCIO was able to use the dashboard to go 16 back and identify and make quick fixes to things, to IT challenges that people 17 were jamming about during the Jam.

18 Next slide, please.

19 So, this was alluded to in the video, but behind the scenes 20 during the Jam we had staff feverishly working to analyze the feedback that 21 was coming in from the staff to turn that into action. We used the results of 22 that analysis, along with some other information like the Futures Assessment, 23

18 and the work that went into the Transformation SECY Paper to develop four 1

focus areas for transformation.

2 They include recruiting, developing, and retaining a strong 3

workforce; improving our decision making by accepting an appropriate level 4

of risk; making better use of technology, for example, by better enabling our 5

staff to adopt new and existing IT resources; and establishing a culture that 6

embraces innovation.

7 On the right side of this slide are the seven supporting 8

initiatives that we launched. Again, this was based in large part on the 9

feedback we got from the staff through the Jam.

10 We made a lot of great progress on a number of these 11 initiatives even before the Jam took place. Amy will be talking about work 12 that she and her team have done on innovation. And that had -- they'd done 13 a lot of great work before the Jam.

14 Similarly, the work we did on the Futures Assessment will 15 give us a great head start on the Signposts and Markers Initiative.

16 Next slide, please.

17 Overall, we feel it's critical that we leverage all the work 18 that's already been done by our offices here at the NRC to make the 19 transformation successful. In fact, the first step in the majority of the 20 initiatives is to do sort of like a baseline with all the offices, get feedback on 21 what's going on so we know where we're starting from.

22 For each of the seven initiatives we've established a team, 23

19 including an executive sponsor. The team members were selected from 1

across the Agency, and from all positions and grades, so we have a really 2

good cross-section of the staff represented.

3 Similarly, the majority of the NRC offices are represented in 4

the executive sponsor ranks. We have two regional executive sponsors, and 5

many corporate executives that are sponsors.

6 There's clearly, clearly a benefit to having such a diverse 7

team representing us. We'll hear a lot of differing views. But, also, those 8

staff will take back to their offices what they've learned through this initiative 9

and, hopefully, build our change capabilities throughout the Agency into the 10 future.

11 We've developed charters of concrete milestones and 12 deliverables for each of the initiatives. The teams are responsible for 13 developing meaningful performance measures so that we can make sure 14 we're holding ourselves accountable for accomplishing each initiative and that 15 it's achieving its desired result.

16 I mentioned earlier that the majority of the initiatives were 17 based on feedback from the staff. So, transparency with them on how we're 18 doing in addressing the initiatives is of critical importance. In the very near 19 term we plan on making available information broadly that they can, that they 20 can use to see how we're doing in implementing our transformation vision.

21 We expect to complete work on the first seven initiatives 22 within a year, with many of them being completed sooner than that. We've 23

20 identified additional initiatives that we're planning on kicking off in calendar 1

year 2020 as the first seven are completed. We've done some initial work 2

scoping those out, developing what they'll look like. But we have more work 3

to do before they're ready to be kicked off.

4 You can go to the next slide.

5 So, before I turn things over to the next presenter, I'd like to 6

take a minute to share some personal thoughts on transformation at the 7

internal. And I'll preface this by repeating something I said earlier.

8 I am generally a skeptic. So, when Steve West contacted 9

me about helping with transformation, I did what probably many of the NRC 10 staff in this room would do, and reacted with a lot of enthusiasm. Internally, 11 though, I had a lot of skepticism, well, skepticism.

12 But over the last few months I've had the opportunity to do 13 a lot of reflection on how what we're doing today would have influenced some 14 of the things I experienced at my career at the NRC, specifically, some of the 15 challenges.

16 The specific example that resonates with me the most is our 17 work on our actions in response to the Fukushima Daiichi accident. I had the 18 privilege of working on that project for about six years. And throughout that 19 entire period I worked with some of the most hard-working, competent staff 20 we have here at the Agency. These are staff that know how to solve 21 problems, that have a dedication to the mission of the Agency, and are willing 22 to do whatever it takes to help us accomplish that mission.

23

21 But time and time again we found ourselves struggling with 1

one obstacle after the next trying to get done what we needed to do to 2

accomplish our mission. The reasons for the struggles varied. Sometimes 3

it was because our approach was a little different than how we'd always done 4

business. Sometimes it was because our processes were overly 5

cumbersome.

6 Sometimes it was because we were asking our staff to take 7

a little more risk than they were accustomed to. And sometimes it was 8

because people felt such a strong personal investment in the project that 9

change was very difficult for them. More often than not, it was a combination 10 of those things.

11 So, I was a first line supervisor for the majority of those six 12 years. And I can't tell you how difficult it was to come into work every day 13 and watch my staff encountering one roadblock after the next, being worn 14 down, all the while being worn down myself. It was really very, very 15 challenging to keep the staff engaged and keep myself engaged.

16 So, I think about the initiatives on the previous slide. And 17 every single one of them if -- well, not, maybe not every single one of them, 18 but the majority of them, if they had been implemented effectively back then, 19 would have helped us get past those struggles more efficiently and effectively, 20 without the risk of disenfranchising our staff.

21 So, for that reason, while I was initially skeptical, I truly 22 believe that now is the time for us to change.

23

22 So, in closing, I view this as our opportunity to make the 1

Agency better for future generations and nuclear regulators. I want them to 2

work in a place where they can make a real difference and feel empowered to 3

help us identify ways we can make the Agency operate better.

4 So, I take our collective responsibility to make this vision a 5

reality very seriously. And I'm looking forward to seeing the change and then 6

living the change.

7 Thank you. Turn it over to Jennifer.

8 MS. GOLDER: Thank you, Greg.

9 Good morning, Chairman Svinicki and Commissioners. As 10 Margie mentioned, I'm co-sponsoring the Career Enhancement Initiative with 11 Dave Lew. And Dafna Silberfeld from OCHCO, and Colleen Todd from 12 Region I are co-leading the team. We have a great team with diversity from 13 throughout the Agency.

14 I'm happy to be here today to talk to you about our human 15 capital Transformation and Innovation Initiatives that support the heart of our 16 Agency, our people. And the NRC has a dynamic environment, and our 17 workforce needs to prepare to perform as modern, risk-informed regulators to 18 help meet our important safety and security mission.

19 This involves providing opportunities for our employees to 20 re-skill, broaden, and develop through new experiences; streamlining and 21 creating flexibility in our processes; supporting staff and team agility; and 22 feeding the pipeline of future talent.

23

23 And we last briefed you in June about the investments we 1

are making to evolve and bolster our human capital program to meet the 2

changing needs of the NRC, including enhancing our strategic workforce 3

planning efforts, and developing and implementing the Competency Modeling 4

Initiative. This summer's Jam highlighted the importance these programs 5

play in strengthening our workforce and creating opportunities to address and 6

change employee concerns and perceptions.

7 And today I will share insights from the Jam and highlight a 8

few new human capital initiatives under way that are purposefully designed to 9

help our current employees grow, as well as transform how we attract and 10 recruit new employees for the future.

11 Next slide, please.

12 The care and feeding of our current and future staff were 13 prevalent themes from this summer's Jam. And several sub-themes 14 emerged, including workforce planning, career advancement, training and 15 development, and recruitment. And these are just some of the quotes from 16 the Jam impressions from our employees.

17 Overall, our employees want to add and feel valued as they 18 support our mission.

19 They want to enhance or learn new skills, gain new 20 experiences, and have opportunities to contribute, grow, and succeed in their 21 journeys.

22 And our employees also understand that we need to feed 23

24 the pipeline for our future.

1 And through the Jam it became clear that while these 2

initiatives have and will continue to strengthen our Agency, it was also made 3

evident that employees don't understand how they all fit together, how -- what 4

they all mean, and how to use all the resources and tools to advance their 5

careers while becoming modern, risk-informed regulators.

6 Next slide, please.

7 The Career Enhancement Team Initiative -- the Career 8

Enhancement Initiative Team will be focused on explaining how all the human 9

capital programs, resources, and tool fit together, and how employees can 10 leverage these tools to enrich their own careers and their own journeys.

11 The word cloud on this slide is not the same dynamic one 12 that Greg talked about, but it does represent the rich array of tools and 13 resources that are or will be available for our current and future workforce.

14 And our employees at every level can develop, grow, and 15 expand in their journeys by taking advantage of these opportunities, including 16 self-assessments through the Competence Modeling Initiative, and pursuing 17 both technical training and training on softer skills, to name just a few. And 18 Margie and Greg already mentioned culture. And Patrice is leading that 19 effort, one of those initiatives.

20 And this year we developed a new seminar that examines 21 the values, behaviors, and practices that promote and maintain a positive 22 organizational culture. And this course enables our employees to share with 23

25 each other as they explore and gain a deeper understanding of aspirational 1

organizational cultures through the lens of our leadership model, which can 2

serve as a guidepost for navigating change, which is especially important, 3

given the many changes taking place in this Agency all at once, which can 4

result in feelings of discomfort, confusion, or even frustration among staff.

5 Next slide, please.

6 A new initiative we're piloting is a skills marketplace, which 7

is being led by a small group within the SES career development program.

8 Greg is on that group. The concept is to improve workforce agility and 9

productivity by enabling the NRC to meet time-sensitive work and resources 10 needs, and to better utilize people's talents through short-term projects that 11 employees can work on part time while continuing in their current roles.

12 This will enable us to quickly create integrated teams to shift 13 to support new or emerging work.

14 And the team conducted benchmarking to leverage best 15 practices with other organizations, and chose the OPM Open Opportunities 16 platform for the pilot that we're conducting. And six projects were advertised, 17 including developing a Nucleapedia site, to coordinating training across 18 regions, to supporting the Agency's Innovation Forum. And selections have 19 been made from the people that expressed interest, and work is under way.

20 And an example of how this works will be given shortly by 21 Amy and John. And this tool can be used as one potential feeder for 22 innovative ideas, and it could also be considered for rotational and 23

26 developmental opportunities for our mid-career staff, and to address 1

unanticipated workload.

2 And going forward, the team is going to assess the program, 3

and will develop recommendations on platform use, process changes, 4

training, and marketing to make it a key tool on how the NRC accomplishes 5

work in an innovative and agile way while supporting employee development.

6 Another developmental opportunity is the Skills-based 7

Mentoring Program. And that, we are piloting that right now in NMSS. And 8

that connects experienced employees or experts to learners who are 9

interested in developing specific competencies within a short time frame.

10 And we envision that learners will be able to improve job performance, 11 increase creative thought, gain new perspective, and increase their networks.

12 The pilot will also be assessed, and recommendations will 13 be developed for broader Agency use moving forward.

14 And before I talk about innovations and recruiting, I want to 15 update you on our Competence Modeling Initiative which we've briefed you 16 on in the past. And that is a tool that can help staff improve their job skills 17 and help prepare them to move into different positions to address workload 18 shifts. And so far we've developed over 70 models for seven offices and the 19 regions. And there are currently over 1,400 users with access to our self-20 directed learning engine. And they can take assessment in that tool.

21 And we're continuing to develop more models in conjunction 22 with the enhanced strategic workforce planning process, as well as 23

27 encouraging staff and supervisors to complete assessment.

1 Next slide, please.

2 As Jason Shay mentioned in June at the human capital 3

Commission briefing, we're planning for a new entry level development 4

program called the Nuclear Regulator Apprenticeship Network, or NRAN as 5

we often refer to it. That will be launching in the end of this June. And 6

program specifics are in development now. And we're actively working on 7

selecting the participants.

8 And to support this, we updated and streamlined the 9

recruitment process. We refreshed our marketing materials, which were 10 outdated. And we made use of the new materials during this recruitment 11 season, which occurred during September and October and just wrapped up.

12 And we had over 40 NRC recruiters, plus H.R. specialists, attending career 13 fairs. They held information sessions and met with grant recipients and 14 faculty at over 20 schools.

15 And we will have our recruitment campaign materials on 16 display at the Innovation Expo tomorrow for all to see, along with some other 17 human capital initiatives that we're very proud of.

18 And to fill the program, we're focusing on nine competitive 19 placement authorities, such as grant recipients, our co-ops who are 20 graduating, veterans, and students with disabilities. And we created a team 21 of managers from across the Agency to conduct interviews, and are making 22 selections utilizing insights gained from our strategic workforce planning 23

28 process.

1 And through use of these teams -- we're calling them tiger 2

teams -- we're able to extend offers four to five months earlier than in prior 3

years. And we expect all offers will be made within the next few weeks. And 4

doing so ensures that we are able to recruit top talent in this very competitive 5

market.

6 We'll be leveraging affinity groups to engage selectees in 7

activities before they come on board. And we plan to host an invitational 8

event during the Regulatory Information Conference in March to introduce 9

them to the NRC and strengthen their connection before they start in June.

10 We're also using the same approach to accelerate our 11 summer student selections. We're planning to begin to extend offers by the 12 end of November, again, many months ahead of prior years. And we expect 13 to have a robust summer program. We've received over 500 applications for 14 our summer students. And we're expecting to bring on between 75 to 90 15 interns. And that also includes the summer interns that are coming back from 16 last summer.

17 And, additionally, we have expanded use of direct hire 18 authorities, which can help us more quickly address critical workforce gaps, 19 particularly at the mid-career level.

20 And, in sum, all of these efforts will support our employees 21 in their journeys and will help feed the pipeline of future risk-informed 22 regulators.

23

29 And with that, I'll turn it over to John.

1 MR. LUBINSKI: Thank you, Jennifer.

2 Good morning, Chairman, Commissioners. Very happy to 3

be here this morning to talk about accepting risk in decision making. I am 4

one of the co-sponsors, along with Darrell Roberts and Ben Ficks. We benefit 5

very much from having a diverse team from the standpoint of someone from 6

a program office, someone from a region, and someone representing the 7

corporate side.

8 We're also very fortunate to have such a strong team, which 9

is led by Mirela Gavrilas out of NRR.

10 From our standpoint, we look at us as co-sponsors as 11 helping to guide the team. The team is put together, they're doing the work, 12 they're actually owning the initiative. And we're very happy to see that they've 13 kicked off to such a great start.

14 If I can go to slide 2.

15 I really loved seeing the participation during the Jam in June.

16 During the Jam we have a topic on risk informing, and that was led by Ho Nieh 17 doing a chat on that. We received a lot of great insights. And the team is 18 looking at those insights while developing the charter for our group, as well as 19 the activities we will perform under this effort.

20 We could have included so many great quotes on this slide, 21 but we, for space, we've only included two. And these two very much 22 resonated with me.

23

30 When we consider -- we do consider risk, either consciously 1

or subconsciously, every day in every decision we make. These decisions 2

include whether to cross the street against the light because you're running 3

late for a meeting, whether to approve a license amendment for a plant design 4

change, or whether you're on vacation and deciding whether you want to go 5

parasail or not. We think about and evaluate the probability and 6

consequence of each of these decisions.

7 As Michele notes in her quote, the crux of our decision is 8

how much risk are we accepting. Many times we reach different decisions 9

based on our acceptance, our tolerance, or our appetite for risk. This is a key 10 area where our group is focusing.

11 As noted by Susan, risk acceptance is broader than our 12 safety decision. Risk is considered and accepted in policy, resource, 13 corporate, and legal decisions every day.

14 Some notes during the Jam that we have many great 15 methods and tools for considering risk. Some folks are becoming confused 16 by so many initiatives and not understanding their relationship. We, as a 17 team, need to capture these initiatives and efforts under an umbrella definition, 18 and have a roadmap that ties in together for the staff.

19 Next slide, please.

20 The next three slides describe our charter in the form of a 21 strategy on a page. As I noted, we all consider and accept risk. However, 22 we believe that varied, different, and inconsistent all describe our current state 23

31 of use and acceptance of risk.

1 For instance, we have successfully used enterprise risk 2

management, or ERM, over the past two years in addressing a full spectrum 3

of risk across a variety of programs. In the corporate area, for instance, we've 4

applied this to our efforts to increase transparency and accuracy around our 5

fee revenue activities, and in maintaining IT service quality during transition to 6

a new contract.

7 We are still in the developmental stages in our efforts to 8

further risk inform our reactor licensing and oversight activities. There are a 9

number of initiatives under way, including risk-informed changes to the ROP 10 process, as outlined in the ROP Enhancement Paper, and a new low safety 11 significant issue resolution process that is under development in NRR with 12 senior sponsorship from Region III.

13 Similar efforts are occurring in the nuclear materials arena, 14 including developing smarter licensing and inspection programs for fuel 15 facilities.

16 While none of the current applications of risk are wrong, or 17 one is not necessarily better than the other, we do have different and unique 18 tools. Also, we have different levels of acceptance or tolerance for risk.

19 These differences can lead to misunderstanding and ineffective or inefficient 20 application and acceptance of risk.

21 Next slide.

22 So, what is our desired outcome? It is that everyone is 23

32 aligned with being a modern, risk-informed regulator, that we all have a 1

common understanding of risk and acceptance of risk, and that everyone 2

accepts risk in every decision every day.

3 Next slide.

4 So, how do we get there? We are not reinventing the 5

wheel. We will develop common language using existing information, 6

guidance, and policies as the starting point. We will identify all the 7

communications, tools, and initiatives we currently have, current barriers to 8

the acceptance of risk, any gaps in guidance and tools, and best practices, 9

both internal and external.

10 Finally, we will develop a roadmap that highlights the 11 connection between all of our efforts, and we will link this information together 12 for ease of understanding and use.

13 Next slide.

14 As I said, we are not reinventing the wheel. Organizations 15 have been successful at transformations in the past -- organizations that have 16 been successful at transformation in the past have freed up resources to be 17 used in these important areas, with the National Transportation Safety Board 18 and the Department of Veteran Affairs who shared their experiences with the 19 entire senior management team here at headquarters last week being great 20 examples.

21 This is a graphic from the Committee of Sponsoring 22 Organizations of the Treadway Commission. As you can see, the words and 23

33 comments are the same developing similar to what we are doing here at the 1

NRC, particularly as it relates to NRC's enterprise risk management, or ERM.

2 OMB required agencies to implement ERM starting in 2017. At NRC, we 3

leveraged the quarterly performance review process to discuss agency-wide 4

risk holistically to identify, characterize, and control the risk. We will evaluate 5

this information and developing and improving our own tools.

6 Next slide, please.

7 The risk triplet resonates with us as a team. It asks what 8

can happen, how likely is it, and what are the consequences? It's plain 9

language and is used in all types of decision making.

10 Overlaid is the question: Given my options and the risk 11 associated with each, how much risk am I willing to accept?

12 Next slide.

13 On the topic of accepting risk, which is part of our initiative's 14 title, it's important to note that accepting risk means that we are strengthening, 15 not weakening, our oversight. It means that we are focusing our resources 16 on the most important issues to our safety and security mission, and applying 17 fewer resources to the less important ones as we continue to risk inform our 18 programs and ourselves.

19 Next slide.

20 As one example of how we are moving forward, the staff is 21 currently performing an assessment to identify opportunities to enhance the 22 rulemaking process. So far, we have conducted benchmarking of four 23

34 agencies, and have interviewed 15 internal stakeholders.

1 We are taking a hard look at why we do our activities the 2

way we've been doing them. We are assessing the risk or consequences to 3

NRC changing, then considering whether we could accept that risk or put in 4

place controls to manage or mitigate those risks. While we are continuing 5

our assessment we are already implementing process changes.

6 With regards to regulatory bases, we are already 7

implementing changes. The staff has historically developed a draft and final 8

reg basis before developing a proposed rule. For rulemakings that involve 9

development of a regulatory basis, the staff will issue a regulatory basis 10 document for public comment. And instead of issuing a draft for public 11 comment and then a final, the development of the final reg basis was 12 somewhat duplicative to the development of the proposed rule.

13 This change is expected to save at least three months of 14 overall rulemaking schedule, and the staff will continue to benefit from the 15 comments it receives on the reg basis which will be considered in the 16 proposed rule.

17 For some straightforward rulemakings, such as some direct 18 final rules, the staff will now recommend to the Commission that no regulatory 19 basis be developed.

20 The concurrence process also presents opportunities to 21 achieve efficiencies with the acceptance of some modest risk. Some ideas 22 that are being explored are streamlining the process by having concurrence 23

35 alignment meetings which would facilitate getting multiple concurrences from 1

the right managers in an efficient way, and paperless concurrence, which 2

we're already in the process of piloting.

3 Early in the rulemaking process the staff is developing a 4

rigorous regulatory analysis that is risk-informed.

5 Thanks to the regulatory analysis, the staff has identified 6

several rules that may not be justified and have been recommended for 7

discontinuation early in the process. The staff also looks into less costly ways 8

on achieving the desired outcome.

9 For example, the staff recently submitted two papers to the 10 Commission recommending discontinuation of the independent spent fuel 11 storage installation security requirements, and enhanced security of special 12 materials rulemakings. The staff's rationale for these rulemakings is similar 13 to what was presented for discontinuation of the access authorization and 14 fitness for duty determinations rulemakings, which was discontinued in August 15 of 2019.

16 There are a few areas -- these are a few areas where we 17 have moved forward. And as this initiative further takes hold, we will identify 18 others.

19 This concludes my remarks. And I will now turn the 20 presentation to Dave Nelson.

21 MR. NELSON: Thank you, John. Good morning, 22 Chairman Svinicki and Commissioners. As the agency's Chief Information 23

36 Technology and Data Tools and Governance Officer, I am -- and a member of 1

the executive steering committee on all the transformation, I am pleased to be 2

here this morning to talk to you about how IT modernization and leveraging 3

our data will support the transformation efforts of the Agency. Next slide, 4

please.

5 The Jam also exceeded my expectations as well. As a 6

strategic partner to our offices and as a service organization as well, I felt we 7

were close enough to staff to really understand the demand for the intuitive 8

technology to support collaboration and new ways of working. Some of the 9

planning and design for these tools was already underway and -- but it was 10 exhilarating to lead the actual conversation around technology and to hear all 11 the candid reviews and detailed information about how those experiences 12 were occurring out in our organization.

13 The feedback did help us prioritize some of the work that 14 we're doing and the capabilities and services that we plan to launch to support 15 the agency. But it also, as Greg mentioned, helped us resolve some of the 16 technical and process barriers that were already identified and were out there 17

-- and easily addressed, once we really have the detail information about 18 them.

19 One of the emerging themes that came out of the Jam was 20 the need for support in technology adoption and how we would really drive the 21 adoption of the tools that we have today, and the tools of the future. From 22 that, one of the initiatives led by Rob Lewis as the executive sponsor, and Bob 23

37 Randall and my organization are helping to put the team together to really 1

address that particular initiative. Next slide, please.

2 So I am here today to -- over the course of this presentation, 3

I would like to provide a few examples of how technology helps us work 4

smarter and how it will help us develop the twenty-first century knowledge 5

workers that the Agency needs for transformation. I am also going to talk a 6

bit about data analytics and how it will improve our decision making and 7

opportunities to enable process simplification. Next slide, please.

8 To support transformation and our safety mission, OCIO has 9

six priorities that are part of our IT/IM Strategic Plan. Leading those are 10 customer experience, really improving the customer experience. Designing 11 our products and platforms around how they're to be used and how we can 12 actually put those in place to be the most productive for our employees. Also, 13 IT and network modernization, cyber security and always improving our cyber 14 security posture and making sure that we're prepared for the adversaries as 15 their improving their skills as well. Data analytics to promote data-driven 16 decisions. Business process simplification and modernization of end-user 17 tools and systems. Those are our six priorities. Next slide, please.

18 So I would now like to talk to you and provide several 19 examples of some of the IT modernization efforts. The first, the NRC actually 20 relies on a tremendous amount of legacy documents to support regulatory 21 missions. The nuclear documents system actually includes 42 million images 22 on microfiche and paper that we are now currently in the process of digitizing 23

38 for our regulators. Those are inclusive of safety analysis reports, technical 1

specifications, environmental reports and a number of other types of 2

documents that help us with our decision making.

3 We're leveraging advanced tools such as computer 4

visioning, machine learning, digital scanning and extracting and organizing 5

and loading that information into the Agency's record repository. It is now --

6 we have hundreds of thousands of records that are now available for our 7

regulators to actually access electronically through search. Next I'd like --

8 one of the emerging themes that also came out of the Jam was the staff 9

interest in technology to support collaboration and productive work activities.

10 Since the Jam, we have upgraded that Agency's network to support secure 11 wireless throughout the campus. We are currently in the process of testing a 12 pilot on two floors in one of the headquarter campus buildings. And soon 13 we'll be rolling out the wifi capabilities in allowing our employees to work in a 14 much more mobile way across all of the campuses, including the regions.

15 Another theme was the conference rooms -- we've heard 16 from staff throughout the Jam, and even before the Jam, that new tools were 17 needed to support collaboration with external and internal stakeholders that 18 were working together in these collaborative spaces. We're currently testing 19 and have plans for rolling out in a very aggressive manner new technology 20 that will allow a very simple connection to Skype in our productivity tools in the 21 conference rooms. And it will be intuitive and easy to use and standard 22 across -- again, across all of the campuses of NRC.

23

39 And then most importantly, the visualization techniques and 1

technologies, updated analytics, help us disclose perspectives that haven't 2

been available in the past, and extract new insights to support our decision 3

making.

4 I'd like to give you three examples of some of the data 5

analytics work that's being done within the agency. First, in 2016, one group 6

in NRR, the Plant Operating Experience Group, introduced a test and analysis, 7

OpE Data Analysis Tool that was developed to crawl through information both 8

internally and externally and make that available data displayed in easy 9

interpretations to help our oversight program really make risk-based 10 decisions.

11 Secondly, earlier this month OCHCO launched a portal 12 which actually provides a clear lens into data that supports the agency's 13 succession planning and critical gap analysis. This will allow us to make 14 preemptive decisions versus reactive decisions in the area of strategic 15 workforce planning. It's an exciting tool that is being piloted in several of the 16 offices now, but has generated a lot of excitement through the managers that 17 have actually been able to see this and drive insights.

18 And then finally I'd like to talk to you about our mission 19 application portal, which provides accessible data to support NRC workload 20 planning and analysis, budget estimation and execution. This was kicked off 21 with the Office of 18F, which is part of the General Services Administration.

22 If you recall, one of the speakers in the March Transformation public meeting 23

40 was Bethany Blakey, also from GSA. The GSA is currently helping and 1

partnering with agencies to deliver digital services and designers, engineers, 2

product managers and strategists to help with twenty-first century techniques 3

for development.

4 Throughout this kickoff they helped us with a discovery 5

session and then helped us through a whole acquisition process to bring on a 6

new type of designer and developer that will work with new twenty-first century 7

concepts such as human-centered design and agile development techniques.

8 But while these requirements in the -- were being assembled through 9

discovery, an innovative team within OCIO and within NRR went through a 10 process to see how they could develop, using these techniques, a dashboard 11 for seeing how things were progressing at Vogtle's 3 and 4 units. We'd like 12 to demo a working prototype a working prototype of that dashboard today with 13 real-time licensing program insights. Taylor Lamb will be demo-ing this for 14 us. She's from NRR and she's been instrumental in guiding this team through 15 prioritizing user needs to optimize value through dozens of iterations. So, 16 Taylor, if you could --

17 MS. LAMB: Okay, thank you, Dave. Good morning 18 Chairman Svinicki and Commissioners. I am really excited to be here today 19 to show you this dashboard because this really a true transformational effort 20 that we have at the agency. As Dave said, I've been working with a team in 21 OCIO to develop a dashboard as a one-stop shop for Vogtle construction 22 activities.

23

41 If you could pull that slide back up that was on there before.

1 So, back in July Ho Nieh ended up presenting this image to us as an idea for 2

the first step of the dashboard. And this project actually falls within Embark -

3

- which, I can see Commissioner Caputo, you're wearing an Embark pin over 4

there, so, hooray.

5 (Laughter.)

6 MS. LAMB: So the keys to this dashboard -- we really 7

wanted to present the key areas of success, which are ITAAC, licensing and 8

inspection. So what we really wanted was to have a simple, clearer and 9

easily accessible tool for the staff to go to see the entire project's status. And 10 display that information to a variety of stakeholders. So -I'm going to go into 11 a demo.

12 (Pause.)

13 MS. LAMB: And if you could share this screen, that would 14 be great. Here we go. All right. So this is the dashboard that was 15 developed from that image that you just saw. So this will be used to develop 16 reports, streamline executive briefings and it will inform decision making.

17 So, as you can see on the dashboard, the information on 18 the three key areas for success -- ITAAC, licensing, and inspection -- are 19 displayed there as well as information on public meetings, Vogtle construction 20 news, and some of the top focus areas for risks for this project. But for the 21 purposes of this demonstration, I'd like to discuss all direct inspection hours, 22 which are right under the cursor over here.

23

42 So, traditionally, we would manually gather that data and it 1

would take weeks to put this together for the annual Commission reactor 2

oversight process self-assessment that we would send up to you. But now, 3

this information is fully automated. So it updates on a daily basis. You can 4

go to this at any point and see what the current status is. And it actually 5

includes a projection based on current resources expended. So with that, if 6

you're also interested in just seeing the information for one unit, you can just 7

click in the top left over here. And now you can see the information for Vogtle 8

Unit 3 which is number one in line. Go back. So I am proud to share that 9

this was actually accomplished in just under ten weeks using solely internal 10 resources. So I thank the OCIO team for diligently working on this effort.

11 Thank you, guys.

12 And so in the coming months we will be working on 13 enhanced functionality to make it more predictive, to highlight if we're on target 14 with our planned burn-off for ITAAC and inspections and ITAAC closure 15 notifications. And it will also be accessible via mobile devices, which you can 16 see here. So, have it on the phone. And I look forward to continuing to work 17 with the OCIO and MAP teams on this project. So, back to you, Dave.

18 MR. NELSON: Taylor, that was great. Thank you. That 19 last iteration on the phone was just done yesterday, by the way, so --

20 (Laughter.)

21 MR. NELSON: All right, next slide please. I would like to 22 say a few words about the future as well. I think it's important that OCIO and 23

43 our partner offices continue to search for innovative ways to implement and 1

support future efforts. The fast paced advances require NRC to keep abreast 2

of all these latest tools and methodologies that are being applied throughout 3

our industry and other industries. So we can really understand how they can 4

be used within our work and regulatory work.

5 Earlier this year, the Nuclear Regulatory Research Office 6

and all the partner offices developed a plan which positions us to better 7

understand and evaluate -- and take advantage of some of these advanced 8

tools, such as artificial intelligence. There's several tactical activities that are 9

proposed and are being implemented within that plan over the next three years 10 to truly understand and take advantage of these new tools and our regulatory 11 activities. Next slide, final slide, please.

12 Okay, so how do we marry these disparate activities and 13 focus on transformation? Again, I'd like to bring it back to those priorities 14 within my office, which is to support and to really push forward the customer 15 experience and understand how the products are being used -- make sure 16 that our networks and our IT infrastructure have been modernized and are 17 ready to support these tools as well. Cyber security and protecting our data, 18 data analytics to promote data-driven decisions, business process 19 simplification, working with all of our offices in automate those processes and 20 modernizing our end-user tools and systems for the twenty-first century 21 workers. So with that, I'd like to turn it over to Maureen. Thank you.

22 MS. WYLIE: Thank you very much, Dave. Chairman 23

44 Svinicki, Commissioners -- I really appreciate the chance to talk to you about 1

the innovation and change that we've seen within the budget and financial 2

management communities over the last several years. The changes that I 3

am going to talk to you about today extend into the work lives of every 4

employee in the agency and will serve as the baseline for transformational 5

change. It will allow scaling of projects, like the mission analytics portal or 6

dashboards like the Vogtle dashboard, across our program offices because 7

they'll be consistent and available financial management data for every part 8

of our business.

9 That's been possible in large part due to the wonderful 10 people in the Office of the Chief Financial Officer, and our partner offices like 11 OCIO, NRR, NMSS and the other offices. So it's really been a combined 12 effort because, as you'll see on the next slide -- go to that slide, please -- it's 13 not a single financial system. It's actually a system of systems and it's 14 extremely complex. Or, it can hurt your brain if you're not careful. It's very 15 complicated. But these systems are the bones of our processes. And the 16 data that these systems and processes produce -- there's an analogy to the 17 blood in our bloodstream.

18 From my perspective, FAIMIS, which if our financial 19 management -- our core financial system, is the beating heart of that system.

20 All of these systems are necessary for every part of our daily business. And 21 part of the complexity is that we as an agency do not control either all of the 22 requirements for the systems, or many of the systems themselves.

23

45 So, going to the chart again, for example, those cans that 1

are in red -- this is an architecture diagram of the system of systems -- are all 2

owned by the Department of Treasury or by GSA. These are systems that I 3

must use, I must be able to interface to for basic things like financial reporting 4

or acquisitions, as an example. So even though we have STAQS, the grey 5

can, we still have to go through SAM and IPP in order to execute those 6

activities.

7 So these systems are designed to facilitate our internal 8

activity and to interface with the outside world. It also requires that the blue 9

cans, which are those that are owned by my organization, interface with 10 systems that are owned by other federal agencies. OCHCO gets their data 11 and some of their process activities from FPSS -- and all of these acronyms 12 are in your glossary at the end. The New Talent Management System comes 13 from OPM. It provides us with critical data. The Reactor Program System, 14 or its new incarnation, Replacement -- RPS, needs a new name in my opinion 15

-- is one of those integral processes to provide management information, but 16 also provides information to me about cost that then is made available to our 17 licensees. WBL, GL -- those things are necessary for interaction with our 18 materials licensees. And then you all love GSA's travel system.

19 (Laughter.)

20 MS. WYLIE: I don't -- we don't get a choice about being 21 able to use that, but it also provides critical management information. We've 22 made a lot of changes in the last few years because changes to systems allow 23

46 you to re-engineer your processes, increase standardization and integration 1

of business processes. And then improve the controls around them because 2

at some point it's work, but eventually it becomes money. And then once 3

those two items are interrelated, you have to have strong controls around that.

4 As Mike Wetklow, the deputy chief financial officer at NSF, 5

pointed out at your last transformation meeting, financial management 6

systems in the federal government are based on requirements for auditability 7

and control as articulated in the Chief Financial Officer's Act of 1990. Across 8

the federal government and with GAO we're engaged in trying to modernize 9

that act. And as a part of that, we've recognized that data -- for data analytics 10

-- may be as important, or even in some cases more important than that 11 auditability control environment. Not getting all the traction we'd like from 12 some of our friends in the audit community. But across the federal 13 government, we know that managers and leaders need information that we 14 have available and our challenge is to get it out. So I've given you a tour of 15 our environment. I'd like to go back to the slide just for a moment to talk about 16 some of the changes we've made to FAIMIS.

17 FAIMIS is a Momentum product. It's a government-wide 18 software. It's owned by CGI. They've been our partner since 19 implementation in 2011. We have made substantial changes to the system 20 over the last several years. It's about five times faster than it was when we 21 implemented it in 2011. It's in a private cloud which gives us a great deal of 22 speed. It gives us efficiency. And it also gives us an opportunity to get 23

47 updates done faster and cheaper. The reason we have to do updates is 1

many times not for things that we want, but because the Department of 2

Treasury drives a lot of our requirements.

3 So as the Treasury modernizes its approach to financial 4

management, they pull us along. So particularly in the cost arena, we get 5

significant benefits there. It is the source of authoritative data. Even though 6

we have systems that have other parts of our financial processes, essentially, 7

if you ain't in FAIMIS, you ain't. Then it is the core of the reality of 8

implementation of spending money in the agency.

9 We have also gone into the shared service environment.

10 And we in fact have Department of Treasury employees operating in our 11 system. They're in the Administrative Resource Center in Parkersburg, West 12 Virginia. We were able to make almost 25-percent savings in how we 13 implemented those transactional processes by going there. We're their first 14 Momentum customer. And now that they've been designated the quality 15 service management organization for finance for the federal government, 16 they'll be taking on more Momentum customers and finding savings for other 17 federal agencies as well. Next slide, please.

18 So I'm really excited about the opportunity to talk about the 19 budget formulation system and to highlight some of the challenges that we've 20 had in that area as well. So OMB, as you might be aware, is bifurcated into 21 two areas. Management, which is where Financial Management 22 Procurement sits, and budget, which controls the budget execution process.

23

48 Our processes are governed by Appendix A, 1100-page sleeper about how 1

we would in fact do the detailed business of financial management in budget 2

arena.

3 The two segments do match, but OMB has different 4

requirements. BFS is an Oracle Financials product. It is the best system 5

available to do budget-type activities. It's based on an old Hyperion product 6

that Oracle bought and substantially improved. And we've used it to 7

centralize budget formulation as a part of the TABS initiative, integrate and 8

standardize how we actually do formulation in our business lines. It's been 9

flexible enough for us to adapt to use for the new data requirements in NEIMA.

10 And it is in fact the policy implementation of resources in our agency.

11 When you, as a Commission, make decisions, those 12 decisions are held within BFS. The most exciting and newest part of BFS is 13 the commitment planning module. This is the place where we're able to start 14 from financial -- from budget formulation, and yet do all the parts of budget 15 execution within a single system. Budget execution is very difficult to 16 automate because it's done differently in almost every federal agency because 17 it's driven by organizations and allowance holders. So for the first time, we'll 18 have not only the contract execution data and spend plan, which you can see 19 on the chart, but we'll also have that planning by allowance holders -- will allow 20 us to do acquisition planning and to forecast through the fiscal year what we'll 21 actually need and when we'll actually be able to obligate it.

22 So for the first time, instead of just being able to tell you, well 23

49 this is what we've spent to date, we'll be able to give you a fuller picture 1

because we'll be able to say, here's what we've spent to date, here's our plan 2

for what we need spent throughout the end of the year, and the added benefit 3

is that Dave gets to have full control over how we handle IT spending as well.

4 We also do support to our friends in OCHCO in the staffing 5

module. That's the management of funded positions. We're getting ready 6

to field that across the agency. And that will be very helpful to managers who 7

actually have to do that staffing plan management year over year. So if you 8

go to the next slide, these systems allow you to have little dashboards or 9

infolets. These are items that allow you to see if you're a contracting officer's 10 representative, or if you're an executive trying to manage your staffing plan.

11 It's going to allow you to see very quickly in a one-stop shopping way where 12 you are and where you need to go. Next slide.

13 So now to my favorite part. When we talk about fees 14 transformation, there is often a focus on the sort of surface things -- and I am 15 going to show you some of those things. But the big changes that we've 16 made around fees transformation have really been in the systems that govern 17 our work and govern time and attendance. Inherent to the Part 170 billing 18 process is the ability to have transparency for licensees so they will know what 19 they're paying for and how much of it that we've actually charged them for.

20 We had to create sources for authoritative data outside of RPS because as 21 RPS was evolving, some of those data elements were being left behind.

22 And our previous process had significant deficiencies in 23

50 terms of how those elements were concerned. How dockets were made -- a 1

nice lady with a book would write down your new docket if a new docket was 2

required. So not even basically automated. We didn't have any way to 3

control those items. Now Dave has a system, EDMS. That controls that for 4

all users of dockets. So, nice to have, not in a book. Easier to see.

5 It used to be that we would have technical activity cods, 6

TACs, in RPS and that's how work was being assigned. We had 15,000 of 7

those. Anybody could make one and that's sort of the antithesis of a control 8

environment from financial management. So now we have tightly controlled 9

cost activity codes that my staff is accountable for, and that we centrally 10 control through the cost activity codes system, or CACS. Those things lead 11 into HRMS, where people do their time.

12 Well, it's still more complicated than it needs to be. We 13 heard loud and clear from inspectors during the Jam that they have some of 14 the most complex time cards ever invented because we currently collect both 15 procedure, as a Enterprise Project Code, or an EPID, and activity. So if 16 you're walking through a plant and you touch on 12 procedures and five 17 chapters, you've got 190 CACS that you need to be accountable for. So we 18 are working very expeditiously with our partners in NRR and other parts of the 19 agency to try to get a hold of that coding. What's the magic minimum that 20 allows us to have transparency to licensees, management information and 21 break to those folks? But the EPID is a powerful data element that we have 22 yet to fully exploit.

23

51 It started when our folks in the Research Office said I need 1

a better way to track projects -- thank you, ma'am. Where we recognized that 2

we needed to have a code that would have some more flexibility than those 3

just for financial management. I don't have to control them so tightly. But as 4

we've implemented those codes using CACS over the last couple of years, 5

Dave and I have determined that there's still opportunities to go. So I am very 6

excited about the authoritative data and the controls that we have in this area.

7 I am going to go quickly through the last couple of slides.

8 All this new data, all these controls allowed us to go to an enhanced invoice.

9 This is, to me, the inherent transparency of the fees process. That 10 transparency allowed us to gain trust with our licensees about reducing billing 11 errors. And it allowed us to go to -- next slide -- to electronic billing. So not 12 only now will we have better information and transparency with them, but 13 they'll have the ability to download their own data and do their own data 14 analytics in a way that they haven't been able to do before. We currently 15 have 14 licensees, up from 9. We issued $23 million in electronic bills this 16 month. It's very exciting. Next slide.

17 So there's more to come. The next CFO is going to have a 18 lot of opportunity to excel here. We have been implementing robotic process 19 automation within the accounting system to get rid of days of work that it would 20 require us to do to close the year. We're using, as a test project, Tableau, to 21 do things like the budget execution report, which we've been transforming this 22 year, because we want to have a thousand flowers blooming. We want to 23

52 have as much innovation and change as we can. We're also -- we have an 1

RFI out now to get a new look at our fee billing engine to see if there are ways 2

that we can do that better and faster. And then coming up we appreciate the 3

support that we've had from the Commission to add acquisition and simplify 4

our interface process. Thank you very much, and now I'll turn it over to Amy.

5 CHAIRMAN SVINICKI: Thank you. And just before Amy 6

goes, I've seen some real-time supervision happening at the table, and we're 7

running a little behind. But Amy and Jonathan, I really do want to hear -- I 8

want to hear what you're going to talk about today. I think it's really important.

9 So if necessary, to my colleagues, I will yield some of my Q&A time. I want 10 to hear what you have to say. Thank you.

11 MS. D'AGOSTINO: Thank you, Chairman. I appreciate 12 that.

13 Thanks, Maureen.

14 Good morning, Chairman Svinicki and Commissioners. I'm 15 Amy D'Agostino. I am the Innovation Initiative lead under the Transformation 16 efforts, and Jon Greives is with me today. Both Jon and I are excited to be 17 here today to talk to you about innovation. Next slide, please.

18 I wanted to start with a quote from the Jam that I think really 19 captures what we're trying to accomplish through our Innovation Initiative.

20 We want to capture and share successful innovation. We also want to reward 21 and recognize innovative mindset and behaviors, and we want to learn from 22 our successes and failures and continue to evolve our approach to innovation.

23

53 Next slide, please.

1 Innovation is one of the four Transformation focus areas as 2

our EDO mentioned and that's because it helps enable all of the other focus 3

areas. To achieve our vision of being a modern risk-informed regulator, we 4

have to find new and better ways to work and we can only do that through 5

innovation. But innovation is impossible if we don't have a culture that not 6

only supports but encourages, and in fact expects our people to find better 7

ways to do their work while maintaining the highest safety standard. Next 8

slide, please.

9 We are on an innovation journey at the NRC. Our first 10 formal innovation program was created in 2017. However, as you can see 11 from all of the wonderful presentations today, we've been innovating for many 12 years in many ways.

13 Today, Jon and I will focus on the formal innovation program 14 because this program is a great example of how we are applying lessons 15 learned and best practices to find better ways of doing business. Jon's going 16 to take over in just a minute and explain the journey of an innovative idea in 17 the first version of this program, and then I'll follow with a discussion of how 18 our efforts over the last year will improve the next version of the program.

19 MR. GREIVES: Thanks, Amy.

20 Good morning, Chairman and Commissioners. My name 21 is Jon Greives and I've been involved in InnovateNRC 1.0 and Region I's 22 innovation greenhouse since their inception. I'm also currently a team 23

54 member on both the career enhancement and signposts and markers 1

transformation initiative teams.

2 To best describe how InnovateNRC 1.0 worked, I think I'll 3

share the journey of an idea that -- a recent idea. Over the summer, a Region 4

I staff member questioned the way that we share recent findings, observations 5

and inspector best practices through a weekly effort we call knowledge 6

transfer or KT. And, specifically, he noted that each region, you know, 7

implements their own version of KT independently and occasionally brings in 8

other regions as appropriate, and had the idea that we could develop a more 9

integrated approach to share these lessons learned across all regions.

10 We already use Skype to allow our, to enable our resident 11 inspectors to participate, and he figured that if we broadened this approach so 12 that all four regions participate, we could save resources, share these lessons 13 more broadly and maybe even become more consistent across the regions.

14 He submitted his idea to the Region I innovation greenhouse 15 and in short order the Region I innovation panel had reviewed his idea, 16 assessed its value and determined it needed to be submitted to the Agency 17 Innovation Forum, or AIF, because it affected multiple offices. However, that 18 submission didn't occur. Right about that same time, an SES CDP group was 19 looking for pilot projects for the skills marketplace and the Region I innovation 20 greenhouse or panel thought that it might be a good fit.

21 This is one of the ideas the Jennifer had mentioned 22 previously. Had the idea of taking the normal innovation approach, within 30 23

55 days the AIF would have assigned an idea champion to evaluate the idea 1

based on its merits, and within 90 days the AIF would have voted on the idea 2

and whether to present the idea to management with a recommendation for 3

implementation.

4 At that point, implementation would have been up to senior 5

agency leadership based on current resource constraints and, you know, 6

alignment with the broader agency direction. The skills marketplace path 7

took less time in this case and allowed us to align resources, to gather 8

resources directly from across the agency.

9 While the skills marketplace path can be faster, provide a 10 faster route to implementation, there are some downfalls for some ideas. For 11 example, there's no opportunity to bring in a variety of viewpoints to maybe 12 make the idea better or find an optimal solution. In addition, going direct 13 implementation for ideas that affect multiple offices can also result in a lack of 14 alignment. While the original path can take longer and path implementation 15 may be a little less clear, it does ensure that we provide an opportunity to 16 gather multiple viewpoints and opportunities for alignment along the way.

17 I'll pass it back now to Amy, and she can discuss how we 18 might address an idea like this under our new program in the future in a way 19 that allows for a diversity of thought, seeks the best solution as well as quickly 20 aligns to our implementation process. Next slide, please.

21 MS. D'AGOSTINO: Thanks, Jon. The first version of our 22 innovation program really helped us build our innovation muscle. However, 23

56 our experience over the last few years has really taught us that there is room 1

for improvement.

2 Over the past year, we've invested time and resources to 3

gather lessons learned through an internal assessment of our innovation 4

program and we also held our first InnovateNRC workshop on September 5

30th. We've also done extensive external benchmarking with other federal 6

agencies to identify best practices.

7 We've collaborated with agencies such as NASA, the Jet 8

Propulsion Lab, OPM and DHS, just to name a few. Based on our findings, 9

there are four major elements we will modify in InnovateNRC 2.0. We will 10 diversify our approach to innovation. We will not just be using a suggestion 11 box to submit new ideas, we're also going to use a more targeted approach to 12 innovation. Specifically, we will innovate around problem statements or 13 challenges and crowdsource our staff for solutions.

14 We're also going to capture and communicate what we're 15 already doing in our home organizations. As you can see today, we have a 16 lot of that going on. And we're going to capture those things at a central 17 location so that we can all see it, we can celebrate all the innovation that is 18 happening, we can avoid duplication of effort and we can integrate and 19 streamline approaches to our work.

When ideas do come in 20 as a suggestion, if they are aligned with our vision and well-developed, we're 21 going to fast track them and have clear paths to implementation such as the 22 skills marketplace, but we are also going to say no to things that aren't well-23

57 developed and that don't get us closer to our vision.

We're 1

also going to ensure, recognizing and rewarding innovation as a priority. I 2

know you are interested in that. In line with our leadership model, we want 3

to consistently reward the behaviors that we want to see. And, finally, we're 4

going to use technology to work smarter. We've recently procured and 5

onboarded a technology platform called IdeaScale, with the help of our folks 6

in OCIO. Next slide, please.

7 With this platform, if we refer back to Jon's example, the 8

Region I KT training process could be captured in a success gallery, facilitating 9

awareness and perhaps even adoption and integration by other regions.

10 Another way that we could address Jon's example in this future innovation 11 program is by posting a challenge that asks how can we develop a more 12 integrated approach to KT across all regions.

The challenge 13 might result in several possible solutions, then we can use the best idea or 14 combination of ideas to be implemented. A challenge approach helps us 15 promote participative decision making. It allows us to consider a variety of 16 perspectives and ultimately allows us to choose the most appropriate solution.

17 InnovateNRC 2.0 and IdeaScale platform provide a modern and efficient 18 means to empower and enable our staff to find better ways to work.

19 In closing, I believe that when our first thought is how can I 20 do this better, when we are excited to share our innovations and when we get 21 recognized and rewarded by our leaders for an innovative mindset and 22 behaviors and when innovation is part of our daily job, I believe then we will 23

58 know that we have realized our vision.

1 Thank you for your time today. And I'll also hand it back to 2

Margie.

3 MS. DOANE: Okay. I'm going to also yield some of my 4

time that I had for the conclusion and I'll take any questions and answer, 5

hopefully address any issues that I haven't covered that I thought I might sum 6

up in the conclusion when I get your questions, because I'm trying to move us 7

along but I do want to do a couple things.

8 The first is, I want to make sure that I tell you about a piece 9

of art that we have that has been created. It's outside. Is it up in this room?

10 Oh, no. It's up here. Great. It's back there. It's back in the room. We 11 had, as Jon mentioned, we had a two-day workshop. This was the first time 12 that we had ever done this.

13 We brought all of our executives here, even from the 14 regions, and we could see how many of us were working together on 15 Transformation, and we also committed to moving our Transformation efforts 16 and we signed a document where we all committed to that and I don't think 17 that's in here.

18 At the same time, when we were going through this 19 conversation, this is something that we had seen at an expo, an innovation 20 expo, a much grander innovation expo. We had seen how artwork could be 21 produced at the time that you were coming up with the various proposals that 22 you were going to embark on and that the artwork would capture what had 23

59 come out of those conversations through art as well as we were capturing 1

them in writing as well.

2 And so this is the piece of art that we came up with that 3

shows all of the different things that we had discussed, the themes, the 4

initiatives and the commitments that we made. And it's really beautiful, and 5

this was done real-time by two of our staff, Alicia Bone and Marcos --

6 somebody help me out here. Thank you. Rolon.

7 Okay. So, sorry about that. I didn't have that written 8

down. But anyway, it is very beautiful and we were all incredibly impressed.

9 So that's just a way that we're really stretching our minds. That's the first 10 thing.

11 The second thing is, we're going to have an expo tomorrow, 12 and we've put out the ask for how many people want to show their ideas. You 13 saw Taylor Lamb, you see Jonathan Greives where we have some things 14 going on, and we have well over, I believe it's over 25 now, different ideas that 15 are going to be the subject of this expo tomorrow and they're going to be doing 16 real-time demonstrations for the staff.

17 So that was incredible, so I -- that's why I want everybody to 18 see the progress that we're making on Transformation. It really is 19 extraordinary. And, last, we'd like to show a video that just sums everything 20 up for us.

21 (Video played.)

22 MS. DOANE: We're ready for your questions. We look 23

60 forward to them.

1 CHAIRMAN SVINICKI: Okay. Well, thank you all so 2

much. That was wonderful and you've left us a lot of terrain here to cover.

3 We will begin questions with Commissioner Wright.

4 COMMISSIONER WRIGHT: Good morning. So this has 5

been very informative. You've done a great job of setting the tone. I like the, 6

I really like the enthusiasm I see, Taylor, Greg and Amy and Jonathan. You 7

know, I can feel it and it's kind of contagious and that's a good thing. It's also 8

heartening to see that these first seven initiatives were developed from the 9

feedback that staff provided in the Jam.

10 And that was my first Jam as well. You know, I've never 11 experienced anything quite like that and it kind of grew on you as the days 12 went. So, and I agree with you, Greg, that if you left for a while you had to 13 dig your way through to get back, so.

14 And, Margie, I'm going to start with you obviously, so I do 15 applaud each of you for your communication today on Transformation. And, 16 Margie, your last three EDO updates have been helpful as well in providing a 17 vision and an explanation of how we're going to know when we get there.

18 You know, your statement about being enablers of 19 enhancement to safety kind of resonates with me as well. I look at 20 Transformation as an opportunity to improve how we meet our vital safety 21 mission. I think we should be looking at ways to do things in a new way and 22 leverage technology, experience, data and innovation.

23

61 I was also pleased to hear about the all-SES meeting you 1

had with senior management because I do believe communication is really 2

going to be key to this. I think obviously face-to-face meetings are critical. I 3

really believe in them, especially, you know, with the senior leaders, so that 4

then you can infiltrate it down to everybody. So thank you for your efforts to 5

making this happen.

6 So now having said that, Margie, can you talk to me a little 7

bit about how you're ensuring that communications are reaching the staff and 8

that they're buying in to Transformation?

9 MS. DOANE: So we're using various ways to 10 communicate. One thing is making sure that we're communicating well to our 11 senior leaders, because our senior leaders touch all of those organizations, of 12 course, but we have to do more.

13 We need to make sure that now we've talked to the senior 14 leaders about the themes and the seven initiatives. We have to then make 15 sure that we touch all of the branch chiefs, that we communicate with the 16 branch chiefs as well, and then that we hear from the staff on how to 17 implement these seven initiatives.

And so the teams, so the next 18 effort that will happen is that the teams themselves will now be reaching out 19 to the various parts of the agency to understand what are we already doing 20 with respect to that initiative, and then what should be the agency actions and 21 then what is being done or should be done at the office level.

22 And so as we, as the teams formulate this better 23

62 understanding, we're going to have a dashboard that shows what the progress 1

is that we're making on the initiatives, where the work is being done, and to 2

the extent that offices or maybe Embark is doing good work in these areas, 3

we're going to capture that so that all of the offices can see what's being done.

4 So this is all in progress because the initiative teams have 5

just been stood up and we're going to have milestones so that we can show 6

the progress and hold ourselves accountable and get feedback from the staff 7

on whether these initiatives are really moving the needle.

8 And the feedback that we seek will be through different 9

ways. We can -- I've heard some of the teams talking about focus groups, 10 some are talking about surveys and things like that. So a lot more 11 communication needs to take place and needs to take place in different ways.

12 COMMISSIONER WRIGHT: Thank you for that.

13 So we've done quite a few change initiatives over the past decade or 14 more such as Project AIM, we've done Fee Transformation and Enhanced 15 Strategic Workforce Planning, Transformation Futures Assessment and 16 Agency Innovation Forum. And Greg also mentioned there's several other 17 grassroots things going on.

18 So how do these change initiatives kind of fit together?

19 How are you trying to get that done? How do they fit into the overall vision, if 20 you could explain a little bit more maybe in a little more detail. And then while 21 you're thinking about it and going through that and given how much change 22 has already been going on at the agency, how are you addressing change 23

63 fatigue? You know, how are you going to keep the momentum going?

1 MS. DOANE: So it's a tall order. And I get a lot of my 2

motivation from reading books of people that have already gone through it by 3

seeing that there is a beginning and a middle and in the end is usually you've 4

evolved.

5 So it's never really an end to what the work has to be done 6

or the new way that you're doing it, but it's really that you've reached this level 7

in the evolution, where like Amy was saying, you're there because people 8

know how to, you know, they're looking for ways of working smarter all the 9

time and doing their mission better all the time.

10 So one thing I've done is recently is I've been talking to 11 people who also have gone through change to make sure that I understand 12 what did they have to do at the beginning, the middle and the end and make 13 sure that we're doing this.

14 So, for example, we had Scott Blackburn come in from the 15 VA and they were very instrumental. They had set out twelve initiatives. We 16 have seven, but they set out twelve initiatives. They didn't carry out all of 17 them, but they did the very same thing that we're doing by setting themes, 18 coming up with initiatives and gathering their executives together periodically 19 to make sure that we are focusing our Transformation efforts going down this 20 one path and making sure that we're all staying on board.

21 That will help us to address the fatigue, because as we see 22 things that really aren't going toward that vision we can reprioritize those.

23

64 Those won't be as important. And that's what we should be doing, ideally, 1

but we have a lot more work to do in this area, because like I said we just set 2

up these initiatives.

3 One of the biggest things that's going to be very important 4

to whether we can really make it through this is Commissioner Caputo gave 5

me a book called "Measure What Matters" and we've been studying this since 6

you gave it to me. I read it like in days. It's a very good book. And it shows 7

you how to cascade these measurements through the organization so that 8

everybody understands their role in Transformation and what we mean by the 9

initiatives that are most important.

10 So this is going to be a very important pathway. It needs to 11 be transparent, but this is another thing that we're doing. It's a huge effort.

12 It's not me, it's really this entire organization, especially all of the executives 13 that will have to --

14 MS. DOANE: -- really participate in this in getting us all 15 aligned in making sure that we don't have initiative fatigue.

16 COMMISSIONER WRIGHT: Thank you. And it wouldn't -

17

- I would be remiss if I did not end with Maureen.

18 So, Maureen, you know, this is your last time before us as 19 CFO, more than likely, and I'd like to take this time to thank you for your service 20 and for your vision. Many of these projects that we're doing wouldn't, it 21 wouldn't be possible if it weren't for what your determination and your skill and 22 your leadership, so thank you for that.

23

65 When I started here 18 months ago trying to understand our 1

budget here at the NRC that hurt my brain. So, you know, you've been a 2

great help to me and to my staff and for just trying to help us come up to speed 3

on how the agency does things, why we do it this way and why it matters, and 4

from everything from just the budget to fees and everything like that. So 5

thank you for that and I hope that you enjoy your well-deserved retirement.

6 And, Madam Chairman, she does smile way too much now.

7 MS. WYLIE: Thank you very much, sir. Thank you.

8 COMMISSIONER WRIGHT: So one last question for you.

9 In addition to the four near-term projects that you mentioned, what do you see 10 as the next big financial management issues to tackle and do you have any 11 advice for the next CFO?

12 MS. WYLIE: So thank you very much for asking that. I'm 13 involved at the government-wide level in the financial data transformation 14 executive steering committee and the big challenge is to transcend the 15 compliance requirement. I'm not saying that compliance goes away, but 16 we're actually at a point in my field where the demand for control and 17 auditability has become a risk to innovation.

18 And not all data needs to be controlled as tightly as some 19 does, but our approach has been very one-size-fits-all and very rigid. And 20 that's fair when, you know, we don't want the money to leak out, but as we 21 interact with the audit community with CIGIE and with GAO, it's clear that the 22 problems that the original CFO Act was meant to solve have largely been 23

66 solved.

1 There are agencies that have financial problems, still, but 20 2

years later we're done, you know, we're mostly done. And so for the next 3

CFO it's to continue to look for opportunities to take appropriate accepted risk 4

in the environment so that more data can be easily made available for data 5

analytics.

6 COMMISSIONER WRIGHT: Thank you so much.

7 CHAIRMAN SVINICKI: Well, thank you all again. I really 8

appreciate the presentations.

9 And one of our, among our values here at NRC is inclusion 10 and I appreciate that we were able to have a number of presenters today so 11 that we could have the kind of inclusion and the diversity of involvement in our 12 transition activities, our Transformation activities talked about today.

13 One of the unfortunate realities of doing a meeting like this 14 is as much as we highlighted there's other stuff going on and those folks aren't 15 here today. I hope that if they are in the audience or they are tuning in, they 16 know that we did have to have an orientation for our discussion today.

17 But I certainly know, I know that my colleagues are all aware 18 of a lot of other great initiatives and activities that are going on across the 19 agency that, you know, so stand by, because as I mentioned at the beginning 20 there will be future meetings on our activities. And I hope over the course of 21 time we're going to be able to have at these public Commission meetings the 22 diversity of things that are going on here.

23

67 I share the interest that Commissioner Wright had on, you 1

know, there can be fatigue about large organizations and the way that they 2

evolve over time. Having been here for the entirety of Project AIM, I contrast 3

my experiences with our Transformation work today very strongly with that.

4 That served a purpose and was a very useful kind of look 5

at, a strategic look at activities across the agency and as a result we did find 6

some very low-value things and we did that orientation.

But I think 7

what we're embarking on today is a lot more profound and foundational than 8

that. That kind of initiative has its place, but to me this is a very different 9

orientation that we're on right now. And I would hope that the skeptics like 10 Greg and others, you know, would say that this does look and feel quite 11 different from some things that we've tried in the past.

12 I know that, Margie, you have a focus on communication.

13 Also today, I know that this presentation was maybe a little bit SES-heavy or 14 that there's a lot of executive perspective today, and I just want to 15 communicate from me is that's necessary.

16 We've got to have a kind of an architecture in which to bring 17 our activities together to do the kind of measurement that Commissioner 18 Caputo has talked about and that the staff is taking on board to say, you know, 19 how can we be sure that we are making timely progress towards achieving 20 the vision that we want to achieve.

21 But that being said, you know, this, I think the ownership that 22 I feel about Transformation is the people who are doing the work who will 23

68 derive almost an immediate benefit from some of these changes when they're 1

in place. The quality of, you know, their days might improve their efficiency 2

and getting done the really important parts of the process that they do might 3

fundamentally change.

4 And so I think they as beneficiaries of this are bringing a 5

tremendous personal investment in what's going on here. And I realize that 6

wasn't maybe the strongest part of the dialogue we had today, but it was 7

intentional because we had the Jam and we needed as a Commission, I think, 8

to put a spotlight on what were the really high-level things that grew out of the 9

Jam and the fact that it does have a correlation through the analytics to what 10 the, you know, tens of thousands of individual comments and remarks that 11 were made in that Jam, so I appreciate it.

12 I just had one quick question and I do appreciate, Dave, that 13 you talked about greater support here for technology adoption, which we all 14 come at this with our own experiences. But I know here when we do some 15 sort of technology upgrade, I, just as an employee here I get something, it's 16 like, well, when you show up on Monday your workstation is going to look 17 different and you're going to have something. The support is really essential 18 and sometimes I feel like we focused on efficient rollout of things, but then I 19 look at it and say, gosh, this probably has additional functionality some of 20 which might be really useful to me.

21 But that element when we're all so busy just doing kind of 22 the regular, what did we call it, keep-the-lights-on work, you know, you just go, 23

69 well, I guess I'll read, you know, a little brochure on this later and there's 1

probably beneficial things here to my work.

2 Can you talk, Dave, a little bit about what we're 3

conceptualizing on supporting people actually understanding the benefits of 4

these new tools and taking the time to learn them and use them?

5 MR. NELSON: Sure. Thank you for that question, 6

Chairman.

7 I'd like to concentrate on a few things, but also point out that 8

our initiative team is putting their plan together. And the design, by intention, 9

brought people in from outside of CIO to really provide some of those user 10 experience perspectives in what does a good rollout look like.

11 So I'm looking forward to hearing, you know, some of the 12 new things that we might be able to do. We have brought in new training 13 contractors to help us with productivity tools such as Office 365. I know that 14 the team is currently working to put together a working group across the 15 agency to really find those individuals that are inspired by this kind of new 16 technology and working with the new tools and trying them out to help become 17 the ambassadors and to teach their offices as well.

18 So I think that will be a big help as well, but we need to look 19 at new ways of doing that. I think we've had some success with some of our 20 technology rollouts. Our recent Windows 10 and laptop rollouts, I think, went 21 almost flawlessly. We had a lot of really good feedback.

22 And some of the tools we've designed most recently have 23

70 got similar sorts of feedback and it is because we are using these new 1

techniques and really concentrating on that user experience.

2 CHAIRMAN SVINICKI: Well, I appreciate that. I gave 3

some positive feedback. I hope it made its way to you. I was kind of 4

skeptical because I'm so old school I'm like oh, these big CPU towers that, 5

you know, obviously a laptop is going to be slower, I'm going to notice that.

6 And I didn't.

7 And now I am excited when I meet with employee.

8 Sometimes they've taken their laptops so they can show me something or 9

whatever, but the connectivity is the issue because they'll say, oh, this is just 10 a cached, and not ain money, but just it's a stored image of something.

11 And they said, well, when we get the secure wi-fi, Chairman, 12 I'll be able to kind of pull this up and actually show you something, you know, 13 during our discussion. So I know there's a lot of excitement about that.

14 And since we're all innovating and every idea is welcome, 15 I'm going to do a real-time idea right now that I have, which is that training, I 16 think, sometimes is unapproachable when you're busy, and so if you were to 17 say, you know what, you have something new on your workstation today, if 18 you have five minutes, here's a thing. If you have 15 minutes, here's a 19 different thing you could, you know, a little tour you could go through. And 20 then if you had like an hour you could sign up for this iLearn module.

21 I think all of that would -- so that's my suggestion --

22 MR. NELSON: Excellent.

23

71 CHAIRMAN SVINICKI: -- is to have tunable training. So 1

that's me, okay. And with that we will turn it over --

2 MR. NELSON: Thank you.

3 CHAIRMAN SVINICKI: -- to Commissioner Baran.

4 COMMISSIONER BARAN: Thanks. It's clear from the 5

presentations that there's a lot of enthusiasm for making changes at the 6

agency and I think there are some very good innovative ideas here on 7

boosting workforce agility, being more innovative in how we recruit and hire, 8

simplifying some of our more cumbersome internal processes, and getting the 9

right IT in place including some exciting dashboards.

But I think we 10 need to be honest. Mixed in with these positive efforts are some very bad 11 proposals that would roll back safety and security standards and weaken 12 NRC's oversight of our licensees. We've seen recommendations to reduce 13 the frequency of critical engineering inspections and problem identification 14 resolution inspections.

15 There are proposals focused on minimizing the importance 16 of white findings that would have the effect of making it less likely that nuclear 17 power plants would move to higher levels of NRC oversight. Some are even 18 proposing that NRC should allow industry self-assessments to replace NRC 19 inspections in engineering, radiation protection, emergency preparedness, 20 and security.

21 None of those proposals were discussed in your 22 presentation today, but they have all been characterized by the staff as efforts 23

72 to risk-inform NRC's oversight of nuclear power plants. We have a choice to 1

make. We can focus on consensus innovation efforts that everyone agrees 2

are worthwhile, or NRC can go down the divisive path of weakening safety 3

standards and reducing oversight.

4 I fear that risk-informing and accepting risk are becoming 5

code for just this kind of regulatory rollback. The title of slide 23 of the staff's 6

presentation is "What does accepting risk mean?" I think this has become a 7

real muddle.

8 Using risk insights in decision making, of course that's a 9

good idea. We do a lot of that. Taking chances personally on new ideas or 10 approaches that's great. We want to encourage that. And NRC has never 11 regulated to zero risk. But I don't think the American public is particularly 12 interested in NRC accepting more radiological risk on their behalf. If that's 13 what this is about, we have a real problem. So, Margie, I just want to ask you 14 directly about this. Is this initiative about accepting increased radiological risk 15 from nuclear power plants, fuel cycle facilities, and radioactive material users?

16 MS. DOANE: No. It's not about -- this is not about 17 weakening our safety. It's about strengthening our safety. I am convinced 18 that we will have a smaller staff and smaller resources, so we need to 19 understand where have we put our focus in areas that haven't moved the 20 needle at all.

21 If you were to do a PRA in these situations and you were to 22 measure this change, you would see no change on the risk analysis. None.

23

73 Because these weren't safety-significant issues in the first place, they were 1

low or minimal. So if --

2 COMMISSIONER BARAN: Well, I'm glad to hear this is not 3

about accepting greater radiological risk and I hope the staff takes that 4

seriously when they hear you. But I'll be honest, you know, that's not the 5

conclusion I would draw based on some of the potential changes being 6

discussed, particularly to the reactor oversight process.

7 You know, John made the point I think you were making 8

here about shifting resources to lower risk items, from lower risk items to 9

higher risk items can improve oversight, but most of the potential ROP 10 changes wouldn't shift anything, they would just cut. And that's not better 11 oversight, that's less oversight.

12 So I wanted to -- I appreciate that you're saying that this is 13 not about accepting increased radiological risk. That's an important thing for 14 people to hear because we're using the word "risk" now in so many contexts 15 on these slides and as part of the initiative. If that's not what this is about we 16 need to take that seriously.

17 I want to ask about a couple ideas for updating the 18 rulemaking process that could be positive steps. John, you talked about 19 these. You talked about streamlining the process that instead of a draft 20 regulatory basis and public comment and then a final regulatory basis, there 21 would one reg basis that the agency would take comment on it and then go 22 right to a draft proposed rule.

23

74 Is that a change or a plan to apply to all rulemakings that 1

don't involve direct final rules?

2 MR. LUBINSKI: At this point we're looking at it on a case-3 by-case basis.

4 COMMISSIONER BARAN: Okay.

5 MR. LUBINSKI: As we've gone through our analysis what 6

we've looked at is, we've gotten into the culture of looking at our procedure 7

and addressing every rulemaking the exact same way.

8 So we've always said, let's look at the most complex rule, if 9

you will, what steps do we need, and we follow that for even the most simplistic 10 rules where we've gone forward and said, let's do a draft reg basis and then 11 issue the final reg basis, then make a decision going through the rulemaking.

12 And we said, you don't need to do that because not every rule from a scope 13 standpoint or a significance is created the same.

14 So most recently when we've looked at it, we've said, what 15 benefit are we getting out of developing a draft reg basis and then a final?

16 The purpose of the draft is to get comments to determine should we go into 17 rulemaking. If the result is yes, we're going to go into rulemaking, then why 18 do we have to put back out a final basis that says here's our conclusions?

19 So proposed rule captures that plus we get the benefits of 20 the comments that came in. Also, if we already know we're going to 21 rulemaking and we, as I stated we may bring this to the Commission, is if we 22 know we're going to rulemaking or it's a direct final rulemaking, what's really 23

75 the purpose of a reg basis? It's to get feedback on whether we should do 1

rulemaking or not.

2 Well, if it's -- why do you need the reg basis? If you're really 3

trying to get public comment on what the rules should look like, that's part of 4

the proposed rulemaking process. So that's what we're trying to say that 5

we're not doing it for every rule, but we need to ask the question of when we 6

do a rulemaking what is the best way to do it?

7 Another, which I didn't state earlier, was we're looking at 8

having now what we're calling mini-alignment meetings on the front end where 9

we get together and make a determination of the process and say, okay, what 10 is the most effective process to follow for this rule.

11 And even in some cases we've found we've asked ourselves 12 the question, do we need a rule or is this just a policy change that we're making 13 that's a change in a policy statement and we can come back to the 14 Commission and change that policy statement?

15 COMMISSIONER BARAN: That makes a lot of sense to 16 me. And the concurrence process, you mentioned the idea of concurrence 17 alignment meetings and paperless concurrence. Can you talk a little bit more 18 about how those approaches could work?

19 MR. LUBINSKI: Sure. What we're talking about is 20 bringing together a group where when we're doing a rulemaking bringing the 21 key decision makers who would normally have a concurrence and it could be 22 at the division level or office level from a different group of offices, but their 23

76 focus would be on what is it about this rule that they're concurring in.

1 Is it just a security aspect of it where answer can come to 2

the table and doesn't have to look at the safety aspects of the rule. And that's 3

the concurrence to take a look at it and say, well, with respect to this issue, I 4

concur and I don't need to see the final package.

5 I trust the judgment of the final folks that are doing it that 6

they'll follow the rulemaking process. They'll make sure that the grammar's 7

correct. They'll make sure that the format of the FRN are correct, and I just 8

had to give my input of the concurrence on what the technical issue or the 9

policy issue that I was concurring in.

10 COMMISSIONER BARAN: Okay. Well, I think those are 11 the kinds of practical ideas we should absolutely be exploring and pursuing.

12 Maureen, I wanted to ask briefly, we've got a little bit of time 13 left, about the $62 million in carryover we're expecting to have this year. This 14 is money that was appropriated by Congress that NRC hasn't spent.

15 I think there are two primary causes for this large amount of 16 carryover and they're closely related. First, there's been a steeper decline in 17 agency spending than what was anticipated two years ago when the budget 18 was being developed. And second, the agency hasn't been hiring nearly 19 enough new employees to offset attrition.

20 As a result, some important mission-related work isn't 21 getting done or is moving much more slowly than it should. What do you think 22 about the causes for the larger than usual amount of carryover? Are these 23

77 two factors, the steeper than expected decline in spending and lack of hiring 1

the main contributors of this?

2 MS. WYLIE: I have a chart that is at the end of the 3

presentation, if you'll bring that up. I think the answer to both your questions 4

is, generally, yes. So the traditional look at carryover is by fund source and 5

so that's on my left. And as you can see, 50.8 million of that is in fee-based 6

carryover. That's obviously, as the title says, is what licensees pay their fees 7

on. And then the rest of it, with the exception of Commission carryover, 8

they're fairly small dollars. The rep fund is so small it doesn't make it to the 9

rounding error.

10 But, so in general, yes, where licensees have paid fee we 11 do have carryover, but by control point you get some additional insight.

12 Roughly $30 million of the carryover this year, it was within the nuclear safety 13 control point, so the new reactor business line and the operating reactor 14 business line, and so the bulk of the FTE that were not hired are in that.

15 And so as we approach that budget in 2017, one of the 16 things that we were worried about was the ability to attrit down to get ready for 17 the NRR-NRO merger and so there was some conservatism in the estimation, 18 in my opinion.

19 The other area that I would want to point out though is the 20 corporate support. One of the reasons that that's so large is that prior-year 21 carryover which is effectively colorless gets included in that control point, so 22 that's about ten million of those resources. But when the Commission is not 23

78 fully staffed, your carryover falls into corporate support as well.

1 But we have had difficulty hiring in both the acquisition and 2

cyber IT space, which is one of the reasons that we underran in corporate 3

support. So.

4 COMMISSIONER BARAN: Do you think it's, in terms of 5

the kind of reasons for the lack of hiring, is it a reluctance to hire? Is it an 6

issue with managers being concerned about hiring for some reason, or is it 7

something else?

8 MS. WYLIE: I'll start, and I would invite Margie to give her 9

much more informed opinion. I think there is a concern about the ability to 10 attrit down to the next lowest year coming. We are still continuing in our glide 11 path of decline, the '20 budget, particularly in the reactor safety control point 12 we were very, we were much more rigorous in our application of cuts 13 associated with closing reactors.

And so I think there's a national 14 conservatism there as well because we have been focused on not having to 15 then replace people in other areas. We placed almost 40 people when the 16 SCANA work went away, so there is some impact to that. But I think Margie's 17 insights around we are trying to hire, the hiring process takes a long time.

18 And so, while budgeting is clearly delimited by the start of a 19 fiscal year and the end of a fiscal year, the work of the agency is more like a 20 river that our regulatory activity continues. Sometimes it speeds up.

21 Sometimes it slows down.

22 And then of course we're hostage to individual decisions like 23

79 mine, to retire. And so those things can culminate into some difficulty in 1

managing.

2 COMMISSIONER BARAN: Do you want to briefly add 3

anything on there though?

4 MS. DOANE: Just to make sure that, right, so I just want 5

to make sure that we understand that we had anticipated four percent attrition.

6 It's up to 6.9 percent attrition and that just, I want to make sure that that's well 7

understood, because that just demonstrates how we're, you know, we're 8

facing this higher attrition rate. I believe it will stay that or even be higher, but 9

that's not what we were expecting when we built the budgets two years ago, 10 so that's part of it is the attrition.

11 And also, as Maureen said, we were just starting to get back 12 to hiring because we did put in these very necessary changes so that we could 13 bring the agency down so that it matched our workload and now we're getting 14 started in things like the NRAN program, the apprenticeship program. It's 15 taking a while because we had to build it and then we had to match it to the 16 fall hiring opportunities.

17 So those are some of the things. And we have many, many 18 individuals in the pipeline ready to be hired into the agency that will just meet 19 our attrition.

20 COMMISSIONER BARAN: Well, I'm glad to hear that it's 21 starting to move after some kind of initial building of some of these new 22 processes. I, you know, and we've talked about this before. NRC has plenty 23

80 of work and we're going to have plenty of work to do in 2030 and 2040 and 1

2050, so we've got to be ready for that timeframe.

2 I think this carryover is an indication where we haven't been 3

able to do nearly enough hiring to get the work done today or to be ready in 4

the future. I think it's probably maybe our number one enterprise risk as an 5

agency. And we need to make it a top priority and I'm glad to hear that that's 6

starting to happen more.

7 I think it was you earlier who were talking about the 8

potential, you know, retirements we're going to have in the next few years.

9 We're going to need a lot of people still here doing the work and we've got to 10 make sure we're ready for it. Thanks.

11 CHAIRMAN SVINICKI: Thank you, Commissioner Baran.

12 Commissioner Caputo, please.

13 COMMISSIONER CAPUTO: Good morning. Thank you 14 all for coming today. I'm very eager to have this meeting today and to hear 15 all of these presentations. I wholeheartedly support Transformation and I do 16 sincerely want to be helpful in any way that I can.

I was lucky 17 enough to spend some time yesterday with Embark Venture Studio and those 18 folks, hearing about what they're up to. It's very impressive. It's very 19 exciting in addition to all of your presentations today.

20 As Commissioner Wright said, the ideas, the initiative that's 21 taking place here really is contagious and I want to commend everyone for 22 their efforts. I think this is a very exciting time for the agency and I'm glad to 23

81 be part of it.

1 I do think one of the toughest Transformation activities is the 2

risk and accepting risk. I think this is a situation where for the employees that 3

are engaged in this Transformation activity it takes a bit of courage. It's 4

probably the activity that's most likely to draw criticism. I know I've had 5

conversations myself with Ho Nieh about accepting risk and about ensuring 6

that any activities that we're taking here are thoroughly thought out, analyzed, 7

able to articulate why they're important and beneficial, why they're going to 8

meet that mission and preserve safety. That they are -- that we can articulate 9

them and defend them.

10 And I think the work that's going on really represents 11 perhaps the best within us as an agency, which is that we will have the 12 courage to look at these issues, to look at these ideas and situations and really 13 use our intellectual heft, our experience to really make the case for changes 14 that ultimately are going to help the agency execute its mission better going 15 forward.

16 So I just, I want to say a special thank you to the employees 17 who really are contributing to that effort in challenging themselves to thinking 18 this way and really make the case. So thank you, John, for your leadership 19 in that area.

20 I also want to give kudos to NMSS for a recent lessons 21 learned effort regarding the material control and accounting rulemaking. So 22 I understand these conclusions are going to contribute to the Transformation 23

82 effort in simplifying and optimizing NRC processes, which I think is very useful.

1 However, I have to say, my own observations on the agency's lessons learned 2

efforts in general is they often seem to be somewhat cumbersome and time-3 consuming.

4 So I'm wondering if you have any observations about 5

possibly using this example to also look at simplifying lessons learned and 6

making a more efficient tool for continuous improvement across the agency.

7 MR. LUBINSKI: I assume you mean from the standpoint 8

of, I believe this one was done very efficiently and effectively, so I'm assuming 9

the question is how do we take the lessons learned from this lessons learned 10 and apply it to the program. I think -- thank you for your -- okay.

11 COMMISSIONER CAPUTO: Let me clarify just a little bit.

12 MR. LUBINSKI: Sure. I'll make sure to get the question.

13 COMMISSIONER CAPUTO: Because I think this lessons 14 learned effort took six months, right.

15 MR. LUBINSKI: It was, we had a six-month timeframe, 16 yes.

17 COMMISSIONER CAPUTO: Okay.

18 MR. LUBINSKI: So I take that question of making it even 19 more efficient as a question, so.

20 COMMISSIONER CAPUTO: It's a long time to have folks 21 focused backward on a particular issue. I mean I just, I feel like we should 22 be looking for ways to sort of capture those lessons so that we can begin 23

83 applying them going forward.

1 MR. LUBINSKI: And I think it's -- I'm grateful you said that 2

because when I looked at the team as developing this lessons learned they 3

weren't looking backwards. They were really looking forward.

4 And not only were they looking forward from the standpoint of where 5

do we go on making a new system that looks better with respect to what we're 6

taking out as material control and accounting, but they were also looking more 7

broadly and saying what else have we seen come out from the Commission 8

recently? What have we seen externally that has taken place and factored 9

that in?

10 So they weren't just looking backwards from the standpoint 11 of that rule and what happened in that rule, they were looking forward from 12 that point and saying what other changes have we seen across the agency 13 that look like they relate to what we did here.

I

also, I

14 appreciate you thanking NMSS. I want to thank CRGR. You know, we were 15 working very closely together on that. And I think if I had to say what would be 16 the lesson I would take from that to be more efficient in moving forward is 17 when you look at a lessons learned don't look just at the activity you did.

18 Look quickly at that activity to bring up the couple key points 19 that you want and then start to take those more broadly and look at the other 20 signposts you may have out there, the other indicators that you're getting 21 externally and what you're getting from the Commission, because when the 22 recommendations that came out of there I think really capture other items that 23

84 came out, not just material control and accounting, but where did the 1

Commission come out with back fit, more recently on the discussion of forward 2

fit and factoring that into the discussion, issues of reasonable assurance, so 3

they were very broad issues that weren't just centered on this rule.

4 So I think that would be what I would take as one of the key 5

learnings from that moving forward.

6 COMMISSIONER CAPUTO: Okay, thank you.

7 I'm going to shift gears a little bit to an area where I think our results 8

really emphasize the need for Transformation and that's in financial 9

management. Just to recap what Commissioner Baran pointed out, we just 10 reported to appropriators 62 million in carryover, so this is 62 million more that 11 we collected from ratepayers and licensees that we didn't need to use to 12 complete our mission this year.

But the reality is, this is in 13 addition to prior year unliquidated resources of 107 million. So these are 14 appropriated funds from fiscal years 2018 and older that still haven't been 15 spent, so together this is quite a sum of money that we have collected but not 16 used.

17 So I understand your comment about work being a river, but 18 I think there's room for certainly an improvement in our accuracy in budgeting.

19 I think this is an area where above all data analytics is important. I understand 20 Margie's comment about attrition, but this agency has also discussed the age 21 demographic and the potential for retirement for years.

22 So, you know, the expectation that somehow that 23

85 demographic would grow over time and attrition rate wouldn't change, I think 1

is probably just a lack of looking at the data. Because I think if we look back, 2

that attrition rate has creeped up and we should not find ourselves surprised.

3 I would be surprised if it doesn't increase beyond where it is.

4 So the hiring effort, I think, is very important. It needs to be 5

measured, but I think it also needs to be fully informed by data on where we're 6

seeing retirements, where we need to build those skills, where we have not 7

just gaps in expertise through strategic workforce planning, but also where we 8

have surpluses of personnel with expertise that we're perhaps not using that 9

need to be reskilled.

But I think all of this gets back to the 10 need to better use data analytics to actually inform budgeting and that's what 11 I find missing, really, from the slides.

12 Ms. Wylie, slide 34 touts innovation, but it doesn't have a 13 connection to the use of the actual expenditures to inform budget 14 development. So we're still in this cycle where we're developing a budget two 15 years out by basing it on a budget that was developed two years out.

16 Is it your expectation that you're going to continue the 17 practice of keeping budget execution separate from budget formulation, or do 18 you see a Transformation opportunity by using data on actual expenditures to 19 improve budget accuracy through data analytics?

20 MS. WYLIE: So thank you very much. I think that we 21 have a different view on how data analytics and the use of actual expenditures 22 is, in fact, used. There are large-scale actuals at the product and product line 23

86 level where we do, in fact, looked at what we spent in the most recent year.

1 But the challenge of building budgets two years in advance 2

that the actual data that we have is also two years old by the time, or three by 3

the time we actually get it in budget execution. So we do ask that people look 4

at their actual data, but they're not able to look at it at the workload level.

5 That's what the data analytics' opportunity is going to give 6

them. We're going to be able to see what specific licensing actions really cost 7

in a way that will be different than we've been able to see in the past.

8 So I do disagree with you. I do believe that we use actuals 9

data. We both use it at the program level and we provide it in the budget as 10 is required. But again, a program that is looking at actuals when they're 11 building the budget so when we were building the budget in '17, we were 12 looking at '16. That was a year that we spent $990 million.

13 COMMISSIONER CAPUTO: So at what point in time do 14 you factor into budget space the fact that we are carrying money that is a year 15 or older forward without actually utilizing the resources?

16 MS. WYLIE: So I --

17 COMMISSIONER CAPUTO: How do you account for that 18 in budget space?

19 MS. WYLIE: We do, in fact, take into account the 20 requirements for our contracts and we make explicit the requirement that we 21 look at forward funding. We have a difference of opinion here as well about 22 whether or not forward funding is bad for the agency. In a period where 23

87 resources are relatively constant, I would agree, yes, that a large bow wave 1

of forward funding is a bad idea.

2 But over a period of time, over five years and now more 3

where our budgets are going to decline, we mitigate our risk to our central 4

functions by maintaining contracts that will handle things particularly in the 5

corporate space over time and we are looking specifically at forward funding.

6 We did for '21 and will for '22.

7 And the commitment planning module that we've put into 8

effect will give people greater clarity about what the plans are for the year 9

that's underway. So I don't agree with you that people don't look at it. I think 10 that we do, but we draw different conclusions about its importance.

11 Related to carryover, first of all, the 62 million is total funds.

12 The fee-based funds which our licensees have paid fees on is 50 million, still 13 a large number, but the process that we've been in with our appropriations 14 committees over the last four years of using carryover balances to reduce the 15 requirement for appropriation in the next year, actually then limits the impact 16 on licensees year over year.

17 So the Senate bill that we have before us that has not yet 18 been to the floor calls for carryover funding of $40 million. That is a number 19 that we discussed with both majority and minority staff recognizing that that 20 would leave the agency a cushion should it want to spend resources on things 21 like renovating facilities that are not in the budget or having resources in the 22 in-house, so to speak, should there be uncertainty about appropriations.

23

88 But those monies don't just sit in the bank. They're 1

essentially going to the Treasury and we're being appropriated less. So in 2

the end that year over year process does control for that.

3 COMMISSIONER CAPUTO: But in the end, we have 4

resources from 2018 and 2017 that we didn't use this year, so what's the point 5

in maintaining that?

6 MS. WYLIE: Well, we are executing those resources as a 7

part of legally binding contracts that were based on requirements at the time.

8 So each of those things vary contract over contract, but the purpose of having 9

those things like the accounting system, some of our GLINDA contracts, is in 10 fact to mitigate risk in corporate while we continue to reduce our budget going 11 forward.

12 COMMISSIONER CAPUTO: That's it for my questions.

13 MS. WYLIE: Thank you, ma'am.

14 CHAIRMAN SVINICKI: Well, again, I want to thank 15 everyone who presented today and just all of the NRC employees in every 16 office, at every level with every expertise that are a part of these activities.

17 I do agree with Commissioner Caputo, it's really, I think, an 18 exciting time. I think this time will be looked back on in the agency's history 19 as, really, the incubator of a lot of things that had great staying power and are 20 so related to the core important mission that we carry out that we'll say, thank 21 goodness for those people, much like we say thank goodness for people who 22 created ROP and other things we benefit from today.

23

89 So thank you all for the work you're doing and the 1

contributions you're making, and with that we are adjourned.

2 (Whereupon, the above-entitled matter went off the record 3

at 12:17 p.m.)

4