ML18306A779

From kanterella
Jump to navigation Jump to search
Transcript of Advisory Committee on Reactor Safeguards Structural Analysis Subcommittee Meeting - October 3, 2018, Pages 1-134
ML18306A779
Person / Time
Issue date: 10/03/2018
From: Shukla G
Advisory Committee on Reactor Safeguards
To:
Shukla G
References
NRC-3927
Download: ML18306A779 (134)


Text

Official Transcript of Proceedings NUCLEAR REGULATORY COMMISSION

Title:

Advisory Committee on Reactor Safeguards Structural Analysis Subcommittee Docket Number:

(n/a)

Location:

Rockville, Maryland Date:

Wednesday, October 3, 3018 Work Order No.:

NRC-3927 Pages 1-134 NEAL R. GROSS AND CO., INC.

Court Reporters and Transcribers 1323 Rhode Island Avenue, N.W.

Washington, D.C. 20005 (202) 234-4433

NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 www.nealrgross.com 1

1 2

3 DISCLAIMER 4

5 6

UNITED STATES NUCLEAR REGULATORY COMMISSIONS 7

ADVISORY COMMITTEE ON REACTOR SAFEGUARDS 8

9 10 The contents of this transcript of the 11 proceeding of the United States Nuclear Regulatory 12 Commission Advisory Committee on Reactor Safeguards, 13 as reported herein, is a record of the discussions 14 recorded at the meeting.

15 16 This transcript has not been reviewed, 17 corrected, and edited, and it may contain 18 inaccuracies.

19 20 21 22 23

1 UNITED STATES OF AMERICA 1

NUCLEAR REGULATORY COMMISSION 2

+ + + + +

3 ADVISORY COMMITTEE ON REACTOR SAFEGUARDS 4

(ACRS) 5

+ + + + +

6 STRUCTURAL ANALYSIS SUBCOMMITTEE 7

+ + + + +

8 WEDNESDAY 9

OCTOBER 3, 2018 10

+ + + + +

11 ROCKVILLE, MARYLAND 12

+ + + + +

13 The Subcommittee met at the Nuclear 14 Regulatory Commission, Two White Flint North, Room 15 T2B1, 11545 Rockville Pike, at 1:00 p.m., Peter 16 Riccardella, Chairman, presiding.

17 18 19 20 21 22 23 24 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

2 COMMITTEE MEMBERS:

1 PETER RICCARDELLA, Chairman 2

MICHAEL L. CORRADINI, Member 3

RONALD G. BALLINGER, Member 4

MARGARET SZE-TAI Y. CHU, Member 5

VESNA B. DIMITRIJEVIC, Member 6

JOSE MARCH-LEUBA, Member 7

HAROLD B. RAY, Member 8

JOY L. REMPE, Member 9

GORDON R. SKILLMAN, Member 10 MATTHEW SUNSERI, Member 11 12 DESIGNATED FEDERAL OFFICIAL:

13 GIRIJA SHUKLA 14 15 ALSO PRESENT:

16 JOSE PIRES, RES 17 MEHDI REISI-FAHRD, NRR 18 19 20 21 22 23 24 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

3 C-O-N-T-E-N-T-S 1

PAGE 2

Opening Remarks and Objectives 3

Peter (Pete) Riccardella, ACRS 4

4 Presentation and Discussion........... 10 5

Correlation or Dependency of Seismic 6

Performance of Similar SSCs by Jose 7

Pires (RES) and Mehdi Reisi-Fard (NRR.

8 Closing Comments 9

Pete Riccardella, ACRS 104 10 Adjourn....................

104 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

4 P-R-O-C-E-E-D-I-N-G-S 1

(12:58 p.m.)

2 CHAIRMAN RICCARDELLA: The meeting will 3

now come to order. This is a meeting of the ACRS 4

Structural Analysis Subcommittee.

I am Pete 5

Riccardella, Chairman of the Subcommittee. ACRS 6

members in attendance are, Vesna B. Dimitrijevic, 7

Margaret Sze, Harold Ray, Gordon Skillman, Mike 8

Corradini, Matt Sunseri, Joy Rempe, Jose March-Leuba, 9

and Ron Ballinger. We may or may not have two other 10 members come in later.

11 Girija Shukla of the ACRS is the 12 Designated Government Official for this meeting.

13 The ACRS reviews and advises the 14 Commission in regard to licensing and operation of 15 production and utilization facilities and related 16 safety issues, the adequacy of proposed reactor safety 17 standards, technical, and policy issues related to the 18 licensing of evolutionary and passive plant designs, 19 and other matters referred to it by the Commission.

20 The purpose of this Subcommittee meeting 21 is for the staff to brief Subcommittee on the topic of 22 Correlation or Dependency of Seismic Performance of 23 Similar SSCs. This is the topic of a research 24 publication, NUREG/CR-7237, Correlation of Seismic 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

5 Performance of Similar SSCs.

1 Members of the -- this is also the topic 2

of a research review, and I want to note that this 3

briefing that we're having here is independent of the 4

research quality review. That quality review is well 5

under way and the panel, the research panel is here 6

but they've pretty much already completed their 7

review.

8 The Subcommittee will gather information, 9

analyze relevant issues and facts. And formulate 10 proposed positions and actions as appropriate. The 11 meeting will be open to the public. We have not 12 received any written comments, or any requests for 13 time to make oral statements from members of the 14 public regarding today's meeting.

15 A transcript of the meeting is being kept 16 and will be made available as stated in the Federal 17 Register

Notice, therefore we request that 18 participants in this meeting use the microphones 19 located throughout the meeting room when addressing 20 the Subcommittee.

21 Participants should first identify 22 themselves, and speak with sufficient clarity and 23 volume so that they can be readily heard. To avoid 24 interruption of the meeting, please mute your 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

6 individual lines during the presentations and 1

committee discussions. Also please silence your 2

phones. And I just, I've been advised that --

3 MEMBER CORRADINI:

Yes, just for 4

everybody. So this test of the Emergency Broadcast 5

System via mobile is going to happen in a little bit 6

more than an hour. My recommendation is that you 7

power off your phones --

8 CHAIRMAN RICCARDELLA: Before.

9 MEMBER CORRADINI: -- before 2 o'clock so 10 it, because it will broadcast whether you have your 11 phone muted or not.

12 MEMBER MARCH-LEUBA:

Yes, but 13 alternatively, you can put it in airplane mode.

14 MEMBER CORRADINI: It'll still --

15 MEMBER MARCH-LEUBA: Airplane mode --

16 MEMBER CORRADINI: Won't do it. It'll 17 still broadcast through it.

18 MEMBER MARCH-LEUBA: Airplane mode?

19 MEMBER CORRADINI: Yes if you power --

20 you're going to have to poser it off.

21 MEMBER MARCH-LEUBA: Let's try a test.

22 MEMBER CORRADINI: Okay, go ahead.

23 (Laughter.)

24 MEMBER CORRADINI: Feel free.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

7 CHAIRMAN RICCARDELLA: Let me, just for 1

those members who weren't on the Research Review 2

Committee, just a little bit of an introduction in my 3

simple way of looking at it, at the topic.

4 Suppose you have three pieces of 5

equipment, pumps that are required -- that are in 6

parallel, and one of them is required to work in an 7

accident sequence. And let's assume that the 8

probability of failure of each of those pieces of 9

equipment at a given level earthquake is 0.1. Okay.

10 If the components are independent then the 11 probability of none of them working is.1 of q, or 10 12 to the minus 3. On the other hand if they are 13 dependent, if the three are dependent, the probability 14 that if one fails, they're all going to fail, so the 15 probability is.1. And that's the significance that 16 we're talking about.

17 And current seismic PRA's there's a rule 18 of thumb which I'm sure Jose and others will discuss 19 that in some cases you assume they are perfectly 20 correlated, which is the 0.1. And in other situations 21 you assume that they're totally uncorrelated, which is 22 the 10 to the minus 3.

23 And I think what came to my mind when I 24 reviewed this was the potential significance with 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

8 respect to NuScale, where you might have 10 or 12 1

reactors in a common site. And you have a big 2

earthquake, you know, is the probability -- you know, 3

you could get into a 10 to the minus ten, 10 to the 4

minus 12th situation versus a.1 probability that 5

they'll all fail.

6 So, that's why I thought it might be a 7

good idea to have this meeting. And I think this 8

meeting will also serve as sort of some education for 9

the members of the committee who weren't on the 10 quality review.

11 MEMBER SKILLMAN: Pete, let me ask this, 12 for the record, I'm Dick Skillman. In this argument, 13 or in this example that you just explained, the way I 14 interpret that is if these three components are 15 identical, are operable, that means they're not pulled 16 along. They are in trigger, ready to go. And at the 17 same location, thus experiencing the same physical 18 behavior --

19 CHAIRMAN RICCARDELLA: Yes.

20 MEMBER SKILLMAN: Then all that you've 21 just mentioned is accurate. But of the three pumps, 22 if one is a 14 stage, one's a 13 stage, one's a 12 23 stage, one is in total lock, and one is on a different 24 set of supports. Then there is basis for the 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

9 licensing to claim, not identical, different response, 1

and here's the response data for, you know, the shaker 2

table test I did for these. Therefore, the seismic 3

dependency while interesting, doesn't take out all of 4

my components. Is that an accurate framework for 5

this?

6 CHAIRMAN RICCARDELLA: Yes, and there's 7

current rules of thumb for how you handle that, okay.

8 MEMBER SKILLMAN: Okay, thank you.

9 CHAIRMAN RICCARDELLA: But as I understand 10 it, in fact even for those three identical pumps there 11 are aspects of their seismic fragility which are 12 correlated, and aspects that aren't correlated. Okay, 13 and so the reality is probably somewhere between zero 14 and one.

15 And for example, you know, if I think a 16 seismic qualification test is probably a lot like a 17 fatigue test. I run ten identical fatigue tests on 18 the same pieces of equipment, and the equipment can, 19 you know the samples will fail sometimes anywhere 20 between 1000 and 10,000 cycles, or 100,000 cycles.

21 And so there's a -- that's a total randomness that 22 even for identical equipment exists.

23 So, but this report is aimed at something 24 in between those extremes of zero and 1. And with 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

10 that I'll let Jose and the Research staff proceed.

1 MR. PIRES: Good afternoon, I am Jose 2

Pires. I am a Senior Technical Advisor in the 3

Division of Engineering, in the Office of Research.

4 I'm really the main preparer of this briefing because 5

this project was conducted by the Division of 6

Engineering. We had the lead for this project.

7 In the preparation of these slides, and in 8

preparation for this meeting, I discussed with some 9

other colleagues. I discussed with Selim, various 10 topics related to the issues of correlations. He's a 11 Seismic PRA Analyst. So he has experience in that 12 area. So if I could benefit from it. He's sitting 13 here if his help is needed to answer some questions 14 that I may not be able to answer.

15 And Mehdi, he works at NRR and he's been 16 involved in the reviews of Seismic PRAs that have been 17 submitted as part of the 2.1 Evaluation. So he can 18 provide some perspectives also. I also discussed with 19 him issues of seismic dependency, seismic failure 20 dependencies. And he can provide some perspectives of 21 what is being done nowadays in this area to address 22 this issue.

23 CHAIRMAN RICCARDELLA: Yes, perhaps some 24 perspective on the significance of it. In other words 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

11 if you did have a more accurate way of treating it, 1

would it have a significant effect of some PRAs or 2

not?

3 MR. PIRES: And I just in case that if we 4

talk about the applicability of some of these 5

methodologies here to these modular reactors, I also 6

talked to someone at NRO that is more familiar with 7

what is going on in relation to new reactors. So he's 8

sitting here too, and if necessary can also help 9

answer some things, if necessary, he can.

10 So, this is pretty much the outline. And 11 so I will try to focus mainly on the research before 12 us. And on the research that was then. So I'll talk 13 some about the objectives, some background leading to 14 research objectives and goals, how we thought these 15 could be used. The scope of the work.

16 And I quickly go, we're talking about the 17 approach and everything. I think it's probably a good 18 thing to talk about some aspects of the analysis. So 19 I'll, the treatment of correlations he's used in the 20 seismic PRA analysis. And what his methodology, what 21 are the enhancement that these methodology provide?

22 So this analyses aspect can go back to the 23 approach, it was a methodical approach involved in the 24 review of the existing PRAs to see what is the 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

12 significance of the correlations on the analyses, or 1

the dependencies.

2 Review of current literature, and various 3

methodologies that I used. The project also involved 4

workshops with experts. And those workshops were 5

useful. Those are mostly seismic fragility knowledge 6

experts. They provided insights.

7 We questioned them for instance about what 8

is their data? Are they experimental data or 9

experienced data that somehow could be useful in a 10 more data driven approach? And we'll talk about that 11 later.

12 Then we'll talk about what will be the 13 process of implementing this methodology in the 14 seismic PRAs? It's really an obvious process but then 15 what could be issues associated with that, the use of 16 this methodology? Then I will summarize.

17 Right now, I say so that we have to, I 18 guess your introduction already covered that, that the 19 Seismic PRA risk, Seismic Probability Risk Assessments 20 have been done worldwide. And not just in the United 21 States for quite a long time too, more than three 22 decades. And some key aspects there, I guess one of 23 the aspects is that one has to consider all possible 24 earthquake levels in the PRA. And so the frequency of 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

13 occurrence of what we would say, some earthquake size 1

is what we relate to in the seismic hazard.

2 And then do a proper convolution of the 3

fragilities expressed in terms of those earthquake 4

size with the hazard, seismic hazard. That has been 5

addressed.

6 Topic today is that the earthquakes can 7

simultaneously damage multiple, redundant components 8

for example. And then also for similar components, 9

all at the same time. So, and that there is 10 quantification should account for that.

11 I have some pictures here just to try to 12 illustrate --

13 MEMBER RAY: Excuse me, I wanted to ask a 14 question on the slide before. The phrase, "all 15 possible earthquake levels". What does that mean?

16 MR. PIRES: Well, that means that the 17 seismic hazard should encompass the true scope of the 18 hazard. You know, not artificially have a limitation.

19 Is what the results of the probabilistic seismic 20 hazard analysis produce that should all be accounted 21 for in the seismic probability statistics.

22 MEMBER RAY: So there's no limit on the 23 range of probability, or is there a cutoff?

24 MR. PIRES: No, in principle there should 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

14 not be any, I mean. But what happens in practice is 1

that after some levels the probabilities are so small 2

that they can be neglected.

3 MEMBER RAY: Sure.

4 MR. PIRES: But they theoretically are 5

possible.

6 CHAIRMAN RICCARDELLA: Okay. You know, 7

you have a probability of occurrence of an earthquake 8

of various sizes and as the earthquake gets larger 9

obviously that probability goes down. But, you know, 10 they'll consider ground motions from.1g up to greater 11 than 1g. You know, 1g, 2g and they'll consider them 12 incrementally. And then each one of those earthquakes 13 has an uncertainty distribution around it as well.

14 Each one of those --

15 MEMBER RAY: Yes, I understand Pete, I was 16 just wondering if they at some point as he said, the 17 probability is low enough that it's cut off?

18 MR. PIRES: Yes, I --

19 MEMBER RAY: And I didn't know what all 20 possible --

21 MR. PIRES: That's what is meant. And in 22 many ways it's probably -- I don't like it. In the 23 case of the earthquake hazard, you somehow have to 24 choose now that it can come, go over the entire range, 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

15 and both of these very low probabilities. So, you can 1

do that.

2 CHAIRMAN RICCARDELLA: But, I think, also 3

when you say all possible earthquake levels, they're 4

really referring to the peak ground acceleration, 5

which is, you know, the ZPA, the g level of that.

6 They're not considering all multiple possible spectra 7

for a given GPA, are they?

8 MR. PIRES: Yes, the hazard will give us 9

that. For a site, it can give us the ground motion 10 response factor. And so, it dramatically could vary, 11 but normally in the bins of interest, it does not vary 12 much for a particular site. But if necessary, that 13 could be accounted for and make the process more 14 complex.

15 (Off microphone comment.)

16 CHAIRMAN RICCARDELLA: Okay.

17 MR. PIRES: So, I went and got some 18 pictures of earthquakes of first design -- looking at 19 power plant components. This is just to show that 20 sometimes really, we have structures or components 21 that are side-by-side for the same earthquake, and 22 some fail, and others do not fail, for a variety of 23 reasons.

24 And like the Northridge earthquake in 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

16 1994, north of Los Angeles, near the San Fernando 1

Valley. You can see there, some buildings, I think, 2

yes, the ones on the right, the first floor collapsed.

3 It's very typical on some of these old constructions.

4 First floor is soft, collapses.

5 The buildings now have one less story and 6

there are people living on that story or occupying 7

those facilities. Normally they are garages, so there 8

will be loss of life.

9 The performance faction for those 10 buildings typically is no collapse and no loss of 11 life. And the ones on the left, they do have 12 structural damage, but they did not collapse. They 13 are like very close to each other. I'm not saying 14 these are just purely statistical considerations, 15 there may be other factors. But this is an example.

16 Below is an apartment building, it was a 17 similar situation. You can see the ones on the left, 18 in the front have two story. The other on the left is 19 three story. And the first story also collapsed.

20 They are near, they're right next it, they did not.

21 I find interesting the components, the 22 electric power components, designed in a substation.

23 This was in Haiti, and you can see those components.

24 One would expect they all fail, because they typically 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

17 are not very robust for seismic loads. In this 1

particular case, only one failed. The others were on.

2 That does not mean that the substation did not fail 3

because there is a power flow going there, it's a 4

different issue.

5 This is in a power plant, but is not a 6

nuclear power plant in Guam, in an earthquake, and its 7

motor control centers. We don't know if they all 8

failed. But if they all failed they had different 9

failure modes because obviously one had a tilt-out 10 failure mode. The others might have had other 11 functional failure mode. I don't know, but at least 12 the failure modes were different in these phase.

13 Now, actually with the experience data, I 14 caution, sometimes it is very difficult to interpret, 15 because we don't have all information. But in this 16 case one would expect that the ground motion would be 17 similarly, the basic citation would be similar upon 18 all of them.

19 I just put one more here, these are tanks.

20 They are many makeup water tanks at the facility they 21 had built in place. And they normally tend to all 22 fail in an earthquake, but however the failure modes 23 are different for many of them. So there is a 24 possibility not all fail.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

18 In this case, they all had damage. There 1

is buckling off the shelf, there are some anchor 2

supports. So there may have been, they have different 3

failure modes. The one on the bottom right, sliding 4

which I don't understand. So there are issues in each 5

case. Sometimes not so obvious.

6 CHAIRMAN RICCARDELLA: The bottom left is 7

anchorage for the tank?

8 MR. PIRES: It's, I think it's an anchor 9

system that there was a lift off there.

10 CHAIRMAN RICCARDELLA: Yes.

11 MR. PIRES: Some amount of liftoff. I 12 cannot know, may not know the details of those, but 13 these was presented at one of the workshops, and was 14 a few years ago. But it illustrates that in some 15 cases you have multiple failures. Almost all the 16 components or structures fail. In other cases we 17 really don't have, in our observations of those.

18 MEMBER REMPE: Has any effort been made to 19 recently, to try and understand those differences?

20 Differences in anchorages, or there's just not data to 21 try and --

22 MR. PIRES: Oh, no. There --

23 MEMBER REMPE: -- understand this?

24 MR. PIRES: There are a lot of studies.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

19 With tank facilities there are quite a few studies.

1 MEMBER REMPE: Say it again. Could you be 2

closer to the mic? I'm having trouble hearing you.

3 MR. PIRES: With tank facilities there are 4

several studies to understand those behaviors. They 5

may not be looking at the same thing as we do in terms 6

of correlations. But, you know, there are a lot of 7

different, natural gas storage tanks, gas, and other 8

things like that. So these are critical facilities.

9 There is a good understanding of their behavior.

10 MEMBER REMPE: But I mean at Daini, do 11 they know why there were different failure --

12 MR. PIRES: Oh, at Daini?

13 MEMBER REMPE: -- modes as you've 14 indicated here?

15 MR. PIRES: I think this is to be expected 16 that there will be multiple failures of the water, of 17 these water tanks. Now, I have not done an analysis 18 of those. And I have not seen a report on those.

19 MEMBER REMPE: It just seems like, that an 20 important piece of information is to try and 21 understand what data are there, and can you extract 22 some insights from that data? And so examples, not 23 only over in Japan, but in the U.S. If we could try 24 and understand the differences it would be an 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

20 important aspect to investigate.

1 MR. PIRES: That was parts of the 2

workshops on these projects.

3 MEMBER REMPE: Right.

4 MR. PIRES: The workshops for these 5

projects had experts that typically go to every 6

earthquake that has major damage. They normally go 7

there as part of their professional work. They were 8

gathered to the workshop and they provided input. So, 9

and there is some conclusions that came out of that 10 work.

11 MEMBER REMPE: And when I reviewed those 12 conclusions, the data --

13 MR. PIRES: Well that, the data is very 14 difficult to interpret and back calculate.

15 MEMBER REMPE: And that's why I'm asking 16 this question. It seems like where there are data, 17 one should try to understand it before trying to model 18 it. And it's --

19 MR. PIRES: Yes, it's fraught with 20 uncertainties. And to the extent, Fukushima people 21 who developed models, tried to correlate them with 22 what exists in practice. But we cannot trust the data 23 by itself directly. You have to have the modeling, 24 and the knowledge, and the testing.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

21 (Simultaneous speaking.)

1 CHAIRMAN RICCARDELLA: You're probably 2

talking --

3 MR. PIRES: From the aspect HPS.

4 CHAIRMAN RICCARDELLA: You're probably 5

talking a big research project just to model one 6

situation like this. Model all the tanks and, you 7

know, you're probably, it's probably a research 8

project in itself that's of equal cost of this NUREG.

9 MEMBER REMPE: In other fields once you 10 get the model that's based on the data, you turn 11 around and find another place, and see if you can 12 apply that model, and if it can be validated. And so 13 that's why I'm more interested in the data before I 14 get interested in the model.

15 MR. PIRES: It is done. The experts 16 working on the field of tanks for example, they try to 17 always see how their results correlate with data. But 18 there are uncertainties on that.

19 MEMBER REMPE: Yes.

20 MR. PIRES: What happens in the field 21 normally does not have all the information that you 22 would like for a full benchmark.

23 MEMBER REMPE: Yes, I understand.

24 CHAIRMAN RICCARDELLA: Jose.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

22 MEMBER MARCH-LEUBA: I find interesting a 1

couple slides before, it's very visual. One more, 2

there. The picture on the right is really, that one.

3 You had to tell me what happens on the floors, the 4

missing floors. But when I look at that one I clearly 5

see one failed, three that didn't.

6 MR. PIRES: Yes.

7 MEMBER MARCH-LEUBA: Will these be 8

relevant only for only, quote-unquote, marginal 9

earthquakes? So it was, and by marginal I mean an 10 earthquake that is close to the acceleration where you 11 fail?

12 CHAIRMAN RICCARDELLA: Are you talking 13 about the Haiti?

14 MEMBER MARCH-LEUBA: The Haiti one.

15 CHAIRMAN RICCARDELLA: Okay.

16 MEMBER MARCH-LEUBA: I mean this one, it 17 tells me one failed, three didn't.

18 CHAIRMAN RICCARDELLA: Yes.

19 MEMBER MARCH-LEUBA: On the houses you 20 have to tell me what happened. Although it's clearly 21 worse.

22 MR. PIRES: Yes.

23 MEMBER MARCH-LEUBA: But it is only for a 24 small range of Gs that this will happen? If the 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

23 acceleration had been ten percent higher, all of them 1

would have failed? The acceleration would have been 2

ten percent lower, none of them would have failed?

3 MR. PIRES: It's quite possible, it's 4

quite possible. There in this, for this particular 5

components they have prove --

6 MEMBER MARCH-LEUBA: No, but the basis of 7

their method. Is that we're going to separate this 8

plus-minus? Is this plus-minus ten percent? Is this 9

plus-minus 50 percent with random variability versus 10 11 CHAIRMAN RICCARDELLA: I would say, I'd be 12 surprised if ten percent made --

13 (Laughter.)

14 CHAIRMAN RICCARDELLA: -- made that much 15 of a difference.

16 MR. PIRES: I have no idea.

17 MEMBER MARCH-LEUBA: Yes.

18 MR. PIRES: In this particular, the 19 ceramic components on the substation tend to be 20 vulnerable. And so if the earthquake was stronger at 21 site, you almost would expect all of them to fail.

22 However, in this case, those cables going upwards do 23 provide some support.

24 MEMBER MARCH-LEUBA: Oh, they're holding 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

24 it.

1 MR. PIRES: And that might have worked 2

differently for the different components and that made 3

the difference in this case. So it also however, 4

those components, those cables going up, also may pull 5

up the bus that goes overhead. So, you have to 6

consider both cases.

7 MEMBER MARCH-LEUBA: Yes, this goes back 8

to our conclusions. And I know Vesna is going to talk 9

about that. This is going to be almost impossible to 10 recommend. Because you need to know how tight are 11 those cables on top?

12 MR. PIRES: Right. I meant, caution is 13 that as far as nuclear power plants are concerned, 14 this is not a component that appears in the PRA. But 15 it's just an example. It's normally other components 16 appear in nuclear.

17 This crisis in this case is an issue of 18 what are the anchors on these cabinets?

19 CHAIRMAN RICCARDELLA: Go.

20 MEMBER SKILLMAN: Jose, on this image, on 21 the lower left.

22 MEMBER MARCH-LEUBA: Here?

23 MEMBER SKILLMAN: No, the bolt. Very 24 commonly, the construction for that bolt is a J-bolt 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

25 that's been grouted or that's a Hilti that has pulled 1

loose. But in either case, I interpret that to be a 2

four or five inch displacement of the base of that 3

tank against what had been the original forked bolt.

4 That bolt has been pulled loose.

5 MR. PIRES: Yes, probably the bolt might 6

have --

7 MEMBER SKILLMAN: The force that pulled 8

the bolt loose was the ear on the tag that moved 9

upward. It pulled the bolt right out of the ground.

10 MR. PIRES: Yes.

11 MEMBER SKILLMAN: Is that what you see in 12 that image?

13 MR. PIRES: I would say that that is 14 probably the correct interpretation. I would say, 15 because I think there might have been an overturning 16 moment, and the entire force on that bolt might have 17 failed the bolt. And then it was sliding after that.

18 But you could also fail the tank involved, depending 19 on what is the weak link there? So it is, so either 20 can be a weak link. Normally, it would probably, the 21 bolt failure would be the --

22 MEMBER SKILLMAN: Likely, the bolt 23 anchorage.

24 CHAIRMAN RICCARDELLA: The anchorage of 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

26 the bolt, anchor fail.

1 MR. PIRES: Not, the tank link itself 2

would be the buckling. And that does not necessarily 3

mean that there is a leakage of the water. But it is 4

normally assumed that there is. But that does not 5

mean that there is. It might still hold water.

6 There, so I'll just say that normally 7

these, of course all these SPRAs normally involve a 8

set of, a rule-based approach so to speak, on how to 9

deal with the dependent failures. And typically data, 10 two parameters that are important is the similarity of 11 the components at the very high level and the 12 proximity of the components.

13 So based on those two parameters now you 14 have four cases, four combinations, similar components 15 close by, similar components far apart. But a 16 different storage, and dissimilar components close by, 17 and far apart.

18 So the rule-bases account for those cases.

19 And they try to make, I just put there two cases, and 20 not in case I need to go here with all the details of 21 the rule-bases. But obviously they are intent to be 22 close together. They are close together, they are 23 similar normally. And that's the baseline knowledge 24 is assumed correlation on those failures.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

27 MEMBER MARCH-LEUBA: So this is the state 1

of the err. This is what everybody has been doing for 2

the last 35 years.

3 MR. PIRES: That's what people do, yes.

4 But is not the state of the -- I would say it is the 5

state of the practice.

6 MEMBER MARCH-LEUBA: Right. People know 7

better, but they're, right.

8 MR. PIRES: Right.

9 MEMBER MARCH-LEUBA: Now would you explain 10 the logic? And I don't know anything about seismic 11 responsive buildings, but I would expect that if a 12 tank fails on the basement of a building, on floor 13 five, they will fail too. And according to this, you 14 failed them, you have correlation only if you're on 15 the same floor, but not on higher floors?

16 MR. PIRES: Yes, that is a complicated 17 situation. Because if you do a, calculate the 18 structural response of a building, the acceleration is 19 on the floors of the building. So that will be like 20 the new ground for the components mounted there.

21 You can actually calculate the correlation 22 factor between those, the accelerations on the various 23 floors. And you can see that they, the correlation 24 factor actually goes down. Can become small, around 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

28

.2 or.3. You know, if they are on the same floor it 1

will be higher. But if there are different floors, 2

you can start decreasing the correlation factor. It 3

is not by necessarily, it could be 1 or even.5.

4 MEMBER MARCH-LEUBA: My point, just not 5

knowing how this thing is done is, I would have done 6

if one fails, all the ones that are in weaker 7

positions, fail too.

8 MR. PIRES: If the ground motion that is 9

higher than the one with the weakest ground motion 10 fails, then that probably can happen. But there is, 11 the correlation coefficient between the motion of the 12 various floors does decrease with the --

13 MEMBER MARCH-LEUBA: So they --

14 MR. PIRES: -- floor level and the 15 distance.

16 MEMBER MARCH-LEUBA: -- kind of the G 17 forces are smaller on the 5th floor than on --

18 MR. PIRES: Well they normally are higher 19 on the fifth floor. Because there is amplification to 20 the top. But what I'm saying is the correlation 21 coefficient between them.

22 MEMBER MARCH-LEUBA: What I would do if 23 something fails on the 5th floor, doesn't mean the 24 four, three, two, and one are bad. But if something 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

29 fails on one, then two, three, four, and five are bad.

1 MR. PIRES: It depends on -- I see 2

particularly there is an amplification as you go up.

3 There is also a bandwidth on the ground motion. As 4

you go up and amplify, you also have more narrower 5

band ground motion. So, depending on what are the 6

frequencies of the components, and IRS, and then we 7

test those narrow bands and motions. So that also is 8

another effect.

9 CHAIRMAN RICCARDELLA: Tends to go toward 10 the natural frequency of the building.

11 MR. PIRES: Yes.

12 CHAIRMAN RICCARDELLA: And or the mode --

13 MR. PIRES: But in the lower floors the 14 bandwidth is a lot broader.

15 CHAIRMAN RICCARDELLA: Yes.

16 MR. PIRES: Tends to be broader.

17 CHAIRMAN RICCARDELLA: Yes.

18 MR. PIRES: So, and, but that is captured.

19 The response part, yes now is can capture it 20 reasonably well. Is the capacity part in my opinion 21 that is more difficult, for which it is more difficult 22 to establish the correlations.

23 CHAIRMAN RICCARDELLA: So in a seismic 24 puree, does the fragility, the person developing the 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

30 fragility curves, he considers the difference in 1

response say to a.5 g earthquake, between the 1st 2

floor and the fifth floor? That's built into his 3

fragility --

4 MR. PIRES: Yes.

5 CHAIRMAN RICCARDELLA: -- curves. So 6

that's taken into account? So it's, the correlation 7

is different than the magnitude of the response.

8 MEMBER MARCH-LEUBA: I have been told by 9

some experts in this room that that was not the case.

10 But obviously I was wrong.

11 MR. PIRES: How it is, it is.

12 MEMBER MARCH-LEUBA: I was misinformed.

13 MR. PIRES: You try to express all the 14 fragilities in terms of the ground motion at one 15 reference location. But the calculation of that 16 accounts for the transfer function between these 17 locations.

18 So the capacity of the component may be 19 the same but the fragility can change because of the 20 location, and the ground motion varies. So there is 21 a difference there.

22 MEMBER MARCH-LEUBA: Yes, and I can see 23 how the building can because of the natural frequency, 24 can filter some. I mean you could have a high 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

31 frequency, you have less shock upstairs than 1

downstairs.

2 MR. PIRES: Yes, there is some of that.

3 And, you know, the question is how much of that, of 4

the process is involved some type of broaden of --

5 MEMBER MARCH-LEUBA: Yes.

6 MR. PIRES: -- of the motion. And so we 7

are careful to do that. But those effects do exist.

8 MEMBER MARCH-LEUBA: It's a complex 9

phenomenon.

10 (Off microphone comment.)

11 MR. PIRES: Those effects exist. The fact 12 that the ground motion frequency content can change 13 somewhat with the location, and is important.

14 So I guess one part of the background was 15 that of course the methodology makes this bounding --

16 simplifying assumptions. Later on when we talk about 17 the literature review, she'll review our mission that 18 initially there was a set of simply finding 19 assumptions that was more complex than these. But 20 even that set of simply applying assumptions has 21 fallen off somehow.

22 One of, of course sensitivity analysis are 23 always done. I see the analysts pick up a baseline 24 case and they do sensitivity analysis to see how 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

32 important those aspects are.

1 Sometimes people expressed their idea that 2

although these bands are large, you may mask some 3

insights that otherwise would not be masked. If you 4

had data more detailed than all this.

5 And now I would like to mention that the 6

treatment, well I'm not saying that the treatment of 7

dependencies the way it done now is deficient, or 8

somehow inappropriate. The treatment of dependencies 9

depend on the intended use of the results. And what 10 is the need for those results?

11 So that is one aspect, and so that I would 12 like to caution that the other thing is that the 13 methodology that was developed that here, that might, 14 will need further demonstrations and development.

15 But its use in those further 16 demonstrations will definitely, are going to depend on 17 our rising uses or needs.

18 CHAIRMAN RICCARDELLA: Yes.

19 MR. PIRES: To my understanding the 20 current uses and needs, what has been used, seems to 21 be sufficient. But that may change.

22 CHAIRMAN RICCARDELLA: Okay.

23 MR. PIRES: So, I think particular 24 applications, that some more elaborate studies have 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

33 been that.

1 CHAIRMAN RICCARDELLA: You know, I think 2

going back to the previous slide, I think it's, to me 3

an important point is that insights that you might 4

get. You know, for example if you have three pieces 5

of equipment, maybe it would be smart to just change 6

the mounting a little bit.

7 Make it, you know, come out and rotate 8

them or put different size gaskets in there, or 9

something. Just anything to make them not identical.

10 You might reduce the -- you know, if it turned out to 11 be significant it could have a significant --

12 MEMBER MARCH-LEUBA: But only for those 13 pieces or components of the SPRA, defined as critical.

14 (Simultaneous speaking.)

15 MEMBER MARCH-LEUBA: And which would be 16 one or two, it won't be the whole plant.

17 CHAIRMAN RICCARDELLA: Yes, I would think 18 the sensitivity analysis, you'd say well, I'll do it 19 one way with everything 100 percent correlated. I'll 20 do it a second time with everything percent zero 21 correlated. And if the core damage frequency comes 22 out the same, obviously doesn't matter, right.

23 MR. PIRES: In this, one of the slides 24 later on says, of the implementation, all the use of 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

34 these, what will be the process for use these? And of 1

course the process is iterative. It starts with 2

simply finding assumptions based on that, you identify 3

those few, you know, cut-sets or accident sequences 4

that need to be further refined and investigated.

5 CHAIRMAN RICCARDELLA: Yes.

6 MR. PIRES: And you'll proceed that way.

7 MR. REISI-FARD: Can I provide a comment 8

on that question?

9 MR. PIRES: Sure.

10 MR. REISI-FARD: So this is Mehdi 11 Reisi-Fard. I'm an acting team lead in the Office of 12 Nuclear Reactor Regulation. On the point that you had 13 with respect to sensitivity analysis, in fact that's 14 what the licensees do in some risk-informed 15 applications like 50.69.

16 As a part of the NEI guidance to do those 17 50.69 evaluations, when they use seismic PRA, it is 18 recommended to do, to assume full correlation and no 19 correlation on the same floor, to just get their --

20 sites.

21 So that's part of the guidance that the 22 industry is using currently for some of those 23 applications.

24 CHAIRMAN RICCARDELLA: Yes, thank you.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

35 MR. PIRES: Yes, I'd like to put this 1

first bullet, you may think of it as a disclaimer, but 2

I don't want to claim that what the current practice 3

is necessarily not a good practice, you know. This, 4

so I will go back what was the objective of the study.

5 You know, the 2010, 2014 seismic constructional 6

research plan in the Office of Research, initiated 7

this study.

8 And those are the objectives of the study.

9 So a lot of these topics, and if feasible to propose 10 some refinements to the methodology that could provide 11 those additional refinements, or could be more precise 12 for needs that at that time were thought that might 13 come up.

14 And at that time there were some studies 15 going on, severe accident studies going on, that 16 motivated part of this study, even though they were 17 not PRA studies. The Level 3 PRA project was going to 18 start. There was talk of modular reactors coming for, 19 even though that far back there was already talk of 20 that. And then that subsided somewhat, and then along 21 it came it back again.

22 So, the Office was being prepared to 23 address these issues. And this, the goals of course 24 are that somehow the review that the report did, the 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

36 opinions of the experts on the components that 1

typically appear as critical, and that appear on the, 2

as important in terms of dependencies, and other 3

information there, could support staff reviews or peer 4

reviews, you know. It's tool that could be consulted 5

and used in those reviews.

6 And so, the methodology depending on the 7

needs of potential applicants, and our staff in terms 8

of their reviews could provide more insightful 9

approaches.

10 Now the scope of the work as defined in 11 the statement of work, it said, first part was, assess 12 the impact of correlation and some different 13 assumptions on the results of seismic PRAs that have 14 been done to date, and that they read about. This 15 concentrated on core damage frequency. They reviewed 16 17 And so then, the other part was what we 18 talked before. The review of what, an identification 19 of an analysis method that could be an improvement, or 20 thought it is now, but will not necessarily be a very 21 cumbersome method. That will not involve a level of 22 effort and work that would be another of magnitude 23 higher. But maybe 50 percent more level of effort.

24 So, and that was the intent there.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

37 The third way, the third is of course 1

identify a pathway so that this methodology could 2

become standard. That of course is a more, does not 3

depend on the NRC. Depends on the need of the 4

industry.

5 MEMBER SKILLMAN: Jose, before you move 6

that slide, for the first two bullets, how many 7

examples, or how many calculations, or how many --

8 what is the population of the review, as you point to 9

these two bullets?

10 MR. PIRES: Okay.

11 MEMBER SKILLMAN: Is it 100 samples, 80 12 samples, 500 samples?

13 MR. PIRES: Right, the project really 14 reviewed what existed into analysis by themselves.

15 But they reviewed 20 PRAs, 20 cycling PRAs. Some were 16 done in the last ten years, other were done probably 17 ten to 20 years ago. So there were already were the 18 ways of doing the PRA during that timeframe.

19 The analysis methods that I used, yes 20 several were reviewed. Some very simple method like 21 what they call split fraction method, to more 22 complicated methods like the Simex Safety Modular 23 Research Program, then at Livermore. I don't know if 24 you heard of that. Simex Safety Modular Research 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

38 Program done at Livermore, supposedly by the NRC.

1 Really involved defining for cut-sets, a 2

joint probability distribution fraction. For the 3

response in the capacity and then integrating the two 4

together to calculate what was the probability of 5

failure. Was a very complex and detailed approach, 6

and that was used in designing PRA. So this addresses 7

the second bullet. So that is more complex approach, 8

and in many ways, the more rigorous approach.

9 And that yielded a set of rules. More 10 complicated than the ones used now, but still simple.

11 So we reviewed the entire scope of methodology that 12 had been used and proposed.

13 MEMBER SKILLMAN: Thank you.

14 MEMBER REMPE: So later you cite the 15 impact of those assumptions. And you do, as you noted 16 in the first bullet, focus on CDF. What would have 17 happened, you know, how important would it have been 18 if you'd focused on the risk impact versus the 19 frequency impact. Would you still have 30 to 60 20 percent, and up to a factor of 2 to 4? I mean are 21 these important from a risk perspective as well as a 22 frequency perspective is what I'm trying to --

23 MR. PIRES: In terms of the --

24 MEMBER REMPE: Of the studies you 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

39 reviewed?

1 MR. PIRES: -- risk of consequences, you 2

3 MEMBER REMPE: Right. I mean are we 4

looking at things that are not really risk important 5

sequences? And okay, you say well it could be up to 6

a factor of 2 to 4 for some of these sequences. And 7

does it impact risk as much as it does frequency?

8 MR. PIRES: I think you're if you start --

9 right. This was outside the scope of the work, so I 10 cannot really tell you. And also there are very few 11 PRAs that have gone that far.

12 MEMBER REMPE: But you looked at those two 13 or three, or whatever you looked at. And I'm just 14 wondering what was the impact on risk of those PRAs?

15 MR. PIRES: I would be speculating.

16 (Off microphone comment.)

17 MEMBER MARCH-LEUBA: Are you implying that 18 different core damages have different risk, different 19 consequences?

20 MEMBER REMPE: Yes, I mean okay, the 21 frequency could, they're quite, this differences of 22 frequency, or what they're giving values of, and so, 23 yes, you can have core damage where you have a big 24 release. And you can have core damage when you don't 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

40 have squat coming out.

1 And that's what I'm asking. And are we 2

focusing on something important or not is where I'm 3

getting to?

4 CHAIRMAN RICCARDELLA: But do seismic PRAs 5

address that, or that they just compute a --

6 MEMBER DIMITRIJEVIC: Well core damage 7

frequencies, least measure. It just will at least 8

measure the large release frequency for example. Not 9

too many seismic things went to the Level 2, or Level 10 3 that you can compare it. That's at least my 11 understanding.

12 MR. PIRES: And the regular --

13 MEMBER DIMITRIJEVIC: And they're only 14 special things. Because those frequencies, also these 15 measures, so it's a large release which is next 16 running through the consequences, and then you have a 17 Level 3, which is, you know, public release which is 18 different thing.

19 But the seismic so far, I mean I only saw 20 core damage frequencies, but I'm sure that now new 21 ones are also producing land releases, right?

22 MR. PIRES: I think so.

23 MEMBER DIMITRIJEVIC: Yes, yes so.

24 MR. PIRES: Now they are.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

41 CHAIRMAN RICCARDELLA: What was that last 1

point? I missed that.

2 MEMBER DIMITRIJEVIC: I think that those 3

sites will now, when they're handling this seismic 4

PRAs is a part of this 2.1 initiative. I think they 5

are going to the large release too.

6 CHAIRMAN RICCARDELLA: Okay.

7 MEMBER DIMITRIJEVIC: But I don't know the 8

ones which you reviewed, these 20 PRAs, did they have 9

releases?

10 MR. PIRES: The one I, no they did not.

11 Some of the ones that -- one of the PRAs that were 12 more complex were the NUREG-1150. You know, some of 13 those went to large, to releases, but not for seismic.

14 The seismic part ended before that, was not continued 15 all the way there.

16 MEMBER MARCH-LEUBA: Because for that you 17 would have to consider correlation between this C 18 pumps over here, and failure of the containment.

19 MR. PIRES: Yes.

20 MEMBER MARCH-LEUBA: And you will have to 21 consider that correlation on top of the other one 22 which is already a difficult to have.

23 MR. PIRES: I don't want to steer away 24 from the topic, but some of the multipatient from the 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

42 study back in 2010 time to '12 timeframe was the 1

SOARCA study. Because you had some sequences and 2

eventually the containment, there would be a release 3

and others. And so but in the end, were never used 4

there obviously.

5 The report work was turned in before and 6

that was not the risk study. It was a severe 7

accident, yes. So you can see that, yes, it was along 8

those lines. Also you have to bring evacuation 9

issues, relocation issues, and there those are also 10 another type of problem. And at this moment NUREG-11 1150 been stopped before, before that part is external 12 hazards.

13 And this, I talk a little bit about the 14 analysis aspect because we keep talking about the 15 methodology that somehow was proposed. And might be 16 better. And I felt, don't want to delay that too much 17 before going back to some of the review of the 18 literature.

19 And so it might, I think what the authors, 20 if I could put myself in their frame of mind, the way 21 I understood it, is that so these dependencies really 22 arise on the system analysis part of the -- when you 23 do the fragility analysis for a component, you don't 24 have this issue. You're talking to a single component 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

43 there.

1 So in the system analysis sometimes you 2

would have a set, or a subsystem that involves various 3

components, and the performance of that subsystem is 4

a Boolean expression. Simplest one would be the 5

series, the components in parallel, where if you 6

assume dependency, it will be an upper bound estimate.

7 Those are the AND gates. And OR are the ones in 8

series, which is the converse way, that is simple.

9 So in the end what you really get out of 10 that is a fragility fraction. Even though much has 11 been the fragility of one of the components. Or a 12 multiplication of the fragility, but you really get a 13 fragility fraction that represents that subsystem.

14 So the multipatient of these researchers 15 was a --

16 MEMBER RAY: Wait.

17 MR. PIRES: Yes.

18 MEMBER RAY: I waited to ask a question 19 before you changed that slide.

20 (Off microphone comment.)

21 MEMBER RAY: Well, I thought I'd pressed 22 it but I didn't, hadn't. This is a -- I started to 23 say an unfair question maybe, but nevertheless I've 24 got to ask it because it's hanging on my -- would you, 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

44 in talking about the AND gates, structures and some 1

components in parallel. It makes me think as somebody 2

who operated plants for a long time, what do we 3

assume, or is it relevant to even think about what the 4

tech specs require in terms of, being in service?

5 In other words, I've got three pumps but 6

I only have to have two of them in service. And I can 7

take one of those out for a week. Does that ever 8

enter into these analyses? Maybe Mehdi could shed 9

light on that --

10 MR. REISI-FARD: The short answer is yes.

11 So the reliability or availability numbers that are 12 already included in PRAs, they do take into account, 13 you know, taking certain SSCs out of service for a 14 period of time. So the numbers in the PRAs, the 15 availability numbers in the PRAs take into account 16 that factor.

17 MEMBER RAY: Okay, and that's good to 18 hear. I assumed it wasn't germane to exactly what we 19 were talking about here, but nevertheless it was a 20 question that I had because systems required to be in 21 service is sometimes a real burdensome requirement 22 that people back away from in actual practice. And 23 that's what I was interested in.

24 MR. REISI-FARD: And I used the word 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

45 availability, I should have said, unavailability.

1 MEMBER RAY: Yes, well that's fine. Thank 2

you.

3 CHAIRMAN RICCARDELLA: And just help me on 4

that first subbullet that you have the SSSs. Is that 5

a typo, is that supposed to be SSCs?

6 MR. REISI-FARD: Yes.

7 CHAIRMAN RICCARDELLA: I just wanted to 8

make sure we weren't introducing a new acronym here.

9 I have enough trouble --

10 MEMBER REMPE: Wise.

11 (Off microphone comments.)

12 MR. PIRES: Sorry. So what was, what's 13 done here was to try to say okay, this is, these 14 dependencies issues are right, getting the system 15 analysis process. But in the reality what you are 16 trying to do is that for that subsystem where the 17 dependencies may be significant and important, you're 18 really trying to calculate a new fragility fraction 19 for those. It is essentially what you are doing that 20 those sets of rules are doing that, using what 21 fragilities that you already have.

22 So the approach was to see okay, what, how 23 are these fragility fractions calculated for each 24 component? And then break down the process into 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

46 various factors that have some physical meaning or 1

engineering meaning, so that you more easily would be 2

able to break down what are the parts that would 3

likely be correlated there. So that was the approach 4

that was done here. And so then the methodology could 5

then provide this spectra between fully correlated and 6

independent.

7 I tried to put here something just to try 8

to show what I just said. And I'm not trying to come 9

much more intent in terms of these equations, but in 10 the seismic fragility, normally is expressed in terms 11 of a ground motion level. A, so it is expressed in 12 terms of the median of that ground motion level, that 13 in this case represents the capacity of the component.

14 Can it resist that ground motion level?

15 And then two random variables, one they 16 will refer to it as the random uncertainty. And the 17 other the epistemic uncertainty. And normally this 18 process is simplified by saying that the fragility can 19 be expressed in terms of effect of safety, times a 20 reference level earthquake. The spectra of safety is 21 really just scales of these, but it's just a 22 convenience. Now --

23 CHAIRMAN RICCARDELLA: The reference level 24 is like SSE, or OBE?

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

47 MR. PIRES: Could be the SSE, or OBE, or 1

at the given as a level, being say, the ten to the 2

minus four if you are talking about, if we think the 3

dominant being, would be around that level, ten to the 4

minus four, as a -- this, so you have that factor of 5

safety.

6 So it is component, capacity, components 7

and it is seismic response components, and those are 8

even further broken down into either the capacity as 9

some, these are strengths. The other is the 10 ductility.

11 The partial factors for the seismic 12 response have many parameters like the uncertainties 13 on the spectra of the ground motion. How you combine 14 the mode shapes, to the substructure direction. So 15 the transfer function that brings you the ground to 16 the various floors that you asked about.

17 So what this method does is that if you 18 have various components in that cut-set, in that 19 Boolean expression A, B, C & D. You are going to try 20 to find out what is the correlation coefficient on 21 those uncertainties. When you got to the epistemic 22 uncertainties that

are, what part of those 23 uncertainties between A&B, and B&C and D is really a 24 correlation coefficient, the co-variance?

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

48 CHAIRMAN RICCARDELLA: Could we go back to 1

the previous one, and just help me with what all those 2

F factors are on the bottom.

3 MR. PIRES: Right, I know this is a bit 4

hard.

5 CHAIRMAN RICCARDELLA: I understand, you 6

know, capacity and response, okay. But then the next 7

one, are you saying that the capacity breaks down into 8

that F sub S, and F sub U?

9 MR. PIRES: Yes, that is the capacity they 10

-- it is for fragility analysis not for design. Is 11 that if you have for instance a sheer wall on a 12 building, you know what the distress of that sheer 13 wall. But you know that it may have some ductility.

14 And so because of that ductility, it can actually take 15 higher seismic loads. Not just the ones that goes to 16 the region that's strained. So the analysis is 17 rigorous and accounts for this.

18 I don't want to make your discussion on 19 all the fragility analysis done, but that it has all 20 these factors appear there. So when the analyst --

21 CHAIRMAN RICCARDELLA: Just tell me what 22 some of those subscripts stand for.

23 MR. PIRES: Okay, so the first one on the 24 response factor, the first one, SA, stands for the 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

49 uncertainties on the response factor of the ground 1

motion. If you have a frequency, say 5Hz, you know 2

what is the median value of the spectral acceleration.

3 But there is an uncertainty about that.

4 CHAIRMAN RICCARDELLA: Okay.

5 MR. PIRES: So that they are accounted 6

there. D is the damping. We may not know as well the 7

damping of the structure as we think we know. M, now 8

I'm a little worried about what this M, I forgot, but 9

it will probably come back.

10 But MC is the model combination rule that 11 you use. You have to combine all these mode change.

12 EC is how you combine ground motion in different 13 directions, because the earthquake goes actually in 14 all directions. You know, you just cannot do an 15 analysis for one.

16 CHAIRMAN RICCARDELLA: Yes.

17 MR. PIRES: And so that's EC. And SD is 18 the depth. If the structures are embedded, you know, 19 you normally tend to reduce the forces on the 20 components but there are uncertainties also. That 21 also brought uncertainties.

22 CHAIRMAN RICCARDELLA: Yes.

23 MR.

PIRES:

And the SS is the 24 soil-structure interaction. You know, when you 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

50 interact the structure is not in -- it couples with 1

the ground and some energy is radiated away --

2 CHAIRMAN RICCARDELLA: Right.

3 MR. PIRES: -- and changes the resonant 4

frequency. So these are factors that appear on the 5

calculation of the response. Every one of those has 6

a random uncertainty and epistemic uncertainty.

7 CHAIRMAN RICCARDELLA: Yes.

8 MR. PIRES: And so what is the first is 9

trying to do here? What they try to do is if you add 10 several components, a component A and a component B, 11 or a B and C, a component B and a component C, you 12 will try to see on that ER and EU, what part of that 13 uncertainty between those two components is really 14 correlated?

15 And so you will break down the uncertainty 16 into correlated and then what it is for the component 17 itself is independent.

18 MEMBER MARCH-LEUBA: Since Pete brought 19 the math, why do you combine the certainties in a 20 multiplicity of sense, instead of being like the sum 21 or the sum of the squares, or -- does that make sense?

22 MR. PIRES: The uncertainties are going to 23 the sum of the squares.

24 MEMBER MARCH-LEUBA: I thought they 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

51 weren't.

1 (Simultaneous speaking.)

2 MEMBER MARCH-LEUBA: Well, those Fs are 3

not uncertainty?

4 MR. PIRES: Those Fs are not the 5

uncertainties.

6 CHAIRMAN RICCARDELLA: Those are factors.

7 MR. PIRES: Each one of those Fs is equal 8

to a median times two uncertainty factors. One for 9

random, one for epistemic. So those Fs are the 10 factors themselves.

11 CHAIRMAN RICCARDELLA: Yes.

12 MR. PIRES: And that factor is now, F, 13 those factors, each one of those factors has an 14 expression like the first one above.

15 CHAIRMAN RICCARDELLA: As a mean plus a 16 distribution.

17 MR. PIRES: Plus two factors on all you 18 vary around the mean.

19 MEMBER MARCH-LEUBA: Okay, so there was a 20 reason to the madness, and I believe you.

21 MR. PIRES: Right, right. No, it is the 22 way to account for all those factors there. So until 23 the uncertainties on all those are combined into the 24 sum of squares, and the square root. And essentially 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

52 what the method is trying to do is really almost like 1

finding a set of accumulating dependent random 2

variables in which they try to separate what is 3

correlated from what is not correlated between pairs 4

of components. But without necessarily throwing away 5

uncertainties.

Still trying to preserve the 6

uncertainty, but allocating it.

7 Now if you go and allocate the uncertainty 8

at the high level there on the first line, that may be 9

too abrupt, may be very judgmental. The idea of 10 allocating the uncertainty through this method is that 11 each one of those components you may have more 12 engineering insights, to say what is to be correlated 13 or not. For instance in the response we can actually 14 have an analytical way to somehow calculate 15 correlation. And the capacity is more difficult.

16 MR. PIRES: All right, so I move forward.

17 And now, what are uncertainties on this process? So 18 this process demonstrated in the report for various 19 cases. But the report really does not go to the, 20 starts more or less focus on the first line there.

21 They don't go into detail to the bottom line, but 22 that's necessary. So I just want to mention that, why 23 it is necessary?

24 Because of the uncertainties, because and 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

53 different analysts may come up with different results.

1 So the more you try to break down and things limit 2

you, you have really engineering understanding and 3

meaning.

4 So, all you allocate what is correlated on 5

the uncertainty, to what is independent is subjective 6

in some ways. So there is engineering judgment. But 7

if you break down to those basic variables, and then 8

mathematically bring them back up to the higher level, 9

you have a process that is more transparent, so to 10 speak. That's the intent here.

11 Now, talk a little bit about the parts of 12 the study. So the review of the SPRAs was processed.

13 The impact of the assumption, the predicament of 14 dependencies. And the conclusion there was that 15 almost all SPRAs have used rule-based approach. And 16 simple rule-based approach is perfectly correlated, 17 totally dependent, and can date sensitivity analysis 18 of those.

19 There have been a few exceptions, like I 20 mentioned before, the Zion SPRA is an exception on the 21 Seismic Safety Margins Research Program. So a very, 22 these were done in the late, early, 70s. So there was 23 a lot money to do these research projects, and we were 24 learning. I mean what we do now, we learned from 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

54 those projects.

1 And the Diablo Canyon SPRA also uses more 2

complicated set of rules. It essentially started with 3

the SSMRP approach, and then simplified to those rule-4 based approaches, but not just a direct use of them, 5

more complex.

6 And so reviewed ten SPRAs. I think I told 7

you 20, but it was a mistake. It was only ten, and 8

that is the CDF range, so there was a broad range of 9

CDF and the conclusions were those that sometimes 10 there was a difference by a factor of two. But the 11 more typical difference in the bottom line number is 12 30 to 60 percent. But some specific accident 13 sequences could be more. And so the, for several 14 SPRAs there really was not much of a sensitivity of 15 the result to the dependencies.

16 MEMBER MARCH-LEUBA: Remind me again on 17 that first bullet the factor of two, are 30 to 60 18 percent, is that by setting all correlations to one 19 and all correlations to zero on the difference?

20 MR. PIRES: Yes.

21 MEMBER MARCH-LEUBA: Good. Thank you.

22 MR. PIRES: Great. Yes, and the --

23 CHAIRMAN RICCARDELLA: 30 to 60 percent on 24 CDF?

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

55 MR. PIRES: On CDF. But on particular 1

sequence is, and this where we talk about the 2

insights, is the factor was high and it could be two 3

to four.

4 MEMBER MARCH-LEUBA: Well, there are 5

sequences that don't really contribute that much to 6

the final numbers, is that correct?

7 MR. PIRES: Or there may be more than one 8

sequence that contributes. There may be three or four 9

sequences that contribute and the others are not so 10 sensitive.

11 The cases normally where the dependencies 12 were not significant, or the cases where there was a 13 sequence that controlled the CDF and one component on 14 that sequence. But they call it a single --

15 apparently that's the term they use. And those 16 happen. It's --

17 MEMBER MARCH-LEUBA: Can you give us an 18 example? Where will be the single component that is 19 the dominant?

20 MR. PIRES: I can't tell you an example 21 from my sequence --

22 MEMBER MARCH-LEUBA: From the many plans?

23 MR. PIRES: Yes, from a pilot study that 24 EPRI did. I think in that plan that there were some 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

56 sump pumps, there were actually several, but they all 1

are damaged by the collapse of the building. And so, 2

and those apparently were the main factor from --

3 MEMBER MARCH-LEUBA: So the collapse of 4

the building is the single --

5 MR. PIRES: Yes, and damages all of them.

6 That's the assumption. We already know by the way, 7

that buildings not all collapse entirely but that 8

there are parts of a building may collapse, others 9

not, but that was a refinement that was not used and 10 is not really used yet and I think that was one of the 11 cases. But I may be wrong but that's my recollection.

12 MEMBER REMPE: So --

13 MEMBER MARCH-LEUBA: I think it's a work 14 example.

15 MR. PIRES: Yes.

16 MEMBER REMPE: Years ago, I used to work 17 for a company that had a paper reactor design. And so 18 when they did their seismic study for the paper 19 reactor design, they could get the release because 20 they would just assume, look for the release of the 21 sequence of with all those components failed.

22 Like in the Zion PRA, it seems like one 23 could go back to the nons, the regular PRA and get 24 those releases for those sequences that were deemed to 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

57 be important here. If it's only a few sequences that 1

are important, I think you could get some insights on 2

is this important to risk from the information that is 3

available.

4 And so I guess I'm still pushing. I think 5

it should be explored. Are these things really 6

important to risk if it's just 10 PRAs and a few 7

sequences in those PRAs?

8 Is, I don't know how, I've seen some of 9

the Zion one and some of these PRAs that seems like 10 one could find some of that information.

11 MR. PIRES: Yes. I think you could find 12 a nice, I'm pretty sure the authors of this study will 13 know some of that information because they deal with 14 these issues predominately and so they will know some 15 of that.

16 And the, a lot of these, the benefits of 17 some of these may be more for new designs because what 18 already exist there is we don't have much in terms of 19 what to change.

20 The, so one of the interesting parts of 21 those reviews was that it looked like there was some 22 set of components that tend to keep appearing on as 23 being critical and some are relevant for these 24 dependencies.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

58 And they identified in the

study, 1

identified if you are listing them there. I don't 2

want to go in more detail other than to say that they, 3

the workshops also questioned the participants to 4

force them to say what are the aspects of those 5

components that really may make then really be more or 6

less significant in terms of dependencies. For 7

instance, the tanks, they tend to be fabricated 8

locally so there are some variations actually.

9 So in that regard, in terms of the 10 capacity, there may be some independence. But when 11 you have some things fabricated in a factory and put 12 together there may be more correlation between them.

13 However, the anchors are done locally so that's more 14 uncertainty.

15 So but they're at least collecting some 16 input from experts there. Now the review of the 17 literature like I said before, all the methods were 18 reviewed. I'm not going to go here over all the 19 methods. I don't think there is a point in doing 20 that. I just like to provide a broad scope.

21 Of course the more rigorous one was this 22 SMRP approach in which equity joint distributions were 23 done for the capacity and the demands for components 24 in a cut-set or in a Boolean expression and those were 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

59 actually numerically integrated over the failure 1

region and they were used in design PRA.

2 One of the benefits of that was that one 3

of those authors of those studies, Mr. Bohn and Mr.

4 Lambright, both of them, but Bohn seems to have been 5

the name which will be associated with it, came up 6

with rules that people use and that were simpler.

7 And but those rules were even deemed too 8

difficult and too complex so they're further 9

simplified.

10 I just show you the rules here. You can 11 see that in some points these

rules, these 12 correlations coefficients of.05 and.75, those were 13 abandoned in the current practice. People went back 14 to minus zero.

15 MEMBER SUNSERI: This is a more complex 16 set of --

17 MR. PIRES: A more complex set of rules on 18 rules. But even this complex set of rules is not used 19 in practice.

20 MEMBER CORRADINI: Because it's too 21 complex?

22 MR. PIRES: And to that point I think was 23 because probably the effort needed did not justify the 24 intended use of the results, of the PRA, I think.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

60 But now that of course as the odds have 1

increased and so forth, so in some cases it might be 2

more important to do, to at least bring some of those 3

aspects into place.

4 So when they study and review of all the 5

approaches, they come up that these older approach by 6

Mr. Reed and McCann -- by both of them, mostly Reed, 7

you won't find McCann on these there -- that this 8

approach based on what I described before, it goes 9

back to all the fragility and models done by the 10 component.

11 All those factors are isolated and get out 12 from there, because some of those factors, mostly you 13 have some engineering meaning and there's an 14 understanding of those, you could separate what could 15 be correlated from that, but there is still 16 subjectivity. There is still room for some judgment 17 there, so.

18 But and it's not very difficult because 19 you essentially are going to really, you already have 20 that information from the fragility allowed for the 21 components, and you can program the process that is 22 there and implement. So there is an advantage.

23 In my opinion, of course, because there is 24 some room from subjectivity there, it is the more you 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

61 break down in the basic components and then work up 1

from those, the better. The other is that the method 2

is simplified so may warrant the comparison with more 3

rigorous methods which exist, but they are very 4

complicated but are used in practice. And that is not 5

really the object of major research. That's just a 6

graduate student master's key system.

7 The other part was review of existing data 8

and I guess initially the researchers taught that 9

there could be, it would be possible to get data so 10 that the approach would be a more data-driven approach 11 but it is not possible. The data is just not there 12 and it would be very extensive.

13 MEMBER CORRADINI: Because it doesn't 14 exist or because it's too complicated to analyze?

15 MR. PIRES: Both. No, the aspect 16 experience data is too complicated to analyze. There 17 are a lot of uncertainties on those. And so far, it 18 has been proven very difficult. You know, the access 19 to the data plus the uncertainties.

20 MEMBER CORRADINI:

Is there other 21 industries that care enough about seismic response 22 that this approach has been taken or a simpler 23 approach has been taken?

24 MR. PIRES: Yes. There is a, actually, in 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

62 our work, there is an approach that relies a lot on --

1 experience data.

2 MEMBER CORRADINI: Say again, please?

3 MR. PIRES: In the nuclear power plants, 4

I don't know if you ever heard about seismic 5

liquefaction, soil liquefaction --

6 MEMBER CORRADINI: Yes.

7 MR. PIRES: -- during an earthquake.

8 Ultimately, the approaches for soil liquefaction are 9

experience-based. There is always even, because it is 10 your technical problem involves soils and so forth.

11 The laboratory samples are typically very small.

12 There is a large effort to connect to an 13 experience data. And the uncertainty still is large 14 and disparity of many disagreements on authoring that 15 data, but it has become necessary to do that. So 16 that's a success story on use of earthquake experience 17 data.

18 MEMBER CORRADINI: What I guess I'm trying 19 to get is, is there, I'm trying to connect back to 20 your multifactor formula --

21 MR. PIRES: Okay.

22 MEMBER CORRADINI: -- which is some sort 23 of benchmarking of the approach that might be used in 24 difference to the heuristic rules that are currently 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

63 used.

1 MR. PIRES: Yes. I think the benchmark, 2

it probably would have to be done with shake table 3

testing data.

4 CHAIRMAN RICCARDELLA: I think the problem 5

with shake table testing though is that in equipment 6

qualification, you don't shake it to failure. You 7

just shake it up until a certain level. If it doesn't 8

fail, it passes and you're done. So you really don't 9

get any data about correlation or even about the 10 failure level of a piece of equipment, right?

11 MR. PIRES: I think that's one of the 12 issues of the test data on shake table. The more the 13 fragility analysis is amenable to analytical approach 14 is the easier it is to use this methodology. But 15 equipment, sometimes that not so easy to do.

16 CHAIRMAN RICCARDELLA: Yes, oh yes.

17 MR. PIRES: You know, for some equipment 18 changes you can do analysis, but for other equipment 19 you cannot do that. One possibility would be to, 20 there are very large shaking tables of detail that 21 maybe while there you could put multiple components on 22 the shake table, orient them in different directions 23 but you see that they have collect data. But that's 24 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

64 CHAIRMAN RICCARDELLA: You still have to 1

shake them to failure, you're not --

2 MR. PIRES: Right, you still have to shake 3

that to --

4 CHAIRMAN RICCARDELLA: You still have to 5

shake them up to a certain level and nothing fails, 6

you don't learn anything, right?

7 MR. PIRES: Yes, you will need to shake 8

them to failure until probably all of them are failed 9

in the table. And that would have correlated ground 10 motions but then you should isolate the capacity part 11 though because you --

12 CHAIRMAN RICCARDELLA: Yes, yes.

13 MR. PIRES: But to do that, you have to 14 have adjudication in that is it necessary to do that 15 for the use intended? But that will be, for some of 16 these aspect experience, in some cases you can find 17 the information but is not common.

18 MEMBER CORRADINI: So let me ask the 19 question from a justification standpoint. So I 20 thought your slide number, maybe I misunderstood the 21 conclusion you had in the slide, which was Slide 19, 22 which is it made a 30 to 60 percent difference on CDF.

23 MR. PIRES: Well, it --

24 MEMBER CORRADINI: Typical difference in 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

65 the range of 30 to 60 percent.

1 MR. PIRES: Yes.

2 MEMBER CORRADINI: So is that enough of a 3

difference to warrant this, excuse my English, complex 4

analysis approach?

5 MR. PIRES: It depends on the use of that 6

result. I think it, I, you know, if you start going 7

in terms of the total risk or are you just separating 8

the risk for each seismic cause, simple seismic 9

causes?

10 MEMBER CORRADINI: That last part, I'm 11 sorry?

12 MR. PIRES: Suppose you are interested on 13 the total risk for the facility, not just from the 14 seismic concept which I understand could be between 15 five to 50 percent of the total risk in terms of CDF.

16 But now you start bringing the fire, you start 17 bringing the internal events, and higher range, and 18 combining all the hazards together. Then you get that 19 risk that you may need to see where can you obtain a 20 more accurate results and so that you can open risk 21 inside safety insights --

22 MEMBER CORRADINI: Okay.

23 MR. PIRES: -- and to address that. So in 24 those situations I can possibly see that that could 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

66 happen for an operating plant but I've not seen any 1

case like that.

2 MEMBER MARCH-LEUBA: This is not unusual 3

for this application. We see this in the nuclear 4

industry, especially on -- an example I always mention 5

is over pressure events where you analyze how close 6

you are from the level C. All plants are like two PSI 7

from it because this started first with a cheap 8

analysis. You ran it, good. A cheap conservative 9

analysis. You run with it you stop.

10 If you

fail, you go to a

more 11 sophisticated analysis. You fail that one, you go to 12 even more sophisticated analysis until you pass. And 13 all of them are perfectly good analysis so this is a 14 similar thing. So this will be only applicable for 15 plants that are close to a limit and where 30 percent 16 makes a difference.

17 MR. PIRES: Yes. It, and typically when, 18 Mehdi is here, he can correct me. I went to a meeting 19 recently in which there was an issue and obviously the 20 hazard is low and the plant was designed, the job is 21 design it for a minimum capacity. In that case you 22 probably don't need to do these things. The other is 23 very high and like in the, that case of Diablo Canyon, 24 all of the studies were done in some level of rigor.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

67 If some of those plants closer to that 1

higher hazard situation in which the original design 2

might have missed the hazard, that would have more 3

critical. Otherwise it's new designs.

4 MEMBER MARCH-LEUBA: And my personal 5

philosophy, preference if you want to, and so for 6

spending the money doing an analysis, going forth with 7

some of those components and make them better. Spend 8

the same money and Well, just spend the money on 9

paperwork or actually reinforced beams, put some 10 reinforced beams.

11 MR. PIRES: Well, what the analyst can't 12 tell you is what each wants to do that.

13 MEMBER MARCH-LEUBA: That is where the 14 value is.

15 MR. PIRES: Yes, that would be the value 16 because it's not expected that there will be many if 17 that case would happen. I've not seen any case but 18 the analyst could tell you which one of those.

19 MEMBER MARCH-LEUBA: You know there is 20 going to be cheaper to bring forth a couple of 21 components, rotate them 90 degrees or whatever, than 22 doing all the paperwork.

23 MR. PIRES: In the end, you will end up 24 with capital investments that can do that on some 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

68 components and I think these analyst can identify 1

those.

2 MEMBER MARCH-LEUBA: And while it would on 3

this, NRC will not reward you for doing the right 4

thing, just reinforcing those components. There are 5

so many questions about it, whereas if you come up 6

with the paperwork analysis, they'll let you go 7

through.

8 MR. PIRES: But I have seen that in some 9

cases, people somehow identified what risk contributed 10 but maybe possible single tons, I don't, can't be 11 specific but that somehow might have led to some 12 upgrade.

13 MEMBER MARCH-LEUBA: Yes. As an example, 14 I always say that if I am operating a plant, I will 15 mount two diesel generators. One in the basement and 16 one on the fifth floor. The fifth floor will fail in 17 an earthquake, the basement will fail on a flood but 18 at least I'll have one left.

19 MR. PIRES: Right.

20 MEMBER REMPE: So if you were going to use 21 this for insights on which components to reinforce, I 22 would then say you need better data. So if you go 23 back to Slide 24, you talk about that the data from 24 actual earthquake experience in the plants is sparse 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

69 because people are only reporting failures, or a few 1

failures.

2 I was wondering if one would take a 3

different attitude. Maybe you ought to also be 4

documenting which components survive as well as the 5

ones who fail.

6 I think, again, I'm more into, yes, I'd 7

like to upgrade the plant but also before I go and do 8

more on data or on that modeling, I would really focus 9

on what could you learn from the real world before I 10 get a model. And so it seems like you could do 11 something that way.

12 MR. PIRES: That is done. The aspects 13 that go and collect aspect experience, they collect 14 both types. Do you remember that meeting in North 15 Carolina about a year ago and in which there was a 16 person proposing more collection of earthquake 17 experience data and more analysis of that? And he 18 emphasized and he has done that in practice for 19 industrial facilities like fossil power plants and the 20 others, and they collect both data. They collect data 21 that survived and data that did not survive.

22 MEMBER REMPE: Yes.

23 MR. PIRES: Most types of data are 24 collected. And but I think in this case, the 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

70 reference to the, to where you might want to do some 1

capital investments is for those cases where you could 2

see that that would have a big payoff to these 3

sensitive analysis.

4 MEMBER REMPE: The sensitivity with the 5

old current models. I agree on that one, but.

6 MR. PIRES: Or even with even with 7

improved models, it's, but probably that's of course 8

my opinion.

9 MEMBER REMPE: We all have opinions, I 10 guess.

11 (Laughter.)

12 MR. PIRES: Right. But probably more 13 value of these and I move the, if I may, move to the 14 other slide. This is how the author recommended that 15 all these would be used so they would still start to 16 be the, perform SPR using the standard methods, enough 17 sensitivity studies so that you can see what, where 18 you may need to make refinements, then the 19 identification of those cut-sets or sequences where 20 you would want to make this refinement of the 21 methodologies.

22 So these are systems analysts there in 23 red. The one in blue, that would be now back to the 24 fragility analyst that would then go use these methods 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

71 to revise the fragility calculation for those cut-sets 1

to obtain numbers that was the methodology that is 2

referred to here.

3 And then we'll go back to the SPRA analyst 4

and do the work. So that would be a process that 5

could be done.

6 MEMBER MARCH-LEUBA: So if you only 7

propose to do this analysis for the two or three 8

cut-sets that make a difference, it's not that 9

expensive.

10 MR. PIRES: No. But you need to have a 11 good analyst.

12 MEMBER MARCH-LEUBA: Yes, well, that's 13 where the big bucks are, right?

14 MR. PIRES: Right, yes, maybe. And so you 15 have here that, so there are difficulties here with 16 the analyst and for this revised fragilities that 17 appear on the blue box and it is, there can be 18 variability among fragility analysts and the report 19 mentions that.

20 (Off microphone comment.)

21 MR. PIRES: And there is still some level 22 of expert judgment. I think by breaking down on the 23 basic variables like the fragility on all these tests, 24 you reduce some of that judgment quite significantly 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

72 I think. Because it's more transparent to the process 1

where you get to the breakdown of the uncertainties 2

and so.

3 (Off microphone comment.)

4 MEMBER CHU: The airplane mode works.

5 CHAIRMAN RICCARDELLA: Airplane mode 6

works, yes. I never said, that's not me.

7 MR. PIRES: And so this is, let me see, so 8

I don't know if somebody remarked that essentially 9

it's just a summary of what we have been discussing 10 about it. I don't know if you want to go through them 11 again.

12 But one item that I would like to say 13 there, is that this, we think that with this study we 14 can maintain a dialogue with the industry. If the 15 industry's interested and go into other, you know, 16 more refined methodologies. We already, it's 17 essentially our part and now the industry probably, 18 they are interested. They can either pursue this part 19 or others because we already did some staffing say 20 that there is some things that may have promise.

21 Now with the, you ask that the, so the 22 treatment of dependencies always depends on the 23 intended results. So we are not implying here that 24 what is being done now is not appropriate or correct.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

73 And part of the demonstrations of 1

methodology would be necessary like you said. It's 2

just the start of a dialogue and there can be arising 3

needs. And like you mentioned, the Chairman mentioned 4

at the beginning of the meeting, maybe modular 5

reactors or advanced reactors may want to consider 6

these at the early design stage.

7 I understand it's not being done now 8

because the design certification process is, there is 9

not a lot of definition yet but that is a choice of 10 the applicant.

11 And so we want some of you prepared if the 12 applicants go that way. They, our knowledge can 13 respond to that and now understand it.

14 MEMBER CORRADINI: Or they could just make 15 a more robust structure so that the residual risk is 16 small enough you don't care.

17 MR. PIRES: Right. But that is there to 18 be their choice.

19 MEMBER CORRADINI: Yes, okay.

20 MR. PIRES: And but the point is, one I 21 can hear is that you may keep adding more components 22 and not really have much benefit in terms of the 23 redundancy that it will bring up.

24 So you can from the very get-go design 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

74 that to get that redundancy so that they will not have 1

a dependent failure.

2 MEMBER SKILLMAN: Two or three times 3

around the table, members have mentioned that maybe 4

the ticket here is to make a robust structure. And 5

I've been involved in Europe and in the United States 6

where the exact opposite was the right thing to do.

7 We actually weakened the structure. We 8

made sure that the earthquake went under the structure 9

and the structure didn't respond and so it can go 10 either way.

11 And it boils down, at least in my mind, 12 this whole thing boils down to a probabilistic risk 13 assessment that identifies those structures and 14 systems and components that are credited for success 15 for the specific accident.

16 In one case, it might be the batteries.

17 In another case it might be high pressure injection 18 pump. In another case it might be the high head 19 safety injection pump in a boiling water reactor. So 20 it's scenario specific, it's plant design specific, 21 and it is condition specific.

22 Like Harold said, like I said early on, 23 you got to know the tech specs. You got to know 24 what's credited. You got to know which systems are 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

75 aligned for what purpose and when, when the event 1

occurs.

2 That is part of this rubrics to get a path 3

forward that allows examination that is meaningful in 4

terms of what Dr. Rempe said, risk, not just a failure 5

of the device.

6 You know, you can fail the water cooler, 7

you can fail the front door of the administration 8

building, but you don't want to fail the nozzle that 9

puts the water onto the fuel.

10 The risk is associated with the right 11 component, in the right place, at the right time for 12 the particular accident and the particular ground 13 motion. All of those are pieces.

14 CHAIRMAN RICCARDELLA:

Core damage 15 frequency can't capture those differences though.

16 MEMBER SKILLMAN: Pardon?

17 CHAIRMAN RICCARDELLA:

Core damage 18 frequency can't, I mean, the water cooler and the door 19 to the admin building isn't going to impact core 20 damage frequency.

21 MEMBER SKILLMAN: My only point is, my 22 only point is, it's very component-specific.

23 CHAIRMAN RICCARDELLA: Yes.

24 MEMBER SKILLMAN: Your risk is very, very 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

76 component specific.

1 MR. PIRES: I think the least that they 2

showed here on the workshop as a result of the 3

workshop and the review of past PRAs, mostly the 4

components are of course are not buildings. I guess 5

we knew that, they, this is the type of component that 6

typically appeared there as critical.

7 Of course the building's response affects 8

those because the way it amplifies the ground motion.

9 And when people talk about seismic isolation, they 10 could review some of these.

11 MEMBER CORRADINI: So let's talk about 12 seismic. You brought it up. I was going to but you 13 first. Tell me about, I was under the impression 14 there is a potential standard that, a potential 15 approach that's been in front of the staff to look at 16 for seismic isolation?

17 MR. PIRES: No, no. No, no, no. There is 18 a standard --

19 MEMBER CORRADINI: You did it. I didn't 20 do it.

21 MR. PIRES: Right. No, I know.

22 CHAIRMAN RICCARDELLA: There was a DOE 23 research part.

24 MR. PIRES: There is a standard. There is 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

77 an American Society of Civil Engineering Standards 1

that has a chapter there on Seismic isolation.

2 And we are not necessarily reviewing that 3

standard for seismic isolation. We are reviewing that 4

standard for many other, in terms of for more risk, 5

and from approach, performance based to the seismic 6

design, but not necessarily that particular part. We 7

have other research projects on seismic isolation 8

already at the Agency here and so we have to look at 9

those.

10 MEMBER CORRADINI: Well, what I guess I'm 11

--I'm sorry, I didn't mean to interrupt you.

12 MR. PIRES: Sure.

13 MEMBER CORRADINI: Go ahead and finish, 14 I'm sorry.

15 MR. PIRES: No, we have other research 16 projects but not necessarily aimed at reviewing a 17 particular standard but aimed at developing technical 18 consideration that should be accounted for when 19 designing seismic isolation systems.

20 MEMBER CORRADINI: Well I guess I'm a bit 21 unsure what you just said. So is there a standard in 22 front of the staff to evaluate or is it still a matter 23 of research?

24 I thought there was a standard in front of 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

78 the staff that the staff is evaluating, the suggested 1

standard from the civil engineering society.

2 MR. PIRES: There is a standard but we are 3

not ever tasked to evaluate that standard.

4 MEMBER CORRADINI: We --

5 MR. PIRES: We do not have a task to 6

evaluate that standard, but --

7 MEMBER CORRADINI: So there's not been a 8

request yet?

9 MR. PIRES: Not been a request. Yes, 10 there's not been a request. We are reviewing that 11 standard but that standard has so many other aspects, 12 those are the ones we are doing.

13 But we have independently done research 14 that develop technical considerations for, that should 15 be accounted for if seismic isolation were to be used 16 in a nuclear power plant design. So we have 17 independently done that ourselves.

18 MEMBER CORRADINI: But if tomorrow, if 19 reactor X comes in, a small modular reactor, and says 20 we're going to isolate the safety structures with 21 seismic isolation, is there a standard they can follow 22 that the NRC has approved or at least has reviewed?

23 MR. PIRES: No. There is not a standard 24 that we have taken a staff position on.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

79 MEMBER CORRADINI: Is there something that 1

2 MR. PIRES: We have done research in 3

relation to that.

4 MEMBER CORRADINI: So there's nothing that 5

they can point to that is yet to be reviewed but could 6

be, or is it a matter of research or is it a matter of 7

working through the standard that is out there but yet 8

to be reviewed and approved? I'm trying to understand 9

where this is.

10 MR. PIRES: Right. All right. Our 11 research project culminated in a NUREG/CR contractor 12 report that does technical considerations for the use 13 of base isolation on nuclear power plants. Those 14 technical considerations are probably better than 15 those in the standard.

16 MEMBER CORRADINI: Right.

17 MR. PIRES: This is of course our opinion.

18 But they are very closely related in many ways. So 19 actually our contractor was the one who brought most 20 up to standard.

21 MEMBER CORRADINI: Okay.

22 MR. PIRES: So maybe I should not say 23 this, but that does not mean that the standard per se 24 is sufficient either. The standard may not be 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

80 necessarily sufficient.

1 MEMBER CORRADINI: Okay.

2 MR. PIRES: Because there are several many 3

other details and considerations that are not 4

necessarily covered in the standard by that, neither 5

by that NUREGs.

6 MEMBER CORRADINI: Because that's some --

7 MR. PIRES: It the variety for the 8

details.

9 MEMBER CORRADINI: Well, I mean the reason 10 I'm bringing it up is, one, you did but I was going to 11 anyway, so I can't blame you totally.

12 MR. PIRES: Right.

13 MEMBER CORRADINI: But in other technical 14 meetings there has been discussion that these advanced 15 reactors, whatever they are, are going to try to use 16 this to minimize to allow the structure to be more 17 simply built --

18 MR. PIRES: Right.

19 MEMBER CORRADINI: -- because it has a 20 smaller footprint. And so the next question has been, 21 in some of these technical discussions, well, is there 22 a standard? And the answer back is yes, but the NRC 23 has not reviewed it.

24 That is what I've heard in technical 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

81 discussions.

1 MR. PIRES: Right.

2 MEMBER CORRADINI: And I'm trying to 3

understand where the reality is versus what I hear in 4

a --

5 MR. PIRES: The NRC has not reviewed and 6

taken a staff position on that standard. The NRC has 7

done research very similar to the research that 8

supports the standard. So we are not at zero. We 9

have a knowledge basis in Agency on that topic. So we 10 can come --

11 MEMBER CORRADINI: But nobody has come to 12 you to say we want to use this, can we use this?

13 That's what I'm hopeful for.

14 MR. PIRES: Right.

15 MEMBER CORRADINI: Eventually.

16 MR. PIRES: We are not at that situation, 17 yet. But we have done the research --

18 MEMBER CORRADINI: Okay.

19 CHAIRMAN RICCARDELLA: Yes, good.

20 MR. PIRES: -- that can take to that 21 situation if that materializes.

22 CHAIRMAN RICCARDELLA: I recall a meeting 23 I attended maybe three years ago at the Department of 24 DOE. Did DOE sponsor a big program like that?

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

82 MEMBER CORRADINI: Yes, there was a study 1

at DOE.

2 CHAIRMAN RICCARDELLA: You were there, 3

weren't you, Jose?

4 MR. PIRES: Yes, DOE does have recent 5

projects on that.

6 (Simultaneous speaking.)

7 CHAIRMAN RICCARDELLA: On isolation.

8 MEMBER CORRADINI: University of Buffalo.

9 There is a large group at University of Buffalo.

10 That's where I had the presentation and I --

11 MR. PIRES: He was our contact there for 12 that project.

13 CHAIRMAN RICCARDELLA: Your contact.

14 MR. PIRES: For that same group.

15 MEMBER CORRADINI: Same group?

16 MR. PIRES: Yes. So we are up to date on 17 what is happening in that world and obviously where if 18 someone is going to submit an application, there are 19 many, many more details than just the standard.

20 CHAIRMAN RICCARDELLA: Yes.

21 MR. PIRES: But we are up to date but we 22 have not developed necessarily a staff position.

23 That's, but we are up to date.

24 MEMBER CORRADINI: Okay.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

83 MR. PIRES: We are not, which I think we 1

are in a good position to be responsive.

2 MEMBER CORRADINI: Thanks for bringing it 3

up.

4 MR. PIRES: You are welcome, yes.

5 CHAIRMAN RICCARDELLA: I have a couple of 6

questions. I know there's these ongoing Task 2.1 7

seismic reviews of the CS plants and as I understood 8

it, about a third of the plants out there had to take 9

a new look at their seismic because they exceeded 10 their current ground motion response factor, right?

11 MR. REISI-FARD: That's about the right 12 number.

13 CHAIRMAN RICCARDELLA: Are those plants 14 having problems? I mean they're doing SPRAs or 15 seismic margins analyses. Are they having, are there 16 any plants that have issues, are having issues 17 satisfying the criteria?

18 MR. REISI-FARD: Not to my knowledge and 19 this goes back to some of the discussions earlier 20 about the level of detail or analysis that is needed 21 to do the SPRAs.

22 For the purpose of this informed decision 23 making, there is the SPRA standard out there which is 24 being peer reviewed by, you know, there's a process 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

84 for doing the peer review.

1 And they have been using, the industry, 2

the licensees have been using these methods for a long 3

time and, you know, it's been, their PRAs have been 4

peer reviewed against the standard and, you know, it's 5

just a

matter of uncertainty, key assumption 6

uncertainty in the model. There are no, typically 7

there are not many findings associated with how the 8

correlation is considered. They either assume full 9

correlation or no correlation.

10 CHAIRMAN RICCARDELLA: Yes. Yes, I mean 11 I would think kind of like what Jose said earlier, you 12 only sharpen your pencil as sharp as it needs to be.

13 And so if none of these plants are having 14 any problem meeting their, whatever the criteria are 15 for their SPRAs then they wouldn't necessarily go back 16 and relook at this. But if they do have an analysis 17 or two that's giving them problems, maybe they might 18 try to do it.

19 MR. REISI-FARD: And I know that's out of 20 a few or several SPRAs that we've seen, there is only 21 one exception that they've used a little bit more 22 refined analysis. It's not using.05 or.75 or 23 anything like that.

24 But because the licensee decided to have 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

85 a look, it's more detailed final element analysis they 1

have a better understanding of the seismic demand in 2

different locations. So if there was a different 3

seismic demand, they use different correlations. But 4

other than that, they basically assume zero or 5

complete correlation.

6 CHAIRMAN RICCARDELLA: Yes. So and then 7

another potential application as I said earlier, is 8

the NuScale or some new reactors where if you haven't 9

completed the design yet, it seems like you could take 10 some of this into consideration in advance and have it 11 affect your design.

12 But, Vesna, the NuScale PRA that we'll be 13 reviewing, does that include a seismic PRA?

14 (Off microphone comment.)

15 MEMBER CORRADINI: I thought it was a 16 seismic --

17 CHAIRMAN RICCARDELLA: It concentrates on 18 a --

19 MEMBER CORRADINI: -- margin analysis. I 20 didn't think it was the seismic --

21 MEMBER DIMITRIJEVIC: Yes. I mean, 22 seismic analysis -- seismic risk analysis is a new 23 type. I think it's a seismic matching but it's 24 irrelevant because the NuScale is submitted analysis 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

86 based on the single unit.

1 CHAIRMAN RICCARDELLA: So --

2 MEMBER DIMITRIJEVIC: So it's irrelevant, 3

do they have a ten, 12, or 20 units. They just 4

analyze in single units. That's what their agreement 5

with NRC, so we don't, we may see in consequence, but 6

the consequence in this case means that, you know, 7

Level 3 analyzes that some combination. But on the 8

PRA, no, it's just a single use.

9 MR. PIRES: That's what I heard too. That 10 currently it's a single unit and the seismic margin is 11 what they call a PRA based seismic margin.

12 MEMBER DIMITRIJEVIC: Right.

13 MR. PIRES: But because that seismic 14 margin approach and that the guidance really involves 15 simplified methods, min-max approaches and that there.

16 So it's not really --

17 (Off microphone comment.)

18 MR. PIRES: But can be used that, but is 19 a simplified PRA based seismic margin and --

20 CHAIRMAN RICCARDELLA: But if they were to 21 come in and try to license multiple plants at a site, 22 wouldn't it be necessary for their PRA to address a 23 multi-unit site?

24 MEMBER DIMITRIJEVIC: That's my opinion 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

87 but I jump on this train late and disagreements had 1

already reached, I mean, with the staff. So, I mean, 2

I will bring this question to the review because it's 3

not just seismic, all other external ones, you know?

4 CHAIRMAN RICCARDELLA: Yes, yes, of 5

course.

6 MEMBER DIMITRIJEVIC: You know, like 7

external floods and which is one of the main important 8

contributions. But that's what is put into that so.

9 They have a multi-unit on the license but that 10 actually involves the analysis from ability that two 11 units fails. That didn't include the seismic common 12 cause, it just includes the single, the single 13 non-seismic common cause between each. So we will 14 have a discussion about that but that's --

15 CHAIRMAN RICCARDELLA: Okay.

16 MEMBER DIMITRIJEVIC: It doesn't say if 17 you have a challenge, what's the probability of one of 18 12 things with that.

19 CHAIRMAN RICCARDELLA: Yes. That's coming 20 up this month, right?

21 MEMBER DIMITRIJEVIC: Yes, and this 22 analysis is happening in the next --

23 MEMBER CORRADINI: The first meeting will 24 be this month.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

88 MEMBER DIMITRIJEVIC: -- yes, yes.

1 MEMBER CORRADINI: It won't be the last 2

meeting.

3 MEMBER DIMITRIJEVIC: No. Right, so.

4 CHAIRMAN RICCARDELLA: Okay.

5 MEMBER DIMITRIJEVIC: Well, and I have a 6

microphone on. I have one question. In your report 7

there was some example identified with three service 8

water pumps show as important.

9 You know, when we have a seismic, we 10 always assume that we have a loss of onsite power as 11 it normally is out and then these generators as you 12 mentioned are important, but, and but they cool the 13 service water so service water is important.

14 And usually single structures or tanks 15 like lube oil tank can dominate what is used at the 16 generator if you don't know correlation, or intake 17 structure when it's the pumps itself.

18 But there was an example reported in that 19 report of the sump cuts, actually the three service 20 water pumps.

21 CHAIRMAN RICCARDELLA: Yes.

22 MEMBER DIMITRIJEVIC: The three service 23 water pumps show it's very important in that site meet 24 PRA but then they didn't proceed with how did they 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

89 solve that issue?

1 MR. PIRES: The one I referred to was a 2

pilot study so it was not really tied into any 3

particular licensing issue or not.

4 (Simultaneous speaking.)

5 MEMBER DIMITRIJEVIC: I see.

6 MR. PIRES: It was a pilot study.

7 MEMBER DIMITRIJEVIC: It could be, yes, is 8

the early ones when done and then they tried it, yes.

9 I understand this.

10 MR. PIRES: So it was a little different, 11 the use. Well, in principle this methodology can be 12 useful modular reactors and but again it also depends 13 on the problem statement. What would it be used for?

14 What would be the intent to go all the way to 15 releases, to one model fails, all fails, do they fail 16 simultaneously? And do they need safety systems from 17 another? Are they relying on safety systems from 18 another core module to stop an accident progression on 19 one of their modules and on their other model?

20 So I think depending on the problem 21 statement is done, is what one they have to look, but 22 in principle can be done. And if you had the analysis 23 for the single model you can extrapolate it by the 24 correlations using this approach. But it has to pay 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

90 off, has to have a benefit for the applicant.

1 MEMBER REMPE: So when I look at the last 2

bullet here I also go back to Page 26 and see all of 3

the caveats you have about before you can be using 4

this methodology and it seems like that there's a lot 5

of work still to be done if one wanted to apply and 6

use this as part of the standard tool kit available to 7

seismic people. And I just kind of wanted to see you 8

shake your head up and down, yes.

9 MR. PIRES: I think so. There is, there 10 will be substantial work yet, but the question is at 11 this point, like I think I mentioned before, I think 12 we have done probably our part on the dialogue.

13 MEMBER REMPE: Yes.

14 MR. PIRES: And so maybe now someone else 15 has to get that additional work and maybe we, put 16 these points to some other organization that does 17 research, that can be cooperative research but maybe 18 will have a role. But if I think we only need to have 19 now the initiative coming from outside.

20 MEMBER MARCH-LEUBA: This gets me thinking 21 to the topic I wanted to change the conversation just 22 as we have plenty of time and I know you've done all 23 this because you've told me on the side.

24 MR. PIRES: Yes.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

91 MEMBER MARCH-LEUBA: It's still bit of 1

certainties.

2 MR. PIRES: Okay.

3 MEMBER MARCH-LEUBA: You told us that all 4

of those F parameters on the long equation have their 5

uncertainty but now you're splitting that uncertainty 6

into two.

7 MR. PIRES: Right.

8 MEMBER MARCH-LEUBA: Yes. And the estate 9

of the practice now is to split the CO1 by setting the 10 correlation to CO1 and that term means what the 11 uncertainty is. I know you've given some thought on 12 how you would do the uncertainty with the proposed 13 method. Can you talk a little bit about that?

14 MR. PIRES: How we would split this?

15 MEMBER MARCH-LEUBA: Yes. How would you, 16 I mean, what is your, what was your consideration for 17 treatment of uncertainties, the additional uncertainty 18 that this introduce by the new method?

19 MR. PIRES: Oh, alright, yes. I think one 20 of the bigger uncertainties to this, by the new method 21 is this step that you just mentioned. How you are 22 going to assign what is correlated and what is 23 uncorrelated, particularly given that you don't have 24 hard data.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

92 And so but the study really did not look 1

at that into detail because the study at this moment, 2

they just, all the examples they have, they assign it 3

the information to those things on the top line 4

directly. They didn't even use the bottom line.

5 They just have statements. They are 6

saying the -- interaction part of the building is not 7

the same so if all components are in the same 8

building, the -- interaction uncertainty probably is 9

correlated.

10 But they have not really provided the 11 metallic aspect how to go from the bottom line to the 12 top line in assigning those uncertainties. So but I 13 think that needs to be that. And if that, because of 14 so many factors, they had all of these factors, they 15 have many quality analysts, can eliminate much of the 16 judgment, particularly those that can be done by 17 analysis.

18 MEMBER MARCH-LEUBA: You know the field 19 which was a very large study, 1980s probably, was the 20 CSAU, Code Scaling, Applicability and Uncertainty 21 Analysis.

22 MR. PIRES: Okay.

23 MEMBER MARCH-LEUBA: Anyway, called CSAU.

24 The first step on CSAU is to provide a PIRT, Phenomena 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

93 Identification and Ranking Table, okay.

1 MR. PIRES: Right.

2 MEMBER MARCH-LEUBA: And all the thermal-3 hydraulics which are more of a deterministic instead 4

of a probabilistic -- understood that because there 5

will be, that you will get a different number, that he 6

will get a different number.

7 So the PIRT always requests to have at 8

least three experts in the field. And then you look 9

at the variability between different opinions.

10 When you do the separation between ER and 11 EU, probably will require at least a second opinion 12 instead of just one guy.

13 MR. PIRES: Did, one of the things and the 14 report mentions that they really recommend a peer 15 review even if it is informal. Even if that is not a 16 formal peer review that is required by a regulator or, 17 they really recommend that you should have that.

18 But I think even before you get the peer 19 review, you probably need the guidance on how to do 20 that, based on this first step, it's to have that 21 guidance and second is to have a peer review.

22 MEMBER MARCH-LEUBA: Yes, but in my mind, 23 and maybe I'm biased, but I think the largest source 24 of uncertainty will be a subjective evaluation of 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

94 numbers and that Jose will give a different result 1

than Josie.

2 MR. PIRES: Right.

3 MEMBER MARCH-LEUBA: And it will be, and 4

I thought that you addressed that in the report by 5

recommending a peer review or list, you get an idea 6

what the uncertainty is.

7 MR. PIRES: Right. And the report 8

recognizes that, recognizes that there will be 9

variability among the analysts.

10 MEMBER DIMITRIJEVIC: And do you know what 11 also is problem, there is not two. There don't exist 12 two fragility experts in that. You know, an agility 13 expert is very sparse. Like ten years ago all world 14 was using just one. I mean, I don't know what's the 15 situation is now but then --

16 MR. PIRES: No, there are a few.

17 MEMBER DIMITRIJEVIC: We're not going to 18 find many too complex opinions.

19 MR. PIRES: There are a few and I think 20 the breaking down of the problem allows that. In my 21 opinion, the more you can do to some analysis that are 22 having to rely directly on the use of data so you have 23 a matching off the two, you are better.

24 MEMBER MARCH-LEUBA: Okay. Well, my point 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

95 is in the report you've given some thought to it and 1

you have addressed the issue, that this is a problem.

2 MR. PIRES: Right. It is an issue.

3 CHAIRMAN RICCARDELLA: You know, on this 4

slide you've got two different things where you split 5

the uncertainty. In the top line it's random versus 6

uncertainty. But to me, what's equally significant on 7

the very bottom line, the first part of the equation 8

there, it's F sub C and F sub RS and do each one of 9

those have an R and a U?

10 MR. PIRES: Yes. And then each one of the 11 other F's has an R and a U. So when you, in the end 12 you can have a square root of some squares that are 13 about 15 times there. So it can be complex.

14 But the analysts are used to do that.

15 They go to their training. Typically what happens is 16 if a utility wants to do an SPRA, what I understand 17 some of them did is that they contract a firm that 18 knows how to do these and they do an example for a 19 building and the components in there.

20 They go through all this process. They 21 define templates, and then they can have other 22 engineers that go through that process systematically 23 for other components and other buildings and other 24 aspects.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

96 So they have a process to do that to 1

minimize errors and subjectivity. But it still can 2

happen because the next step is to assign what part 3

of, if you have two components now of those all their 4

Rs and Us, what is the part that is correlated, the 5

part of a covariance is still just a variance for each 6

one?

7 And that part is somewhat difficult but 8

there are reasons and arguments when you break down to 9

be able to move in that direction, and it partly 10 depends on the importance of the problem and what you 11 want to do with the results.

12 CHAIRMAN RICCARDELLA: Yes. It seems that 13 there's an opportunity that if you're designing a new 14 plant for a new concept, like these modular reactors, 15 that there might be some very, very minor things that 16 you could do at relatively low cost that would make 17 things less correlated.

18 MEMBER CORRADINI: But you could also 19 increase the risk of something else. You can't just 20 change this, you would have to redo everything. If I 21 took all of these things and orient them ten degrees 22 different, then my fuel handling might change --

23 CHAIRMAN RICCARDELLA: Yes, right, right.

24 MEMBER CORRADINI: -- so that I can 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

97 increase the risk of a fuel handling accident.

1 MR. PIRES: Yes. In some of these 2

aspects, you probably, you know, one exercise a day, 3

so I'm just thinking aloud without really --

4 But ideally it would be to have a set of 5

rules coming out from PRA studies and those set of 6

rules, then give indications if you want to obtain 7

redundancy, you need to do these things in your design 8

so that the design not necessarily have to, or define 9

the rules that, and then, but and those would be 10 exercise PRAs to come up with those rules.

11 MEMBER CORRADINI: Yes, but I think but in 12 13 MEMBER MARCH-LEUBA: For in --

14 MEMBER CORRADINI: If I might just say, I 15 think your Slide 25 though is the one that I got --

16 you don't have to go to it -- but the one with your 17 blue and red boxes. You don't do this for everything.

18 You find out where it's critical to do it 19 and then you delve in. I mean, it's like Jose's 20 example of where you want to sharpen your pencil and 21 where it's good enough to do a simple analysis.

22 That's what I took away from that.

23 MEMBER MARCH-LEUBA: What I think that 24 Pete is saying is that when we do fire analysis and do 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

98 the INC. We put one division in a different cabinet.

1 We have four different fire enclosures for each 2

division because we only, we put them only in one, we 3

have a fire, we're cooked. Okay.

4 If doing this safety PRN and you find out 5

that all your three sump pumps are on the same weak 6

building, that tells you a problem that you maybe need 7

two sump pumps in different places. And that points 8

you to small changes that maybe are not expensive that 9

make the plant better. Remove the single pump.

10 MR. PIRES: Yes, like you said, that box 11 already there in the parenthesis, but presumably 12 should be few of those where you have to do that and 13 have a benefit.

14 CHAIRMAN RICCARDELLA: But I guess the 15 first step would be to make sure that they consider 16 the multiple units in the PRA. If they're not doing 17 that --

18 MEMBER MARCH-LEUBA: Somewhere I've read 19 that they just multiply times 12 the results of one.

20 And that they assume they're fully correlated. That's 21 what I read somewhere but you're --

22 MEMBER CORRADINI: Wait until the October 23 18th meeting.

24 MEMBER MARCH-LEUBA: Yes.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

99 MEMBER REMPE: But if you do, I mean, it's 1

what your point was about the ship already, or the 2

train already left. There's a couple of things, again 3

just thinking off the top of your head, not only do 4

you have the issue that you might have three pumps in 5

12 units that all are not considering all 12 units in 6

the common cause, but what about just that you've got 7

12 units in the same pool and a bowling ball approach 8

where they knock out each other?

9 MEMBER SKILLMAN: Joy, we raised that 10 question.

11 MEMBER REMPE: Yes, I know.

12 MEMBER SKILLMAN: We absolutely raised 13 that exact issue.

14 MEMBER REMPE: Yes.

15 MEMBER SKILLMAN: I think we're in a 16 different --

17 (Off microphone comment.)

18 MEMBER REMPE: No.

19 MEMBER CORRADINI: I would suggest we're 20 in a different discussion, that we should wait until 21 we actually have the --

22 CHAIRMAN RICCARDELLA: Yes.

23 MEMBER SKILLMAN: I think in a way we're 24 in a different discussion but we're going after the 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

100 comment that Pete made that I think is right on the 1

money.

2 Early on, slight adjustments can provide 3

great risks reduction, or great reductions in risk.

4 I think that that's accurate and I think we ought to 5

be thinking about that. Just a couple of very minor 6

changes that can allow a very significant outcome for 7

an event and I think that's accurate.

8 MR. PIRES: In this case, I think for the 9

multi-module syncs, it was probably important to come 10 up with what is the problem statement that, for the 11 applicant that the applicant wants to address? Is, 12 are they worried about releases or if using systems 13 from another module to save one model? Or, you know, 14 I think that now that the problem statement has 15 expanded because you have all these modules there 16 relatively close to each other, and depending on that 17 then they would have to choose what they want to do.

18 MEMBER MARCH-LEUBA: But I would like to 19 think that the applicant is already doing that. I'm 20 sure whoever designed the plant, they're looking for 21 the low hanging fruit. I mean, if we weren't under 22 the review when it comes to ACRS, nothing can be 23 changed. So what we need is to encourage the 24 applicants to think things this way.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

101 MEMBER DIMITRIJEVIC: But this is just to 1

tell you it's also bad because actually they're not in 2

parallel, they're in series. So fail of any unit is, 3

you know, basically the failer. It's, you know, 4

they're not in parallel. So if you look in the 5

component combination, whatever fail that unit, if you 6

want to fail the second unit, or fail only the one 7

unit present the problem. So it's from a, you know 8

what I want try to say, the units are in the series 9

actually when it comes to the core damage frequency, 10 so.

11 MR. PIRES: This may be a case where a 12 release might make a difference because if you ever 13 sourced them for 12 modules versus from one module, 14 but I don't know. It's, I have no idea. It's a 15 problem statement.

16 CHAIRMAN RICCARDELLA: No, we have some 17 food for thought for our meeting in two weeks and we 18 can ask the applicant then.

19 Well, Jose, I thank you very much for 20 coming by and briefing us all and Mehdi, we appreciate 21 it.

22 I'm going to go around the room. But 23 first, is there anybody in the room that would like to 24 make a comment?

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

102 Hearing none, we'll go to the phone line.

1 Can we open the line please?

2 MEMBER CORRADINI: We'll wait for a 3

crackling sound.

4 CHAIRMAN RICCARDELLA: Yes. So when the 5

phone line is open, if there's anybody listening to 6

this, in on this call, I'd appreciate it if you would 7

let us know that you're there and you hear us.

8 MEMBER MARCH-LEUBA: I just want to take 9

-- on the line. Let's go around the table.

10 CHAIRMAN RICCARDELLA: Okay. So let's ask 11 the subcommittee members. Vesna, do you, starting 12 with Vesna and we'll go around the table.

13 MEMBER DIMITRIJEVIC: Yes, I'm all right.

14 I don't have additional questions.

15 MEMBER CHU: Nothing.

16 CHAIRMAN RICCARDELLA: Harold?

17 MEMBER RAY: To me, Pete, this is more 18 input rather than a time for us to give feedback. I, 19 you know, I think the issue always in my mind is how 20 to reduce core damage. What's the most efficient way 21 and the most appropriate way to reduce core damage 22 frequency to an acceptable level? And we're making a 23 transition now in how we think about that and I just 24 need to hear more before I can make a comment.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

103 CHAIRMAN RICCARDELLA: Okay. I'm just 1

going to interrupt for a second. I think I heard the 2

crackle. Is there anybody on the line that would like 3

to make a comment?

4 MEMBER MARCH-LEUBA: Nobody phoned in on 5

the line.

6 CHAIRMAN RICCARDELLA: Nobody?

7 MEMBER MARCH-LEUBA: Not that we hear.

8 CHAIRMAN RICCARDELLA: Okay. Okay. Jose, 9

Mehdi, so thank you. That's it.

10 MEMBER CORRADINI: No comments. Thanks to 11 Jose and Mehdi.

12 MEMBER SUNSERI: I find it to be an 13 interesting advancement of the state of practice I 14 guess in this particular area.

15 I suppose my overall feed, input similar 16 to Harold here, is saying that, you know, I think we 17 need to be cautious about how we go about utilizing 18 and or applying those, because my experience is if you 19 start tweaking with hardware to try to make analysts 20 come out in different areas, it's tricky business.

21 And you can cause unintended consequences to solve a 22 problem.

23 (Off microphone comment.)

24 MEMBER SUNSERI: So that's the only 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

104 caution I offer at this time. I do appreciate the 1

presentation. Thank you.

2 CHAIRMAN RICCARDELLA: Joy?

3 MEMBER REMPE: I don't have any additional 4

comments but I do want to thank you for taking the 5

time and coming and talking to us.

6 MEMBER MARCH-LEUBA: I want to also 7

emphasize a thank you because that was a very 8

interesting presentation. You see it was very lively 9

and everybody wanted to hear about this.

10 My main concern when these things happen 11 is whether it may be misused. I mean, whenever you 12 give an applicant additional margin, he might come 13 down the real safety of the plan by using additional 14 margins. So that's a warning that let's make sure 15 that this results in safer plants.

16 (Off microphone comment.)

17 CHAIRMAN RICCARDELLA: Okay. Thank you.

18 MEMBER BALLINGER: No more additional 19 comments.

20 CHAIRMAN RICCARDELLA: Okay. Well, with 21 that I'll thank you again and I guess we'll adjourn 22 the meeting.

23 (Whereupon, the above-entitled matter went 24 off the record at 2:54 p.m.)

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005-3701 (202) 234-4433

Correlations of Seismic Performance in Similar SSCs (Structures, Systems and Components) - NUREG/CR-7237 Information Briefing to:

Advisory Committee on Reactor Safeguards Structural Analysis Subcommittee October 3, 2018 Rockville, MD Staff presenters/speakers:

Jose Pires, RES/DE Mehdi Reis-Fard, NRR/DRA/APLB/RILIT Selim Sancaktar, RES/DRA/PRAB 1

Overview

  • Background
  • Objectives and Goals
  • Scope
  • Analysis Aspects
  • Study Approach

- Review of Existing PRAs

- Review of Current Literature

- Workshops with Experts

  • Analysis Process in a SPRA and Issues/Uncertainties
  • Summary and Remarks
  • Further Questions 2

=

Background===

  • Two key SPRA aspects I.

All possible earthquake levels, their frequencies of occurrence and potential consequential damage should be considered II.

Earthquakes can simultaneously damage multiple redundant components

  • Risk-quantification should account for this common cause effect 3

=

Background===

4 1994 Northridge earthquake Haiti

=

Background===

5 Single Motor Control Center Failure at Piti Power Plant -

Guam (1993 Earthquake)

=

Background===

6 Fukushima Daini Make Up Tank Failures -

Dependent Failures

=

Background===

  • Treatment of dependent failures involves a set of assumptions (rules-based approach) such as:

- Similar redundant components next to each other and subjected to similar seismic forces fail simultaneously

- Diverse or similar components at different (far apart) locations fail independently

- Sensitivity analysis to postulated bounding assumptions

  • This approach can mask insights and lead to varying degrees of conservatism in various places of the analysis 7

=

Background===

  • The treatment of dependencies of seismic failures in SPRAs depends on the intended use of their results.
  • Further demonstrations of the identified methodology and its use would depend on arising uses or needs or, for example, applications to new designs, namely advanced non-light water reactors or modular reactor designs.

8

Objective

  • As part of the 2010-2014 seismic and structural research plan, the Office of Nuclear Regulatory Research (RES) initiated research to:

- evaluate and explore the seismic correlation-dependency topic and, if feasible,

- to propose one or more advanced, more refined and more insightful analysis approaches for its treatment in seismic Probabilistic Risk Assessments (PRAs).

9

Goals

  • That the evaluation of existing methodologies, the review of the related SSC-failure database, and the attributes of the proposed analysis methodology will inform SPRA analyses, peer-reviews, and staff reviews in relation to the treatment of seismic failures dependencies in seismic PRAs for operating and new reactors.
  • Identification of a methodology that with further demonstrations (by its potential users) and use will provide an improved and more insightful approach to seismic PRA 10

Scope

  • Assessment of impact of correlation assumptions made in modern SPRAs have on risk estimates (concentrating on CDF)
  • Review and identification of analysis methods and data sources that could be developed for improved and more insightful risk assessments
  • Identification of a pathway (methodology) so that improved analysis of dependent seismic failures could become a standard part of SPRAs 11

Analysis Aspects

  • Dependencies arise in the system analysis part of a PRA

- Dependencies of SSCs arise in the calculation of the failure frequency of a sub-system of SSSs with performance defined by a Boolean (logic) statement

  • SSCs in parallel (redundant SSCs for example) involve AND gates

- Assumption of dependency results in an upper bound estimate of the sub-system failure frequency (system fragility)

  • SSCs in series involve OR gates

- Assuming independency results in an upper bound of the sub-system failure frequency (system fragility) 12

Analysis Aspects

  • Dependencies arise in the system analysis part of a PRA

- Output of the analysis of the sub-system Boolean expression is essentially a fragility function for the system

- Simplified (anticipated to be bounding) assumptions are typically made

- An improved methodology would obtain narrower bounds on the system failure and address sensitivity of the results to defensible assumptions on dependencies and correlations

  • Approach: involve fragility and system analysts to obtain fragility functions for the sub-systems functions (Boolean expression) 13

Analysis Aspects

  • Seismic Fragility: A = AmEREU

- Am = median, ER= inherent random uncertainty about the median and EU = epistemic uncertainty about the median

  • Usually A = F x RE

- F = a factor of safety and RE = a reference size of earthquake

  • F = FCFRS=(FSFu)(FSAFdFMFMCFECFSDFSS) 14 Capacity factor Seismic response factor Partial factors

Analysis Aspects

  • Seismic Fragility: A = AmEREU

- When there are several components in a Boolean statement, (B, C, D, ) the method involves:

  • Determining the correlation for the EU uncertainty between components (co-variances)
  • Assigning the remaining uncertainty (independent part of the uncertainty) to each component (preserving the total uncertainty)

- Similarly for the uncertainties for ER

- Then the methodology uses a set of rules to determine the frequency of the sub-system failure 15

Analysis Aspects

  • Uncertainties 1.

Determination of the correlation coefficients for the uncertainties in EU and ER 2.

Subsequent set of rules to calculate the sub-system failure probability

  • Item 1 - The correlation coefficients can be determined from the partial factors of safety and the combined to obtain those for Eu and ER (may reduce variability among analysts)
  • Item 2 - Verification of the simplified method against more rigorous existing mathematical approaches (too onerous for general use) 16

Study Approach

  • Review of several SPRAs in the literature (Chapter 4)
  • Review of the existing literature on seismic correlation and dependency analysis (Chapters 2, 6 and 7)
  • Review of existing data from testing and earthquake experience (Chapter 3)
  • Identification of a possible improved and more insightful methodology for treating dependencies in a SPRA 17

Review of SPRAs

  • Assessed impact of assumptions on the treatment of dependencies on the seismic failure of SSCs in risk estimates (concentrated on Core Damage Frequency (CDF) risk estimates)
  • Almost all SPRAs used the rule-based approach with few exceptions

- The Zion SPRA for the Seismic Safety Margins Research Program (SSMRP) and the Diablo Canyon SPRA

Review of SPRAs

  • Observations from the review (examples), which used expert judgement:

- For some SPRAs, the differences in the seismic CDF could range from close (but less than) a factor of 2, but with a typical difference in the range of 30% to 60%.

- For some accident sequences, the differences could be larger (as much as factor of 2 to 4)

- Treatment of dependent failures has small impact if the CDF is controlled by an accident sequence that is itself controlled by a single SSC (singleton).

- For several SPRAs the CDF estimates are not very sensitive to the dependencies issue but risk insights can be sensitive to the assumptions made in the analysis of dependencies

- A few types of SSCs seemed to appear repeatedly among those for which the assumptions used affected the results (the CDF estimates) (although not all affect the results in every SPRA reviewed) 19

Review of SPRAs SSCs that seem to appear repeatedly among those for which the approach to analyze dependencies in their seismic failure can affect the CDF estimates (not all appeared in this manner in all SPRAs reviewed):

- Masonry walls

- Electrical Motor Control Centers (MCCs)

- Large tanks: condensate storage tanks of other similar tanks

- Small tanks: diesel generator fuel oil day tanks

- Heat exchangers: such as component cooling water heat exchangers

- Mechanical: long-shafted service-water pumps, horizontal auxiliary feedwater pumps (motor and turbine driven dependency)

- Batteries and racks 20

Review of Existing Literature on Dependency Analysis

  • A variety of approaches with different level of mathematical rigor have been proposed
  • SSMRP approach

- Used join-lognormal distributions for the response and capacity of SSCs in a cut-set

- Defines cut-set failure as all responses exceeding their capacities

- Integrates the joint distributions over the failure region

- Used in the Zion and SPRA and to derive a set of simplified rules (rule-based approach) called the Bohn-Lambright rules

- Practice tends to use further simplified rules, which assign 100% to the situation of similar SSCs exposed to the same earthquake load (typically, SSCs located near each other), and zero everywhere else.

21

Review of Existing Literature on Dependency Analysis

  • Bohn rule-based approach 22 Rule #

Description 1

Components on the same floor slab and sensitive to the same spectral frequency range (i.e., ZPA, 5-10 Hz. or 10-15 Hz) will be assigned response correlation = 1.0.

2 Components on the same floor slab sensitive to different ranges of spectral acceleration will be assigned response correlation = 0.5.

3 Components on different floor slabs (but in the same building) and sensitive to the same spectral frequency range (ZPA, 5-10 Hz or 10-15 Hz) will be assigned response correlation = 0.75.

4 Components on the ground surface (outside tanks, etc.) shall be treated as if they were on the grade floor of an adjacent building 5

"Ganged" valve configurations (either parallel or series) will have response correlation = 1.0.

6 All other configurations will have response correlation equal to zero.

Review of Existing Literature on Dependency Analysis

  • The review identified an approach that would lead to a more refined and more insightful methodology

- Initially proposed by Reed and McCann (1985) but not further developed

- Leverages approaches widely used in the fragility analysis of SSCs that lead themselves to engineering identification of correlations in the uncertainties of variables that determine and SSC fragility estimation 23

Review of Existing Data

  • Main observations in relation to data-driven support for determining seismic failure dependencies
  • Shake-table testing data

- Shake-table test data is largely inadequate for purpose of understanding dependencies among failures - Mostly qualification testing data and when taken to failure mostly testing of single items

- Largely inadequate for the purposes of understanding the dependencies among seismic failures - Sparse data, difficult to understand and large interpretation uncertainties 24

Analysis Process in a SPRA 25

1. Performance of a SPRA using standard methods Needs to include sufficient sensitivity analysis studies)
2. Identification of those (presumably few) cut-sets or accident sequences where correlations analysis makes a difference Difference in terms of risk quantification, importance, and safety insights
3. Use the improved methodology to study the identified cut sets or accident sequences one-by-one.

Revised fragility functions

4. Use of the revised fragility functions in the SPRA in the usual way May involve iterations to Step 3 or Step 2

Analysis Issues/Uncertainties

  • Difficult to use methodology for the revised fragilities except for most experienced SPRA fragility analysts
  • Variability among fragility analysts

- Variability from analyst to analyst

- Expert judgement to assign uncertainties as dependent or independent (determining coefficients of correlation)

- Would need further sensitivity assessments

  • Issue of data availability and focus on matters of more or less conservative analyses (instead of, for example, looking for safety insights)
  • Peer-review needs 26

Summary / Remarks As part of the 2011-2014 seismic and structural research plan RES initiated research to explore the topic of dependent seismic failures of SSCs is SPRAs and, if feasible, to identify more refined and insightful analysis approaches for its treatment in SPRAs.

The research documented reviewed past SPRAs, the SSC-failure database, and identified a more refined and insightful methodology that has promise for practical treatment of the dependency issue in SPRAs The methodology described needs further demonstrations (by potential users) to provide an new and more insightful approach for SPRAs (in relation to the treatment of dependency of seismic failures) 27

Summary / Remarks The treatment of dependencies of seismic failures in SPRAs depends on the intended use of their results.

Further demonstrations of the identified methodology and its use would depend on arising uses or needs or, for example, applications to new designs, namely advanced non-light water reactors or modular reactor designs.

28