ML18306A779

From kanterella
Revision as of 20:57, 14 June 2019 by StriderTol (talk | contribs) (Created page by program invented by StriderTol)
Jump to navigation Jump to search
Transcript of Advisory Committee on Reactor Safeguards Structural Analysis Subcommittee Meeting - October 3, 2018, Pages 1-134
ML18306A779
Person / Time
Issue date: 10/03/2018
From: Shukla G
Advisory Committee on Reactor Safeguards
To:
Shukla G
References
NRC-3927
Download: ML18306A779 (134)


Text

Official Transcript of Proceedings NUCLEAR REGULATORY COMMISSION Title: Advisory Committee on Reactor Safeguards Structural Analysis SubcommitteeDocket Number:(n/a)Location:Rockville, Maryland

Date:Wednesday, October 3, 3018Work Order No.:NRC-3927 Pages 1-14 NEAL R. GROSS AND CO., INC.

Court Reporters and Transcribers 1323 Rhode Island Avenue, N.W.

Washington, D.C. 20005(202)234-4433 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.

(202) 234-4433 WASHINGTON, D.C. 20005

-3701 www.nealrgross.com 1 1 2 3 DISCLAIMER 4 5 6 UNITED STATES NUCLEAR REGULATORY COMMISSION'S 7 ADVISORY COMMITTE E ON REACTOR SAFEGUARDS 8 9 10 The contents of this transcript of the 11 proceeding of the United States Nuclear Regulatory 12 Commission Advisory Committee on Reactor Safeguards, 13 as reported herein, is a record of the discussions 14 recorded at the meeting.

15 16 This t ranscript has not been reviewed, 17 corrected, and edited, and it may contain 18 inaccuracies.

19 20 21 22 23 1 UNITED STATES OF AMERICA 1 NUCLEAR REGULATORY COMMISSION 2+ + + + +3 ADVISORY COMMITTEE ON REACTOR SAFEGUARDS 4 (ACRS)5+ + + + +6 STRUCTURAL ANALYSIS SUBCOMMITTEE 7+ + + + +8 WEDNESDAY 9 OCTOBER 3, 2018 10+ + + + +11 ROCKVILLE, MARYLAND 12+ + + + +13 The Subcommittee met at the Nuclear 14 Regulatory Commission, Two White Flint North, Room 15 T2B1, 11545 Rockville Pike, at 1:00 p.m., Peter 16 Riccardella, Chairman, presiding.

17 18 19 20 21 22 23 24 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 2 COMMITTEE MEMBERS:

1 PETER RICCARDELLA, Chairman 2 MICHAEL L. CORRADINI, Member 3 RONALD G. BALLINGER, Member 4 MARGARET SZE-TAI Y. CHU, Member 5 VESNA B. DIMITRIJEVIC, Member 6 JOSE MARCH-LEUBA, Member 7 HAROLD B. RAY , Member 8 JOY L. REMPE, Member 9 GORDON R. SKILLMAN, Member 10 MATTHEW SUNSERI, Member 11 12 DESIGNATED FEDERAL OFFICIAL:

13 GIRIJA SHUKLA 14 15 ALSO PRESENT:

16 JOSE PIRES, RES 17 MEHDI REISI-FAHRD, NRR 18 19 20 21 22 23 24 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 3 C-O-N-T-E-N-T-S 1 PAGE 2 Opening Remarks and Objectives 3 Peter (Pete) Riccardella, ACRS......4 4 Presentation and Discussion...........10 5 Correlation or Dependency of Seismic 6 Performance of Similar SSCs by Jose 7 Pires (RES) and Mehdi Reisi-Fard (NRR.

8 Closing Comments 9 Pete Riccardella, ACRS.........104 10 Adjourn....................104 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 4 P-R-O-C-E-E-D-I-N-G-S 1 (12:58 p.m.)

2CHAIRMAN RICCARDELLA: The meeting will 3now come to order. This is a meeting of the ACRS 4Structural Analysis Subcommittee. I am Pete 5Riccardella, Chairman of the Subcommittee. ACRS 6 members in attendance are, Vesna B. Dimitrijevic, 7 Margaret Sze, Harold Ray, Gordon Skillman, Mike 8 Corradini, Matt Sunseri, Joy Rempe, Jose March-Leuba, 9 and Ron Ballinger. We may or may not have two other 10 members come in later.

11 Girija Shukla of the ACRS is the 12 Designated Government Official for this meeting.

13 The ACRS reviews and advises the 14 Commission in regard to licensing and operation of 15 production and utilization facilities and related 16 safety issues, the adequacy of proposed reactor safety 17 standards, technical, and policy issues related to the 18 licensing of evolutionary and passive plant designs, 19 and other matters referred to it by the Commission.

20 The purpose of this Subcommittee meeting 21 is for the staff to brief Subcommittee on the topic of 22 Correlation or Dependency of Seismic Performance of 23Similar SSCs. This is the topic of a research 24 publication, NUREG/CR-7237, Correlation of Seismic 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 5 Performance of Similar SSCs.

1 Members of the -- this is also the topic 2 of a research review, and I want to note that this 3 briefing that we're having here is independent of the 4research quality review. That quality review is well 5 under way and the panel, the research panel is here 6 but they've pretty much already completed their 7 review.8 The Subcommittee will gather information, 9analyze relevant issues and facts. And formulate 10proposed positions and actions as appropriate. The 11meeting will be open to the public. We have not 12 received any written comments, or any requests for 13 time to make oral statements from members of the 14 public regarding today's meeting.

15 A transcript of the meeting is being kept 16and will be made available as stated in the Federal 17 Register Notice, therefore we request that 18 participants in this meeting use the microphones 19 located throughout the meeting room when addressing 20 the Subcommittee.

21 Participants should first identify 22 themselves, and speak with sufficient clarity and 23volume so that they can be readily heard. To avoid 24 interruption of the meeting, please mute your 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 6 individual lines during the presentations and 1committee discussions. Also please silence your 2 phones. And I just, I've been advised that --

3MEMBER CORRADINI: Yes, just for 4everybody. So this test of the Emergency Broadcast 5 System via mobile is going to happen in a little bit 6more than an hour. My recommendation is that you 7 power off your phones --

8 CHAIRMAN RICCARDELLA: Before.

9MEMBER CORRADINI: -- before 2 o'clock so 10 it, because it will broadcast whether you have your 11 phone muted or not.

12 MEMBER MARCH-LEUBA: Yes, but 13 alternatively, you can put it in airplane mode.

14 MEMBER CORRADINI: It'll still --

15 MEMBER MARCH-LEUBA: Airplane mode --

16MEMBER CORRADINI: Won't do it. It'll 17 still broadcast through it.

18 MEMBER MARCH-LEUBA: Airplane mode?

19MEMBER CORRADINI: Yes if you power --

20 you're going to have to poser it off.

21 MEMBER MARCH-LEUBA: Let's try a test.

22 MEMBER CORRADINI: Okay, go ahead.

23 (Laughter.)

24 MEMBER CORRADINI: Feel free.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 7CHAIRMAN RICCARDELLA: Let me, just for 1 those members who weren't on the Research Review 2 Committee, just a little bit of an introduction in my 3 simple way of looking at it, at the topic.

4 Suppose you have three pieces of 5 equipment, pumps that are required -- that are in 6 parallel, and one of them is required to work in an 7accident sequence. And let's assume that the 8 probability of failure of each of those pieces of 9 equipment at a given level earthquake is 0.1. Okay.

10 If the components are independent then the 11 probability of none of them working is .1 of q, or 10 12to the minus 3. On the other hand if they are 13 dependent, if the three are dependent, the probability 14 that if one fails, they're all going to fail, so the 15 probability is .1. And that's the significance that 16 we're talking about.

17 And current seismic PRA's there's a rule 18 of thumb which I'm sure Jose and others will discuss 19 that in some cases you assume they are perfectly 20correlated, which is the 0.1. And in other situations 21 you assume that they're totally uncorrelated, which is 22 the 10 to the minus 3.

23 And I think what came to my mind when I 24 reviewed this was the potential significance with 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 8 respect to NuScale, where you might have 10 or 12 1reactors in a common site. And you have a big 2 earthquake, you know, is the probability -- you know, 3 you could get into a 10 to the minus ten, 10 to the 4 minus 12th situation versus a .1 probability that 5 they'll all fail.

6 So, that's why I thought it might be a 7good idea to have this meeting. And I think this 8 meeting will also serve as sort of some education for 9 the members of the committee who weren't on the 10 quality review.

11 MEMBER SKILLMAN: Pete, let me ask this, 12for the record, I'm Dick Skillman. In this argument, 13 or in this example that you just explained, the way I 14 interpret that is if these three components are 15 identical, are operable, that means they're not pulled 16along. They are in trigger, ready to go. And at the 17 same location, thus experiencing the same physical 18 behavior --

19 CHAIRMAN RICCARDELLA: Yes.

20MEMBER SKILLMAN: Then all that you've 21 just mentioned is accurate. But of the three pumps, 22 if one is a 14 stage, one's a 13 stage, one's a 12 23 stage, one is in total lock, and one is on a different 24set of supports. Then there is basis for the 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 9 licensing to claim, not identical, different response, 1 and here's the response data for, you know, the shaker 2table test I did for these. Therefore, the seismic 3 dependency while interesting, doesn't take out all of 4my components. Is that an accurate framework for 5 this?6CHAIRMAN RICCARDELLA: Yes, and there's 7 current rules of thumb for how you handle that, okay.

8 MEMBER SKILLMAN: Okay, thank you.

9CHAIRMAN RICCARDELLA: But as I understand 10 it, in fact even for those three identical pumps there 11 are aspects of their seismic fragility which are 12correlated, and aspects that aren't correlated. Okay, 13 and so the reality is probably somewhere between zero 14 and one.15 And for example, you know, if I think a 16 seismic qualification test is probably a lot like a 17fatigue test. I run ten identical fatigue tests on 18 the same pieces of equipment, and the equipment can, 19 you know the samples will fail sometimes anywhere 20between 1000 and 10,000 cycles, or 100,000 cycles.

21 And so there's a -- that's a total randomness that 22 even for identical equipment exists.

23 So, but this report is aimed at something 24in between those extremes of zero and 1. And with 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 10 that I'll let Jose and the Research staff proceed.

1MR. PIRES: Good afternoon, I am Jose 2Pires. I am a Senior Technical Advisor in the 3 Division of Engineering, in the Office of Research.

4 I'm really the main preparer of this briefing because 5 this project was conducted by the Division of 6 Engineering. We had the lead for this project.

7 In the preparation of these slides, and in 8 preparation for this meeting, I discussed with some 9other colleagues. I discussed with Selim, various 10topics related to the issues of correlations. He's a 11Seismic PRA Analyst. So he has experience in that 12area. So if I could benefit from it. He's sitting 13here if his help is needed to answer some questions 14 that I may not be able to answer.

15 And Mehdi, he works at NRR and he's been 16 involved in the reviews of Seismic PRAs that have been 17submitted as part of the 2.1 Evaluation. So he can 18provide some perspectives also. I also discussed with 19 him issues of seismic dependency, seismic failure 20dependencies. And he can provide some perspectives of 21 what is being done nowadays in this area to address 22 this issue.

23 CHAIRMAN RICCARDELLA: Yes, perhaps some 24perspective on the significance of it. In other words 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 11 if you did have a more accurate way of treating it, 1would it have a significant effect of some PRAs or 2 not?3MR. PIRES: And I just in case that if we 4 talk about the applicability of some of these 5 methodologies here to these modular reactors, I also 6 talked to someone at NRO that is more familiar with 7what is going on in relation to new reactors. So he's 8 sitting here too, and if necessary can also help 9 answer some things, if necessary, he can.

10So, this is pretty much the outline. And 11 so I will try to focus mainly on the research before 12us. And on the research that was then. So I'll talk 13 some about the objectives, some background leading to 14 research objectives and goals, how we thought these 15 could be used. The scope of the work.

16 And I quickly go, we're talking about the 17approach and everything. I think it's probably a good 18thing to talk about some aspects of the analysis. So 19 I'll, the treatment of correlations he's used in the 20seismic PRA analysis. And what his methodology, what 21 are the enhancement that these methodology provide?

22 So this analyses aspect can go back to the 23 approach, it was a methodical approach involved in the 24 review of the existing PRAs to see what is the 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 12 significance of the correlations on the analyses, or 1 the dependencies.

2 Review of current literature, and various 3methodologies that I used. The project also involved 4workshops with experts. And those workshops were 5useful. Those are mostly seismic fragility knowledge 6 experts. They provided insights.

7 We questioned them for instance about what 8is their data? Are they experimental data or 9 experienced data that somehow could be useful in a 10more data driven approach? And we'll talk about that 11 later.12Then we'll talk about what will be the 13 process of implementing this methodology in the 14seismic PRAs? It's really an obvious process but then 15 what could be issues associated with that, the use of 16 this methodology? Then I will summarize.

17Right now, I say so that we have to, I 18 guess your introduction already covered that, that the 19 Seismic PRA risk, Seismic Probability Risk Assessments 20have been done worldwide. And not just in the United 21 States for quite a long time too, more than three 22 decades. And some key aspects there, I guess one of 23 the aspects is that one has to consider all possible 24earthquake levels in the PRA. And so the frequency of 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 13 occurrence of what we would say, some earthquake size 1 is what we relate to in the seismic hazard.

2 And then do a proper convolution of the 3 fragilities expressed in terms of those earthquake 4 size with the hazard, seismic hazard. That has been 5 addressed.

6 Topic today is that the earthquakes can 7 simultaneously damage multiple, redundant components 8for example. And then also for similar components, 9all at the same time. So, and that there is 10 quantification should account for that.

11 I have some pictures here just to try to 12 illustrate --

13MEMBER RAY: Excuse me, I wanted to ask a 14question on the slide before. The phrase, "all 15 possible earthquake levels". What does that mean?

16MR. PIRES: Well, that means that the 17 seismic hazard should encompass the true scope of the 18hazard. You know, not artificially have a limitation.

19 Is what the results of the probabilistic seismic 20 hazard analysis produce that should all be accounted 21 for in the seismic probability statistics.

22MEMBER RAY: So there's no limit on the 23 range of probability, or is there a cutoff?

24MR. PIRES: No, in principle there should 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 14 not be any, I mean. But what happens in practice is 1 that after some levels the probabilities are so small 2 that they can be neglected.

3 MEMBER RAY: Sure.

4MR. PIRES: But they theoretically are 5 possible.6CHAIRMAN RICCARDELLA: Okay. You know, 7 you have a probability of occurrence of an earthquake 8 of various sizes and as the earthquake gets larger 9obviously that probability goes down. But, you know, 10 they'll consider ground motions from .1g up to greater 11 than 1g. You know, 1g, 2g and they'll consider them 12incrementally. And then each one of those earthquakes 13 has an uncertainty distribution around it as well.

14 Each one of those --

15MEMBER RAY: Yes, I understand Pete, I was 16 just wondering if they at some point as he said, the 17 probability is low enough that it's cut off?

18 MR. PIRES: Yes, I --

19MEMBER RAY: And I didn't know what all 20 possible --

21MR. PIRES: That's what is meant. And in 22many ways it's probably -- I don't like it. In the 23 case of the earthquake hazard, you somehow have to 24 choose now that it can come, go over the entire range, 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 15and both of these very low probabilities. So, you can 1 do that.2CHAIRMAN RICCARDELLA: But, I think, also 3 when you say all possible earthquake levels, they're 4 really referring to the peak ground acceleration, 5 which is, you know, the ZPA, the g level of that.

6 They're not considering all multiple possible spectra 7 for a given GPA, are they?

8 MR. PIRES: Yes, the hazard will give us 9that. For a site, it can give us the ground motion 10response factor. And so, it dramatically could vary, 11 but normally in the bins of interest, it does not vary 12much for a particular site. But if necessary, that 13 could be accounted for and make the process more 14 complex.15 (Off microphone comment.)

16 CHAIRMAN RICCARDELLA: Okay.

17MR. PIRES: So, I went and got some 18 pictures of earthquakes of first design -- looking at 19 power plant components. This is just to show that 20 sometimes really, we have structures or components 21 that are side-by-side for the same earthquake, and 22 some fail, and others do not fail, for a variety of 23 reasons.24 And like the Northridge earthquake in 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 16 1994, north of Los Angeles, near the San Fernando 1 Valley. You can see there, some buildings, I think, 2 yes, the ones on the right, the first floor collapsed.

3 It's very typical on some of these old constructions.

4 First floor is soft, collapses.

5 The buildings now have one less story and 6 there are people living on that story or occupying 7those facilities. Normally they are garages, so there 8 will be loss of life.

9 The performance faction for those 10 buildings typically is no collapse and no loss of 11life. And the ones on the left, they do have 12structural damage, but they did not collapse. They 13are like very close to each other. I'm not saying 14 these are just purely statistical considerations, 15 there may be other factors. But this is an example.

16 Below is an apartment building, it was a 17similar situation. You can see the ones on the left, 18in the front have two story. The other on the left is 19three story. And the first story also collapsed.

20 They are near, they're right next it, they did not.

21 I find interesting the components, the 22 electric power components, designed in a substation.

23 This was in Haiti, and you can see those components.

24 One would expect they all fail, because they typically 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 17 are not very robust for seismic loads. In this 1particular case, only one failed. The others were on.

2That does not mean that the substation did not fail 3 because there is a power flow going there, it's a 4 different issue.

5This is in a power plant, but is not a 6 nuclear power plant in Guam, in an earthquake, and its 7motor control centers. We don't know if they all 8failed. But if they all failed they had different 9 failure modes because obviously one had a tilt-out 10failure mode. The others might have had other 11 functional failure mode. I don't know, but at least 12 the failure modes were different in these phase.

13 Now, actually with the experience data, I 14 caution, sometimes it is very difficult to interpret, 15because we don't have all information. But in this 16 case one would expect that the ground motion would be 17 similarly, the basic citation would be similar upon 18 all of them.

19 I just put one more here, these are tanks.

20 They are many makeup water tanks at the facility they 21had built in place. And they normally tend to all 22 fail in an earthquake, but however the failure modes 23are different for many of them. So there is a 24 possibility not all fail.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 18In this case, they all had damage. There 1 is buckling off the shelf, there are some anchor 2supports. So there may have been, they have different 3 failure modes. The one on the bottom right, sliding 4which I don't understand. So there are issues in each 5 case. Sometimes not so obvious.

6CHAIRMAN RICCARDELLA: The bottom left is 7 anchorage for the tank?

8 MR. PIRES: It's, I think it's an anchor 9 system that there was a lift off there.

10 CHAIRMAN RICCARDELLA: Yes.

11MR. PIRES: Some amount of liftoff. I 12 cannot know, may not know the details of those, but 13 these was presented at one of the workshops, and was 14a few years ago. But it illustrates that in some 15cases you have multiple failures. Almost all the 16components or structures fail. In other cases we 17 really don't have, in our observations of those.

18MEMBER REMPE: Has any effort been made to 19 recently, to try and understand those differences?

20 Differences in anchorages, or there's just not data to 21 try and --

22 MR. PIRES: Oh, no. There --

23 MEMBER REMPE: -- understand this?

24 MR. PIRES: There are a lot of studies.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 19 With tank facilities there are quite a few studies.

1MEMBER REMPE: Say it again. Could you be 2 closer to the mic? I'm having trouble hearing you.

3MR. PIRES: With tank facilities there are 4 several studies to understand those behaviors. They 5 may not be looking at the same thing as we do in terms 6of correlations. But, you know, there are a lot of 7 different, natural gas storage tanks, gas, and other 8 things like that. So these are critical facilities.

9 There is a good understanding of their behavior.

10MEMBER REMPE: But I mean at Daini, do 11 they know why there were different failure --

12 MR. PIRES: Oh, at Daini?

13MEMBER REMPE: -- modes as you've 14 indicated here?

15MR. PIRES: I think this is to be expected 16 that there will be multiple failures of the water, of 17 these water tanks. Now, I have not done an analysis 18 of those. And I have not seen a report on those.

19MEMBER REMPE: It just seems like, that an 20 important piece of information is to try and 21 understand what data are there, and can you extract 22some insights from that data? And so examples, not 23 only over in Japan, but in the U.S. If we could try 24 and understand the differences it would be an 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 20 important aspect to investigate.

1MR. PIRES: That was parts of the 2 workshops on these projects.

3 MEMBER REMPE: Right.

4MR. PIRES: The workshops for these 5 projects had experts that typic ally go to every 6earthquake that has major damage. They normally go 7 there as part of their professional work. They were 8gathered to the workshop and they provided input. So, 9and there is some conclusions that came out of that 10 work.11 MEMBER REMPE: And when I reviewed those 12 conclusions, the data --

13MR. PIRES: Well that, the data is very 14 difficult to interpret and back calculate.

15 MEMBER REMPE: And that's why I'm asking 16this question. It seems like where there are data, 17 one should try to understand it before trying to model 18 it. And it's --

19MR. PIRES: Yes, it's fraught with 20uncertainties. And to the extent, Fukushima people 21 who developed models, tried to correlate them with 22what exists in practice. But we cannot trust the data 23by itself directly. You have to have the modeling, 24 and the knowledge, and the testing.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 21 (Simultaneous speaking.)

1CHAIRMAN RICCARDELLA: You're probably 2 talking --

3 MR. PIRES: From the aspect HPS.

4CHAIRMAN RICCARDELLA: You're probably 5 talking a big research project just to model one 6situation like this. Model all the tanks and, you 7 know, you're probably, it's probably a research 8 project in itself that's of equal cost of this NUREG.

9MEMBER REMPE: In other fields once you 10 get the model that's based on the data, you turn 11 around and find another place, and see if you can 12apply that model, and if it can be validated. And so 13 that's why I'm more interested in the data before I 14 get interested in the model.

15MR. PIRES: It is done. The experts 16 working on the field of tanks for example, they try to 17always see how their results correlate with data. But 18 there are uncertainties on that.

19 MEMBER REMPE: Yes.

20MR. PIRES: What happens in the field 21 normally does not have all the information that you 22 would like for a full benchmark.

23 MEMBER REMPE: Yes, I understand.

24 CHAIRMAN RICCARDELLA: Jose.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 22MEMBER MARCH-LEUBA: I find interesting a 1couple slides before, it's very visual. One more, 2there. The picture on the right is really, that one.

3 You had to tell me what happens on the floors, the 4missing floors. But when I look at that one I clearly 5 see one failed, three that didn't.

6 MR. PIRES: Yes.

7MEMBER MARCH-LEUBA: Will these be 8 relevant only for only, quote-unquote, marginal 9earthquakes? So it was, and by marginal I mean an 10 earthquake that is close to the acceleration where you 11 fail?12CHAIRMAN RICCARDELLA: Are you talking 13 about the Haiti?

14 MEMBER MARCH-LEUBA: The Haiti one.

15 CHAIRMAN RICCARDELLA: Okay.

16 MEMBER MARCH-LEUBA: I mean this one, it 17 tells me one failed, three didn't.

18 CHAIRMAN RICCARDELLA: Yes.

19MEMBER MARCH-LEUBA: On the houses you 20have to tell me what happened. Although it's clearly 21 worse.22 MR. PIRES: Yes.

23MEMBER MARCH-LEUBA: But it is only for a 24small range of Gs that this will happen? If the 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 23 acceleration had been ten percent higher, all of them 1 would have failed? The acceleration would have been 2 ten percent lower, none of them would have failed?

3MR. PIRES: It's quite possible, it's 4quite possible. There in this, for this particular 5 components they have prove --

6MEMBER MARCH-LEUBA: No, but the basis of 7their method. Is that we're going to separate this 8plus-minus? Is this plus-minus ten percent? Is this 9 plus-minus 50 percent with random variability versus 10--11CHAIRMAN RICCARDELLA: I would say, I'd be 12 surprised if ten percent made --

13 (Laughter.)

14 CHAIRMAN RICCARDELLA: -- made that much 15 of a difference.

16 MR. PIRES: I have no idea.

17 MEMBER MARCH-LEUBA: Yes.

18MR. PIRES: In this particular, the 19 ceramic components on the substation tend to be 20vulnerable. And so if the earthquake was stronger at 21 site, you almost would expect all of them to fail.

22 However, in this case, those cables going upwards do 23 provide some support.

24 MEMBER MARCH-LEUBA: Oh, they're holding 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 24 it.1MR. PIRES: And that might have worked 2 differently for the different components and that made 3the difference in this case. So it also however, 4 those components, those cables going up, also may pull 5up the bus that goes overhead. So, you have to 6 consider both cases.

7 MEMBER MARCH-LEUBA: Yes, this goes back 8to our conclusions. And I know Vesna is going to talk 9about that. This is going to be almost impossible to 10recommend.

Because you need to know how tight are 11 those cables on top?

12MR. PIRES: Right. I meant, caution is 13 that as far as nuclear power plants are concerned, 14this is not a component that appears in the PRA. But 15it's just an example. It's normally other components 16 appear in nuclear.

17 This crisis in this case is an issue of 18 what are the anchors on these cabinets?

19 CHAIRMAN RICCARDELLA: Go.

20MEMBER SKILLMAN: Jose, on this image, on 21 the lower left.

22 MEMBER MARCH-LEUBA: Here?

23MEMBER SKILLMAN: No, the bolt. Very 24 commonly, the construction for that bolt is a J-bolt 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 25 that's been grouted or that's a Hilti that has pulled 1 loose. But in either case, I interpret that to be a 2four or five inch displacement of the base of that 3 tank against what had been the original forked bolt.

4 That bolt has been pulled loose.

5 MR. PIRES: Yes, probably the bolt might 6 have --7MEMBER SKILLMAN: The force that pulled 8 the bolt loose was the ear on the tag that moved 9 upward. It pulled the bolt right out of the ground.

10 MR. PIRES: Yes.

11MEMBER SKILLMAN: Is that what you see in 12 that image?

13MR. PIRES: I would say that that is 14 probably the correct interpretation. I would say, 15 because I think there might have been an overturning 16 moment, and the entire force on that bolt might have 17failed the bolt. And then it was sliding after that.

18 But you could also fail the tank involved, depending 19 on what is the weak link there? So it is, so either 20can be a weak link. Normally, it would probably, the 21 bolt failure would be the --

22MEMBER SKILLMAN: Likely, the bolt 23 anchorage.

24CHAIRMAN RICCARDELLA: The anchorage of 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 26 the bolt, anchor fail.

1MR. PIRES: Not, the tank link itself 2would be the buckling. And that does not necessarily 3mean that there is a leakage of the water. But it is 4normally assumed that there is. But that does not 5 mean that there is. It might still hold water.

6 There, so I'll just say that normally 7 these, of course all these SPRAs normally involve a 8 set of, a rule-based approach so to speak, on how to 9deal with the dependent failures. And typically data, 10 two parameters that are important is the similarity of 11 the components at the very high level and the 12 proximity of the components.

13 So based on those two parameters now you 14 have four cases, four combinations, similar components 15close by, similar components far apart. But a 16 different storage, and dissimilar components close by, 17 and far apart.

18 So the rule-bases account for those cases.

19 And they try to make, I just put there two cases, and 20 not in case I need to go here with all the details of 21 the rule-bases. But obviously they are intent to be 22close together. They are close together, they are 23 similar normally. And that's the baseline knowledge 24 is assumed correlation on those failures.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 27MEMBER MARCH-LEUBA: So this is the state 1of the err. This is what everybody has been doing for 2 the last 35 years.

3MR. PIRES: That's what people do, yes.

4 But is not the state of the -- I would say it is the 5 state of the practice.

6 MEMBER MARCH-LEUBA: Right. People know 7 better, but they're, right.

8 MR. PIRES: Right.

9MEMBER MARCH-LEUBA: Now would you explain 10the logic? And I don't know anything about seismic 11 responsive buildings, but I would expect that if a 12 tank fails on the basement of a building, on floor 13five, they will fail too. And according to this, you 14 failed them, you have correlation only if you're on 15 the same floor, but not on higher floors?

16MR. PIRES: Yes, that is a complicated 17situation. Because if you do a, calculate the 18 structural response of a building, the acceleration is 19 on the floors of the building. So that will be like 20 the new ground for the components mounted there.

21 You can actually calculate the correlation 22 factor between those, the accelerations on the various 23floors. And you can see that they, the correlation 24 factor actually goes down. Can become small, around 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 28.2 or .3. You know, if they are on the same floor it 1will be higher. But if there are different floors, 2 you can start decreasing the correlation factor. It 3 is not by necessarily, it could be 1 or even .5.

4MEMBER MARCH-LEUBA: My point, just not 5 knowing how this thing is done is, I would have done 6 if one fails, all the ones that are in weaker 7 positions, fail too.

8 MR. PIRES: If the ground motion that is 9 higher than the one with the weakest ground motion 10 fails, then that probably can happen. But there is, 11 the correlation coefficient between the motion of the 12 various floors does decrease with the --

13 MEMBER MARCH-LEUBA: So they --

14MR. PIRES: -- floor level and the 15 distance.16MEMBER MARCH-LEUBA: -- kind of the G 17 forces are smaller on the 5th floor than on --

18MR. PIRES: Well they normally are higher 19on the fifth floor. Because there is amplification to 20the top. But what I'm saying is the correlation 21 coefficient between them.

22MEMBER MARCH-LEUBA: What I would do if 23 something fails on the 5th floor, doesn't mean the 24 four, three, two, and one are bad. But if something 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 29 fails on one, then two, three, four, and five are bad.

1MR. PIRES: It depends on -- I see 2 particularly there is an amplification as you go up.

3There is also a bandwidth on the ground motion. As 4 you go up and amplify, you also have more narrower 5band ground motion. So, depending on what are the 6 frequencies of the components, and IRS, and then we 7test those narrow bands and motions. So that also is 8 another effect.

9CHAIRMAN RICCARDELLA: Tends to go toward 10 the natural frequency of the building.

11 MR. PIRES: Yes.

12CHAIRMAN RICCARDELLA: And or the mode --

13MR. PIRES: But in the lower floors the 14 bandwidth is a lot broader.

15 CHAIRMAN RICCARDELLA: Yes.

16 MR. PIRES: Tends to be broader.

17 CHAIRMAN RICCARDELLA: Yes.

18MR. PIRES: So, and, but that is captured.

19 The response part, yes now is can capture it 20 reasonably well. Is the capacity part in my opinion 21 that is more difficult, for which it is more difficult 22 to establish the correlations.

23CHAIRMAN RICCARDELLA: So in a seismic 24 puree, does the fragility, the person developing the 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 30 fragility curves, he considers the difference in 1 response say to a .5 g earthquake, between the 1st 2floor and the fifth floor? That's built into his 3 fragility --

4 MR. PIRES: Yes.

5CHAIRMAN RICCARDELLA: -- curves. So 6 that's taken into account? So it's, the correlation 7 is different than the magnitude of the response.

8 MEMBER MARCH-LEUBA: I have been told by 9 some experts in this room that that was not the case.

10 But obviously I was wrong.

11 MR. PIRES: How it is, it is.

12 MEMBER MARCH-LEUBA: I was misinformed.

13MR. PIRES: You try to express all the 14 fragilities in terms of the ground motion at one 15reference location. But the calculation of that 16 accounts for the transfer function between these 17 locations.

18So the capacity of the component may be 19 the same but the fragility can change because of the 20 location, and the ground motion varies. So there is 21 a difference there.

22MEMBER MARCH-LEUBA: Yes, and I can see 23 how the building can because of the natural frequency, 24can filter some. I mean you could have a high 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 31 frequency, you have less shock upstairs than 1 downstairs.

2MR. PIRES: Yes, there is some of that.

3 And, you know, the question is how much of that, of 4 the process is involved some type of broaden of --

5 MEMBER MARCH-LEUBA: Yes.

6 MR. PIRES: -- of the motion. And so we 7 are careful to do that. But those effects do exist.

8MEMBER MARCH-LEUBA: It's a complex 9 phenomenon.

10 (Off microphone comment.)

11MR. PIRES: Those effects exist. The fact 12 that the ground motion frequency content can change 13 somewhat with the location, and is important.

14 So I guess one part of the background was 15 that of course the methodology makes this bounding --

16simplifying assumptions. Later on when we talk about 17 the literature review, she'll review our mission that 18initially there was a set of simply finding 19assumptions that was more complex than these. But 20even that set of simply applying assumptions has 21 fallen off somehow.

22 One of, of course sensitivity analysis are 23always done. I see the analysts pick up a baseline 24 case and they do sensitivity analysis to see how 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 32 important those aspects are.

1 Sometimes people expressed their idea that 2 although these bands are large, you may mask some 3 insights that otherwise would not be masked. If you 4 had data more detailed than all this.

5 And now I would like to mention that the 6 treatment, well I'm not saying that the treatment of 7 dependencies the way it done now is deficient, or 8somehow inappropriate. The treatment of dependencies 9 depend on the intended use of the results. And what 10 is the need for those results?

11 So that is one aspect, and so that I would 12 like to caution that the other thing is that the 13 methodology that was developed that here, that might, 14 will need further demonstrations and development.

15 But its use in those further 16 demonstrations will definitely, are going to depend on 17 our rising uses or needs.

18 CHAIRMAN RICCARDELLA: Yes.

19MR. PIRES: To my understanding the 20 current uses and needs, what has been used, seems to 21 be sufficient. But that may change.

22 CHAIRMAN RICCARDELLA: Okay.

23MR. PIRES: So, I think particular 24 applications, that some more elaborate studies have 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 33 been that.

1 CHAIRMAN RICCARDELLA: You know, I think 2 going back to the previous slide, I think it's, to me 3 an important point is that insights that you might 4 get. You know, for example if you have three pieces 5 of equipment, maybe it would be smart to just change 6 the mounting a little bit.

7Make it, you know, come out and rotate 8 them or put different size gaskets in there, or 9something. Just anything to make them not identical.

10 You might reduce the -- you know, if it turned out to 11 be significant it could have a significant --

12MEMBER MARCH-LEUBA: But only for those 13 pieces or components of the SPRA, defined as critical.

14 (Simultaneous speaking.)

15MEMBER MARCH-LEUBA: And which would be 16 one or two, it won't be the whole plant.

17CHAIRMAN RICCARDELLA: Yes, I would think 18 the sensitivity analysis, you'd say well, I'll do it 19one way with everything 100 percent correlated. I'll 20 do it a second time with everything percent zero 21correlated. And if the core damage frequency comes 22 out the same, obviously doesn't matter, right.

23MR. PIRES: In this, one of the slides 24 later on says, of the implementation, all the use of 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 34these, what will be the process for use these? And of 1course the process is iterative. It starts with 2 simply finding assumptions based on that, you identify 3 those few, you know, cut-sets or accident sequences 4 that need to be further refined and investigated.

5 CHAIRMAN RICCARDELLA: Yes.

6 MR. PIRES: And you'll proceed that way.

7 MR. REISI-FARD: Can I provide a comment 8 on that question?

9 MR. PIRES: Sure.

10MR. REISI-FARD: So this is Mehdi 11Reisi-Fard. I'm an acting team lead in the Office of 12Nuclear Reactor Regulation. On the point that you had 13 with respect to sensitivity analysis, in fact that's 14 what the licensees do in some risk-informed 15 applications like 50.69.

16 As a part of the NEI guidance to do those 17 50.69 evaluations, when they use seismic PRA, it is 18 recommended to do, to assume full correlation and no 19correlation on the same floor, to just get their --

20 sites.21 So that's part of the guidance that the 22 industry is using currently for some of those 23 applications.

24 CHAIRMAN RICCARDELLA: Yes, thank you.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 35MR. PIRES: Yes, I'd like to put this 1 first bullet, you may think of it as a disclaimer, but 2 I don't want to claim that what the current practice 3 is necessarily not a good practice, you know. This, 4 so I will go back what was the objective of the study.

5 You know, the 2010, 2014 seismic constructional 6research plan in the Office of Research, initiated 7 this study.

8 And those are the objectives of the study.

9 So a lot of these topics, and if feasible to propose 10 some refinements to the methodology that could provide 11 those additional refinements, or could be more precise 12 for needs that at that time were thought that might 13 come up.14 And at that time there were some studies 15 going on, severe accident studies going on, that 16 motivated part of this study, even though they were 17not PRA studies. The Level 3 PRA project was going to 18start. There was talk of modular reactors coming for, 19even though that far back there was already talk of 20that. And then that subsided somewhat, and then along 21 it came it back again.

22 So, the Office was being prepared to 23 address these issues. And this, the goals of course 24 are that somehow the review that the report did, the 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 36 opinions of the experts on the componen ts that 1 typically appear as critical, and that appear on the, 2 as important in terms of dependencies, and other 3 information there, could support staff reviews or peer 4reviews, you know. It's tool that could be consulted 5 and used in those reviews.

6 And so, the methodology depending on the 7 needs of potential applicants, and our staff in terms 8 of their reviews could provide more insightful 9 approaches.

10 Now the scope of the work as defined in 11 the statement of work, it said, first part was, assess 12 the impact of correlation and some different 13 assumptions on the results of seismic PRAs that have 14been done to date, and that they read about. This 15concentrated on core damage frequency. They reviewed 16--17 And so then, the other part was what we 18talked before. The review of what, an identification 19 of an analysis method that could be an improvement, or 20 thought it is now, but will not necessarily be a very 21 cumbersome method. That will not involve a level of 22 effort and work that would be another of magnitude 23higher. But maybe 50 percent more level of effort.

24 So, and that was the intent there.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 37 The third way, the third is of course 1identify a pathway so that this methodology could 2 become standard. That of course is a more, does not 3depend on the NRC. Depends on the need of the 4 industry.5MEMBER SKILLMAN: Jose, before you move 6 that slide, for the first two bullets, how many 7 examples, or how many calculations, or how many --

8 what is the population of the review, as you point to 9 these two bullets?

10 MR. PIRES: Okay.

11MEMBER SKILLMAN: Is it 100 samples, 80 12 samples, 500 samples?

13MR. PIRES: Right, the project really 14 reviewed what existed into analysis by themselves.

15But they reviewed 20 PRAs, 20 cycling PRAs. Some were 16 done in the last ten years, other were done probably 17 ten to 20 years ago. So there were already were the 18 ways of doing the PRA during that timeframe.

19 The analysis methods that I used, yes 20 several were reviewed. Some very simple method like 21 what they call split fraction method, to more 22 complicated methods like the Simex Safety Modular 23Research Program, then at Livermore. I don't know if 24you heard of that. Simex Safety Modular Research 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 38 Program done at Livermore, supposedly by the NRC.

1 Really involved defining for cut-sets, a 2joint probability distribution fraction. For the 3 response in the capacity and then integrating the two 4 together to calculate what was the probability of 5failure. Was a very complex and detailed approach, 6and that was used in designing PRA. So this addresses 7the second bullet. So that is more complex approach, 8 and in many ways, the more rigorous approach.

9And that yielded a set of rules. More 10 complicated than the ones used now, but still simple.

11 So we reviewed the entire scope of methodology that 12 had been used and proposed.

13 MEMBER SKILLMAN: Thank you.

14MEMBER REMPE: So l ater you cite the 15impact of those assumptions. And you do, as you noted 16in the first bullet, focus on CDF. What would have 17 happened, you know, how important would it have been 18 if you'd focused on the risk impact versus the 19frequency impact. Would you still have 30 to 60 20percent, and up to a factor of 2 to 4? I mean are 21 these important from a risk perspective as well as a 22 frequency perspective is what I'm trying to --

23 MR. PIRES: In terms of the --

24MEMBER REMPE: Of the studies you 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 39 reviewed?1 MR. PIRES: -- risk of consequences, you 2--3MEMBER REMPE: Right. I mean are we 4 looking at things that are not really risk important 5 sequences? And okay, you say well it could be up to 6 a factor of 2 to 4 for some of these sequences. And 7 does it impact risk as much as it does frequency?

8MR. PIRES: I think you're if you start --

9 right. This was outside the scope of the work, so I 10 cannot really tell you. And also there are very few 11 PRAs that have gone that far.

12MEMBER REMPE: But you looked at those two 13or three, or whatever you looked at. And I'm just 14 wondering what was the impact on risk of those PRAs?

15 MR. PIRES: I would be speculating.

16 (Off microphone comment.)

17MEMBER MARCH-LEUBA: Are you implying that 18 different core damages have different risk, different 19 consequences?

20MEMBER REMPE: Yes, I mean okay, the 21 frequency could, they're quite, this differences of 22 frequency, or what they're giving values of, and so, 23 yes, you can have core damage where you have a big 24release. And you can have core damage when you don't 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 40 have squat coming out.

1And that's what I'm asking. And are we 2 focusing on something important or not is where I'm 3 getting to?

4CHAIRMAN RICCARDELLA: But do seismic PRAs 5 address that, or that they just compute a --

6MEMBER DIMITRIJEVIC: Well core damage 7frequencies, least measure. It just will at least 8measure the large release frequency for example. Not 9 too many seismic things went to the Level 2, or Level 103 that you can compare it. That's at least my 11 understanding.

12 MR. PIRES: And the regular --

13MEMBER DIMITRIJEVIC: And they're only 14special things. Because those frequencies, also these 15 measures, so it's a large release which is next 16 running through the consequences, and then you have a 17 Level 3, which is, you know, public release which is 18 different thing.

19 But the seismic so far, I mean I only saw 20 core damage frequencies, but I'm sure that now new 21 ones are also producing land releases, right?

22 MR. PIRES: I think so.

23 MEMBER DIMITRIJEVIC: Yes, yes so.

24 MR. PIRES: Now they are.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 41CHAIRMAN RICCARDELLA: What was that last 1 point? I missed that.

2 MEMBER DIMITRIJEVIC: I think that those 3sites will now, when they're handling this seismic 4 PRAs is a part of this 2.1 initiative. I think they 5 are going to the large release too.

6 CHAIRMAN RICCARDELLA: Okay.

7MEMBER DIMITRIJEVIC: But I don't know the 8 ones which you reviewed, these 20 PRAs, did they have 9 releases?10MR. PIRES: The one I, no they did not.

11 Some of the ones that --

one of the PRAs that were 12 more complex were the NUREG-1150. You know, some of 13 those went to large, to releases, but not for seismic.

14 The seismic part ended before that, was not continued 15 all the way there.

16MEMBER MARCH-LEUBA: Because for that you 17 would have to consider correlation between this C 18 pumps over here, and failure of the containment.

19 MR. PIRES: Yes.

20MEMBER MARCH-LEUBA: And you will have to 21 consider that correlation on top of the other one 22 which is already a difficult to have.

23MR. PIRES: I don't want to steer away 24 from the topic, but some of the multipatient from the 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 42 study back in 2010 time to '12 timeframe was the 1SOARCA study. Because you had some sequences and 2 eventually the containment, there would be a release 3and others. And so but in the end, were never used 4 there obviously.

5 The report work was turned in before and 6that was not the risk study. It was a severe 7accident, yes. So you can see that, yes, it was along 8those lines. Also you have to bring evacuation 9 issues, relocation issues, and there those are also 10another type of problem. And at this moment NUREG-11 1150 been stopped before, before that part is external 12 hazards.13 And this, I talk a little bit about the 14 analysis aspect because we keep talking about the 15 methodology that somehow was proposed. And might be 16better. And I felt, don't want to delay that too much 17 before going back to some of the review of the 18 literature.

19 And so it might, I think what the authors, 20 if I could put myself in their frame of mind, the way 21 I understood it, is that so these dependencies really 22 arise on the system analysis part of the -- when you 23 do the fragility analysis for a component, you don't 24have this issue. You're talking to a single component 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 43 there.1 So in the system analysis sometimes you 2 would have a set, or a subsystem that involves various 3 components, and the performance of that subsystem is 4a Boolean expression. Simplest one would be the 5 series, the components in parallel, where if you 6 assume dependency, it will be an upper bound estimate.

7Those are the AND gates. And OR are the ones in 8 series, which is the converse way, that is simple.

9 So in the end what you really get out of 10that is a fragility fraction. Even though much has 11been the fragility of one of the components. Or a 12 multiplication of the fragility, but you really get a 13 fragility fraction that represents that subsystem.

14 So the multipatient of these researchers 15 was a --16 MEMBER RAY: Wait.

17 MR. PIRES: Yes.

18MEMBER RAY: I waited to ask a question 19 before you changed that slide.

20 (Off microphone comment.)

21 MEMBER RAY: Well, I thought I'd pressed 22it but I didn't, hadn't. This is a -- I started to 23 say an unfair question maybe, but nevertheless I've 24 got to ask it because it's hanging on my -- would you, 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 44 in talking about the AND gates, structures and some 1components in parallel. It makes me think as somebody 2 who operated plants for a long time, what do we 3 assume, or is it relevant to even think about what the 4 tech specs require in terms of, being in service?

5 In other words, I've got three pumps but 6I only have to have two of them in service. And I can 7take one of those out for a week. Does that ever 8enter into these analyses? Maybe Mehdi could shed 9 light on that --

10MR. REISI-FARD: The short answer is yes.

11 So the reliability or availability numbers that are 12 already included in PRAs, they do take into account, 13 you know, taking ce rtain SSCs out of service for a 14period of time. So the numbers in the PRAs, the 15availability numbers in the PRAs take into account 16 that factor.

17MEMBER RAY: Okay, and that's good to 18hear. I assumed it wasn't germane to exactly what we 19 were talking about here, but nevertheless it was a 20 question that I had because systems required to be in 21 service is sometimes a real burdensome requirement 22that people back away from in actual practice. And 23 that's what I was interested in.

24MR. REISI-FARD: And I used the word 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 45 availability, I should have said, unavailability.

1MEMBER RAY: Yes, well that's fine. Thank 2 you.3CHAIRMAN RICCARDELLA: And just help me on 4that first subbullet that you have the SSSs. Is that 5 a typo, is that supposed to be SSCs?

6 MR. REISI-FARD: Yes.

7CHAIRMAN RICCARDELLA: I just wanted to 8 make sure we weren't introducing a new acronym here.

9 I have enough trouble --

10 MEMBER REMPE: Wise.

11 (Off microphone comments.)

12MR. PIRES: Sorry. So what was, what's 13 done here was to try to say okay, this is, these 14 dependencies issues are right, getting the system 15analysis process. But in the reality what you are 16 trying to do is that for that subsystem where the 17 dependencies may be significant and important, you're 18 really trying to calculate a new fragility fraction 19for those. It is essentially what you are doing that 20 those sets of rules are doing that, using what 21 fragilities that you already have.

22 So the approach was to see okay, what, how 23 are these fragility fractions calculated for each 24component? And then break down the process into 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 46 various factors that have some physical meaning or 1 engineering meaning, so that you more easily would be 2 able to break down what are the parts that would 3likely be correlated there. So that was the approach 4that was done here. And so then the methodology could 5 then provide this spectra between fully correlated and 6 independent.

7 I tried to put here something just to try 8to show what I just said. And I'm not trying to come 9 much more intent in terms of these equations, but in 10 the seismic fragility, normally is expressed in terms 11of a ground motion level. A, so it is expressed in 12 terms of the median of that ground motion level, that 13 in this case represents the capacity of the component.

14 Can it resist that ground motion level?

15 And then two random variables, one they 16 will refer to it as the random uncertainty. And the 17other the epistemic uncertainty. And normally this 18 process is simplified by saying that the fragility can 19be expressed in terms of effect of safety, times a 20reference level earthquake. The spectra of safety is 21 really just scales of these, but it's just a 22 convenience. Now --

23CHAIRMAN RICCARDELLA: The reference level 24 is like SSE, or OBE?

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 47 MR. PIRES: Could be the SSE, or OBE, or 1 at the given as a level, being say, the ten to the 2 minus four if you are talking about, if we think the 3 dominant being, would be around that level, ten to the 4 minus four, as a -- this, so you have that factor of 5 safety.6 So it is component, capacity, components 7 and it is seismic response components, and those are 8 even further broken down into either the capacity as 9some, these are strengths. The other is the 10 ductility.

11 The partial factors for the seismic 12 response have many parameters like the uncertainties 13on the spectra of the ground motion. How you combine 14the mode shapes, to the substructure direction. So 15 the transfer function that brings you the ground to 16 the various floors that you asked about.

17 So what this method does is that if you 18 have various components in that cut-set, in that 19Boolean expression A, B, C & D. You are going to try 20 to find out what is the correlation coefficient on 21those uncertainties. When you got to the epistemic 22 uncertainties that are, what part of those 23 uncertainties between A&B, and B&C and D is really a 24 correlation coefficient, the co-variance?

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 48CHAIRMAN RICCARDELLA: Could we go back to 1 the previous one, and just help me with what all those 2 F factors are on the bottom.

3MR. PIRES: Right, I know this is a bit 4 hard.5 CHAIRMAN RICCARDELLA: I understand, you 6know, capacity and response, okay. But then the next 7 one, are you saying that the capacity breaks down into 8 that F sub S, and F sub U?

9MR. PIRES: Yes, that is the capacity they 10-- it is for fragility analysis not for design. Is 11 that if you have for instance a sheer wall on a 12 building, you know what the distress of that sheer 13 wall. But you know that it may have some ductility.

14 And so because of that ductility, it can actually take 15higher seismic loads. Not just the ones that goes to 16the region that's strained. So the analysis is 17 rigorous and accounts for this.

18 I don't want to make your discussion on 19 all the fragility analysis done, but that it has all 20 these factors appear there. So when the analyst --

21 CHAIRMAN RICCARDELLA: Just tell me what 22 some of those subscripts stand for.

23MR. PIRES: Okay, so the first one on the 24 response factor, the first one, SA, stands for the 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 49 uncertainties on the response factor of the ground 1motion. If you have a frequency, say 5Hz, you know 2 what is the median value of the spectral acceleration.

3 But there is an uncertainty about that.

4 CHAIRMAN RICCARDELLA: Okay.

5MR. PIRES: So that they are accounted 6there. D is the damping. We may not know as well the 7damping of the structure as we think we know. M, now 8 I'm a little worried about what this M, I forgot, but 9 it will probably come back.

10 But MC is the model combination rule that 11 you use. You have to combine all these mode change.

12 EC is how you combine ground motion in different 13 directions, because the earthquake goes actually in 14all directions. You know, you just cannot do an 15 analysis for one.

16 CHAIRMAN RICCARDELLA: Yes.

17 MR. PIRES: And so that's EC. And SD is 18the depth. If the structures are embedded, you know, 19 you normally tend to reduce the forces on the 20components but there are uncertainties also. That 21 also brought uncertainties.

22 CHAIRMAN RICCARDELLA: Yes.

23MR. PIRES: And the SS is the 24soil-structure interaction. You know, when you 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 50interact the structure is not in -- it couples with 1 the ground and some energy is radiated away --

2 CHAIRMAN RICCARDELLA: Right.

3MR. PIRES: -- and changes the resonant 4frequency. So these are factors that appear on the 5 calculation of the response. Every one of those has 6 a random uncertainty and epistemic uncertainty.

7 CHAIRMAN RICCARDELLA: Yes.

8MR. PIRES: And so what is the first is 9trying to do here? What they try to do is if you add 10 several components, a component A and a component B, 11 or a B and C, a component B and a component C, you 12 will try to see on that ER and EU, what part of that 13 uncertainty between those two components is really 14 correlated?

15 And so you will break down the uncertainty 16 into correlated and then what it is for the component 17 itself is independent.

18MEMBER MARCH-LEUBA: Since Pete brought 19 the math, why do you combine the certainties in a 20 multiplicity of sense, instead of being like the sum 21 or the sum of the squares, or -- does that make sense?

22MR. PIRES: The uncertainties are going to 23 the sum of the squares.

24MEMBER MARCH-LEUBA: I thought they 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 51 weren't.1 (Simultaneous speaking.)

2MEMBER MARCH-LEUBA: Well, those Fs are 3 not uncertainty?

4MR. PIRES: Those Fs are not the 5 uncertainties.

6CHAIRMAN RICCARDELLA: Those are factors.

7MR. PIRES: Each one of those Fs is equal 8to a median times two uncertainty factors. One for 9 random, one for epistemic. So those Fs are the 10 factors themselves.

11 CHAIRMAN RICCARDELLA: Yes.

12MR. PIRES: And that factor is now, F, 13 those factors, each one of those factors has an 14 expression like the first one above.

15CHAIRMAN RICCARDELLA: As a mean plus a 16 distribution.

17MR. PIRES: Plus two factors on all you 18 vary around the mean.

19MEMBER MARCH-LEUBA: Okay, so there was a 20 reason to the madness, and I believe you.

21 MR. PIRES: Right, right. No, it is the 22way to account for all those factors there. So until 23 the uncertainties on all those are combined into the 24sum of squares, and the square root. And essentially 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 52 what the method is trying to do is really almost like 1 finding a set of accumulating dependent random 2 variables in which they try to separate what is 3 correlated from what is not correlated between pairs 4of components. But without necessarily throwing away 5uncertainties. Still trying to preserve the 6 uncertainty, but allocating it.

7 Now if you go and allocate the uncertainty 8 at the high level there on the first line, that may be 9too abrupt, may be very judgmental. The idea of 10 allocating the uncertainty through this method is that 11 each one of those components you may have more 12 engineering insights, to say what is to be correlated 13or not. For instance in the response we can actually 14 have an analytical way to somehow calculate 15 correlation. And the capacity is more difficult.

16MR. PIRES: All right, so I move forward.

17 And now, what are uncertainties on this process? So 18 this process demonstrated in the report for various 19cases. But the report really does not go to the, 20 starts more or less focus on the first line there.

21 They don't go into detail to the bottom line, but 22that's necessary. So I just want to mention that, why 23 it is necessary?

24 Because of the uncertainties, because and 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 53 different analysts may come up with different results.

1 So the more you try to break down and things limit 2 you, you have really engineering understanding and 3 meaning.4 So, all you allocate what is correlated on 5 the uncertainty, to what is independent is subjective 6in some ways. So there is engineering judgment. But 7 if you break down to those basic variables, and then 8 mathematically bring them back up to the higher level, 9you have a process that is more transparent, so to 10 speak. That's the intent here.

11 Now, talk a little bit about the parts of 12the study. So the review of the SPRAs was processed.

13 The impact of the assumption, the predicament of 14dependencies. And the conclusion there was that 15 almost all SPRAs have used rule-based approach. And 16 simple rule-based approach is perfectly correlated, 17 totally dependent, and can date sensitivity analysis 18 of those.19 There have been a few exceptions, like I 20 mentioned before, the Zion SPRA is an exception on the 21 Seismic Safety Margins Research Program. So a very, 22 these were done in the late, early, 70s. So there was 23 a lot money to do these research projects, and we were 24learning. I mean what we do now, we learned from 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 54 those projects.

1 And the Diablo Canyon SPRA also uses more 2complicated set of rules. It essentially started with 3 the SSMRP approach, and then simplified to those rule-4 based approaches, but not just a direct use of them, 5 more complex.

6And so reviewed ten SPRAs. I think I told 7you 20, but it was a mistake. It was only ten, and 8 that is the CDF range, so there was a broad range of 9CDF and the conclusions were those that sometimes 10 there was a difference by a factor of two. But the 11 more typical difference in the bottom line number is 1230 to 60 percent. But some specific accident 13sequences could be more. And so the, for several 14 SPRAs there really was not much of a sensitivity of 15 the result to the dependencies.

16MEMBER MARCH-LEUBA: Remind me again on 17 that first bullet the factor of two, are 30 to 60 18 percent, is that by setting all correlations to one 19 and all correlations to zero on the difference?

20 MR. PIRES: Yes.

21 MEMBER MARCH-LEUBA: Good. Thank you.

22 MR. PIRES: Great. Yes, and the --

23CHAIRMAN RICCARDELLA: 30 to 60 percent on 24 CDF?25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 55MR. PIRES: On CDF. But on particular 1 sequence is, and this where we talk about the 2 insights, is the factor was high and it could be two 3 to four.4MEMBER MARCH-LEUBA: Well, there are 5 sequences that don't really contribute that much to 6 the final numbers, is that correct?

7MR. PIRES: Or there may be more than one 8sequence that contributes. There may be three or four 9 sequences that contribute and the others are not so 10 sensitive.

11 The cases normally where the dependencies 12 were not significant, or the cases where there was a 13 sequence that controlled the CDF and one component on 14 that sequence. But they call it a single --

15apparently that's the term they use. And those 16 happen. It's --

17MEMBER MARCH-LEUBA: Can you give us an 18 example? Where will be the single component that is 19 the dominant?

20MR. PIRES: I can't tell you an example 21 from my sequence --

22MEMBER MARCH-LEUBA: From the many plans?

23 MR. PIRES: Yes, from a pilot study that 24 EPRI did. I think in that plan that there were some 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 56 sump pumps, there were actually several, but they all 1are damaged by the collapse of the building. And so, 2 and those apparently were the main factor from --

3MEMBER MARCH-LEUBA: So the collapse of 4 the building is the single --

5MR. PIRES: Yes, and damages all of them.

6That's the assumption. We already know by the way, 7that buildings not all collapse entirely but that 8 there are parts of a building may collapse, others 9 not, but that was a refinement that was not used and 10 is not really used yet and I think that was one of the 11cases. But I may be wrong but that's my recollection.

12 MEMBER REMPE: So --

13 MEMBER MARCH-LEUBA: I think it's a work 14 example.15 MR. PIRES: Yes.

16 MEMBER REMPE: Years ago, I used to work 17for a company that had a paper reactor design. And so 18 when they did their seismic study for the paper 19 reactor design, they could get the release because 20 they would just assume, look for the release of the 21 sequence of with all those components failed.

22 Like in the Zion PRA, it seems like one 23 could go back to the nons, the regular PRA and get 24 those releases for those sequences that were deemed to 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 57be important here. If it's only a few sequences that 1 are important, I think you could get some insights on 2 is this important to risk from the information that is 3 available.

4And so I guess I'm still pushing. I think 5it should be explored. Are these things really 6 important to risk if it's just 10 PRAs and a few 7 sequences in those PRAs?

8 Is, I don't know how, I've seen some of 9 the Zion one and some of these PRAs that seems like 10 one could find some of that information.

11 MR. PIRES: Yes. I think you could find 12 a nice, I'm pretty sure the authors of this study will 13 know some of that information because they deal with 14 these issues predominately and so they will know some 15 of that.16 And the, a lot of these, the benefits of 17 some of these may be more for new designs because what 18 already exist there is we don't have much in terms of 19 what to change.

20 The, so one of the interesting parts of 21 those reviews was that it looked like there was some 22 set of components that tend to keep appearing on as 23being critical and some are relevant for these 24 dependencies.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 58 And they identified in the study, 1identified if you are listing them there. I don't 2 want to go in more detail other than to say that they, 3 the workshops also questioned the participants to 4 force them to say what are the aspects of those 5 components that really may make then really be more or 6less significant in terms of dependencies. For 7instance, the tanks, they tend to be fabricated 8 locally so there are some variations actually.

9 So in that regard, in terms of the 10capacity, there may be some independence. But when 11 you have some things fabricated in a factory and put 12 together there may be more correlation between them.

13 However, the anchors are done locally so that's more 14 uncertainty.

15 So but they're at least collecting some 16input from experts there. Now the review of the 17 literature like I said before, all the methods were 18reviewed. I'm not going to go here over all the 19methods. I don't think there is a point in doing 20 that. I just like to provide a broad scope.

21 Of course the more rigorous one was this 22 SMRP approach in which equity joint distributions were 23 done for the capacity and the demands for components 24 in a cut-set or in a Boolean expression and those were 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 59 actually numerically integrated over the failure 1 region and they were used in design PRA.

2 One of the benefits of that was that one 3 of those authors of those studies, Mr. Bohn and Mr.

4 Lambright, both of them, but Bohn seems to have been 5the name which will be associated with it, came up 6 with rules that people use and that were simpler.

7 And but those rules were even deemed too 8 difficult and too complex so they're further 9 simplified.

10 I just show you the rules here. You can 11see that in some points these rules, these 12 correlations coefficients of .05 and .75, those were 13 abandoned in the current practice. People went back 14 to minus zero.

15MEMBER SUNSERI: This is a more complex 16 set of --17MR. PIRES: A more complex set of rules on 18rules. But even this complex set of rules is not used 19 in practice.

20MEMBER CORRADINI: Because it's too 21 complex?22MR. PIRES: And to that point I think was 23 because probably the effort needed did not justify the 24 intended use of the results, of the PRA, I think.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 60 But now that of course as the odds have 1 increased and so forth, so in some cases it might be 2 more important to do, to at least bring some of those 3 aspects into place.

4 So when they study and review of all the 5 approaches, they come up that these older approach by 6 Mr. Reed and McCann -- by both of them, mostly Reed, 7 you won't find McCann on these there -- that this 8 approach based on what I described before, it goes 9back to all the fragility and models done by the 10 component.

11 All those factors are isolated and get out 12 from there, because some of those factors, mostly you 13 have some engineering meaning and there's an 14 understanding of those, you could separate what could 15 be correlated from that, but there is still 16 subjectivity. There is still room for some judgment 17 there, so.

18 But and it's not very difficult because 19 you essentially are going to really, you already have 20 that information from the fragility allowed for the 21 components, and you can program the process that is 22 there and implement. So there is an advantage.

23 In my opinion, of course, because there is 24 some room from subjectivity there, it is the more you 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 61 break down in the basic components and then work up 1from those, the better. The other is that the method 2 is simplified so may warrant the comparison with more 3 rigorous methods which exist, but they are very 4complicated but are used in practice. And that is not 5really the object of major research. That's just a 6 graduate student master's key system.

7 The other part was review of existing data 8 and I guess initially the researchers taught that 9 there could be, it would be possible to get data so 10 that the approach would be a more data-driven approach 11but it is not possible. The data is just not there 12 and it would be very extensive.

13MEMBER CORRADINI: Because it doesn't 14 exist or because it's too complicated to analyze?

15MR. PIRES: Both. No, the aspect 16experience data is too complicated to analyze. There 17 are a lot of uncertainties on those. And so far, it 18has been proven very difficult. You know, the access 19 to the data plus the uncertainties.

20MEMBER CORRADINI: Is there other 21 industries that care enough about seismic response 22 that this approach has been taken or a simpler 23 approach has been taken?

24MR. PIRES: Yes. There is a, actually, in 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 62 our work, there is an approach that relies a lot on --

1 experience data.

2 MEMBER CORRADINI: Say again, please?

3 MR. PIRES: In the nuclear power plants, 4 I don't know if you ever heard about seismic 5 liquefaction, soil liquefaction --

6 MEMBER CORRADINI: Yes.

7MR. PIRES: -- during an earthquake.

8 Ultimately, the approaches for soil liquefaction are 9experience-based. There is always even, because it is 10 your technical problem involves soils and so forth.

11 The laboratory samples are typically very small.

12 There is a large effort to connect to an 13 experience data. And the uncertainty still is large 14 and disparity of many disagreements on authoring that 15data, but it has become necessary to do that. So 16 that's a success story on use of earthquake experience 17 data.18MEMBER CORRADINI: What I guess I'm trying 19 to get is, is there, I'm trying to connect back to 20 your multifactor formula --

21 MR. PIRES: Okay.

22 MEMBER CORRADINI: -- which is some sort 23 of benchmarking of the approach that might be used in 24 difference to the heuristic rules that are currently 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 63 used.1 MR. PIRES: Yes. I think the benchmark, 2 it probably would have to be done with shake table 3 testing data.

4CHAIRMAN RICCARDELLA: I think the problem 5 with shake table testing though is that in equipment 6qualification, you don't shake it to failure. You 7just shake it up until a certain level. If it doesn't 8fail, it passes and you're done. So you really don't 9 get any data about correlation or even about the 10 failure level of a piece of equipment, right?

11MR. PIRES: I think that's one of the 12issues of the test data on shake table. The more the 13 fragility analysis is amenable to analytical approach 14is the easier it is to use this methodology. But 15 equipment, sometimes that not so easy to do.

16 CHAIRMAN RICCARDELLA: Yes, oh yes.

17 MR. PIRES: You know, for some equipment 18 changes you can do analysis, but for other equipment 19you cannot do that. One possibility would be to, 20 there are very large shaking tables of detail that 21 maybe while there you could put multiple components on 22 the shake table, orient them in different directions 23 but you see that they have collect data. But that's 24--25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 64 CHAIRMAN RICCARDELLA: You still have to 1 shake them to failure, you're not --

2MR. PIRES: Right, you still have to shake 3 that to --

4 CHAIRMAN RICCARDELLA: You still have to 5 shake them up to a certain level and nothing fails, 6 you don't learn anything, right?

7MR. PIRES: Yes, you will need to shake 8 them to failure until probably all of them are failed 9 in the table. And that would have correlated ground 10 motions but then you should isolate the capacity part 11 though because you --

12 CHAIRMAN RICCARDELLA: Yes, yes.

13MR. PIRES: But to do that, you have to 14 have adjudication in that is it necessary to do that 15 for the use intended? But that will be, for some of 16 these aspect experience, in some cases you can find 17 the information but is not common.

18MEMBER CORRADINI: So let me ask the 19 question from a justification standpoint. So I 20 thought your slide number, maybe I misunderstood the 21 conclusion you had in the slide, which was Slide 19, 22 which is it made a 30 to 60 percent difference on CDF.

23 MR. PIRES: Well, it --

24 MEMBER CORRADINI: Typical difference in 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 65 the range of 30 to 60 percent.

1 MR. PIRES: Yes.

2MEMBER CORRADINI: So is that enough of a 3 difference to warrant this, excuse my English, complex 4 analysis approach?

5MR. PIRES: It depends on the use of that 6 result. I think it, I, you know, if you start going 7 in terms of the total risk or are you just separating 8 the risk for each seismic cause, simple seismic 9 causes?10MEMBER CORRADINI: That last part, I'm 11 sorry?12MR. PIRES: Suppose you are interested on 13 the total risk for the facility, not just from the 14 seismic concept which I understand could be between 15 five to 50 percent of the total risk in terms of CDF.

16 But now you start bringing the fire, you start 17 bringing the internal events, and higher range, and 18combining all the hazards together. Then you get that 19 risk that you may need to see where can you obtain a 20 more accurate results and so that you can open risk 21 inside safety insights --

22 MEMBER CORRADINI: Okay.

23MR. PIRES: -- and to address that. So in 24 those situations I can possibly see that that could 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 66happen for an operating plant but I've not seen any 1 case like that.

2 MEMBER MARCH-LEUBA: This is not unusual 3for this application. We see this in the nuclear 4 industry, especially on -- an example I always mention 5 is over pressure events where you analyze how close 6you are from the level C. All plants are like two PSI 7 from it because this started first with a cheap 8analysis. You ran it, good. A cheap conservative 9 analysis. You run with it you stop.

10If you fail, you go to a more 11sophisticated analysis. You fail that one, you go to 12even more sophisticated analysis until you pass. And 13 all of them are perfectly good analysis so this is a 14similar thing. So this will be only applicable for 15 plants that are close to a limit and where 30 percent 16 makes a difference.

17MR. PIRES: Yes. It, and typically when, 18Mehdi is here, he can correct me. I went to a meeting 19 recently in which there was an issue and obviously the 20 hazard is low and the plant was designed, the job is 21design it for a minimum capacity. In that case you 22probably don't need to do these things. The other is 23 very high and like in the, that case of Diablo Canyon, 24 all of the studies were done in some level of rigor.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 67If some of those plants closer to that 1 higher hazard situation in which the original design 2 might have missed the hazard, that would have more 3 critical. Otherwise it's new designs.

4MEMBER MARCH-LEUBA: And my personal 5 philosophy, preference if you want to, and so for 6 spending the money doing an analysis, going forth with 7some of those components and make them better. Spend 8the same money and Well, just spend the money on 9 paperwork or actually reinforced beams, put some 10 reinforced beams.

11 MR. PIRES: Well, what the analyst can't 12 tell you is what each wants to do that.

13MEMBER MARCH-LEUBA: That is where the 14 value is.15 MR. PIRES: Yes, that would be the value 16 because it's not expected that there will be many if 17that case would happen. I've not seen any case but 18 the analyst could tell you which one of those.

19MEMBER MARCH-LEUBA: You know there is 20 going to be cheaper to bring forth a couple of 21 components, rotate them 90 degrees or whatever, than 22 doing all the paperwork.

23MR. PIRES: In the end, you will end up 24 with capital investments that can do that on some 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 68components and I think these analyst can identify 1 those.2MEMBER MARCH-LEUBA: And while it would on 3 this, NRC will not reward you for doing the right 4 thing, just reinforcing those components. There are 5 so many questions about it, whereas if you come up 6with the paperwork analysis, they'll let you go 7 through.8 MR. PIRES: But I have seen that in some 9 cases, people somehow identified what risk contributed 10 but maybe possible single tons, I don't, can't be 11 specific but that somehow might have led to some 12 upgrade.13MEMBER MARCH-LEUBA: Yes. As an example, 14 I always say that if I am operating a plant, I will 15mount two diesel generators. One in the basement and 16one on the fifth floor. The fifth floor will fail in 17 an earthquake, the basement will fail on a flood but 18 at least I'll have one left.

19 MR. PIRES: Right.

20MEMBER REMPE: So if you were going to use 21 this for insights on which components to reinforce, I 22 would then say you need better data.

So if you go 23 back to Slide 24, you talk about that the data from 24 actual earthquake experience in the plants is sparse 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 69 because people are only reporting failures, or a few 1 failures.2I was wondering if one would take a 3different attitude. Maybe you ought to also be 4 documenting which components survive as well as the 5 ones who fail.

6 I think, again, I'm more into, yes, I'd 7 like to upgrade the plant but also before I go and do 8 more on data or on that modeling, I would really focus 9 on what could you learn from the real world before I 10get a model. And so it seems like you could do 11 something that way.

12MR. PIRES: That is done. The aspects 13that go and collect aspect experience, they collect 14both types. Do you remember that meeting in North 15 Carolina about a year ago and in which there was a 16 person proposing more collection of earthquake 17experience data and more analysis of that? And he 18 emphasized and he has done that in practice for 19 industrial facilities like fossil power plants and the 20others, and they collect both data. They collect data 21 that survived and data that did not survive.

22 MEMBER REMPE: Yes.

23MR. PIRES: Most types of data are 24collected. And but I think in this case, the 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 70 reference to the, to where you might want to do some 1 capital investments is for those cases where you could 2 see that that would have a big payoff to these 3 sensitive analysis.

4MEMBER REMPE: The sensitivity with the 5 old current models. I agree on that one, but.

6MR. PIRES: Or even with even with 7 improved models, it's, but probably that's of course 8 my opinion.

9MEMBER REMPE: We all have opinions, I 10 guess.11 (Laughter.)

12MR. PIRES: Right. But probably more 13 value of these and I move the, if I may, move to the 14other slide. This is how the author recommended that 15 all these would be used so they would still start to 16 be the, perform SPR using the standard methods, enough 17 sensitivity studies so that you can see what, where 18 you may need to make refinements, then the 19 identification of those cut-sets or sequences where 20 you would want to make this refinement of the 21 methodologies.

22 So these are systems analysts there in 23 red. The one in blue, that would be now back to the 24 fragility analyst that would then go use these methods 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 71 to revise the fragility calculation for those cut-sets 1 to obtain numbers that was the methodology that is 2 referred to here.

3 And then we'll go back to the SPRA analyst 4and do the work. So that would be a process that 5 could be done.

6MEMBER MARCH-LEUBA: So if you only 7 propose to do this analysis for the two or three 8cut-sets that make a difference, it's not that 9 expensive.

10MR. PIRES: No. But you need to have a 11 good analyst.

12MEMBER MARCH-LEUBA: Yes, well, that's 13 where the big bucks are, right?

14MR. PIRES: Right, yes, maybe. And so you 15 have here that, so there are difficulties here with 16 the analyst and for this revised fragilities that 17 appear on the blue box and it is, there can be 18 variability among fragility analysts and the report 19 mentions that.

20 (Off microphone comment.)

21MR. PIRES: And there is still some level 22 of expert judgment. I think by breaking down on the 23 basic variables like the fragility on all these tests, 24 you reduce some of that judgment quite significantly 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 72I think. Because it's more transparent to the process 1 where you get to the breakdown of the uncertainties 2 and so.3 (Off microphone comment.)

4 MEMBER CHU: The airplane mode works.

5CHAIRMAN RICCARDELLA: Airplane mode 6 works, yes. I never said, that's not me.

7MR. PIRES: And so this is, let me see, so 8 I don't know if somebody remarked that essentially 9 it's just a summary of what we have been discussing 10about it. I don't know if you want to go through them 11 again.12 But one item that I would like to say 13 there, is that this, we think that with this study we 14can maintain a dialogue with the industry. If the 15 industry's interested and go into other, you know, 16more refined methodologies. We already, it's 17 essentially our part and now the industry probably, 18they are interested. They can either pursue this part 19 or others because we already did some staffing say 20 that there is some things that may have promise.

21 Now with the, you ask that the, so the 22 treatment of dependencies always depends on the 23intended results. So we are not implying here that 24 what is being done now is not appropriate or correct.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 73 And part of the demonstrations of 1methodology would be necessary like you said. It's 2 just the start of a dialogue and there can be arising 3needs. And like you mentioned, the Chairman mentioned 4 at the beginning of the meeting, maybe modular 5 reactors or advanced reactors may want to consider 6 these at the early design stage.

7 I understand it's not being done now 8 because the design certification process is, there is 9 not a lot of definition yet but that is a choice of 10 the applicant.

11 And so we want some of you prepared if the 12applicants go that way. They, our knowledge can 13 respond to that and now understand it.

14MEMBER CORRADINI: Or they could just make 15 a more robust structure so that the residual risk is 16 small enough you don't care.

17 MR. PIRES: Right. But that is there to 18 be their choice.

19 MEMBER CORRADINI: Yes, okay.

20MR. PIRES: And but the point is, one I 21 can hear is that you may keep adding more components 22and not really have much benefit in terms of the 23 redundancy that it will bring up.

24So you can from the very get-go design 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 74 that to get that redundancy so that they will not have 1 a dependent failure.

2MEMBER SKILLMAN: Two or three times 3around the table, members have mentioned that maybe 4the ticket here is to make a robust structure. And 5 I've been involved in Europe and in the United States 6 where the exact opposite was the right thing to do.

7We actually weakened the structure. We 8 made sure that the earthquake went under the structure 9 and the structure didn't respond and so it can go 10 either way.

11 And it boils down, at least in my mind, 12 this whole thing boils down to a probabilistic risk 13 assessment that identifies those structures and 14 systems and components that are credited for success 15 for the specific accident.

16In one case, it might be the batteries.

17 In another case it might be high pressure injection 18pump. In another case it might be the high head 19safety injection pump in a boiling water reactor. So 20 it's scenario specific, it's plant design specific, 21 and it is condition specific.

22 Like Harold said, like I said early on, 23you got to know the tech specs. You got to know 24what's credited. You got to know which systems are 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 75 aligned for what purpose and when, when the event 1 occurs.2 That is part of this rubrics to get a path 3 forward that allows examination that is meaningful in 4 terms of what Dr. Rempe said, risk, not just a failure 5 of the device.

6 You know, you can fail the water cooler, 7 you can fail the front door of the administration 8 building, but you don't want to fail the nozzle that 9 puts the water onto the fuel.

10 The risk is associated with the right 11 component, in the right place, at the right time for 12 the particular accident and the particular ground 13 motion. All of those are pieces.

14CHAIRMAN RICCARDELLA: Core damage 15 frequency can't capture those differences though.

16 MEMBER SKILLMAN: Pardon?

17CHAIRMAN RICCARDELLA: Core damage 18 frequency can't, I mean, the water cooler and the door 19 to the admin building isn't going to impact core 20 damage frequency.

21MEMBER SKILLMAN: My only point is, my 22 only point is, it's very component-specific.

23 CHAIRMAN RICCARDELLA: Yes.

24MEMBER SKILLMAN: Your risk is very, very 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 76 component specific.

1MR. PIRES: I think the least that they 2 showed here on the workshop as a result of the 3 workshop and the review of past PRAs, mostly the 4 components are of course are not buildings. I guess 5 we knew that, they, this is the type of component that 6 typically appeared there as critical.

7 Of course the building's response affects 8 those because the way it amplifies the ground motion.

9 And when people talk about seismic isolation, they 10 could review some of these.

11MEMBER CORRADINI: So let's talk about 12 seismic. You brought it up. I was going to but you 13first. Tell me about, I was under the impression 14there is a potential standard that, a potential 15 approach that's been in front of the staff to look at 16 for seismic isolation?

17MR. PIRES: No, no. No, no, no. There is 18 a standard --

19 MEMBER CORRADINI: You did it. I didn't 20 do it.21 MR. PIRES: Right. No, I know.

22CHAIRMAN RICCARDELLA: There was a DOE 23 research part.

24MR. PIRES: There is a standard. There is 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 77 an American Society of Civil Engineering Standards 1 that has a chapter there on Seismic isolation.

2 And we are not necessarily reviewing that 3standard for seismic isolation. We are reviewing that 4standard for many other, in terms of for more risk, 5 and from approach, performance based to the seismic 6design, but not necessarily that particular part. We 7 have other research projects on seismic isolation 8 already at the Agency here and so we have to look at 9 those.10MEMBER CORRADINI: Well, what I guess I'm 11--I'm sorry, I didn't mean to interrupt you.

12 MR. PIRES: Sure.

13MEMBER CORRADINI: Go ahead and finish, 14 I'm sorry.

15MR. PIRES: No, we have other research 16 projects but not necessarily aimed at reviewing a 17 particular standard but aimed at developing technical 18 consideration that should be accounted for when 19 designing seismic isolation systems.

20MEMBER CORRADINI: Well I guess I'm a bit 21unsure what you just said. So is there a standard in 22 front of the staff to evaluate or is it still a matter 23 of research?

24 I thought there was a standard in front of 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 78 the staff that the staff is evaluating, the suggested 1 standard from the civil engineering society.

2MR. PIRES: There is a standard but we are 3 not ever tasked to evaluate that standard.

4 MEMBER CORRADINI: We --

5MR. PIRES: We do not have a task to 6 evaluate that standard, but --

7 MEMBER CORRADINI: So there's not been a 8 request yet?

9MR. PIRES: Not been a request. Yes, 10 there's not been a request. We are reviewing that 11 standard but that standard has so many other aspects, 12 those are the ones we are doing.

13 But we have independently done research 14 that develop technical considerations for, that should 15 be accounted for if seismic isolation were to be used 16in a nuclear power plant design. So we have 17 independently done that ourselves.

18MEMBER CORRADINI: But if tomorrow, if 19 reactor X comes in, a small modular reactor, and says 20 we're going to isolate the safety structures with 21 seismic isolation, is there a standard they can follow 22 that the NRC has approved or at least has reviewed?

23 MR. PIRES: No. There is not a standard 24 that we have taken a staff position on.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 79MEMBER CORRADINI: Is there something that 1--2MR. PIRES: We have done research in 3 relation to that.

4MEMBER CORRADINI: So there's nothing that 5 they can point to that is yet to be reviewed but could 6 be, or is it a matter of research or is it a matter of 7 working through the standard that is out there but yet 8to be reviewed and approved? I'm trying to understand 9 where this is.

10MR. PIRES: Right. All right. Our 11 research project culminated in a NUREG/CR contractor 12 report that does technical considerations for the use 13of base isolation on nuclear power plants. Those 14 technical considerations are probably better than 15 those in the standard.

16 MEMBER CORRADINI: Right.

17MR. PIRES: This is of course our opinion.

18But they are very closely related in many ways. So 19 actually our contractor was the one who brought most 20 up to standard.

21 MEMBER CORRADINI: Okay.

22MR. PIRES: So maybe I should not say 23 this, but that does not mean that the standard per se 24is sufficient either. The standard may not be 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 80 necessarily sufficient.

1 MEMBER CORRADINI: Okay.

2MR. PIRES: Because there are several many 3 other details and considerations that are not 4 necessarily covered in the standard by that, neither 5 by that NUREGs.

6MEMBER CORRADINI: Because that's some --

7MR. PIRES: It the variety for the 8 details.9MEMBER CORRADINI: Well, I mean the reason 10 I'm bringing it up is, one, you did but I was going to 11 anyway, so I can't blame you totally.

12 MR. PIRES: Right.

13MEMBER CORRADINI: But in other technical 14 meetings there has been discussion that these advanced 15 reactors, whatever they are, are going to try to use 16 this to minimize to allow the structure to be more 17 simply built --

18 MR. PIRES: Right.

19MEMBER CORRADINI: -- because it has a 20smaller footprint. And so the next question has been, 21 in some of these technical discussions, well, is there 22 a standard? And the answer back is yes, but the NRC 23 has not reviewed it.

24 That is what I've heard in technical 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 81 discussions.

1 MR. PIRES: Right.

2MEMBER CORRADINI: And I'm trying to 3 understand where the reality is versus what I hear in 4 a --5 MR. PIRES: The NRC has not reviewed and 6taken a staff position on that standard. The NRC has 7done research very similar to the research that 8supports the standard. So we are not at zero. We 9have a knowledge basis in Agency on that topic. So we 10 can come --

11MEMBER CORRADINI: But nobody has come to 12 you to say we want to use this, can we use this?

13 That's what I'm hopeful for.

14 MR. PIRES: Right.

15 MEMBER CORRADINI: Eventually.

16MR. PIRES: We are not at that situation, 17 yet. But we have done the research --

18 MEMBER CORRADINI: Okay.

19 CHAIRMAN RICCARDELLA: Yes, good.

20MR. PIRES: -- that can take to that 21 situation if that materializes.

22CHAIRMAN RICCARDELLA: I recall a meeting 23 I attended maybe three years ago at the Department of 24 DOE. Did DOE sponsor a big program like that?

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 82MEMBER CORRADINI: Yes, there was a study 1 at DOE.2CHAIRMAN RICCARDELLA: You were there, 3 weren't you, Jose?

4MR. PIRES: Yes, DOE does have recent 5 projects on that.

6 (Simultaneous speaking.)

7 CHAIRMAN RICCARDELLA: On isolation.

8MEMBER CORRADINI: University of Buffalo.

9 There is a large group at University of Buffalo.

10 That's where I had the presentation and I --

11 MR. PIRES: He was our contact there for 12 that project.

13 CHAIRMAN RICCARDELLA: Your contact.

14 MR. PIRES: For that same group.

15 MEMBER CORRADINI: Same group?

16MR. PIRES: Yes. So we are up to date on 17 what is happening in that world and obviously where if 18 someone is going to submit an application, there are 19 many, many more details than just the standard.

20 CHAIRMAN RICCARDELLA: Yes.

21 MR. PIRES: But we are up to date but we 22 have not developed necessarily a staff position.

23 That's, but we are up to date.

24 MEMBER CORRADINI: Okay.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 83 MR. PIRES: We are not, which I think we 1 are in a good position to be responsive.

2MEMBER CORRADINI: Thanks for bringing it 3 up.4 MR. PIRES: You are welcome, yes.

5CHAIRMAN RICCARDELLA: I have a couple of 6questions. I know there's these ongoing Task 2.1 7 seismic reviews of the CS plants and as I understood 8 it, about a third of the plants out there had to take 9 a new look at their seismic because they exceeded 10 their current ground motion response factor, right?

11MR. REISI-FARD: That's about the right 12 number.13CHAIRMAN RICCARDELLA: Are those plants 14having problems? I mean they're doing SPRAs or 15seismic margins analyses. Are they having, are there 16 any plants that have issues, are having issues 17 satisfying the criteria?

18 MR. REISI-FARD: Not to my knowledge and 19 this goes back to some of the discussions earlier 20 about the level of detail or analysis that is needed 21 to do the SPRAs.

22 For the purpose of this informed decision 23 making, there is the SPRA standard out there which is 24 being peer reviewed by, you know, there's a process 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 84 for doing the peer review.

1 And they have been using, the industry, 2 the licensees have been using these methods for a long 3 time and, you know, it's been, their PRAs have been 4 peer reviewed against the standard and, you know, it's 5 just a matter of uncertainty, key assumption 6uncertainty in the model. There are no, typically 7 there are not many findings associated with how the 8correlation is considered. They either assume full 9 correlation or no correlation.

10 CHAIRMAN RICCARDELLA: Yes. Yes, I mean 11 I would think kind of like what Jose said earlier, you 12 only sharpen your pencil as sharp as it needs to be.

13 And so if none of these plants are having 14 any problem meeting their, whatever the criteria are 15 for their SPRAs then they wouldn't necessarily go back 16 and relook at this. But if they do have an analysis 17 or two that's giving them problems, maybe they might 18 try to do it.

19MR. REISI-FARD: And I know that's out of 20 a few or several SPRAs that we've seen, there is only 21 one exception that they've used a little bit more 22refined analysis. It's not using .05 or

.75 or 23 anything like that.

24 But because the licensee decided to have 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 85 a look, it's more detailed final element analysis they 1 have a better understanding of the seismic demand in 2different locations. So if there was a different 3seismic demand, they use different correlations. But 4 other than that, they b asically assume zero or 5 complete correlation.

6 CHAIRMAN RICCARDELLA: Yes. So and then 7 another potential application as I said earlier, is 8 the NuScale or some new reactors where if you haven't 9 completed the design yet, it seems like you could take 10 some of this into consideration in advance and have it 11 affect your design.

12 But, Vesna, the NuScale PRA that we'll be 13 reviewing, does that include a seismic PRA?

14 (Off microphone comment.)

15MEMBER CORRADINI: I thought it was a 16 seismic --

17CHAIRMAN RICCARDELLA: It concentrates on 18 a --19 MEMBER CORRADINI: -- margin analysis. I 20 didn't think it was the seismic --

21MEMBER DIMITRIJEVIC: Yes. I mean, 22 seismic analysis -- seismic risk analysis is a new 23type. I think it's a seismic matching but it's 24 irrelevant because the NuScale is submitted analysis 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 86 based on the single unit.

1 CHAIRMAN RICCARDELLA: So --

2MEMBER DIMITRIJEVIC: So it's irrelevant, 3do they have a ten, 12, or 20 units. They just 4analyze in single units. That's what their agreement 5 with NRC, so we don't, we may see in consequence, but 6 the consequence in this case means that, you know, 7Level 3 analyzes that some combination. But on the 8 PRA, no, it's just a single use.

9MR. PIRES: That's what I heard too. That 10 currently it's a single unit and the seismic margin is 11 what they call a PRA based seismic margin.

12 MEMBER DIMITRIJEVIC: Right.

13MR. PIRES: But because that seismic 14 margin approach and that the guidance really involves 15 simplified methods, min-max approaches and that there.

16 So it's not really --

17 (Off microphone comment.)

18 MR. PIRES: But can be used that, but is 19 a simplified PRA based seismic margin and --

20CHAIRMAN RICCARDELLA: But if they were to 21 come in and try to license multiple plants at a site, 22wouldn't it be necessary for their PRA to address a 23 multi-unit site?

24MEMBER DIMITRIJEVIC: That's my opinion 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 87but I jump on this train late and disagreements had 1already reached, I mean, with the staff. So, I mean, 2 I will bring this question to the review because it's 3 not just seismic, all other external ones, you know?

4CHAIRMAN RICCARDELLA: Yes, yes, of 5 course.6MEMBER DIMITRIJEVIC: You know, like 7 external floods and which is one of the main important 8 contributions. But that's what is put into that so.

9 They have a multi-unit on the license but that 10 actually involves the analysis from ability that two 11 units fails. That didn't include the seismic common 12 cause, it just includes the single, the single 13non-seismic common cause between each. So we will 14 have a discussion about that but that's --

15 CHAIRMAN RICCARDELLA: Okay.

16MEMBER DIMITRIJEVIC: It doesn't say if 17 you have a challenge, what's the probability of one of 18 12 things with that.

19CHAIRMAN RICCARDELLA: Yes. That's coming 20 up this month, right?

21MEMBER DIMITRIJEVIC: Yes, and this 22 analysis is happening in the next --

23MEMBER CORRADINI: The first meeting will 24 be this month.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 88 MEMBER DIMITRIJEVIC: -- yes, yes.

1MEMBER CORRADINI: It won't be the last 2 meeting.3 MEMBER DIMITRIJEVIC: No. Right, so.

4 CHAIRMAN RICCARDELLA: Okay.

5 MEMBER DIMITRIJEVIC: Well, and I have a 6 microphone on. I have one question. In your report 7 there was some example identified with three service 8 water pumps show as important.

9 You know, when we have a seismic, we 10 always assume that we have a loss of onsite power as 11it normally is out and then these generators as you 12 mentioned are important, but, and but they cool the 13 service water so service water is important.

14 And usually single structures or tanks 15 like lube oil tank can dominate what is used at the 16generator if you don't know correlation, or intake 17 structure when it's the pumps itself.

18 But there was an example reported in that 19 report of the sump cuts, actually the three service 20 water pumps.

21 CHAIRMAN RICCARDELLA: Yes.

22MEMBER DIMITRIJEVIC: The three service 23 water pumps show it's very important in that site meet 24 PRA but then they didn't proceed with how did they 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 89 solve that issue?

1MR. PIRES: The one I referred to was a 2 pilot study so it was not really tied into any 3 particular licensing issue or not.

4 (Simultaneous speaking.)

5 MEMBER DIMITRIJEVIC: I see.

6 MR. PIRES: It was a pilot study.

7MEMBER DIMITRIJEVIC: It could be, yes, is 8 the early ones when done and then they tried it, yes.

9 I understand this.

10MR. PIRES: So it was a little different, 11 the use. Well, in principle this methodology can be 12 useful modular reactors and but again it also depends 13on the problem statement. What would it be used for?

14 What would be the intent to go all the way to 15 releases, to one model fails, all fails, do they fail 16simultaneously? And do they need safety systems from 17another? Are they relying on safety systems from 18 another core module to stop an accident progression on 19 one of their modules and on their other model?

20 So I think depending on the problem 21 statement is done, is what one they have to look, but 22in principle can be done. And if you had the analysis 23 for the single model you can extrapolate it by the 24 correlations using this approach. But it has to pay 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 90 off, has to have a benefit for the applicant.

1MEMBER REMPE: So when I look at the last 2 bullet here I also go back to Page 26 and see all of 3 the caveats you have about before you can be using 4 this methodology and it seems like that there's a lot 5 of work still to be done if one wanted to apply and 6 use this as part of the standard tool kit available to 7seismic people. And I just kind of wanted to see you 8 shake your head up and down, yes.

9 MR. PIRES: I think so. There is, there 10 will be substantial work yet, but the question is at 11 this point, like I think I mentioned before, I think 12 we have done probably our part on the dialogue.

13 MEMBER REMPE: Yes.

14MR. PIRES: And so maybe now someone else 15 has to get that additional work and maybe we, put 16 these points to some other organization that does 17 research, that can be cooperative research but maybe 18will have a role. But if I think we only need to have 19 now the initiative coming from outside.

20 MEMBER MARCH-LEUBA: This gets me thinking 21 to the topic I wanted to change the conversation just 22 as we have plenty of time and I know you've done all 23 this because you've told me on the side.

24 MR. PIRES: Yes.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 91MEMBER MARCH-LEUBA: It's still bit of 1 certainties.

2 MR. PIRES: Okay.

3MEMBER MARCH-LEUBA: You told us that all 4 of those F parameters on the long equation have their 5 uncertainty but now you're splitting that uncertainty 6 into two.7 MR. PIRES: Right.

8MEMBER MARCH-LEUBA: Yes. And the estate 9 of the practice now is to split the CO1 by setting the 10 correlation to CO1 and that term means what the 11 uncertainty is. I know you've given some thought on 12 how you would do the uncertainty with the proposed 13 method. Can you talk a little bit about that?

14 MR. PIRES: How we would split this?

15MEMBER MARCH-LEUBA: Yes. How would you, 16 I mean, what is your, what was your consideration for 17 treatment of uncertainties, the additional uncertainty 18 that this introduce by the new method?

19MR. PIRES: Oh, alright, yes. I think one 20 of the bigger uncertainties to this, by the new method 21is this step that you just mentioned. How you are 22 going to assign what is correlated and what is 23 uncorrelated, particularly given that you don't have 24 hard data.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 92 And so but the study really did not look 1 at that into detail because the study at this moment, 2 they just, all the examples they have, they assign it 3 the information to those things on the top line 4 directly. They didn't even use the bottom line.

5They just have statements. They are 6 saying the -- interaction part of the building is not 7the same so if all components are in the same 8 building, the -- interaction uncertainty probably is 9 correlated.

10 But they have not really provided the 11 metallic aspect how to go from the bottom line to the 12 top line in assigning those uncertainties. So but I 13think that needs to be that. And if that, because of 14 so many factors, they had all of these factors, they 15 have many quality analysts, can eliminate much of the 16 judgment, particularly those that can be done by 17 analysis.18MEMBER MARCH-LEUBA: You know the field 19 which was a very large study, 1980s probably, was the 20 CSAU, Code Scaling, Applicability and Uncertainty 21 Analysis.22 MR. PIRES: Okay.

23MEMBER MARCH-LEUBA: Anyway, called CSAU.

24 The first step on CSAU is to provide a PIRT, Phenomena 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 93 Identification and Ranking Table, okay.

1 MR. PIRES: Right.

2MEMBER MARCH-LEUBA: And all the thermal-3 hydraulics which are more of a deterministic instead 4 of a probabilistic -- understood that because there 5 will be, that you will get a different number, that he 6 will get a different number.

7 So the PIRT always requests to have at 8 least three experts in the field. And then you look 9 at the variability between different opinions.

10 When you do the separation between ER and 11 EU, probably will require at least a second opinion 12 instead of just one guy.

13MR. PIRES: Did, one of the things and the 14report mentions that they really recommend a peer 15review even if it is informal. Even if that is not a 16 formal peer review that is required by a regulator or, 17 they really recommend that you should have that.

18 But I think even before you get the peer 19review, you probably need the guidance on how to do 20 that, based on this first step, it's to have that 21 guidance and second is to have a peer review.

22MEMBER MARCH-LEUBA: Yes, but in my mind, 23 and maybe I'm biased, but I think the largest source 24 of uncertainty will be a subjective evaluation of 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 94 numbers and that Jose will give a different result 1 than Josie.

2 MR. PIRES: Right.

3 MEMBER MARCH-LEUBA: And it will be, and 4 I thought that you addressed that in the report by 5 recommending a peer review or list, you get an idea 6 what the uncertainty is.

7MR. PIRES: Right. And the report 8 recognizes that, recognizes that there will be 9 variability among the analysts.

10MEMBER DIMITRIJEVIC: And do you know what 11also is problem, there is not two. There don't exist 12 two fragility experts in that. You know, an agility 13 expert is very sparse. Like ten years ago all world 14 was using just one. I mean, I don't know what's the 15 situation is now but then --

16 MR. PIRES: No, there are a few.

17 MEMBER DIMITRIJEVIC: We're not going to 18 find many too complex opinions.

19MR. PIRES: There are a few and I think 20 the breaking down of the problem allows that. In my 21 opinion, the more you can do to some analysis that are 22 having to rely directly on the use of data so you have 23 a matching off the two, you are better.

24MEMBER MARCH-LEUBA: Okay. Well, my point 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 95 is in the report you've given some thought to it and 1 you have addressed the issue, that this is a problem.

2 MR. PIRES: Right. It is an issue.

3 CHAIRMAN RICCARDELLA: You know, on this 4 slide you've got two different things where you split 5 the uncertainty. In the top line it's random versus 6uncertainty. But to me, what's equally significant on 7 the very bottom line, the first part of the equation 8 there, it's F sub C and F sub RS and do each one of 9 those have an R and a U?

10MR. PIRES: Yes. And then each one of the 11 other F's has an R and a U. So when you, in the end 12 you can have a square root of some squares that are 13 about 15 times there. So it can be complex.

14 But the analysts are used to do that.

15They go to their training. Typically what happens is 16 if a utility wants to do an SPRA, what I understand 17 some of them did is that they contract a firm that 18knows how to do these and they do an example for a 19 building and the components in there.

20They go through all this process. They 21 define templates, and then they can have other 22 engineers that go through that process systematically 23for other components and other buildings and other 24 aspects.25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 96 So they have a process to do that to 1minimize errors and subjectivity. But it still can 2happen because the next step is to assign what part 3 of, if you have two components now of those all their 4 Rs and Us, what is the part that is correlated, the 5 part of a covariance is still just a variance for each 6 one?7 And that part is somewhat difficult but 8 there are reasons and arguments when you break down to 9 be able to move in that direction, and it partly 10 depends on the importance of the problem and what you 11 want to do with the results.

12CHAIRMAN RICCARDELLA: Yes. It seems that 13 there's an opportunity that if you're designing a new 14 plant for a new concept, like these modular reactors, 15 that there might be some very, very minor things that 16 you could do at relatively low cost that would make 17 things less correlated.

18MEMBER CORRADINI: But you could also 19 increase the risk of something else. You can't just 20change this, you would have to redo everything. If I 21 took all of these things and orient them ten degrees 22 different, then my fuel handling might change --

23CHAIRMAN RICCARDELLA: Yes, right, right.

24MEMBER CORRADINI: -- so that I can 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 97 increase the risk of a fuel handling accident.

1MR. PIRES: Yes. In some of these 2 aspects, you probably, you know, one exercise a day, 3 so I'm just thinking aloud without really --

4 But ideally it would be to have a set of 5 rules coming out from PRA studies and those set of 6 rules, then give indications if you want to obtain 7 redundancy, you need to do these things in your design 8 so that the design not necessarily have to, or define 9 the rules that, and then, but and those would be 10 exercise PRAs to come up with those rules.

11MEMBER CORRADINI: Yes, but I think but in 12--13 MEMBER MARCH-LEUBA: For in --

14MEMBER CORRADINI: If I might just say, I 15think your Slide 25 though is the one that I got --

16 you don't have to go to it -- but the one with your 17blue and red boxes. You don't do this for everything.

18 You find out where it's critical to do it 19and then you delve in. I mean, it's like Jose's 20 example of where you want to sharpen your pencil and 21 where it's good enough to do a simple analysis.

22 That's what I took away from that.

23MEMBER MARCH-LEUBA: What I think that 24 Pete is saying is that when we do fire analysis and do 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 98the INC. We put one division in a different cabinet.

1 We have four different fire enclosures for each 2 division because we only, we put them only in one, we 3 have a fire, we're cooked. Okay.

4 If doing this safety PRN and you find out 5 that all your three sump pumps are on the same weak 6 building, that tells you a problem that you maybe need 7 two sump pumps in different places. And that points 8 you to small changes that maybe are not expensive that 9 make the plant better. Remove the single pump.

10 MR. PIRES: Yes, like you said, that box 11 already there in the parenthesis, but presumably 12 should be few of those where you have to do that and 13 have a benefit.

14CHAIRMAN RICCARDELLA: But I guess the 15first step would be to make sure that they consider 16 the multiple units in the PRA. If they're not doing 17 that --18 MEMBER MARCH-LEUBA: Somewhere I've read 19 that they just multiply times 12 the results of one.

20And that they assume they're fully correlated. That's 21 what I read somewhere but you're --

22MEMBER CORRADINI: Wait until the October 23 18th meeting.

24 MEMBER MARCH-LEUBA: Yes.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 99MEMBER REMPE: But if you do, I mean, it's 1 what your point was about the ship already, or the 2train already left. There's a couple of things, again 3 just thinking off the top of your head, not only do 4 you have the issue that you might have three pumps in 5 12 units that all are not considering all 12 units in 6 the common cause, but what about just that you've got 7 12 units in the same pool and a bowling ball approach 8 where they knock out each other?

9MEMBER SKILLMAN: Joy, we raised that 10 question.11 MEMBER REMPE: Yes, I know.

12MEMBER SKILLMAN: We absolutely raised 13 that exact issue.

14 MEMBER REMPE: Yes.

15MEMBER SKILLMAN: I think we're in a 16 different --

17 (Off microphone comment.)

18 MEMBER REMPE: No.

19 MEMBER CORRADINI: I would suggest we're 20 in a different discussion, that we should wait until 21 we actually have the --

22 CHAIRMAN RICCARDELLA: Yes.

23 MEMBER SKILLMAN: I think in a way we're 24 in a different discussion but we're going after the 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 100 comment that Pete made that I think is right on the 1 money.2 Early on, slight adjustments can provide 3 great risks reduction, or great reductions in risk.

4 I think that that's accurate and I think we ought to 5 be thinking about that. Just a couple of very minor 6 changes that can allow a very significant outcome for 7 an event and I think that's accurate.

8MR. PIRES: In this case, I think for the 9 multi-module syncs, it was probably important to come 10up with what is the problem statement that, for the 11applicant that the applicant wants to address? Is, 12 are they worried about releases or if using systems 13from another module to save one model? Or, you know, 14 I think that now that the problem statement has 15expanded because you have all these modules there 16 relatively close to each other, and depending on that 17 then they would have to choose what they want to do.

18 MEMBER MARCH-LEUBA: But I would like to 19 think that the applicant is already doing that. I'm 20 sure whoever designed the plant, they're looking for 21the low hanging fruit. I mean, if we weren't under 22 the review when it comes to ACRS, nothing can be 23changed. So what we need is to encourage the 24 applicants to think things this way.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 101MEMBER DIMITRIJEVIC: But this is just to 1 tell you it's also bad because actually they're not in 2parallel, they're in series. So fail of any unit is, 3 you know, basically the failer. It's, you know, 4 they're not in parallel. So if you look in the 5 component combination, whatever fail that unit, if you 6 want to fail the second unit, or fail only the one 7 unit present the problem. So it's from a, you know 8 what I want try to say, the units are in the series 9 actually when it comes to the core damage frequency, 10 so.11MR. PIRES: This may be a case where a 12 release might make a difference because if you ever 13 sourced them for 12 modules versus from one module, 14but I don't know. It's, I have no idea. It's a 15 problem statement.

16CHAIRMAN RICCARDELLA: No, we have some 17 food for thought for our meeting in two weeks and we 18 can ask the applicant then.

19 Well, Jose, I thank you very much for 20 coming by and briefing us all and Mehdi, we appreciate 21 it.22I'm going to go around the room. But 23 first, is there anybody in the room that would like to 24 make a comment?

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 102 Hearing none, we'll go to the phone line.

1 Can we open the line please?

2MEMBER CORRADINI: We'll wait for a 3 crackling sound.

4 CHAIRMAN RICCARDELLA: Yes. So when the 5 phone line is open, if there's anybody listening to 6 this, in on this call, I'd appreciate it if you would 7 let us know that you're there and you hear us.

8 MEMBER MARCH-LEUBA: I just want to take 9-- on the line. Let's go around the table.

10CHAIRMAN RICCARDELLA: Okay. So let's ask 11the subcommittee members. Vesna, do you, starting 12 with Vesna and we'll go around the table.

13MEMBER DIMITRIJEVIC: Yes, I'm all right.

14 I don't have additional questions.

15 MEMBER CHU: Nothing.

16 CHAIRMAN RICCARDELLA: Harold?

17MEMBER RAY: To me, Pete, this is more 18input rather than a time for us to give feedback. I, 19 you know, I think the issue always in my mind is how 20to reduce core damage. What's the most efficient way 21 and the most appropriate way to reduce core damage 22frequency to an acceptable level? And we're making a 23 transition now in how we think about that and I just 24 need to hear more before I can make a comment.

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 103CHAIRMAN RICCARDELLA: Okay. I'm just 1going to interrupt for a second. I think I heard the 2crackle. Is there anybody on the line that would like 3 to make a comment?

4 MEMBER MARCH-LEUBA: Nobody phoned in on 5 the line.6 CHAIRMAN RICCARDELLA: Nobody?

7 MEMBER MARCH-LEUBA: Not that we hear.

8CHAIRMAN RICCARDELLA: Okay. Okay. Jose, 9 Mehdi, so thank you. That's it.

10MEMBER CORRADINI: No comments. Thanks to 11 Jose and Mehdi.

12MEMBER SUNSERI: I find it to be an 13 interesting advancement of the state of practice I 14 guess in this particular area.

15 I suppose my overall feed, input similar 16 to Harold here, is saying that, you know, I think we 17need to be cautious about how we go about utilizing 18 and or applying those, because my experience is if you 19 start tweaking with hardware to try to make analysts 20 come out in different areas, it's tricky business.

21 And you can cause unintended consequences to solve a 22 problem.23 (Off microphone comment.)

24MEMBER SUNSERI: So that's the only 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 104caution I offer at this time. I do appreciate the 1 presentation. Thank you.

2 CHAIRMAN RICCARDELLA: Joy?

3MEMBER REMPE: I don't have any additional 4 comments but I do want to thank you for taking the 5 time and coming and talking to us.

6MEMBER MARCH-LEUBA: I want to also 7 emphasize a thank you because that was a very 8interesting presentation. You see it was very lively 9 and everybody wanted to hear about this.

10 My main concern when these things happen 11is whether it may be misused. I mean, whenever you 12 give an applicant additional margin, he might come 13 down the real safety of the plan by using additional 14margins. So that's a war ning that let's make sure 15 that this results in safer plants.

16 (Off microphone comment.)

17 CHAIRMAN RICCARDELLA: Okay. Thank you.

18MEMBER BALLINGER: No more additional 19 comments.20 CHAIRMAN RICCARDELLA: Okay. Well, with 21 that I'll thank you again and I guess we'll adjourn 22 the meeting.

23 (Whereupon, the abo ve-entitled matter went 24 off the record at 2:54 p.m.)

25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1323 RHODE ISLAND AVE., N.W.(202) 234-4433WASHINGTON, D.C. 20005-3701(202) 234-4433 Correlations of Seismic Performance in Similar SSCs (Structures, Systems and Components)

-NUREG/CR-7237Information Briefing to:Advisory Committee on Reactor SafeguardsStructural Analysis SubcommitteeOctober 3, 2018Rockville, MDStaff presenters/speakers:Jose Pires, RES/DEMehdi Reis

-Fard, NRR/DRA/APLB/RILITSelim Sancaktar, RES/DRA/PRAB 1

Overview*Background

  • Objectives and Goals
  • Scope*Analysis Aspects
  • Study Approach

-Review of Existing PRAs

-Review of Current Literature

-Workshops with Experts

  • Analysis Process in a SPRA and Issues/Uncertainties
  • Summary and Remarks
  • Further Questions 2

Background

  • Two key SPRA aspects I.All possible earthquake levels, their frequencies of occurrence and potential consequential damage should be considered II.Earthquakes can simultaneously damage multiple redundant components
  • Risk-quantification should account for this 'common cause' effect 3

Background

41994 Northridge earthquakeHaiti

Background

5Single Motor Control Center Failure at PitiPower Plant

-Guam (1993 Earthquake)

Background

6Fukushima DainiMake Up Tank Failures -Dependent Failures

Background

  • Treatment of dependent failures involves a set of assumptions (rules

-based approach) such as:

-Similar redundant components next to each other and subjected to similar seismic forces fail simultaneously

-Diverse or similar components at different (far apart) locations fail independently

-Sensitivity analysis to postulated bounding assumptions

  • This approach can mask insights and lead to varying degrees of conservatism in various places of the analysis 7

Background

  • The treatment of dependencies of seismic failures in SPRAs depends on the intended use of their results.
  • Further demonstrations of the identified methodology and its use would depend on arising uses or needs or, for example, applications to new designs, namely advanced non

-light water reactors or modular reactor designs.

8 Objective

  • As part of the 2010

-2014 seismic and structural research plan, the Office of Nuclear Regulatory Research (RES) initiated research to:-evaluate and explore the seismic correlation

-dependency topic and, if feasible, -to propose one or more advanced, more refined and more insightful analysis approaches for its treatment in seismic Probabilistic Risk Assessments (PRAs).

9 Goals*That the evaluation of existing methodologies, the review of the related SSC

-failure database, and the attributes of the proposed analysis methodology will inform SPRA analyses, peer

-reviews, and staff reviews in relation to the treatment of seismic failures dependencies in seismic PRAs for operating and new reactors

.*Identification of a methodology that with further demonstrations (by its potential users) and use will provide an improved and more insightful approach to seismic PRA 10 Scope*Assessment of impact of correlation assumptions made in modern SPRAs have on risk estimates (concentrating on CDF)

  • Review and identification of analysis methods and data sources that could be developed for improved and more insightful risk assessments
  • Identification of a pathway (methodology) so that improved analysis of dependent seismic failures could become a standard part of SPRAs 11 Analysis Aspects
  • Dependencies arise in the system analysis part of a PRA-Dependencies of SSCs arise in the calculation of the failure frequency of a sub

-system of SSSs with performance defined by a Boolean (logic) statement

  • SSCs in parallel (redundant SSCs for example) involve 'AND gates'

-Assumption of dependency results in an upper bound estimate of the sub-system failure frequency (system fragility)

  • SSCs in series involve 'OR gates'

-Assuming independency results in an upper bound of the sub

-system failure frequency (system fragility) 12 Analysis Aspects

  • Dependencies arise in the system analysis part of a PRA

-Output of the analysis of the sub

-system Boolean expression is essentially a fragility function for the system

-Simplified (anticipated to be bounding) assumptions are typically made-An improved methodology would obtain narrower bounds on the system failure and address sensitivity of the results to defensible assumptions on dependencies and correlations

  • Approach:involve fragility and system analysts to obtain fragility functions for the sub

-systems functions (Boolean expression) 13 Analysis Aspects

  • Seismic Fragility: A =

A m E R E U-A m= median, E R= inherent random uncertainty about the median and E U= epistemic uncertainty about the median

  • Usually A = F x RE

-F = a factor of safety and RE = a reference 'size' of earthquake

  • F = F C F RS=(F S F u)(FSA F d F M F MC FEC F SD FSS)14Capacity factorSeismic response factorPartial factors Analysis Aspects
  • Seismic Fragility: A =

A m E R E U-When there are several components in a Boolean statement, (B, C, D, -) the method involves:

  • Determining the correlation for the E Uuncertainty between components (co

-variances)

  • Assigning the remaining uncertainty (independent part of the uncertainty) to each component (preserving the total uncertainty)

-Similarly for the uncertainties for E R-Then the methodology uses a set of rules to determine the frequency of the sub

-system failure 15 Analysis Aspects

  • Uncertainties 1.Determination of the correlation coefficients for the uncertainties in E Uand E R 2.Subsequent set of rules to calculate the sub

-system failure probability

  • Item 1 -The correlation coefficients can be determined from the partial factors of safety and the combined to obtain those for E u and E R(may reduce variability among analysts)*Item 2 -Verification of the simplified method against more rigorous existing mathematical approaches (too onerous for general use) 16 Study Approach
  • Review of several SPRAs in the literature (Chapter 4)
  • Review of the existing literature on seismic correlation and dependency analysis (Chapters 2, 6 and 7)
  • Review of existing data from testing and earthquake experience (Chapter 3)
  • Identification of a possible improved and more insightful methodology for treating dependencies in a SPRA 17 Review of SPRAs
  • Assessed impact of assumptions on the treatment of dependencies on the seismic failure of SSCs in risk estimates (concentrated on Core Damage Frequency (CDF) risk estimates)
  • Almost all SPRAs used the rule

-based approach with few exceptions

-The Zion SPRA for the Seismic Safety Margins Research Program (SSMRP) and the Diablo Canyon SPRA*Reviewed 10 SPRAs with CDF estimates ranging from 1E-7/year to 2xE

-5/year 18 Review of SPRAs

  • Observations from the review (examples), which used expert judgement:

-For some SPRAs, the differences in the seismic CDF could range from close (but less than) a factor of 2, but with a typical difference in the range of 30% to 60%.-For some accident sequences, the differences could be larger (as much as factor of 2 to 4)

-Treatment of dependent failures has small impact if the CDF is controlled by an accident sequence that is itself controlled by a single SSC(singleton).

-For several SPRAs the CDF estimates are not very sensitive to the dependencies issue but risk insights can be sensitive to the assumptions made in the analysis of dependencies

-A few types of SSCs seemed to appear repeatedly among those for which the assumptions used affected the results (the CDF estimates) (although not all affect the results in every SPRA reviewed

)19 Review of SPRAs

  • SSCs that seem to appear repeatedly among those for which the approach to analyze dependencies in their seismic failure can affect the CDF estimates (not all appeared in this manner in all SPRAs reviewed):

-Masonry walls

-Electrical Motor Control Centers (MCCs)

-Large tanks: condensate storage tanks of other similar tanks

-Small tanks: diesel generator fuel oil day tanks

-Heat exchangers: such as component cooling water heat exchangers

-Mechanical: long

-shafted service

-water pumps, horizontal auxiliary feedwaterpumps (motor and turbine driven dependency)

-Batteries and racks 20 Review of Existing Literature on Dependency Analysis

  • A variety of approaches with different level of mathematical rigor have been proposed
  • SSMRP approach

-Used join-lognormal distributions for the response and capacity of SSCs in a cut

-set-Defines cut

-set failure as all responses exceeding their capacities

-Integrates the joint distributions over the failure region

-Used in the Zion and SPRA and to derive a set of simplified rules (rule-based approach) called the Bohn

-Lambright rules

-Practice tends to use further simplified rules, which assign 100% to the situation of similar SSCs exposed to the same earthquake load (typically, SSCs located near each other), and zero everywhere else.

21 Review of Existing Literature on Dependency Analysis

  • Bohn rule-based approach 22Rule #Description 1Components on the same floor slab and sensitive to the same spectral frequency range (i.e., ZPA, 5

-10 Hz. or 10

-15 Hz) will be assigned response correlation = 1.0.

2Components on the same floor slab sensitive to different ranges of spectralacceleration will be assigned response correlation = 0.5.

3Components on different floor slabs (but in the same building) and sensitive to the same spectral frequency range (ZPA, 5

-10 Hz or 10

-15 Hz) will be assigned response correlation = 0.75.

4Components on the ground surface (outside tanks, etc.) shall be treated as if they were on the grade floor of an adjacent building 5"Ganged" valve configurations (either parallel or series) will have response correlation = 1.0.

6All other configurations will have response correlation equal to zero.

Review of Existing Literature on Dependency Analysis

  • The review identified an approach that would lead to a more refined and more insightful methodology

-Initially proposed by Reed and McCann (1985) but not further developed

-Leverages approaches widely used in the fragility analysis of SSCs that lead themselves to engineering identification of correlations in the uncertainties of variables that determine and SSC fragility estimation 23 Review of Existing Data

  • Main observations in relation to data

-driven support for determining seismic failure dependencies

  • Shake-table testing data

-Shake-table test data is largely inadequate for purpose of understanding dependencies among failures

-Mostly qualification testing data and when taken to failure mostly testing of single items

  • Earthquake experience data

-Largely inadequate for the purposes of understanding the dependencies among seismic failures

-Sparse data, difficult to understand and large interpretation uncertainties 24 Analysis Process in a SPRA 25 1.Performance of a SPRA using standard methodsNeeds to include sufficient sensitivity analysis studies) 2.Identification of those (presumably few) cut

-sets or accident sequences where correlations analysis 'makes a difference'Difference in terms of risk quantification, importance, and safety insights 3.Use the improved methodology to study the identified cut sets or accident sequences one

-by-one.Revised fragility functions 4.Use of the revised fragility functions in the SPRA in the usual wayMay involve iterations to Step 3 or Step 2 Analysis Issues/Uncertainties

  • Difficult to use methodology for the 'revised fragilities' except for most experienced SPRA fragility analysts
  • Variability among fragility analysts

-Variability from analyst to analyst

-Expert judgement to assign uncertainties as dependent or independent (determining coefficients of correlation)

-Would need further sensitivity assessments

  • Issue of data availability and focus on matters of more or less conservative analyses (instead of, for example, looking for safety insights)
  • Peer-review needs 26 Summary / Remarks
  • As part of the 2011

-2014 seismic and structural research plan RES initiated research to explore the topic of dependent seismic failures of SSCs is SPRAs and, if feasible, to identify more refined and insightful analysis approaches for its treatment in SPRAs.

  • The research documented reviewed past SPRAs, the SSC

-failure database, and identified a more refined and insightful methodology that has promise for practical treatment of the dependency issue in SPRAs*The methodology described needs further demonstrations (by potential users) to provide an new and more insightful approach for SPRAs (in relation to the treatment of dependency of seismic failures)27 Summary / Remarks

  • The treatment of dependencies of seismic failures in SPRAs depends on the intended use of their results.
  • Further demonstrations of the identified methodology and its use would depend on arising uses or needs or, for example, applications to new designs, namely advanced non

-light water reactors or modular reactor designs.

28