ML24150A068
| ML24150A068 | |
| Person / Time | |
|---|---|
| Issue date: | 05/21/2024 |
| From: | NRC/OCIO |
| To: | |
| Leah Kube | |
| References | |
| NRC-2858 | |
| Download: ML24150A068 (1) | |
Text
Official Transcript of Proceedings NUCLEAR REGULATORY COMMISSION
Title:
ADAMS Public Search Public Meeting Docket Number:
(n/a)
Location:
teleconference Date:
Tuesday, May 21, 2024 Work Order No.:
NRC-2858 Pages 1-38 NEAL R. GROSS AND CO., INC.
Court Reporters and Transcribers 1716 14th Street, N.W.
Washington, D.C. 20009 (202) 234-4433
1 UNITED STATES OF AMERICA 1
NUCLEAR REGULATORY COMMISSION 2
+ + + + +
3 ADAMS PUBLIC SEARCH PUBLIC MEETING 4
+ + + + +
5
- TUESDAY, 6
MAY 21, 2024 7
+ + + + +
8 The meeting was convened via 9
Videoconference, at 1:00 p.m. EDT, Lynn Ronewicz, 10 Facilitator, presiding.
11 PRESENT:
12 LYNN RONEWICZ, Facilitator 13 STEPHANIE BLANEY, Chief, FOIA, Library, and 14 Information Collections Branch, Office 15 of the Chief Information Officer 16 GRACE CANTY, Senior Information Management 17 Analyst, Digitization, Processing, and 18 Records Branch, Office of the Chief 19 Information Officer 20 ROY CHOUDHURY, IT Services Development and 21 Operations Division, Office of the Chief 22 Information Officer 23 24 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
2 ARATHI DOMMETI, Senior IT Specialist, 1
Application Development Services Branch, 2
Office of the Chief Information Officer 3
DAN FRUMKIN, Senior Information Technology 4
Project Manager, Office of the Chief 5
Human Capital Officer 6
ANNE GOEL, Senior Technical Librarian, FOIA, 7
Library, and Information Collections 8
Branch, Office of the Chief Information 9
Officer 10 LEAH KUBE, Chief, Digitization, Processing, 11 and Records Branch, Office of the Chief 12 Information Officer 13 BASIA SALL, Director, Data, Information 14 Management, and Enterprise Governance 15 Division, Office of the Chief 16 Information Officer 17 AMY WAGNER, Acting Deputy Director, IT 18 Services Development Operations 19 Division, Office of the Chief 20 Information Officer 21 22 23 24 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
3 ALSO PRESENT:
1 LAURIE BORSKI 2
KATHY EDWARDS-REICHERT, Aerotest Operations, 3
Inc.
4 LARRY GELDER 5
RUSSELL GOFF 7
EDWIN LYMAN, Union of Concerned Scientists 8
TARA NOBLE 9
ANDY RATCHFORD, Jensen Hughes 10 JAMES SLIDER, Nuclear Energy Institute 11 JACKIE TOTH, Good Energy Collective 12 PATRICK WHITE, Nuclear Innovation Alliance 13 JASON ZORN 14 15 16 17 18 19 20 21 22 23 24 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
4 P-R-O-C-E-E-D-I-N-G-S 1
1:00 p.m.
2 MS. RONEWICZ: Good afternoon. Welcome to 3
this virtual comment-gathering public meeting and 4
thank you for attending. My name is Lynn Ronewicz.
5 I am an NRC employee, and I will be assisting with 6
meeting facilitation today.
7 Please note that this meeting is audio-8 recorded in Teams and is being transcribed by a court 9
reporter. The court reporter's typed transcript will 10 be made publicly available at a later date. Please 11 keep yourself on mute unless you have been called on 12 to speak. Also, please keep your camera turned off 13 unless you are speaking and want to turn your camera 14 on during that time. This saves bandwidth and 15 prevents any distraction. The Teams chat has been 16 turned off for this meeting, as we would like to 17 receive all comments verbally for the court reporter 18 to transcribe into the final typed transcript.
19 The members of the public will be asked 20 for comments to three questions after the presentation 21 slides have been shown. The members of the public 22 will be asked to raise their hands via Teams, a 23 bridgeline, and will be called on in order of hands 24 raised. We will try to get to as many of those who 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
5 raise their hands as we can, but we cannot guarantee 1
we will get to all of them.
2 The purpose of this meeting is to gain 3
thoughts on how the existing Web-Based ADAMS 4
application is working for the public and potential 5
ideas, feedback, on future search capabilities. The 6
NRC will consider the input and feedback to help 7
develop a modern application that will be called ADAMS 8
Public Search. Please note that this meeting is not 9
to discuss the ADAMS application program interface 10 that some of you may currently be using to retrieve 11 ADAMS data into your database or applications. Also 12 note that Web-Based ADAMS is a separate application to 13 search publicly-available ADAMS documents and is 14 separate from the NRC public site.
15
- Again, we plan to start with a
16 presentation about the current known challenges with 17 Web-Based ADAMS and its look and feel currently. Then 18 we will discuss the plan to develop a modern ADAMS 19 public search application with a mockup of the home 20 page. Finally, we will ask some questions to hear 21 from you about your thoughts and ideas for the future.
22 We will start by introducing the NRC 23 members presenting. I will now turn it over to Amy 24 Wagner.
25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
6 MS. WAGNER: Hi, everyone. My name is Amy 1
Wagner, and I'm the acting Deputy Director for the IT 2
Services Development Operations Division in the Office 3
of the Chief Information Officer, and I would like to 4
introduce several of my colleagues before moving on to 5
the presentation and questions/comments portion of 6
this public meeting.
7 So joining me today is Stephanie Blaney, 8
who is our FOIA, Library, and Information Collections 9
Branch Chief. We have Leah Kube, who is our 10 Digitization, Processing, and Records Branch Chief; 11 Anne Goel, our Senior Technical Librarian in FOIA, 12 Library, and Information Collections Branch; Grace 13 Canty, our Senior Information Management Analyst in 14 Digitization, Processing, and Records Branch; and then 15 we also have Arathi Dommeti, Senior IT Specialist in 16 our Applications Development Services Branch.
17 And now I'm going to turn it over to 18 Arathi to go over our presentation today.
19 MS. DOMMETI: Thank you, Amy. Good 20 afternoon, everyone. So as Amy introduced, I'm the 21 Senior Project Manager, and I'm going to be the 22 technical project lead for the new application that we 23 plan to roll out.
24 So let me go ahead and share my screen.
25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
7 And let me know if you are able to see my screen.
1 MS. RONEWICZ: We all see it.
2 MS. DOMMETI: All right. So before I get 3
started, quickly, I want to mention that I will be 4
referring to the existing search application called 5
Web-Based ADAMS as WBA and the future search 6
applications as ADAMS Public Search.
7 So before I move on to the existing 8
screens and others, I wanted to touch upon some more 9
challenges that we are currently aware of in the 10 existing application. So some of these, the first one 11 being is the search results page. I think the 12 majority of you who have been using WBA are aware 13 that, currently, it is limited to the first thousand 14 records matching the search criteria. So this is 15 something that has resulted because of the underlying 16 technical limitation since this application was 17 developed many years ago. So, therefore, one of our 18 primary goals is to address this limitation in the new 19 application.
20 Also, for the search, it's not just the 21 number of records that has a limitation, but sometimes 22 the user is also not able to see the correct number of 23 results count for the search criteria. So, for 24 example, if your search criteria results in 5,000 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
8 records, the page shows the first thousand and you're 1
unaware of the fact that there are 5,000 results as 2
part of the search. So this is something we 3
definitely want to address as part of a new 4
application.
5 The second and the third bullets are more 6
related to the intuitiveness of the user interface.
7 So for some of you who use WBA often know how the 8
homepage looks like, what are some of the search 9
criteria you have to provide in specific tabs, and go 10 to the results. But for a novice user, it sometimes 11 becomes challenging for them to know where to get 12 started and how to go about the search screens; and, 13 therefore, they contact the public document room to 14 get the required assistance. And, therefore, we 15 definitely want to address these two to ensure that in 16 the new application you are able to get to the 17 specific documents you're looking for without 18 involving number of clicks and it is easy to navigate.
19 And then coming to the search results, 20 sometimes these are not always accurate. We have 21 observed that, based on the search criteria that you 22 provide and the way the index provides the results 23 back, you may not be able to find the documents you 24 are looking for in the top list. And this is another 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
9 thing we want to address as part of the new technology 1
that we'll be using in the future state of the 2
application.
3 So these are just some of the known 4
challenges, and that is why we are undertaking this 5
initiative to modernize and build forward to all of 6
you the new search application. We are planning to 7
develop this search solution using the cognitive 8
search technologies, as well as take a human-centered 9
design approach. What that means is that we want to 10 take a personal-based perspective when designing the 11 user interface so that any user, whether they are new 12 or advanced, is able to know immediately after they 13 come to the homepage how exactly they can put in the 14 keywords to search, whether they can perform certain 15 actions, and so on.
16 So all of this is going to enable the 17 users to reap several benefits, some of them being 18 better user experience, improving the accuracy of the 19 results that they are going to receive, as well as 20 provide faster performance. We have used this 21 technology in developing our internal search 22 application, and the results have been phenomenal.
23 And, therefore, we are very much looking forward to 24 bringing this new modernized search application to the 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
10 public users, as well.
1 In the next few slides, I just want to 2
quickly give you a glimpse of how the homepage and the 3
search page look like in WBA and what we are looking 4
to change so that it's much more usable to all of you.
5 So as you can see, this is the current homepage, and 6
you have certain tabs using which you can see the most 7
recently released documents in a folder view. You can 8
click on content search and advanced search to provide 9
the search parameters and get to the results.
10 So in this next screen, I'm showing you 11 the content search, as well. So here you have the 12 ability to provide a keyword and then select from the 13 various properties that are available and click on 14 search, and what that will do is the right part of the 15 window is going to provide you the results which can 16 be exported into a file.
17 How we want to approach in the new 18 application is that, the moment a user comes to the 19 homepage, they are able to see the recently-released 20 documents, as well as for those who probably won't 21 immediately start searching have the capability to 22 look at the keyword, as you can see, type in a word or 23 a combination of words, and click on search. And for 24 those of you who want to actually combine different 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
11 parameters using various operators, you'll be able to 1
do using the advanced search feature. And then you 2
can save your search, as well as load it, as well.
3 The search results are going to be 4
displayed in the bottom window of the page. So in 5
this case, what you see is, immediately, when you 6
come, we are going to show you the release documents 7
for that specific day and the count. And on the left-8 hand side, you will be able to browse through various 9
months and get to the specific date.
10 Now, as you are trying to provide feedback 11 in the later part of the meeting, please do think 12 about how this will be structured on the recently-13 released documents is working, what are some things 14 you think will be beneficial as we gather the 15 feedback.
16 In the next slide, I just wanted to show 17 how the results will look like. And please note that 18 this is a very bare minimum mockup. This is not how 19 the final pages will look like. We have just started 20 the project, and we didn't add any colors and 21 everything. So this is just to give you a concept of 22 how it will look like.
23 So on the results page, you can type in 24 keywords, and, as I said, it's not just one keyword.
25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
12 You can provide a combination of words, and that's 1
going to produce the results both in a summary and a 2
tabular format. So here on this page, you are seeing 3
the tabular format, and then you will have the 4
opportunity to sort them by various columns. You will 5
be able to go to specific pages using the pagination.
6 You will be able to edit the search criteria, and then 7
you will be able to download the results into a CSV or 8
an Excel and so on. So I'm not going to get into the 9
details of how we are envisioning, but this is just to 10 give you a high-level visualization of what we are 11 planning to provide.
12 So with that, I will then hand it over to 13 Lynn, who is going to go over the questions and seek 14 for feedback. Over to you, Lynn.
15 MS. RONEWICZ: Thank you. So we will now 16 ask for comments from the public to the three 17 questions provided. Please raise your hand, and you 18 will be called on in order of hands raised. Please 19 remember to speak loudly and clearly so the court 20 reporter can capture all the information. Please 21 state your name and then your comments to any or all 22 of the three questions.
23 If you're dialed in by phone, please raise 24 your hand by pressing *5, and then, once called on, 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
13 press *6 to unmute yourself. Please try to keep your 1
comments brief to the extent possible so we can hear 2
as many comments as possible. We will try to go back 3
to all those who would like a second turn to speak.
4 We will try to address all those who raise their 5
hands, but it may not be possible to address all of 6
them.
7 Okay. So let's see. We have Tony 8
Clements. Please go ahead with your comment. Tony, 9
please go ahead. And if you're having any problems, 10 we'll go on to the next person and come back to you.
11 We'll give you another moment.
12 MS. WAGNER: I believe, Lynn, it might be 13 Tom Clements.
14 MS. RONEWICZ: Oh, Tom Clements. I 15 apologize. Yes. Tom, please go ahead. Okay. At 16 this point, yes, you'll have to unmute yourself, Tom 17 Clements. So let me go to Kathy Edwards in the 18 meantime, and then we'll come back to you. Kathy, 19 please go ahead.
20 MS. EDWARDS-REICHERT: Hi. My name is 21 Kathy Edwards-Reichert, and I'm with Aerotest 22 Operations, Incorporated. I was wondering, so, 23 currently, the date that's on the web-based thing, the 24 date is the date that it was added to ADAMS; is that 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
14 correct? Is the release date going to be different 1
than that, or is that still going to be the date that 2
it was added?
3 MS. RONEWICZ: And did we have staff who 4
would like to answer that?
5 MS. WAGNER: Yes. So I don't believe 6
we're planning on making any changes to the dates of 7
releases of documents. So the date that it was 8
released is the date that it will appear, the same way 9
it does today.
10 MS. RONEWICZ: Okay. And let's go back.
11 Tom Clements, we're going back to you to see if you 12 can unmute and speak. Tom, I will say perhaps you 13 would like to dial in on the bridgeline and that might 14 work. In the meantime, we'll go to Russell Goff.
15 Please go ahead. Unmute yourself and go forward with 16 your comment.
17 MR. GOFF: Sure. I hope my mike works.
18 Yes. When I'm visiting ADAMS, I'm typically trying to 19 find information about a specific company or a 20 specific project and just, you know, everything that's 21 been submitted on the docket for that project or 22 company. And so if that search feature functionality 23 could get built into the new ADAMS search, you know, 24 where I could just click, you know, everything about, 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
15 you know, a company, like company A, B, or C, and just 1
like that would just be one of the filters, for 2
example.
3 And then for number three I know that it's 4
sort of typical of the nuclear industry to always be 5
like a generation of technology behind the rest of the 6
world, but it's sort of like we're finally getting our 7
nice search functionality and it looks amazing, and 8
you guys are doing a great job with it. But then it's 9
like now some of the AI is out there, and I'm aware 10 of, like, some private companies that are trying to 11 use AI to make ADAMS more searchable. So is there 12 anything that the staff is doing for AI search 13 enhancements? Thanks.
14 MS. SALL: So, hi, this is Basia Sall.
15 I'll jump on and take this. I'm the chief data 16 officer for the NRC, and we are currently engaging 17 with several of those start-ups to really learn how 18 they're working with our data in ADAMS to ensure that 19 we, you know, provide open data to those folks, and we 20 will be having some additional interactions and 21 discussions with what they're learning so that we can 22 also learn, as well, and sort of grow in this AI 23 environment together.
24 So we are engaging with our Office of 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
16 Research to gain additional insight into the work 1
they're doing. Thanks.
2 MR. GOFF: Excellent. Thank you.
3 MS. RONEWICZ: Thank you. And next we'll 4
go on to Edwin Lyman. Please go ahead and unmute 5
yourself.
6 MR. LYMAN: Yes. Hi, it's Ed Lyman from 7
Union of Concerned Scientists. Can you hear me okay?
8 MS. RONEWICZ: Yes, we can.
9 MR. LYMAN: Great. So I'd just like to 10 commend you for taking this on, and, actually, in your 11 slide with, your first slide showing all the problems, 12 I've come prepared to say, basically, you know, give 13 examples for each one of those. So I think you've 14 identified the current issues with ADAMS or many of 15 them.
16 And I guess I'd like to second Mr. Goff's 17 proposal that, often, it would be really useful if 18 your initial search, the default would give, let's 19 say, the thousand most recent documents associated 20 with a given licensee. And that's one thing that's a 21 little hard to dig out in ADAMS, and it looks like, 22 what you're proposing, that would probably be pretty 23 easy to do. But I just want to highlight that that is 24 something useful. Or within a date range. So anyway 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
17 to make that easier to achieve would be great. Thank 1
you.
2 MS. RONEWICZ: Okay. Then was there any 3
response to that, or are we just good with that?
4 MS. DOMMETI: Yes. We will be including 5
date range in the searches.
6 MS. RONEWICZ: Thank you. And we'll on to 7
Andy Ratchford, and, just as a reminder, after you've 8
asked your question or comment, please try to remember 9
to lower your hand if you could.
10 Andy, please go ahead.
11 MR. RATCHFORD: Thank you. I'm Andy 12 Ratchford from Jensen Hughes, and I search quite a bit 13 in ADAMS, usually on a facility that I know I'm 14 looking for specific correspondence on a certain 15 issue, sometimes document type, so similar to the 16 previous questioners. Sometimes, I find myself doing 17 multiple searches, Googling a docket number when I 18 know it's a specific commercial nuclear plant, and 19 maybe some additional information to make that easier 20 without involving, you know, separate searches because 21 I know specifically but not the docket number 22 memorized or have it on a separate sheet --
23 (Audio interference.)
24 MR. RATCHFORD: -- specific information.
25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
18 So I think it's similar to the other questions, but 1
that's all I had, and that's mainly related to 2
questions one and two. Thank you.
3 MS. RONEWICZ: Thank you. And we will go 4
on to Larry Gelder, please. Go ahead and unmute.
5 MR. GELDER: This is Larry Gelder, and I'm 6
going to answer questions one and two. When I visit 7
ADAMS, I'm mostly looking for 10 CFR Part 71-related 8
activities, and what feature would I like to see is 9
I'd like to be able to narrow the search down because 10 right now I'll go through and look for individual 11 tasks that are related to Part 71. But if it was 12 organized a little bit better by maybe topic or, you 13 know, the part of the CFR, that would help narrow my 14 search down.
15 But I use ADAMS frequently, at least 16 weekly and sometimes several times a week.
17 MS. DOMMETI: And -- oh, sorry. Go ahead.
18 MR. GELDER: No, no, go ahead. I was 19 going to just say if you have any questions for me I'd 20 be glad to answer them.
21 MS. DOMMETI: Sure. I just wanted to 22 address regarding the narrow search, so that will be 23 a feature as part of the new results in the form of 24 facets. So, hopefully, that will help you narrow down 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
19 the search better using certain categories.
1 MR. GELDER: Thank you.
2 MS. RONEWICZ: Okay. Thank you. And 3
moving on, Kathy Edwards-Reichert, please go ahead.
4 Unmute.
5 MS. EDWARDS-REICHERT: I have some 6
questions on the existing system. So we'll send in 7
things to document control, and it will take months 8
before it actually shows up on ADAMS. Is there some 9
way to get that -- to expedite that?
10 MS. WAGNER: I'm sorry. Can you restate 11 that question? I apologize.
12 MS. EDWARDS-REICHERT: Okay. So we submit 13 stuff to document control, and it will take months for 14 it to show up on ADAMS. Is there some way to speed 15 that up?
16 MS. RONEWICZ: Let me just interject if I 17 could. That question would be outside the scope, if 18 you don't mind, and we will provide information for 19 you to send that question on and different staff can 20 answer that. Is that okay with you? It's pretty much 21
-- it's just not in the scope of these particular 22 questions, but we'll let you know if we --
23 MS.
EDWARDS-REICHERT:
We find it 24 frustrating when we go back to look back at history 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
20 that we know things have happened but they're not on 1
ADAMS. From both our standpoint and from the NRC's 2
standpoint, the documents aren't there.
3 MS. RONEWICZ: Yes. And we're --
4 MS. BLANEY: We understand. And if we 5
could have -- at the end, we'll give you the email 6
address to send that to, and we will definitely take 7
that comment into consideration and try to find an 8
answer for you and get back to you as soon as 9
possible.
10 MS. EDWARDS-REICHERT: Okay. Thank you.
11 MS. BLANEY: You're welcome.
12 MS. RONEWICZ: And thank you for that 13 question. Now, Tom Clements, I see you did have your 14 hand raised, but now I don't see you but wanted to 15 give you an opportunity. Tom Clements, if you had a 16 question, please go ahead and unmute. Okay. Then we 17 will go on to Jason Zorn. Please go ahead.
18 MR. ZORN: Hi. Can you hear me okay?
19 MS. RONEWICZ: Yes, we can.
20 MR. ZORN: Hi. My name is Jason Zorn. A 21 quick question about getting accession numbers. It 22 seems to me that a longstanding kind of flaw of the 23 existing Web-Based Adams is there's no simple way to 24 just enter an ML number into ADAMS to quickly get a 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
21 document. You have to go to multiple drop-down menus.
1 I didn't see on the previous slides whether or not 2
that functionality was going to be added or you just 3
had a very quick window that you could enter the ML 4
number or maybe through the keyword search or 5
something like that, but my suggestion would be to try 6
to make it easier to just enter ML numbers into the 7
system quickly.
8 MS. DOMMETI: Yes. And we are going to 9
take care of that, Jason. So in the keyword search, 10 you will be able to provide the ML number that it can 11 search.
12 MR. ZORN: Perfect. Thank you so much.
13 MS. RONEWICZ: Thank you for that 14 question. Dan Frumkin, moving on to you.
15 MR. FRUMKIN: Hi. This is Dan Frumkin.
16 I'm a member of the staff, but I feel like there's an 17 opportunity during this call to get some examples for 18 industry searches that people like. Many people have, 19 one person said that they were open to (audio 20 interference) and a number of people said I would like 21 to be able to choose this or choose that or, just like 22 you said, like an accession number.
23 Are there examples of generally available 24 searches that you use that allow that kind of 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
22 functionality? Because I think, if we could look at 1
that, we could get some ideas of better, maybe a 2
better picture of what it is you're expecting or 3
hoping for beyond the functionality on the previous 4
slide. So that's a question for previous questioners 5
if they're willing to provide names of products that 6
do the searches like you like.
7 MS. RONEWICZ: And if anybody would like 8
to respond to Dan's question, we'll give it a few 9
moments. Just go ahead and raise your hand or just 10 speak out at this point.
11 Okay. If you --
12 MR. GELDER: Sorry. Was that just that 13 you wanted the names of, like, commercial companies 14 that have, essentially, a replica of ADAMS with --
15 MR. FRUMKIN: No, no.
16 MR. GELDER: -- that search function --
17 MR. FRUMKIN: I'm sorry to be talking over 18 you because there's a court reporter. No. The 19 question is, and I'll feed, like, one, LexisNexis, 20 maybe Wall Street Journal or has a search or 21 Washington Post. They have like technical libraries 22 that are searchable. And I'm wondering if there's 23 examples of those kind of technical searches that have 24 the capabilities that you're describing, like --
25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
23 MS. RONEWICZ: Dan, you're breaking up a 1
little bit. Not to interrupt, Dan, you're breaking up 2
a little bit.
3 MR. FRUMKIN: Okay.
4 MS. RONEWICZ: Sorry, Dan. You were 5
breaking up a bit.
6 MR. FRUMKIN: So did you get the 7
LexisNexis thing?
8 MS. RONEWICZ: We did.
9 MR. FRUMKIN: Okay. So that's what I'm 10 asking, not for the third parties who are doing ADAMS 11 but for other commercial searches of technical 12 libraries that you think have features that ADAMS, 13 that you would prefer that ADAMS replicate.
14 MS. RONEWICZ: If anybody wanted to weigh 15 in to Dan, I would say just go ahead and speak, just 16 so we don't have confusion on who has got hands raised 17 for the three. So if anybody wants to respond to Dan, 18 just please go ahead and, one at a time, and unmute 19 yourself and speak.
20 MR. LYMAN: I mean, this is Edwin Lyman.
21 I mean, just an ordinary Google search, you can type 22 in a keyword in quotation marks, you can select the 23 period of time or, you know, the last seven days, the 24 last month, and whatever, and that's easier to use 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
24 than ADAMS to do that same function. So really we're 1
talking about very basic things here.
2 MS. RONEWICZ: Thank you for that. Were 3
there any other comments for Dan? Okay. For now, 4
we'll go ahead and move on to the next hand raised.
5 Laurie Borski, please go ahead, unmute yourself. And, 6
Laurie Borski, if you can go ahead and unmute yourself 7
and go ahead. Okay.
8 MS. BORSKI: Hello.
9 MS. RONEWICZ: Yes, we can hear you now.
10 MS. BORSKI: Very good. I've been using 11 ADAMS for daily searches since 2007. I don't think 12 I'm a novice anymore. The primary area that I'm 13 interested in is nuclear waste, and, of course, the 14 limitation of a thousand documents added to ADAMS each 15 day is a huge impediment, especially when thousands 16 and sometimes over tends of thousands of documents are 17 added per day, as has been recently done. It's hard 18 for me to figure out what is new today without having 19 to filter down, and then I'm limited to ten filters, 20 which makes it sometimes impossible to determine how 21 many documents or what they are that have been added 22 to ADAMS in a given day.
23 My question to you, I actually have two.
24 The new software doesn't seem to show the title of the 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
25 document in the search results, and it seems to limit 1
to 25 displayed. So I need to know if that's the plan 2
for the future, or if that is something that can be 3
changed. I use ADAMS every workday. I'm looking for, 4
primarily, what has been added to ADAMS in a given 5
day. The 1000-display limitation needs to go away 6
finally. This has been a problem for years.
7 And I also need to ask if the LSN 8
capability is going to be impacted by your new 9
software. Thank you.
10 MS. DOMMETI: Hi, Laurie. So I can answer 11 the first two questions. So you know what I had shown 12 in the slide is just a mockup, but document title is 13 going to be part of the search results. And second is 14 you will have -- we will not be limiting it to 25 per 15 page, so that was, you know, just to show, but that 16 can be increased.
17 MS. BORSKI: Okay. So to clarify, you did 18 say that the document would be shown if I decide to do 19 it that way?
20 MS. DOMMETI: More than 25.
21 MS. BORSKI: Okay. And will it display 22 the title of the document?
23 MS. DOMMETI: Yes. And the document title 24 can be displayed, yes.
25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
26 MS. BORSKI: Excellent. Thank you.
1 MS. DOMMETI: Yes. Anyone wants to take 2
the LSN question?
3 MR. CHOUDHURY: Arathi, this is Roy. As 4
far as I know, the LSN will not be impacted by what we 5
are doing for the public search.
6 MS. DOMMETI: Okay. Thanks, Roy.
7 MR. CHOUDHURY: The LSN is still working 8
with the search, and that will continue until we 9
actually decide what to do.
10 MS. BORSKI: Okay. Very good. I was part 11 of the LSN ARP meeting in 2018, and so I already had 12 provided NRC with my thoughts on that database.
13 MR. CHOUDHURY: Yes, Laurie, I remember 14 fully. I was also part of that.
15 MS. BORSKI: I know. I recognize your 16 name. Good to see you again. Thank you.
17 MR. CHOUDHURY: Thank you.
18 MS. RONEWICZ: Okay. Thank you. Now we 19 will go on to Patrick White. Please go ahead and 20 unmute.
21 MR. WHITE: Great. Thank you very much.
22 Patrick White with Nuclear Innovation Alliance. So, 23 first off, thanks for hosting this public comment-24 gathering session. Very excited for this.
25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
27 In response to your specific questions, 1
the first one, when visiting Web-Based ADAMS, I'm 2
normally looking for a variety of documents. This can 3
be things like regulatory guidance or commission 4
documents, like SECYs or other types of either 5
commission papers or staff papers to the commission, 6
or I'm sometimes looking for kind of project or site-7 specific regulatory documents. So it's a variety of 8
different documents. Oftentimes, also looking for 9
historic documents, so things from 1970s, 1980s, that 10 might be included in the public legacy documents.
11 In terms of features or functionality that 12 I'd be most interested in, a lot of it would really 13 come down to either searchability within documents or 14 more effective keyword searches. Oftentimes, it's 15 looking for a specific phrase or a specific topic that 16 might be embedded somewhere within a much larger 17 document.
18 So, for example, looking at a specific 19 engineering analysis method or a specific regulatory 20 topic that might be embedded in a several thousand-21 page document. A more effective way to try to find 22 documents that contain those phrases, I think, would 23 be helpful and would be effective.
24 So I guess kind of one, two questions, or 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
28 I guess two questions I had as kind of a follow up to 1
this is, one, is there any thought on increasing the 2
searchability of text within the existing documents on 3
ADAMS, rather than just using the existing keyword or 4
title searches, similar to, I think, what Ed Lyman 5
talked about in terms of what you can do with a GOogle 6
search.
7 And, second, is there any thought on how 8
to kind of incorporate or ensure continued 9
searchability of the NRC legacy documents, things that 10 might not yet have been digitized but are something 11 that an external stakeholder might be interested in 12 either following up with a FOIA request or coming to 13 the NRC's library to look at on some of the physically 14 available systems? I know I'll often use the legacy 15 library as a way to look for documents that might not 16 be available now but might be things that I'm 17 interested in following up with the staff on later.
18 So thank you so much.
19 MS. DOMMETI: Sure. So I can answer the 20 first one. So if I understood correctly, you're 21 saying not just based on a property but text search?
22 MR. WHITE:
That's correct.
So, 23 essentially, searchability within the text of a 24 document.
25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
29 MS. DOMMETI: Yes. That will be 1
available. And regarding legacy documents, I think 2
the public document room can get back to you on that 3
if you can email them.
4 MR. WHITE: Will do. Thank you very much.
5 MS. RONEWICZ: Okay. And moving on, and, 6
I apologize, James Slider, did you already speak? If 7
not, please go ahead.
8 MR. SLIDER: Thank you. James Slider with 9
the Nuclear Energy Institute. One of the features I 10 would love to see happens -- occasionally, I will find 11 an accession number mentioned in a commission 12 document, and when I plug that accession number into 13 ADAMS it returns zero results. And I would appreciate 14 it if, in your new display, you could indicate that 15 such a number that might reference a document that's 16 withheld from public view so that I know it isn't just 17 a failure of the ADAMS search function but it, in 18 fact, is a document, but the document isn't available 19 on the public side of ADAMS.
20 The other related challenge that I face, 21 probably outside of your group's responsibilities, but 22 the search box on the website just isn't -- it's 23 abysmal in terms of producing useful results. They're 24 very disorganized, and I have no way to tell how 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
30 relevant they are. And, again, I don't expect you all 1
to have to address that, but in these cases where I 2
get an ML number and I can't find it in ADAMS and I 3
plug it into the website search box and get no 4
results, it's not very informative, other than I 5
suspect it's not available publicly but I don't know 6
for sure. And so I often resort to what Ed Lyman 7
mentioned earlier. Sometimes, it's a lot easier to 8
find things on Google than through these two search 9
options, ADAMS and the website search box.
10 MS. DOMMETI: Thank you. We'll make a 11 note of it.
12 MR. SLIDER: Thanks.
13 MS. RONEWICZ: Okay. And moving on, Tara 14 Noble, please go ahead and unmute.
15 MS. NOBLE: He covered my question. My 16 question was would we have the availability of knowing 17 that a document is not available to the public when we 18 search on it. Currently, the only way we can get 19 confirmation is by emailing the PDR and waiting for a 20 response to be told that that is not a publicly-21 available document.
22 MS. RONEWICZ: Thank you for that. Edwin 23 Lyman, please go ahead.
24 MR. LYMAN: Hi. This is Ed Lyman again.
25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
31 This also may be out of the scope of this meeting, but 1
I wanted to raise it. With regard to the document 2
naming conventions and the metadata, so that, if you 3
want to separate a document from the search results, 4
some of them are the default names, the accession 5
number. Sometimes, there's a detailed description 6
what the document is, sometimes it's a series of, you 7
know, codes and letters and numbers for some 8
inspection report. I don't know if there's a 9
consistent -- I mean, it doesn't look to me like 10 there's a consistent convention for that, and it would 11 be really helpful if there were so that you could 12 easily download a document without having to rename it 13 according to your own convention. So I just wanted to 14 raise that. And if I'm missing something, if there is 15 some logic to it that I'm not aware of, I'd appreciate 16 being informed of that. Thank you.
17 MS. DOMMETI: Ed Lyman, can you just 18 quickly repeat your suggestion once again? I was not 19 able to gather all of that.
20 MR. LYMAN: Sorry. It's when you -- can 21 you hear me now?
22 MS. DOMMETI: Yes.
23 MR. LYMAN: When you save the document 24 from -- you click on a document to download it from 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
32 the ADAMS results, the default name is, there doesn't 1
seem to be a consistent convention. Sometimes, that's 2
the accession number. Sometimes, it's a document 3
title or a description. Sometimes, it's a code for an 4
inspection report or something like that. And I'm 5
just saying it doesn't seem like there's a consistent 6
naming convention there.
7 MS. DOMMETI: Okay.
8 MR. LYMAN: So that was my comment.
9 MS. DOMMETI: Okay. Thank you. We'll 10 make a note of that.
11 MS. RONEWICZ: Okay. And we are waiting 12 for any other comments. Waiting for hands raised.
13 Okay. And we'll wait about 30 seconds or so. If 14 anybody else has any comments, please go ahead and 15 raise your hand. Yes, okay. Patrick White, go ahead.
16 MR. WHITE: Great. I'm just following up 17 on my additional comment. I think if there were some 18 way to help kind of search out what types of documents 19 you're looking at, are you specifically looking at 20 correspondence, are you specifically looking at SECYs, 21 different regulatory guides, that might be helpful.
22 I can't recall if that's already available in the Web-23 Based ADAMS, or if that can be an additional feature 24 just as a way to help kind of further clarify the 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
33 search results.
1 MS. DOMMETI: Sure. Thanks, Patrick. We 2
will have search by document type. Hopefully, that 3
is, I think, what you're referring to.
4 MR. WHITE: That's exactly it. Thank you 5
very much.
6 MS. RONEWICZ: Okay. And Jackie Toth, 7
please go ahead.
8 MS. TOTH: Jackie Toth at Good Energy 9
Collective. I just want to underscore what Patrick 10 just said. That would be very useful to be able to 11 indicate and differentiate between the various 12 document types.
13 And just thinking about accessibility 14 here, I think if there are ways and opportunities to 15 explore different colors or different icons that would 16 start to differentiate between many different document 17 types that are in ADAMS, that would be very helpful 18 from an accessibility perspective. Thanks, all.
19 MS. RONEWICZ: Thank you. Joe Gillespie, 20 please go ahead.
21 MR. GILLESPIE: Yes, hi. I just want to 22 point out that I would encourage the systems board --
23 and maybe this was addressed earlier, I joined a 24 little bit later -- that you all continue to keep the 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
34 documentation for whatever API is in place to keep 1
that updated because it's a very useful feature right 2
now for things like custom searches and using other 3
applications to access the information.
4 MS. DOMMETI: Sure. Thank you.
5 MS. WAGNER: Joe, can I ask a follow-up 6
question to that?
7 MR. GILLESPIE: Absolutely.
8 MS. WAGNER: What applications are you 9
thinking of putting that into, just out of curiosity?
10 MR. GILLESPIE: Right now, I use it in a 11 couple of different ways. One is to, you know, I run 12 a small application that will go and query the API for 13 recent documents based on certain dockets or 14 adjudicatory documents, things like that.
15 Alternatively, I've used it for pulling information 16 about titles and information from documents to go and, 17 you know, so I can put an ML number and just find that 18 information in different formats. Like, mine sends it 19 directly from an Excel document or, I mean, an Excel 20 file, for example.
21 MS. WAGNER: Awesome. Thank you. I 22 appreciate that additional information.
23 MS. RONEWICZ: Okay. Dave Lochbaum, 24 please go ahead. Okay. Dave Lochbaum, please go 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
35 right ahead with your comment. We can't hear you if 1
you're speaking, Dave Lochbaum. Okay. Maybe there 2
was an issue.
3 Okay. So looking to hear any other 4
comments. Please go ahead and raise your hand. Yes, 5
Andy Ratchford.
6 MR. RATCHFORD: Hi. One of the things I 7
struggle with is the document type, and I think some 8
others have brought about that. I know it's heavily 9
populated, but sometimes, like, I'll note something is 10 an inspection report but it might be coded as NRC 11 inspection report. You know, there's trip report and 12 trip reports and things like that, so maybe having 13 some flexibility in that document type that will pick 14 up all of the things that look like a license 15 amendment request or an inspection report or something 16 like that might be helpful because I think they're 17 probably limited to what it was coded at the time for 18 a document type, and it might not be what we would 19 traditionally call it. So that's my input on document 20 type because there are a lot of choices, and some of 21 them look to be duplicates to each other and things.
22 MS. RONEWICZ: Thank you for that. Okay.
23 I'm waiting for other questions or other comments.
24 MR. FRUMKIN: Hey, Lynn. This is Dan 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
36 Frumkin again. A couple of questions ago, I think 1
maybe before Joe Gillespie's question, somebody talked 2
about accessibility, the use of icons, the ability to 3
click on a certain type and drill down. Again, I 4
think it would be helpful if we had some examples of 5
-- we know about Google, which doesn't really do those 6
things, but what other examples of commercially-7 available library search software can we look at and 8
say, oh, yes, that's what they're talking about 9
because right now it's a very, I guess, theoretical.
10 But I think if we could get some examples of actual 11 products that other large vendors use, we could maybe 12 make some progress faster if we know what it is that 13 we're going to be looking for. Especially if they're 14 government tools that are out there that do this 15 better than you think NRC does, please let us know 16 because we can collaborate with government agencies.
17 So any of the questioners, please, if you 18 have examples of, like, well, if ADAMS looked like 19 this, other than Google, let us know and we will be 20 able to take that into consideration.
21 MS. RONEWICZ: So anybody that would like 22 to respond to Dan? No need to raise your hand. Just 23 go ahead one at a time and feel free to provide any 24 input to Dan that you'd like to. And there will be 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
37 information at the end if you think of things you 1
would like to send in. So let's give it a little bit 2
more time for any other comments. Please go ahead and 3
raise your hand. We'll give it about 30 seconds more, 4
and then we'll turn it over for closing remarks.
5 Seeing no hands raised, we will go ahead 6
and turn it over to Basia Sall for closing remarks.
7 MS. SALL: Thanks so much, Lynn. First, 8
thank you, everybody, for your participation in this 9
public meeting. As a chief data officer for NRC, one 10 of my key responsibilities is engaging agency 11 employees and the public in using public data assets 12 and encouraging the collaborative approaches to 13 improving data use. By opening the doors to data, we 14 can really start to unlock innovation as we move 15 forward.
16 If you have additional comments about 17 anything we've discussed today, you can contact the 18 public document room resource, and that's located at 19 pdr.resource@nrc.gov. We encourage participants 20 outside of NRC to provide public meeting feedback to 21 the NRC staff via the NRC public meeting website. A 22 link will be posted shortly after the conclusion of 23 this meeting.
24 Thank you all for participating in this 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com
38 public meeting about Web-Based ADAMS. Your feedback 1
is valuable to us.
2 With that, this meeting is concluded, and 3
we thank you all for attending.
4 (Whereupon, the above-entitled matter went 5
off the record at 1:47 p.m.)
6 7
8 9
10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 NEAL R. GROSS COURT REPORTERS AND TRANSCRIBERS 1716 14th STREET, N.W., SUITE 200 (202) 234-4433 WASHINGTON, D.C. 20009-4309 www.nealrgross.com