ML18058B305
| ML18058B305 | |
| Person / Time | |
|---|---|
| Issue date: | 02/27/2018 |
| From: | NRC/Licensing Support Network Advisory Review Panel (LSNARP) |
| To: | |
| References | |
| Download: ML18058B305 (174) | |
Text
LicensingSupportNetwork AdvisoryReviewPanelMeeting February27 28,2018 1
Introductions
Dr.AndrewBates ChipCameron LSNARPChair MeetingFacilitator MargieJanney ActingLSNAdministrator 2
Agenda February27,2018
Introductions
MeetingProcess&Overview Break StatusofYuccaMountainAdjudicatory Process HistoryoftheLSNandIntroductionofLSN Reconstitution/ReplacementOptionsPaper StatusofEIE/EHDandExhibitSubmission Gap Lunch Option1,TraditionalDiscovery Option2,NRCADAMSLSNLibrary Break WrapUp Break ADAMSLSNLibraryOrientation February28,2018 RecapofDayOne RecapofMeetingProcess Option3,MovetotheCloud Lunch Option4,RebuildtheOriginalLSN Break Replacement/ReconstitutedLSNOptions Summary CommentandDiscussiononAllOptions MemberViewsonOptions WrapUp/PathForward 3
MemberIntroductions ChurchillCounty,NV CityOfCaliente,NV ClarkCounty,NV DepartmentofEnergy EsmeraldaCounty,NV EurekaCounty,NV InyoCounty,CA LanderCounty,NV LincolnCounty,NV MineralCounty,NV NationalCongressOfAmerican Indians NativeCommunityActionCouncil NevadaNuclearWasteTaskForce NRCStaff NuclearEnergyInstitute NyeCounty,NV PrairieIslandIndianCommunity StateofNevada TimbishaShoshoneTribe WhitePineCounty,NV 4
MeetingProcess 5
CommentandDiscussion I.
CommentsfromLSNARPMembers 1.
LSNARPMembersintheRoom 2.
LSNARPMembersconnectedthroughGoToMeeting 3.
LSNARPMembersontheTelephone II. CommentsfromMembersofthePublic 1.
MembersofthePublicintheRoom 2.
MembersofthePublicconnectedthroughGoToWebinar RaiseYourHand commentthroughaudio TypedQuestionstobereadbyFacilitator 3.
MembersofthePublicontheTelephone 6
I.
CommentsfromLSNARPMembers 1.
LSNARPMembersintheRoom 2.
LSNARPMembersconnectedthroughGoToMeeting 3.
LSNARPMembersontheTelephone II. CommentsfromMembersofthePublic 1.
MembersofthePublicintheRoom 2.
MembersofthePublicconnectedthroughGoToWebinar RaiseYourHand commentthroughaudio TypedQuestionstobereadbyFacilitator 3.
MembersofthePublicontheTelephone
GoToMeeting LSNARPMemberParticipation 7
GoToMeeting-AudioMute/UnMute
- Selfmuteyouraudio byclickingonthe microphoneicon
- Unmuteyouraudio whenyouarecalled
- Pauseamomentbefore speakingasthereisa briefdelaywhenaudio isunmuted 8
GoToMeeting-Chat
- Ifyoudonothaveaweb cameraorneedto communicatewiththeITstaff, pleaseusethechatfeature
- Besuretosendchatrequests toOrganizer(s)Only 9
GoToWebinar PublicParticipationOptions 10
GoToWebinar ControlPanel
- OpentheGotoWebinar ControlPanelbyclickingonthe Orangearrow
- TheOrangearrowcantypicallybefoundintheupper rightareaofyourcomputerscreen 11
VerbalQuestion
- Ifyouareusingyourcomputeraudio andhaveamicrophoneorareusing theGoToWebinar providedphone number,youcanaskaquestion verbally
- FromtheGoToWebinar toolbar,click onRaiseYourHand
- ThehandwilldisplayanUpArrow
- Whenitistimeforpubliccomments andyouhaveRaisedyourhand, youraudioconnectionwillbe unmuted 12
TypedQuestion 13 OpentheQuestionspanel
- (###)#######
- (###)#######
TypeinyourquestionandpressSend iOS,Android,etc.displayaQuestionMark
MeetingOverview 14
LicensingSupportNetwork AdvisoryReviewPanelMeeting StateofNevadaPerspective RobertHalstead ExecutiveDirector StateofNevadaAgencyforNuclearProjects Rockville,MD February27,2018
ImportanceoftheLSN
- TheLSNandanyLSNsubstituteservethe importantpurposeofallowingthepublictostay informedaboutYuccaMountain.
- TheprincipleobjectiveoftheLSNandanyLSN substituteistoprovideanelectronicdiscoverytool thatwillservetheneedsoftheparticipantsinthe YuccaMountainlicensingproceeding.
- ThisisespeciallyimportanttotheStateofNevada.
- Nevadawillneedtosupportanddefendover200 contentions,probablyunderstrictdeadlines,and NevadawillsufferthemostiftheLSNorLSN substituteperformspoorly.
2/27/2018 16
LSNARPandDeterminationofUsers Needs
- TheLSNARPwasestablishedundertheFederalAdvisoryCommittee Act(FACA)and,asrequiredbyFACA,operatesunderanNRC approvedCharterthatspecifiesLSNARPsobjectives.
- LSNARPCharter:LSNARPsprimaryfocusistechnicalissues relatingtotheoperationandmaintenanceoftheLSNandcontinuing assessmentsastohowandwhethertheLSNisperformingits intendedfunctionandservingusersneeds.
- Thereforedeterminingtheusersneedsiscritical.
- Theusersneeds(especiallytheneedsofthenineteen participants)canonlybedeterminedthroughtheiractive participationintheadvisorycommitteeprocessandinsubsequent rulemaking.
- Allnineteenparticipantsmustbeinvolved,especiallyatearlystages whencriteriaforarchitectureselectionaredevelopedand architectureoptionsareputforward.
2/27/2018 17
LSNARP&CurrentConstrained Circumstances
- Withtheproceedingsuspendedforoversixyears, prospectsforresumptionunclearatbest,andnonew federalfundingforpartiesandparticipantsinthe currentfiscalyear,itisnotreasonabletoexpectthe kindofparticipantinvolvementthatisrequired.
- TheCommissionhasrecognizedthatparticipants fundinglimitationsmustbetakenintoaccountin decidinghowtomoveforward(CLI1308,78NRC219, 233(2013)).
- Tomoveforwardwiththisadvisorycommitteeprocess allLSNARPmemberswillneedadequateresourcesso thattheycanparticipateeffectively,especiallyin formulatingcriteriaforarchitectureselectionandthen puttingoptionsforwardforfurtherconsideration.
2/27/2018 18
NevadaExpectationforThisLSNARP Meeting
- NevadaunderstandsthattheLSNARPChairDr.Bates,representativesof theAtomicSafetyandLicensingBoardPanel,andotherNRCstaff, are andwillinthefuturebeconstrainedbyCommissiondirectives.
- Nevertheless,Nevadawishestostate,fortherecord,that,whileitis participatinginthisLSNARPmeeting,Nevadaobjectstoanyprocess wherebyaninadequatelyfundedLSNARPwouldbeaskedtoprovide finaladviceafteronlythisonemeeting.
- Nevadasuggeststhattheproperdeliverablefromthismeetingcannot befinalopinionsandoptionstotheASLBP.
- Nevadasuggeststhedeliverable(ifany)shouldbeapathforwardfor facilitatingeffectiveparticipationinfutureLSNARPmeetingsand obtainingLSNARPadvicethatreflectsalloftheusersneeds.
2/27/2018 19
NevadasViewofUserNeeds GuidanceforDatabaseManagementSystemDesign
- Databasemanagementsoftwareshouldbe designedwiththeenduserinmind.
- Notallenduserswillaccessadatabaseforthe samepurposeoruseitthesameway.
- DBMSdesignersshouldbeawareofthefunctions variousenduserswillneedinordertoaccomplish theirtasks.
- Alistingofdesiredattributesforendusers,based onNevadasexperienceintheYuccaMountain licensingproceeding,isprovidedinthefollowing slides.
2/27/2018 20
NevadasViewofUserNeeds 2 DesiredAttributesinaDatabaseManagementSystem
- Rapidspeedforaccess,search,filter,viewand download
- Centralizedsearchcapability-singleportalaccess totheentirelibrary
- Accessibletousersviatheweb
- Accessibleviapopularwebbrowsers(notjust InternetExplorer)
- Equalaccessbyagencies,participants,and interestedmembersofthepublic
- Stablecollectionofdocuments/headers 2/27/2018 21
NevadasViewofUserNeeds 3 DesiredAttributesinaDatabaseManagementSystem,cont.
- Transparentprocessforadding,revisinganddeleting documents(deletingisrare)
- Newversionsofdocumentsalreadyinthedatabaseare added;theydonotreplaceexistingversionsof documents;documentswithmarginaliaaretreatedas newversions
- Searchtemplateswithlogicalsearchproperties(i.e.,
date,title,LSN#,P/A#,type)
- Contentsearchofdocuments(entiredocument,not limitedtopageorlinebreaks)
- Searchitemsarehighlightedinthesearchresultslist
- Searchtemplatedisappearstorevealsearchresultsand doesnothavetobehidden 2/27/2018 22
NevadasViewofUserNeeds 4 DesiredAttributesinaDatabaseManagementSystem,cont.
- Abilitytonarrowandfiltersearchresults
- Abilitytosetnumberofdocumentsdisplayedper searchpage
- Displayheader/bibliographicinformationwitheach documentlistedinsearchresults
- Abilitytoscrollthroughpagesofsearchresultsrapidly orpagejumpasneeded
- Printsearchresults(oneclickprinting,notthecopy andpasteworkaround)
- Viewtheactualdocumentwithouthavingtodownload itfirst
- Easyandrapiddownloadofdocuments 2/27/2018 23
CommentandDiscussion I.
CommentsfromLSNARPMembers 1.
LSNARPMembersintheRoom 2.
LSNARPMembersconnectedthroughGoToMeeting 3.
LSNARPMembersontheTelephone II.
CommentsfromMembersofthePublic 1.
MembersofthePublicintheRoom 2.
MembersofthePublicconnectedthroughGoToWebinar RaiseYourHand commentthroughaudio TypedQuestionstobereadbyFacilitator 3.
MembersofthePublicontheTelephone 24 I.
CommentsfromLSNARPMembers 1.
LSNARPMembersintheRoom 2.
LSNARPMembersconnectedthroughGoToMeeting 3.
LSNARPMembersontheTelephone II. CommentsfromMembersofthePublic 1.
MembersofthePublicintheRoom 2.
MembersofthePublicconnectedthroughGoToWebinar RaiseYourHand commentthroughaudio TypedQuestionstobereadbyFacilitator 3.
MembersofthePublicontheTelephone
Break (EnterTime) 25
StatusofYuccaMountain AdjudicatoryProcess PaulBollwerk,AdministrativeJudge AtomicSafetyandLicensingBoardPanel 26
Timeline 27 LSNShutdown (Aug.2011)
CommissionDirectiontoCAB04toCompleteActivities CLI117,74NRC212(Sept.2011)
CAB04SuspensionDecision LBP1124,74NRC368(Sept.2011)
CourtMandamusRuling InreAikenCounty,725F.3d255(D.C.Cir.July2013)
CommissionResponsetoCourtRuling CLI1308,78NRC219(Nov.2013)
InternalLSNLibraryOperational (Apr.2014)
NRCStaff SafetyEvaluationReportCompleted NUREG1949(Jan.2015)
CommissionAuthorizesPublicLSNLibrary SRMCOMSECY140041(Feb.2015)
NRCStaff SupplementalEnvironmentalImpactStatementCompleted NUREG2184(May2016)
PublicLSNLibraryOperational (Aug.2016)
CommissionAuthorizesLSNARPMeeting SRMCOMSECY170019(July2017)
Jan. 2011 Dec. 2017
StatusofYuccaMountain AdjudicatoryProcess PaulBollwerk,AdministrativeJudge AtomicSafetyandLicensingBoardPanel 28
LicensingSupportNetworkAdvisoryReviewPanel Meeting StateofNevada APathForwardfortheLSN MartinG.Malsch Partner EganFitzpatrickMalsch&Lawrence,PLLC SpecialDeputyAttorneyGeneral StateofNevada Rockville,Maryland February27,2018
NevadasStatementonaPathForwardfor theLSN
- TheLSNwasdevelopedonlyafternumerousadvisory committeemeetingsandconsiderationofoptions preparedbyatechnicalworkinggroup.
- AlsoboththeLSNandthepriorelectronicdiscovery system(theLSS)wereincorporatedintoPart2only afternoticeandcommentrulemaking.
- Thesameprocessshouldbefollowedhere(assuming theoldLSNcannotsimplyberevived).
- Animmediatelyeffectivechangeto(oranexemption from)10C.F.R.Part2SubpartJtoreflectanLSN substitutewillonlycauseconfusion,delayand, possibly,prejudice.
2/27/2018 30
HistoryoftheLSN andtheADAMSLSNLibrary MargieJanney ActingLSNAdministrator
PurposeoftheLSN
- NWPArequiresNRCtoevaluateDOEs applicationforageologicrepository
- NRCslicensingprocess
- Technicalreview
- Licensingadjudication
- LSNtomakediscoverymaterialelectronically availableforinitialconstructionauthorization andreceiveandpossessproceedings 32
LSNDevelopment
- LSNRuleissued(1998)
- 10C.F.R.Part2,SubpartJprovidesspecificrules governingaHLWdiscoverysystem
- LSNARPwascreated
- NRCsubmittedbusinesscaseanalysis(2000)
- LSNoperational(20012011) 33
FunctionalityofOriginalLSN
- RequirementsdocumentedinLicensingSupport NetworkFunctionalRequirements (ML003722859)
- LSNGuidelines(ML061380788) 34
LSNComprised
- 19servers
- LANenvironment
- Offsitedatacenter
- www.lsnnet.gov
- Participantoperatedwebsites
- LSNcreatedindexandpointedtothe documents 35
ShuttingDowntheLSN
- HLWproceedingsuspendedSept2011
- CAB04issuedApril2011order
- ParticipantstosubmitdocumentcollectionstoSECY
- SECYtomakedocumentspubliclyavailablein ADAMS
- NRCrequiredtobecompliantwithNARA recordsrequirements.
36
HistoryofPublicADAMSLSNLibrary
- TohelptheNRCstaffcompleteitsHLWSafetyEvaluation Report,theCommissiondirectedentryofLSNdocuments intononpublicADAMS(11/2013,ML13322A744)
- CommissiondirectedLSNdocumentcollectionsbemade publiclyavailableinADAMS(01/2014.ML14024A429)
- CommissionplacedresponsibilityforLSNdocumentactivities withSECYandASLBP(02/2015,ML15034A088)
- TheprojecttomakeLSNdocumentcollectionspublicly availableinADAMSbeganinDecember2015(ML15335A395)
- InAugust2016,theLSNLibrarybecamepubliclyavailable (ML16210A436) 37
AnomalieswithADAMSLSNLibrary
- LSNLibrarywasverifiedusingLSNAdministrators finallistofLSNAccessionNumbersand correspondingParticipantAccessionNumbersas providedtoSECY(ML11209C291).
- Issueswerefoundwith130ofthe3,692,306LSN Librarydocuments.
- ResolutionofanomaliesdocumentedintheLSN LibraryAnomalyResolutiondocument (ML17087A500).
38
FromLSNtoLSNLibrary
- Since2011,theNRChasactedto:
- PreserveLSNdocumentsfromallparties.
- Resolveanomaliesindocumentsandindexes submittedbytheparties.
- MakeLSNrecordsavailableandsearchableforthe NRCstaffandpublicinanewLSNLibrary database.
39
Introductionof LSNReconstitution/Replacement OptionsPaper MargieJanney,ActingLSNA
UnderlyingAssumptions Optionswillrequiremodificationstoorexemptionsfrompartsof10C.F.R.
Part2,SubpartJ ASLBPLSNAappointedtooverseedesign,implementation,andoperation HardwareandsoftwarecomponentsthatconstitutedtheNRCportionof originalLSNnolongeravailableorsupported OriginalLSNGuidelinestobeupdatedbytheLSNA,withtheLSNARP,to providetechnicalguidanceontheoperation ReconstitutedorreplacementLSNneedstoremaininoperationthrough anyjudicialappellateproceedingsfollowingthereceiveandpossess licensingproceeding Participants2011bibliographicinformationstillassociatedwitheach headeranddocument OriginalLSNaccessionnumbercanbeusedtofindheadersand documentsinthepublicADAMSLSNLibrary 41
DocumentSizingResponses
- InyoCounty=~50documents,noheaderonlyentries
- NEI=100to500documents,noheaderonlyentries
- StateofNevada=1,000+documents
- DOE=1,000+documents,9%headeronly
- Additionallicenseapplicationworkandnewcontentionswill influencetheamountofnewmaterial
- NRC=1,000to2,000newdocuments,1%headeronly
- Significantuncertaintiesastoresumptionofadjudicationmay impactestimate
- NyeCounty=200to300documents,5%headeronlyentries 42
GeneralObjectiveofthePaper
- OutlinespossibleITsystemoptionsforthereplacement oftheoriginalLSN
- Eachoptiondiscussionincludes
- ITsystemimplementationcostestimate
- ITsystemimplementationtimeestimate
- ITsystemimplementationrisksandchallenges
- ITsystemimplementationpros/cons
- Costandtimeestimateswerebasedonavailable informationandintendedtoprovideacomparison betweenoptions 43
HighLevelOverview Option1-TraditionalDiscovery
- ExistingpublicADAMSLSNlibraryusedtoaccesspreviouslysubmitted documentarymaterial
- Newmaterialexchangedamongsttheparties Option2-UseofExistingPublicADAMSLSNLibrary
- UsesthealreadydevelopedexistingpublicADAMSLSNlibrary
- Intake/modificationprocesseswouldbedevelopedusingtheEIEora semiautomatedprocess fornewmaterial Option3-MovetotheCloud
- PreviouslysubmittedmaterialmovedfromtheexistingpublicADAMS LSNlibrarytoacloudbasedsystem
- Intake/modificationprocessmovedtoacloudbasedsystemfornew material Option4-RebuildtheOriginalLSN 44
HighLevelOverview,contd.
- AppendixAprovidesalistoforiginalLSNfunctional requirementsthat
- Couldntbemetbyoneormoreoftheoptions
- Wouldneedtobemodified
- AppendixAdoesnotincludeoriginalLSNfunctional requirementsthat
- ArenotITsystemrelated
- Arecurrentlyprovidedbyothersystems
- Havebeenovertakenbyevents
- AppendixBdescribestheriskfactorsthatwereconsidered foreachoption
- AppendixClistsproposednewfunctionalrequirements
- AppendixDisanoptionssummarytable 45
E-Filing and the Electronic Hearing Docket Russell Chazell Assistant for Rulemakings and Adjudications FACA Committee Management Officer Office of the Secretary LSN Advisory Review Panel Meeting
OfficeoftheSecretary(SECY)
- TheCommissionmandatedelectronicfilingin10 CFR2.1013.
- 10CFR2.1013(a)(2)mandatesthatSECYmanage theHighLevelWaste(HLW)docket.
- TofacilitateelectronicfilingofHLWdocuments,the ElectronicInformationExchange(EIE)and ElectronicHearingDocket(EHD)systemswere developedandimplemented.
- Thesesystemsarecurrentlyusedforsubmissionof adjudicatorydocuments.
47
EFilingandtheElectronicHearing Docket
- DocumentsarefiledusingtheNRCsElectronic InformationExchange(EIE)at
www.nrc.gov 49
EFilingandtheElectronicHearing Docket
- Adigitalcertificateisneededtoaccessthe application.
- Onecanbeobtainedat https://pki.nrc.gov/ecs/,thenclickonElectronic Submittals Adjudicatory 50
AdjudicatorySubmissions-ObtainaDigitalCertificate 51
ExternalCredentialService 52
ApplyNow 53
Level1Credentialing 54
DigitalCredentialRequest 55
AdjudicatorySubmissions 56
ElectronicInformationExchange 57
EIEAdjudicatoryMainPage 58
PublicSubmission 59
ProceedingSelection 60
ProceedingSelection,contd.
61
AdjudicatorySubmissionForm 62
EFilingandtheElectronicHearing Docket
- Adjudicatorydocumentsarehousedinthe ElectronicHearingDocket(EHD)
- TheEHDcanbeaccessedathttp://adams.nrc.gov/ehd/
- TheEHDcanalsobeaccessedfromthemain www.nrc.govwebpageunderNRCLibrary,then ElectronicHearingDocket,thenabout2/3oftheway downthepage,AccesstheElectronicHearingDocket
- DocumentarymaterialsarehousedintheLicensing SupportNetwork(LSN) 63
www.nrc.gov 64
AccesstheElectronicHearingDocket 65
ElectronicHearingDocket 66
EIE/EHDUsageGuidance
- TheAdjudicatorySubmissionsUser'sGuide describestheprocessforobtainingadigital certificateandusingEIEandEHD (seehttps://www.nrc.gov/sitehelp/e submittals/adjudicatoryeiesubmissionuserguide.pdf)
- TheoperatinghoursoftheEFilingHelpDeskare9AMto 6PM(Eastern)MondaythroughFriday(exceptfor Federalholidays).TheHelpDeskcanbereachedat866 6727640.
67
Contacts 68 Russell Chazell Brian Newell 301-415-7469 301-415-4659 russell.chazell@nrc.gov brian.newell@nrc.gov lsnarp@nrc.gov
ExhibitSubmissionGap AndyWelkie ITSpecialist AtomicSafetyandLicensingBoardPanel 69
ExhibitSubmission Background Exhibitsaredocumentsorobjectsofferedasevidencetosupportwrittenor oraltestimony 10C.F.R.§ 2.1001Definitions.
- LSNis...thecombinedsystemthatmakesdocumentarymaterialavailable electronicallytoparties...
- Electronicdocketis...theNRCinformationsystemthatreceives,distributes, stores,andretrievestheCommission'sadjudicatorydocketmaterials.(i.e.EIE andEHD) 10C.F.R.§ 2.1013Useoftheelectronicdocketduringtheproceeding.
- (b)Absentgoodcause,allexhibitstenderedduringthehearingmusthavebeen madeavailabletothepartiesinelectronicformbeforethecommencementof thatportionofthehearinginwhichtheexhibitwillbeoffered.
10C.F.R.§ 2.304Prefiledwrittentestimonyandexhibits.
- (g)...thewrittentestimonyofeachindividualwitnessorwitnesspanelandeach individualexhibitshallbesubmittedasanindividualelectronicfile.
70
ExhibitSubmissionGap
- Highpercentageofevidentiarymateriallikelyexistsin theLSNwithnoautomatedmechanismtosubmita documentasanexhibitdirectlyfromtheLSNtothe ElectronicHearingDocket
- Reentryofexistingbibliographicinformationwouldbe requiredresultinginhigherlaboreffortandpotential dataentryerrors
- Potentiallysignificantparticipantlaboreffortto downloaddocumentsfromtheLSNandsubmit throughtheElectronicInformationExchange 71
ProcesstoFileanLSNDocumentasanExhibit (IftheProceedinghadContinuedin2011) 1.
Findthedocument(s)intheLSN 2.
Downloadthedocument(s)andeither
- Usetheentiredocument
- Extractpartsofthedocument 3.
Placeanexhibitnumberoneachdocument 4.
LogintotheElectronicInformationExchange 5.
Filloutinformationregardingtheexhibit 6.
Submiteachexhibit(100MBaggregatefilesizelimitpersubmission) 7.
Receiveaconfirmationemailthatthesubmissionwassuccessful 8.
Addtheexhibit(s)toanexhibitlistandsubmittheexhibitslistper Boardinstructions 72
PotentialGapClosureProcesstoFileanLSNDocumentasanExhibit (IftheProceedingweretoResume) 1.
Findthedocument(s)inthereconstituted/replacementLSNsystem 2.
Addthedocument(s)toanexhibitcartbyatobedetermined selectionmethod 3.
Foreachdocumentlistedinthecart Specifyfulldocumentorspecificpages Provideanexhibitnumber 4.
Submittheexhibitcart(Eachexhibitwouldhaveasystemgeneratedcoversheet addedthatincludedpartyexhibitnumber,LSNaccessionnumber,title(fromLSNheader),etc.)
5.
Receiveaconfirmationemailthatthedocumentsinthecartwere submitted 6.
Downloadanexhibitlistbasedondocumentssubmittedfromthe exhibitcart 73
Limitations
- Onlyforpublicallyavailabledocuments containedinareconstituted/replacementLSN system
- Headeronlydocumentswouldbefiled separately(likelyasanonpublicexhibitor physicalexhibit)
- NonLSNdocumentswouldbefiledseparately (e.g.prefiledtestimonyorothernondiscovery material) 74
OptionsApplicability Apossiblecapabilityfor
- Option2 UseofExistingPublicADAMSLSNLibrary AlternativeOne EIESystemModification AlternativeTwo SemiManualProcess
- Option3 MovetotheCloud AlternativeOne NRCMaintainedCloudBasedSystem AlternativeTwo(a) HLWParticipantMaintainedCloudBasedSystemwithNRCMaintained SearchIndex
- Option4 RebuildtheOriginalLSN Unlikelyfor
- Option1 TraditionalDiscovery(unlessdecisionmadetoenhancethepublicADAMSLSN Library)
- Option3 MovetotheCloud AlternativeTwo(b)HLWParticipantMaintainedCloudBasedSystemwithParticipant MaintainedSearchIndex 75
ClarifyingQuestions I.
ClarifyingQuestionsfromLSNARPMembers 1.
LSNARPMembersintheRoom 2.
LSNARPMembersconnectedthroughGoToMeeting 3.
LSNARPMembersontheTelephone II. ClarifyingQuestionsfromMembersofthePublic 1.
MembersofthePublicintheRoom 2.
MembersofthePublicconnectedthroughGoToWebinar RaiseYourHand commentthroughaudio TypedQuestionstobereadbyFacilitator 3.
MembersofthePublicontheTelephone 76 I.
ClarifyingQuestionsfromLSNARPMembers 1.
LSNARPMembersintheRoom 2.
LSNARPMembersconnectedthroughGoToMeeting 3.
LSNARPMembersontheTelephone II. ClarifyingQuestionsfromMembersofthePublic 1.
MembersofthePublicintheRoom 2.
MembersofthePublicconnectedthroughGoToWebinar RaiseYourHand commentthroughaudio TypedQuestionstobereadbyFacilitator 3.
MembersofthePublicontheTelephone
LunchBreak Approximately12:45p.m.(EST) 77
Option1 TraditionalDiscovery PaulBollwerk,AdministrativeJudge AtomicSafetyandLicensingBoardPanel 78
=
Background===
- ForRestartedAdjudication,aPrincipalConcern WillBeEnsuringSuitableParticipantAccessto BothExistingandNewDocumentaryMaterial
- ToAddressThisConcern
- IsanEntirelyNewLSNlikeElectronicSystem NecessaryforAllMaterials
- or
- WillTraditionalDiscoveryMethodsBeSufficientfor NewDocumentaryMaterial?
79
TraditionalDiscoveryProcess(Background)
- 10C.F.R.§ 2.336DetailsDocumentDiscovery Procedures
- RequiresInitialandSubsequentPeriodicDocument Disclosures
- ParticipantsMustProvideaCopyorDescription,by CategoryandLocation,ofEachRelevantDocument
- GenerallyImplementedbyElectronicHearing DocketFilingofDocumentLists,withDocument DistributionGovernedbyParticipantestablished Protocols 80
OptionAssumptions
- HearingParticipantsWillHaveaSmallVolume ofNewDiscoveryMaterial
- NRCWillContinuetoMaintainthePublicLSN LibraryforExistingDocumentaryMaterial 81
GeneralDescription
- PublicLSNLibraryRemainsSourcefor DocumentaryMaterialIdentifiedPriorto AdjudicationsSuspension
- NewDocumentaryMaterialWouldBe Exchanged/MadeAvailabletoAdjudication ParticipantsViaTraditionalDiscoveryMethods 82
CostandTimeEstimate
- OptionDoesNotInvolveImplementationof NewInformationTechnologySystem,SoNo SignificantAdditionalImplementationTimeor CostIsRequired 83
ImplementationRiskFactorScore 84 Option RiskScore Range:(6 - 54)
Option1 TraditionalDiscovery NotApplicable RiskFactors:Acquisition,TechnicalComplexity,TechnicalObsolescence,ITPolicy, TechnicalExpertise,Standardization
Pros/Cons 85 Pros Cons Immediateimplementation Membersofthepublicmaynothaveaccessto newdocumentarymaterial No/lowimplementationcosts HLWhearingparticipantswouldberequiredto distributenewdocumentarymaterialtomultiple otherHLWhearingparticipants Anynewdocumentarymaterialwouldnotbe searchableelectronicallyusingacentralized searchsystem Newdocumentarymaterialwouldlacka consistent/uniformnumberingsystem Noabilitytomodifyordeleteexisting headers/documentscurrentlyavailable electronicallyinthePublicLSNLibrary
RankSummary 86 Option Cost Time Risk Pros/Cons Total Option1 TraditionalDiscovery 1
1 1
7 10 Option2 UseofExistingPublicADAMSLSN Library/AlternativeOne EIESystem Modification 4
4 2
1 11 Option2 UseofExistingPublicADAMSLSN Library/AlternativeTwo SemiManualProcess 3
3 2
2 10 Option3 MovetotheCloud/AlternativeOne NRCMaintainedCloudBasedSystem 5
5 4
6 20 Option3 MovetotheCloud/AlternativeTwo(a)
HLWParticipantMaintainedCloudBasedSystem withNRCMaintainedSearchIndex 5
6 7
4 22 Option3 MovetotheCloud/AlternativeTwo(b)
HLWParticipantMaintainedCloudBasedSystem withParticipantMaintainedSearchIndex 2
2 5
4 13 Option4 RebuildtheOriginalLSN 7
7 6
3 23
CommentandDiscussion I.
CommentsfromLSNARPMembers 1.
LSNARPMembersintheRoom 2.
LSNARPMembersconnectedthroughGoToMeeting 3.
LSNARPMembersontheTelephone II. CommentsfromMembersofthePublic 1.
MembersofthePublicintheRoom 2.
MembersofthePublicconnectedthroughGoToWebinar RaiseYourHand commentthroughaudio TypedQuestionstobereadbyFacilitator 3.
MembersofthePublicontheTelephone 87 I.
CommentsfromLSNARPMembers 1.
LSNARPMembersintheRoom 2.
LSNARPMembersconnectedthroughGoToMeeting 3.
LSNARPMembersontheTelephone II. CommentsfromMembersofthePublic 1.
MembersofthePublicintheRoom 2.
MembersofthePublicconnectedthroughGoToWebinar RaiseYourHand commentthroughaudio TypedQuestionstobereadbyFacilitator 3.
MembersofthePublicontheTelephone
Option2 UseofExistingPublicADAMSLSNLibrary KGGolshan,BranchChief OfficeoftheChiefInformationOfficer BusinessApplicationDeliveryBranch 88
OptionAssumptions
- ForAlternativeOne EIESystemModification
- Thetotalnumberofheader/documentactionswill averagemorethan1000permonthfortheduration oftheHLWproceeding
- NRCwillbethecustodianofalldiscovery documentsintheLSNforfederalrecord keepingpurposes 89
GeneralDescription
- TwoAlternatives
- AlternativeOne leveragestheEIESystem
- AlternativeTwo SemiManualProcess
- BothAlternatives
- UsetheexistingPublicADAMSLSNLibrary
- NosubstantivechangesmadetothePublicADAMS LSNLibrary
- Modificationsanddeletionsarereflectedinsystem generatedlistmadeavailableonthePublicADAMS LSNLibraryhomepage.
90
KeyDifferenceBetweenAlternatives
- AlternativeOne EIESystemModification
- Additions,deletionsandmodificationsareinitiated byusingtheEIEsystem
- AlternativeTwo SemiManualProcess
- Additions,deletionsandmodificationsareinitiated bythesubmissionofaCD/DVD 91
CostandTimeEstimate
- AlternativeOne EIESystemModification
- Costestimate
- Initialcost:
$900K $1,525K
- AnnualRecurringcost: $800K $1,500K
- Timeestimate: Between8and15months
- AlternativeTwo SemiManualProcess
- Costestimate
- Initialcost:
$600K $1,100K
- AnnualRecurringcost: $800K $1,500K
- Timeestimate: Between7and12months 92 CostRank:4 TimeRank:4 CostRank:3 TimeRank:3 CostRank:4 TimeRank:4
ImplementationRiskFactorScore 93 Option RiskScore Range:(6 - 54)
AlternativeOne EIESystemModification 15 AlternativeTwo SemiManualProcess 15 RiskfactorsAcquisition,TechnicalComplexity,TechnicalObsolescence,ITPolicy, TechnicalExpertise,Standardization
CommonPros/Cons 94 Pros Cons Relativelyquickimplementation Additionalcosts associatedwithfederalrecords responsibilityfornewheaders/documents Centralizesandasinglerepository NRCwillmaintainthecollections,butadditional stepsrequiredforparticipantstomakeadditions, deletionsand/or totheircollections LeveragesthecurrentNRCinvestments ContinuesstandardizationofLSNaccession numberingscheme RobustsearchenginebuiltonIBMWatson Automatedauditcapabilitiesavailableforthe entirecollection
UniquePros/Cons
- AlternativeOne EIESystemModification
- AlternativeTwo SemiManualProcess 95 Pros Cons Allowsforquickprocessingoflarge volumesofdocuments Aggregatesizeofallheaders/documentsina submissioncannotexceed100megabytes Pros Cons Nosubmissionsizerestrictions Partialmanualprocesswithpotential processingdelaysforlargevolumesof headers/documents
RankSummary 96 Option Cost Time Risk Pros/Cons Total Option1 TraditionalDiscovery 1
1 1
7 10 Option2 UseofExistingPublicADAMSLSN Library/AlternativeOne EIESystem Modification 4
4 2
1 11 Option2 UseofExistingPublicADAMSLSN Library/AlternativeTwo SemiManualProcess 3
3 2
2 10 Option3 MovetotheCloud/AlternativeOne NRCMaintainedCloudBasedSystem 5
5 4
6 20 Option3 MovetotheCloud/AlternativeTwo(a)
HLWParticipantMaintainedCloudBasedSystem withNRCMaintainedSearchIndex 5
6 7
4 22 Option3 MovetotheCloud/AlternativeTwo(b)
HLWParticipantMaintainedCloudBasedSystem withParticipantMaintainedSearchIndex 2
2 5
4 13 Option4 RebuildtheOriginalLSN 7
7 6
3 23
LicensingSupportNetwork AdvisoryReviewPanelMeeting StateofNevada ADAMSLSNProblemList LaurieBorski Paralegal EganFitzpatrickMalsch&LawrencePLLC Rockville,Maryland February27,2018
GeneralConcerns-1
- Toomanysignificanterrormessagesare encounteredforadatabasethatissoadvancedin development.
- LSNDRD2.1:Sitesmustbeprovisionedtobeable tosatisfynotlessthan500webpagerequestsper minute.DoestheADAMSLSNhavethis capability?
- Hasitbeentakenintoconsiderationthattheremay be>200usersonADAMSLSNatthesametimeand foranextendedperiodoftimeduringanyhearing?
2/27/2018 98
GeneralConcerns-2
- Nevadaaskedseveraldifferentpeopletoconduct specifictestsearchesonADAMSLSNandthesame problemsbecameevidenttoallsearchersatthe sametime.
- Quotationmarksmustbefreshlytypedinsearch boxesasthosecopiedandpastedaredisregarded.
- TheADAMSLSNfeelsveryclunkytotheenduser comparedtootherNRCand.gov websites,and litigationdatabases.
2/27/2018 99
GeneralConcerns-3
- Documentpreviewwindowsdonotalwayscontain aclosebuttontoallowuserstoclosethepreview window.
- Thecomputerproblemsexperiencedduringthe secondADAMSLSNwebinarwerereflectiveofuser experience.
- NRCdocumentsoccasionallydownloadwitha defaultnumberthatisnottheLSNNumberorthe ParticipantAccessionNumber(NRC000012598, ML012060483,downloadedas012060483).
2/27/2018 100
Speed
- SlowspeedisanissuewithADAMSLSN,butnotWebBased ADAMS.
- LSNDRD2.2:Sitesmustbeprovisionedtobeableto deliverawebpageorimagepageonaverageinnotmore thanfivesecondstoawebbrowserlocatedonthesame LAN(LocalAreaNetwork)segment.
- Mostbasicsearchestook1to4+minutestoreturnresults.
- Ittook>2minutestonarrowtheresultsofabasicsearch.
- Defaultsettingwasusedfornumberofentriesdisplayed.
- SearchesweregenerallyfastestwithLSN#.
- Oursearchesaremorebasic(broad)inordertodiscover whatisontheLSNversussimplylocatingaparticular document.
2/27/2018 101
Printingsearchresults
- Thereisnooneclickprintingofsearchresults.
- Thisisamajordatabasesoftwareerror.
- Oneclickprintingofsearchresultswasavailableon theLSN.net.
- LSNITsaidtheywillexploreitasafutureoption.
- Printoutsareusedtomemorializesearchresults andtomakedecisionsondownloadingorprinting documents.
- Printoutsarealsousedasexhibitsandevidenceby attorneysinadeposition,pleading,oratthe licensingproceedingtoillustratethenumberof documentsreturnedinaparticularLSNsearch.
2/27/2018 102
Userscannotcancelarequestinprogress
- Appliestosearchrequests,pagescrolling,and refiningsearches.
- ThisisanissuebecauseoftheADAMSLSNsslow speed;mostbasicsearchesandsomeadvanced searchestake1to4+minutestoperform.
- WebBasedADAMShastheabilitytocancela searchinprogressanditworkswell.
2/27/2018 103
Scrollingthroughpagesofsearchresults
- Ittook>10minutestoscrollthrough1,124search resultsat100resultsperpage.
- Scrollingthroughlargesearchresultsstopsat document3,000andtheremainingpagesdisplay asResults00of11,342withablankpageof searchresults;itmattersnotwhether25,50,or 100hitsperpagearedisplayed.
- Alltoooften,anattempttoscrollresultsin repeatederrormessages.
- Thereisnoabilitytopagejumpthroughsearch resultsbytypinginadesiredpagenumbertoview.
2/27/2018 104
Documentpreview
- DocumentscouldbepreviewedonLSN.netby clickingonthedocumenttitle.
- ThereisnopreviewofthePDFdocumentandno optiontoviewthePDFintheActiondropdown.
Clickingonthedocumenttitleismostlikelyto downloadthedocumentthantoviewit.
- AbilitytopreviewaPDFlistedinthesearchresults hasvariedbyuser,nottheinternetbrowserused.
- TheFile8viewofthedocumentistextonlyand notreliableenoughtousewhenconfirminga documentsearch.
2/27/2018 105
FacetChart FacetChart:
- HasthesameinformationastheFacetTree.
- MerelyvisualizessearchresultsshownintheFacetTree.
- Doesnotallowscrollingdowntoseetheentirelistingfora givenproperty.
- FacetChartisnotevenmentionedintheLSNQuickGuide.
- LSNUserGuidesaysthefacetchartallowsyoutovisualize howmanydocumentsareavailableasmeetingacertain criterion.
- FacetCharttakesuptoomuchrealestateonthescreen withoutprovidinganybenefit.
- TheFacetChartoftenlagsbehindthecurrentsearch, displayingtheresultsfromaprevioussearchifthenew searchreturnszerohits.
2/27/2018 106
FacetTreeandTimeSeries FacetTree:
- MoreFacetsdisplaysfor>15facetresults;smaller screendoesnotdisplayallsearchresultsandslider doesnotfullyoperatepastacertainpoint.
- LSN#sandParticipantAccession#slistedintheFacet Treearenotinthesameorderasdisplayedinthelistof documentsearchresults.
TimeSeries:
- HasthesameinformationastheFacetTree.
- MerelyvisualizessearchresultsshownintheFacet Tree.
- TimeSeriestakesuptoomuchrealestateonthescreen withoutprovidinganybenefit.
2/27/2018 107
Advancedsearch
- TheAdvancedSearchfeaturetakesupmostofthe screenanddoesnotretreatfromthescreenonce enterispressed,asinmostsearchsoftware.
- UsersmustmanuallyclickonHideAdvanced aftereverysearchormodificationinordertosee morethanonelineofthesearchresults.
- WhenchangingtheFieldQueryproperty,the previoussearchtermshoulddisappear,butinstead mustbemanuallydeletedeachtime.
2/27/2018 108
Documentdates-1
- UsersshouldbeawarethattheoriginalLSN databasecontainedmanydocumentdateerrors thatpropagatedtoADAMSLSNandcannotbe changed.
- Anadvancedsearchfordocumentsdated 01/01/190012/31/1901returns35,322documents datedbetween1899and1902.
- 11ofthosedocumentsaredated12/31/1899.
- >3,000ofthosedocumentsaredated12/31/1900
- Iwasunabletoscrollpastthe3,000thresultdue todatabaseerror.
2/27/2018 109
Documentdates-2
- Asearchfordocumentsdated12/31/1900returns zerodocuments.
- DN2001470545,ALH.20040511.1644displaysas havingadateof12/31/1900intheheader,butthe timeseriesbaronthebottomofthescreenshows adateof01/01/1901.
- 3documentsarereturnedbysearchingfordates between01/01/1902and12/31/1902;twoof thesedocumentsaredated12/31/1901 (HQZ.19870302.0500,ALK.20040511.7733);oneis dated09/01/1902(HQZ.19870227.2511).
2/27/2018 110
Relatedrecordsarelistedindocumentpropertiesbutarenot accessible
- DN2002041330,ALH.20040617.5604isalettertotheNRCSECY transmittingDOEscommentsonaproposedrulemakingandhas onelistedrelatedrecord,ALG.20040617.8674.Thecoverletter referencesEnclosure1,CommentsonProposedRevisionstothe 10CFRPart2Rule.SearchesfortheParticipantAccession Numberlistsonlyonedocument:DN2002041330.Searchonthe titleoftheenclosurereturnedzeroresults.
- ALA.20070712.1698hasonerelatedrecord,ALA.20070712.1697, whichinturnhasonerelatedrecord,ALA.20070712.1696.Able tolocateanddownloadthefirsttworecords,butsearchresults forthethirdrecordshowszerohits.Asearchusingthedocument dateofthefirsttwodocumentsyields469hits,noneofwhichis thedocument.HowshouldIsearchtolocatethethirdrelated recordiftheParticipantAccessionNumberisallIhave?Doesthis meantheLSNLibraryisincomplete?
- DN2002468468,ALA.20070829.0827has9relatedrecords, ALA.20070829.0828throughALA.20070829.0836.Abletolocate, verifyanddownload8ofthe9withALA.20070829.0829 thelone holdout.
2/27/2018 111
Documenttitlesearches
- BasicSearchforpresentationentitledLA DevelopmentApproach(ALC.20040610.8938) yieldedsixdocuments,noneofwhichwasthe correctdocument;thedocumentsLSNtitleis:LA DEVELOPMENTAPPROACH;LAApproach 0606b.pptsowhydidthisnotpopupduringthe initialsearch?
- SearchforTechnicalGuidanceforLicense ApplicationPlanning(PlanB:ComplianceFocused Program)gotzeroresults.NextsearchforPlanB:
ComplianceFocusedProgramgotzeroresults.
ThirdsearchforTechnicalGuidanceforLicense ApplicationPlanninggot58results,including13 directhits.
2/27/2018 112
Searches-1
- IfadocumentisnotbeingreturnedinasearchbyParticipant AccessionNumber,andthatistheonlyinformationonehas,then howisthatdocumenttobefound?
- AdvancedSearchforknownDOEdocumentCCU.20071009.0009 (DN2002493055)byParticipantAccessionNumberreturnedone result,whichisthecorrectdocument(CCU.20071009.0009, DN2002493055);BasicSearchonthePA#inquotesreturned8 documents,oneisthecorrectdocument,andanotherhasthe PA#searchedonlistedasadocumentnumber.
- BasicSearchbytitleofaknownCNWRApaperSupplemental EvaluationofGeophysicalInformationUsedtoDetectand CharacterizeBuriedVolcanicFeaturesintheYuccaMountain Regionyieldedsevenresults,threeofwhicharethecorrectNRC documents(ML072290569,ML072290572,andML072290575);
theotherfourlistingsdonothaveanywordshighlightedinthe searchresultsandwouldhavetobedownloadedandsearchedto determineiftheyarerelevant.
2/27/2018 113
Searches-2
- AdvancedsearchforaDOEdocumentwithtitlecontainingthe wordsTDMS_Master_32807(whichwastheentiretitleonthe oldLSN.net)returnedonedocument(DN2002388002, ALA.20070530.0734)whichisnowentitledCONCEPTOF OPERATIONSFORTHEYUCCAMOUNTAINPROJECTTECHNICAL DATAMANAGEMENTSYSTEMVERSION1.0MARCH31,2007; TDMS_Master_32807;theabbreviatedtitleontheLSN.netwas usedasanexhibitin2007;thedocumentprofiledoesnot indicatethedocumenttitlewaschangedfromtheoriginal LSN.netentry.
- AdvancedSearchforMOL.20070829.0046byParticipant AccessionNumberreturnedonehit;aBasicSearchfor MOL.20070829.0046returnedtwohitsandtook4+minutesto perform;AdvancedSearchforMOL.20070829.0046byTheexact phrasereturnedtwohits-andtook4+minutestoperform.If oneisattemptingtoperformathoroughsearch(asforall versionsofadocumenttoincludethosewithmarginalia)isthere amoreefficientwaytoperformthissearch?
2/27/2018 114
HelpDesk
- WilltherebeaHelpDeskfortheLSNinarestarted proceedingthatissimilartotheDDMS/EHD/EIEHelp Deskthatexistedduringtheoriginalproceeding?That HelpDeskwasresponsiveandhelpful.
- IftherearenoplanstoincludearobustHelpDesk,then duringahearingattheLasVegasfacilityinarestarted proceeding,userstherewouldnothaveaccesstolive ITassistancebeginningat1:00p.m.localtime.
- Atpresent,theonlywaytoreportLSNerrorsisbygoing tothePDRLibrarian,whothenrelaystheinformation totheLSNITtechnician.Responsetimesarenot usuallysameday,andiftheissueisoneinwhich additionalinformationhasbeenrequestedfromthe user,thereisnofeedbackunlesstheuserspecifically followsuptorequestit.
2/27/2018 115
HelpDeskExperiences-1
- AfterconductinganumberofsearchesontheADAMSLSN,I receivedanoticethatmysessionhadexpired,andthena loginscreenwasdisplayed.Allfunctionswereblockedand theonlyremedywastoexitthebrowserandstartagain; errorreported;afewhourslater,Iwasadvisedthatthe problemwascleared.
- Onanotheroccasion,Iwascaughtinaloopbetween preparingdesktopandtheWelcometoADAMSPublic LSNSearchpage;errorreported;twohourslater,Iwastold toretryaccess.
- Afterconductingasearchfordocuments,IdiscoveredthatI couldnotprintthesearchresultsusingnormalmethodsand requestedassistance.Oneweeklaterrequestedfollowup; theLSNITresponse:willexploreitasafutureoption.A cutandpasteworkaroundwasprovidedtwoweekslaterto thepublicviaupdatedLSNFAQs,andthenthefollowingday wasprovidedtomeviaemail.Workaroundisnot satisfactory.
2/27/2018 116
HelpDeskExperiences-2
- Receivedanerrormessagewhenattemptingtodisplay100search resultsperpageinalargenumberofsearchresults;LSNITconfirmed theywereabletoreplicatetheerror,wereactivelylookingintothe causeoftheerrormessageandsuggestedthatInarrow[my]search resultsbyfilteringoninformationsourcebecausetheadditional filteringcriteriaenablesthesearchenginetomoreefficientlymanage thesearchresults,thusreducingthelikelihoodofgeneratingtheerror messageyoureceived.
- Receivedanerrormessagewhenattemptingtonarrowtheresultsby year,andreceivedanothererrormessagewhenreportingtoPDRvia emailform;PDRadvisedtheywereexperiencingintermittentoutages; twoweeksaftermyreport,theLSNITtechnicianrespondedthatthey werenotabletorecreatetheerror,andthattheNRCnetworkwasnot experiencinganynetworkconnectivityissuesatthetimeofmyreport.
- Thepriorthreereportsweresubmittedondifferentdatesbutthe responsesfromtheLSNITwereallsenttomeonthesameday;are responsestouserssentinbatches,and/oristheLSNITonlyonduty everyotherFriday?
2/27/2018 117
StateofNevadaLSNLibrary ProblemsList KGGolshan TomWellock
ConcernsBeingAddressed
- ErrorMessages
- Returnsgreaterthan3000results.
- DatesandTimeZones 2/27/2018 119
ConcernsThatMaybeAddressed
- IncreasedComputingPower
- SiteTraffic
- Speed
- Scrolling
- PageJumping
- CancelingaSearch
- Previewinginpdf
- PrintingSearchResults
- Indexenhancement 2/27/2018 120
HelpDesk Iftheadjudicationisrestartedandthe LSN(orafunctionalequivalent)is reinstated,thenaHelpDeskwillbe establishedtosupportsystemusers.
2/27/2018 121
WorkingwiththeExistingSystem
- PreviewMode(textversion)
- CloseButton
- Avoiddocumentdownloads
- Documentnumbersandpdf nameschosenby participants
- FacetTree,Chart,andTimeSeries
- Adjustwindowsorminimize
- AdvancedSearches:FieldQueryterms 2/27/2018 122
SpecificSearchConcerns
- DocumentDates:TimeZones
- AccessingRelatedRecords
- Converttitlesearchtobasicsearch
- Relatedrecordnumberssuppliedbyparticipants 2/27/2018 123
Break (EnterTime) 124
CommentandDiscussion I.
CommentsfromLSNARPMembers 1.
LSNARPMembersintheRoom 2.
LSNARPMembersconnectedthroughGoToMeeting 3.
LSNARPMembersontheTelephone II. CommentsfromMembersofthePublic 1.
MembersofthePublicintheRoom 2.
MembersofthePublicconnectedthroughGoToWebinar RaiseYourHand commentthroughaudio TypedQuestionstobereadbyFacilitator 3.
MembersofthePublicontheTelephone 125 I.
CommentsfromLSNARPMembers 1.
LSNARPMembersintheRoom 2.
LSNARPMembersconnectedthroughGoToMeeting 3.
LSNARPMembersontheTelephone II. CommentsfromMembersofthePublic 1.
MembersofthePublicintheRoom 2.
MembersofthePublicconnectedthroughGoToWebinar RaiseYourHand commentthroughaudio TypedQuestionstobereadbyFacilitator 3.
MembersofthePublicontheTelephone
DayOneWrapUp 126
Break (EnterTime)
OptionalADAMSLSNLibrary OrientationtoFollowBreak 127
LicensingSupportNetwork AdvisoryReviewPanelMeeting February27 28,2018 128
Agenda February27,2018
Introductions
MeetingProcess&Overview Break StatusofYuccaMountainAdjudicatory Process HistoryoftheLSNandIntroductionofLSN Reconstitution/ReplacementOptionsPaper StatusofEIE/EHDandExhibitSubmission Gap Lunch Option1,TraditionalDiscovery Option2,NRCADAMSLSNLibrary Break WrapUp Break ADAMSLSNLibraryOrientation February28,2018 RecapofDayOne RecapofMeetingProcess Option3,MovetotheCloud Lunch Option4,RebuildtheOriginalLSN Break Replacement/ReconstitutedLSNOptions Summary CommentandDiscussiononAllOptions MemberViewsonOptions WrapUp/PathForward 129
RecapofDayOne 130
RecapofMeetingProcess 131
CommentandDiscussion I.
CommentsfromLSNARPMembers 1.
LSNARPMembersintheRoom 2.
LSNARPMembersconnectedthroughGoToMeeting 3.
LSNARPMembersontheTelephone II. CommentsfromMembersofthePublic 1.
MembersofthePublicintheRoom 2.
MembersofthePublicconnectedthroughGoToWebinar RaiseYourHand commentthroughaudio TypedQuestionstobereadbyFacilitator 3.
MembersofthePublicontheTelephone 132 I.
CommentsfromLSNARPMembers 1.
LSNARPMembersintheRoom 2.
LSNARPMembersconnectedthroughGoToMeeting 3.
LSNARPMembersontheTelephone II. CommentsfromMembersofthePublic 1.
MembersofthePublicintheRoom 2.
MembersofthePublicconnectedthroughGoToWebinar RaiseYourHand commentthroughaudio TypedQuestionstobereadbyFacilitator 3.
MembersofthePublicontheTelephone
GoToMeeting LSNARPMemberParticipation 133
GoToMeeting-AudioMute/UnMute
- Selfmuteyouraudio byclickingonthe microphoneicon
- Unmuteyouraudio whenyouarecalled
- Pauseamomentbefore speakingasthereisa briefdelaywhenaudio isunmuted 134
GoToMeeting-Chat
- Ifyoudonothaveaweb cameraorneedto communicatewiththeITstaff, pleaseusethechatfeature
- Besuretosendchatrequests toOrganizer(s)Only 135
GoToWebinar PublicParticipationOptions 136
GoToWebinar ControlPanel
- OpentheGotoWebinar ControlPanelbyclickingonthe Orangearrow
- TheOrangearrowcantypicallybefoundintheupper rightareaofyourcomputerscreen 137
VerbalQuestion
- Ifyouareusingyourcomputeraudio andhaveamicrophoneorareusing theGoToWebinar providedphone number,youcanaskaquestion verbally
- FromtheGoToWebinar toolbar,click onRaiseYourHand
- ThehandwilldisplayanUpArrow
- Whenitistimeforpubliccomments andyouhaveRaisedyourhand, youraudioconnectionwillbe unmuted 138
TypedQuestion 139 OpentheQuestionspanel
- (###)#######
- (###)#######
TypeinyourquestionandpressSend iOS,Android,etc.displayaQuestionMark
Option3 MovetotheCloud KGGolshan,BranchChief OfficeoftheChiefInformationOfficer BusinessApplicationDeliveryBranch
OptionAssumptions
- NRCwilldecommissionPublicADAMSLSNLibrary
- CurrentcopiesofpublicLSNrecordswillremainin possessionofNRCforFederalrecordskeepingpurposes
- Anycloudbasedsolutionprovidermustfollowthe guidelinessetbyFederalRiskandAuthorization ManagementProgramandshallbe(FEDRamp) certified.
141
GeneralDescription
- TwoAlternatives
- AlternativeOne NRCMaintainedCloudBasedSystem
- AlternativeTwo HLWParticipantMaintainedCloud BasedSystem a)
NRCProvidedSearchPortal b)
NRCMaintainedWebPageofParticipantLinks BothAlternatives
- Movetheheaders/documentsfromthePublicADAMS LSNLibrarytocloudbasedstorage
- Indexing,searching,andretrievalsystemsarecloud based 142
KeyDifferencesBetweenAlternatives
- AlternativeOne-NRCMaintainedCloudBasedSystem
- NRCmanagescloudbasedrepository
- Theprocessesforadditions,modifications,anddeletions describedinOption2(UseoftheExistingLSNLibrary)
- AlternativeTwo HLWParticipantMaintainedCloudBased StorageorSystem a)
NRCProvidedSearchPortal
- Participantsmanagetheirowncloudbasedrepository/collection
- NRCmanagesacentralizedsearchengine(similartooriginalLSN)
- Participantsmanageprocessforadditions,modifications,anddeletions b)
NRCMaintainedWebPageofParticipantLinks
- Participantsmanagetheirowncloudbasedrepository
- Nocentralizedsearchengine
- Participantsmanageprocessforadditions,modifications,anddeletions 143
CostandTimeEstimate
- AlternativeOne-NRCMaintainedCloudBased System
- Costestimate(SystemDevelopment)
- Initialcost:
$1,200K $1,950K
- AnnualRecurringcost: $1,100K $1,750K
- Timeestimate:
Between22and38months 144 CostRank:5 TimeRank:5
CostandTimeEstimate,contd
- AlternativeTwo HLWParticipantMaintainedCloudBased System a)
NRCProvidedSearchPortal SystemDevelopment(NRCSearchPortal)
Initialcost:
$1,200K $2,000K AnnualRecurringcost:
$600K $1,100K Timeestimate:
Between24an42months NRCStaffCollection(asaParticipant)
Initialcost:
$350K $600K AnnualRecurringcost:
$525K $900K Timeestimate:
Between16and28months NonNRCStaffHLWParticipantCollections Initialcost:
Undetermined AnnualRecurringcost: Undetermined Timeestimate:
Undetermined 145 Timeestimatesareundetermined aseachparticipantmayhave differentITpoliciesinplaceforthe procurementandimplementation ofanITsolution CostRank:5 TimeRank:6
CostandTimeEstimate,contd
- AlternativeTwo HLWParticipantMaintainedCloudBased System b)
NRCMaintainedWebPageofParticipantLinks SystemDevelopment(NRCLinkPage)
Initialcost:
$400K $675K AnnualRecurringcost:
$250K $425K Timeestimate:
Between4and7months NRCStaffCollection(asaParticipant)
Initialcost:
$350K $600K AnnualRecurringcost:
$525K $900K Timeestimate:
Between16and28months NonNRCStaffHLWParticipantCollections Initialcost:
Undetermined AnnualRecurringcost: Undetermined Timeestimate:
Undetermined 146 Timeestimatesareundetermined aseachparticipantmayhave differentITpoliciesinplaceforthe procurementandimplementation ofanITsolution CostRank:2 TimeRank:2
ImplementationRiskFactorScore 147 Option RiskScore (Range:6 - 54)
AlternativeOne NRCMaintainedCloudBasedSystem 23 AlternativeTwo(a) HLWParticipantMaintainedCloud BasedSystemwithNRCProvidedSearchPortal 29 AlternativeTwo(b) HLWParticipantMaintainedCloud BasedSystemwithNRCMaintainedWebPageof ParticipantLinks 29 RiskfactorsAcquisition,TechnicalComplexity,TechnicalObsolescence,ITPolicy, TechnicalExpertise,Standardization
CommonPros/Cons 148 Pros Cons Leveragescurrentefficiencyandscalabilityof cloud Closecoordinationwithallpartiesmaybetime consuming.
TakesadvantageofexistingInternetsearchand othercloudresources Allowsforpromptprocessingoflargevolumesof documents
UniquePros/Cons
- AlternativeOne NRCMaintainedCloudBasedSystem 149 Pros Cons ContinuesstandardizationofLSNaccession numberingscheme Complexityofimplementation Locatesdocumentarymaterialinasingle repository Costofdevelopingcentralizedcloudbased searchportal Automatedauditcapabilitiesavailableforthe entirecollection Additionalcostsassociatedwithfederalrecords responsibilityfornewheaders/documents Rudimentarysearchcapability,dependingonthe cloud offering Documentheaderinformationmay notbe viewable Partiesarerequiredtokeeptheircollectionsup todate inthecloud
UniquePros/Cons,contd
- AlternativeTwo(a) HLWParticipantMaintained CloudBasedSystemwithNRCProvidedSearchPortal 150 Pros Cons MimicsoriginalLSNconceptandintentas decentralized,includingcostsharedbyparties Complexityanduncertaintyofimplementation ContinuesstandardizationofLSNaccession numberingscheme Rudimentarysearchcapability NoNRCrecordsresponsibilityfornew headers/documents Documentheaderinformationmay notbe viewable Possiblyasimplerprocessforaparticipantto makeadditions,modifications,ordeletionstoits collection Noautomatedauditcapabilitiesfortheentire collection
UniquePros/Cons,contd
- AlternativeTwo(b) HLWParticipantMaintained CloudBasedSystemwithNRCMaintainedWebPage ofParticipantLinks 151 Pros Cons Simplifiedapproachtomaintenanceof header/documentcollections Noconsolidatedsearchcapability NoNRCrecordsresponsibilityfornew headers/documents Documentheaderinformationmaynotbe viewable Simplerprocessforaparticipanttomake additions,modifications,ordeletionstoits collection NostandardizationofLSNaccessionnumbering scheme Noautomatedauditcapabilitiesfortheentire collection
RankSummary 152 Option Cost Time Risk Pros/Cons Total Option1 TraditionalDiscovery 1
1 1
7 10 Option2 UseofExistingPublicADAMSLSN Library/AlternativeOne EIESystemModification 4
4 2
1 11 Option2 UseofExistingPublicADAMSLSN Library/AlternativeTwo SemiManualProcess 3
3 2
2 10 Option3 MovetotheCloud/AlternativeOne NRCMaintainedCloudBasedSystem 5
5 4
6 20 Option3 MovetotheCloud/AlternativeTwo(a)
HLWParticipantMaintainedCloudBasedSystem withNRCMaintainedSearchIndex 5
6 7
4 22 Option3 MovetotheCloud/AlternativeTwo(b)
HLWParticipantMaintainedCloudBasedSystem withParticipantMaintainedSearchIndex 2
2 5
4 13 Option4 RebuildtheOriginalLSN 7
7 6
3 23
CommentandDiscussion I.
CommentsfromLSNARPMembers 1.
LSNARPMembersintheRoom 2.
LSNARPMembersconnectedthroughGoToMeeting 3.
LSNARPMembersontheTelephone II. CommentsfromMembersofthePublic 1.
MembersofthePublicintheRoom 2.
MembersofthePublicconnectedthroughGoToWebinar RaiseYourHand commentthroughaudio TypedQuestionstobereadbyFacilitator 3.
MembersofthePublicontheTelephone 153 I.
CommentsfromLSNARPMembers 1.
LSNARPMembersintheRoom 2.
LSNARPMembersconnectedthroughGoToMeeting 3.
LSNARPMembersontheTelephone II. CommentsfromMembersofthePublic 1.
MembersofthePublicintheRoom 2.
MembersofthePublicconnectedthroughGoToWebinar RaiseYourHand commentthroughaudio TypedQuestionstobereadbyFacilitator 3.
MembersofthePublicontheTelephone
LunchBreakUntil1:30p.m.(EST) 154
Option4 RebuildtheOriginalLSN MargieJanney ActingLSNAdministrator
Assumptions
- BasisfordevelopmentisProjectDefinitionand AnalysisDocumentfortheLSN
- ParticipantwebsiteswillbecrawledbytheLSN
- NRCwilldecommissionADAMSLSNLibrary
- Copiesofthoserecordswillremaininpossessionof NRCforFederalrecordsmanagementpurposes 156
GeneralDescription
- DistributedsystemlikeGoogle
- 3majorfunctions:
- Auditing
- Indexing
- Searching&retrieving
- 5majorsubsystems
- Fetchparticipantdocumentsandheaders
- Auditparticipantsites
- SearchLSNcontent
- AdministerLSN
- AccessLSNwebsite 157
GeneralDepiction 158
SearchandRetrieval
- NRCprovidessearchinterface
- SearchesNRCmaintainedindexofparticipants headersdocuments
- Searchinterfaceredirectsusertothe participantscollectiontopresentthe documentforviewing.
159
CostandTimeEstimates
- RebuildtheOriginalLSN
- SystemDevelopment
- Initialcost:Between$2,600K $4,400K
- Recurringcost:Between$850K $1,500K
- Timeestimate:Between30and42months
- EachHLWParticipantCollection(IncludingtheNRC Staff)
- Initialcost:Undetermined
- Recurringcost:Undetermined
- Timeestimate:Undetermined 160
ImplementationRiskFactorScore 161 Option RiskScore Range:(6 - 54)
Option4 RebuildtheOriginalLSN 31 RiskFactors:Acquisition,TechnicalComplexity,TechnicalObsolescence,ITPolicy, TechnicalExpertise,Standardization
ImplementationRiskFactorScore RiskFactor Impacton Option Likelihoodof Occurrence RiskScores (ImpactxLikelihood)
Acquisition High(3)
High(3) 9 TechnicalComplexity Moderate(2)
Moderate(2) 4 TechnicalObsolescence Moderate(2)
Moderate(2) 4 ITPolicy High(3)
High(3) 9 TechnicalExpertise Moderate(2)
Moderate(2) 4 Standardization Low(1)
Low(1) 1 TotalScore 31 162
Pros/Cons g
Pros Cons Simplerprocessforaparticipantto makeadditions,modifications,or deletionstoitscollection Extendedimplementation ContinuesstandardizationofLSN accessionnumberingscheme Highcost Robustsearchengine ConflictswithFederalITpolicy Allowsforpromptprocessingoflarge volumesofdocuments 163
RankSummary 164 Option Cost Time Risk Pros/Cons Total Option1 TraditionalDiscovery 1
1 1
7 10 Option2 UseofExistingPublicADAMSLSN Library/AlternativeOne EIESystem Modification 4
4 2
1 11 Option2 UseofExistingPublicADAMSLSN Library/AlternativeTwo SemiManualProcess 3
3 2
2 10 Option3 MovetotheCloud/AlternativeOne NRCMaintainedCloudBasedSystem 5
5 4
6 20 Option3 MovetotheCloud/AlternativeTwo(a)
HLWParticipantMaintainedCloudBasedSystem withNRCMaintainedSearchIndex 5
6 7
4 22 Option3 MovetotheCloud/AlternativeTwo(b)
HLWParticipantMaintainedCloudBasedSystem withParticipantMaintainedSearchIndex 2
2 5
4 13 Option4 RebuildtheOriginalLSN 7
7 6
3 23
CommentandDiscussion I.
CommentsfromLSNARPMembers 1.
LSNARPMembersintheRoom 2.
LSNARPMembersconnectedthroughGoToMeeting 3.
LSNARPMembersontheTelephone II. CommentsfromMembersofthePublic 1.
MembersofthePublicintheRoom 2.
MembersofthePublicconnectedthroughGoToWebinar RaiseYourHand commentthroughaudio TypedQuestionstobereadbyFacilitator 3.
MembersofthePublicontheTelephone 165 I.
CommentsfromLSNARPMembers 1.
LSNARPMembersintheRoom 2.
LSNARPMembersconnectedthroughGoToMeeting 3.
LSNARPMembersontheTelephone II. CommentsfromMembersofthePublic 1.
MembersofthePublicintheRoom 2.
MembersofthePublicconnectedthroughGoToWebinar RaiseYourHand commentthroughaudio TypedQuestionstobereadbyFacilitator 3.
MembersofthePublicontheTelephone
Replacement/ReconstitutedLSN OptionsSummary MargieJanney ActingLSNAdministrator 166
Recap HighLevelOverview Option1-TraditionalDiscovery
- ExistingpublicADAMSLSNlibraryusedtoaccesspreviouslysubmitted documentarymaterial
- Newmaterialexchangedamongthepartiesusingtraditionaldiscovery methods Option2-UseofExistingPublicADAMSLSNLibrary
- UsesthealreadydevelopedexistingpublicADAMSLSNlibrary
- Intake/modificationprocesseswouldbedevelopedusingtheEIEorasemi manualprocess Option3-MovetotheCloud
- PreviouslysubmittedmaterialmovedfromtheexistingpublicADAMSLSN librarytoacloudbasedsystem
- Intake/modificationprocessmovedtoacloudbasedsystemfornewmaterial Option4-RebuildtheOriginalLSN 167
CostEstimate Comparison 168 Option Rank System Development NRCStaff (asaparticipant)
NonNRCStaff Participant Initial Annual Recurring Initial Annual Recurring Initial Annual Recurring Option1 TraditionalDiscovery 1
N/A*
N/A N/A N/A N/A N/A Option2 UseofExistingPublicADAMSLSNLibrary AlternativeOne EIESystemModification 4
$900K
$1,525K
$800K
$1,500K N/A N/A N/A N/A Option2 UseofExistingPublicADAMSLSNLibrary AlternativeTwo SemiManualProcess 3
$600K
$1,100K
$800K
$1,500K N/A N/A N/A N/A Option3 MovetotheCloud AlternativeOne NRCMaintainedCloudBased System 5
$1,200K
$1,950K
$1,100K
$1,750K N/A N/A N/A N/A Option3 MovetotheCloud AlternativeTwo(a) HLWParticipantMaintained CloudBasedSystemwithNRCMaintainedSearch Index 5
$1,200K
$2,000K
$600K
$1,100K
$350K
$600K
$525K
$900K Unknown Unknown Option3 MovetotheCloud AlternativeTwo(b)HLWParticipantMaintained CloudBasedSystemwithParticipantMaintained SearchIndex 2
$400K
$675K
$250K
$425K
$350K
$600K
$525K
$900K Unknown Unknown Option4 RebuildtheOriginalLSN 7
$2,600K
$4,400K
$850K
$1,500K Unknown Unknown Unknown Unknown
- N/AindicatestherearenoapplicableITSystemdevelopment,implementation,ormaintenancecosts.
TimeEstimate Comparison 169 Option Rank System Development NRCStaff (asaparticipant)
NonNRCStaff Participant Option1 TraditionalDiscovery 1
N/A N/A N/A Option2 UseofExistingPublicADAMSLSNLibrary AlternativeOne EIESystemModification 4
8Monthsto 15Months N/A N/A Option2 UseofExistingPublicADAMSLSNLibrary AlternativeTwo SemiManualProcess 3
7Monthsto 12Months N/A N/A Option3 MovetotheCloud AlternativeOne NRCMaintainedCloudBasedSystem 5
22Monthsto 38Months N/A N/A Option3 MovetotheCloud AlternativeTwo(a) HLWParticipantMaintained CloudBasedSystemwithNRCMaintainedSearchIndex 6
24Monthsto 42Months 16Monthsto 28Months Undetermined Option3 MovetotheCloud AlternativeTwo(b)HLWParticipantMaintained CloudBasedSystemwithParticipantMaintained SearchIndex 2
4Monthsto 7Months 16Monthsto 28Months Undetermined Option4 RebuildtheOriginalLSN 7
30Monthsto 52Months Undetermined Undetermined
- N/AindicatesthereistimerequiredforITSystemdevelopment, implementation,ormaintenance.
RiskScore Comparison 170 Option Rank RiskScore (ImpactxLikelihood)
Option1 TraditionalDiscovery 1
NotApplicable Option2 UseofExistingPublicADAMSLSNLibraryAlternative One EIESystemModification 2
15 Option2 UseofExistingPublicADAMSLSNLibraryAlternative Two SemiManualProcess 2
15 Option3 MovetotheCloud AlternativeOne NRCMaintainedCloudBasedSystem 4
23 Option3 MovetotheCloud AlternativeTwo(a) HLWParticipantMaintainedCloudBased SystemwithNRCMaintainedSearchIndex 7
37 Option3 MovetotheCloud AlternativeTwo(b)HLWParticipantMaintainedCloudBased SystemwithParticipantMaintainedSearchIndex 5
29 Option4 RebuildtheOriginalLSN 6
31
Pros/Cons Comparison 171 Option Rank Pros/Cons*
Option1 TraditionalDiscovery 7
3 Option2 UseofExistingPublicADAMSLSNLibrary AlternativeOne EIESystemModification 1
4 Option2 UseofExistingPublicADAMSLSNLibrary AlternativeTwo SemiManualProcess 2
3 Option3 MovetotheCloud AlternativeOne NRCMaintainedCloudBasedSystem 6
0 Option3 MovetotheCloud AlternativeTwo(a) HLWParticipantMaintainedCloudBased SystemwithNRCMaintainedSearchIndex 4
2 Option3 MovetotheCloud AlternativeTwo(b)HLWParticipantMaintainedCloudBased SystemwithParticipantMaintainedSearchIndex 4
2 Option4 RebuildtheOriginalLSN 3
1
- Numeric score for system benefit determined by subtracting the number of Cons from the number of Pros.
RankSummary 172 Option Cost Time Risk Pros/Cons Total Option1 TraditionalDiscovery 1
1 1
7 10 Option2 UseofExistingPublicADAMSLSN Library/AlternativeOne EIESystem Modification 4
4 2
1 11 Option2 UseofExistingPublicADAMSLSN Library/AlternativeTwo SemiManualProcess 3
3 2
2 10 Option3 MovetotheCloud/AlternativeOne NRCMaintainedCloudBasedSystem 5
5 4
6 20 Option3 MovetotheCloud/AlternativeTwo(a)
HLWParticipantMaintainedCloudBasedSystem withNRCMaintainedSearchIndex 5
6 7
4 22 Option3 MovetotheCloud/AlternativeTwo(b)
HLWParticipantMaintainedCloudBasedSystem withParticipantMaintainedSearchIndex 2
2 5
4 13 Option4 RebuildtheOriginalLSN 7
7 6
3 23
MemberViewsOnOptions 173
MeetingWrapUp and PathForward 174