ML21211A578
| ML21211A578 | |
| Person / Time | |
|---|---|
| Issue date: | 07/30/2021 |
| From: | Maurin Scheetz NRC/NRR/DRO/IOLB |
| To: | |
| Scheetz M | |
| References | |
| Download: ML21211A578 (50) | |
Text
Number Section Comment Description Recommendation NRC Disposition 1
ES1.1page1 (line18)
Howareproceduresandguidance differentiatedwithinthestandard?Howis eachidentified?
Provideclarification,ifnecessary, onthedifferencebetween proceduresandguidance.
Addedclarification:Proceduresandguidance arenormallyidentifiedintheintroductory paragraphoridentifiedinthesectionor subsectiontitles.ThiswasaddedtoES1.1,C.
2 ES1.2step3, page1of6 (line4146)
Missingstatement"andthelicenseeshallfirst notifytheNRCsregionalofficetoensurethat apointofcontactremainsavailabletorespond toquestions."Iscontactnolongerrequiredor notallowed?
ConfirmifNRCcontactisrequired duringwrittenexamandensureit isaddedbackinthesectionifso intended.
Nochangerequired.TheNRCpointofcontactis stillnecessaryiftheNRCisnotonsiteduring thewrittenexamination.SeeES4.3forWritten ExaminationAdministration.
3 ES1.2step4, page2of6 (line1012)
Indicatesthatapplicantstablets,cellphones orothercommunicationdevicesarenot allowedintotheexaminationroomforthe writtenexam.Thereisnocorresponding statementaboutthemnotbeingallowed duringtheoperatingtest.
Addsimilarwordingtothe operatingtestsectioniftheyare notallowedoraddastatement thattheycannotbeusedifthatis theintent.Anotheroptionwould betoplacethestatementinthe overallsectioncoveringallaspects oftheexam.
AddedanitemtotheOperatingTestGuidelines inES1.2:Applicantsshallnotusepersonalcell phonesorelectronicdevicesduringthe operatingtest.
4 ES1.2step7, page2of6 (line30)
States;Notethatanswerstoquestionsyou askedduringtheexaminationaredocumented andtakenintoconsiderationduringthe gradingprocess.
Toimproveclarityandintend,ensurethat questionsaskedandanswersprovidedwillbe documented.
Considermodifyingthestatement toincludequestionsandanswers willbedocumented.
Addedtothesamesentencethatquestionswill alsobedocumented.
NUREG-1021 Revision 12 Public Comments Section1,General
5 ES1.2,step 10,page4of6 (lines3435)
Thefollowingstatementwasremoved:Many ofthequestionswillrequireyoutouseplant referencematerial,whileothersshouldbe answeredwithouttheuseofreferences.Ifyou needtoconsultareferencetoanswera question,asktheexaminerifitisacceptableto doso.Shouldthatguidancebeaddedback forclarity?
AddstatementbackinfromRev.
11iftheintentisstillforapplicants torequestpermissiontousea reference.
Nochangemadebecausethisstatement appearsintheES1.2SectionC,"General OperatingTestGuidelines,"asNo.3.Thistype ofinformationwasrelocatedtothesubsection aspartofthestreamlineeffort.
6 ES1.2B.2, Page1of6 (line3439)
ThisstatementwasdeletedfromR12ES1.2 B.2(R11AppendixEB.2):SROUapplicants whodotaketheROportionoftheexamand scorebelow80percentonthatpartofthe examcanstillpassoverallbutmayrequire remediation.
DoesthischangeimplythatanSROUwho takestheROportionoftheexaminationwith overallgradeof80%andgreaterthan70%on SROonlyitemsnolongerrequireanalysisfor ROquestionstodetermineifremediationis required?
Confirmifstatementshouldbe addedtoR12ES1.2.
Nochangemade.InES2.1,A,"General Guidelines,"theterm"additionaltraining"was usedtoreplace"remediationtraining"andthis nowappliestoANYapplicantthat demonstratesdeficienciesonthewritten examination,notjustSROUapplicants.In otherwords,thetrainingorganizationshould makesurethattheapplicantsunderstandwhat questionstheygotwrongandwhy.Thisisan expectationofaSATbasedtrainingprogram.
7 ES1.2B.3, Pages1to2)
ES1.2B.3pages12outlinestimesfor completinginitialandrequalexaminations.
Thefirstparagraphstates:"Thetimesallotted fortakingeachexaminationnotedaboveshall notbeextendedexceptforunavoidable situations(e.g.,lossofpower,building evacuation,emergency"response).
Thefollowingparagraphstates:"Fora requalificationexamination,thetimelimitfor completingbothsectionsoftheexaminationis 3hours."Istheintentthatthetimeforrequal examsnotbeextendedaswell?
Additionally,doesthetimelimitforrequal examsonlyapplyforNRCdevelopedrequal exams?Ifautilityprocedurestatesthatan extensionmaybegranted,isthatacceptable?
Thestatementofnotextending timeshouldeitherberepeatedor modifiedtostatethatthereareno timeextensionsforeitherexams.
Provideclarificationifitis acceptableifautilityprocedure statesthatanextensionmaybe granted ThetimeallotmentsareforNRCconducted requalificationexaminations.Revisedthe statementtoallowforextensionsresulting fromunavoidablecircumstances.
8 ES1.2D.5, Page4of6 (line68)
FromR11AppendixED.3,statementwas addedIftheJPMtaskrequirestheopeningof paneldoors,checkwithyourexaminerbefore openingthedoor;theexaminerwillletyou knowiftheoperatingcrewhasgiven permission.
Doesthischangeindicatethatrequirementsto opencabinetdoorsbediscretelyevaluated duringJPMdevelopmentandresultsincluded intheJPM?
Ifconsiderationforhowto coordinateopeningdoorswith controlroomstaffshouldbe includedasanexaminercuewithin JPMs,consideraddingappropriate guidancetoES3.2,DevelopingJob PerformanceMeasures.
Nochangemade.Thisstatementwasadded basedonoperatingexperiencefrompastJPMs intheplant.Regardingthesecondpartofthe comment,anythingtheapplicantdoesduring theJPMcanbeconsideredintheevaluationof theapplicant'sperformance.
9 ES1.2E.5, Page5of6 (line2324)
R12ES1.2E.5(fromR11AppendixEE.5) addedthestatement;theexaminermay considerthesenoteswhenevaluatingyour performance.
Whatisintentofthisstatement?Ifroughlogs arenotmaintained,howwillitimpact evaluation?Statementimpliesadditional importancehasbeenplacedonmaintaining roughlogs,whichcouldbereconstructedpost eventusingeventrecorders,chartrecorders, computerlogging,etc.
Considerremovingstatementor provideclarificationonhowthese noteswillbeevaluated.
TheNRCadded,"theexaminermayconsider thesenoteswhenevaluatingyour performance,"becausethistypeofinformation issomethingtheapplicantisexpectedtoknow beforetakingtheoperatingtest.Roughlogs canprovideanexaminerinformationabout applicantknowledge.Simulatorlogsdonot providethistypeofperformanceinformation.
10 ES1.2E.11, Page6of6 (line7)
R11AppendixEE.11statedYoumaybegiven ashortbreakbetweenscenarios,whichwas deletedinR12.
Doesthischangeimplythatbreaksbetween scenariosarenolongerpermittedorislevelof detailbeingreduced?
ConfirmintentofchangeinR12 changesummaryorinclude allowancetoprovidebreakinR12.
Nochangemade.Thechangeisnotneeded becauseapplicantbreaksareinaccordance withfacilitylicenseeproceduresandthe examinationschedule;thislevelofdetailwas removedfromtheES1.2Guidelines.The facilitylicenseeandtheNRCchiefexaminer coordinatetheexaminationschedulein accordancewithES3.5.
11 ES2.1page8 of20(lines30 31)
Statementisincomplete;shouldinclude reviewfindingstothewrittenexamandop test.
Consideraddingmoredetailtothe statementtoincludereview findingstothewrittenexamand optest.
Changemadeconsistentwiththe recommendation,addedwrittenexamination andoperatingtesttothescopeofthisstep.
12 ES2.1page10 of20(line9 15)
Isthereanytimelimitonprevious employment?Example,ifanexaminerworked atautility10yearsagowhenthecandidates wereininitialnonlicensedoperatortraining aretheyallowedtobepartofthelicense exam?
Addatimelimittothisrestriction.
Nochangemadebecausethereisnotimelimit forthissituation.TherestrictionisforanNRC examinerthatwaspreviouslyemployedatthe facilityANDinvolvedintraininganyofthe currentlicenseapplicants.
Section2,PreExaminationActivities
13 ES2.1,4.a.(4)
Page12of20 Lines10thru 15 Thisitemrequiresthefacilitytosubmittheir entireJPMbankaspartofthereference materialtoprovideforeachoperatorlicensing initialexamination.Significantresourcescan beexpendedinordertomaintainanentire JPMbankreadyforuseatanytime.
Additionally,thewordingofthisrequirement infersthattheJPMbankwillreachafinitesize, howeverexamdevelopmentrulesrequirenew ormodifiedJPMstobedevelopedwitheach exam.Inpractice,anewormodifiedJPMcould bedevelopedtotestmuchofthefacilitysjob taskanalysis.
Forcoldlicensingplants,thenumberof availableJPMsmaybesmall,andtheinplant JPMswillbeconstructedtousethealternative meansdescribedinES3.7.
Rewordthisrequirementforthe facilitytosubmitalistofavailable JPMs,alongwithastatusofeach onetoindicateifitis,orwas, recentlyvalidatedandconsidered readytouse.
NochangemadebecausethebeginningofES 2.1Fsaysthatthislistcanbetailoredforthe specificexamination.Thisshouldbe coordinatedwiththeNRCchiefexaminerduring theinitialmeeting.
14 ES2.1,4.o.(2) and 4.o.(4)
Page13of20 Lines2thru5, and 8thru10 Thisitemrequiresthefacilitytosubmitalistof allmalfunctionsthatthesimulatorcan perform,withcauseandeffectinformation andconcisedescriptionsofeach.Many simulatorsavailableforuseatnewerplants, andatexistingfleetplant,havevast capabilitiestomakevariablemalfunctions.As thiscapabilityhasexpanded,theseverityof malfunctionsismoreandmoredependenton thestartingconditionswhentheyoccur.
Recommendrewordingthis requirementtoprovidealistofthe availablemalfunctions Nochangemade.Therecommendationmay notprovideenoughinformationaboutthe availablemalfunctionsforNRCdeveloped examinationsorforNRCreviewoffacility licenseeexaminations.Additionally,ES2.1,F states:TheNRCexpectsfacilitylicenseesto providereferencematerialsforeachNRC operatorlicensinginitialexamination.TheNRC regionalofficewillcustomizethelistof referencematerialstosupportthespecific examinationassignment.Theregionaloffice shallconsidertheadministrativeburdenit placesonthefacilitylicenseeandwillrequest
15 ES2.1page17 of20,Form2.1 1
Previousversioncontainedreferencestothe applicableSectionofthestandard.Thiswas usefulforreviewingtheactual requirement/guideline.
Recommendaddingthembackin.
ReferencesaddedtoForm2.11 16 ES2.1,Figure 1Page15of 20Line1 Figure1identifiesoperatorlicensing milestonesfor10CFRPart52plantsunder construction.Considermakingthefollowing changes,basedonexperiencesgainedduring currentnewplantdeploymentactivities:
Theinitialaccreditationofoperator licensingtrainingprogramsdidnotoccuruntil closeto,orfollowingthestartofthefirst trainingprograms
TheK/Acatalogsfornewplantswereused asdrafts,ratherthanasapprovedcatalogs
Additionaleffortmayberequiredvery earlyintheprocesstoidentifypotential changesneededforlicensingexamsonplants usingnewtechnology
Recommendmovingthe milestoneforstartofmonitoring initialaccreditationactivitiescloser tothestartofthefirstclass,and addanadditionalmilestonefor thecompletionoffull accreditationbefore103(g)finding
ConsiderchangingK/Acatalog bullettoidentifyadraftcatalog willbeused
Addanewbulletearlyinthe processtoconsiderexam methodologychanges Additionalinformationhasbeenaddedonhow touseFigure1inES2.2.Thisfigurecontainsa suggestedsequenceofmilestonesandisnot expectedtoencompasseverynewreactorcase.
UseofadraftK/Acatalogisanoptionthatwas usedfordevelopingsomeAP1000examinations butthatmayormaynotbenecessaryinall futurenewreactorscases.
17 ES2.1,Form 2.11,item#10 The75daysubmittaltothefacilityforanNRC developedexamdoesnotprovideadequate timefortechnicalreviewandvalidation.When thefacilitydevelopstheexamandsubmitsitto theNRCat75days(i.e.,item#9)theexamhas alreadybeentechnicallyreviewedand validated.ThetimelineforanNRCdeveloped examthatissubmittedtothefacilityPRIORto facilitytechnicalreviewandvalidationneeds tobeextended.
ExtendtimelineforNRCdeveloped examsfrom75daystoatleast90 daystoaccountfortheadditional timeneededforfacilitytechnical reviewandvalidation.
Changedto100daysbasedonthis recommendationandlessonslearnedreport fromthe2018Ginnaexamination.
18 ES2.2,page3 of22(starting online10)
SectionreferencesACAD10001,Revision1.
Revisedeligibilityrequirementsarecontained inACAD10001,Revision2,whichwillbe releasedsoon.
Additionally,theACADmayberevisedmore frequentlythanNUREG1021toupdate programmaticrequirementsforinitiallicense programcontent.Arevisionstatingto referencethelatestrevisionofACAD10001or latestrevisionoftheNANTacademyguideline foroperatoreligibilityandselectionwouldbe moreaccurate.
RevisetoreferenceACAD10001, Revision2ormakeageneral statementtoreferencethelatest revisionoftheACAD10001or latestrevisionofNANTacademy guidelinesincetheNRC participatesintherevisionprocess perINPOguidance.
ChangesweremadetoES2.2torecognize ACAD10001aspartoftheNANTguidelinesfor NNABaccreditatedtrainingprogramsandto makethisamoregeneralrecognitionofthe processandnotaspecificrevisionoftheACAD.
19 ES2.2Section F.2.b Aregulatorybasisforthenumberofhours consideredextensiveactualoperating experienceinES2.2SectionF.2.b,Multiunit ExaminationWaiver,isnotprovidedinthe draftNUREG.Additionally,theproposed wordingappearsinadequatetoaddress multiunitstationsthatarebuiltsimultaneously toaPart52certifiedstandarddesign.
Thoughtheadditionaloperatingexperience maybenecessaryforoperatingasubsequent unitwithsignificantdifferencesfromexisting unit(s),itisunnecessarywhenoperating identicalunits.Becausedesigncertification andITAACensuressubsequentunitsare essentiallythesame,operatorslicensedonthe firstunitbuilthavealreadytakenan examinationapplicabletosubsequentunits, providedthelicenseecandemonstratethat therearenoexaminabledifferencesbetween theunits.
SNCrecommendsflexibilityinthe NUREGtoprovideNRCstaff guidancetoaddressthevarying degreesofunitsimilarityandtime lapsesbetweenconstructionfor whichlicenseesmayrequesta waiverunder§55.47(e.g.,Part50 plantsdecadesapartvs.Part52 plantsmonthsapart).
AddedbasistoES2.2for520hourswhichis equivalenttotheunitfamiliaritytimeperiod usedininitiallicensingtrainingprograms.The NRCplanstoamend§55.47aspartofthe AlignmentofLicensingProcessesandLessons LearnedfromNewReactorLicensing rulemaking(DocketIDNRC20090196).
Specifically,theNRCwouldaddanewsetof criteriathatjustifyawaiverofanyorallofthe writtenexaminationandoperatingtestfor applicantstobelicensedonsubsequentunitsat amultiunitsitethatisunderconstruction.
Thus,thenewcriteriawouldaddressmultiunit stationsthatarebuiltsimultaneouslytoaPart 52certifiedstandarddesign.
20 ES2.3Form 2.32,page9 of19 ItemaofSimulatorreferencesForm2.31.
ShoulditbeForm3.41?
ConsiderswitchingitemsaandbunderJPMs.
Verifythecorrectformto reference,andconsiderifitemsa andbshouldbeswitched.
Changemadeconsistentwiththe recommendation.
21 Form2.32 (revisedop testQAform),
ES2.3,page 10of19 AbullethasbeenaddedunderWalkthrough Criteria,thatstatesspecificdesignationifit meetsalternatepathcriteria.JPMcover sheetstypicallydesignatealternatepath.This informationisalsotypicallyinthebodyofthe JPM.
Provideclarificationiftheadded bulletresultsinnew/additional requirementsforalternatepath JPMs.
Changemadetoclarifythatthisissimplyalabel andnotanewrequirementforalternatepath JPM.Theaddedbulletisacheckthatthe alternatepathJPMSarelabeledormarkedas "alternatepath"todistinguishthemthesame waythatatimecriticalJPMismarkedto distinguishitfornotificationpurposes.
22 ES2.2C.3, page5of22 (line7)
R11ES202C.1.cdescriptionforcontrol manipulationsstatesEveryeffortshouldbe madetoperformatleastsomeofthe manipulationsontheactualplantandto diversifythereactivityandpowerchangesfor eachapplicant.R12doesnotincludethis clarification.Thischangeappearstoreduce importanceofperformingcontrol manipulationsontheactualplant.
Confirmthatthisclarificationisnot required.
Nochangemade.ThestatementfromRevision 11toperformsomeofthemanipulationsinthe plantwasremovedbecause10CFR55.31(a)(5) allowsthesetobeperformedonthefacilityfor whichthelicenseissoughtoronaplant referencedsimulator.Theinformationabout diversifyingthemstillexistsinRevision12:
"Applicantsshouldperformdiversesignificant controlmanipulations."
23 ES2.2C.3, page5of22 (line1920)
R11ES202C.1.c.descriptionforcontrol manipulationsstateswhilethoseontheplant maybesmallerbutofsufficientmagnitudefor theoperatortoexperienceappropriate feedback(i.e.,clearlyobservableeffectsonthe plant,whichcouldincludemaintainingpower constantwhileperformingadilution/boration evolution)asaresultofthecontrol manipulationwouldbeconsidered.R12does notincludethisclarification.Withoutthis clarification,borationordilutionofany magnitudewouldseemtosatisfyperformance ofacontrolmanipulation.
Confirmthatthisclarificationisnot required.
AddedapointerinES2.2tothedefinitionof significantcontrolmanipulationintheglossary (ES8).ThedefinitioninES8ofSignificant ControlManipulationsstates:Anoperation (excludingthoserequiredforfuelhandling)of anapparatusormechanismthatdirectlyaffects thereactivityorpowerlevelofacriticalreactor byanamountofsufficientmagnitudetoallow fortheobservationofcleareffectsontheplant bytheoperator.
24 ES2.2,A,7th paragraph Page2of22, Lines11thru 20 Thissectiondiscussescoldlicensingof operators,andendorsesNuclearEnergy Institute(NEI)0613A,Templateforan IndustryTrainingProgramDescriptionasan acceptablemethodtoacquiretheknowledge andexperiencerequired.
SpecificallyitendorsesRevision2,andthe attachedsafetyevaluation.NEI0613A Revision2,inturn,referencesRegulatory Guide1.8,QualificationandTrainingof PersonnelforNuclearPowerPlants,revision3 andANSI/ANS3.11993,Selection, QualificationandTrainingofPersonnelfor NuclearPowerPlants.RegulatoryGuide1.8 hasbeenrevisedtorevision4sincetheSERfor NEI0613Awasissued.TheANSIstandardhas alsoberevisedtothe3.12014revision,andis nolongerendorsedbyRegulatoryGuide1.8, revision4.
Additionally,NEI0613Adoesnotspecifically addressneweradvanceddesigned,passively cooledreactorsthathavealternativestaffing requirements.
Considerrevisingthissectionto statethatfacilitiesmayseekother alternativemethodstomeetthese requirements.
Addedstatement:Facilitylicenseesmayseek alternativemethodsforthecoldlicensingof operators.
25 ES2.2,B,3rd paragraph Page3of22, Lines12and 13 TheNANTguidelineACAD10001,revision1,is identifiedasanacceptablemethodfor meetingtheeligibilityrequirementsfor educationandexperience.Thisdocumentis currentlybeing revisedtothenextrevision.
Updatethisreferencetothe newestrevisionifitispublished priortotheapprovalofthis NUREG.
Samedispositionascomment18
26 ES2.2,C,3, 3rd paragraph Page5of22, Lines20thru 22 Thissectionstatesthatforcontrol manipulationsperformedonasimulatorto counttowardsthefiverequiredcontrol manipulation,theyarerequiredheretobe performedonaplantreferencedsimulator thatmeetstherequirementsof10CFR 55.46(c).Thiswouldbeaplantreferenced simulator(PRS),notacommissionapproved simulator(CAS).
Also,sectionG.2.a,onpage15ofthissection, lines24thru26,statesthatcoldplant applicantsmaydeferthesemanipulationsuntil theycanbecompletedonaplantreferenced simulator.
ThecurrentdefinitionofaPRSin10CFR55.46, (c)(2)(i)statesthatthesimulatormodels relatingtonuclearandthermalhydraulic characteristicsthatreplicatethemostrecent coreloadinthereferencedplant.
Itisnotclearhowthefirstoperatorsatacold plantwillbeabletodothisifplant performancedataisrequiredbeforea simulatorcanmeetthisPRSrequirement.
RecommendrevisingsectionC,2, 3tostateclearlyhow,duringcold licensingofoperators,control manipulationscanonlybe performedonaplantreferenced simulator,notonacommission approvedsimulator.Alsoconsider removingtheallowanceforcold plantstodeferthecontrol manipulationsuntilaPRSis available,insectionG.2.a.
Alsorevisethedefinitionofplant referencedsimulator(inthe glossary)toincludehowsignificant controlmanipulationscanbe performedduringthecoldlicense phase.
TheNRCstaffisconsideringtheissues highlightedinthiscommentintheParts50and 52alignmentrulemaking.Theproposed changesaredescribedinRegulatoryBasisfor PublicComment(ML20149K680),AppendixE.
27 ES2.3,page4, line15 Actionsisusedtwiceinthissentence.
Deletethe2ndactions.
Deletedthesecond"actions."
28 ES2.3,page5, lines3841 Thisisredundanttopage4,lines2528.
Deleteoneinstanceofthis sentence.
Deletedthefirstoccurrenceofthisstatementin lines2528onpage4.
29 ES2.3,Page6
- of19, line3436, AfterC.4.c.
Thisstepstatesthatthewrittenexaminations andoperatingtestshouldnotoverlapintheir content.However,theexampleprovidedistoo limitingasitdefinesoverlapexistsifthesame pressurizerlevelcontrollerconceptistested duringasimulatoreventandinawritten examinationquestion.
Thetermconceptshouldberefinedtoallow subsetsofaconcepttobetestediftheyhave differentrecoveryactions.
Recommendaddingexampleof controllerfailingupscaleonthe operatingexamandthesame controllerfailingdownscaleonthe writtenexam.Thisillustratesthat thisisdifferentenoughtobothbe allowedonthesameexamination anddoesnotviolatetheoverlap restrictions.
Theexamplewasrevisedtoclarify:For example,overlapexistsifthesamepressurizer levelcontrollerfailure(i.e.,failshigh)is testedduringasimulatoreventandinawritten examinationquestion.
30 ES2.3,page
- 11and16, Form2.32
- noteatbottomofpage11andpage16 shouldstateexamortestviceoutline.
Thislookslikeacopyandpasteerrorfrom Form2.31.
Updateformasstated.
Changemadeinaccordancewiththecomment.
31 Form2.35 Instructions forWritten Examination Review Worksheet ES4.2,Page9 of29 Lines412 Form2.35andES4.2haveconflicting informationcoveringthewrittenexamination levelofdifficulty.TheformusesLODrating1 5andES4.2discussesapercentage.
Recommendaligningthetwo sectionstoreflecttheLOD15 requirement.
Clarificationwasaddedtowhattheterm
'difficultlevel'meansinES4.2byreplacingthat termwithabetterdescription.Correlating difficultylevelwithLODisoutsidethescopeof thisrevision.
32 Form2.35 Written Examination Review Worksheet DuringapublicmeetingtheNRCstatedthaton thisformthey,addedcheckfortechnical referenceanddirectlookupquestions.
Thereisnotaboxforreferencesontheform.
Intheinstructionssectionfortheworksheet, Item#2LevelofDifficulty,itdiscussesthata directlookupshouldbemarkedLOD1.The intentshouldbemoreclearlystatedinthe form.
Recommendaddingaboxonthe actualformtoreviewtheprovided referencetomakesureitisnota directlookupandthatthe referencedoesnotprovide additionalinformationthatwould helpansweranotherquestionon thetest.
Nochangerequired.Form2.34,"Written ExaminationQualityChecklist"includesacheck foreachquestiontohaveatechnicalreference.
Directlookupquestionsaretobemarkedas LOD1onForm2.35inaccordancewiththe instructionsonthisform.Step8onForm2.34 includesacheckthatreferencematerialdoes notgiveawayanswers.
33 ES2.3,Page
- 13of19, Form2.33 Instructions forCompleting theJPMTable ES3.2,Page7
- of18, Line10 EachJPMmustcontainatleasttwocritical steps.Anexceptiontothisrequirement shouldbemadeforadminJPMs.TheAdmin JPMtaskstandardshouldbetomatchthe answerkey.TheAdminJPMsshouldnotbe heldtoaminimumnumberofcriticalsteps.
(Example:Howmanystepsdoyouhaveto haveforanEALcall?Theyshouldmakethe properdeclarationintherequiredamountof time.)
RecommendthattheAdminJPM taskstandardshouldstatematch theanswerkeyvicerequirea minimumoftwocriticalsteps.
Nochangemade.RegardingtheexampleofEAL determinations,twotypicalcriticalstepsare theEALclassificationwithinthetimeperiod(15 minutes).
34 ES3.1,page4 of5(lines35 and38)
Steps13.band13.ccoverthesametopic,using JPMstotestknowledgeofthedifferences betweenplantsonmultiunitsites.
Considercombiningthetwosteps intoonestep.
Deletedthesentencein13.b"Considerdoing JPMSontheotherunit."
Section3,OperatingTests
35 ES3.2,page2 of18(line29)
ES3.2,B.3.a.listsexamplesforConductofOps Topics,includingaccesscontrolsfor vital/controlledplantareas.However,Rev3 ofNUREG1123deletedKA2.1.13,Knowledge offacilityrequirementsforcontrolling vital/controlledaccess.ThatstheonlyKA statementthatwasapplicabletothatexample.
Accesscontrolsfor vital/controlledplantareas shouldnolongerbeusedasan example.Recommend replacementwithanewexample.
ThisK/Awasdeletedinthelatestrevisionfor thePWR,BWR,andAP1000K/Acatalogs,but stillremainsintheABWRcatalog(2.1.11).
Deletedtheexamplepertherecommendations, andreplacingwithanewexampleisnot needed,asthereareseveralexampleslisted.
36 ES3.2,page3 of18(lines26 32)
Bulletformattingisdifferentthan3.aand3.b.
Considerclosingbulletedlines(i.e.,
nospaceinbetweeneachbulleted line).
Spacingbetweenbulletsadjustedtomatchthe restofES3.2.
37 ES3.2,page3 of18(line31)
ES3.2,B.3.c.listsexamplesforRadiation ControlTopics,includingradiationwork permits.However,Rev3ofNUREG1123 deletedKA2.3.7,theonlyKAthatwas associatedwithradiationworkpermits.
Radiationworkpermitsshould nolongerbeusedasanexample.
Recommendreplacementwitha newexample.
ThisK/Awasdeletedinthelatestrevisionfor thePWR,BWR,andAP1000K/Acatalogs,but stillremainsintheABWRcatalog(2.3.4).
Deletedtheexamplepertherecommendations, andreplacingwithanewexampleisnot needed,asthereareseveralexampleslisted.
38 ES3.2,page7 of18(lines5 6,and2730)
Isthisnewtext?
Provideclarificationwhetheror notthisisanewcomment.
Theclarificationthatacriticalstepmightnot involveaverifiableactionandtwoexamplesare newforRev12.Thespecificationtoinclude JPMterminationcriteriawasaddedbecausein practiceexaminationauthorsincludedcriteria forwhenaJPMshouldbeterminated.
39 ES3.2,page9 of18(line20)
Definition/standardofalternatepathJPM shouldbeclearlystatedinthissectionsince thetermisintroduced.
Addclarificationtothissection.
ThereisnotadefinitionofalternatepathJPM fortheglossary.Thefollowingclarificationwas addedonpage9:AnalternatepathJPMallows theNRCtoevaluatewhethertheapplicanthas theskillsandknowledgeatthelevelneededto safelyoperatethesystem,andtheabilityto recognizeanddiagnoseanunexpectedsystem responseandthenexecuteoneormore alternativepathswithinthewidespectrumof proceduresundertheapplicantscognizance; thesearetypicallyproceduresthatthe applicantwouldnototherwisebeexaminedon.
Additionally,addedto1.SuccessPaththe following:Thesuccesspathmustbean alternatepaththatdiffersfromthenormal successpathinordertotesttheapplicants abilitytouseanalternateoperation.
40 ES3.2,page9 of18(lines26 28)
Sentenceisincomplete;shouldbeprecededby "AlternatepathJPMsareused...".
Additionally,itappearsthattherearetwo separatesubjects:1)whattheintentof alternatepathJPMsis;and2)howthe alternatedpathisimplemented.
Revisethesentence.
Revisedthesentenceinaccordancewiththe recommendationanddeletedtheterm "observe"sincethisimpliedthatitwasdone duringJPMimplementation.
41 ES3.2,page 12of18Form 3.21,step3 Thephraseseniorreactoroperatorisspelled out,unlikeRO,eventhoughitisastandard abbreviation(onlistofabbreviations).
ConsiderusingSROvicesenior reactoroperatorforconsistency.
Changemadeinaccordancewiththecomment.
42 ES3.2D.1.c, Page7of18 (line10)
ES3.2D.1.crequiresJPMstocontainatleast twocriticalsteps.
Somesafetysignificanttasksmayrequire completionofasinglecriticalstepto demonstratecompetentperformance.For example,onceRCPtripcriteriaaremet followingasmallbreakLOCA,theverifiable criticalstepissimplystoppingtheRCPs.
RequiringtwocriticalstepsforaJPMmay eliminatetestingofsomesafetysignificant tasksfromtheexaminationbankorrequire extensiverevisionofJPMstoincludetwo criticalstepswithoutacorrespondingincrease insafetysignificance.
Considerremovingrequirement fortwocriticalstepsforaJPM.
Nochangemade.Thisrequirementisaligned withRev11guidanceforlimitingtheuseof simpleonestepJPMs.EachJPMmustcontain atleasttwocriticalstepsbecausethisiswhatis practiced.Theexampleprovidedinthe commentfortrippingRCPscouldbesplitinto morethanonecriticalstep,forexample,each RCPtripisonecriticalstep.
43 ES3.2D.1.c, Page7of18 (line2830)
R12ES3.2D.1.drequiresincludinga statementthatdescribestheconditionstobe metfortheNRCexaminertoterminatethe JPM,consideringbothapplicantsuccessand failuretomeetthetaskstandard.
Althoughapplicantsuccesswithcompleting thetaskmaybepredictablegivenconfinesof taskperformanceoutlinedintheJPM, potentialfailuremodesmaybelessso.For example,theapplicantmaynotbeableto locatetheappropriateequipmentinthefield, performthetaskonthewrongUnit,failto correctlyengageamanualoverride,etc.
Includingallthesepotentialfailurepathsinto theevaluationtoolmaymakeitunwieldlyand confusing.ES3.2D.1.dcontainsa requirementtoIncludeastatementthat describestheconditionstobemetfortheNRC examinertoterminatetheJPM.This guidancewouldseemadequate.
Considerremovingrequirement thatimpliesJPMtermination requirementsrequireapplicant successandfailureconditionsto beincludedintheJPM.
Addedclarificationthatthisisnota requirementbyaddingthewords"suchas."
ThiswasaddedinRev.12becauseitiswhatis beingpracticedandisconsistentwiththesteps ofdevelopingaJPM.Theintentisnottomake theexaminerlistALLpossiblefailuremodes.
44 ES3.3,page1 of17(line1 andline26)
PrimarilyfromAppendixDofR11.Abetter titleforthisstandardmightbe"Generic...."
ConsidermakingthisanAttachmenttoES3.4 ratherthanastandalonestandard.
Forline26,Thefollowingparagraphsimply describeswhattheobjectiveofusingaSim Scenarioisanddoesnotprovideanydirection fordeterminingobjectivesofanygiven scenario.Thisinformationisbettersuitedfor theprecedingintroduction.
Considermakingthisan AttachmenttoES3.4ratherthana standalonestandard.
Considerplacingtheparagraph afterline26inthepreceding introduction.
Added"General"tothetitleofthissection.The materialinthissectiondoesnotneedtobe movedtoanothersection.
45 ES3.3,page1 of17(lines5,6 and22,23)
Textstatestheguidelinesalsoapplyto requalificationexaminations.Itisunclearwhat specificallyappliestorequalificationprograms andwhatisinspectableperIP71111.11,if anything.Clarifyiftheguidelinesonlyapply whentheNRCwritesarequalificationexam perES6.
Clarifyhowsimulatortesting guidelinesspecificallyapplyto requalificationprograms,ifatall, andifIP71111.11willchangeto incorporatethosespecific requirements.
AddedclarificationthatthiswouldapplytoNRC conductedrequalificationexaminations.
46 ES3.3,page1 of17(lines42 and43)
Step2statestheICshouldbe representativeofatypicalplantstatuswith variouscomponents,instruments,and annunciatorsoutofservice.Althoughthisis notachangefromRev.11,itseemstodenote anunnecessaryrequirementbynotallowing cleanICs.
Revisetostate:theICshouldbe representativeofatypicalplant status,whichmayincludevarious components,instruments,and annunciatorsoutof service.
AddedclarificationforICsinaccordancewith therecommendation.
47 ES3.3,page2 of17(line18)
Thelastsentenceoftheparagraphstates:As such,theoperatingtestshouldnotinclude sucheventstheyarenecessarytosetthestage forsubsequenteventsortotesttheSRO applicantsknowledgeofTSactions.It appearsthewordunlessshouldbeincluded beforethey.
Addunlessbetweenevents andtheyinthesentenceto correctthestatement.
Changemadeinaccordancewiththe recommendation.
48 ES3.3,page5 of17(line10)
Thewordwithdoesnotseemtobelongin thefollowingsentence.
Ifthisjumpisused,thecrewmustreceive withaturnoverorcueaddressinganyrelevant plantconditionsthatchangedduetothetime compression.
Removewithorrevisetoclarify intent.
Changemadeinaccordancewiththe recommendation.
49 ES3.3,page8 of17(starting atline8)
Thisstatesacomponent/instrumentfailure thatoccursbeforethemajoreventcouldbe creditedforactionsbeforeANDafterthe majoreventprovidedtheactionstodealwith thefailurearedifferentwhencomparingthe responsebeforeandafter.Theprovided exampleofexcessletdowndemonstrates whenthiscouldNOTbeusedsinceexcess letdownactionsarethesamebothbeforeand afterthemajorevent.Isitacceptabletocount thesamemalfunctiontwice,oncebeforeand onceafterthemajor,providedtheactionsto addressthefailurearedifferent?
Provideapositiveexampleofusing thisallowancetoaddclarityof acceptance.
Changemadeinaccordancewiththe recommendation.Addedapositiveexampleof howtousethisallowanceinES3.3.
50 ES3.3,page 10of17item 3,(lines42,43) andpage11of 17(line1)
FormattingisdifferentfortheCombustion EngineeringPWRascomparedtotheothers (doublespacingbetweenbulletedlines).
Closebulletedlines(i.e.,nospace inbetweeneachbulletedline).
Removedspacebetweenbulletitemsforlistof CEcontingencyprocedures.
51 ES3.3,Page 11of17 Line18 ES1.2,Page6
- of6, lines56 Ascenarioshouldbedesignedtorun approximately60to90minutes.
11.Theoperatingtestforinitiallicensingwill normallyconsistoftwoorthreescenarioseach lastingapproximately1.5to2hours.
Thescenariosshouldrun4560minuteswitha requalcrewduringvalidationandshouldrun 4590minutesfortheILOstudents.
RecommendchangingES1.2to alignwithES3.3.
ChangedES1.2page6of6to11.5hoursper scenarioforinitiallicensingexaminations.
52 ES3.3,step5, page10of17 RecentchangestotheBWROwnersGroup guidelineshavechangedthesetuponsome contingencyprocedures.Specifically, AlternateLevelControlisnolongera separatecontingencyprocedureandhasbeen addedtotheRPVControlEOP.Itisstillan EOPcontingencypath/procedureandshould betreatedassuch.
Consideraddingstatementthat theidentifiedcontingency proceduresneednotbe standaloneEOPsandmaybe includedinthebaseEOPs.
AddedthefollowingNote:Becauseofthe GeneralElectricBWREOPstructure,thesemay notbestandaloneprocedures.
53 ES3.3,stepk, Page11of17 (line45)
ES3.6,page4 of27(line43)
Table3.61, page6of27 Raisingthegradingthreshold(i.e.,makingit harderforanapplicanttopass)shouldbe limitedtoclosinggapswithlicensingapplicants thatweredeterminedtonotdisplaythe minimumrequirementsnecessarytobe licensedascompetentlicensedoperators.
Thereisnoevidencethatthecurrentgrading criteriaisinadequatetolicensecompetent applicantsandthechangewasmadeasoneof theactionstoimprovegradingclarityand consistency.Manyoftheotherchanges, includingthenewSPDcategorywillhelp improvegradingclarityandconsistency withouttheneedforincreasingthe significancetoautomaticfailureforamissed CTorCPD.Theindustryalsoperformedastudy ofasmallerpopulationanddeterminedthat therewillbeincreasedfailuresoflicensed operatorcandidatesduringthesimulator operatingexamination.
Recommendmaintainingamissed CTorCPDasa3pointdeduction.
TheNRCreconsideredthegradingofCPDs basedonindustryfeedbackandaCPDhasbeen returnedtoa3pointdeduction;twoormore CPDswillresultinafailureofthesimulator operatingtestregardlessofthecalculated competencyareascores.
53continued Additionally,theeliminationofabroad categoryofitemscontainedinRev.11thatcan constituteacriticaltask(e.g.,scrams)while maintainingtherequirementofatleast2 preidentifiedcriticaltaskswillpotentiallymake scenarioslonger,morecomplexandincrease difficultyduetotheneedtomakeCTsEOP basedsimilartoRev.10.Becausethestudies conductedbytheLOFGandNRCstaffused previouslygradedexamsasthesubjectmatter, thepotentialconsequencesofthischange couldnotbeassessed.Theselossesof competentoperatorsfromtalentpipelineswill negativelyimpactorganizationalstaffingand noclearsafetyissueexiststowarrantthe NRCsimpositionofthisburden.
Recommendmaintainingamissed CTorCPDasa3pointdeduction.
TheNRCreconsideredthegradingofCPDs basedonindustryfeedbackandaCPDhasbeen returnedtoa3pointdeduction;twoormore CPDswillresultinafailureofthesimulator operatingtestregardlessofthecalculated competencyareascores.TheCTcriteriainRev 12willnotmakethescenarioslonger.The concernwithhavingoneCTperscenariomeans thatsomeapplicantsmightnotreceiveaCT.
TheNRCchiefexaminerhastheabilityto controlthescenariosiftheyaregettingtoolong orcomplex.ThemajorityofRevision11CTs shouldstillbeusable.Themajorchangetothe CTmethodologywasremovingunintentional reactorprotectionsystem(RPS)orESF actuationsfromthelistofwhatqualifiesasa postscenarioCT.
54 ES3.3,page 12/13of17 (line38)
CriticalTaskMethodologyStepC.1is IdentifyingScenarioSpecificCriticalTasks directsscenariodeveloperstoapplyguidance toIDENTIFYandDESIGNATECTs.Thelistof itemsprovidedmainlydescribeapplicant actionswhatapplicantsmustdoornotdo whenrespondingtoplantconditionsto satisfactorilyaddresstheCT.Whendeveloping CTs,theauthorcanonlyknowwhatactions theapplicantsSHOULDtake,basedonthe proceduralguidanceandprojectedplant response.TheauthorCANNOTknow,atthis pointintheprocess,whatactionsthe applicantsWILLtakewhentheyperformthe scenario.Thelistofbulletsonpage13appear tobeadescriptionofhowtodetermineifa postscenarioCThasbeencreated.Rev.11CT methodologydescribeshowtodetermine whetheraproposedmalfunctionisasafety significantCT.
ProposedReplacementLanguage forPage13ofES3.3:The developershouldapplythe followingguidancetoidentifyand designateCTsinconjunctionwith facilityCTlistsorintheabsenceof suchalist:
Doconditionsexistwhich representsignificantsafety challenges?Examplesincludethe following:
Conditionsthatwarrant initiationofemergency depressurizations(BWR)
Conditionsrequiringorangeor redpathCSFresponse(Wand AP1000)
Conditionsthatwarrant performanceofFRGtransition(CE)
Conditionsthatwarrant declarationofSAEorGE Conditionswhicharebeyondthe controlofthecreworwhichare irreparablyintroducedbythe scenarioshouldnotbedesignated asCTs.
TheNRCagreeswiththecommenterthatthe instructionsforidentifyingcriticaltaskswere writtenintermsofapplicantactionsandnot usefulforselectingcriticaltasksduringscenario development.TheNRCmadechangestoES3.3 CriticalTaskMethodologyinstructionsfor identifyingcriticaltasksthatare"task orientated,"forexample:"actionsthatdirectly leadtotherestorationofoneormoresafety functions"and"EOPdirectedactionsthatare essentialtoaneventsoverallmitigative strategy."
55 ES3.3A.4, Page3of17 (line1216)
Thisrequiressimulatorguidestoincludeboth theprocedurestepsandtheverifiableactions thattheapplicantsareexpectedtotake.For example,insteadofonlystating,TheBOP startsemergencydieselgeneratorAin accordancewithProcedureXYZ,Steps 1.10-1.25,referencetheprocedurestepsand includeverifiableactionsforthatsetof procedurestepsthattheBOPisexpectedto perform.Thisrequirementcouldbe interpretedtorequireseparateclarificationof verifiablestepswhenstepperformance inherentlycontainsverifiableactions.Addinga separateclarificationtoidentifyandspecify whichactivitiesareverifiableactionsmay maketheevaluationtoolunwieldlyand confusing.
Consideraddingclarificationto paragraphthatstates,Ifa procedurestepdescribesthe verifiableactions,includingthe stepdescriptionalonewould satisfythisrequirement.
Changewasmadeforclarity.Theintentisthat theScenarioGuideorForm3.32containsthe verifiableactionsandnotonlyprocedurestep numbersbecausethisprovidesclearobjective gradingcriteriaforgradingpurposes.Therewas nochangetotheRev11requirementin AppendixDto"includeeveryrequiredoperator action."
56 ES3.3A.4, Page3of17 (line3132)
Thisrequiressimulatorguidestoidentifyand documenteventsthatimpactTSfunctions (suchasforinoperableinstruments).This requirementisreasonablepriortoamajor transient.Forexample,adesignbasisaccident andresultingemergencyproceduredirected actionsmayresultinimpacttoTSfunctions butevaluatingthisimpacttoTSisless importanttosafetythanappropriateaccident responseprocedureimplementation.
Considerclarifyingrequirementto state,Ataminimum,identifyand documentthoseeventsthat impactTSfunctions(suchasfor inoperableinstruments)priorto majortransients.
Added"priortomajortransient."
57 ES3.3page12 of17(line2)
Thisdoesnotseemtofittheconceptof"risk informed."
Deletedthesentenceinquestionbecauseitwas redundanttothefirstsentenceinthe paragraph.
58 ES3.4A,Page 1of9(line22 30)
R12ES3.4A.containsguidancefordeveloping simulatorscenarioswhilelimitingoverlap.R11 ES301D.5.brecognizedthatbecauseofa limitednumberofmethodsforadding reactivity,reactivitymanipulationevents wouldbeexemptfromprescribedoverlap limits.ThisallowancewasnotincludedinR12.
Consideraddingthisclarification.
NochangewasmadebecauseES3.4Astates:
Becauseofalimitednumberofmethodsfor addingreactivity,reactivitymanipulationevents canberepeatedfrompastexaminations.
59 ES3.4page2 of9(line35)
Segregatingthestepsforcompletingthe outline(FormES3.31)fromthestepsof completingthescenarioguides(FromES3.3 2),intoseparatesectionswouldbetter describetheprocessofdevelopingaSimulator Scenarioandclearlyidentifywhichelements arepartoftheoutlinedevelopmentandwhich arepartofthescenarioguidedevelopment.
Considerseparatingthestepsfor completingtheoutlinefromthe stepsofcompletingscenario guides.
Changemadeinaccordancewiththe recommendation.
60 ES3.4A,Page 2of9(line18 20)
Theadditionallimitationthatthescenario shouldnotduplicateoperatortasksthat appearontheJPMportionoftheoperating testorthewrittenexamination unlessthe operatoractionsforthesametaskare differentfortherelatedsimulatorevent.Since JPMsandsimulatorscenariosevaluateskill performance,thisrestrictioniswarrantedto preventduplication.However,written examinationsevaluateknowledgethatmay applytonumerousnormalandabnormal tasks.Evaluatingallwrittenexamination questionstoeliminatepotentialoverlapfor theskillportionofexaminationswillbe subjectiveandtimeconsuming.Inaddition, knowinghowataskshouldbeperformedand performingactionsareinherentlytwo differentevaluations.
Considerrevisinglimitationto excludeconsiderationofthe writtenexamination.
Nochangewasmade.Thisinstructionexisted inRev11,onFormES3013,tocheckfor overlapwiththeentireexam,thereforethisis notanewrequirement.Oneconcernisthat applicantscouldbepenalizedmorethanonce forknowledgeorperformancedeficienciesfor thesametopic/task.
61 ES3.4,Page3 of9,Section2 Informationabouttheuseofsurrogates shouldbeinthestandardonadministration (ES3.5SectionD).Scenariosarenotdesigned aroundtheuseofsurrogates,unlessthe scenariowillbeusedonlywithasetofcrews thatwilluseasurrogateinthesameposition foralliterationsofthescenarioadministration.
Ifkepthere,thisshouldnotbelistedasa separatestepinthe"developmentprocess."It seemstobemoreappropriatetolistthisasa subtopictoitem1(Determiningthenumber ofscenarios).
Determineifthissectionshouldbe keptinthislocationorasubtopic toitem1.
Thestepsforsurrogateoperatorshavebeen movedtoaseparateSubsectionB:Determining theNumberofScenariostoDevelopandUseof SurrogateOperators.
62 ES3.4,page3 of9 (line5)
Theexampleonline5couldmoreclearlyshow thebenefitoftheapplicationofthe requirementondeterminingthenumberof scenariosrequiredbasedoncrewcomposition.
Recommendaddingthefollowing example:Ifawatchteamhastwo SROIswithoneRO,bothSROIs wouldnotneedtobeATC requiring3scenarios.Youcould completeallrequirementswith twoscenarios,eliminating requirementfor3rdscenario Theexamplesinthissectionhavebeenrevised basedonthiscomment.
63 ES3.4,Page4 of9(line28 30)
R12Table3.42EventsandEvolutionsfor LicenseLevelincludesminimumnumberof eventsorevolutionsforeachtypeoflicense andnowrequiresManualControlofAutomatic ActionforROandSROIpositionsduringthe simulatorexamination.Thisrequirementdoes notcontainanyclarificationonwhat constitutesmanualcontrolofanautomatic function.Forexample,doestakingmanual controlofanautomaticsecondaryside feedwaterheaterdrainvalvesatisfythis requirement?
Considerclarifyinganyrestrictions forcreditingmanualcontrolof automaticfunctionorprovide examples.
Addedthatmanualcontrolofautomatic functioneventmustincludeverifiableactions.
Alsoadded:d.Manualcontrolofanautomatic functioncanbeforasafetyoranonsafety relatedsystemthathasbothanautomaticand amanualcontrolfeature;thecontrolfeatureis notlimitedtocomponentcontrollers.For example,theeventinvolvesthefailureofthe automaticstartfeatureofapumpandthe applicanthastomanuallystartthatpump.The eventmustinvolvetheapplicantmanually,with verifiableactions,takingcontrolofthe automaticfunction.Forexample,verification thatadigitalcontrollerauctioneeredoutabad inputwouldnotbeconsideredaverifiable actionforthisevent.
64 ES3.4,page1 of9 (line9)
Thisparagraphusesthetermexamination developers.Othertextusesexamination authorsandexaminationwriters.For consistencyandclarity,usingacommonterm issuggested.
Recommendusingexamination authorsthroughout.
ES3.2,3.3andES3.4revisedtouse "examinationauthor"consistentlyinsteadof scenario/examdeveloperorscenarioauthor.
65 ES3.4,page1 of9 (line39)
Bullet3regardingScenariosextracted shouldbedeletedsincethisrequirementis encompassedinbullet2.
Considerdeletingbullet3or combinewithbullet2.
Changemadetoclarifythatthisisrequired(as itwasinRev11)andthereforewasaddedto theinstructionsforsignificantlymodifyingbank scenariosinRev12.
66 ES3.4,page2 of9 (line1820)
Thebulletstates;Thescenarioshouldnot duplicateoperatortasksthatappearonthe JPMportionoftheoperatingtestoronthe writtenexaminationunlesstheoperator actionsforthesametaskaredifferentforthe relatedsimulatorevent.Alsoseesections;ES 3.1page2&ES2,page15,step3onform3.2 2.Scenariosandwrittenexamsareperformed indifferentcontextsandareseparatedintime.
Ascurrentlywritten,thiscouldcausea significantlevelofincreasedefforttocross checkthirtytofifty(ormore)scenario elementsagainst100writtenexamquestions withverylittlebenefit,andrisktoexamination quality.Asdiscussedattherecentpublic meetingheldonOct21,2021,itappearsthat theintentofthisrequirementisfortasksthat resultinactionstakenwhendueto malfunctions.
Recommendremovingwritten examinationcheckoradd flexibilitysimilartoRev.11that hadwithinacceptablelimits.
Considerwordingsuchas;Efforts shouldbetakentominimizetasks thatarethesameontheboththe operatingtestandwritten examination.
Also,considerspecificallycalling outthatthisisintendedfortasks associatedwithmalfunctions.
Thisisnotanewrequirement.Clarificationwas addedbyrevisingthebulletinES3.4tostate thefollowing:
- Theoperatoractionsforthescenario events/evolutionsshoulddifferfromoperator tasksthatappearontheJPMportionofthe operatingtestoronthewrittenexamination.
67 ES3.4,page3 of9 (line2)
ES3.4,B.1,thirdbulletconflictssomewhat withtheexampleimmediatelyafter.Third bulletsaysSROIneedstobeevaluatedin eithertheBOPORATCposition.Thereareno conditionssimilartothe3015inRev.11(Form 3.41inRev.12).Theexampleimmediately afterseemstospecifyATCpositionsincelead operatorwasdefinedastheATCinthebullet before.
Theexampleafterthethirdbullet shouldsaywhiletheSROI applicantisinareactoroperator position.
Examplechangedtosay:Forexample,acrew consistingoftwoROsandoneSROIwill normallyrequirethreescenariostoevaluate eachapplicantsperformanceontheprimary plantcomponentcontrols;however,a surrogateSROmayhavetofillthesupervisory rolewhiletheSROIapplicantisintheATC/BOP position.
68 ES3.4,page3 of9 (lines2529)
Thisisessentiallythatsameas,andredundant to,whatisonpage2,lines2226.
Eliminateredundancy.
Changemadeinaccordancewiththe recommendation.
69 ES3.4,page3 of9 (lines3133)
Regardinguseofsurrogatesregional managementshouldhavetheauthorityto permittheuseofsurrogatesinorderto streamlineperformanceoftheoperatingtest withoutNRRinvolvement.Thiswouldincrease efficiency.
Eliminateneedtoconsultwith NRRonuseofsurrogatesto streamlineperformanceofthe operatingtest.Recommend replacementwithregionalbranch chiefconcurrence.
Nochange.NRRoperatorlicensingprogram tracksthistypeofinformation.Itshouldnot takelongtogetconcurrencenorimpactthe examadministrationschedule.
70 ES3.4,page4 of9,Table3.4 1
Rev12leavesonlyEOPBasedCTsavailableto meettheatleast2criteria.Maintainingthe requirementtohave2CTsperscenariowhile removingalargebatchofwhatconstitutesa CTwillmakescenariospotentiallylongerand morecomplicated.Inaddition,consideringa CTfailurewillresultinacriticalperformance deficiency(CPD)andanautomaticfailureof theoperatingexam,existingCTsthatarenot commensuratewithapenaltyofthisseverity willlikelynotbeappliedinfutureinitial licensingexaminations.Forexample,atsome BWRstations,insertingamanualscramona 2ndcontrolroddriftiscategorizedasacritical task.Thesafetysignificanceisavoiding potentialfueldamageduetoanunanalyzed controlrodpattern.Thisseemslikelytobe omittedasaCTonRev.12basedexamsdueto theseverepenaltynotaligningwiththesafety significance(i.e.,potentialfueldamage).
RecommendchangingCTcriteria toatleast1(versus2)per scenariosincethepopulationof eventsinatypicalscenariothat canresultinacriticaltaskhave beenreduced.
Additionally,limitingthemaximum numberofCTsto2wouldreduce thelikelihoodofhavingscenarios thataretoolongorcomplexand mayhelpinconsistencyduring scenariodevelopment.
Nochangewasmade.TheCTcriteriainRev12 willnotmakethescenarioslonger.The concernwithhavingoneCTperscenariomeans thatsomeapplicantsmightnotreceiveaCT.
TheNRCchiefexaminerhastheabilityto controlthescenariosiftheyaregettingtoolong orcomplex.ThemajorityofRevision11CTs shouldstillbeusable.Themajorchangetothe CTmethodologywasremovingunintentional reactorprotectionsystem(RPS)orESF actuationsfromthelistofwhatqualifiesasa postscenarioCT.
71 ES3.4,page4 of9,Table3.4 1(line3)
Thereisnodefinitionastowhatconstitutesa scenariosetasitappliestocontingency EOPs.Therequirementisforonecontingency EOPperscenarioset,buttheresnothingthat clarifiesifthatmeanseachoperatormustbe evaluatedwithascenariothatcontainsa contingencyEOP.
Recommendaddingastatement identifyingascenariosetmeans thescenariostheindividual operatorwillseeandnotthesetof scenariosselectedfortheoverall class.
Nochangewasmade.Scenariosetisdefinedin ES8.TheRev12requirementis:OneEOP contingencyrequiredperscenarioset,notone EOPcontingencyperscenarionorperapplicant.
Thesearetargetsbutascenariomayalsobe acceptablewithoutmeetingallofthetarget numbers.Thisisalsoforexaminationsecurity topreventapplicantsfrom"expecting"anEOP contingencyprocedure.
72 ES3.4,page4 of9,Table3.4 2
Havingatleast1ManualControlofAutomatic FunctioneventforROandSROIapplicants representsanewrequirementascomparedto Rev.11.Therewouldbebenefittoincluding additionalguidanceonwhatfallsintothis category.
Addadditionalguidanceonwhat qualifiesasmanualcontrolofan automaticfunction.Forexample, doesplacingthebackupEHC pressureregulatorinservice qualify?
ThisisnotanewrequirementforRev12, insteadanexistingRev11elementofscenarios (fromtheROcompetencychecklist)thathas beenrelocatedtothelistofeventsand evolutionsforeachapplicant(seeES301page 16of33).Additionalguidancehasbeenadded forthisitem(seeDispositionforcomment#63).
73 ES3.4,page5 of9(lines38 40)
Thelastsentenceinthisparagraphstatesthe ODCMcannotbeusedtomeettheminimum TSevaluationrequirement.CantheTRMbe usedtomeetthe minimumTSevaluationrequirement?
ClarifywhethertheTRMcanbe usedtomeetminimumTS evaluationrequirements.
Nochangewasmade.Clarificationisalready providedintheglossarydefinitionofTSwhich includesTRM.
74 ES3.5,Page1 of13(line40)
Page11of13 (lines21and 33)
Page12of13 (lines43and 46)
ThetermerrorisusedinseveralcasesinES 3.5.Shouldperformancedeficiencybeused instead?
Clarify/modifyasnecessary.
RevisedES3.5toreplacetheterm'error"with "performancedeficiency."
75 ES3.5,page1 of13(line29)
ThelastsentenceinsectionA.2ismissing somewords.ItshouldprobablystateObtain concurrencefromtheNRRoperatorlicensing programofficeifmorethan30dayswillelapse betweenthecompletionofoneandthestart oftheother.
Modifyasnecessarybyadding obtainandiftothesentence ashighlighted.
Changedmadeinaccordancewiththe recommendation.
76 ES3.5,page2 of13(line1)
Thisstatementseemstobeunnecessarysince itisokaytodoiteitherway.Additionally,the exceptiontotheexaminerofrecord administeringeachJPMtotheirassigned applicantisaddressedinPartH(Specific instructionsforadministeringJPMs).
Considerremovingthisstatement. Deletedstep4onpage1of13.
77 ES3.5,page2 of13(lines13 15)
Thisshouldbeincludedinthe development/reviewprocessandnothere.
Considerplacinginthe development/reviewprocess.
Movedstep7tochecksimulator differences/deficienciesfromES3.5toES2.3 fortheNRCchiefexaminertocheckduringop testreview.
78 ES3.5A.9, Page2of13 (line2729)
R12ES3.5A.9preventsthefacilitylicensee fromaudioorvideorecordingtheoperating test.Videorecordingsdonotnecessarily requireadditionalobserverstoobtainthe recordingandrecordingscanbecontrolledto satisfyexaminationsecurityrequirements.
Considerremovingthisrestriction.
Nochangewasmade.TheNRCdoesnothavea clearprocessforhowtousevideotaped scenariosafterexaminationadministration.
Additionally,stateshavedifferentlawsfor allowingvideotapingsothismaynotbe implementedconsistentlyacrosstheregions.
79 ES3.5,page2 of13(line35)
ThiswordingwouldimplythatonlytheChief Examineradministerstheoptest.Thisshould probablyread:"Ensurethateachapplicant identifiedonForm2.21,"ListofApplicants,"is administeredtheapplicableportionsoperating testspecifiedontheform."Consider combiningwithitem13listedbelow.
Considercombiningwithitem13.
Mergedthisstatementnumber11with statementnumber13.
80 ES3.5,page3 of13(line2)
Thisneedstobemorespecificastowhat materialsthissentencerefersto.
Considermakingthisstatement morespecific.
Nochangewasmade.Thisismaterialthat supportsthelicensingdecision.MD3.53has moreinformationonrecordingkeeping.
81 ES3.5,page3 of13(lines13 16)
Thisshouldbemovedtothenextsectionasit appliestoallexaminers.
Considermovingtothenext section Changemadeinaccordancewiththe recommendation.
82 ES3.5,step7, page4of13 (line24)
Grammar/typoremovethat Anapplicantmayrequestthatthe administrationofhisorheroperatingtest without24extraneousobservers.
Removethatfromitem#7.
Changemadeinaccordancewiththe recommendation.
83 ES3.5,page4 of13(line29)
MovethecontentofES3.4SectionB.2tothis standard.
ConsidermovingcontentofES3.4 SectionB.2.
Nochangewasmade.Thisinformationis importanttoremaininES3.4whenplanning howmanyscenariostodevelop.
84 ES3.5,page9 of13(line20)
Grammar/typoinsection16.a-perform shouldbeperformed Verifythateachexaminerobservedthathis orherapplicantperformtherequired20 numberoftransientsandeventstoallow adequateevaluationofallrequired21 competencies.
Changeperformtoperformed. Changemadeinaccordancewiththe recommendation.
85 ES3.5,page9 of13(line42 44)
ES3.6,page5 of28(lines12 13)
ThisstatesanSPDexistsifanavoidable emergencyactionlevelentryorescalationis reached.
AnerrorresultinginEALentryorescalationat theUnusualEventleveldoesnotrequire staffingtheemergencyresponsecentersor haveincreasedsafetyconsequences.
ConsiderathresholdofALERTor higherformeetingthecriteriaof anSPD.
TheNRCagreeswiththecommentandhas changedthethresholdforSPDsto entry/escalationtoanAlertorhigherbutless thantheCPDcriteria.ChangemadeinES3.5 andES3.6forSPD.
86 ES3.5,page9 of13(line32 40)
ES3.6,page5 of38(lines5 10)
ThenotestatesthatsubsequentRPS/ESF actuationsthatdonotalterequipment alignmentsarenottreatedasadditional significantperformancedeficiencies.Other examplesthatshouldntbeconsideredanSPD wouldbesinglechannelactuationsorhalf scrams.Thesewouldnotalterequipment alignmentsoronlyopenreactortripbreakers thatwouldnotresultinanautomaticscram.
Considerrevisingcurrentnoteor addanadditionalnotethatsingle channelactuationsorhalf scramsshouldnotbeconsidered anSPD.
AddednoteforthispartofES3.5forSingle channelRPS/ESFASactuation.
87 ES3.5,page9 of13(line46 47)
ES3.6,page5 of38(lines15 16)
ThisstatesanSPDexistsifperformance deficienciesresultinanunplannedpower changeofmorethan10percentratedthermal power.TheintentisthattheSPDisdueto inadequatepowercontrol.Attimesunit supervisorscoulddirectreducingorcontrolling poweratalowerpowerleveldueto conservativedecisionmaking.Conservatismis anoperatorfundamentalthatisstrongly reinforcedbytheutilitytrainingprograms.
Consideraddingastatementthat placingtheplantatalowerpower levelasaresultofconservative decisionmakingwouldnotapply tothiscriterion.
AddednoteforthispartofES3.5/ES3.6for unplannedpowerchanges.
88 ES3.5,step 17,page10of 13(lines14 18)
Aswritten,step17maycauseconfusion.
Ifasimulatorscenarioincludesemergency planeventclassification,becausethesimulator operatingtestsfortheinitiallicensing examinationareconductedwithonlyone applicantintheSROposition,theNRCdoes notrequiretheSROapplicanttocompletean emergencyclassificationwithinthenormal eventclassificationperiodoftime.The scenariodoesnotneedtoincludeevent classification.
Toaddclarity,considermodifying withthefollowingwording; Sincethesimulatoroperating testsfortheinitiallicensing examinationareconductedwith onlyoneapplicantintheSRO position,theNRCdoesnotrequire theSROapplicanttocompletean emergencyclassificationwithinthe normaleventclassificationperiod oftime.Thescenariodoesnot needtoincludeevent classification.
Changemadeinaccordancewiththe recommendation.
89 ES3.5,page 11of13(line 15)
ThisissomethingthatshouldbepartoftheES 1.2briefingnothere.Thisissomethingthe applicantshoulddowithoutbepromptedor encouragedduringtheexamadministration.
Considerremovingfromthis section.
Stephasbeenrevisedasfollows:deletedthe statementabouttheexaminerencouragingthe applicanttousereferencematerialsincethisis containedinES1.2.
90 ES3.6,Section B.4.a ThediscussiononCriticalPerformance Deficiencies,statesthatasignificant performancedeficiency(SPD)includes performancedeficiencies(PDs)resultingin unplannedpowerchangesofmorethan10 percentratedthermalpower.Thisseemsto indicatethatactinginaconservativemanner toreducetheenergystateofthereactorcould resultinaSPD.Isthistheintentofthe statement?Thestatementseemstobeopen forawidevariationininterpretation.
Provideclarificationontheintent ofthisstatement.
InES3.5andES3.6,anotewasaddedthat placingtheplantatalowerpowerlevelasa resultofconservativedecisionmakingwould notbeaSPD(seecomment#87).
91 ES3.6, throughout PDandPDsareusedthroughoutthis section,asisperformancedeficiency.CPD andSPDareincludedintheAbbreviationsand Acronymssection,butPDisnot.
AddPDtoAbbreviationsand Acronymsforconsistency.
Changemadeinaccordancewiththe recommendation.
92 ES3.6,page4 of27(lines35 40)
Thisparagraphintroducesgradingsubjectivity, especiallyifthecriticaltaskwas met/completed.PDssuchasprocedureusage orplacekeepingerrorsorinterventionby othercrewmembersmaybegradedasaCPD.
Inmanycases,theremaybenowayto determineiftheapplicantwouldhavecaught andcorrectedtheerrorinareasonable amountoftimeduringthescenario.Whilewe recognizethattherewillbealevelof judgementbytheexaminerwhenevaluatinga performancedeficiencyinthisarea,thiswill likelyleadtoadditionalcandidateappealsifa CPDisassigned,resultinginautomatic simulatorexaminationfailureevenifthe associatedCTitselfwascompleted.Theremay havebeenanopportunityforthecandidateto selfidentifyandcorrecttheerrorwithoutthe interventionbutcontrolroomteamsare trainedandexpectedtoimmediatelycoach andcorrectbehaviorswhenstandardsarenot beingmetorerrorsareidentified.Additionally, thischangemayresultinlesschallenge betweencontrolroomteammembers.
Considerthefollowing recommendationstothisareato reducesubjectivitytobenefit examinersandtoaccountforthe increased safetysignificance.
APDassociatedwithperformance ofactionsinsupportofcompleting aCTrequiringinterventionby othercrewmemberstocomplete theCTwouldbeanSPDifthe applicantwouldnothavebeen abletoidentifyandcorrectthe errorinatimelymanner(i.e.,
beforetheCTwouldbe unrecoverable).
Nochangewasmadeastherecommendation createsamorecomplicatedgradingrubric.The NRCevaluatestheindividualperformanceof applicants.Regardingtheconcernthat applicantsmaybelesswillingtocoachor assistantoneanotherhasimplicationsforthe performanceevaluationoftheothercrew members.
93 ES3.6,page5 of27(line12)
Thisshouldbeclarifiedtoindicateapplicability toentry/escalationnotinvolvinglossof multiplefissionproductbarriers(whichwould beaCPD)
Consideraddingclarification.
AddedstatementforSPDcriterionto distinguishfromCPDcriteria.
94 ES3.6Page6 of27(line16)
Page8of27 (line6)
Page9of27 (lines6and9)
ThetermerrorisusedinseveralcasesinES 3.6.ShouldPDorPerformancedeficiency beusedinstead?Orinsomecases,errorcan beeliminatedfromthesentence.
Clarify/modifytheuseoferroras desiredandremovethewordfor onpage6,line16.
Changemadeinaccordancewiththe recommendation.
95 ES3.6,page6 of27(line17)
CPDsshouldnotbeassignedto understandingRFs.Theapplicantneedsto demonstratetheinabilitytotakeCTlevel safetysignificantactionstoresultinaCPD.
Shouldnotbebasedonfailingtoprovidea correctanswertoafollowupquestion.
RecommendnotallowingCPDsto beassignedtounderstanding RFs.
Nochangewasmade.Followupquestions mustbetiedtoanobservedPDsothisisnota standalonesituation.TheCPD/SPDcriteriais forobservedperformancenotfollowup questions.SeeES3.5EInstructionsforUseof Followupquestions.ACPDwouldnotbe assignedbasedonapplicantresponsetoa followupquestiononly.Thatwouldnotmeet theCTmethodologyinES3.3 Thefollowingareexamplesofperformance standardsthatcannotbemeasuredobjectively duringasimulatorscenarioand,therefore,are notsuitableforCTperformancestandards:
- understanding(suchasanapplicantmust understandthesignificanceofacertainplant response)
- observingthatanexpectedresponsehas occurred
- observingtheperformanceofasystem
96 ES3.6,page8 (line26)
ThedeparturefromnucleateboilingTS exampleprovidedisPWRspecific.Maybe beneficialtouseanexamplethatappliesmore genericallytootherreactortypes.
ConsiderusingaTSexamplethatis applicabletoallreactor technologies.
ExamplewasaddedforBWRplantsinES3.6.
97 ES3.6,page8, 9
WithonlythreeRFpointstoworkwith,the allowancetoassignmultiplePDsforeachTSin asingleeventisnotproportional.EachTS eventshouldbelimitedtoonePDnormally.
Considersimplifyingandadjusting gradingcriteriadescribedinthis section.
Nochangewasmade.Theinstructionsstate, "EverymissedTSentryrepresentsaPD,except formissedTSentriesthatfallunderRF6.a, whicharelimitedtoonePDperTSevent."PDs inTSspacecanalsobeassignedtoother Competencyareas.TSeventsaretreatedlikeall othereventsinthattheremaybemorethan oneopportunityforaPDsineachevent.IfTS weregradedwithonePDperTSevent,then therewouldbeasituationwheresome applicantsmaynevergetmorethantwo opportunitiestomakeaPDandthereforecould notbegradedlowerthan2onTScompetency.
Anothercontrolinplaceisthatnoerroris carriedforwardforindividualTSevents.
98 ES3.6,page 10(line35)
TheassignmentsofCPDs(orevenSPDs)in Communicationsseemsexcessive.All communicationserrorsshouldbeassessedasa PDafterthefirstone.Thismaymakegrading simplerandmoreconsistent.
Considersimplifying communicationscompetencyRFs.
ThechangewasmadesoallcommunicationPDs willbegradedusingtheRev11criteriafor communicationPDs.
99 ES3.7 Page1of1 ThecurrentexemptionsfortheAP1000 providesaconditionwhenthealternative compliancemeasuresendwhenthesite10 CFR52.103(g)findingisissued.
Italsoallowsforusingactualplantequipment forinplantJPMsasitbecomesavailable duringtheconstructionphase.
Recommendaddingbothofthese itemstothissection.
Addedadditionalinformationaboutusing alternativeJPMS.Theallowancetouseactual plantequipmentalreadyexiststhroughthe "normal"JPMinstructionsinES3.2.
100 ES3.7,page1 (line21)
StepA.4-aperiodismissingfromtheendof thesentence.
Addperiod.
Changemadeinaccordancewiththe recommendation.
101 ES4.2B.3, Page3of29 (line1922)
InR11ES401D.2.a,deviationsfromthe previouslyapprovedexaminationoutline requiredadiscussionoftheproposed deviationwiththeNRCchiefexaminerto obtainreplacementK/As(ifneeded).R12ES 4.2B.3providesexamplesofwhendeviations mayberequiredandseemstorequire documentationonly.
Confirmthatdiscussionwiththe NRCchiefexaminerisnolonger requiredtodeviatefromthe examinationoutline.
ThefollowingchangewasmadetoES2.1to clarifythatNRCchiefexaminerpermissionis stillrequiredtodeviatefromtheapproved outline:Anytimeitbecomesnecessaryto deviatefromthepreviouslyapprovedwritten examinationoutline,contacttheNRCchief examinerforconcurrenceontheneedto deviateandrequestareplacementK/A.The NRCchiefexaminerwillrandomlyselectand provideareplacementK/A.Theexamination authormustdocumenttheeliminatedK/A statementsonForm4.11,orequivalent,with anexplanationofwhytheK/Awasrejected.
Alsoaddedtokickoffcalllistoftopics(ES2.1) fortheNRCchiefexaminerandthelicensee pointofcontacttodiscussexpectationsfor deviatingfromtheapprovedwritten examinationoutlineandselectingreplaceK/As.
Section4,WrittenExaminations
102 ES4.2B.4, Page3of29 (line2425)
R11ES205Dclarifiesthatquestionsusedon theGFEshallconformtotheapplicable constructionandstyleguidelinesinAppendix B.Theexaminationshallinclude40questions takendirectlyfromtheNRCsGFEquestion bankfortheapplicablevendortype,5 questionsthatarederivedfromexistingbank questionsbymakingoneormoresignificant modifications,and5questionsthatarenewly developed.ES4.2B.4containsgeneric requirementsforexaminationquestion selectionfromexaminationbanks.Itisnot clearwhatruleswillapplytoTheoryquestion developmentunderR12.
ConsiderclarifyingES4.2B.4by modifyingthefollowingstatement, ThisdefinitionincludesNRC examinationquestionsusedat otherfacilitylicenseesitesandthe NRCsGFEquestionbank.
Thefollowingchangewasmade:Added clarificationforGFEexambankinES4.2.This definitionincludesNRCGenericFundamentals Examination(GFE)bankquestionsandNRC examinationquestionsusedatotherfacility licenseesites.
103 ES4.3,Page3 of6(line1),
page5of6 (line111),and ES4.4,page3 of6(line22)
Whatisthepurposeorvalueofdeveloping andprovidingaseatingchart.Ihavenever hadaneedorreasontolookattheseating chartfollowingtheexamnorisitrequiredto beretained.
Considerevaluatingtheneedfor providingaseatingchart.
Nochangewasmade.Thischangeisoutsidethe scopeofthisrevision.
104 ES4.4,C,3,g
- Page5of6, Line31 Thereappearstobeamissingsectionheader betweenitemf.anditemg.Inrevision11the headerisGradetheExaminations.
RecommendaddingGradethe Examinationasitem4,and renumbersubsequentsteps.
Nochangewasmade.ForRev12,wording changedfrom"grading"to"reviewofgrading" becauseusuallythefacilitylicenseegradesthe writtenexaminationinaccordancewith 55.40(b)Powerreactorfacilitylicenseesmay prepare,proctor,andgradethewritten examinationsrequiredby§§55.41and55.43.
105 ES5.1,Page1 of20,Line16 and17 TheproposedchangestoES3.6nowdefines criticalperformancedeficienciesand significantperformancedeficiencies,sothe previousexamplesofdeviationsfromnominal gradingpracticesmaynolongerbeaccurate.
Recommenddeletingasimulator failurebasedonasingleerrorwith serioussafetyconsequencesor fromthisparenthetical.
Nochangemade.ThegradingcriteriaforCPDs waschangedfollowingpubliccommentperiod.
106 ES5.1,D,3 page5of20, Line2 Missingcloseofquotationattheendof SamplePassLetter.
Recommendaddingclosing quotationmarkfollowingtheword Letter.
Changemadeinaccordancewiththecomment.
107 ES5.1,D,3 Page5of20, Line11 Duringthecoldlicensephasethetime betweenreceivingaPassLetterand completingalltheelementsof10CFR55.31 wasprolonged,socandidateswereenrolledin aSATbasedcontinuingtrainingprogramwhile completingtheitems.
Recommendaddingadiscussion abouthowaPassLettercouldbe usedduringcoldlicensephase.
Additionally,addarequirement forthosecandidatestoenteraSAT basedcontinuingtrainingprogram if thatisappropriate.
Nochangewasmade.TheNRChasproposedto addarequirementforapplicantstoparticipate inaSATbasedcontinuingtrainingprogramin situationsdescribedbythecommenter.The proposedchangesaredescribedinRegulatory BasisforPublicComment(ML20149K680),
AppendixE.ProposedchangestoNUREG1021 thatwouldbemadeiftheruleisimplemented, includingchangestothepasslettertemplateif determinedtobenecessary,willbeavailableto thepublicforcommentwhentheproposedrule isissuedforpubliccomment Section5,PostExaminationActivitiesandOtherLicensingActions
108 ES5.3,A,1,b Page2of12, Line14 IfcoldlicensephasecandidateswithPass LettersareenrolledinaSATbasedcontinuing trainingprogramthatisbasedonatypical licenseoperatorrequalificationtraining program,thefirstclassarelikelytobeinthis programfortwoyears.Clearlystatewhenthe requirementtobeginrequalificationexams begins,fromtheentryofthefirstclassintothis programorfromtheissuanceofthefirst licenses.
Recommendclearlystatingthat therequirementtobegin requalificationexamsbeginsfrom theissuanceofthefirstlicenses.
Nochangewasmade.Makingthis recommendedchangeinRev12maycontradict futurerulelanguageforthisissue(See comment#107).TheNRCstaffisconsidering updatingguidanceonthisissueinNUREG1021 aspartoftheParts50and52rulemaking.
109 ES6.1,step5, page8of33 (line21) postexaminationshouldbehyphenated.
Changepostexaminationto postexamination Changemadeinaccordancewiththe recommendation.
110 ES6.1,H.2.c andd,Page14 of33 Regardingfirstandsecondretakes,the documentdoesnotspecifywhetherasecond retakeisrequiredfollowingpassingthefirst retake.
NotethatthisisnotachangefromES605 (page13),anditimpliesasecondretakeisnt necessaryfollowingpassingofthefirst,but maybeaddedintheinterestofclarity.
Consideraddingastatementthata secondretakedoesnotapply followingsuccessfulcompletionof thefirstretake.
Thefollowingchangewasmade:Added clarificationIfthesecond(firstretake) examinationwasfailed,theNRCwillnormally administerathird(secondretake)examination approximately6monthsafterissuingthe secondfailure.
111 ES6.1,Page 15of33(line 21)
Form6.11Hasnotitledescription Includeformtitle.
Changemadeinaccordancewiththe recommendation.
112 ES6.1,Page 15of33(line 46)
Form6.16Hasnotitledescription Includeformtitle.
Changemadeinaccordancewiththe recommendation.
113 Form6.13,ES 6.1Page20of 33 PreexaminationandPostexamination shouldbehyphenated.
ChangePreexaminationand PostexaminationtoPre examinationandPost examination.
Changemadeinaccordancewiththe recommendation.
Section6,RequalificationExaminations
114 ES6.1,Page 23&24of33 UnderIII.Quality,ExamSectiongoesfrom;A.
SamplePlantoC.Walkthrough Itappearsthatthereshouldbeanothersection for;B.WrittenExam Movetheguidanceforwritten examqualityfromrevision11to revision12.
SectionBhasbeenaddedfromES601.
115 ES6.1,Page 26of33 Thepagenumbershows2of33versus26of 33.
Correctthepagenumberto26of 33.
Changemadeinaccordancewiththe recommendation.
116 ES6.1,Form ES6.14,Page 21of33 Therequiredminimumnumberofopen referencewrittenexamitemsis700questions, 350persection.Duringcoldlicensingand initialoperatingcyclefornewconstruction plantsa700questionexambankrequiresa significantamountoftimeandresourcesto accumulate.Thisismoredifficultconsidering thehigherlikelihoodofdesignchangesduring constructioncompletion.
Recommendaddinganallowance fornewplantstosubmitthe availablequestionsintheirbank.
ThissectionisforNRCconducted requalificationexaminationsonly.Thischange fornewreactorsisoutsidethescopeofRev12 objectivesandwillbeconsideredinfuture revisions.AsstatedinES6.1,"TheNRCwill considerpreferentiallyusingthefacility licenseesrequalificationexaminationstructure ormethodologyifitisdifferentfromthat describedhereinprovidedthatitcomplieswith 10CFR55.59,Requalification,andisfreeof significantflaws."
117 ES6.1,Form ES6.14,Page 21of33 Therequiredminimumnumberofjob performancemeasuresis95,plus10peryear followingtheinitialrequalificationexamuntil thejobtaskanalysisisfullycovered.The writtenexambankandscenarioexambank haveuppersizelimits.ES6.3, B.1.d(onpage3of7ofES6.3)onlyrequiresa representativesampleofJPM,andstatesthat theNRCanticipatesthatbankwillbe approximately125to150JPMs.Duringcold licensingandinitialoperatingcyclefornew constructionplantsa95JPMbankrequiresa significantamountoftimeandresourcesto accumulate.Thisismoredifficultconsidering thehigherlikelihoodofdesignchangesduring constructioncompletion,andfurther complicatedbytheuseofalternativemeans describedinSection3.7forcoldlicenseJPMs.
Recommendchangingtherequired JPMbanksizetomatchES6.3,of approximately125to150JPMs.
Alsorecommendaddingan allowancefornewplantstosubmit theiravailableJPMbankat submittaltime.
ThissectionisforNRCconducted requalificationexaminationsonly.Thischange fornewreactorsisoutsidethescopeofRev12 objectivesandwillbeconsideredinfuture revisions.AsstatedinES6.1,"TheNRCwill considerpreferentiallyusingthefacility licenseesrequalificationexaminationstructure ormethodologyifitisdifferentfromthat describedhereinprovidedthatitcomplieswith 10CFR55.59,Requalification,andisfreeof significantflaws."
118 ES6.2,A,Page 1of24Lines 13thru21 ThissectiondiscussesthatthePlantand ControlSystemssectionoftheexam(section A)isadministeredusingastaticsimulator.
ThereisanentryaboutthisintheNRC OperatorLicensingProgramFeedbackpage.It acknowledgesthatthisexamstylewas developedbyaworkinggroupin1987,but thatsomelicenseesstoppedusingthatformat sincetheNRCshiftedtoaninspectionbased oversightprogramin1994.Theentryallows thattheNRCwillconsiderusingthefacility licenseesrequalificationexamination structureormethodologyifitisdifferent, provideditcomplieswith10CFR55.59andis freeofsignificantflaws.Section6.1,B,2nd paragraphsaysthat[T]theNRCwillconsider preferentiallyusingthefacilitylicensees requalificationexaminationstructureof methodologyifitdiffersfromwhatis describedhereifitcomplieswith10CFR55.59 andisfreeofsignificantflaws,butdoesnot specificallydiscusstheuseofstaticexam questions.Italsorequirestheregionalofficeto consultwithNRRoperatorlicensingprogram officepriortomakingthisdecision.
Incorporatetheclarification providedintheOperatorLicensing ProgramFeedbackintoES6.2to improvetheclarityandintentof thissection:Asdiscussedin SectionCof[ES6.1],ifafacility licenseesrequalificationprogram usesanexaminationstructureor methodologydifferentfromthat describedinthe[ES6]seriesand theNRCdecidestoconductan examination,theNRCwillconsider preferentiallyusingthefacility licenseesrequalification examinationstructureof methodologyifitisdifferentfrom thatdescribedintheES,provided itcomplieswith10CFR55.59and isfreeofsignificantflaws.State thattheplantandcontrolsystem sectionofthewrittenexamis allowedtobetestedinthesame mannerastheAdministrative Controls/ProceduralLimits withoutpriorapproval.
Nochangemadebecausethisisoutsidethe scopeofthisrevision.Additionally,this statementexistsinES6.1andappliestoES6.2 aswell:TheNRCconductedrequalification examinationnormallyconsistsofthreeparts, includingatwosectionopenreferencewritten examination,awalkthroughevaluation,anda dynamicsimulatorevaluation.ES6.2,ES6.3, andES6.4furtherdescribethethree examinationparts.TheNRCwillconsider preferentiallyusingthefacilitylicensees requalificationexaminationstructureor methodologyifitdiffersfromthatdescribed here,andifitcomplieswith10CFR55.59, Requalification,andisfreeofsignificant flaws.Theregionalofficeshallconsultwiththe NRRoperatorlicensingprogramofficeto determinetheappropriateexamination procedure.
119 ES6.2,D,1,d.
Page15of24 Line39thru47 Thereisnocleardirectionforhow digital/embeddedelectronicformatted proceduresareaddressed.Duringnormal operationcrewmembersroutinelycheck AlarmResponseProceduresorCriticalSafety FunctionStatusTreeindication,inadditionto theotherreferencematerialavailable.
Recommendclearlystatingthat thenormalaccesstothe digital/embeddedelectronic formatproceduresshouldbe provided.
Nochangemadebecausethisisoutsidethe scopeofthisrevision.Additionally,this statementexistsinES6.1andappliestoES6.2 aswell:TheNRCconductedrequalification examinationnormallyconsistsofthreeparts, includingatwosectionopenreferencewritten examination,awalkthroughevaluation,anda dynamicsimulatorevaluation.ES6.2,ES6.3, andES6.4furtherdescribethethree examinationparts.TheNRCwillconsider preferentiallyusingthefacilitylicensees requalificationexaminationstructureor methodologyifitdiffersfromthatdescribed here,andifitcomplieswith10CFR55.59, Requalification,andisfreeofsignificant flaws.Theregionalofficeshallconsultwiththe NRRoperatorlicensingprogramofficeto determinetheappropriateexamination procedure.
120 ES6.2,D,1,e.
Page16of24 Line6 Thelistofplantproceduresavailableasopen referencematerialincludesemergency operatingprocedures,abnormaloperating procedures,andnormaloperatingprocedures, butdoesnotincludealarmresponse procedures.
Recommendaddingalarm responseprocedurestothislist.
Nochangemadebecausethisisoutsidethe scopeofthisrevision.Additionally,this statementexistsinES6.1andappliestoES6.2 aswell:TheNRCconductedrequalification examinationnormallyconsistsofthreeparts, includingatwosectionopenreferencewritten examination,awalkthroughevaluation,anda dynamicsimulatorevaluation.ES6.2,ES6.3, andES6.4furtherdescribethethree examinationparts.TheNRCwillconsider preferentiallyusingthefacilitylicensees requalificationexaminationstructureor methodologyifitdiffersfromthatdescribed here,andifitcomplieswith10CFR55.59, Requalification,andisfreeofsignificant flaws.Theregionalofficeshallconsultwiththe NRRoperatorlicensingprogramofficeto determinetheappropriateexamination procedure.
121 ES6.3,page2 of7(line3)
Thesentencesystemsthatarethesubjectof NRCinformationnoticesisaseparatethought fromtheoneaboveandshouldbeaseparate bullet.
Makesentenceitsownbullet.
Changemadeinaccordancewiththe recommendation.
122 ES8,Glossary Page6of7 Lines20thru 27 Thereisadefinitionforsimulationfacility, whichincludesbulletsforaplantreferenced simulatorandacommissionapproved simulator.Thereisalsoaseparatedefinition foraplantreferencedsimulator,which includeshowitisusedinoperatorlicensing.
Recommendaddingaseparate definitionforacommission approvedsimulator,which includeshowitisusedinoperator licensing.
Addedapointerto10CFR55.4,"Definitions" forPRSandsimulationfacilitysothatthereis onlyoneplaceforthesedefinitions.
123 AppendixB Tier4Theoryisnewtothewritten examinationandpreviouslyusedgeneric examplesofreactorandthermodynamic theoryquestionsmayormaynotbe acceptableonfinallicensingexaminations.
Therewouldbeabenefittodeveloping examplestoinclude.
Addexamplesofplantspecific, operationallyvalidtheory questionstoAppendixBtoaidthe facilityExaminationAuthorsin developingsatisfactory operationallyvalidtheory questions(refertoNEIletteron GenericFundamentals Reintegration,Appendix1, Recommendation1,datedMarch 4,2020(ML20083F400).
Nochangewasmade.TheNRCadded someexamplesofTier4questionstoa generalOperatorLicensingProgram Feedbackitem.
124 General Comment Revision12,Severalblankpages Recommendremovingblankpages toreducedocumentsize.
Nochangewasmade.Blankpagesarerequired byNRCNUREGpublishingprocedures.
Other/Miscellaneous Section8,Glossary AppendixB,ExamplesofWrittenExaminationQuestions