ML18109A329

From kanterella
Revision as of 09:54, 17 June 2019 by StriderTol (talk | contribs) (Created page by program invented by StriderTol)
Jump to navigation Jump to search

Final Qa/Related Forms (Folder 1)
ML18109A329
Person / Time
Site: Susquehanna  Talen Energy icon.png
Issue date: 02/21/2018
From: Berryman B
Susquehanna, Talen Energy
To: Peter Presby
NRC Region 1
Shared Package
ML17138A109 List:
References
CAC U01950
Download: ML18109A329 (23)
v • d • e


Text

Brad Berryman Site Vice President Mr. Peter Presby USNRC Chief Examiner Susquehanna Nuclear, LLC 769 Salem Boulevard Berwick, PA 18603 Tel. 570.542.2904 Fax 570.542.1504 Brad.Berryman@TalenEnergy.com TALEN~ ENERGY 10 CFR 55.40 U. S. Nuclear Regulatory Commission

-Region 1 2100 Renaissance Blvd -Suite 100 FEB 2 1 2018 King of Prussia, PA 19406-2713 SUSQUEHANNA STEAM ELECTRIC STATION INTEGRATED INITIAL LICENSE TRAINING EXAMINATION REVISED UNIT 1 LICENSE NO. NPF-14 UNIT 2 LICENSE NO. NPF-22 PLA-7686 Docket No. 50-387 50-388

Reference:

I. SSES Letter (PLA-7660), "Susquehanna Steam Electric Station Integrated Initial License Training Examination Materials," dated December 14, 2017. Enclosed are the updated examination materials, which Susquehanna Steam Electric Station (SSES) is submitting in support of the Initial License Examination scheduled for the weeks of March 5th and March Ii\ 2018, at SSES. This transmittal contains an update to the materials previously submitted under Reference

1. The updates provided are based on discussions with the NRC Chief Examiner.

This submittal includes the Senior Reactor Operator and Reactor Operator Written Examinations, Job Performance Measures, and Integrated Plant Operations Scenario Guides. These examination materials have been developed in accordance with NUREG-1021, "Operator Licensing Examination Standards," Revision 11. Please note that reference materials are attached to each individual examination question or item. In accordance with NUREG-1021, Revision 11, Section ES-201, please ensure that these materials are withheld from public disclosure until after the examinations are complete.

Should you have any questions concerning this letter, please contact Drew Rodgers, Operations Training Manager, at 570-542-6713.

For questions concerning examination materials, please contact Michael Wilcox, Examination Author, at 570-542-3783.

This letter contains no new regulatory commitments.

B.

Enclosures:

-RO/SRO Composite Examination with references attached USNRC -Region I PLA-7686 Enclosure 2 -Control Room Systems and Facility Walk Through Job Performance Measures with references attached Enclosure 3 -Administrative Topic Job Performance Measures with references attached Enclosure 4 -Integrated Plant Operations Scenario Guides Enclosure 5 -Operating Test Quality Checklist (Form ES-301-3) -Simulator Scenario Quality Checklist (Form ES-301-4) -Transient and Event Checklist (Form ES-301-5) -Competencies Checklist (Form ES-301-6)

Enclosure 9-Written Exam Quality Checklist (Form ES-401-6)

Enclosure IO-Examination Security Agreements (Form ES-201-3)

Enclosure 11 -Record of Rejected K/As (Form ES-401-4)

Copy: (without attachments)

NRC Document Control Desk L. Micewski, NRC Senior Resident Inspector T. E Hood, NRC Project Manager ES-201 Examination Preparation Checklist Form ES-201-1 Facility:

Susquehanna Date of Examination:

03/05/2018 Developed by: Written: Facility [ZJ NRC D II Operating:

Facility [ZJ NRC D Target Task Description (Reference)

Chief Examiner's Date* Initials -240 1. Examination administration date confirmed (C.1.a; C.2.a-b).

For NRC-prepared exams, arrangements are made for the facility to submit reference materials (C.1.e; C.3.c; Attachment 3). -210 2. NRC examiners and facility contact assigned (C.1.d; C.2.f). 3. Facility contact briefed on security and other requirements (C.2.c). As applicable, the facility -210 contact submits to the NRC any prescreened K/As for elimination from the written examination outline, with a description of the facility's prescreening process (ES-401, D.1.b). -210 4. Reference material due for NRC-prepared exams (C.1.e; C.3.c; Attachment 3). 0 N/A -210 s. Corporate notification letter sent (C.2.e). 6. NRC-developed written examination outline (ES-401-1/2 or ES-401N-1/2 and ES-401-3 or -195 ES-401N-3) sent to facility contact (must be on the exam security agreement) (C.1.e-f; C.2.h; C.3.d-e).

-150 7. Operating test outline(s) and other checklists due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-5, and ES-D-1, as applicable (C.1.e-f; C.3.d-e).

-136 8. Operating test outline(s) reviewed by the NRC and feedback provided to facility licensee (C.2.h; C.3.d-e).

9. Proposed examinations (written, JPMs, and scenarios, as applicable) and outlines (Forms ES-301-1, -75 ES-301-2, ES-D-1, ES-401-1/2 or ES-401N-1/2, and ES-401-3 or ES-401N-3);

supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, ES-401-6, ES-401N-6, and any Form ES-201-2 and ES-201-3 updates);

and reference materials due (C.1.e-h; C.3.d). -75 10. Examinations prepared by the NRC are approved by the NRC supervisor and forwarded for facility N/A licensee review (C.1.i; C.2.h; C.3.f-g).

-60 11. Preliminary waiver/excusal requests due (C.1.m; C.2.c; ES-202). -SO 12. Written exam and operating test reviews completed (C.3.f). -35 13. Examination review results discussed between the NRC and facility licensee (C.1.i; C.1.k-1; C.2.h; ,;&:? C.3.g). The NRC and the facility licensee conduct exam preparatory week. -30 14. Preliminary license applications and waiver/excusal requests, as applicable (NRC Form 398) due (C.1.m; C.2.i; ES-202). A -14 15. Final license applications and waiver/excusal requests, as applicable (NRC Form 398), due and Form ES-201-4 prepared (C.1.m; C.2.k; ES-202). -7 16. Written examinations and operating tests approved by the NRC supervisor (C.2.j-k; C.3.h). -7 17. Request facility licensee management feedback on the examination (C.2.1). 18. Final applications reviewed; one or two (if more than 10) applications audited to confirm -7 qualifications/eligibility; and examination approval and waiver/excusal letters sent (C.2.k; Attachment S; ES-202, C.3.j; ES-204). -7 19. Proctoring/written exam administration guidelines reviewed with facility licensee (C.3.k). A .... -7 20. Approved scenarios and job performance measures distributed to NRC examiners (C.3.i). '2

  • Target dates are based on facility-prepared examinations and the examination date identified in the corporate notification letter~ These dates are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.

0 ES-201 Examination Securi!Y~reement Form ES-201-3 1. Pre-Examination I acknowledge that I have acquired specialized knowledge ahout tf:e US. Nuclear Regulatory Commission ,NRC) licensing examinations scheduled for the week(s) of J *:. , 7 -3 ;~ *i 7 as of the date of my signature I agree that I wffl not knowingly divt.lge any information about these examinations to any persons who have not been authorized by the NRC's chief examiner.

I understand that I am not to instruct, evaluate.

or provide performance feedback !o those applicants scheduled to be administered these licensing examinations from this date until completion of examinatior.

administration, except as specifically noted below and authorized by the NRC (e.g .. acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or Indirect feedback).

=ur1hermore.

I am aware of the physical security measures and requirements (as documented in the facility licensee*s procedures) and understand that violation of :he conditions of this agreement may result in cancellation of tr,e examinations and/or an enforcement action against me or the facility licensee.

I wilf immediately report to facility management or :he NRC's chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination m To the best of my knowledge i did net divulge to any unauthorized persons any inforrraticn concerning thc: NRC licensing examinations administered rv during !t,e week{s} of---*--**--**__

From the dale that I entered ,rto this security agreement until the con';)/e1ion of examination ad,ninistration.

laid o nol i'1s!ruct, evaluate.

or r,rovide pertocrr1ar.ce feedbaci<.

~o those aoolicw1ts who were acministereo tf1ese ioensing exarn1natiorn,, except as ""'°"m,..,,1,,, -o noted below ano autl1crized by the NRC. ru 75 PRINTED NAME JOB TITLE!RESPOI\/SIBIUTY SIGNATURE

,'.1J DATE SiGI\IATURE (2) DA""F: f\OT!: w .... 0 1. lil -~ : .. ,4f_.::__;.,.J1~,cf

2. f'Ac;_ !>
.HA"" _ 3 . ..
fi,.!:',_ac.:p?x:: . 4.C~e,.lLv.;..S

~I:'.. ~filwj~dL 7.~ a.cs B.~~ ;o.~D;¥~ 11~ "'>};!NJ 12. arb** 1-.. J. 13. {)'lA~ 2. 'fO\:;.TV:I 14._~.l.H:\~C..

?,"'-15 ~)+/-_-~ /...f AC t: !(,t"" 4-,: 1t.<<, t ;,cl.1rr"'..1;.._'f

(* ,>.-~ **'tt.,-~+;/\

-~ -"..l:u * .J* £........

futb,, c 06,.l:);.

~-1.llM.~T.~L .i=..Clbill~-4f?~~-

s*.Tµvt..t'f!2p

___ <c~& __ _ _.z;c..c, l..V?W2 . ---Pw J *1-' )~ -sR.* -zx~*J-c~-

-51l12'/_

,* .,,_ r -------_ _E_c~.AL.l~A";"f)~

--_ ft /J~;;~ -------~*J:'?L~"':S'G.t$

~floj ,10)1clubll 11 L--.. r * .. ""', -,tt t,.._..,.::::-:o--

_.L ;fa,.. ' L *"50-i7 .,11. I--... 0 -3*15-J'(;

~z~--*--=~

.~~:r;:-~.

~~~~---**** ------**--

--_j __ 'fL215& ~~--*---:*1. _ _} __ t"C> 2-~~~-Y!_~4 ,9-__ _ ~---**** .... *****---**-*

--*--*----

---I _JI I ~----------_k_ . *~}~~== **-= :} -~ '.L.......__

___ I( /e(25:Q _ -----*---_ I _ 11/f?/12 -------J NOlES t' .-<' . _ (.), 6/V' ;;-~ (.,;,..;,=-,,e,...,,;:2) if,, [;v,4rL (IJ,4'1 /;c.L C)(l'J/'/)

St!.CJ'2,,7 K-lwv,/l-C/Vlt';.J;-.S

l.'.4vc ,6'cc,J H,z-1 Se-.;,
A :-, /./( rl.: 7) Z-/r-,1Jiv',!)J/./~

f;;l"/Pa Ye:) ,5 /\.Jc L-u.NG:.:.-~

ES-201,Page31of32

,() j 7µ 1.,oJ (;. /vt!:. t<..G 'y, ,J , (_.;., ,1 r r,'<-,V,<(..

,) VA ,'Cl.<.Lt,'-1 "iHt,-r /,!LL fil'4M. St:Lv,'2.17/

12.c:c i_.: ,.;5*/..,.,.6 ,v 1! .5 /./14vi 6e'c1.J /l1r: (' /vl1CiJrKi.

{r)tLi.O.,r I t! )<£1'-4u:-r,t111..

Iv/ L.,J/.,c, f .-5SES 1.-0c..':l.'\

ES-201 Examination Securi~reement Form ES-201-3 1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the U.S. Nuclear Regulatory Commission (NRC) licensing examinations scheduled for the week(s) of ?>/s/,g -,It, /19 as of the date of my signature.

I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC's chief examiner.

I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRG (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback).

Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee.

I will immediately report to facility management or the NRC's chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination m To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRG licensing examinations administered l\l during the week(s) of . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically
, noted below and authorized by the NRC. Ol cc CD w ..... JOB TITLE/RESPONSIBILITY 0 1.~~~-""-"---

Ex/tW' ~btJEL {}1:.J2 2-~;.a:...:.:..:..:-=---=-~~-

..... 3--~~-r----+--

4. t..r 6 1rc..o PC,Q. 5.~,$00 ,l...y..d.

._ 6. 0 ;\A</ ;,.1,"'<-.h (I co ~: t!:z,~ _s.....,_"~-~-_-,---

9. US jii\=i; ===~~L..--=c::o============
12. uuSst::-\tJ fw:su:i.(kJ t --,--u-~=<'~--r-----

13 . ..l~f'.'-f

<3~8'..0--.so~

\ c.. t> l--"i.,.A b 14 .* 11..so.v /;,{) . ivS"f 15. Jrt.u;;;. 1 <...a -<..; >-z NOTES: / -5,<,.AIU 0:JvFIJ'-/"'.O v'/4 {:.M.4/t...

_5([,,-,4~-;Ai..-,1,t)

DATE SIGNATURE (2) ~;4t,d{f ,pjµi_ -1_ 41(,Az 4 --_J_ -_J_ 1,z0iz --I h/n./,2 ---,-1'/ctL I?_ ----, -Ii ~JJi:@,,,.., -z(<s(te. --------. 'l .f:l:.IJ:I_

()

_.,,-et:,£l*

'1 3' :> -,-:g'--;;~,,0.--,,-~--~~

A Ll.;:><:1'1-,....

s<c-v!Lr-,y

/'< ... fav,.e.c,,..,.<r',J< ;./A-1/e l'fJcc',v

/IA~:-r'/f4T DATE NOTE 2 -/0(J,t/1i)JAt..

i5 ,.JO '-o.,J[:;ttft-

~-/'-'1Pt...il/ii

1) /3 '/ *r,:,-(...<'f/l/

~,,UtC/2.6y.

3-20,._,F,,Q,.v,,n, t11 4 -,~f...<'-or.//

-;-/.t,-tf, ES-201, Page31 of32 /ilv i:':X&i/V' 5* .. ._Jl/.,,-y

/ ... ercic11/Zc;'/Y'CNrS

//4//'e ,<3:e,,,J

,,,_,,,<, M1c:...i-1A~L...

t.,-Jl'-~ux, EX4,,.,., Av,?H'.e.

~c~ired specialized knowledge about the U.S. Nuclear Regulatory Commission (NRC) licensing examinations scheduled for the week(s) of 1~g-~ S:: as of the date of my signature.

I agree that I will not knowingly divulge any information about these examinations to any persons who ave not een authorized by the NRC's chief examiner.

I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback).

Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee.

I will immediately report to facility management or the NRC's chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination m To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically -u noted below and authorized by the NRC. Q) <O CD w PRINTED NAME JOB TITLE/RESPONSIBILITY

-; 1. c~ l}rAklf!IJ/

/4tr41.ci~,e_ 2.J~&ec-f~<(et-,'"1(-

IO j-1"('(..)c J~{ ...... 3.~~ <3-. 0-XC, :: ~---~!;-~ 6. ~!,Xlt'( .Z~;.s 7./ fl<

9. ______ _ 10. -------11. ______ _ 12. -------13. ______ _ 14. -------15. ______ _ SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE tifi_~~ .:i/~i\'8, t,,e -_L Y;f:~ '3ti!t<t I NOTES: ;.,.,-s;l,,vrt'c G'rvf:1/2/V'icl)

V*/1 ([tvll4!L

      • >M-: /}cL G x_;1,v1 ,')i:'Dv/1..1-ry K ca._,,;,.,;-,,,.,-.

I!'"-' 7 5 !-IJ4Va /}<'e,,J /Viv-;*_ S~*L /4-;-,!'lc,/.r!'i).

Z -/,0,_).1/1 1)'-' , v ,vi) L,,i-.1(;<£!2_.

(!;,.V,J"i.

<l VtD ,(; '/ "'7""1lerl (f;Neft2.c.y.

3 -lc,N r-1rd"-1~

1> A,:..<-(£ )(Al"-Viti--re1..rt:lt>>~

7;J4 7 ES-201 , Page 31 of 32 'f,,t:Lvt'I.

-.y /2-c"Qu,fl..<.
7.f'V'(CrJT5 p4v:! 13e.r,v MlfT. ;v/,c..d 4t"L W,c..ct:)( 1 ( Yl.l,--, A,.,,,;c,"-/

-~ W .J..,c,

  • ES-201 Examination Securit~reement Form ES-201-3 1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the U.S. Nuclear Regulatory Commission (NRC) licensing examinations scheduled for the week(s) of 3 --;,-17 -3 .;,.; 7 as of the date of my signature.

I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC's chief examiner.

I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback).

Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee.

I will immediately report to facility management or the NRC's chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination m To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered N during the week(s) of . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically -u noted below and authorized by the NRC. 0) co CD (.,.) ..... Q, (.,.) ..... PRINTED NAME JOB TITLE/RESPONSIBILITY luHJ (y4-,,.,..

4u1wo1., ~-...... '.~fit: HAI 71, ,r1'!,, "PC'D vc;~,c -... -f' (_4 If ,,fw Jttl>A, LA,n:n-s~ ~~~o\,p.j1~

_ ,~lfV' JJ;.. Plot>< ( f;lir..-SIGNATURE (1) -2 'f"':;:---;:-;---:-

DATE /7 SIGNATURE (2) :......, 7 r~...,lt,,-

A w 1..__p 1~-------11 -$ -I 7-'--------

~~------*. ;:,:*;,~'

DATE :5 1.5*/B NOTE '2.. :3 _J_ _J_ -' _J_ Y!l!i_y-_J_ ~r iJdJ>>, -_/ _l_ Ccf'-'Flt2.Mt£f>

VA (._/V',:,,,.._

11-tr.l ( 4-L,c ([_y~ 5-c.L cJ("'LI ( y /2-cav.~4</""({r/7'5

/M-UC Ot!~.,v 11'1t.<r.

btSc:; /-I ,~/JC-Ire-/).

2 -/,-, 0 11.1 *1> u4-z.. 1 s* rJc ~0.0r:,c,e J> Li>.-J,,.Ct!CA-'1[.,)

V,?~ (t:Lt::~ j+-i. L... (J )(,e:\--l'Y' 6 C '-0 />. I < / (;_ ,IA /'LC 7' 6 !) /3 y *;;;.<-c..-v

~,vc~ 6y ES-201, Page 31 of 32 ,e.e:-u. C.,, ,tl_ {!C /!-", 4:"" rJ .~.s I /4-V i3 ,/ /1V ,M ;-'" jVJ-"-i-//lC'-

~11.-cc*.,;:

,-<1.x;a.,,,..._

/4'.,,r..1-.::,,.,_ l-0.-G ES-301 Operating Test Quality Checklist Form ES-301-3 Facility:

£ 5 ( S Date of Examination:

M ~IL cw icii Operating Test Number: Loe.. z.') 1. General Criteria Initials a b* c# a. The operating test conforms to the previously approved outline; changes are consistent with samolina reauirements (e.a., 1 O CFR 55.45, ooerational imoortance, safetv function distribution).

'----" (..<? b. There is no day-to-day repetition between this and other operating tests to be administered

'\...._.)

I~ durina this examination.

,_;p C. The operating test shall not duplicate items from the applicants' audit testis) (see Section D.1.a. ). "--> cJJ ,,,,4:, d. Overlap with the written examination and between different parts of the operating test is within \.A_.} c__,.-;, acceptable limits. e. It appears that the operating test will differentiate between competent and less-than-competent L,-, ,J:' applicants at the desiqnated license level. CJ! 2. Walkthrough Criteria -----a. Each JPM includes the following, as applicable: . initial conditions . initiating cues . references and tools, including associated procedures . reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time critical by the facility licensee . operationally important specific performance criteria that include-\.......)

Ci -detailed expected actions with exact criteria and nomenclature

-system response and other examiner c1:1es -statements describing important observations to be made by the applicant

-criteria for successful completion of the task -identification of critical steps and their associated performance standards

-restrictions on the sequence of steps, if applicable

b. Ensure that any changes from the previously approved systems and administrative walkthrough outlines (Forms ES-301-1 and ES-301-2) have not caused the test to deviate from any of the w acceptance criteria (e.g., item distribution, bank use, repetition from the last two NRC Cu examinations) specified on those forms and Form ES-201-2.
3. Simulator Criteria -----The associated simulator operating tests (scenario sets) have been reviewed in accordance with w us p,, Form ES-301-4, and a coov is attached.

Printed Name/Signature Date a. Author Mitk!'.):c!'-

W1~ '--"t. !._ L-.:))L.c, b. Facility Reviewer (*) t~~\1,~ '3,(~

,1 / tkfl'/[;r,;"7ffr:;'5::.

7-Li°'./\"e, C. NRC Chief Examiner(#)

fi H/ f?-e~hw / ~~/-£a,...._

~LZ3!~ 1)\-It L _I/ *~".1 I ;)JI Jl. l~ I I d. NRC Supervisor z..L2.3[18 l /

  • The facility licensee signature is not applicable for NRC-<leveloped tests. # The independent NRC reviewer initials items in column "c"; the chief examiner concurrence is required.

ES-301, Page 24 of 33 ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Facility:

SSES Date of Exam: March 2018 Scenario Numbers: 1/2/3/4/5 Operating Test No.: LOC 29 QUALITATIVE ATTRIBUTES Initials a b* c# 1. The initial conditions are realistic in that some equipment and/or instrumentation may be out of service, w C3 but it does not cue the operators into expected events. A-2. The scenarios consist mostly of related events. L-...) Qi'S 3. Each event description consists of the following:

  • the point in the scenario when it is to be initiated
  • the malfunction(s) or conditions that are entered to initiate the event l.,-.J
  • the symptoms/cues that will be visible to the crew
  • the expected operator actions (by shift position)
  • the event termination point (if applicable)
4. The events are valid with regard to physics and thermodynamics.

w G-:, A-5. Sequencing and timing of events is reasonable and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.

w /tY 6. If time compression techniques are used, the scenario summary clearly so indicates.

Operators have sufficient time to carry out expected activities without undue time constraints.

w e:..~., Cues are given. 7. The simulator modeling is not altered. \.,-J CD 8. The scenarios have been validated.

Pursuant to 10 CFR 55.46(d}, any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional w V' h fidelity is maintained while running the planned scenarios.

9. Scenarios are new or significantly modified in accordance with Section D.5 of ES-301. t.t-..'.)
0 10. All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the /!:? form along with the simulator scenarios).

I.,..) (£ 11. The scenario set provides the opportunity for each applicant to be evaluated in each of the applicable

(_p /5? rating factors. (Competency rating factors as described on Forms ES-303-1 and ES-303-3.)

l:,_,-..1

12. Each applicant will be significantly involved in the minimum number of transients and events specified w .,4, on Form ES-301-5 (submit the form with the simulator scenarios).

GS 13. Applicants are evaluated on a similar number of preidentified critical tasks across scenarios, when l,v (0 /&7 possible.

14. The level of difficulty is appropriate to support licensing decisions for each crew position.

t.,J Cf Target Quantitative Attributes per Scenario (See Section D.5.d) Actual Attributes

1. Malfunctions after EOP entry (1-2) 1 /1 /1 /2/2 \,--., (:J', /.b 2. Abnormal events (2-4) 4/3/4/3/2

\,v )\ 3. Major transients (1-2) 1 /1 /1 /2/2 e,.._, , I~ ,.-f 4. EOPs entered/requiring substantive actions (1-2) 2/2/2/2/2

\..._. <..../J 5. Entry into a contingency EOP with substantive actions (::-. 1 per scenario 1 /1 /1 /1 /1 set) t,.., (.)J 6. Preidentified critical tasks (> 2) 2/2/2/2/2 w ,* .;,

  • The facility licensee signature is not applicable for NRG-developed tests. # An independent NRC reviewer initials items in column "c"; chief examiner concurrence is required.

ES-301 I Facility:

SSES A p p L I C A N T RO 1 & R02 R03 R04 Instructions:

E V E N T T y p E RX NOR 1/C MAJ TS RX NOR 1/C MAJ TS RX NOR 1/C MAJ TS 2 CREW POSITION s A B R T 0 0 C p Transient and Event Checklist Form ES-301-5 Date of Exam: March 2018 Operating Test No.: LOC 29 3 CREW POSITION s A B R T 0 0 C p Scenarios 4 CREW POSITION s A B R T 0 0 C p M I N I M u M(*) 1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants.

ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions.

Instant SROs (SRO-I) must serve in both the SRO and the ATC positions, including at least two instrument or component (1/C) malfunctions and one major transient, in the ATC position.

If an SRO-I additionally serves in the BOP position, one 1/C malfunction can be credited toward the two 1/C malfunctions required for the ATC position.

2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional 1/C malfunctions on a one-for-one basis. 3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's competence count toward the minimum requirements specified for the applicant's license level in the right-hand columns. 4. For new reactor facility licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-I applicants in either the ATC or BOP position to best evaluate the SRO-I in manipulating plant controls.

ES-301 Transient and Event Checklist Form ES-301-5 Facility:

SSES Date of Exam: March 2018 Operating Test No.: LOC 29 A E Scenarios p V p E L N I T C A T N y T p 2 3 4 M CREW CREW POSITION CREW POSITION I N POSITION I s A B s A B s A B M R T 0 R T 0 R T 0 u 0 C p 0 C p 0 C p M(*) E RX ISRO 1 NOR & 1/C ISR03 MAJ TS RX NOR ISR02 1/C MAJ TS RX NOR ISR04 1/C MAJ TS RX NOR ISR05 1/C MAJ 6 TS RX 2 Spare NOR Scenario 1/C 3,4,5, 5 7 MAJ 6,8 TS 3,4 ES-301 Competencies Checklist Form ES-301-6 Facility:

SSES Date of Examination:

March 2018 Operating Test No.: LOC 29 APPLICANTS Competencies lnterpreUDiagnose Events and Conditions Comply With and Use Procedures (1) Operate Control Boards 2 Communicate and Interact Demonstrate Su Comply With and Use Tech. S ecs. 3 RO 1 & R02 SCENARIO 2 3 BOP BOP 4,5,6,7 3,5,6,7,8 1,4,5,6,7 3,5,6,7,8 1,4,5,6,7 3,5,6,7,8 All All 4 ATC 5,6,7,8 1,5,6,7,8 1,5,6,7,8 All Notes: (1) (2) Includes Technical Specification compliance for an RO. Optional for an SRO-U. (3) Only applicable to SROs. Instructions:

2 ATC 2,5,6,7 2,4,5,6,7 2,4,5,6,7 All R03 SCENARIO 3 BOP 3,5,6,7,8 3,5,6,7,8 3,5,6,7,8 All Check the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

4 BOP 4,5,6,7,8 2,4,5,6,7,8

2,4,5,6,7,8 All ES-301 Competencies Checklist Form ES-301-6 Facility:

SSES Date of Examination:

March 2018 Operating Test No.: LOC 29 Competencies Interpret/Diagnose Events and Conditions Comply With and Use Procedures (1) Operate Control Boards 2 Communicate and Interact Demonstrate Su ervisor Comply With and Use Tech. S ecs. 3 2 BOP 4,5,6,7 1,4,5,6,7 1,4,5,6,7 All APPLICANTS R04 SCENARIO 3 4 ATC BOP 4,6,7 4,5,6,7,8 1,2,4,6,7 2,4,5,6,7,8 1,2,4,6,7 2,4,5,6,7,8 All All Notes: ( 1) (2) Includes Technical Specification compliance for an RO. Optional for an SRO-U. (3) Only applicable to SROs. Instructions:

SCENARIO Check the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate eve,y applicable competency for eve,y applicant.

ES-301 Competencies Checklist Form ES-301-6 Facility:

SSES Date of Examination:

March 2018 Operating Test No.: LOC 29 APPLICANTS Competencies Interpret/Diagnose Events and Conditions Comply With and Use Procedures (1) Operate Control Boards 2 Communicate and Interact Demonstrate Su ervisor Abilit 3 ISRO 1 & ISR03 SCENARIO 2 3 4 SRO ATC SRO 2,3,4,5,6,7 4,6,7 3,4,5,6,7,8 All 1,2,4,6,7 All Notes: ( 1) (2) Includes Technical Specification compliance for an RO. Optional for an SRO-U. (3) Only applicable to SROs. 2 ATC 2,5,6,7 2,4,5,6,7 ISR02 SCENARIO 3 4 SRO SRO 3,4,5,6,7,8 4,5,6,7,8 All 2,4,5,6,7,8 ES-301 Competencies Checklist Form ES-301-6 Facility:

SSES Date of Examination:

March 2018 Operating Test No.: LOC 29 Competencies lnterpreUDiagnose Events and Conditions 2 ATC 2,5,6,7 ISR04 SCENARIO 3 SRO 3,4,5,6,7,8 APPLICANTS 4 2 BOP SRO 4,5,6,7,8 2,3,4,5,6,7 Comply With and Use Procedures (1) 2,4,5,6,7 All 2,4,5,6,7,8 All Operate Control Boards 2 Communicate and Interact Demonstrate Su ervisor Comply With and Use Tech. S ecs. 3 Notes: ( 1) (2) (3) Includes Technical Specification compliance for an RO. Optional for an SRO-U. Only applicable to SROs. ISROS SCENARIO 3 4 SRO ATC 3,4,5,6,7,8 4,5,6,7,8 All 2,4,5,6,7,8 ES-301 Operating Test Review Worksheet Facility:

Susquehanna Unit 1 & 2 Exam Date: 1 3 4 5 ADMIN Attributes Job Content Admin JPMs L;D I Topic (1-si I 1-----,----y-----y--------,,------y-------.---+-----y-----1 U/E/S and KIA A-1 I I 3 SROA-2 I I 3 -ROA-2 3 A-3 3 A-4 3 SROA-5 3 Sim ulator/1 n-Plant Safety Function JPMs and KIA a X 3 b 3 C X I 3 I d 3 e 3 f 3 g 3 h 3 3 3 k 3 I 1/C I I Critical I Scope I I Perf. Cues Overlap Focus Steps (N/B) Std. ----*----*----* . =:c=====r= I I I I I I I I I I Key I Minutia I I I I I I Job Link E E E E s s u E I u s E E s E E s I E Form ES-301-7 March 5-9, 2018 6 Explanation Inconsistency between task cue and body of JPM for the RO and SRO tasks. Specified individual RO and SRO task standards.

Updated evaluator cues. Corrected coversheet KIA reference.

Specified TS grading criteria and enhanced task conditions.

Added procedure step numbers. Added one additional step. rec1assm;auon.

Removed bulleted step captured later in JPM. Replaced JPM due to oversampling of SF. Replacement JPM Satisfacto Enhanced task condition, evaluator cue and evaluator note. Enhanced evaluator cue and note and removed the last step of the JPM. Enhanced evaluator note and cue Added procedure step references Changed step from non-critical to critical.

Added to steps 5 and 6.

ES-301 2 Form ES-301-7 Instructions for Completing This Table: Check or mark any item(s) requiring a comment and explain the issue in the space provided using the guide below. 1. Check each JPM for appropriate administrative topic requirements (COO, EC, Rad, and EP) or safety function requirements and corresponding K/A. Mark in column 1. (ES-301, D.3 and D.4) 2. Determine the level of difficulty

{LOD) using an established 1-5 rating scale. Levels 1 and 5 represent an inappropriate (low or high) discriminatory level for the license that is being tested. Mark in column 2 (Appendix D, C.1.f) 3. In column 3, "Attributes," check the appropriate box when an attribute is not met: c The initial conditions and/or initiating cue is clear to ensure the operator understands the task and how to begin. (Appendix C, B.4) l-The JPM contains appropriate cues that clearly indicate when they should be provided to the examinee.

Cues are objective and not leading. (Appendix C, D.1) All critical steps (elements) are properly identified.

l-The scope of the task is not too narrow (N) or too broad (B). 1 Excessive overlap does not occur with other parts of the operating test or written examination. (ES-301, D.1.a, and ES-301, D.2.a) The task performance standard clearly describes the expected outcome (i.e., end state). Each performance step identifies a standard for successful completion of the step. r_ A valid marked up key was provided (e.g., graph interpretation, initialed steps for handouts).

4. For column 4, "Job Content," check the appropriate box if the job content flaw does not meet the following elements:

I Topics are linked to the job content (e.g., not a disguised task, task required in real job). r-The JPM has meaningful performance requirements that will provide a legitimate basis for evaluating the applicant's understanding and ability to safely operate the plant. (ES-301, D.2.c) 5. Based on the reviewer's judgment, is the JPM as written (U}nacceptable (requiring repair or replacement), in need of (E)nhancement, or (S)atisfactory?

Mark the answer in column 5. 6. In column 6, provide a brief description of any (U)nacceptable or (E}nhancement rating from column 5. Save initial review comments and detail subsequent comment resolution so that each exam-bound JPM is marked by a (S)atisfactory resolution on this form.

ES-301 3 Form ES-301-7 Facility:

SSES Scenario:

2 Exam Date: March 2018 1 2 3 4 5 6 7 8 9 10 Event Realism/Cred.

Required Verifiable LOD TS CTs Seen. U/E/S Explanation Actions actions Overlap 1 s 2 X s 2015 Sen 4 Event 2 3 X s 4 X s 5 X s 6 X X s 2015 Sen 4 Event 7 s 7 0 0 0 5 Facility:

SSES Scenario:

3 Exam Date: March 2018 1 2 3 4 5 6 7 8 9 10 Event Realism/Cred.

Required Verifiable LOD TS CTs Seen. U/E/S Explanation Actions actions Overlap 1 X s 2015 Sen 3 Event 1 2 X s 3 X s 4 s 5 s 6 s 7 X X s 2016 Sen 1 Event 7 8 X s 8 0 0 0 6 ES-301 4 Form ES-301-7 Facility:

SSES Scenario:

4 Exam Date: March 2018 1 2 3 4 5 6 7 8 9 10 Event Realism/Cred.

Required Verifiable LOO TS CTs Seen. U/E/S Explanation Actions actions Overlap 1 s 2 s 3 X s 4 E Modified D-2 to move to next event after maior mitioative actions 5 X X s 2015 Sen 4 Event 5 6 X s 7 s 8 X s 8 0 0 0 7 ES-301 5 Form ES-301-7 Instructions for Completing This Table:

  • Use this table for each scenario for evaluation.

2 3,4 Check this box if the events are not related ( e.g., seismic event followed by a pipe rupture) OR if the events do not obey the laws of physics and thermodynamics.

In columns 3 and 4, check the box if there is no verifiable or required action, as applicable.

Examples of required actions are as follows: (ES-301, D.5f) * *

  • opening, closing, and throttling valves starting and stopping equipment raising and lowering level, flow, and pressure
  • making decisions and giving directions
  • acknowledging or verifying key alarms and automatic actions (Uncomplicated events that require no operator action beyond this should not be included on the operating test unless they are necessary to set the stage for subsequent events. (Appendix D, B.3).) 5 Check this box if the level of difficulty is not appropriate.

6 Check this box if the event has a TS. 7 Check this box if the event has a critical task (CT}. If the same CT covers more than one event, check the event where the CT started only. 8 Check this box if the event overlaps with another event on any of the last two NRC examinations. (Appendix D, C.1.f) 9 Based on the reviewer's judgment, is the event as written (U)nacceptable (requiring repair or replacement), in need of (E)nhancement, or (S)atisfactory?

Mark the answer in column 9. 10 Record any explanations of the events here. In the shaded boxes, sum the number of check marks in each column. * * * * * *

  • In column 1, sum the number of events . In columns 2-4, record the total number of check marks for each column . In column 5, based on the reviewer's judgement, place a checkmark only if the scenario's LOD is not appropriate . In column 6, TS are required to be~ 2 for each scenario. (ES-301, D.5.d) In column 7, preidentified CTs should be~ 2 for each scenario. (Appendix D; ES-301, D.5.d; ES-301-4)

In column 8, record the number of events not used on the two previous NRC initial licensing exams. A scenario is considered unsatisfactory if there is< 2 new events. (ES-301, D.5.b; Appendix D, C.1.f) In column 9, record whether the scenario as written (U)nacceptable, in need of (E)nhancement, or (S)atisfactory from column 11 of the simulator scenario table.

ES-301 6 Form ES-301-7 Facility:

Exam Date: 1 2 3 4 5 6 7 8 11 Scenario Event Events TS TS CT CT % Unsat. Explanation Totals Unsat. Total Unsat. Total Unsat. Scenario U/E/S Elements 2 7 0 2 0 2 0 0 E Added some additional detail to the D-2 forms. 3 8 0 2 0 2 0 0 E Added some additional detail to the D-2 forms. 4 8 0 2 0 2 0 0 E Added some additional detail to the D-2 forms. Instructions for Completing This Table: Check or mark any item(s) requiring comment and explain the issue in the space provided.

1, 3, 5 For each simulator scenario, enter the total number of events (column 1 ), TS entries/actions (column 3), and CTs (column 5). This number should match the respective scenario from the event-based scenario tables (the sum from columns 1, 6, and 7, respectively).

2,4,6 For each simulator scenario, evaluate each event, TS, and CT as (S)atisfactory, (E)nhance, or (U)nsatisfactory based on the following criteria:

a. Events. Each event is described on a Form ES-D-2, including all switch manipulations, pertinent alarms, and verifiable actions. Event actions are balanced between at-the-controls and balance-of-plant applicants during the scenario.

All event-related attributes on Form ES-301-4 are met. Enter the total number of unsatisfactory events in column 2. b. TS. A scenario includes at least two TS entries/actions across at least two different events. TS entries and actions are detailed on Form ES-D-2. Enter the total number of unsatisfactory TS entries/actions in column 4. (ES-301, D.5d) C. CT. Check that a scenario includes at least two preidentified CTs. This criterion is a target quantitative attribute, not an absolute minimum requirement.

Check that each CT is explicitly bounded on Form ES-D-2 with measurable performance standards (see Appendix D). Enter the total number of unsatisfactory CTs in column 6. 7 In column 7, calculate the percentage of unsatisfactory scenario elements:

(2 + 4 + 6) 1 + 3 + 5 100% 8 If the value in column 7 is> 20%, mark the scenario as (U)nsatisfactory in column 8. If column 7 is s 20%, annotate with (E)nhancement or (S)atisfactory.

9 In column 9, explain each unsatisfactory event, TS, and CT. Editorial comments can also be added here. Save initial review comments and detail subsequent comment resolution so that each exam-bound scenario is marked by a (S)atisfactory resolution on this form.

ES-301 Site name: Admin. JPMs Sim.fin-Plant JPMs Scenarios Op. Test Totals: SSES Total Total Unsat. 6 0 11 2 3 0 20 2 7 Form ES-301-7 Exam Date: March 2018 OPERATING TEST TOTALS Total Total Explanation Edits Sat. 4 2 6 3 3 0 13 5 10 Instructions for Completing This Table: Update data for this table from quality reviews and totals in the previous tables and then calculate the percentage of total items that are unsatisfactory and give an explanation in the space provided.

1. 2. 3. 4. 5. 6. Enter the total number of items submitted for the operating test in the "Total" column. For example, if nine administrative JPMs were submitted, enter "9" in the "Total" items column for administrative JPMs. For scenarios, enter the total number of simulator scenarios.

Enter the total number of (U)nsatisfactory JPMs and scenarios from the two JPMs column 5 and simulator scenarios column 8 in the previous tables. Provide an explanation in the space provided.

Enter totals for (E)nhancements needed and (S)atisfactory JPMs and scenarios from the previous tables. This task is for tracking only. Total each column and enter the amounts in the "Op. Test Totals" row. Calculate the percentage of the operating test that is (U)nsatisfactory (Op. Test Total Unsat.)/(Op.

Test Total) and place this value in the balded"% Unsat." cell. Refer to ES-501, E.3.a, to rate the overall operating test as follows:

  • satisfactory, if the "Op. Test Total""% Unsat." is s; 20%
  • unsatisfactory, if "Op. Test Total""% Unsat." is> 20% Update this table and the tables above with post-exam changes if the "as-administered" operating test required content changes, including the following:
  • The JPM performance standards were incorrect.
  • The administrative JPM tasks/keys were incorrect.
  • CTs were incorrect in the scenarios (not including postscenario critical tasks defined in Appendix D).
  • The EOP strategy was incorrect in a scenario(s).
  • TS entries/actions were determined to be incorrect in a scenarios .

ES-403 Written Examination Grading Quality Checklist Facility:

5*) E~ Date of Exam:?-/ z.t-/<oExam Level: Item Description

1. Clean answer sheets copied before grading 2. Proposed answer key changes and question deletions justified and documented (facility reviewer initials not required (N/R) if NO post-examination comments are submitted)
3. Applicants' scores checked for addition errors (reviewers spot check> 25% of examinations)
4. Grading for all borderline cases (80% +/-2% overall and 70% or 80%, as applicable, +/-4% on the SRO-only exam) reviewed in detail 5. All other failing examinations checked to ensure that grades are justified
6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by one-half or more of the applicants Printed Name/Signature RO a 4 t'fR_ f i~ 11\ y Form ES-403-1 ref sRO li2f' Initials b C M.f( w X. '% .Al~ f{ tAl'f w ~( N;e '(R .-v,/,( ;<o Y..fl w /-b Date a. Grader ~~fhcu1. ?,Mc~ctC~~~Z;F-3-/6-/'if
b. Facility Reviewer(*)

ci1c.t.!:JA~1..

/,.;)rLc."'l=

/ /VI L,0Lp 3 lk,*/6 MMP..,J fJX.r~ lr-,--r,&£.-

41~;,2 C. NRC Chief Examiner(*)

~tq-/Jo~ /,~J z-~-3 23 18 l>>rv.JJ .J...;,,.., , , 3(23L,i d. NRC Supervisor

(*) -l/ l/ (*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-403, Page 6 of 6

Retrieved from "https://kanterella.com/w/index.php?title=ML18109A329&oldid=1656965"