ML18109A329
| ML18109A329 | |
| Person / Time | |
|---|---|
| Site: | Susquehanna  |
| Issue date: | 02/21/2018 |
| From: | Berryman B Susquehanna, Talen Energy |
| To: | Peter Presby NRC Region 1 |
| Shared Package | |
| ML17138A109 | List: |
| References | |
| CAC U01950 | |
| Download: ML18109A329 (23) | |
Text
Susquehanna Nuclear, LLC Brad Berryman Site Vice President 769 Salem Boulevard Berwick, PA 18603 TALEN~
Tel. 570.542.2904 Fax 570.542.1504 ENERGY Brad.Berryman@TalenEnergy.com Mr. Peter Presby 10 CFR 55.40 USNRC Chief Examiner U. S. Nuclear Regulatory Commission - Region 1 2100 Renaissance Blvd - Suite 100 FEB 2 1 2018 King of Prussia, PA 19406-2713 SUSQUEHANNA STEAM ELECTRIC STATION INTEGRATED INITIAL LICENSE TRAINING EXAMINATION MATERIALS-REVISED UNIT 1 LICENSE NO. NPF-14 Docket No. 50-387 UNIT 2 LICENSE NO. NPF-22 50-388 PLA-7686
Reference:
I. SSES Letter (PLA-7660), "Susquehanna Steam Electric Station Integrated Initial License Training Examination Materials," dated December 14, 2017.
Enclosed are the updated examination materials, which Susquehanna Steam Electric Station (SSES) is submitting in support of the Initial License Examination scheduled for the weeks of March 5th and March Ii\ 2018, at SSES. This transmittal contains an update to the materials previously submitted under Reference 1. The updates provided are based on discussions with the NRC Chief Examiner.
This submittal includes the Senior Reactor Operator and Reactor Operator Written Examinations, Job Performance Measures, and Integrated Plant Operations Scenario Guides.
These examination materials have been developed in accordance with NUREG-1021, "Operator Licensing Examination Standards," Revision 11. Please note that reference materials are attached to each individual examination question or item.
In accordance with NUREG-1021, Revision 11, Section ES-201, please ensure that these materials are withheld from public disclosure until after the examinations are complete.
Should you have any questions concerning this letter, please contact Drew Rodgers, Operations Training Manager, at 570-542-6713. For questions concerning examination materials, please contact Michael Wilcox, Examination Author, at 570-542-3783.
This letter contains no new regulatory commitments.
B.
Enclosures:
- RO/SRO Composite Examination with references attached - Control Room Systems and Facility Walk Through Job Performance Measures with references attached -Administrative Topic Job Performance Measures with references attached - Integrated Plant Operations Scenario Guides - Operating Test Quality Checklist (Form ES-301-3) - Simulator Scenario Quality Checklist (Form ES-301-4) - Transient and Event Checklist (Form ES-301-5) - Competencies Checklist (Form ES-301-6) - Written Exam Quality Checklist (Form ES-401-6)
Enclosure IO-Examination Security Agreements (Form ES-201-3) 1 -Record of Rejected K/As (Form ES-401-4)
Copy: (without attachments)
NRC Document Control Desk L. Micewski, NRC Senior Resident Inspector T. E Hood, NRC Project Manager
ES-201 Examination Preparation Checklist Form ES-201-1 Facility: Susquehanna Date of Examination: 03/05/2018 Developed by: Written: Facility [ZJ NRC D II Operating: Facility [ZJ NRC D Chief Target Task Description (Reference) Examiner's Date*
Initials
- 1. Examination administration date confirmed (C.1.a; C.2.a-b). For NRC-prepared exams,
~
-240 arrangements are made for the facility to submit reference materials (C.1.e; C.3.c; Attachment 3).
-210 2. NRC examiners and facility contact assigned (C.1.d; C.2.f).
~
- 3. Facility contact briefed on security and other requirements (C.2.c). As applicable, the facility
-210 contact submits to the NRC any prescreened K/As for elimination from the written examination outline, with a description of the facility's prescreening process (ES-401, D.1.b). ~
-210 4. Reference material due for NRC-prepared exams (C.1.e; C.3.c; Attachment 3). 0 N/A
-210 s. Corporate notification letter sent (C.2.e).
~
- 6. NRC-developed written examination outline (ES-401-1/2 or ES-401N-1/2 and ES-401-3 or
-195 ES-401N-3) sent to facility contact (must be on the exam security agreement) (C.1.e-f; C.2.h; C.3.d-e). ~
- 7. Operating test outline(s) and other checklists due, including Forms ES-201-2, ES-201-3, ES-301-1,
~
-150 ES-301-2, ES-301-5, and ES-D-1, as applicable (C.1.e-f; C.3.d-e).
- 8. Operating test outline(s) reviewed by the NRC and feedback provided to facility licensee (C.2.h;
~
-136 C.3.d-e).
- 9. Proposed examinations (written, JPMs, and scenarios, as applicable) and outlines (Forms ES-301-1, ES-301-2, ES-D-1, ES-401-1/2 or ES-401N-1/2, and ES-401-3 or ES-401N-3); supporting
-75 documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, ES-401-6, ES-401N-6, and any Form ES-201-2 and ES-201-3 updates); and reference materials due (C.1.e-h; C.3.d). ~
- 10. Examinations prepared by the NRC are approved by the NRC supervisor and forwarded for facility
-75 N/A licensee review (C.1.i; C.2.h; C.3.f-g).
-60 11. Preliminary waiver/excusal requests due (C.1.m; C.2.c; ES-202).
~
-SO 12. Written exam and operating test reviews completed (C.3.f).
~
- 13. Examination review results discussed between the NRC and facility licensee (C.1.i; C.1.k-1; C.2.h;
-35 C.3.g). The NRC and the facility licensee conduct exam preparatory week. ,;&:?
- 14. Preliminary license applications and waiver/excusal requests, as applicable (NRC Form 398) due
-30 (C.1.m; C.2.i; ES-202). A
- 15. Final license applications and waiver/excusal requests, as applicable (NRC Form 398), due and
~
-14 Form ES-201-4 prepared (C.1.m; C.2.k; ES-202).
~
-7 16. Written examinations and operating tests approved by the NRC supervisor (C.2.j-k; C.3.h).
-7 17. Request facility licensee management feedback on the examination (C.2.1).
~
- 18. Final applications reviewed; one or two (if more than 10) applications audited to confirm
-7 qualifications/eligibility; and examination approval and waiver/excusal letters sent (C.2.k; Attachment S; ES-202, C.3.j; ES-204). ~
-7 19. Proctoring/written exam administration guidelines reviewed with facility licensee (C.3.k).
A ....
-7 20. Approved scenarios and job performance measures distributed to NRC examiners (C.3.i). '2
- Target dates are based on facility-prepared examinations and the examination date identified in the corporate notification letter~ These dates are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.
ES-201 Examination Securi!Y~reement Form ES-201-3
- 1. Pre-Examination I acknowledge that I have acquired specialized knowledge ahout tf:e US. Nuclear Regulatory Commission ,NRC) licensing examinations scheduled for the week(s) of J *:. , 7 - 3 ;~ *i 7 as of the date of my signature I agree that I wffl not knowingly divt.lge any information about these examinations to any persons who have not been authorized by the NRC's chief examiner. I understand that I am not to instruct, evaluate. or provide performance feedback !o those applicants scheduled to be administered these licensing examinations from this date until completion of examinatior. administration, except as specifically noted below and authorized by the NRC (e.g .. acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or Indirect feedback). =ur1hermore. I am aware of the physical security measures and requirements (as documented in the facility licensee*s procedures) and understand that violation of :he conditions of this agreement may result in cancellation of tr,e examinations and/or an enforcement action against me or the facility licensee. I wilf immediately report to facility management or :he NRC's chief examiner any indications or suggestions that examination security may have been compromised.
- 2. Post-Examination mTo the best of my knowledge i did net divulge to any unauthorized persons any inforrraticn concerning thc: NRC licensing examinations administered rv during !t,e week{s} of---*--**--**__ From the dale that I entered ,rto this security agreement until the con';)/e1ion of examination ad,ninistration. laid o nol i'1s!ruct, evaluate. or r,rovide pertocrr1ar.ce feedbaci<. ~o those aoolicw1ts who were acministereo tf1ese ioensing exarn1natiorn,, except as ""'°"m,..,,1,,,
-o noted below ano autl1crized by the NRC.
ru 75 PRINTED NAME JOB TITLE!RESPOI\/SIBIUTY SIGNATURE ,'.1J DATE SiGI\IATURE (2) DA""F: f\OT!:
w
.... I--...
=~ ~~7~-
..""', ~ L *"50-i7 .,11.
- 1. lil -~ :.. ,4f_.::__;.,.J1~,cf /...f AC t: !(,t"" 4-,: 1t.<<, t -,tt
- fa,..t,.._..,.
- :::-:o--
/~~ '
0 - 3*15-J'(;
0
- 2. f'Ac;_ !>
- .HA"" _
3 . ..:fi,.!:',_ac.:p?x:: .
- ,cl.1rr"'..1;.._'f (* ,>.-~
~ -"..l:u*.J*
- 'tt.,-~+;/\
£........ futb,, c
-~
_.L
~z~--*--
4.C~e,.lLv.;..S ~I:'.. 06,.l:);. ~-1.llM.~T.~L .~~:r;:-~. ~~~~---****
.i=..Clbill~-4f?~~- ~ ------**-- - - _j __
~filwj~dL s*.Tµvt..t'f!2p___ <c~&__ _
'fL215&2 ~ ~-- *---:*1. __}__
7.~
- o.~D;¥~
B.~~
11~
a.cs
"'>};!NJ
_.z;c..c, l..V?W2
-51l12'/_
- sR.* -zx~*J-c~-
Pw J
- 1- ' ) ~
,* ., _
_ _E_c~.AL.l~A";"f)~ - -
r -------
. ---
~
t"C>
.*~}~~== **- =:}
_JI I ~--------
-~~~-
---**** . . *****---**-* --*--*---- -
Y!_~4 ,9-__ _
--
-- I
_k_
- 12. arb** 1-..
- 13. {)'lA~ 2. 'fO\:;.TV:I 14._~.l.H:\~C.. ?,"'-
J.
_ft /J~;;~
~*J:'?L~"':S'G.t$
-- ~ - ~ '.L.......__
___ I( /e(25:Q _ - - - - - *--- _
-.---
I _
15 ~ ) +/- _ - ~ ~floj r ,10)1clubll
- 11 L--..
11/f?/12 ----- -- J NOlES t' .- <' . _
(.), 6/V' ;;-~ (.,;,..;,=-,,e,...,,;:2) if,, [;v,4rL (IJ,4'1 /;c.L C)(l'J/'/) St!.CJ'2,,7 K-lwv,/l-C/Vlt';.J;-.S ;l.'.4vc ,6'cc,J H,z-1 Se-.;,: A :- , /./( rl.: 7)
Z- /r-,1Jiv',!)J/./~ ,5 /\.Jc L-u.NG:.:.-~ ES-201,Page31of32 f;;l"/Pa Ye:) ,() j 7µ 1.,oJ (;. /vt!:. t<..G 'y, 12.c:c /l1r: ('
,J , (_.;., ,1 r 1
r,'<-,V,<(.. ,) VA ,'Cl.<.Lt,'-1 "iHt,-r /,!LL fil'4M. St:Lv,'2.17/
i_.: ,.;5*/..,.,.6 ,v ! .5 /./14vi 6e'c1.J
/vl1CiJrKi. {r)tLi.O.,r I t! )<£1'- 4u:-r,t111.. Iv/ L.,J/.,c,
f
.-
5SES 1.-0c..':l.'\
ES-201 Examination Securi~reement Form ES-201-3
- 1. Pre-Examination the week(s) of ?>/s/,g - ,It, I acknowledge that I have acquired specialized knowledge about the U.S. Nuclear Regulatory Commission (NRC) licensing examinations scheduled for
/19 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC's chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRG (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC's chief examiner any indications or suggestions that examination security may have been compromised.
- 2. Post-Examination m To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRG licensing examinations administered l\l during the week(s) of . From the date that I entered into this security agreement until the completion of examination administration, I did
~ not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically
- , noted below and authorized by the NRC.
Ol cc CD JOB TITLE/RESPONSIBILITY DATE SIGNATURE (2) DATE NOTE w
.....
Ex/tW' ~btJEL 0 1.~~~-""-"---
~ 2-~;.a:...:.:..:..:-=---=-~~- {}1:.J2 1rc..o
~;4t,d{f ,pjµi_ -1_
..... 3--~~-r----+--
- 4. t..r 6 PC,Q. 41(,Az
~
4 --
-_J_
_J_
5.~,$00 ,l...y..d. ._
~: t!:z,~
- 6. 0 ;\A</ ;,.1,"'<-.h
_s.....,_"~-~-_-,---
(I co 1,z0iz h/n./,2 1'/ctL I?_
--
- - -,-
I
- 9. ~~r
~~: jii\=i;~
US
~~L..--=c::o=========
Ii ~JJi:@,,,..,
z(<s(te. - - - - - - - -
- - --,-
-
- 12. uuSst::-\tJ fw:su:i.(kJ t --,--u-~=<'~--r-----
13 . ..l~f'.'-f <3~8'..0--.so~ l--"i.,.A b
'1
\ c.. t> . 'l.f:l:.IJ:I_
14.* 11..so.v ~ /;,{) . ivS"f () ~ ~~~~~~2--
- 15. Jrt.u;;;. ~ 1 <...a - <..; >-z _.,,-et:,£l* 3' :> - ,-:g'--;;~,,0.--,,-~--~~
NOTES: / - 5,<,.AIU 0:JvFIJ'-/"'.O v'/4 {:.M.4/t... r'/f4T A Ll.;:><:1'1-,.... s<c-v!Lr-,y /'<...fav,.e.c,,..,.<r',J< ~ ;./A-1/e l'fJcc',v /IA~:-
_5([,,- ,4~-;Ai..-,1,t) 2 - /0(J,t/1i)JAt.. i5 ,.JO '-o.,J[:;ttft- ~-/'-'1Pt...il/ii 1
) /3 '/ *r,:,-(...<'f/l/ ~,,UtC/2.6y.
3- 20,._,F,,Q,.v,,n, t11 4 -,~f...<'-or.// -;-/.t,-tf, ES-201, Page31 of32
/ilv i:':X&i/V' 5* .. ._Jl/.,,-y / ... ercic11/Zc;'/Y'CNrS //4//'e ,<3:e,,,J ,,,_,,,<,
M1c:...i-1A~L... t.,-Jl'-~ux, EX4,,.,., Av,?H'.e. *M ~~
ES-201 Examination Securit~reement Form ES-201-3
- 1. Pre-Examination
~c~ired specialized knowledge about the U.S. Nuclear Regulatory Commission (NRC) licensing examinations scheduled for the week(s) of 1~g-~ S:: as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who ave not een authorized by the NRC's chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC's chief examiner any indications or suggestions that examination security may have been compromised.
- 2. Post-Examination mTo the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered
~ during the week(s) of . From the date that I entered into this security agreement until the completion of examination administration, I did
~ not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically
-u noted below and authorized by the NRC.
Q)
<O CD PRINTED NAME JOB TITLE/RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE w
c~ l}rAklf!IJ/ /4tr41.ci~,e_
-; 1.
~ 2.J~&ec-f~<(et-,'"1(-
...... 3 . ~ ~
<3-.
j-1"('(..)c 0-XC, J~{ t.:i/~i\'8, ifi_~~ t,,e ~ -
~
~ ~!;-~ ~~
_L
- 6. ~
~--- ! , X l t ' ( .Z~;.s Y;f:~ '3ti!t<t I 7./ fl< ~
8.~~~~~~~
9._ _ _ _ _ __
10.- - - - - - -
- 11. _ _ _ _ _ __
12.- - - - - - -
13._ _ _ _ _ __
14.- - - - - - -
15._ _ _ _ _ __
- .,.,-s;l,,vrt'c G'rvf
- 1/2/V'icl) V*/1 ([tvll4!L ***:>M-: /}cL G x_;1,v1 ,')i:'Dv/1..1-ry K ca._,,;,.,;-,,,.,-. I!'"-' 7 5 !-IJ4Va /}<'e,,J /Viv-;*_
NOTES:
S~*L /4-;-,!'lc,/.r!'i).
Z - /,0,_).1/1 1) ' - ' ' ' ' , v ,vi) L,,i-.1(;<£!2_. (!;,.V,J"i. <l VtD ,(; '/ "'7""1lerl (f;Neft2.c.y.
3 - lc,N r-1rd"-1~ 1> Viti- -re1..rt:lt>>~ 7;J4 7 ES-201 , Page 31 of 32 A,:..<- (£ )(Al"- 'f,,t:Lvt'I. ;-.y /2-c"Qu,fl..<.:7.f'V'(CrJT5 p4v:! 13e.r,v MlfT.
- v/,c..d 4t"L W,c..ct
- )(
1
( Yl.l,--, A,.,,,;c,"-/ - ~ W .J..,c,
- 1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the U.S. Nuclear Regulatory Commission (NRC) licensing examinations scheduled for the week(s) of 3 - -;, 3 .;,.; 7 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC's chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC's chief examiner any indications or suggestions that examination security may have been compromised.
- 2. Post-Examination mTo the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered N during the week(s) of . From the date that I entered into this security agreement until the completion of examination administration, I did
~ not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically
-u noted below and authorized by the NRC.
0) co CD PRINTED NAME JOB TITLE/RESPONSIBILITY SIGNATURE (1) DATE /7 SIGNATURE (2) DATE NOTE
- ......,
.....
(.,.)
~
Q, luHJ (y4-,,.,.. 4u1wo1., 7 r~...,lt,,- A w 1..__p :5 1.5*/B
.....
(.,.) ......"PC'D '.~fit:
~-
vc;~,c -... -
,r1'!,,
HAI 71, 1~-------
11 -$ - I 7 - ' - - - - - - - -
'2..
- 3 f' (_4 If,,fw ~ Jttl>A, _J_
~~------
LA,n:n-s~ _J_
'f"':;:---;:-;---:-
~ -'
- 2
~~~o\,p.j1~
_J_
_,~lfV' JJ;.. Plot>< ( ~ f;lir..- Y!l!i_y- _J_
~r iJdJ>>, -
~
- . ;:,:*;,~' _l_
_/
Ccf'-'Flt2.Mt£f> VA (._/V',:,,,.._ 11-tr.l ( 4-L,c ([_y~ 5-c.L cJ("'LI ( y /2-cav.~4</""({r/7'5 /M-UC Ot!~.,v 11'1t.<r.
btSc:; /-I ,~/JC-Ire-/).
2 - /,-,0 11.1 *1> u4-z.. 1 s* rJc ~0.0r:,c,e (;_ ,IA /'LC 7' 6 !) /3 y *;;;.<-c..-v ~,vc~ 6y J> Li>.-J,,.Ct!CA-'1[.,) V,?~ (t:Lt::~ i'l~-;-
ES-201, Page 31 of 32 j+-i. L... (J )(,e:\--l'Y' 6C '- 0 />. I </ ,e.e:-u. C.,, ,tl_ {!C /!-", 4:""rJ .~.s I /4-V ~ i3 ,/ /1V ,M~ ;-'"
jVJ-"-i-//lC'- ~11.-cc*.,;: ,- <1.x;a.,,,..._ /4'.,,r..1-.::,,.,_ ~ l-0.-G
ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: £5 ( S Date of Examination: M ~IL cw icii Operating Test Number: Loe.. z.')
Initials
- 1. General Criteria a b* c#
- a. The operating test conforms to the previously approved outline; changes are consistent with samolina reauirements (e.a., 10 CFR 55.45, ooerational imoortance, safetv function distribution). '----" (..<?
~
- b. There is no day-to-day repetition between this and other operating tests to be administered durina this examination.
'\...._.) ,_;p I~
C. The operating test shall not duplicate items from the applicants' audit testis) (see Section D.1.a. ). "--> cJJ ,,,,4:,
- d. Overlap with the written examination and between different parts of the operating test is within c__,.-;,
~
\.A_.}
acceptable limits.
- e. It appears that the operating test will differentiate between competent and less-than-competent applicants at the desiqnated license level.
L,-,
CJ! ,J:'
- 2. Walkthrough Criteria -- - --
- a. Each JPM includes the following, as applicable:
.. initial conditions
..
initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific
. designation if deemed to be time critical by the facility licensee operationally important specific performance criteria that include-
\.......) Ci ~
- detailed expected actions with exact criteria and nomenclature
- system response and other examiner c1:1es
- statements describing important observations to be made by the applicant
- criteria for successful completion of the task
- identification of critical steps and their associated performance standards
- restrictions on the sequence of steps, if applicable
- b. Ensure that any changes from the previously approved systems and administrative walkthrough outlines (Forms ES-301-1 and ES-301-2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last two NRC w Cu ~
examinations) specified on those forms and Form ES-201-2.
- 3. Simulator Criteria -- - --
The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-301-4, and a coov is attached.
w us p,,
Printed Name/Signature Date
- a. Author Mitk!'.):c!'- W1~ '--"t. !._ ~ L-.:))L.c,
- b. Facility Reviewer (*) t~~\1,~ '3,(~ '~~~ ,1 / tkfl'/[;r,;"7ffr:;'5::. 7-Li°'./\"e, C. NRC Chief Examiner(#) fi H/f?-e~hw 1
/ ~~/-£a,...._ ~LZ3!~
I I
- d. NRC Supervisor 1)\- It L _I/ *~". I ;)JIJl. l ~ z..L2.3[18 l /
- The facility licensee signature is not applicable for NRC-<leveloped tests.
- The independent NRC reviewer initials items in column "c"; the chief examiner concurrence is required.
ES-301, Page 24 of 33
ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Facility: SSES Date of Exam: March 2018 Scenario Numbers: 1/2/3/4/5 Operating Test No.: LOC 29 QUALITATIVE ATTRIBUTES Initials a b* c#
- 1. The initial conditions are realistic in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events. w C3 A-
- 2. The scenarios consist mostly of related events. L-...) Qi'S ~
- 3. Each event description consists of the following:
- the point in the scenario when it is to be initiated
- the malfunction(s) or conditions that are entered to initiate the event l.,-.J ~ ~
- the symptoms/cues that will be visible to the crew
- the expected operator actions (by shift position)
- the event termination point (if applicable)
- 4. The events are valid with regard to physics and thermodynamics. w G-:, A-
- 5. Sequencing and timing of events is reasonable and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives. w ~
/tY
- 6. If time compression techniques are used, the scenario summary clearly so indicates.
w ~
Operators have sufficient time to carry out expected activities without undue time constraints.
Cues are given.
e:..~.,
- 7. The simulator modeling is not altered. \.,-J CD ~
- 8. The scenarios have been validated. Pursuant to 10 CFR 55.46(d}, any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional w V' h fidelity is maintained while running the planned scenarios.
- 9. Scenarios are new or significantly modified in accordance with Section D.5 of ES-301. t.t-..'.) ::0
~
- 10. All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the form along with the simulator scenarios). I.,..)
(£ /!:?
- 11. The scenario set provides the opportunity for each applicant to be evaluated in each of the applicable rating factors. (Competency rating factors as described on Forms ES-303-1 and ES-303-3.)
l:,_,-..1 (_p /5?
- 12. Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).
w GS .,4,
- 13. Applicants are evaluated on a similar number of preidentified critical tasks across scenarios, when possible.
l,v (0 /&7
- 14. The level of difficulty is appropriate to support licensing decisions for each crew position. t.,J Cf ~
Target Quantitative Attributes per Scenario (See Section D.5.d) Actual Attributes -- -- --
- 1. Malfunctions after EOP entry (1-2) 1/1 /1 /2/2 \,--., (:J', /.b
- 2. Abnormal events (2-4) 4/3/4/3/2 \,v )\ ~
,
- 3. Major transients (1-2) 1/1 /1 /2/2 e,.._,
,.- f I~
- 4. EOPs entered/requiring substantive actions (1-2) 2/2/2/2/2 \..._. <..../J ~
- 5. Entry into a contingency EOP with substantive actions (::-. 1 per scenario set) 1/1 /1 /1 /1 t,..,
(.)J
~
- 6. Preidentified critical tasks (> 2) 2/2/2/2/2 w ,* .;, ~
- The facility licensee signature is not applicable for NRG-developed tests.
- An independent NRC reviewer initials items in column "c"; chief examiner concurrence is required.
ES-301 Transient and Event Checklist Form ES-301-5 IFacility: SSES Date of Exam: March 2018 Operating Test No.: LOC 29 A E Scenarios p V p 2 3 4 M E
I L N CREW CREW POSITION CREW POSITION N
I T POSITION I
C A T s A B s A B s A B M N y R T 0 R T 0 R T 0 u 0 C p 0 C p 0 C p M(*)
T p E
RX RO 1 NOR
& 1/C R02 MAJ TS RX NOR R03 1/C MAJ TS RX NOR R04 1/C MAJ TS Instructions:
- 1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions. Instant SROs (SRO-I) must serve in both the SRO and the ATC positions, including at least two instrument or component (1/C) malfunctions and one major transient, in the ATC position. If an SRO-I additionally serves in the BOP position, one 1/C malfunction can be credited toward the two 1/C malfunctions required for the ATC position.
- 2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional 1/C malfunctions on a one-for-one basis.
- 3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's competence count toward the minimum requirements specified for the applicant's license level in the right-hand columns.
- 4. For new reactor facility licensees that use the ATC operator primarily for monitoring plant parameters, the chief examiner may place SRO-I applicants in either the ATC or BOP position to best evaluate the SRO-I in manipulating plant controls.
ES-301 Transient and Event Checklist Form ES-301-5 Facility: SSES Date of Exam: March 2018 Operating Test No.: LOC 29 A E Scenarios p V p 2 3 4 M E
I L N CREW CREW POSITION CREW POSITION N
I T POSITION I
C A T s A B s A B s A B M N y R T 0 R T 0 R T 0 u 0 C p 0 C p 0 C p M(*)
T p E
RX NOR ISRO 1
& 1/C ISR03 MAJ TS RX NOR ISR02 1/C MAJ TS RX NOR ISR04 1/C MAJ TS RX NOR ISR05 1/C MAJ 6 TS RX 2 Spare NOR Scenario 1/C 3,4,5, 5 7 MAJ 6,8 TS 3,4
ES-301 Competencies Checklist Form ES-301-6 Facility: SSES Date of Examination: March 2018 Operating Test No.: LOC 29 APPLICANTS RO 1
& R03 R02 Competencies SCENARIO SCENARIO 2 3 4 2 3 4 BOP BOP ATC ATC BOP BOP lnterpreUDiagnose Events 4,5,6,7 3,5,6,7,8 5,6,7,8 2,5,6,7 3,5,6,7,8 4,5,6,7,8 and Conditions Comply With and 1,4,5,6,7 3,5,6,7,8 1,5,6,7,8 2,4,5,6,7 3,5,6,7,8 2,4,5,6,7,8 Use Procedures (1)
Operate Control 1,4,5,6,7 3,5,6,7,8 1,5,6,7,8 2,4,5,6,7 3,5,6,7,8 2,4,5,6,7,8 Boards 2 Communicate All All All All All All and Interact Demonstrate Su Comply With and Use Tech. S ecs. 3 Notes:
(1) Includes Technical Specification compliance for an RO.
(2) Optional for an SRO-U.
(3) Only applicable to SROs.
Instructions:
Check the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.
ES-301 Competencies Checklist Form ES-301-6
Facility: SSES Date of Examination: March 2018 Operating Test No.: LOC 29 APPLICANTS R04 Competencies SCENARIO SCENARIO 2 3 4 BOP ATC BOP Interpret/Diagnose Events 4,5,6,7 4,6,7 4,5,6,7,8 and Conditions Comply With and 1,4,5,6,7 1,2,4,6,7 2,4,5,6,7,8 Use Procedures (1)
Operate Control 1,4,5,6,7 1,2,4,6,7 2,4,5,6,7,8 Boards 2 Communicate All All All and Interact Demonstrate Su ervisor Comply With and Use Tech. S ecs. 3 Notes:
( 1) Includes Technical Specification compliance for an RO.
(2) Optional for an SRO-U.
(3) Only applicable to SROs.
Instructions:
Check the applicants' license type and enter one or more event numbers that will allow the examiners to evaluate eve,y applicable competency for eve,y applicant.
ES-301 Competencies Checklist Form ES-301-6 Facility: SSES Date of Examination: March 2018 Operating Test No.: LOC 29 APPLICANTS ISRO 1
& ISR02 ISR03 Competencies SCENARIO SCENARIO 2 3 4 2 3 4 SRO ATC SRO ATC SRO SRO Interpret/Diagnose Events 2,3,4,5,6,7 4,6,7 3,4,5,6,7,8 2,5,6,7 3,4,5,6,7,8 4,5,6,7,8 and Conditions Comply With and All 1,2,4,6,7 All 2,4,5,6,7 All 2,4,5,6,7,8 Use Procedures (1)
Operate Control Boards 2 Communicate and Interact Demonstrate Su ervisor Abilit 3 Notes:
( 1) Includes Technical Specification compliance for an RO.
(2) Optional for an SRO-U.
(3) Only applicable to SROs.
ES-301 Competencies Checklist Form ES-301-6 Facility: SSES Date of Examination: March 2018 Operating Test No.: LOC 29 APPLICANTS ISR04 ISROS Competencies SCENARIO SCENARIO 2 3 4 2 3 4 ATC SRO BOP SRO SRO ATC lnterpreUDiagnose Events 2,5,6,7 3,4,5,6,7,8 4,5,6,7,8 2,3,4,5,6,7 3,4,5,6,7,8 4,5,6,7,8 and Conditions Comply With and 2,4,5,6,7 All 2,4,5,6,7,8 All All 2,4,5,6,7,8 Use Procedures (1)
Operate Control Boards 2 Communicate and Interact Demonstrate Su ervisor Comply With and Use Tech. S ecs. 3 Notes:
( 1) Includes Technical Specification compliance for an RO.
(2) Optional for an SRO-U.
(3) Only applicable to SROs.
ES-301 Operating Test Review Worksheet Form ES-301-7 Facility: Susquehanna Unit 1 & 2 Exam Date: March 5-9, 2018 1 3 4 5 6 ADMIN L;D I Attributes Job Content Admin JPMs Topic and KIA (1-si Focus I I I I Cues Critical Steps Scope (N/B)
Overlap I
1-----,----y-----y--------,,------y-------.---+-----y-----1 I 1/C Perf.
Std.
Key I Minutia Job Link U/E/S Explanation
*----*----* . =:c=====r=
Inconsistency between task cue and body of JPM for the RO and SRO tasks. Specified individual RO and SRO A-1 I I 3 E task standards. Updated evaluator cues. Corrected coversheet KIA reference.
Specified TS grading criteria and enhanced task SROA-2 I I 3 E conditions.
-ROA-2 3 E Added procedure step numbers.
A-3 3 E Added one additional step.
A-4 3 s SROA-5 3 s Sim ulator/1 n-Plant Safety Function JPMs and KIA a X 3 u rec1assm;auon.
b 3 E Removed bulleted step captured later in JPM.
Replaced JPM due to oversampling of SF. Replacement C X I 3 I I I I I I I I I I u JPM Satisfacto d 3 s Enhanced task condition, evaluator cue and evaluator e 3 E note.
Enhanced evaluator cue and note and removed the last f 3 E step of the JPM.
g 3 s h 3 E Enhanced evaluator note and cue 3 E Added procedure step references 3 s Changed step from non-critical to critical. Added to k 3 I I I I I I I I I I E steps 5 and 6.
ES-301 2 Form ES-301-7 Instructions for Completing This Table:
Check or mark any item(s) requiring a comment and explain the issue in the space provided using the guide below.
- 1. Check each JPM for appropriate administrative topic requirements (COO, EC, Rad, and EP) or safety function requirements and corresponding K/A. Mark in column 1.
(ES-301, D.3 and D.4)
- 2. Determine the level of difficulty {LOD) using an established 1-5 rating scale. Levels 1 and 5 represent an inappropriate (low or high) discriminatory level for the license that is being tested. Mark in column 2 (Appendix D, C.1.f)
- 3. In column 3, "Attributes," check the appropriate box when an attribute is not met:
c The initial conditions and/or initiating cue is clear to ensure the operator understands the task and how to begin. (Appendix C, B.4) l- The JPM contains appropriate cues that clearly indicate when they should be provided to the examinee. Cues are objective and not leading. (Appendix C, D.1)
All critical steps (elements) are properly identified.
l- The scope of the task is not too narrow (N) or too broad (B).
1 Excessive overlap does not occur with other parts of the operating test or written examination. (ES-301, D.1.a, and ES-301, D.2.a)
The task performance standard clearly describes the expected outcome (i.e., end state). Each performance step identifies a standard for successful completion of the step.
r_ A valid marked up key was provided (e.g., graph interpretation, initialed steps for handouts).
- 4. For column 4, "Job Content," check the appropriate box if the job content flaw does not meet the following elements:
I Topics are linked to the job content (e.g., not a disguised task, task required in real job).
r- The JPM has meaningful performance requirements that will provide a legitimate basis for evaluating the applicant's understanding and ability to safely operate the plant. (ES-301, D.2.c)
- 5. Based on the reviewer's judgment, is the JPM as written (U}nacceptable (requiring repair or replacement), in need of (E)nhancement, or (S)atisfactory? Mark the answer in column 5.
- 6. In column 6, provide a brief description of any (U)nacceptable or (E}nhancement rating from column 5.
Save initial review comments and detail subsequent comment resolution so that each exam-bound JPM is marked by a (S)atisfactory resolution on this form.
ES-301 3 Form ES-301-7 Facility: SSES Scenario: 2 Exam Date: March 2018 1 2 3 4 5 6 7 8 9 10 Required Verifiable Seen.
Event Realism/Cred. LOD TS CTs U/E/S Explanation Actions actions Overlap 1 s 2 X s 2015 Sen 4 Event 2 3 X s 4 X s 5 X s 6 X X s 2015 Sen 4 Event 7 s 7 0 0 0 5 Facility: SSES Scenario: 3 Exam Date: March 2018 1 2 3 4 5 6 7 8 9 10 Required Verifiable Seen.
Event Realism/Cred. LOD TS CTs U/E/S Explanation Actions actions Overlap 1 X s 2015 Sen 3 Event 1 2 X s 3 X s 4 s 5 s 6 s 7 X X s 2016 Sen 1 Event 7 8 X s 8 0 0 0 6
ES-301 4 Form ES-301-7 Facility: SSES Scenario: 4 Exam Date: March 2018 1 2 3 4 5 6 7 8 9 10 Required Verifiable Seen.
Event Realism/Cred. LOO TS CTs U/E/S Explanation Actions actions Overlap 1 s 2 s 3 X s 4 E Modified D-2 to move to next event after maior mitioative actions 5 X X s 2015 Sen 4 Event 5 6 X s 7 s 8 X s 8 0 0 0 7
ES-301 5 Form ES-301-7 Instructions for Completing This Table:
- Use this table for each scenario for evaluation.
2 Check this box if the events are not related (e.g., seismic event followed by a pipe rupture) OR if the events do not obey the laws of physics and thermodynamics.
3,4 In columns 3 and 4, check the box if there is no verifiable or required action, as applicable. Examples of required actions are as follows: (ES-301, D.5f)
- opening, closing, and throttling valves
- starting and stopping equipment
- raising and lowering level, flow, and pressure
- making decisions and giving directions
- acknowledging or verifying key alarms and automatic actions (Uncomplicated events that require no operator action beyond this should not be included on the operating test unless they are necessary to set the stage for subsequent events. (Appendix D, B.3).)
5 Check this box if the level of difficulty is not appropriate.
6 Check this box if the event has a TS.
7 Check this box if the event has a critical task (CT}. If the same CT covers more than one event, check the event where the CT started only.
8 Check this box if the event overlaps with another event on any of the last two NRC examinations. (Appendix D, C.1.f) 9 Based on the reviewer's judgment, is the event as written (U)nacceptable (requiring repair or replacement), in need of (E)nhancement, or (S)atisfactory? Mark the answer in column 9.
10 Record any explanations of the events here.
In the shaded boxes, sum the number of check marks in each column.
- In column 1, sum the number of events .
- In columns 2-4, record the total number of check marks for each column .
- In column 5, based on the reviewer's judgement, place a checkmark only if the scenario's LOD is not appropriate .
- In column 6, TS are required to be~ 2 for each scenario. (ES-301, D.5.d)
- In column 7, preidentified CTs should be~ 2 for each scenario. (Appendix D; ES-301, D.5.d; ES-301-4)
- In column 8, record the number of events not used on the two previous NRC initial licensing exams. A scenario is considered unsatisfactory if there is< 2 new events. (ES-301, D.5.b; Appendix D, C.1.f)
- In column 9, record whether the scenario as written (U)nacceptable, in need of (E)nhancement, or (S)atisfactory from column 11 of the simulator scenario table.
ES-301 6 Form ES-301-7 Facility: Exam Date:
1 2 3 4 5 6 7 8 11 Scenario % Unsat. Explanation Event Events TS TS CT CT Scenario U/E/S Totals Unsat. Total Unsat. Total Unsat.
Elements 2 7 0 2 0 2 0 0 E Added some additional detail to the D-2 forms.
3 8 0 2 0 2 0 0 E Added some additional detail to the D-2 forms.
4 8 0 2 0 2 0 0 E Added some additional detail to the D-2 forms.
Instructions for Completing This Table:
Check or mark any item(s) requiring comment and explain the issue in the space provided.
1, 3, 5 For each simulator scenario, enter the total number of events (column 1), TS entries/actions (column 3), and CTs (column 5).
This number should match the respective scenario from the event-based scenario tables (the sum from columns 1, 6, and 7, respectively).
2,4,6 For each simulator scenario, evaluate each event, TS, and CT as (S)atisfactory, (E)nhance, or (U)nsatisfactory based on the following criteria:
- a. Events. Each event is described on a Form ES-D-2, including all switch manipulations, pertinent alarms, and verifiable actions. Event actions are balanced between at-the-controls and balance-of-plant applicants during the scenario. All event-related attributes on Form ES-301-4 are met. Enter the total number of unsatisfactory events in column 2.
- b. TS. A scenario includes at least two TS entries/actions across at least two different events. TS entries and actions are detailed on Form ES-D-2. Enter the total number of unsatisfactory TS entries/actions in column 4. (ES-301, D.5d)
C. CT. Check that a scenario includes at least two preidentified CTs. This criterion is a target quantitative attribute, not an absolute minimum requirement. Check that each CT is explicitly bounded on Form ES-D-2 with measurable performance standards (see Appendix D). Enter the total number of unsatisfactory CTs in column 6.
7 In column 7, calculate the percentage of unsatisfactory scenario elements:
(21 ++ 43 ++ 6)5 100%
8 If the value in column 7 is> 20%, mark the scenario as (U)nsatisfactory in column 8. If column 7 is s 20%, annotate with (E)nhancement or (S)atisfactory.
9 In column 9, explain each unsatisfactory event, TS, and CT. Editorial comments can also be added here.
Save initial review comments and detail subsequent comment resolution so that each exam-bound scenario is marked by a (S)atisfactory resolution on this form.
ES-301 7 Form ES-301-7 Site name: SSES Exam Date: March 2018 OPERATING TEST TOTALS Total Total Total Total Explanation Unsat. Edits Sat.
Admin.
6 0 4 2 JPMs Sim.fin-Plant 11 2 6 3 JPMs Scenarios 3 0 3 0 Op. Test 20 2 13 5 10 Totals:
Instructions for Completing This Table:
Update data for this table from quality reviews and totals in the previous tables and then calculate the percentage of total items that are unsatisfactory and give an explanation in the space provided.
- 1. Enter the total number of items submitted for the operating test in the "Total" column. For example, if nine administrative JPMs were submitted, enter "9" in the "Total" items column for administrative JPMs.
For scenarios, enter the total number of simulator scenarios.
Enter the total number of (U)nsatisfactory JPMs and scenarios from the two JPMs column 5 and 2.
simulator scenarios column 8 in the previous tables. Provide an explanation in the space provided.
Enter totals for (E)nhancements needed and (S)atisfactory JPMs and scenarios from the previous 3.
tables. This task is for tracking only.
- 4. Total each column and enter the amounts in the "Op. Test Totals" row.
Calculate the percentage of the operating test that is (U)nsatisfactory (Op. Test Total Unsat.)/(Op. Test 5.
Total) and place this value in the balded"% Unsat." cell.
Refer to ES-501, E.3.a, to rate the overall operating test as follows:
- satisfactory, if the "Op. Test Total""% Unsat." is s; 20%
- unsatisfactory, if "Op. Test Total""% Unsat." is> 20%
Update this table and the tables above with post-exam changes if the "as-administered" operating test 6.
required content changes, including the following:
- The JPM performance standards were incorrect.
- The administrative JPM tasks/keys were incorrect.
- CTs were incorrect in the scenarios (not including postscenario critical tasks defined in Appendix D).
- The EOP strategy was incorrect in a scenario(s).
- TS entries/actions were determined to be incorrect in a scenarios .
ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Facility: 5*) E~ Date of Exam:?-/ z.t-/<oExam Level: RO refsRO li2f' Item Description Initials a b C M.f(
1.
2.
Clean answer sheets copied before grading Proposed answer key changes and question deletions 4 w X.
.Al~
justified and documented (facility reviewer initials not required (N/R) if NO post-examination comments are submitted) t'fR_ '%f{ ~
- 3. Applicants' scores checked for addition errors tAl'f (reviewers spot check> 25% of examinations) f w ~
- 4. Grading for all borderline cases (80% +/-2% overall and 70% or i~ ~~
~(
80%, as applicable, +/-4% on the SRO-only exam) reviewed in N;e detail ~
- 5. All other failing examinations checked to ensure that grades .-v,/,(
are justified 11\ '(R ;<o
- 6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by one-half or more of the applicants y w Y..fl
/-b Printed Name/Signature Date
- a. Grader ~~fhcu1. ?,Mc~ctC~~~Z;F-3-/6-/'if
- b. Facility Reviewer(*) ci1c.t.!:JA~1.. /,.;)rLc."'l= / /VI L,0Lp 3 lk,*/6 C. NRC Chief Examiner(*)
MMP..,J fJX.r~
~tq-/Jo~ /,~J lr-,--r,&£.-
z-~- 41~;,2 3, 23, 18
- d. NRC Supervisor (*)
l>>rv.JJ .J...;,,..,~ - l/ 3(23L,i l/
(*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.
ES-403, Page 6 of 6