ML112790104
| ML112790104 | |
| Person / Time | |
|---|---|
| Site: | Browns Ferry  |
| Issue date: | 10/04/2011 |
| From: | NRC/RGN-II |
| To: | Tennessee Valley Authority |
| References | |
| 50-259/11-302, 50-260/11-302, 50-296/11-302 | |
| Download: ML112790104 (60) | |
Text
sri 020r9-siin 1 -fin1-fnrms-ms lnc ES-201 Examination Preparation Checklist Form ES-201-1 Facility: OWJS Date of Examination: /9 I i i Developed by: Written
- Facility D NRC Operating
- Facility NRC Target Chief Date*
Task Description (Reference)
Examiners Initials
-180 1
Examination administration date confirmed (C.1 a; C.2.a and b)
-120 2.
NRC examiners and facility contact assigned (C.1.d; C.2.e)
-120 3.
Facility contact briefed on security and other requirements (C.2.c) Y?!7/
1S1(
-120 4.
Corporate notification letter sent (C.2.d)
.2_/i3/(
ZIL.
[-90]
[5.
Reference material due (C.1.e; C.3.c; Attachment 3)]
3/i/it 14...
{-75}
6.
Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-5, ES-D-ls, ES-401-112, ES-401-3, and ES-401-4, as applicable (C.1.e and f; C.3.d)
/../
{-70}
{7.
Examination outline(s) reviewed by NRC and feedback prpvided to facility licensee (C.2.h; C.3.e)}
7t/
{-45}
8.
Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6, and any Form ES-201-3 updates), and reference materials due (C.1.e, f, g and h; C.3.d)
-30 9.
Preliminary license applications (NRC Form 398s) due (C.1.l;C.2.g; ES-202) 7///i
-14 10.
Final license applications due and Form ES-201-4 prepared (C.1 t C.2.i; ES-202) 7/sE,/,i
-14 11.
Examination approved by NRC supervisor for facility licensep review (C.2.h; C.3.f) aw.
-14 12.
Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g)
-7 13.
Written examinations and operating tests approved by NR su ervisor (C.2.i; C.3.h)
W3/i i c
-7 14.
Final applications reviewed; 1 or 2 (if >10) applications audited to confirm qualifications I eligibility; and examination approval and waiver letters sent (C.2.i; Attachment 5; ES-202, C.2.e; ES-204)
-7 15.
Proctoring/written exam administration guidelines reviewed j
with facility licensee (C.3.k) 8/i2_fU
-7 16.
Approved scenarios, job performance measures, and questions distributed to NRC examiners (C.3.i)
- Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by case basis in coordination with the facility licensee.
[Applies only] {Does not apply} to examinations prepared by the NRC.
_ bJRnrE/
6x,qAl 5242PtE
/AA) 944Y. -
ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility:
CJIIJS F 1
cgy Date of Examination:
/1J),ç C//
Initials Item Task Description
1.
a.
Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401.
R b.
Assess whether the outline was systematically and randomly prepared in accordance with A
I Section D.1 of ES-401 and whether all KIA categories are appropriately sampled.
Ill T
-r
- c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.
f i9
- d. Assess whether the justifications for deselected or rejected KIA statements are appropriate.
Ø 2.
a.
Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, S
and major transients.
b.
Assess whether there are enough scenario sets (and spares) to test the projected number u
and mix of applicants in accordance with the expected crew composition and rotation schedule L
without compromising exam integrity, and ensure that each applicant can be tested using A
at least one new or significantly modified scenario, that no scenarios are duplicated T
from the applicants audit test(s), and that scenarios will not be repeated on subsequent days.
R c.
To the extent possible, assess whether the outline(s) conform(s) with the qualitative and quantitative criteria specified on Form ES-301-4 and described in Appendix D.
3.
- a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:
(1) the outline(s) contain(s) the required number of control room and in-plant tasks W
distributed among the safety functions as specified on the form I
(2) task repetition from the last two NRC examinations is within the limits specified on the form T
(3) no tasks are duplicated from the applicants audit test(s)
(4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form.
b.
Verify that the administrative outline meets the criteria specified on Form ES-301-1:
(1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations
c.
Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.
4.
a.
Assess whether plant-specific priorities (including PRA and IPE insights) are covered
,j 44 in the appropriate exam sections.
Yl
/4
- b. Assess whether the 10 CFR 55.41143 and 55.45 samplIng Is appropriate.
c.
Ensure that K/A importance ratings (except for plant-specific priorities) are at least 2.5.
R
- d. Check for duplication and overlap among exam sections.
/A %,i*
A L
- e. Check the entire exam for balance of coverage.
f.
Assess whether the exam fits the appropriate job level (RO or SRO).
1)?
- a. Author fl1C#,IeL k tiizoio
- b. Facility Reviewer (*)
N/A
.4(4
- c. NRC Chief Examiner (#)
tUb-H)Cfc-f2)J 12-8 -10
- d. NRC Supervisor L14LCiLL4CWIIW&L/
Note:
- Independent NRC reviewer initial items in Column ac; chief examiner concurrence required.
Not applicable for NRC-prepared examination outlines
-bPc F-OtU(
ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility:
DateofExamInation:g.)./,
Initials Item Task Description
1.
a.
Veri that the outline(s) fit(s) the appropriate model, in accordance with ES-401.
R b.
Assess whether the outline was systematically and randomly prepared in accordance with I
Section D.1 of ES-401 and whether all K/A categories are appropriately sampled.
c.
Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.
d.
Assess whether the justifications for deselected or rejected K/A statements are appropriate.
2.
a.
Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, S
and major transients.
- 2. 2°(
M b.
Assess whether there are enough scenario sets (and spares) to test the projected number U
and mix of applicants in accordance with the expected crew composition and rotation schedule L
without compromising exam integrity, and ensure that each applicant can be tested using A
at least one new or significantly modified scenario, that no scenarios are duplicated T
from the applicants audit test(s), and that scenarios will not be repeated on subsequent days.
7Z,
0 c.
To the extent possible, assess whether the outline(s) conform(s) with the qualitative R
and quantitative criteria specified on Form ES-301-4 and described in Appendix D.
o-z-:,
3.
a.
Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:
(1) the outline(s) contain(s) the required number of control room and in-plant tasks W
distributed among the safety functions as specified on the form
/
(2) task repetition from the last two NRC examinations is within the limits specified on the form 1
(3) no tasks are duplicated from the applicants audit test(s)
(4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria 3!5 12(
on the form.
b.
Verify that the administrative outline meets the criteria specified on Form ES-301-1:
(1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations
c.
Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.
4.
a.
Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections.
DZ_ S5
b.
Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.
gi..,4k).(
N c.
Ensure that K/A importance ratings (except for plant-specific priorities) are at least 2.5.
53 1v(
d.
Check for duplication and overlap among exam sections.
o.. 23 X A
e.
Check the entire exam for balance of coverage.
S X L
Assess whether the exam fits the appropriate job level (RO or SRO).
cZ.
Printed Najzie/Snature Date
- a. Author 1P.
- b. Facility Reviewer (*)
j 1(
L11Z7f\\)
- c. NRCChiefExaminer(#)
JlJ/
- d. NRC Supervisor Note:
- Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
Not applicable for NRC-prepared examination outlines ES-201, Page 26 of 28
8P1Za 5
kJ LOZ-S A7 L/
JflfV i?)O ?fI 9
M 1A (
7 -J\\
zm N
V7Z7
-_7
,/1 s
F11 Z1 2Z VA1 d!b/B J*AFV ce 5
r4) fr IIfU
- 1-,w1r
? J(iv
?-t 7
V
7PV E V (1
g cc >
z +/-Wv r
e-4o Lk:
p V C
//J.9/
J.?5 4/ç-
dOJ 1
- fyi, 2
C V N tJ4,Lc A t4 O 7-l(ç 7fy iI 7 wW ryi i(
EU.ON 31V0 t 1fl1/NOIS 11VQ U) ifl!VNS V MflI6INOd3I ! 3ULLor 3VNN O3INfIc1 pac*i eUpedB ser$ix uuiex D1a1ll eaii pwasipaøuwide opa*a3ueLwopad apcud enwca priqsu WU PP I Ufl!P JQ
°4UflU11 RqU!pa eqjaep eqwwj iz-a Jo aiuLfl np ppesuuIin dN au L5u11a3uo uo 1ioiuLcu suouad qneun ue o o5pou pjp apsow /u p sq UOWUjUWX3$Od uzdtUo iqwij Awn U L4L1EX LU JOS15&S3O SUO!IPU1 1X8JLP O4N E341JG Uw I4JpeJO JWJd8J4 paUIUIJJV 1 SUQIJaJ ioiwsuteieuauiouat.ioipue UG UXGapuaeu 1Insaicew iuawaaitiessuojpucxp o pueisipui xi (sarçarnid s uaijigpe u pwrpoIse) uapbai p ujinzes aiee w aiamj (aje Q4t4Jo4q IX1JG 1UUQ 5I4fl p Jousac3pzwIpuI qdaI SJi WWOJOWJOdD t1seUuipe) c(i pOIne PUEW U4ES1UIWPE UU UQJBO 1n1Jeep SLfl WSUOEUUX8 f5uiiie pwa3Up oq oGL UEfldaq uewJ,edepWd Jo ejn pnui aou we iapun uxapjj paioqJneuaqwaAeq os d
wxsai4 naq uoeunøju&e e oujviaee UAL1JO LRJO S o2la O fs)aa oflaaqzs uwa ojraii noqe PJMOWJ p dpa4fltXE eq a8pwu i 9014 £11 UOWU!tUUX3aJd 2
-wJaJ
ILT 1108 ES-201 Examination Security Agreement Form ES-201-3 1.
Pre-ExaminaDon I acknowiedge that I have acquired specLalized kno3Medge aboutthe NRC licensing examinations SChedUled For the week(s) of 818-2212011 as of the date of my signature. L agree that I will not knowingly divulge any information about these examinationsto any persons who have not been authorized by the NRC chief examiner.
I understand that I am not to instruct, evaluate, or provide performance feedback tothose applicants scheduled to be administered these ticensing examinations froni this date ii-tfl completion of examination administration except as specifically noted bekm and authorized by the NRC (e.g., acting as a simulator booth operatoror communicator is acceptable if the iridMdtral does notselect the training content or provide crect or millrect Feedback>. Furthermore, I am aware ofthe phystcal security measures and requirements (as documented in the fadrity licensees procedures) and understand that violation of the conditions of this agreement may result iii cancellation ofthe examinatIons andlor an enforcement action against me or the Fachty licensee.
I will immediately report to faallty management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2.
Post-Examination To the best of my kn&1edge, I did riot divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of 818-2212011 From the date that I entered into this secinity agreement until the completion of examination adninistration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.
PRINTEDNAME JOB11ThEIR&SPON91UW
/1 SINATURE(1)
DATE SIGNATURE(2)
DATE NOTE 1
2
>rbA.*LJ 2
()P TAiJiiJf.L.
sJA-2 4
Q y2t/ii MI A 2,VE&..
$hWLA 45vrijii C) rur)
S7/n PJIA cc 4.
tiViJ,-c/iQ,,)
/
.s -q N I A e
I i4/
J 1
,-,P,
-i-
£/6f1, IsJ pcy 5.
ItJ
ç-q-vi S//ir N/
a 6.
P.iL% v- -s c)
,V JI3?I r4A cee pc..
- (3-4,,
tJ/
11..I4t/-. Sadt,.s Adv A
iLL tJc S 6LL4SS
.V 1
2c4 (ZG iJii 1I.n 13.,)7z.
1475 kM1cJ
(?o l%jv 15.
NOTES:
CnJ ES-201, Page 27 of 28
ILT 1108 ES-201 Examination Security Agreement Form ES-201-3 1.
Pre-Examination I acknowledge that F have acquired specialized knowledge about the NRC hcensing examinations scheduled for the week(s) of 8/8-22/2011 as of the date of my signature agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner I understand that am not to instruct evaluate cc provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e g acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback).. Furthermore, I am aware of The physical security measures and requirements (as documented in the facity licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations andlor an enforcement action against me or the facility licensee.
I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2.
Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of 818-22/2011 From the date that I entered into this security agreement until the completion of examination administration, 1 did not instruct, evaluate, or provide performance feedback to those applicants who were administered these ticensing examinations, except as specificaIy noted below and authorized by the NRC.
PRINTED NAME
- 2. Mic4,4 I rir4kj SLr 4 j 1
L(
kc. r&ht
&-ri 9
Cwic c\\c WjEsF ff+ML 12Ci4 4
-1v L\\Ld,,i4L, I
- 14. 4--/A-J A4A2-l 5
\\cc ii
&/iic NOTES:
JO TITLE I RESPONSlFUW SIGNATURE (1)
DATE
- 8IGNATIRE (2)
DATE NOTE fzI CPS, c1 e.? SpextaA., b (AEt (r
4/z4/ii 112iil 14-LL
Uj-_ç:
-:j -
1.
f___
EV I
1 1
u y I
- \\ifl n
U?tijlCiE)4Th 7fr,/nK, wi---_
sfZ
/
7/z/// /2.-S. 4i.
/?c/i ES-201, Page 27 of 28
ILT 1108 ES-201 Examination Security Agreement Form ES-201-3 1.
Pre-Examination I acknowledge that F have acquired specialized knowledge about the NRC licensing examinations aclieduied for the week(s) of 818-2212011 as of the date of my signature.
I agree that I will not knowinglydivulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner.
I understand that am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below arid authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthernre, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) arid understand That violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facilitj licensee.
I wltl immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2.
Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of 818-2212011. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide perfonriance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.
PRINTED NAME 1(v1D, 2,V6L 5QUk2A
- a. %/
4.
c-ts /,-4i 5,
_\\oi-4.4 ier 6.
FLL 1-LL)Rf_.%
I,
).-rv4e.1
- 42. a i4tv
/bL 4 7
gJJii.
frV/-d--
J41!
i.::;-;f.::
(DJ3J 7/
,fk.
,-,:?,. c_4___
A i;i;&
/2/(
9Z/
3iiJ.h_____
JOB liThE I RESPONSI9ILIW
/J SNATURE(1)
J1 (J Ii ir iU Crl
,2 j_ f
-/ &
Fa.
(
fJ,f,?
DATE IG4ATURE (2) 4t/i iZL S7Wii
.c DATE NOTE kL SlZc U
WIc
-z
- 8. nWJ Su17///...
A.i 1
.k-c c6,.
1Op A.
L,çk 4eJc6
- 11. kii-5,,L 7
f2. iii
- 12. *MtS 84J FwI &
RC Q2i/1 1
E t%i 444, >r-14 p11 C 4AJ/Z/
i1/c,
///q/,i 15.WLLU4-. JTJ LEi 4tb-V
/,
-kgf__
NOTES:
ES-201, Page 27 of 28
ILT 1108 ES-201 Examination Security Agreement Form ES-201-3 1.
Pre-Examination I acknowledge that have acquired speciabzed knowledge about the NRC licensing examinations scheduled for the weak(s) of 818-22/2011 as of The date of my signature.
I agree that I will not knowingly divulge any information about these examinations to any persons wtio have not been authorized by the NRC chief examiner I understand that I am not to instruct, evaluate, or provide performance feedbacl to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (eg, acting as a simulator booth operator or communicator is acceptable if the indMclual does not select the training content or provide direct or indirect 1eedbacl)
Furthermore, I am aware of the physical security measures and requirements (as documented in the faciUty licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee.
I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2.
Post-Examination To the best of my Icnawledge, I did not divulge to any unauthorized persons any infomiation concerning the NRC licensing examinations administered during the ek(s) of 818-22!201 1. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide perfbrmance feedhacic to those applicants who were administered these licensing examinations except as specifically noted below and authorized by the NRC.
PRINTED NAME i(v J-tt 2 Jm-c 7
,Si-vuiij JOB TITLE? RESPONSIBILITY SIGNATURE lI)
DATE SIGNATURE (2)
DATE NOTE U ir 7/.ZaI(
7!YJ/f O,ec$ev Yj 1
up.
P4//I J4F 5it 44zi/. C/Pdc ftL QIt4ct1L c,--
W1 J
- 5. eveut-jL5 Lw +_t P--i--
s,, li,-_______________
6c C-Sc -o Ii 2
b C_
\\T f(L-C tJi fA1S.
4IZ 7/
aN. f cfte(l L
9k/wi db&/
sf 9
_(Jt P Stt s
//u tF7f o
/2hf
- 10. \\CEL
?
. OLSo,.a O c..
8] )%)
11.
CtcsiScL oes u
Jcrtfi..
.rs 3j2_i ))
12 OC1/
2_c-fç 1-cl A177 I 3. -Z7P.
P 1
S
/
jj___
14 t-ri&/,f
- 15. 7,c:-z.
iz 4-::-:%t
/97/,
NOTES:
ES-201, Page 27 of 28
ILT 1108 Administrative Topics Outline Form ES-301-1 Facility:
Browns Ferry NPP Date of Examination:
8/8/201 1 Examination Level: ROISRO Operating Test Number:
1 108 Administrative Topic Type Describe activity to be performed (see Note)
Code
- Conduct of Operations D
2.1.4 Determine Adequate Performance of License Reactivation RO Al a (RO only) 2.1.4 Determine Adequate Performance of License Reactivation SRO Ala Conduct of Operations N
2.1.19 ICS Logs ROA1b 2.1.18 NRC event notification due to Safety Limit Violation SROA1b Equipment Control M
2.2.44 Evaluate Recombiner Performance RO/SRO A2 Radiation Control M
2.3.4 Determine Stay Time under Emergency Conditions and SRO A3 authorize Emergency Plan M
2.4.43 Unit Operator Emergency Call-out ROA4 N
2.4.4 1 Classify an Event SRO A4 NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.
- Type Codes & Criteria:
(C)ontrol Room (D)irect from bank (<3 for ROs; <4 for SROs and RO retakes)
(N)ew or (M)odified from bank (> 1)
(P)revious 2 exams (< 1; randomly selected)
(S)imulator
ILT 1108 Administrative Topics Outline Form ES-301-1 Reactor Operator
- 1. Determine Adequate Performance of License Reactivation Direct OPDP-10, License Status Maintenance, Reactivation, and Proficiency for Non-Licensed Positions Given examples of 3 Reactor Operators returning to shift from rotating assignments, determine which personnel have correctly completed the license reactivation requirements.
2.1.4 Knowledge of individual licensed operator responsibilities related to shift staffing, such as medical requirements, no-solo operation, maintenance of active license status, 10CFR55, etc. RO 3.3
- 2. ICS Logs New 2-SR-2 or 3-SR-2 Perform Operator logs using ICS screens in accordance with 2-SR-2 Instrument Checks and Observations for log tables 1.1, 1.6, 1.25, and 1.30. Verify acceptance criteria are satisfied in accordance with notes.
2.1.19 Ability to use plant computers to evaluate system or component status. RO 3.9
- 3. Evaluate Recombiner Performance Modified 3-01-66, Offgas System Determines that Recombiner performance meets the acceptance criteria and standby Recombiner is not required to be placed in service.
2.2.44 Ability to interpret control room indications to verify the status and operation of a system, and understand how operator actions and directives affect plant and system conditions RO 4.2
- 4. Unit Operator Notifications in an Alert Modified EPIP 3, Alert Perform Appendix B of EPIP-3 with the EPS operable. When a responder fails to respond to the notification the operator takes actions JAW EPIP-3 to fill the vacant position. Requiring Manual Call-Out with the Weekly Duty List and the Call-Out List 2.4.43 Knowledge of emergency communications systems and techniques RO 3.2.
ILT 1108 Administrative Topics Outline Form ES-301-i Senior Reactor Operator
- 1. Determine Adequate Performance of License Reactivation Direct OPDP-10, License Status Maintenance, Reactivation, and Proficiency for Non-Licensed Positions Given examples of 6 licensed personnel returning to shift from rotating assignments, determine which personnel have correctly completed the license reactivation requirements.
2.1.4 Knowledge of individual licensed operator responsibilities related to shift staffing, such as medical requirements, no-solo operation, maintenance of active license status, 10CFR55, etc. SRO 3.8
- 2. NRC event notification due to Safety Limit Violation New NPG-SPP-03.5, Regulatory Reporting Requirements Determine NRC event notification requirements, as the Shift Manager due to a Safety Limit Violation.
2.1.18 Ability to make accurate, clear, and concise logs, records, status boards, and reports.
SRO 3.8
- 3. Evaluate Recombiner Performance Modified 3-01-66, Offgas System Determines that Recombiner performance meets the acceptance criteria and standby Recombiner is not required to be placed in service.
2.2.44 Ability to interpret control room indications to verify the status and operation of a system, and understand how operator actions and directives affect plant and system conditions SRO 4.4
- 4. Determination of Stay Time and Approving Authority to perform an emergency evolution to save equipment.
Modified EPIP 15, Emergency Exposure Determine amount of time an operator has to perform an emergency evolution due to radiation levels and authorize on the correct form.
2.3.4 Knowledge ofradiation exposure limits under normal and emergency conditions.
Importance SRO 3.7
ILT 1108 Administrative Topics Outline Form ES-301-i
- 5. Classify an Event New EPIP-i and 4 Emergency Classification Procedure and Site Area Emergency The event is classified as a Site Area Emergency 2.3-Si and the Initial Notification appendix is completed with the correct information. Event is classified within 15 minutes and Initial Notification is completed within 15 minutes of classification.
2.4.41 Knowledge of emergency action level thresholds and classifications. Importance SRO 4.6
ES-301 Control Roomlln-Plant Systems Outline Form ES-301-2 Facility:
Browns Ferry NPP Date of Examination:
8/8/20 11 Exam Level: RO/SROTJSROU Operating Test No.:
1108 Control Room Systems@ (8 for RO); (7 for SRO-I); (2 or 3 for SRO-U, including I ESF)
System I JPM Title Type Code*
Safety Function
- a. Recirc Pump Recovery with Manual Scram A, N, S 1
- b. EOI-Appendix-7D Standby Coolant Injection D, L, S 2
- c. HPCI in Pressure Control Mode A, L, M, S 4
- d. EOI-Appendix-13 Emergency Vent Primary Containment A, D, EN, S 5
- e. RWM Functional Test for Startup D, L, S 7
- f. USST lB Transformer Tap Changer Auto Checks A, N, S 6
- g. Containment Venting High Off-Site Release M, S, A 9
In-Plant Systems@ (3 for RO); (3 for SRO-l); (3 or 2 for SRO-U)
- i. Stator Cooling Water Return to Automatic Temp Control N, R 3
- k. Alternate Injection Fire Sys Lineup 1-EOI Appendix-7K R, E, L, D 2
All RO and SRO-i control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.
(C)ontrol room (D)irect from bank
< 91< 4 (4)(4)(2)
(E)mergency or abnormal in-plant 1 (2)(2)(1)
(EN)gineered safety feature
- I? I (control room system) (1)(1)(1)
(L)ow-Power I Shutdown
> 1 (4)(4)(1)
(N)ew or (M)odified from bank including 1 (A) 2 (6)(6)(3)
(P)revious 2 exams 3 / 2 (1)(O)(O) (randomly selected)
(R)CA
> 1 (1)(1)(1)
(S)imulator (8)(7)(3)
ILT 1108 Control Roomlln-Plant Systems JPM Narrative Control Room Systems:
- a. Recirc Pump Recovery with Manual Scram (Unit 2 or 3)
- Alternate path / New / Simulator
- 2/3-01-68 Reactor Recirculation System 2/3-AOI-68-1A Recirc Pump Trip/Core Flow Decrease OPRMs Operable 2/3-AOI-100-1 Reactor Scram
- 202001 Recirculation System A2.04 Ability to (a) predict the impacts of the following on the RECIRCULATION SYSTEM; and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal conditions or operations:
Multiple recirculation pump trip IMPORTANCE: RO 3.7 SRO 3.8
- Operator directed to recover tripped Recirculation Pump at power in accordance with 2/3 -
01-68 at step 5.3[10J, in process, the other pump will trip and operator will insert a manual reactor scram in accordance with 2/3-A0I-68-1A, section 4.2 step [1] and perform immediate actions of 2/3-AOl-lOU-i Reactor Scram
- b. EOI-Appendix-7D Standby Coolant Injection (Unit 2 or 3)
- Direct from bank / Low Power / Simulator
- 2/3-EOI-Appendix-7D Injection with Standby Coolant
- 295031 Reactor Low Water Level EA1.08 Ability to operate and/or monitor the following as they apply to REACTOR LOW WATER LEVEL: Alternate Injection Systems IMPORTANCE: R03.8 SRO3.9
- Operator will inject in accordance with EOI-Appendix-7D and raise level.
- c. HPCI in Pressure Control Mode (Unit 2 or 3)
Low Power / Modified from bank / Simulator / Alternate path
- 206000 A4.06 Ability to manually operate and/or monitor in the control room: Reactor pressure IMPORTANCE: RO 4.3 SRO 4.3
- Operator will place HPCI in Test Mode from standby for alternate RPV Pressure Control in accordance with 2/3-EOI-Appendix-1 1C. HPCI flow controller will fail in Automatic and operator will shift to manual to control pressure
ILT 1108 Control Roomlln-Plant Systems JPM Narrative
- d. EOI Appendix-13 Emergency Vent Primary Containment (Unit 2 or 3)
- Alternate Path I Direct from Bank / ENgineered Safety Feature / Simulator
- 2/3-EOI Appendix-13 Emergency Venting Primary Containment
- 295024 High Drywell Pressure EA2.01 Ability to determine and/or interpret the following as they apply to HIGH DRWELL PRESSURE: Drywell pressure IMPORTANCE: RO 4.2 SRO 4.4 Operator is directed to emergency vent Primary Containment to restore and maintain Drywell Pressure below 55 psig as directed by 2/3-EOI Appendix 13, Emergency Venting Primary Containment. Emergency Venting of the Suppression Chamber through the Hardened Wetwell Vents will be unsuccessful and Operator will vent the Drywell to Secondary Containment via Primary Containment vent duct failure.
- e. RWM Functional Test for Startup (Unit 2 or 3)
- Direct from Bank / Low Power-Shutdown / Simulator
- 2/3-SR-3.3.2.l.2 RWM functional test for startup
- 201006 Rod Worth Minimizer System (RWM) A2.05 Ability to (a) predict the impacts of the following on the ROD WORTH MiNIMIZER SYSTEM (RWM) (PLANT SPECIFIC);
and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal conditions or operations: Out of sequence rod movement; P-Spec(Not-BWR6) IMPORTANCE: RO 3.1 SRO 3.5
- Operator will perform 2/3-SR-3.3.2.1.2, RWM Functional Test for Startup, which requires operator to select and withdraw a control rod out of sequence to test the functionality ofthe Select Error, Withdraw Error and Withdraw Block f.
USST lB Transformer Tap Changer Auto Checks (Unit 2 only)
- Alternate Path I New / Simulator
- 0-GOI-300-4, Switchyard Manual
- 262001 AC Electrical Distribution A4.05 Ability to manually operate and/or monitor in the control room: Voltage, current, power, and frequency on AC buses. IMPORTANCE:
RO3.3 SRO3.3
- Operator is directed to perform USST lB Transformer Tap Changer Auto Checks. The Tap changer will fail the initial auto check and a second will have to be performed to verify proper operation of USST lB Tap Changer.
ILT 1108 Control Roomlln-Plant Systems JPM Narrative
- g. Containment Venting High Off-Site Release (Unit 2 or 3)
- Modified I Simulator / Alternate Path
- 213-EOI Appendix-12 Primary Containment Venting
- Vent Primary Containment Vent Primary Containment JAW 2/3-EOJ Appendix-12, after Suppression Chamber Vent path fails will vent through Drywell and flow adjusted to limit high release rates.
- 295017 High Off-Site Release Rate AA1.03 Ability to operate and/or monitor the following as they apply to High Off-Site Release Rate: Plant ventilation systems IMPORTANCE: RO 3.4 SRO 3.4
- Previous 2 exams / Simulator
- 2/3-01-1, Main Steam System
- 239001 Main and Reheat Steam System A4.01 Ability to manually operate and/or monitor in the control room: MSIVs IMPORTANCE: RO 4.2 SRO 4.0
- Operator will close Inboard and Outboard MSJVs on Main Steam Line C, at power, in accordance with 2/3-01-1 section 8.2.3 In-Plant Systems:
i.
Stator Cooling Water Return to Automatic Temp Control
- New/RCA
- 2-ARP-25-l 14A, Window 9, Stator Clg Water Gen Inlet Hi Temp
- 241000 Reactor/Turbine Pressure Regulating System A2.10 Ability to (a) predict the impacts of the following on the REACTORITURBINE PRESSURE REGULATING SYSTEM; and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal conditions or operations: Loss of stator water cooling: Plant-Specific IMPORTANCE: RO 3.1 SRO 3.2
- Operator will simulate restoring the Stator Cooling Water System to Automatic Temperature Control following a Stator Cooling Water Generator Inlet Temp High Alarm and manual control of 2-TCV-35-54 in accordance with 2-ARP-25-1 14A, Window 9, step L
ILT 1108 Control Room/In-Plant Systems JPM Narrative j.
Transfer DG A control to A 4KV SD BD & Secure DG A
- New / RCA Entry
- 0-01-82, Standby Diesel Generator System
- 264000 Emergency Generators (Diesel/Jet) A2.01 Ability to (a) predict the impacts of the following on the EMERGENCY GENERATORS (DIESEL/JET); and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal conditions or operations: Parallel operation of emergency generator IMPORTANCE: RO 3.5 SRO 3.6
- Operator will simulate transferring DG A control to the A 4KV SD BD, in accordance with 0-01-82 section 8.4, then simulate shutting down the diesel from the A 4KV Shutdown board, in accordance with 0-01-82 section 7.2 thru step [9].
k Alternate Injection Fire System Lineup 1-EOI Appendix-7K
- RCA I Emergency or Abnormal In-Plant / Low Power / Direct from Bank
- 1-EOI Appendix-7K, Alternate RPV Injection System Lineup Fire System
- 295031 EA1.08 Reactor Low Water Level Ability to operate and/or monitor the following as they apply to REACTOR LOW WATER LEVEL: Alternate Injection systems: plant-specific IMPORTANCE: RO 3.8 SRO 3.9
- Operator will simulate performing Attachment 1 of 1 -EOI-Appendix-7K due to a Loss of Off-Site Power and a failure of the Diesel Generators. Operator will simulate re-positioning valves by direction of the Unit 1 Operator to line up the Fire System to Inject to the RPV through RHR System II.
ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: Browns Ferry Date of Examination: August 2011 Operating Test Number: ILT 1108 Initials
- 1. General Criteria a
b*
a.
The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).
b.
There is no day-to-day repetition between this and other operating tests to be administered during this examination.
2_
c.
The operating test shall not duplicate items from the applicants audit test(s). (see Section D.1.a.)
c.)5 )(
d.
Overlap with the written examination and between different parts of the operating test is within acceptable limits.
e.
It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license level.
jç7 7.L
- 2. Walk-Through Criteria a.
Each JPM includes the following, as applicable:
initial conditions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee operationally important specific performance criteria that include:
detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important observations to be made by the applicant criteria for successful completion of the task identification of critical steps and their associated performance standards restrictions on the sequence of steps, if applicable b.
Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.
j!?) 34
- 3. Simulator Criteria
The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-301-4 and a copy is attached.
at 5, -cJ4_*
Printed Name / Signature Date
- a. Author
(.
1 z_4i 7-b.
Facility Reviewer(*)
5\\.
scU /
7/ Ii) c.
NRC Chief Examiner (#) 1Z 1141 C) C43A L-(-Efl-o/
2-3 I) d.
NRC Supervisor 1Jke/--
NOTE:
- The facility signature is not applicable for NRC-developed tests.
- Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Facility: Browns Ferry Date of Exam: August 2011 Scenario Numbers:
Operating Test No.: ILT 1108 QUALITATIVE ATTRIBUTES Initials a
b*
1.
The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events.
2.
The scenarios consist mostly of related events.
3.
Each event description consists of the point in the scenario when it is to be initiated the malfunction(s) that are entered to initiate the event the symptoms/cues that will be visible to the crew the expected operator actions (by shift position) the event termination point (if applicable) 4.
No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event.
L-5.
The events are valid with regard to physics and thermodynamics.
$(
6.
Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.
7.
If time compression techniques are used, the scenario summary clearly so indicates.
Operators have sufficient time to carry out expected activities without undue time constraints. Cues are given.
TL. J ?1 8.
The simulator modeling is not altered.
7 ;92t 9.
The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.
10.
Every operator will be evaluated using at least one new or significantly modified scenario. All other scenarios have been altered in accordance with Section D.5 of ES-301.
t-3 c
3 11.
All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the form along with the simulator scenarios).
12.
Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).
35 1L 13.
The level of difficulty is appropriate to support licensing decisions for each crew position.
.Th Target Quantitative Attributes (Per Scenario; See Section D.5.d)
Actual Attributes 1.
Total malfunctions (58) 7/9/7/8/10 2.
Malfunctions after EOP entry (12) 2/4/2/2/6 3.
Abnormal events (24) 4/4/414/4 4.
Major transients (12) 1/1/1/1/2 5.
EOPs entered/requiring substantive actions (12) 3/2/2/2/3 6.
EOP contingencies requiring substantive actions (02) 1/1/1/0/2 7.
Critical tasks (23) 3/4/3/2/4
D cJ CD I
-J 14:
Co ci)I C) 0 0
C1 0)
CD 4-,
CO 0)
D 2
x uJ 9-0 G)
C (4
(4 L
C U)
UI E
0 U
I.
Co U
C)
C)
UI Cu C)
U)
I C?
U)
UI F-0I--<-J Cl CO C4 (1)
C4 C)
C)
C4 C) cOO z
Q UJIZ<HO Q)
Q
cL c,)0 0Q-z Q
CD cEcI)
O
El C
(/)Q
CD0El z
Q ct::ci, O
El (0
CD
()Q C)
CO0 (3
C-)
C,)
0Q-z WI a-
<I0 0z I-a, U
C, C
0 C)
(3 U-CD U,
C,,
C,,
-)
UJ>WZI-H>-t1UJ><
0 cj c,
X 0
cj 0
cj Q
Z I-Z I-Z I-cJ CD If)
-Ii C
C.)
Z00c3>
C/)wcuw U)0D CI)Q C/)Q L
L L
L L
L
D C
I
-J U)a)
I U)00 0
C4 0) cc U)D0)
E a)
LU 4-0 Cu K
(N (N
(N C
C?
U)
Iii EI0 LL 4-I (0
0 C)
C) w 4.1 0)
(0 I-I-OF-<-J C)
C4 C)
Csl m0 z
Q Oc,)
Q
0
(,)0 0cL z
0 (0
ckc,,
C) 0
0 C1)00 Co0 m
a)
C-)
C) 00_
z
Q Qci OQ
11 C)0 c)
z WI 0
<F-C.)
(N 0.
0.z I.
a)
U U) 0 I...
C-)
U-(4 (0
-)
-5 W>WZI H>-DUJ 0
)
Cl)
C)
C/)
<I2.t-JO<ZH 0 0.
Cl) -
>- 0 0)
CI)0I Q0 I
L ii L
Lii L
L
D co cD F-
-J Co a)
F Co0.0 0
C4 0) co (I)
D)
Cuxu-i 0
a)
Cu (N
(N (4
U 0
(I)w E
L.0 U
Co 0
0 w
C 4.J C0 Co C
II-
a
a F- 0 F < -J C1 CD C1 CD C) 0o_
z
0
<HO C.J OQ
ci CI)Q0 0_
C.
z
Q Co OQ ci
(/)Q0 CO0 I
a)
C.)
C/)
Oi0D..
F.
z 0
<F--Q C.)
ci C/)IXQ U)
C) z uJF c5 F..
IIz L.a)
<IC)
Ci U)
C.)
F.
I.
J>wzF
<DCu>-.
-a)a)a)-
l-JO<ZF-I L
L L
L L
L
D co0 F
-J 0
ci)I Cl)C0 C
Cl 0)
Cl)
C)
D E
x LU 0
ci) c..J c.J U
C?
U)w E
0 LI Co C.)
C)
C)
Lii
.1 C)
Co I
Cl)0I I-0I--<-J Ci CD C)
OQ z
Q ZF-O CJ 0
eQ ci
ø0 0a_
z
Q
(
Qcri Q
t:i
(/)0 QD..
z 0
c) p.
OQci
(/)0 ci)
C.)
U) 0a_
L()
z WF a-a0z C,
U)0
<FC (N
0
-)
-)
W>WZF-I>-OLiJ 0
cj 0
U) 0 o
U) s.
F-(>-- <00 a-DJQ<Z-0 I
0 L
L L
L L
ES-S Transient and EveL hecklist Form ES-301-5 Facility: Browns Ferry NPP Date of Exam: August 8
- 19, 2011 Ops Test # ILT1 108 A
E Scenarios P
V T
M P
E 7
1 6
4 L
N CREW CREW CREW CREW T
N I
T POSITION POSITION POSITION POSITION A
S A
B S
A B
S A
B S
A B
L u
A T
R T
0 R
T 0
R T
0 R
T 0
M(*)
N
0 C
P 0
C P
0 C
P 0
C P
T R
I U
E RH RX 2
1 1
lOu m
NOR 1
1 1
I/C 3,6 4,6 2
2 Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an 2.
Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D.
(*) Reactivity and normal evolutions may be 3.
Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements Page 5 of 5
ES-301, Rev. 9 Competencies Checklist Form ES-301-6 Facility: Browns Ferry Date of Examination: August 2011 Operating Test No.: ILT 1108 APPLI CANTS RO SRO-I SRO-U Competencies SCENARIO SCENARIO SCENARIO
124671246712467 Interpret/Diagnose Events 2,4,5, 1,3,4, 3,4,5, 3,4,5, 1,3,4,,4,5, 1,3,4, 3,4,5, 3,4,5, 1,3,4,,4,5, 1,3,4, 3,4,5, 3,4,5, 1,3,4, and Conditions 6,
5,6 6,7 6
5,6 6,
5,6 6,7 6
5,6 6,
5,6 6,7 6
5,6 Comply With and 1,2,3, 1,3,4, 1,2,3, 1,2,3, 1,2,3, [,2,3, 1,3,4, 1,2,3, 1,2,3, 1,2,3,
,2,3, 1,3,4, 1,2,3, 1,2,3, 1,2,3, Use Procedures (1) 7 5,6 6,7 4,6 4,5,6 7
5,6 6,7 4,6 4,5,6 7
5,6 6,7 4,6 4,5,6 Operate Control 1,2,3 1,2,3, 1,2,4, 1,2,3 1,2,3, 1,2,3 1,2,3, 1,2,4, 1,2,3 1,2,3, 1,2,3 1,2,3, 1,2,4, 1,2,3 1,2,3, Boards (2) 4,5,7 4,5,6 5,6,7 4,5,6 4,5,6 4,5,7 4,5,6 5,6,7 4,5,6 4,5,6 4,5,7 4,5,6 5,6,7 4,5,6 4,5,6 Communicate 7
7 7,8 5,7 7,8,9 7
7 7,8 5,7 7,8,9 7
7 7,8 5,7 7,8,9 and Interact Demonstrate Supervisory 1,5,6, 3,4,5, 4,5,6, 4,5,6, 7,8,9
- ,5,6, 3,4,5, 4,5,6, 4,5,6, 7,8,9 bility (3) 7,8 7
7 7,9 7,8 7
Comply With and 2,7 3,5,6 3,5 5,6 1,3 2,7 3,5,6 3,5 5,6 1,3 Use Tech. Specs. (3)
Notes:
(1)
Includes Technical Specification compliance for an RO.
(2)
Optional for an SRO-U.
(3)
Only applicable to SROs.
Instructions:
Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.
ES-401 BWR Examination Outline Form ES-401-1 Facility:
BROWNS FERRY Date of Exam:
AUGUST 2011 RO K/A Category Points SRO-Only Points Tier Group KKKKKKAAAAG A2 G*
Total 1
2 3
4 5
6 1
2 3
4 Total 1.
1 4
3 3
3 3
4 20 3
4 7
Emergency &
Abnormal Plant 2
2 1
1 N/A I
I N/A 1
7 2
1 3
VO utions Tier Totals 6
4 4
4 4
5 27 5
5 10 1
22233332222 26
/4 2
plant 2
I 2
1 1
1 I
I 1
1 1
12 oLtt I
Systems Tier Totals 3
3 4
4 4
4 4
3 3
3 3
38 5
3 8
- 3. Generic Knowledge and Abilities 1
2 3
4 10 1
2 3
4 7
Categories 3
2 2
3 2
2 I
2 Note:
1.
Ensure that at least two topics from every applicable K/A category are sampled within each tier of the RO and SRO-only outlines (i.e., except for one category in Tier 3 of the SRO-only outline, the Tier Totals in each K/A category shall not be less than two).
2.
The point total for each group and tier in the proposed outline must match that specified in the table.
The final point total for each group and tier may deviate by +/-1 from that specified in the table based on NRC revisions.
The final RO exam must total 75 points and the SRO-only exam must total 25 points.
3.
Systems/evolutions within each group are identified on the associated outline; systems or evolutions that do not apply at the facility should be deleted and justified; operationally important, site-specific systems/evolutions that are not included on the outline should be added. Refer to Section D.1.b of ES-401 for guidance regarding the elimination of inappropriate K/A statements.
4.
Select topics from as many systems and evolutions as possible; sample every system or evolution in the group before selecting a second topic for any system or evolution.
5.
Absent a plant-specific priority, only those K/As having an importance rating (lR) of 2.5 or higher shall be selected.
Use the RO and SRO ratings for the RO and SRO-only portions, respectively.
6.
Select SRO topics for Tiers 1 and 2 from the shaded systems and K/A categories.
7*
The generic (G) K/As in Tiers 1 and 2 shall be selected from Section 2 of the K/A Catalog, but the topics must be relevant to the applicable evolution or system. Refer to Section D.1.b of ES-401 for the applicable K/As.
8.
On the following pages, enter the K/A numbers, a brief description of each topic, the topics importance ratings (IRs) for the applicable license level, and the point totals (#) for each system and category. Enter the group and tier totals for each category in the table above; if fuel handling equipment is sampled in other than Category A2 or G* on the SRO-only exam, enter it on the left side of Column A2 for Tier 2, Group 2 (Note #1 does not apply).
Use duplicate pages for RO and SRO-only exams.
9.
For Tier 3, select topics from Section 2 of the K/A catalog, and enter the K/A numbers, descriptions, IRs, and point totals (#) on Form ES-401-3. Limit SRO selections to K/As that are linked to 10 CFR 55.43.
ES-401 2
Form ES4OI..1 ES-401 BWR Examination Outline Form ES-401-1 Emergency and Abnormal Plant Evolutions
E/APE # / Name / Safety Function K
K K
A A
G K/A Topic(s)
IR 12312 295001 AA2.02 295001 Partial or Complete Loss of Forced R
Ability to determine and/or interpret the following as 31 Core Flow Circulation / 1 & 4 they apply to PARTIAL OR COMPLETE LOSS OF FORCED CORE FLOW CIRCULATION
- Neutron monitoring.
(CFR: 41.10 / 43.5/ 45.13) 295003 G2. 1.23 295003 Partial or Complete Loss of AC / 6 R
Ability to perform specific system and integrated plant 4.3 2
procedures during all modes of plant operation.
(CFR: 41.10/43.5 /45.2 /45.6) 295004 Partial or Total Loss of DC Pwr/ 6 R
S 295004 AKI.02 3.2 3
Knowledge of the operational implications of the following concepts as they apply to PARTIAL OR COMPLETE LOSS OF D.C. POWER: Redundant D.C.
power supplies: Plant-Specific....
(CFR: 41.8 to 41.10) 295004 AA2.02 Ability to determine and/or interpret the following as 3.9 76 they apply to PARTIAL OR COMPLETE LOSS OF D.C. POWER: Extent of partial or complete loss of D.C. power (CFR: 41.10 / 43.5 / 45.13) 295005 Main Turbine Generator Trip / 3 R
295005 AK.2.Ol 3.8 4
Knowledge of the interrelations between MAIN TURBINE GENERATOR TRIP and the following:
RPS (CFR: 41.7 / 45.8) 295006 SCRAM / 1 R
S 295006 AK3.06 3,2 5
Knowledge of the reasons for the following responses as they apply to SCRAM
- Recirculation pump speed reduction: Plant-Specific....
(CFR: 41.5 / 45.6) 295006 G2.4.41 Knowledge of the emergency action level thresholds 4.6 77 and classifications.
(CFR: 41.10 / 43.5 / 45.11) 295016 Control Room Abandonment 17 R
S 295016 AAI.08 4.0 6
Ability to operate and/or monitor the following as they apply to CONTROL ROOM ABANDONMENT:
Reactor Pressure.
(CFR: 41.7 / 45.6) 295O1606 (f,t4) 78 Ability to de1eitmne and/or interpret the following as they apply to COROL ROOM ABANDONMENT:
Cooldown rate....
(CFR: 41.10 / 43.5 / 45.13) 2O3 E 1
A O Page 2 of 18
295018 Partial or Total Loss of CCW/ 8 R
295018 AKI.0l 3.5 7
Knowledge of the operational implications of the following concepts as they apply to PARTIAL OR COMPLETE LOSS OF COMPONENT COOLING WATER: Effects on component/system operations (CFR: 41.8 to 41.10) 295019 Partial or Total Loss of Inst. Air / 8 R
295019 AK.2. 17 2.7 8
Knowledge of the interrelations between PARTIAL OR COMPLETE LOSS OF INSTRUMENT AIR and the following: High pressure coolant injection: Plant-Specific (CFR: 41.7/45,8) 295021 Loss of Shutdown Cooling / 4 R
S 295021 AK3.04 3.3 9
Knowledge of the reasons for the following responses as they apply to LOSS OF SHUTDOWN COOLING:
Maximizing reactor water cleanup flow (CFR: 41.5 / 45.6) 295021 G2.4.30 Knowledge of events related to system operation/status that must be reported to internal 4.1 79 organizations or external agencies, such as the State, the NRC, or the transmission system operator.
(CFR: 41.10 / 43.5 / 45.11) 295023 Refueling Acc/8 R
295023 AAI.05 2.8 10 Ability to operate and/or monitor the following as they apply to REFUELING ACCIDENTS
- Fuel transfer system: Plant-Specific (CFR: 41.7 / 45.6) 295024 High Drywell Pressure / 5
R
24..A2.05 re.jz4z.eeQ
- - -7;-
Ability to inc and/or interpret the following as they apply to HI YWELL PRESSURE:
Suppression chamber air-e temperature: Plant-Specific.
(CFR: 41.10 / 43.5 / 45.13) 2t4 2.Oj 295025 High Reactor Pressure / 3 R
295025 G2.4.47 4.2 12 Ability to diagnose and recognize trends in an accurate and timely manner utilizing the appropriate control room reference material.
(CFR: 41.10/43.5 /45.12) 295026 Suppression Pool High Water R
295026 EK2.06 3.5 13 Temp. /5 Knowledge of the interrelations between SUPPRESSION POOL HIGH WATER TEMPERATURE and the following: Suppression pool level...
(CFR: 41.7 / 45.8) 295027 High Containment Temperature / 5 295028 High Drywell Temperature / 5 R
295028 EAI.03 3.9 14 Ability to operate and/or monitor the following as they apply to HIGH DRYWELL TEMPERATURE:
Drywell cooling system.
(CFR:_41.7/45.6)
Page 3 of 18
295030 Low Suppression Pool Wtr Lvi! 5 R
S 295030 EA2.Ol 4.1 15 Ability to determine and/or interpret the following as they apply to LOW SUPPRESSION POOL WATER LEVEL: Suppression pool level..
(CFR: 41.10 / 43.5 / 45.13) 295030 62.4. 6 Knowledge of EOP mitigation strategies 4.7 80 (CFR: 4110 / 43.5 I 45.13) 295031 Reactor Low Water Level /2 R
295031 EK3.0I 4,2 16 Knowledge of the reasons for the following responses as they apply to REACTOR LOW WATER LEVEL:
Automatic depressurization system actuation (CFR: 41.5 /45.6) 295037 SCRAM Condition Present R
295037 G2.4.46 4.2 17 and Reactor Power Above APRM Ability to verify that the alarms are consistent with the Downscale or Unknown / 1 plant conditions.
(CFR: 41.10 /43.5 /45.3 / 45.12) 295038 High Off-site Release Rate / 9 R
295038 EKI.03 2.8 18 Knowledge of the operational implications of the following concepts as they apply to HIGH OFF-SITE RELEASE RATE
- tMeteorological effects on off-site release (CFR: 41.8 to 41.10) 600000 Plant Fire On Site / 8 R
600000 02.4.34 4.2 9
Knowledge of RO tasks performed outside the main control room during an emergency and the resultant operational effects.
(CFR: 41.10/43.5 /45.13)
S 600000 62.4.41 4.6 81 Knowledge of the emergency action level thresholds and classifications, (CFR: 41.10 / 43.5 / 45.11) 700000 Generator Voltage and Electric Grid R
S 700000 AKI.02 3.3 20 Disturbances / 6 Knowledge of the operational implications of the following concepts as they apply to GENERATOR VOLTAGE AND ELECTRIC GRID DISTURBANCES:
Over-excitation.
(CFR: 41.4,41.5,41.7, 41.10 / 45.8) 700000 AA2.05 Ability to determine and/or interpret the following as they apply to GENERATOR VOLTAGE AND 3.8 82 ELECTRIC GRID DISTURBANCES: Operational Status of Offsite Circuit.
(CFR: 41.5 and 43.5 / 45.5, 45,7, and 45.8)
K/A Category Totals;
=
=
=
=
Group Point Total:
20/7 Page 4 of 18
ES-401 3
Form ES-4O11 ES-401 BWR Examination Outline Form ES-401-1 Emergency and Abnormal ant Evolutions
E/APE
/ Name / Safety Function K
K K
A A
0 K/A Topic(s)
IR 12312 295002 Loss of Main Condenser Vac / 3 R
295002 AAI.08 2.6 21 Ability to operate andlor monitor the following as they apply to LOSS OF MAIN CONDENSER VACUUM:
Recirculating flow control system (CFR: 41.7/45.6) 295007 High Reactor Pressure / 3 295008 High Reactor Water Level / 2
295009 Low Reactor Water Level / 2 S
295009 AA2.0l 4.2 83 Ability to determine and/or interpret the following as they apply to LOW REACTOR WATER LEVEL:
Reactor Water Level (CFR: 41.10 / 43.5 / 45.13) 295010 High Drywall Pressure / 5 R
2950l0s&2.04 (r.f14z.cS) 2.8 22 Ability to de7sine andlor interpret the following as they apply to H1DRYWELL PRESSURE: Drywell humidity: Plant-Spet4 (CFR: 4l.l0/43.5/45,15 Z5cIc Af2.Lt 295011 High Containment Temp / 5
295012 High Drywall Temperature / 5
295013 High Suppression Pool Temp. / 5 R
295013 02.4.3 3.7 23 Ability to identify post-accident instrumentation.
(CFR: 41.6/45,4) 295014 Inadvertent Reactivity Addition / 1 S
295014 G2.2.38 4.5 84 Knowledge of conditions and limitations in the facility license.
(CFR: 41.7 / 41.10 / 43.1 / 45.13) 295015 Incomplete SCRAM / 1
295017 High Off-site Release Rate / 9
295020 Inadvertent Cont. Isolation / 5 & 7 295022 Loss of CRD Pumps / 1 R
295022 AKI.02 3.6 24 Knowledge of the operational implications of the following concepts as they apply to LOSS OF CR0 PUMPS: Reactivity control (CFR: 41.8to41.lO) 295029 High Suppression Pool Wtr LVI / 5
295032 High Secondary Containment S
295032 EA2.02 3,5 85 Area Temperature / 5 Ability to determine and/or interpret the following as they apply to HIGH SECONDARY CONTAINMENT AREA TEMPERATURE
- Equipment operability (CFR: 41.10 / 43.5 / 45.13)
Page 5 of 18
295033 High Secondary Containment R
295033 EK2.02 3.8 25 Area Radiation Levels / 9 Knowledge of the interrelations between HIGH SECONDARY CONTAINMENT AREA RADIATION LEVELS and the following: Process radiation monitoring system (CFR: 41.7 / 45.8) 295034 Secondary Containment Ventilation High Radiation / 9
295035 Secondary Containment High R
295035 EK3.Ol 2.8 26 Differential Pressure /5 Knowledge of the reasons for the following responses as they apply to SECONDARY CONTAINMENT HIGH DIFFERENTIAL PRESSURE: Blow-out panel operation:
Plant-Specific (CFR: 41.5 / 45.6) 295036 Secondary Containment High Sump/Area Water Level /5
500000 High CTMT Hydrogen Conc. /5 R
500000 EKI.0I 3.3 27 Knowledge of the operational implications of the following concepts as they apply to HIGH CONTAINMENT HYDROGEN CONCENTRATIONS:
Containment integrity (CFR: 41.8 to 41.10)
K/A Category Point Totals:
=
]
Group Point Total:
7/3 Page 6 of 18
ES-401 4
Form ES-401-1 ES-401 BWR Examination Outline Form ES-401-1
=
Plant §ystems
System#/Name K
K K
K K
K A
A A
A G
K/ATopic(s) lR 1234561234 203000 RHR/LPCI:
Injection R
203000 K6.0l 3,6 28 Mode Knowledge of the effect that a loss or malfunction of the following will have on the RHR/LPCI:
INJECTION MODE (PLANT SPECIFIC)
- AC.
electrical power (CFR: 41.7 / 45.7) 205000 Shutdown Cooling R
205000 A 1.02 3.3 29 Ability to predict and/or monitor changes in parameters associated with operating the SHUTDOWN COOLING SYSTEM (RHR SHUTDOWN COOLING MODE) controls including: SDC/RHR pump flow (CFR: 41.5 /45.5) 206000 HPCI R
206000 A2.15 3.4 30 Ability to (a) predict the impacts of the following on the HIGH PRESSURE COOLANT INJECTION SYSTEM and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal conditions or operations: Loss of control oil pressure: BWR-2,3,4 (CFR: 41.5 /45.6) 206000 A3.06 R
Ability to monitor automatic operations of the 3,8 31 HIGH PRESSURE COOLANT [NJECTION SYSTEM including: System discharge pressure:
BWR-2,3,4 (CFR: 41.7 /45.7) 207000 Isolation (Emergency)
Condenser 209001 LPCS R
209001 A4.05 3.8 32 Ability to manually operate and/or monitor in the control room: Manual initiation controls (CFR: 41.7 / 45.5 to 45.8) 209002 HPCS Page 7 of 18
211000SLC R
S 2ll000KI.07 2.6 33 Knowledge of the physical connections and/or cause effect relationships between STANDBY LIQUID CONTROL SYSTEM and the following:
Jet pump differential pressure indication: Plant-Specific (CFR: 41.2 to 41.9 /45.7 to 45.8) 211000 A2.08 4.2 86 Ability to (a) predict the impacts of the following on the STANDBY LIQUID CONTROL SYSTEM ; and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal conditions or operations: Failure to SCRAM (CFR: 41.5 / 45.6) 212000 RPS R
212000 K2.Ol 3.2 34 Knowledge of electrical power supplies to the following: RPS motor-generator sets (CFR: 41.7) 215003 IRM R
215003 K3.0l 3.9 35 Knowledge of the effect that a loss or malfunction of the INTERMEDIATE RANGE MONITOR (IRM) SYSTEM will have on following: RPS (CFR: 41.7/45.4) 215004 Source Range Monitor R
R 215004 K4.06 3.2 36 Knowledge of SOURCE RANGE MONITOR (SRM) SYSTEM design feature(s) and/or interlocks which provide for the following: IRM/SRM interlock (CFR: 41,7) 215004 K5.03 Knowledge of the operational implications of the 2,8 37 following concepts as they apply to SOURCE RANGE MONITOR (SRM) SYSTEM
215005 K5.04 2,9 38 Knowledge of the operational implications of the following concepts as they apply to AVERAGE POWER RANGE MONITOR/LOCAL POWER RANGE MONITOR SYSTEM
- LPRM detector location and core symmetry (CFR: 41.5 /45.3)
Page 8 of 18
217000 RCIC R
R 2t00K6.03 Crc 4
,(ate) 35 39 KnowIa4,e of the effect that a loss or malfunction of the foil ing will have on the REACTOR CORE ISOL ION COOL[NG SYSTEM (RCIC)
Suppres n pool water supply (CFR:41.7/45,7) l1ooD A3.cI 217000 A2.05 Ability to (a) predict the impacts of the following 3.3 40 on the REACTOR CORE ISOLATION COOLING SYSTEM (RCIC) ; and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal conditions or operations: D.C.
power loss (CFR: 41.5 / 45.6) 218000 ADS R
1pA3.05 (r&2iCQ) 41 Abilititjionitor automatic operations of the AUTOMATh+DEPRESSURIZATION SYSTEM including: Sup?etion pool level (CFR:4l.7/45.7) 21OO 218000 G2.l.7 R
Ability to evaluate plant performance and make 4.4 42 operational judgments based on operating characteristics, reactor behavior, and instrument interpretation.
(CFR: 41.5/43,5/45.12/45,13) 223002 PCIS/Nuclear Steam R
223002 A4.06 3.6 43 Supply Shutoff Ability to manually operate and/or monitor in the control room: Confirm initiation to completion (CFR: 41.7 / 45.5 to 45.8) 239002 5RVs R
239002 G2. 1.20 4.6 44 Ability to interpret and execute procedure steps.
(CFR: 41.10/43.5 /45.12) 259002 Reactor Water Level R
S 259002 KI.02 3.2 45 Control Knowledge of the physical connections and/or cause effect relationships between REACTOR WATER LEVEL CONTROL SYSTEM and the following: Main steam flow (CFR: 41.2 to 41.9/45.7 to 45.8) 259002 A2.06 Ability to (a) predict the impacts of the 3.4 87 following on the REACTOR WATER LEVEL CONTROL SYSTEM ; and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal conditions or operations: Loss of controller signal output (CFR: 41.5 / 45.6)
Page 9 of 18
261000 SGTS R
R 261000 K3.03 3.2 46 Knowledge of the effect that a loss or malfunction of the STANDBY GAS TREATMENT SYSTEM will have on following: Primary containment pressure: Mark-I&ll (CFR: 41.7 /45.6) 2.QQ0Al.05 Abilitse.,predict and/or monitor changes in 47 parametersociated with operating the STANDBY GTREATMENT SYSTEM controls including.
rimary containment oxygen level: Mark-1&Il (CFR:4l.5/45.5)
ALD7 262001 AC Electrical R
S 262001 1(2.01 3 3 48 Distribution Knowledge of electrical power supplies to the following: Off-site sources of power (CFR: 41.7) 262001b..a..19 (r1acea) 88 Ability to usi.t computers to evaluate 4.7 system or compowtstatus.
(CFR: 41.10)45.12) N1\\ ZDLOGc.t.1 262002 UPS (AC/DC)
R 262002 K4.Ol 3.1 49 Knowledge of IJNINTERRUPTABLE POWER SUPPLY (AC/D.C.) design fearure(s) and/or interlocks which provide for the following:
Transfer from preferred power to alternate power Supplies (CFR: 41.7) 263000 DC Electrical R
263000 K5.0l 2.6 50 Distribution Knowledge of the operational implications of the following concepts as they apply to D.C.
ELECTRICAL DISTRIBUTION: Hydrogen generation during battery charging (CFR: 41.5 / 45.3) 264000 EDGs R
S 264000 K6.03 3.5 51 Knowledge of the effect that a loss or malfunction of the following will have on the EMERGENCY GENERATORS (DIESEL/JET): Lube oil pumps (CFR: 41.7 / 45.7) 264000 A2.03 3.4 89 Ability to (a) predict the impacts of the following on the EMERGENCY GENERATORS (DIESEL/JET); and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal conditions or operations: Operating unloaded, lightly loaded, and highly loaded (CFR: 41.5 / 45.6)
Page 10 of 18
300000 Instrument Air R
300000 K4.03 2.8 52 Knowledge of (INSTRUMENT AIR SYSTEM) design feature(s) and or interlocks which provide for the following:
Securing of lAS upon loss of cooling water (CFR: 41.7) 400000 Component Cooling R
S 400000 Al.01 2.8 53 Water Ability to predict and / or monitor changes in parameters associated with operating the CCWS controls including: CCW flow rate (CFR: 41.5 / 45,5) 400000 G2.4.II 4.2 90 Knowledge of abnormal condition procedures.
(CFR: 41,10 / 43.5 / 45.13)
[ K/A Category Point Totals:
[
Group Point Total:
26/5 Page 11 of 18
ES-401 5
Form ES-4O11 ES-401 BWR Examination Outline Form ES-401-1 Plant Sys ems-Tier 2/Crou2 (RO/SRO)
System#/Name K
K K
K K
K A
A A
A G
KJATopic(s) lR 4
12345612 34 201001 CRD Hydraulic R
201001 A3.04 2.8 54 Ability to monitor automatic operations of the CONTROL ROD DRIVE HYDRAULIC SYSTEM including: System flow (CFR: 41.7 / 45.7) 201002 RMCS 201003 Control Rod and Drive R
201003 A4.0l 26 55 Mechanism Ability to manually operate and/or monitor in the control room: CRD mechanism temperature (CFR: 41.7 / 45.5 to 45.8) 201004 RSCS 201005 RCIS 201006 RWM S
20100\\A2.05 (rekce) 3.5 91 Ability tNa) predict the impacts of the following o\\the ROD WORTH M1NIMIZEkSYSTEM (RWH) (PLANT SPECIFIC); ahI (b) based on those predictions, userocedures to correct, control, or mitiga\\e the consequences of those abnormal cokditions or operations:
Out of sequence rotKmovement; P J 2r2_.t00 AZO.
202001 Recirculation S
202001 02.2.44 4.4 92 Ability to interpret control room indications to verify the status and operation of a system, and understand how operator actions and directives affect plant and system conditions.
(CFR: 41.5 / 43.5 / 45.12) 202002 Recirculation Flow Control 204000 RWCU R
204000 02.1,28 4.1 56 Knowledge of the purpose and function of major system components and controls.
(CFR: 41.7) 214000 RPIS S
214000 A2.01 3.3 93 Ability to (a) predict the impacts of the following on the ROD POSITION INFORMATION SYSTEM ; and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal conditions or operations: Failed reed switches (CFR: 41.5 /45.6)
Page 12 of 18
215002 RBM 216000 Nuclear Boiler Inst.
219000 RHR/LPCI: Torus/Pool Cooling Mode 223001 Primary CTMT and Aux.
226001 RHR/LPCI: CTMT Spray Mode 230000 RHR/LPCI: Torus/Pool Spray Mode 233000 Fuel Pool Cooling/Cleanup 234000 Fuel Handling Equipment 239001 Main and Reheat Steam 239003 MSIV Leakage Control 241000 Reactor/Turbine Pressure Regulator 245000 Main Turbine Den. / Aux.
216000 K3.02 4.0 59 Knowledge of the effect that a loss or malfunction of the NUCLEAR BOILER Instrumentation will have on following:
PCIS/NSSSS (CFR: 41.7 / 45.4) 223001 K4.06 3.1 60 Knowledge of PRIMARY CONTAINMENT SYSTEM AND AUXILIARIES design feature(s) andlor interlocks which provide for the following: Maintains proper containment/secondary containment to drywell differential pressure (CFR: 41.7) 230000 K5.07 2,9 61 Knowledge of the operational implications of the following concepts as they apply to RI-IR/LPCI: TORUS/SUPPRESSION POOL SPRAY MODE: Vacuum breaker operation (CFR: 41.5 / 45.3) 245000 K6.03 2.8 62 Knowledge of the effect that a loss or malfunction of the following will have on the MAIN TURBINE GENERATOR AND AUXILIARY SYSTEMS: Hydrogen seal oil (CFR: 41.7/45.7) 215001 Traversing In-core Probe 215001 Kl.05 3.3 57 Knowledge of the physical connections and/or cause effect relationships between TRAVERSING IN-CORE PROBE and the following: Primary containment isolation system: (Not-BWRI)
(CFR: 41.2 to 41.9 / 45.7 to 45.8) 215002 K2.03 2.8 58 Knowledge of electrical power supplies to the following: APRM channels: BWR-3,4,5 (CFR: 41.7) 256000 Reactor Condensate Page 13 of 18
259001 Reactor Feedwater 268000 Radwaste 271000 Offgas 272000 Radiation Monitoring 286000 Fire Protection 288000 Plant Ventilation 290001 Secondary CTMT 290003 Control Room HVAC 290002 Reactor Vessel Internals K/A Catectory Point Totals:
259001 Al.0l 3.3 63 Ability to predict and/or monitor changes in parameters associated with operating the REACTOR FEED WATER SYSTEM controls including: Feedwater flow/pressure (CFR: 41.5 / 45.5) 2903 A2.04 (rep1tc.ec) i Abilito (a) predict the impacts of the foIIowinon the CONTROL ROOM HVAC: a (b) based on those predictions, use procedikes to colTect, control, or mitigate the nsequences of those abnormal conditions or operations: Irn ation/failure of fire protection system (CFR:41.5/45.6)
ZOtO3 A.o(
290002 K3.0l 3.2 65 Knowledge of the effect that a loss or malfunction of the REACTOR VESSEL INTERNALS will have on following: Reactor water level (CFR: 41.7 / 45.4)
Group Point Total:
Page 14 of 18
ES-401 Generic Knowledge and Abilities Outline (Tier 3)
Form ES4O1..3 Facility:
Date of Exam:
Category K/A #
Topic RO SRO-Only IR IR 2.1.
G2.l.18 3.6 66 Ability to make accurate, clear, and concise logs, records, status boards, 1.
and reports.
Conduct (CFR:4l.lO/45,12/45.13) of Operations 2.1.
G2.J,25 3,9 67 Ability to interpret reference materials, such as graphs, curves, tables, etc.
(CFR: 41.10 /43.5 /4512) 2.1.
G2.l.37 4,3 68 Knowledge of procedures, guidelines, or limitations associated with reactivity management.
(CFR: 41.1 /43.6/45.6) 2.1.
G 2.1.5 3.9 94 Ability to use procedures related to shift staffing, such as minimum crew complement, overtime limitations, etc.
(CFR: 41,10 / 43.5/ 45.12)
Subtotal 2.2.
G2.2.7 2.9 69 Knowledge of the process for conducting special or infrequent tests.
(CFR: 41.10 /43.3 /45.13) 2.
Equipment 2.2.
G2.2.l2 3.7 70 Control Knowledge of surveillance procedures.
(CFR: 41.10/45.13) 2.2.
62.2.17 3.8 96 Knowledge of the process for managing maintenance activities during power operations, such as risk assessments, work prioritization, and coordination with the transmission system operator.
(CFR: 41.10 / 43.5 / 45.13) 2.2.
G2.2.25 4.2 97 Knowledge of the bases in Technical Specifications for limiting conditions for operations and safety limits.
(CFR: 41.5/41.7/ 43.2) 2.2.
Page 15 of 18
2.2.
Subtotal 2.3.
G2.3.7 3.5 71 Ability to comply with radiation work permit requirements during normal or abnormal conditions.
3 (CFR:41.12/45.lO)
Radiation Control 2.3.
G2.3,12 3.2 72 Knowledge of radiological safety principles pertaining to licensed operator duties, such as containment entry requirements, fuel handling responsibilities, access to locked high-radiation areas, aligning filters, etc.
(CFR: 41.12 / 45,9/ 45.10) 2.3.
G2,3.15 3.1 98 Knowledge of radiation monitoring systems, such as fixed radiation monitors and alarms, portable survey instruments, personnel monitoring equipment, etc.
(CFR; 41.12 / 43.4/ 45.9) 2.3.
2.3.
2.3.
Subtotal 2.4.
G2.4.2 4.5 73 Knowledge of system set points, interlocks and automatic actions 4.
associated with EUP entry conditions.
Emergency (CFR: 41.7 / 45.7 / 45.8)
Procedures /
Plan 2.4.
G2.4.4 4.5 74 Ability to recognize abnormal indications for system operating parameters that are entry-level conditions for emergency and abnormal operating procedures.
(CFR: 41.10/43.2/45.6) 2.4.
G2.4.35 3.8 75 Knowledge of local auxiliary operator tasks during an emergency and the resultant operational effects.
(CFR: 41.10/43.5/45.13) 2.4.
G 2.4.5 4.3 99 Knowledge of the organization of the operating procedures network for normal, abnormal, and emergency evolutions.
(CFR: 41.10 / 43.5 / 45.13) 2.4.
G2.4.38 4.4 100 Ability to take actions called for in the facility emergency plan, including supporting or acting as emergency coordinator if required.
(CFR; 41.10/43.5/45.11) 2.4.
Subtotal Tier3PointTotal 10 7
Page 16 of 18
ES-401 Record of Rejected KIAs Form ES-401-4 Tier /
Randomly Selected Reason for Rejection Group K/A RU 1/1 295024 EA2.05 Unable to write a discriminating question pertaining to torus air space temperature (plant specific) as it applies to high drywell pressure.
Randomly selected 295024 EA2.01 (drywell pressure). RU 4.2 RU 2/1 218000 A3.05 Unable to write a discriminating question pertaining to monitoring torus level during an ADS blow down. Randomly selected 218000 A3.01 (ADS valve operation) RU 4.2 RU 2/1 261000 A1.05 Unable to write a discriminating question pertaining to predicting/monitoring changes in oxygen level when operating the SBGT system. Randomly selected 261000 A1.07 (SBGTS train temperature) RU 2.8 SRO 2/1 262001 G2. 1.19 Unable to write a discriminating question pertaining to using the plant computers to evaluate AC Electrical Distribution status at the SRU level.
Randomly selected 206000 G2. 1.7 (HPCI: evaluate plant and make judgements) SRU 4.7 SRO 1/1 295016 AA2.06 Question overlapped with RU Q# 6 (295016 AAI.08) and unable to write an SRU level question pertaining to TS actions (all less than or equal to 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />) during Panel 25-32 operations for cool down rate. Randomly selected 295038 EA2.03 (High Uffsite Release Rate: rad levels) SRO 4.3 SRU 2/2 201006 A2.05 All the RWM Tech Spec action statements required immediate action (i.e.,
1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />). Unable to write a discriminating question at the SRU level.
Randomly selected 212000 A2.05 (RPS: Nuclear Boiler Instrument Failure) SRU 3.7 SRU 3 G2. 1.13 Unable to write a discriminating question at the SRO level for vitallcontrolled access because switchyard access and plant area access controls is also RU knowledge. Randomly selected 2.1.41 (Knowledge of refueling) SRU 3.7 RU 1/2 295010 AA2.04 Unable to write a discriminating question pertaining to drywell humidity
BFN has a dew point indicator at Panel 9-47; however, a proposed question to test the applicants ability to distinguish between a drywell pressure problem as opposed to whether or not a leak exists (given the dew point indication) would not provide any discrimination. Randomly selected 295010 AA2.01 (leak rate)
RU 2/1 217000 K6.03 Unable to write a question that did not overlap with SRO Q#88 (HPCI G2. 1.7) because both RCIC and HPCI have the same concern for high torus temperature (140 deg). Randomly selected 217000 A3.01 (Valve operation)
RU 2/2 290003 A2.04 Browns Ferry control rooms do not have a fire suppression system (detection only) Randomly selected 290003 A2.0 1 (initiationlreconfiguration)
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: rowy F--rL.j Date of Exam:
Exam Level: RD SRO El Initial Item Description a
b*
c#
1.
Questions and answers are technically accurate and applicable to the facility.
F 2.
a.
NRC K/As are referenced for all questions.
b.
Facility learning objectives are referenced as available.
3.
SRO questions are appropriate in accordance with Section D.2.d of ES-401 4.
The sampling process was random and systematic (If more than 4 RD or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR CL program office).
5.
Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:
the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or jihe examinations were developed independently; or the licensee certifies that there is no duplication; or other (explain) 6.
Bank use meets limits (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the rest new or modified); enterthe actual RO/SRO-only 0
/
i1
/
O question distribution(s) at right.
- 7. g Between 50 and 60 percent of the questions on the RD Memory C/A exam are written at the comprehension/ analysis level; 62 b the SRO exam may exceed 60 percent if the randomly RD j RD RD /
selected K/As support the higher_cognitive levels; enter 36 1
39 /
thO I SRO questior jstrIbiiiat right.
8.
References/handouts provided do not give away answers or aid in the elimination of distractors.
9.
Question content conforms with specific K/A statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are justified.
10.
Question psychometric quality and format meet the guidelines in ES Appendix B.
11.
The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet.
Printed Name / Signature Date
- a. Author i,
- b. Facility Reviewer (*)
- Al/A
- c. NRC Chief Examiner (#)
L3RUJbLO C,k1AL-LEfrj /?wo 8//i/i)
- d. NRC Regional Supervisor jtAieJc.. F t-ir- /<:7-(_.
Note:
- The facility reviewers initials/signature are not applicable for NRC-developed examinations.
- Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility:
Date of Exam:
Exam Level: RO El SRQ lEt Initial Item Description a
b*
c,#
1.
Questions and answers are technically accurate and applicable to the facility.
(22 2.
a.
NRC K/As are referenced for all questions.
b.
Facility learning objectives are referenced as available.
3.
SRO questions are appropriate in accordance with Section D.2.d of ES-401
4.
The sampling process was random and systematic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR OL program office).
5.
Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:
the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or
-the examinations were developed independently; or the licensee certifies that there is no duplication; or other (explain) 5 6.
Bank use meets limits (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO / SRO-only
/ /
/ 2.
z z question_distribution(s)_at_right.
7.
Between 50 and 60 percent of the questions on the RO Memory C/A s d?
exam are written at the comprehension/ analysis level;
the SRO exam
.0percen if the randomly RD
/ SD
.40
/ g 0
selected K/As support the higher cognitive levels; enter
//
/ 4.
the(aIO / SRO question 41 butionat right.
8.
References/handouts provided do not give away answers i1 or aid in the elimination of distractors.
I 9.
Question content conforms with specific K/A statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are justified.
10.
Question psychometric quality and format meet the guidelines in ES Appendix B.
1 1.
The exam contains the required number of one-point, multiple choice items; 0,
the total is correct and agrees with the value on the cover sheet.
T
/
- a. Author
- b. Facility Reviewer (*)
- c. NRC Chief Examiner (#)
- d. NRC Regional Supervisor Note:
- The facility reviewers initials/signature are not applicable for NRC-developed examinations.
- Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
Browns Ferry 2011-301 Written Examination Review Worksheet Form ES-401-9 r-ES 4Q ( 9 c1(4q & -tLe £e--e Q_ NRC
-rk e-avi.
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/
LOK LOD I
(C/A) (1-5) Stem Cue T/F Cred Partial Job-Minuti
- 1 Back-Q SRO U/E/S Explanation Focu s
Link a
units ward K/A Only s
Dist.
Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
1.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2.
Enter the level of difficulty (LOD) of each question using a 1
- 5 (easy
- difficult) rating scale (questions in the 2
- 4 range are acceptable).
3.
Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated true/false statements.
One or more distractors is not credible.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
4.
Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
5.
Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
6.
Based on the reviewers judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
7.
At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
RO/SRO Combined Question ES-401
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/ LOKLOD (C/A) (1-5) Stem Cue TIE Cred Partial Job-Minuti
- 1 Back-Q SRO UIEIS Explanation Focu s
Link a
units ward KJA Only s
Dist.
Total Recirc Flow documented in ARP and lesson plans.
H 4
u Correct answer is D not B, Eliminate parenthesis after each distractor. See attached 2
F 5
X Y
U One Hour is a step in attachment 9 not a Caution or a Note, recall of knowledge too specific for a closed book exam. For second part could have which DG supplies power to a normally aligned EECW Pump. See attached H
5 X
X Y
X U
Change first part from Operable to have power or do NOT have power. Procedure selection SRO level knowledge for restoration, entry requirements for both of these procedures are met, operationally both procedures would be entered and utilized. See attached
TURV is TURB, Change power level to 23%, correct H
x x
u answer is C. The way currently written can argue annunciator is lit or not lit due to lack of stem focus. Also at 28% can argue both second part are correct since the status of Aux Steam loads is not identified 4 to 5% power for these loads. Currently answer Key has B checked with D at the bottom of the page.
B distractor is different than others. Can argue that all four answers are correct. See attached
Missing a semi colon for A, remove semi colons F
3 Y
S
Knowing what alarm windows are on the backup control 6
H 5
x x
x u
panel is minutia. Pressure Band is a specific step in the AOl and is an SRO Function. Just because you have to verify feed valves closed does not mean the pressure band is 800 to 1000. Recommend BEN Bank Question see attached
Correct should be C, Two Correct answers. More specific H
x u
an immediate scram is required or any scram is required at anytime. Remove is from stem in first sentence. See attached
Distractor B and D are the same, no noun names, no Unit 8
F 5
x x
x u
IDs, drain pots will still auto drain. A is not correct, the most correct answer is C. HPCI loss of air low level of importance for all the things that happen on a loss of air.
See attached
Two correct answers C and D. RWCU is always correct H
x u
for Thermal Stratification. The 200 degrees on all indications is for thermal stratification not alternate decay heat removal. RWCU can be used for both Thermal stratification and alternate decay heat removal. See attached rwo correct answers, both A and B are immediate actions 10 H
x u
in 1-AOl-79-2. It would not be wrong to evacuate the refuel floor of personnel not involved in fuel moves. See attachec Drywell Sprays are required should read Drywell Sprays
1 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/ LOKLOD
(C/A) (1-5) Stem Cue TIF Cred Partial Job-Minuti
- 1 Back-Q SRO U/E/S Explanation Focu s
Link a
units ward K/A Only s
Dist.
are allowed. An ED condition is already met for Drywell H
X u
Temperature greater than 280 degrees. EOl-2 does not direct ED on Curve 8 but Curve 8 is on EOl-2 is always evaluatedand possibly would ED because level instruments would be bad, Can argue that A is also correct. SROs get curve 8 in references and ROs do not.
C and D distractors first and second part do not go 12 H
x u
together. Two plausible choices. Have to assume ATWS need to state in stem.
SRO only question to know that if HCTL is exceeded 13 H
5 x
x u
cannot restore and maintain by lowering Reactor pressure Change torus temp to suppression poo[ temp, torus pressure of 5 psiq is not operationally valid at 190 degrees. Cannot interpolate 800 psig on HCTL, give a pressure from HCTL curve. Need to put an RO in the safe area of the curve. See attached
Not operationally valid to run with only 8 blowers in 14 H
s x
x u
service.
No correct answer only four blowers would be running.
Auto-actuation should read auto initiation signal. Change 200 to 280 or 150.
Formatting, see attached F
3 S
Required to be manually inhibited. Two inch difference to 16 F
5 x
u decide between competent operator.
Memorize step in EOI, recommend the other distractor be
-100 or-50 Could argue -122 is correct if below this number you inhibit ads, other number should be above -120.
Validators had trouble reading question, Stem needs 17 H
3 X
E worked.
Cuilman, where is Cullman. Technically Cullman is not 18 F
5 x
x u
correct for from the 225 degree direction, Cuilman is from 180 to 170 from BFN. Need to change Release is from Reactor Building Refuel Floor to Reactor Building or Turbine Building. Validators said Reactor Building Refuel floor he assumed Refuel floor Hvac release.
EPIP 8 is personnel accountability not dose assessment, Change EPIP 8 to EPIP 13.
19 H
5 X
U Memorize a subsequent action from one of 25 SSIs.
RCIC is operated from panel 25-32 in this SSI, and it is manually started.
Recommend NEW K/A 20 F
4 S
formatting
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/LOKLOD
(C/A) (1-5) Stem Cue TIF Cred Partial Job-Minuti
- 1 Back-Q SRO U/E/S Explanation Focu s
Link a
units ward K/A Only S
Dist.
formatting Need a d on increased in D.
22 F
5 X
X U
Minutia memorize a time from subsequent action step 2.1 of the Aol. This AOl also states that multiple conditions would require entry and that the SRO will direct actions based on symptoms and experience. See attached 23 H
3 E
Black Frame needs to be Black Label formatting see attached 24 H
3 S
formatting see attached 25 F
3 S
formatting see attached
Please spell out FSAR 26 F
4 S
formatting see attached
Iwo correct answers C and D, Change B nitrogen tank to 27 F
X u
A nitrogen tank.
see attached 28 H
4 S
formatting see attached
Need to Enhance stem focus to either Bold no further 29 H
3 5 E
actions taken or Immediately following Pump start and bold immediately. formatting see attached 30 H
3 S
formatting see attached 31 H
3 E
Change to fill in the blank question formatting see attached
Do Not need second half of question or do not need first 32 H
3 X
u half of question FCV-75-23 is the Outboard Valve not Inboard. Not sure if A and B are supposed to be Outboard valves and C and D are Inboard valves?
lAW 2-EOl Appendix -6D/E Injection Subsystems Lineup Core Spray System 1/2 from 2-01-75 see attached H
3 U
Correct answer is A not B. Calibrated Jet Pumps have a tap on the SLC injection sparger as well as the other l6je pumps. The calibrated jet pumps have an extra connection on the diffuser that goes to a separate indicator on panel
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#I LOKLOD r
(C/A) (1-5) Stem Cue T/F Cred Partial Job-Minuti
- 1 Back-Q SRO UIE/S Explanation Focu s
Link a
units ward KIA Only S
Dist.
Stem should state the alternate power supply feed to the H
3 E
1 B RPS Bus is
... there is no alternate power supply to the 1 B RPSMG set two correct answers (A and B). provide a value for IRMs F
3 X
u on range 9 in order to make B the correct answer 36 H
3 S
formatting see attached
Need to provide the status of the SRMs. Are they partially H
3 X
x u
withdrawn or fully inserted? ARP states a tolerance of ÷1-14 cps on the 145 cps which would make the top end of the 125-1 35 cps band within the tolerance. All answers could be argued correct based on detector position and band being within tolerance of alarm 38 H
3 S
D could be argued correct because the 1-55 and 1-56 H
3 X
E valves are required to be opened on a RCIC isolation by procedure (2-AOl-64-2C)
C is the correct answer, not D. The 71-3 valve cannot 40 H
4 u
close without power to the valve formatting see attached
LOOP should be spelled out, not terminology commonly 41 H
4 E
used. Also, level 1 should be provided (actual level), not terminology commonly used. Provide UNID for timer reset pushbutton. formatting see attached
How can all MSIVs be open if the A DW control air 42 H
4 x
x u
header is depressurized? Did the bypass valves fail to operate as designed to allow pressure to get to 1140 psig.
In the stem to ask which main steam lines are used to stabilize pressure is an irrelevant question because the SRVs are upstream of the MSIVs. The first part of the distractors needs to bepast tense to properly ask the question of how many SRVs opened at 1140 psig, otherwise the question is posed as what is happening right now this would lead to no correct answer.
formatting see attached F
3 E
Change H PlC to H PCI in the stem of the question.
formatting see attached
Propose removing the bullet that states there is a fire in H
4 x
u the Unit 3 DO building because this leads to two correct answers, due to 0-SSI-21 actions which state to scram when entry conditions are met. 0-SSI-21 entry conditions:
unit above atmospheric pressure, a fire in the proper location, and equipment spuriously operating (SRV). Also, how can Suppression Pool Temperature be stable when an SRV is stuck open. formatting see attached
)
1 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#J LOKLOD I
(C/A) (1-5) Stem Cue TIF Cred Partial Job-Minuti
- 1 Back-Q SRO U/E/S Explanation Focu s
Link a
units ward K/A Only S
Dist.
The question has good intent but needs to be specific to H
5 x
u provide what instruments are failed and what instruments are still available. Taking the question to this level is minutia make correct answer B or D. formatting see attached
Two correct answers. When DW pressure rises and 46 H
4 X
u reaches 2.45 psig, SBGT trains A & B will auto start, therefore, C and D are both correct depending on the time frame. Even though power to RPS has not been lost SBGTs A & B will still start at 2.45 psig. Propose providing time or DW pressure parameter to ensure only one correct answer. formatting see attached
Need to provide specific value to where the SGT A H
5 X
X x
u charcoal bed temperature rises, otherwise the question is ambiguous and multiple answers could be correct.
Backward logic for alarm, if in control room would know if train was running or not if alarm was received. Minutia to recall from memory when Decay Heat Removal is required to be initiated lAW 0-01-65 and whether an alarm comes in with system running or shutdown. Decay heat removal is also only required when the train is no longer in service.
formatting see attached
Need to change shutdown board to shutdown bus in 48 F
3 E
the second part of the stem formatting see attached F
3 S
formatting see attached
tobeinoperationinAandCshouldbemovedtothe 50 F
3 E
stem statement, as it is relative to all choices. formatting see attached
There is no correct answer to this question as written. The 51 A
x u
alarm is only active if the EDG is running or you haye a low sump level, If EDG were running, be careful with A distractor. formatting see attached
AandBaresubsets,thereforeifBiscorrectsoisA. Cis 52 F
4 x
x u
also a correct answer based on 0-01-32 illustration 4.
There are 3 correct answers. formatting see attached
Define procedure title for 2-01-70 = RBCCW System.
H 4
E Need Unids for valves in distractor A and B, the RBCCW HX Valves, formatting see attached
Delete bullets 1,2 and 5. Only need bullet 3 and 4. Need 54 A
x u
actual Indicator designators or Unids. With holding the I
I switch in close for two seconds there are two correct answers not enough room on flow control valve to return flow to normal, formatting see attached Stem Cueing, 350 is in the stem.
F 5
X X
X U
Not RO question for second part, The answer is in Tech Spec Bases. The TI is an engineering procedure and the right answer is in the body of that procedure, and it says refer to note in 3.1.4 and the answer for note one is in tech
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/LOKLOD
(C/A) (1-5) Stem Cue T/F Cred Partial Job-Minuti
- 1 Back-Q SRO U/E/S Explanation Focu s
Link a
units ward K/A Only S
Dist.
spec bases. formatting see attached Change second part to on pump suction or on pump 56 F
3 E
discharge upstream or downstream is difficult for a closed lop system.
formatting see attached Double jeopardy with question 43 for actuation of TIP, if H
4 u
you do not know it in 43 you would miss this question also.
Need to designate B TIP Ball and Purge Valves formatting see attached 58 F
4 S
formatting see attached
LIS 203A Reactor Water Level Low is tripped LOW due H
3 E
to surveillance. Change lit to in alarm, formatting see attached
lorus Pressure is always lower than drywell pressure.
60 F
U Correct answer is B, All distractors need to have psid NOT psig. formatting see attached
No Correct Answer, EOI SAMG actual level is 19.25 Feet, 61 H
3 x
x x
u it also references that at 18 feet they will start to cover and EOl Bases has 18 feet, this 18 feet is based on actual control room indications. Change second part to when we stop Drywell Spray which is at 18 feet and we could use 18 feet and 19 feet. formatting see attached
Change second part to Hydrogen Purity will Drop and 62 H
4 E
Hydrogen Purity will remain unchanged. formatting see attached
Little to NO operational Validity to operating flow Bias on 63 H
X x
x u
controller, Operators do not adjust. Use column one or three for operational validity and Auto versus manual on master controller. On simulator correct answer is D. A and B can be argued as correct also, adjusting flow bias on a pump will depend on where that pumps bias and the other pumps bias is already at.
formatting see attached 64 H
5 X
X U
BFN Control Rooms do not have a CO2 system, recommend new K and A, Operation of fire protection has no effect on CREV. Whether an SSI is implemented is not RO knowledge.
65 F
3 S
formatting see attached Make a question a fill in the blank question 66 F
3 E
formatting see attached
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#I LOKLOD
(C/A) (1-5) Stem Cue TIF Cred Partial Job-Minuti
- 1 Back-Q=
SRO U/E/S Explanation Focu s
Link a
units ward KJA Only s
Dist.
No correct answer, after 2.5 hours5.787037e-5 days <br />0.00139 hours <br />8.267196e-6 weeks <br />1.9025e-6 months <br /> you are on the curve.
67 H
X U
Need additional clarification for correct answer, all validators choose C. Change answer choices to 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />, 2 hours2.314815e-5 days <br />5.555556e-4 hours <br />3.306878e-6 weeks <br />7.61e-7 months <br />, 3 hours3.472222e-5 days <br />8.333333e-4 hours <br />4.960317e-6 weeks <br />1.1415e-6 months <br /> and 4 hours4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br />.
Cannot interpolate between 45 and 60 relative to half hour increments, thus the time frames must be larger to encompass range of operator error.
Which One of the listed times below is the formatting see attached 68 H
3 S
formatting see attached 69 F
5 X
X
?
U formatting see attached, pulled a specific step out NPG SPP, and played with word out of another specific step in the same procedure. May argue SRO Only question depending on additional validation scores. Not discriminatory, would we really deny an RO license on this question. Is the duty of a test director RO knowledge as fa as line verification activities.
RO not required to memorize surveillance frequency, 70 F
5 x
x u
when surveillance is conducted data is recorded every 15 minutes for operational conservatism. Correct answer C and D.
The question, as written, tests specific knowledge which is not related in any way to a generic knowledge of surveillances. ES-401, page 6 of 33, Section 2.a, last sentence of first paragraph.
formatting see attached
First part of Stem is incorrect, Change to 71 F
5 X
U Unit 3 has entered the EOls and immediate entry into a High Radiation Area is required by an AUO, NO RWP currently exists for the entry. Delete without meeting the prior approval requirements of a RWP formatting see attached 72 H
4 E
This is a three part question, the second part has two choices eliminate second part of second part. formatting see attached F
2 S
formatting see attached Change to H
4 E
The current status of the Offgas System Isolation Valve, 2-FCV-66-28 with the above listed alarms is SUBSEQUENTLY the following alarm is received OG HI HI HI, which of the following identifies the required actions?
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#I L0KL0D (CIA) (1-5) Stem Cue TIE Cred Partial Job-Minuti
- 1 Back-Q SRO UIEIS Explanation Focu s
Link a
units ward K/A Only s
Dist.
The alarm has to be valid for the scram need to add valide alarms formatting see attached H
2 S
formatting see attached SRO ONLY Response to SRO in SRO Responses file 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#I LOKLOD
(C/A) (1-5) Stem Cue TIF Cred Partial Job-Minuti
- 1 Back-Q SRO UIEIS Explanation Focu s
Link a
units ward KIA Only s
Dist.
96 97 98 99 100
ES-401 Written Examination Form ES-401-9 Review Worksheet Brow rry2Oll-3Ol ThA4-5-4DL Wt4.- QQ L9&J 1h1 ICPA141.e 6 0 4k I,UZC-de,e2re4 1t 1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#I LOK LOD I
(C/A) (1-5) Stem Cue TIF Cred Partial Job-Minuti
- 1 Back-Q SRO UIEIS Explanation Focu s
Link a
units ward K/A Only s
Dist.
nstructions Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
1.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2.
Enter the level of difficulty (LCD) of each question using a 1
- 5 (easy
- difficult) rating scale (questions in the 2
- 4 range are acceptable).
3.
Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated true/false statements.
One or more distractors is not credible.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
4.
Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from nemory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
5.
Check guestions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
3.
Based on the reviewers judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
7.
At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
RO/SRO Combined Question
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/LOKLOD
(C/A) (1-5) Stem Cue T/F Cred Partial Job-Minuti
- 1 Back-Q SRO U/F/S Explanation Focu s
Link a
units ward K/A Only s
Dist.
7_
74 75:zzz::___
76 H
Y Y
S 295004AA2.02 M
X Y
Y E
295006G2.4.41 change from scram failure to Section 1.0 Reactor, would like to discuss use of reference 78 H
5 X
Y Y
U 295038EA2.03, requiring them to know all of appendix H PAR flowchart from memory, See attached proposed question H
X Y
Y U
295021 G2.4.30 Two correct answers, remove the word written from the second part of answers. Minor format for how alarms are listed on exams, See attached 80 H
Y Y
E 29503002.4.6, Format, Emergency Depressurization is Emergency RPV Depressurization 81 M
Y Y
S 600000G2.4.41, 82 H
5 X
X Y
Y U
700000AA2.05 Correct Answer is B NOT A, Do not qualify individual 161 or 500 KV lines either 161 or 500 is NOT Qualified or Qualified. With RED on a 161 KV line that would make the 161 KV system Not qualified. Need additional information on 161KV system.
4KV common board is needless information, makes confusing See attached 83 H
X Y
Y E
295009AA2.01, Stem Focus and Format, high pressure feed water, two validators asked status of RCIC and HPCI Since well above TAF, if they believe HPCI or RCIC may be available can argue A is also correct.
Procedure Titles and Units 84 H
5 X
X Y
Y U
2950 1402.2.38, MFLPD = 0, MFLPD not used on Units 2 and 3, Job Link Not SRO, Reactor Engineering function at BFN. Need to remove operator mistake from question stem. See attached
1 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/LOKLOD
(C/A) (1-5) Stem Cue T/F Cred Partial Job-Minuti
- 1 Back-Q SRO U/E/S Explanation Focu s
Link a
units ward K/A Only s
Dist.
85 H
Y Y
E 295032EA2.02, Procedure Titles and Units
in plausibility discussion an error exists 86 H
X Y
Y E
211 000A2.08, add to exit RCQ leg, question format Procedure Titles and Units 87 H
Y Y
E 259002A2.06, typo and format, Capitalize indirectly initiated reactor scram. see attached 88 H
Y Y
E 206000G2.1.7,formatseeattached 89 H
Y Y
E 264000A2.03, format see attached Y
Y E
400000G2.4.11, DW Pressure normally about 1.2 to 1.5 90 H
X psig, Need to have temp slowly rising to lend plausibility to second half of question.
91 H
y y
E 212000A2.05, Procedure Titles and Units, see attached 92 H
X X
Y Y
U 202001 G2.2.44, values for seal failure are incorrect, if #1 seal fails pressure is reactor pressure on seal 1 and 2 H
X X
Y Y
U 214000A2.01, Insert the control rod first, validators said with control rod at 48 cannot disarm while withdrawn Answer A or D correct M
Y Y
S G2.1.5 M
5 X
Y Y
Li G2.1.41, Validators are missing the intent of the Refuel Bridge, most are using top of page as North. Label north on drawing or draw in entire Refuel floor for Unit 1. Need to write out Unit 1. New operators never refueled before.
Knowing correct component for orientation identifies competent operator. See attached 96 M
Y Y
E G2.2.17, format see attached M
s G2.2.25 98 M
5 X
X Y
Y U
G2.3.15, LOD -5, Minutia, Memorize TRM 3.3.5 Table Distractor A ends with declaration. Distractor C ends with classification, see attached proposed question
1.
2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other 6.
7.
Q#/LOKLOD
I (C/A) (1-5) Stem Cue T/F Cred Partial Job-Minuti
- 1 Back-Q SRO UIEIS Explanation Focu s
Link a
units ward K/A Only s
Dist.
M Y
Y E
G2.4.5, Format, confusing or misleading without correct procedure titles, see attached 100 M
(
Y E
G2.4.38, typo or misspelling, write out distractor D like B second half of question overlaps with Admin JPM
ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Facility: &n Date of Exam: g/
1 Jj 1
Exam Level: RO LY SRQ Initials Item Description a
c 1.
Clean answer sheets copied before grading 2.
Answer key changes and question deletions justified A..1 1
4 and documented 7
3.
Applicants scores checked for addition errors (reviewers_spot_check>_25%_of_examinations) 4.
Grading for all borderline cases (80 +/-2% overall and 70 or 80, as_applicable,_+/-4%_on_the_SRO-only)_reviewed_in_detail 5.
All other failing examinations checked to ensure that grades are_justified 6.
Performance on missed questions checked for training
/
deficiencies and wording problems; evaluate validity f\\
uI of questions missed by half or more of the_applicants Printed Name/Signature Date
- a. Grader L1
- b. Facility Reviewer(*)
- c. NRC Chief Examiner (*)
SPJo c_t.,642..OJ 1-/ - (I
- d. NRC Supervisor (*)
JCoUJT.\\1JU)4AAMAJ i/
(*)
The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.
ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Facility:
Fe4rrL4 Date of Exam:
1 Exam Level: RO El SRO Initials Item Description a
b c
1.
Clean answer sheets copied before grading MZi.
A.(4
Ø(
2.
Answer key changes and question deletions justified and documented 3.
Applicants scores checked for addition errors (reviewers spot check> 25% of examinations) i )A 4.
Grading for all borderline cases (80 +/-2% overall and 70 or 80, as applicable, +/-4% on the SRO-only) reviewed in detail
5.
All other failing examinations checked to ensure that grades are justified
\\
6.
Performance on missed questions checked for training J
deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants MJ Printed Name/Signature Date
- a. Grader O3t.
- b. Facility Revlewer(*)
p 4
/4
- c. NRC Chief Examiner(*) /I
- d. NRC Supervisor (*)
(*)
The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.