ML111010548
| ML111010548 | |
| Person / Time | |
|---|---|
| Site: | Browns Ferry  |
| Issue date: | 04/04/2011 |
| From: | NRC/RGN-II/DRS/OLB |
| To: | Tennessee Valley Authority |
| References | |
| 50-259/11-301, 50-260/11-301, 50-296/11-301 | |
| Download: ML111010548 (52) | |
Text
ES-201 Examination Preparation Checklist Form ES-201-1 Facility: Browns Ferry Nuclear Plant Date of Examination: 0210712011 Developed by: Written - Facility NRC II Operating - Facility NRC Target Chief Date* Task Description (Reference) Examiners Initials
-180 1. Examination administration date confirmed (Cia; C.2.a and b) rfa
-120 2. NRC examiners and facility contact assigned (C.1 .d; C.2.e) rfa
-120 3. Facility contact briefed on security and other requirements (C.2.c) rfa
-120 4. Corporate notification letter sent (C.2.d) rfa
[-90] [5. Reference material due (C.1 .e; C.3.c; Attachment 3)] rfa
{-75} 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, rfa ES-301-1, ES-301-2, ES-301-5, ES-D-ls, ES-401-1/2, ES-401-3, and ES-401-4, as applicable (C.1.e and f; C.3.d)
{-70} {7. Examination outline(s) reviewed by NRC and feedback provided to facility rfa licensee (C.2.h; C.3.e)}
{-45} 8. Proposed examinations (including written, walk-through JPMs, and rfa scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6, and any Form ES-201-3 updates), and reference materials due (C.1.e, f, g and h; C.3.d)
-30 9. Preliminary license applications (NRC Form 398s) due (C.1.l; C.2.g; rfa ES-202)
-14 10. Final license applications due and Form ES-201-4 prepared (C.1.l; C.2.i; rfa ES-202)
-14 11. Examination approved by NRC supervisor for facility licensee review rfa (C.2.h; C.3.f)
-14 12. Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g) rfa
-7 13. Written examinations and operating tests approved by NRC supervisor rfa (C.2.i; C.3.h)
-7 14. Final applications reviewed; I or 2 (if >10) applications audited to confirm rfa qualifications I eligibility; and examination approval and waiver letters sent (C.2.i; Attachment 5; ES-202, C.2.e; ES-204)
-7 15. Proctoring/written exam administration guidelines reviewed rfa with facility licensee (C.3.k)
-7 16. Approved scenarios, job performance measures, and questions rfa distributed to NRC examiners (C.3.i)
ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility. p Date of Examination:
13c - , F / -, 7 LO Initials Item Task Description a b c#
- 1. a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401.
W R b. Assess whether the outline was systematically and randomly prepared in accordance with I Section D.1 of ES-401 and whether all K/A categories are appropriately sampled. P
- c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.
- d. Assess whether the justifications for deselected or rejected K/A statements are appropriate.
- 2. a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, S and major transients.
M b. Assess whether there are enough scenario sets (and spares) to test the projected number u and mix of applicants in accordance with the expected crew composition and rotation schedule L without compromising exam integrity, and ensure that each applicant can be tested using A at least one new or significantly modified scenario, that no scenarios are duplicated T from the applicants audit test(s), and that scenarios will not be repeated on subsequent days.
0 c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative R and quantitative criteria specified on Form ES-301-4 and described in Appendix D.
-e
- 3. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:
(1) the outline(s) contain(s) the required number of control room and in-plant tasks W distributed among the safety functions as specified on the form I (2) task repetition from the last two NRC examinations is within the limits specified on the form T (3) no tasks are duplicated from the applicants audit test(s) 7 p
(4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form.
- b. Verifythatthe administrative outline meets the criteria specified on Form ES-301-1:
(1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified Y- Zf -
(3) no more than one task is repeated from the last two NRC licensing examinations
- c. Determine if there are enough different outlines to test the projected number and mix ,.,
of applicants and ensure that no items are duplicated on subsequent days.
-j
in the appropriate exam sections. 01- Zf
- b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate. ,
N c. Ensure that K/A importance ratings (except for plant-specific priorities) are at least 2.5.
f
- d. Check for duplication and overlap among exam sections. Dt-A e. Check the entire exam for balance of coverage. t 0
L
- f. Assess whether the exam fits the appropriate job level (RO or SRO). OZ ,Z2 Printed Name/cignature Date
- a. Author Qrai.k. i,-s1I) -
- b. Facility Reviewer (*) iiLJ i1 / XZ4
- c. NRC Chief Examiner (#) / L9-1/ I 11/ 5 /6
- d. NRC Supervisor ,LCL.4L1 W1DiJLAI Note: # Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
Not applicable for NRC-prepared examination outlines
£ 2 1
t/l ES-201, Page 26 of 28
ILT 11-02 ES-201 Examination Security Agreement Form ES-201-3
- 1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduied for the week(s) of 217-2112011 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthernxjre, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to faculty management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
- 2. Post-Examination To the best of my knowledge. I did not divulge to any unauthonzed persons any information concerning the NRC licensing e:vaminanons administered dunng the week(sj of 217-2112011 From the date that I entered into this security agreement until the cornpleton of examinaoon administration I did not instiuct evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, exceot as specifically noted below and authorized by the NRC PRINTED NAME JOB TITLE I RESPONSIBILITY
_1 SIGN 1 ) DATE 7 SIX3NATU 5-(2) DATE NOTE 1p4S L lCd Uhi/
r- ç%,-o
- 2. Cit-K-c fver, -t;+
- ,7 iA4i.4-k L Eocp 9/iilJ 7f741Zt zØi
- 4. MaiL Moekc- L.t..:t S.-perii:tr 2/3/5 g,t%sc4 2-Z4-i 5C-rackYn4ns- RD OJ(4IAJ J dlJu*/)n (iI U
t Li 3-j-l\
6p,ujAJeZnt.v. 1W jto 4{l4. 4//6/b 4k/t ai&4-s36r 1 7Pe. 9/ - i/iS/i,
&4sAkqS. 6f A 7/n/to 9- ..t Li.? nsa
- 10. /L-141C1( J4ttl&
5 Ro SA (2?> /nf,o flLw e
-fYi OccA có,t4_tn 3/z,ko 1#1\ 3 iiX rnoK,\S - Ru flzz4o zJ4/ b
- 12. U\&,Jci1 ] A/fl/il 13, 51 c 2ss - go ,
14JcLtL#f 4. ct /O/e72n.a 1 F/kvflt r c-
- r c -o///s.,. 77 - Jc 02/2 v/Li NOTES: (
ES-201, Page 27 of 28
I ILT 11-02 ES201 Examination Security Agreement Form ES-201-3
- 1.
Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 217-2112011 as of the date of my signature. I agree that I will not kningIy divulge any information about these examinations to any persons who have not been authorized by the these licensing examinations from this date until completion of examination administration, except as specifically noted NRC chief examiner, understand that I am not to instruct, evaluate. or f rovide perfOrmance feedback to those applicants scheduled to be administered below and authori:ed by the NRC (e.g., acting as a simulator booth operatoror communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security maj have been compromised.
- 2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any infomiation cor:ceming the NRC licensing examinations administered during the week(s) of 217 2112011 From the date that I entered into this security agreement unal the completion of examination adnunistration I did not nsrnict evaluate or provide performance feedback to those applicants who were administered these licensing examinations except as suecificallj noted below and authorized by the NRC.
PRINTED NAME JOB TITLE! RESPONSIBILITY IGNATURE (1) DATE SIGNATU E (2) DATE NOTE
/ WIj, 0
t nn (VkLa.e UNrr SltScfL / 5--
2 fl2,.1 tltO,n/ Caa,.. 0 n9 rt_ tflY6Vtt fl.cq a//n g jc5lfl I 3 nei 1
feh jE;;;;;qc ,-0 wee//7 1
a
-3 W%SI, Cs 4afl 0-Ct -_______________
MtV v-;-Z&22/ ,1 5 .d4tfl &7/ Z,s(
Q t
z 1 n - -
t 4 f-lef4r,aict U4-4 Sn iok In ZTh4L_-----__J2jha ((
7 - kASl, rzc-6,i LiAl ØtOr.jY). C-- -
11 L NS9 3t%W 4fiSr
.irtlTca c4.Cv.g?a1JcCZzgJ(
3YJçi/,-
7
_.Ji 1
)-L, iYi3Z uj ZZAt9ei, sa- n.ici r a1j 12 M t.jaq- 44 1&4*tcflL 5
13 - -i-i 4L,5nLtL ,?croq1Af?w I ,-jp 2- ?L- //
144 &/l..4,.t Pr4t OPC,4 /7-if rf .. z-lt-/1 4<E_
15rV,ij./4 /AaS /-/(-fl 47 Z-7Z-//
iO:. 6-ES-201, Page 27 of 28
ILT 11-02 ES-201 Examination Security Agreement Form ES-201-3
- 1. Pre-Examination I acknowledge that have acquired specialized knowledge about the NRC licensing examinations scheduled for the weeks) of 217-2112011 as of the date of my signature. I agree that I Will not knowingly divulge arpj information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide perfbrrnance feedback to those applicants scheduled to be administered these licensing examinations from this date unto completion of eaniination administration, except as specifically noted below and authorized by the NRC (e g acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or oroide direct or indirect feedback). Furthermore. I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the Conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I wlll immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
- 2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any infornation concerning The NRC licensing examinations administered during the week(s) of 217 21/201-i From the date that I entered into this security agreement until the completion of examination administration I did not instruct evaluate or proside oerformance feedback to those applicants who were admirustei-ed these licensing examinations ecevt as sec flcaIIy noted 1
below and authorized byrne NRC, PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNAT RE (1) DATE SIGNATURE (2) DATE NOTE
-- i 4-ris-2 44_ - 1*
).c-1 1T i-i ijy -i-i A 7, /ód - - __________*2 /4- 22Zfi
- 4. 3kZ.- c__
- 5) çii (AJ £/c//
L.
1 ii-:: -
6 ftJiL M S,J, ?I )vç (L.t-j Vk IC) - ,-kiYY /;1...41 2-2zkL 7,; :4-a 1/7 >* - i? //t-C/ ) 1, -/,
8 i, c& ?CIu 1 ç c .-
c
- 9. /7v-e( Cot? 6j4r fr%:g,
/Z/,k2_ 9-5ifJ 5E --
1O,/c c- A4 15 1
cz c9 *s i,I-s-I iiL S. Li- - sw.
12 (rdi A Sry SU. f(
1 3D9ç P *ZTrc Si m Lc u. 8-119118 (FJ/----- f\Z 2:ii
- 14. cii+I U,r 7-2 -Li 2 /
7r) E7Th v
)1YJiAI ZA1 - I/ /, -
ES-201, Page 27 of 28 U
HLT 1102 Administrative Topics Outline Form ES-301-1 FINAL MODIFIED Facility: Browns Ferry NPP Date of Examination: 2/7/20 1 1 Examination Level: RO/SRO Operating Test Number: 1 102 Administrative Topic Type Describe activity to be performed (see Note) Code
- Conduct of Operations N RO Al a 2.1.7 2-SR-2 Drywell Floor and Equipment Drain Log Calculation 2.1.7 2-SR-2 Drywell Floor and Equipment Drain Log Calculation SRO Ala with Technical Specification Conduct of Operations P 2.1.36 Completion of SRM Operability surveillance RO/SRO Alb Equipment Control N 2.2.41 Determination of Isolation Boundary for RFPT Seal Injection ROA2 Pump2Bor3B 2.2.3 7 Maintenance Rule Availability determination for EECW and RHRSW SRO A2 Radiation Control D 2.3.4 Radiation Exposure Limits under Emergency Conditions RO/SRO A3 Emergency Plan N 2.4.41 E-plan notification GE SRO A4 NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.
(N)ew or (M)odified from bank (> 1)
(P)revious 2 exams (< 1; randomly selected)
(S)imulator
ES-301 Control Roomlln-Plant Systems Outline Form ES-301-2 FINAL Facility: Browns Ferry NPP Date of Examination: 2/7/2011 Exam Level: RO/SROI/SROU Operating Test No.: 1102 Control Room Systems@ (8 for RO); (7 for SRO-l); (2 or 3 for SRO-U, including I ESF)
Safety System I JPM Title Type Code*
Function
- a. CRD Pump Trip < 900 psig Reactor Pressure A, L, N, S 1
- b. RFPT Trip Recovery L, N, S 2
- c. Alternate RPV Pressure Control Drains D, L, S 3
- d. Restore RX and RF Zone Ventilation Following Isolation D, EN, S 5
- f. Loss of Shutdown Cooling M, L, S 4
- g. CAD to Drywell Control Air A, M, S 8
- h. Bypassing Radiation Monitors on Work Station Touch Screen N, S 9(RO only)
In-Plant Systems@ (3 for RO); (3 for SRO-l); (3 or 2 for SRO-U)
- j. Stuck Open SRV A, E, N, R 3
- k. SSI Operator Manual Actions A, N, E 8
@ All RO and SRO-l control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.
Type Codes Criteria for RO I SRO-l / SRO-U (A)ltemate path 4-6 (5)1(5)1(3)
(C)ontrol room (D)irect from bank 9 (4)1(3)1(1)
(E)mergency or abnormal in-plant 1 (3)1(3)1(2)
(EN)gineered safety feature - I (control room system) (1)1(1)1(1)
(L)ow-Power / Shutdown > 1 (4)1(4)1(2)
(N)ew or (M)odified from bank including 1(A) 2 (8)1(7)14)
(P)revious 2 exams < 3 (0) (randomly selected)
(R)CA 1 (1)1(1)1(1)
(S)imulator (8)1(7)1(3)
SROU in Bold
ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: Browns Ferry Date of Examination: February 2011 Operating Test Number: ILT 1102 FINAL
- 1. General Criteria
- a. The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).
- b. There is no day-to-day repetition between this and other operating tests to be administered during this examination.
- c. The operating test shall not duplicate items from the applicants audit test(s). (see Section D.1.a.)
- d. Overlap with the written examination and between different parts of the operating test is within acceptable limits.
- e. It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license level.
- 2. Walk-Through Criteria
- a. Each JPM includes the following, as applicable:
. initial conditions
. initiating cues
. references and tools, including associated procedures
. reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee
. operationally important specific performance criteria that include:
- detailed expected actions with exact criteria and nomenclature
- system response and other examiner cues
- statements describing important observations to be made by the applicant
- criteria for successful completion of the task
- identification of critical steps and their associated performance standards
- restrictions on the sequence of steps, if applicable
- b. Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301 -1 and 2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.
- 3. Simulator Criteria The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-301-4 and a copy is attached.
Printed Name / Signature Date
- a. Author . ZELf ILDJ;: / ,i- z,,,
- b. Facility Reviewer(*) ii. £r -: e 4
- c. NRC Chief Examiner (#) ti
- d. NRC Supervisor AJAC4LL 7 NOTE: The facility signature is not applicable for NRC-deve tests.
- Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Facility: Browns Ferry Date of Exam: February 2011 Scenario Numbers: NB/C/D/F Operating Test No.: ILT 1102 FINAL Initials QUALITATIVE ATTRIBUTES a b* c#
- 1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events.
li2L.
- 2. The scenarios consist mostly of related events. 4YZ-
- 3. Each event description consists of
. the point in the scenario when it is to be initiated
. the malfunction(s) that are entered to initiate the event
. the symptoms/cues that will be visible to the crew
. the expected operator actions (by shift position)
. the event termination point (if applicable) j:-c
- 4. No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event. p-i-
- 5. The events are valid with regard to physics and thermodynamics.
- 6. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives. $
- 7. If time compression techniques are used, the scenario summary clearly so indicates.
Operators have sufficient time to carry out expected activities without undue time constraints. Cues are given. Ot.
- 8. The simulator modeling is not altered.
- 9. The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios. oz.
- 10. Every operator will be evaluated using at least one new or significantly modified scenario. All other scenarios have been altered in accordance with Section D.5 of ES-301. i. 7t.?
- 11. All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the form along with the simulator scenarios). cvz
- 12. Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).
- 13. The level of difficulty is appropriate to support licensing decisions for each crew position. pt. g 1 b Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes -- --
- 1. Total malfunctions (58) 7/8/7/7/6
- 2. Malfunctions after EOP entry (12) 3/3/3/2/2
- 3. Abnormal events (24) 4/4/3/4/4
- 4. Major transients (12) 1/1/1/1/1
- 5. EOPs entered/requiring substantive actions (12) 3/3/3/4/2
- 6. EOP contingencies requiring substantive actions (02) 1/1/2/2/1 ,
- 7. Critical tasks (23) 2/25/3 .1_
r Form ES-301-5 1-INAL IFacility: Browns Ferry NPP Date of Exam: February 7- 18, 2011 Operating Test No.: ILT 1102 II A E SCENARIOS 2(B) 3(C) 4(D) 5(F)
L N CREW CREW CREW CREW CREW T N I T POSITION POSITION POSITION POSITION POSITION A I C S A B S I A B S A B S A B S A L M B
A T R T 0 RIT 0 R T 0 R T 0 R T U 0
N Y o C P OIC P 0 C P 0 C P 0 C P T P I R I U E
RO RX I :
r SROI r I/C 3456 Ib1 3456
- L1t 8 2 SRO U MAJ 7 7 2 r #1 -
v--c-TS 15 345 5 2 0 2 2 2 II SROI
- 1 I/C 3457 6 4
...-5-_
SROUMAJ1 6 22 H
RO R)( 2 2 2 1 SRO-I NOR 1 -J 1 1
r I/C 45 357 3569 9 4 SRO-U--
MAJ 7 6 4}: 7 3 2 F --
TS Page 1 of 4
ES- Form ES-301-5 FINAL IFacility: Browns Ferry NPP Date of Exam: February 7 18, 2011 Operating Test No.: ILT 1102 H
A E SCENARIOS 2(B) 3(C) 4(D) 5(F)
L N CREW CREW CREW CREW CREW T N I T POSITION POSITION POSITION POSITION POSITION A I C S A B S A B S A B S A B A L M S
A T R T 0 R T 0 R T 0 R T U 0 R T 0 N 0 C P 0 C P 0 C P 0 C P 0 C P T P R I U E
RO RX NOR 1 1 2 SRO-I .
F I/C 34,5,6 3,4,5,6 8 - 2
-. I SRO-U MAJ 7 7 2 :
2 p# - --
TS 1,5 - 3,4,5 5 2 RO RX .
.. 2 2 - -. 2- 1 r
- SRO-I
- 2 NOR 1
IE 1
1 i
I/C -. 3.4.5,7 3,6 .
6 4 SRO-UMAJ 6 7 2 2 F -: --
TS . .
2 2 RO I 2
W RX -- 2 ,,
. 1 1 SRO-I NOR I -
1 1
1 F
I/C .. 3,6
, I 4.5,8 -
SRO-UMAJ F
. I - 7 .9. 2 2 I
TS -
rj Page 2 of 4
ES- Form ES-301-5 HNAL IFacility: Browns Ferry NPP Date of Exam: February 7- 18, 2011 Operating Test No.: ILT 1102 A -
SCENARIOS P V T M 2(B) 3(C) 4 (0) 5(F)
P E 0 L N CREW CREW CREW CREW CREW T N T POSITION POSITION POSITION POSITION POSITION A C S A B S A B S A B S A B S L M A B A T R T 0 R T 0 R T 0 R T 0 U R T 0 N Y 0 C p 0 C P 0 C P 0 C P 0 Mfl C P T P R ii:
E RO RX F
NOR ..--.-.
2 1 SRO-I F I/C 3,4,5,6 I, g 3, 4,5,6 8 2 SRO-U MAJ 7 7 2 1 TS 1,5 3,4,5 5 2 RO RX F 2 1 SRO-I NOR I I 1 1 I/C 3,4,5,7 SRO-U MAJ 6 I. 6 4 2 2 F
TS 3,4 2 2 RO RX 1.
2 I NOR 2 SRO-I F I/C 4,5 4,5 3,5,6,9
- f. 8 4 SRO-U MAJ 7 7 7 3 2 F
TS I
Page 3 of 4
ES-C Form ES-301-5 HNAL IFacility: Browns Ferry NPP Date of Exam: February 7 - 18, 2011 Operating Test No.: ILT 1102 A E SCENARIOS P V T M 2B C 3 () 4D 5 ()F P E 0 I L N CREW CREW CREW CREW CREW T N I T POSITION POSITION POSITION POSITION POSITION A I C A B S A B S A B L M S A B S A B A T R T 0 R T 0 R T U 0 R T 0 R T 0 N 0 C P 0 C P 0 C P 0 C P 0 C P T P R I U E
R( 21
.i!.;. :.
NOR .
1 1 1 SRO-I . .
I/C 36 357 458 8 4 SROUMAJ 7 6 7 3 2 r
TS 1r
, .:cf RO ..
5 W .
2 1 1 NOR *. 1 .. 2 1 SRO-I___
i I/C 45 45 3569 8 4 Ou_ -----
TS . . ..
= = = = = = = =
Instructions:
- 1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
- 2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.
- 3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.
Page 4 of 4
ES- Form ES-301-5 FINAL IFacility: Browns Ferry NPP Date of Exam: February 7 - 18, 2011 Operating Test No.: ILT 1102 A E SCENARIOS P V T M 2B 3C() 4D() 5F
()
P E 0 I L N CREW CREW CREW CREW CREW T N I T POSITION POSITION POSITION POSITION POSITION A I C S A B S A B S A B S A L M B S A B A T R T 0 R T 0 R T 0 T U R 0 R T 0 N Y 0 C P 0 C P 0 C P 0 C P 0 C P T P R I U
- 6 RX 2 u1.,
SRO-I i.
F I/C 36 458 4 5
SRO-U MAJ 7 7 2 2 F I RX 2 - I ;.. 1 1 NOR
- 1 SRO-I --. .
F I/C 357 45 5 4 SROU MAJ 6 .... 7 .
2 2 F . . .
TS F Check the applicant levei and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
2 Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.
3 Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the Page lofI
ES-301, Rev. 9 Competencies Checklist Form ES-301-6 FINAL Facility: Browns Ferry Date of Examination: February 2011 Operating Test No.: ILT 1102 APPLICANTS RO SRO-I SRO-U Competencies SCENARIO SCENARIO SCENARIO A B CD F A B CD FA BCD F Interpret/Diagnose Events 3,4,6, 1,3,5, 3,4,5, 3,4,5, ,4,5, ,4,6, 1,3,5, 3,4,5, 3,4,5, 3,4,5, ,4,6, 1,3,5, 3,4,5, 3,4,5, 3,4,5, 3nd Conditions 7 6,7 6 6 6,7 7 6,7 6 6 6,7 7 6,7 6 6 6,7 Comply VVith and 3,4,5, 1,3,4, 1,2,3, 1,2,3, 1,4,5, ,4,5, 1,3,4, 1,2,3, 1,2,3, 1,4,5, ,4,5, 1,3,4, 1,2,3, 1,2,3, 1,4,5, Use Procedures (1) 6,7 5,6 5 5, 6 6,7 5,6 5 5, 6 6,7 5,6 5 5, 6 Operate Control 1,2,3 1,2,3, 1,2,3, 1,2,3 1,2,4, 1,2,3 1,2,3, 1,2,3, 1,2,3 1,2,4, 1,2,3 1,2,3, 1,2,3, 1,2,3 1,2,4, Boards (2) 4,5,6 4,5,6 4,5,6 4,5,6 5,6 4,5,6 4,5,6 4,5,6 4,5,6 5,6 4,5,6 4,5,6 4,5,6 4,5,6 5,6 Communicate 7 7 6 7 7 7 7 6 7 7 7 7 6 7 7 and Interact Demonstrate Supervisory *,6,7, 3,4,5, 4,5,6, 2,3,6, 3,5,7, ,6,7, 3,4,5, 4,5,6, 2,3,6, 3,5,7, biIity (3) 8,9 7,9 7 8 8,9 7,9 7 7 8 Comply With and 4,6 1,5 3,4 3,4 3,4,5 4,6 1,5 3,4 3,4 3,4,5 Use Tech. Specs. (3)
Notes:
- 1) Includes Technical Specification compliance for an RO.
- 2) Optional for an SRO-U.
- 3) Only applicable to SROs.
Instructions:
Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.
ES-401 I Form ES-401-1 Facility: [ Browns Ferry NPP Date of Exam: February 2011 ILT 1102 RD K/A Category Points SRO-Only Points Tier Group K K K K K K A A A A G I Total A2 G* Total 1 2 3 4 5 6 1 2 3 4 *
- 1. 1 343 43 3 20 3 4 7 Emergency 2 1 21 11 1- 7 1 2 3 N/A N/A Abnormal Plant Tier 4 6 4 5 4 4 27 4 6 10 Evolutions Totals 1 :2 323333221 2 26 2 3 5 2 11112111111 12 O1 2 3 Pnt Systems Tier 3 4 5 4 4 3 3 2 3 38 3 5 8 Totals
- 3. Generic Knowledge and 1 21 3 4 1 2 3 4 Abilities Categories 10 7 3 3 2 2 2 2 2 1 Notes: 1. Ensure that at least two topics from every K/A category are sampled within each tier of the RD and SRD-only outlines (i.e., except for one category in Tier 3 of the SRD-only outline, the Tier Totals in each K/A category shall not be less than two).
- 2. The point total for each group and tier in the proposed outline must match that specified in the table. The final point total for each group and tier may deviate by +/-1 from that specified in the table based on NRC revisions. The final RD exam must total 75 points and the SRO-only exam must total 25 points.
- 3. Systems/evolutions within each group are identified on the associated outline; systems or evolutions that do not apply at the facility should be deleted and justified; operationally important, site-specific systems/evolutions that are not included on the outline should be added. Refer to Section D.1 .b of ES-401 for guidance regarding the elimination of inappropriate K/A statements.
- 4. Select topics from as many systems and evolutions as possible; sample every system or evolution in the group before selecting a second topic for any system or evolution.
- 5. Absent a plant-specific priority, only those K/As having an importance rating (IR) of 2.5 or higher shall be selected. Use the RD and SRO ratings for the RD and SRO-only portions, respectively.
- 6. Select SRO topics for Tiers 1 and 2 from the shaded systems and K/A categories.
7* The generic (G) K/As in Tiers 1 and 2 shall be selected from Section 2 of the K/A Catalog, but the topics must be relevant to the applicable evolution or system. Refer to Section D.1 .b of ES-401 for the applicable K/As.
- 8. Dn the following pages, enter the K/A numbers, a brief description of each topic, the topics importance ratings (IR) for the applicable license level, and the point totals (#) for each system and category. Enter the group and tier totals for each category in the table above. Use duplicate pages for RD and SRO-only exams.
- 9. For Tier 3, select topics from Section 2 of the K/A catalog, and enter the K/A numbers, descriptions, IRs, and point totals (#) on Form ES-401-3. Limit SRO selections to K/As that are linked to 10 CFR 55.43.
ES-401, Rev. 9 2 Form ES-401-1 ES-401 BWR Examination Outline Form ES-401-1 Emergency and Abnormal Plant Evolutions Tier 1/Group 1 RO E/APE#/NamelSafetyFunction K K K A A G K/ATopic(s) IR #
12312 295001 Partial or Complete Loss of Forced Core x 1.02 Power/flow distribution 3.3 1 Flow Circulation! 1 & 4 295003 Partial or Complete Loss of AC / 6 x 2.4.6 Knowledge symptom based EOP mitigation 3.7 2 295004 Partial or Total Loss of DC Pwr /6 x 1.03 A.C. electrical distribution 3.4 3 295005 Main Turbine Generator Trip / 3 x 1.01 Pressure effects on reactor power 4.0 4 295006 SCRAM! I x 1.05 Neutron monitoring system 4.2 5 295016 Control Room Abandonment! 7 x 2.1.28 Knowledge of the purpose and function 4.1 6 295018 Partial or Total Loss of CCW / 8 x 2.01 Component temperatures 3.3 7 295019 Partial or Total Loss of Inst. Air! 8 x 3.03 Service air isolations: Plant-Specific 3.2 8 295021 Loss of Shutdown Cooling / 4 x 2.01 Reactor water temperature 3.6 9 295023 Refueling Ace / 8 x 1.03 Fuel handling equipment 3.3 10 295024 High Drywell Pressure / 5 x 3.08 Containment spray: Plant-Specific 3.7 11 295025 High Reactor Pressure! 3 x 1.04 FIPCI: Plant-Specific 3.8 12 295026 Suppression Pool High Water Temp. / 5 x 2.02 Suppression pool spray: Plant-Specific 3.6 13 295027 High Containment Temperature! 5 295028 High Drywell Temperature! 5 x 1.01 Reactor water level measurement 3.5 14 295030 Low Suppression Pool Wtr Lvl /5 x 2.1.31 Ability to locate control room switches, 4.6 15 295031 Reactor Low Water Level / 2 3.01 Automatic depressurization system actuation 3.9 16 295037 SCRAM Condition Present and Power x 2.06 Reactor pressure 4.0 17 Above APRM Downscale or Unknown! I 295038 High Off-site Release Rate / 9 x 2.10 Condenser air removal system 3.2 18 600000 Plant Fire On Site! 8 x 2.13 Need for emergency plant shutdown 3.2 19 700000 Generator Voltage and Electric Grid x 2.07 Turbine! Generator control 3.6 20 Disturbances! 6 K/A Category Totals: 3 4
[ 3 4 3 3 Group Point Total: 20
ES-401, Rev. 9 3 Form ES-401-1 ES-401 BWR Examination Outline Form ES-401-1 Emergency and Abnormal Plant Evolutions Tier 1/Group 2 RO E/APE # / Name / Safety Function K K K A A G K/A Topic(s) IR #
1 2312 295002 Loss of Main Condenser Vac/3 x 1.03 Loss of heat sink 3.6 21 295007 High Reactor Pressure / 3 295008 High Reactor Water Level / 2 295009 Low Reactor Water Level / 2 295010 High Drywell Pressure / 5 295011 High Containment Temp / 5 2950 12 High Drywell Temperature / 5 295013 High Suppression Pool Temp. / 5 295014 Inadvertent Reactivity Addition / 1 x 2.4.50 Ability to verify system alarm setpoints 4.2 22 295015 Incomplete SCRAM / 1 295017 High Off-site Release Rate / 9 295020 Inadvertent Cont. Isolation / 5 & 7 295022 Loss of CRD Pumps / I x 1.01 CRD hydraulic system 3.1 23 295029 High Suppression Pool Wtr Lvl / 5 x 2.02 HPCI: Plant-Specific 3.4 24 295032 High Secondary Containment Area Temperature / 5 295033 High Secondary Containment Area Radiation Levels / 9 295034 Secondary Containment Ventilation x 2.02 Cause of high radiation levels 3.7 25 High Radiation / 9 295035 Secondary Containment High Differential Pressure / 5 295036 Secondary Containment High x 3.01 Emergency depressurization 2.6 26 Sump/Area Water Level / 5 500000 High CTMT Hydrogen Conc. / 5 x 2.09 Drywell nitrogen purge system 3.0 27 K/A Category Point Totals: 1 2 1 1 fi 1 Group Point Total: 7
ES-401, Rev. 9 4 Form ES-401-1 ES-401 BWR Examination Outline Form ES-401-1 Plant Systems Tier 2/Group 1 RO System # / Name K K K K K K A A A A G KIA Topic(s) IR #
1234561234 203000 RHRJLPCI: Injection x 3.04 Adequate core cooling 4.6 28 Mode 205000 Shutdown Cooling x 2.2.22 Knowledge of limiting conditions for 4.0 29 206000 IIPCI x 3.05 Reactor water level: BWR-2,3,4 4.3 30 209001 LPCS x 1.07 DC. electrical power 2.5 31 211000 SLC x 2.07 Valve closures 2.9 32 212000 RIS x 4.03 Provide manual select rod insertion: Plant- 3.9 33 Specific.
215003 IRM x 2.01 IRM channels/detectors 2.5 34 215004 Source Range Monitor x 5.01 Detector operation 2.6 35 5.03 Changing detector position 2.8 36 215005 APRM I LPRM x 3.08 Control rod block status 3.7 37 217000 RCIC x 2.02 RCIC initiation signals (logic) 2.8 38 2.04 Gland seal compressor (vacuum pump) 2.6 39 218000 ADS x 2.1.7 Ability to evaluate plant performance and 4.4 40 223002 PCIS/Nuclear Steam x 4.02 Testability 2.7 41 Supply Shutoff 4.05 Single failures will not impair the function 2.9 42 239002 SRVs x 1.01 Nuclear boiler 3.8 43 259002 Reactor Water Level x 1.01 Reactor water level 3.8 44 Control 261000 SGTS x 4.05 Fission product gas removal 2.6 45 262001 AC Electrical x 3.04 Uninterruptible power supply 3.1 46 Distribution 262002 UPS (AC/DC) x 2.02 Overvoltage 2.5 47 263000 DC Electrical x 6.02 Battery ventilation 2.5 48 Distribution 264000 EDGs x 5.05 Paralleling A.C. power sources 3.4 49 300000 Instrument Air x 6.07 Valves 2.5 50 6.12 Breakers, relays and disconnects 51 2.9 400000 Component Cooling x 1.01 CCW flow rate 2.8 52 Water 1.04 Surge Tank Level 2.8 53 F K/A Category Point Totals: 2 3 2 3 4 ifz Group Point Total: 26
ES-401, Rev. 9 5 Form ES-401-1 ES-401 BWR Examination Outline Form ES-401-1 Plant Systems Tier 2/Group 2 RO System # / Name K K K K K K A A A A G K/A Topic(s) IR #
12345612 34 201001 CRD Hydraulic x 5.05 Indications of pump runout: Plant- 2.7 54 201002 RMCS 201003 Control Rod and Drive x 1.01 Control rod drive hydrauc system 3.2 55 Mechanism 201004 RSCS 201005 RCIS 201006 RWM 202001 Recirculation 202002 Recirculation Flow Control 204000 RWCU 214000 RPIS 215001 Traversing In-core Probe x 4.01 Primary containment isolation: Mark-I 1 3.4 56 215002 RBM 216000 Nuclear Boiler Inst.
219000 RHRILPCI: Torus/Pool Cooling x 2.4.31 Knowledge of annunciators alarms 4.2 57 Mode 223001 Primary CTMT and Aux.
226001 RHRILPCI: CTMT Spray Mode 230000 RHRJLPCI: Torus/Pool Spray x 2.02 Pumps 2.8 58 Mode 233000 Fuel Pool Cooling/Cleanup 234000 Fuel Handling Equipment a 4.02 Control rod drive system 3.4 59 239001 Main and Reheat Steam 239003 MSIV Leakage Control 241000 Reactor/Turbine Pressure Regulator 245000 Main Turbine Gen. / Aux.
256000 Reactor Condensate 259001 Reactor Feedwater x 5.03 Turbine operation: TDRFPs-Only 2.8 60 268000 Radwaste 271000 Offgas x 3.02 Off-site radioactive release rate 3.3 61 272000 Radiation Monitoring 286000 Fire Protection 288000 Plant Ventilation x 3.01 Isolation/initiation signals 3.8 62 290001 Secondary CTMT x 1.01 System lineups 3.1 63 290003 Control Room HVAC x 6.01 Electrical power 2.7 65 290002 Reactor Vessel Internals a 2.01 LOCA 3.7 64
[ K/A Category Point Totals: I I I 1 2 1 1 1 1 1 1 Group Point Total: 12
ES-401, Rev. 9 2 Form ES-401-1 ES-401 BWR Examination Outline Form ES-401-l Emergency and Abnormal Plant Evolutions Tier 1/Group 1 SRO E/APE #1 Name! Safety Function K K K A A G K/A Topic(s) IR #
12312 295001 Partial or Complete Loss of Forced x 2.02 Neutron monitoring 3.2 76 Core Flow Circulation / I & 4 295003 Partial or Complete Loss of AC! 6 295004 Partial or Total Loss of DC Pwr / 6 295005 Main Turbine Generator Trip! 3 x 2.1.32 Ability to explain and apply all system limits 4.0 77 295006 SCRAM! 1 295016 Control Room Abandonment! 7 x 2.1.7 Ability to evaluate plant performance and make 4.7 78 295018 Partial or Total Loss of CCW ! 8 295019 Partial or Total Loss of Inst. Air! 8 295021 Loss of Shutdown Cooling! 4 x 2.4.4 Ability to recognize abnormal indications for 4.7 79 295023 Refueling Acc ! 8 295024 High Drywell Pressure! 5 x 2.08 Drywell radiation levels 4.0 80 295025 High Reactor Pressure! 3 295026 Suppression Pool High Water Temp.!
5 295027 High Containment Temperature / 5 295028 High Drywell Temperature! 5 x 2.02 Reactor pressure 3.9 81 295030 Low Suppression Pool Wtr Lvi ! 5 295031 Reactor Low Water Level! 2 295037 SCRAM Condition Present and Power Above APRM Downscale or Unknown! I 295038 High Off-site Release Rate! 9 x 2.4.9 Knowledge of low power! shutdown implications 4.2 82 600000 Plant Fire On Site! 8 700000 Generator Voltage and Electric Disturbances ! 6 K/A Category Totals: 3 4 Group Point Total: 7
- ES-401, Rev. 9 3 Form ES-401-1 ES-401 BWR Examination Outline Form ES-401-1 Emergency and Abnormal Plant Evolutions Tier 1/Group 2 SRO C E/APE #1 Name / Safety Function K K K A A 12312 G K/A Topic(s) IR #
295002 Loss of Main Condenser Vac / 3 295007 High Reactor Pressure / 3 295008 High Reactor Water Level / 2 295009 Low Reactor Water Level / 2 295010 High Drywell Pressure! 5 295011 High Containment Temp / 5 295012 High Drywell Temperature! 5 295013 High Suppression Pool Temp. /5 295014 Inadvertent Reactivity Addition / 1 295015 Incomplete SCRAM! 1 295017 High Off-site Release Rate! 9 x 2.2.44 Ability to interpret control room indications to. 4.4 83 295020 Inadvertent Cont. Isolation! 5 & 7 295022 Loss of CRD Pumps! 1 295029 High Suppression Pool Wtr Lvl ! 5 x 2.4.47 Ability to diagnose and recognize trends in an ... 4.2 84 295032 High Secondary Containment Area x 2.02 Equipment operability 3.5 85 Temperature ! 5 295033 High Secondary Containment Area Radiation Levels! 9 295034 Secondary Containment Ventilation High Radiation! 9 295035 Secondary Containment High Differential Pressure! 5 295036 Secondary Containment High Sump!Area Water Level! 5 500000 High CTMT Hydrogen Cone.! 5
[ K/A Category Point Totals: 1 2 Group Point Total: f3
ES-401, Rev. 9 4 Form ES-401-1 ES-401 BWR Examination Outline Form ES-401-1 Plant Systems Tier 2/Group I SRO System # / Name K K K K K K A A A A G K/A Topic(s) IR #
1234561234 203000 RHRILPCI: Injection x 2.2.4 (multi-unit) Ability to explain the variations 3.6 86 Mode in Control board layouts, systems 205000 Shutdown Cooling 206000 HPCI 207000 Isolation (Emergency)
Condenser 209001 LPCS 209002 HPCS 211000 SLC 212000 RPS 215003 IRM 215004 Source Range Monitor 215005 APRM / LPRM 217000 RCIC 218000 ADS 223002 PCISfNuclear Steam Supply Shutoff 239002 SRVs 259002 Reactor Water Level Control 261000 SGTS x 2.12 High fuel pool ventilation radiation: Plant- 3.4 88 Specific.
262001 AC Electrical x 2.4.41 Knowledge of the emergency action level 4.6 87 Distribution thresholds and classifications 262002 UPS (AC/DC) 263000 DC Electrical Distribution 264000 EDGs x 2.09 Loss of AC. power 4.1 89 300000 Instrument Air x 2.2.36 Ability to analyze the effect of maintenance ... 4.2 90 400000 Component Cooling Water K/A Category Point Totals:
f [ 2 3 Group Point Total:
fs
ES-401, Rev. 9 5 Form ES-401-1 ES-401 BWR Examination Outline Form ES-401-1 Plant Systems Tier 2/Group 2 SRO System #1 Name K K K K K K A A A A G K/A Topic(s) JR #
12345 61234 201001 CRD Hydraulic 201002 RMCS 201003 Control Rod and Drive Mechanism 201004 RSCS 201005 RCIS 201006 RWM 202001 Recirculation x 2.13 Carryunder 2.8 91 202002 Recirculation Flow Control 204000 RWCU 214000 RPIS 215001 Traversing In-core Probe 215002 RBM 216000 Nuclear Boiler Inst. x 2.4.45 Ability to prioritize and interpret the 4.3 92 significance of each annunciator or alarm.
219000 RHR/LPCI: Torus/Pool Cooling Mode 223001 Primary CTMT and Aux.
226001 RHR/LPCI: CTMT Spray Mode 230000 RHRJLPCI: Torus/Pool Spray Mode 233000 Fuel Pool Cooling/Cleanup 234000 Fuel Handling Equipment 239001 Main and Reheat Steam 239003 MSIV Leakage Control 241000 Reactor/Turbine Pressure Regulator 245000 Main Turbine Gen. / Aux.
256000 Reactor Condensate 259001 Reactor Feedwater 268000 Radwaste 271000 Offgas X 2.2.40 Ability to apply technical 4.7 93 specifications for a system.
272000 Radiation Monitoring 286000 Fire Protection 288000 Plant Ventilation 290001 Secondary CTMT 290003 Control Room HVAC 290002 Reactor Vessel Internals K/A Category Point Totals: 1 2 Group Point Total: 3
ES-401, Rev. 9 Generic Knowledge and Abilities Outline (Tier 3) Form ES-401-3 Facility: Browns Ferry Date of Exam: February 2011 Category K/A # Topic RO SRO-Only JR # JR
- 1. Conduct 2.1.25 Ability to interpret reference materials such as graphs, 0 fO pe r a t io n S monographs and tables which contain performance data.
3.9 66 2.1.27 Knowledge of system purpose and/or function. 3.9 67 2.1.28 Knowledge of the purpose and function of major system 4 1 68 components and controls.
2.1.3 Knowledge of shift or short term relief turnover practices. 3.9 94 2.1.4 Knowledge of individual licensed operator responsibilities related to shift staffing, such as medical requirements... 38 95 Subtotal 3 2
- 2. Equipment 2.2.2 Ability to manipulate the console controls as required to Control operate the facility between shutdown and designated 46. 69 2.2.39 Knowledge of less than one hour technical specification action statements for systems. 3.9 70 2.2.43 Knowledge of the process used to track inoperable alarms. 3.0 71 2.2.23 Ability to track Technical Specification limiting conditions for operations. 46 96 2.2.44 Ability to interpret control room indications to verify the status and operation of a system, and understand how operator 44 97 Subtotal 3 2
- 3. Radiation 2.3.5 Ability to use radiation monitoring systems, such as fixed Control radiation monitors and alarms, portable survey 29 73 2.3.13 Knowledge of radiological safety procedures pertaining to licensed operator duties, such as response to radiation 4 72 2.3.7 Ability to comply with radiation work permit requirements 36 99 during normal or abnormal conditions.
2.3.12 Knowledge of radiological safety principles pertaining to licensed operator duties, such as containment entry 37 98 Subtotal 2 2
- 4. Emergency 2.4.42 Knowledge of emergency response facilities.
Procedures / 2.6 74 Plan 2.4.47 Ability to diagnose and recognize trends in an accurate and 42 75 timely manner utilizing the appropriate control room ...
2.4.22 Knowledge of the bases for prioritizing safety functions during abnormal/emergency operations. 44 100 Subtotal 2 1 Tier 3 Point Total 10 7
ES-401 Record of Rejected K/As Form ES-401-4 Tier / Randomly Group Reason for Rejection Selected K/A Rejected K/A due to overlap and/or double jeopardy with RD 1/1 295031 EK3.02 203000, replaced with EK3.01 Automatic depressurization system actuation Rejected K/A due to no significant relationship between four rod RD 2/1 215005 A3.01 display and APRM/LPRM, replaced with A3.08 Control rod block status.
Rejected due to overlap with 217000 K2.02, replaced with K2.04 RD 2/1 217000 K2.03 Gland seal compressor.
Rejected due to service air refusal valve is not applicable to RD 2/1 300000 K6 04 Browns Ferry, replaced with K6.07 Valves.
Rejected due to no relationship at Browns Ferry between RD 2/2 290003 K6.04 Control HVAC and Fire protection, replaced with K6.01 Electrical power Rejected due to unable to write an SRO Dnly question for RD actions outside Control Room in relation to RWCU. Replaced SRO 2/2 204000 G2.4.34 with 216000 G2.4.45, Nuclear Boiler Instrumentation: Ability to prioritize and interpret the significance of each annunciator or alarm.
Rejected due to no link between Reactor Water Level Control system and emergency action levels. Replaced with 262001 SRO 2/1 259002 G2 4 41 G2.4.41 AC Electrical Distribution: Knowledge of the emergency action level thresholds and classifications.
10/28/2010-12:54:31 PM Page 1
ES-401 Record of Rejected K/As Form ES-401-4 FINAL Tier I Randomly Reason for Rejection Group Selected K/A Rejected K/A due to overlap and/or double jeopardy with RO 1/1 295031 EK3.02 203000, replaced with EK3.01 Automatic depressurization system actuation Rejected K/A due to no significant relationship between four rod RO 2/1 215005 A3.01 display and APRM/LPRM, replaced with A3.08 Control rod block status.
Rejected due to overlap with 217000 K2.02, replaced with K2.04 R0211 217000 K2.03 Gland seal compressor.
Rejected due to service air refusal valve is not applicable to RO 2/1 300000 K6.04 Browns Ferry, replaced with K6.07 Valves.
Rejected due to no relationship at Browns Ferry between RO 2/2 290003 K6.04 Control HVAC and Fire protection, replaced with K6.01 Electrical power Rejected due to unable to write an SRO Only question for RO actions outside Control Room in relation to RWCU. Replaced SRO 2/2 204000 G2.4.34 with 216000 G2.4.45, Nuclear Boiler Instrumentation: Ability to prioritize and interpret the significance of each annunciator or alarm.
Rejected due to no link between Reactor Water Level Control system and emergency action levels. Replaced with 262001 SRO 2/1 259002 G2.4.41 G2.4.41 AC Electrical Distribution: Knowledge of the emergency action level thresholds and classifications.
1/31/2011 -6:39:33AM Page 1
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: Browns Ferry Date of Exam: February 2011 Exam Level: RO SRO I
FINAL MODIFIED Initial a b*
c#
Item Description
- 1. Questions and answers are technically accurate and applicable to the facility.
- 2. a. NRC K/As are referenced for all questions.
o- zL
- b. Facility learning objectives are referenced as available. )Z.
- 4. The sampling process was random and systematic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR CL program office). (
- 5. Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:
the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or the examinations were developed independently; or the licensee certifies that there is no duplication; or (explain) s-c... ,J
- 6. Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest Bank Modified New new or modified); enter the actual RO / SRO-only question distribution(s) at right. 38 7% / 20% / 32°/ 41 3°/ /
16% 52% -r
- 7. Between 50 and 60 percent of the questions on the RO exam are written at the comprehension! analysis level; Memory C/A the SRO exam may exceed 60 percent if the randomly selected K/As support the higher cognitive levels; enter Al 20/ / Q 70/
the actual RO I SRO question distribution(s) at right. - /0! JO.! /0 36% 64% YL
- 8. References/handouts provided do not give away answers oraid in the elimination of distractors. crr
- 9. Question content conforms with specific K/A statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are justified. 2z. fri
- 10. Question psychometric quality and format meet the guidelines in ES Appendix B. ,i.,..J
- 11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet. /iA J J Printed Name I Signature . Date
- a. Author
- b. Facility Reviewer (*) ,Vt I c,4i4
- c. NRC Chief Examiner (#) /4
- d. NRC Regional Supervisor ,tLQ1LOtLLT1JLZ,L4J4J&j Note:
- The facility reviewers initials/signature are not applicable for NRC-developed examinations.
- Independent NRC reviewer initial items in Column c chief examiner concurrence required
ES-401 Written Examination Form ES-401-9 Review Worksheet Browns Ferry 2011-301
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q#/ LOK LOD I (C/A) (1-5) Stem Cue T/F Cred Partial Job- Minuti #1 Back- Q= SRO U/E/S Explanation Focu s . Link a units ward K/A Only 5 Dist.
Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy difficult) rating scale (questions in the 2 4 range are acceptable).
- 3. Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g. unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated true/false statements.
One or more distractors is not credible.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
Based on the reviewer=s judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, o (S)atisfactory?
- 7. At a minimum, explain any AU@ ratings (e.g., how the Appendix B psychometric attributes are not being met).
RO/SRO Combined Question Generic:
Generic I (WOOTF completes the statement below). Should be written like Q 88. (This should be standardized throughout the exam) The stems re riddled with inconsistencies.)
MP = Not Plausible DV = Discriminatory Value DLU = Direct Lookup
fl (fl
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q#/ LOKLOD (CIA) (1-5) Stem Cue TIF Cred Partial Job- Minuti #1 Back- Q SRO UIE/S Explanation Focu s . Link a units ward K/A Only s Dist.
= = = = = = I
= 295001AK1.02 C
3 Y N S Nocomment RFA 12/12/10 2
295003G2.4.6 C 3 Y N S Nocomment RFA 12/12/10 295004AA1.03 C
3 Y N S Nocomment RFA 12/12/10 2950005AK1.01 C
3 X Y N U There are no low reactor pressure trips. Therefore, B is NP. If the bypass valves failed open, reactor pressure would lower to < 850 psig which will result in MSIV closure. With the MSIVs closing and the Mode Switch in E Run, the Reactor will scram. Therefore, this distractor is plausible. Since no limits are placed on reactor pressure, the reactor failure to trip (as in C), is NP. Plausible in that i candidate considers only Main Turbine Trip actuation of RPS, this would be the correct answer since it is bypassed at this power level. This distractor was selected in validation.
This 0 is U since 2 NP distractors.
RFA 12/13/10 If unacceptable need new K&A, requested prior to submittal but was denied.
Re-evaluated and determined to be an E question.
Bulleted stem and made a two sentence question.
RFA 1I25/11 Approved Post validation comments: removed the word direct, seemed to be confusing to the validators and added the word automatic.
RFA 2/14111 Approved 295006AA1.05 M
2 X Y N E Stem: consider the following format:
Given the following:
s - Unit 2 is in Mode 2
- IRMs indicate 29.1 on range 3
- Reactor period is 90 seconds WOOTF ?
RFA 12/13/10 Bulleted the stem RFA 1125111 Approved
n 0
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q#/LOKLOD (CIA) (1-5) Stem Cue TIF Cred Partial Job- Minuti #I Back- Q SRO UIEIS Explanation Focu s . Link a units ward K/A Only S Dist.
6 295016G2.1.28 M 2 Y N S Nocomment RFA 12/13/10
,zuiotA2.O1 C 3 X V N U Without a flow parameter, D is NP f RWCU trip occurs due to isolation valve closing and the n valve closes due to high temperature, then one d argue a trip directly due to a high temp signal is also Icorrect.
This Q is U because of 2 potentially correct answers AND one NP distractor.
RFA 12/13/10 Low flow condition will exist when isolation valves close, some systems do not directly trip off the isolation but the results of the iso!ation. Valves close no flow, low flow trip.
Worked on wording of distractors, validators choice A and edrafted question to make a plausible two part uestion FA 1125111 Approved 51 09AK3.03 8
M 2 Y N S No comment RFA 12/13/10
- 5021AK2.01 C 3 X Y N Generic 1 Do you need to say lAW 3-AOl-74-1? It does not appear
- 40 °F plausible in C and D? There are no delta Ts
-M anywhere that I could find?
A D and D are potentially NP. This Q is U until resolved.
FA 12/13/10 ixed generic 1. Same note that is used for correct answe entifies a delta T of 50 degrees ined part B of all 4 distractors and used common ts of 50 and 75.
- .FA 1125111 Approved 295023AA1 .03 E Lower case the word AND in C to deemphasize and make the correct answer less obvious. In fact, the second part could be eliminated.
S This is an immediate action memory question not comprehensive. Change to M RFA 12/13/10 Changed to M and fixed the right answer as requested RFA 1125111 Approved
C /m
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q#/ L0KL0D I (C/A) (1-5) Stem Cue T/F Cred Partial Job- Minuti #1 Back- Q SRO U/E/S Explanation Focu s . Link a units ward K/A Only s Dist.
295024EK3.03 M 3 Y N S No comment RFA 12/13/10 12 295025EA1.04 C 3 Y N S No comment RFA 12/13/10 295026EK2.02 13 C 3 X X Y N E NONEisnotagooddistractorespeciallysincethe applicants know that this Q was written from an outline where NONE would not address the KA. I dont think this S is true and I seriously doubt that a candidate would ever conclude not correct answer based on this. Consider changing it to a combination of RHR pumps.
Stem 5 bullet: Does the word mode need to follow drywell spray? It does not sound right the way it is written.
RFA 12/13/10 From 1006 exam 4 people missed and 2 chose A (none) also chosen on validation. Added word mode. Dkz 12/23 Added RHR Pump 2B and Removed NONE RFA 1125111 Approved 295028EK1.01 14 C 3 X Y N I do NOT see the plausibility of distractor A (200 degrees).
I Facility explain better or replace.
s RFA 12/13/10 Per caution 1 at a temperature of 200 degrees the mm indicated level would be 20 inches a valid number in caution 1. Dkz 12/23 Retracted Comment, determined 200 degrees plausible.
RFA 1/25/11 Approved 295030G2.1.31 15 C 3 Y N S No comment RFA 12/13/10 295031K3.01 16 C 3 X Y N E Stem: Generic 1 Rewrite as follows: ADS will automatically initiate...
S RFA 12/13/10 Fixed as requested RFA 1l25I1 I Approved 295037EA2.06 17 C 3 Y N S No comment RFA 12/13/10 18 295038EK2.10 C 3 X Y N E Stem: Make alarm/indication = alarms/indications.
fl n
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q#/L0KL0D (C/A) (1-5) Stem Cue TIE Cred Partial Job- Minuti #1 Back- Q SRO UIEIS Explanation Focu s . Link a units ward K/A Only s Dist.
=
= REA 12/13/10 S Fixed as requested RFA 1125111 Approved 19 t500000AA2.13 M 2 X Y N E I am not convinced that distractor A (no reactor scram is required) is plausible. Consider replacing it with Unit I and Unit 3 only.
RFA 12/13/10 S A was chosen during validation, but can change as requested.
Some validators chose no scram required.
RFA 1I25/11 Approved 20 700000AK2.07 C 3 Y N S No comment RFA 12/13/10 530 kV system typo from post validation comments, changed to 500 kV RFA 2/14/11 Approved 21 295002AK1.03 C 3 Y N S No comment RFA 12/13/10 295014G2.4.50 22 C 3 X X Y N E Distractor D is NP since the reactor is critical and the period will not change until the POAH is obtained.
S Stem: Change the SRM period to 10 seconds to make distractor B more plausible.
Since B is NOT totally implausible, and E has been assigned.
RFA 12/13/10 Reworked distractor D which is now A and changed period to 10 seconds.
B was selected by multiple candidates. With LOD of 3, do we really need to change the SRM Period and move further away from validation. Stopping CR withdrawal was used for Short Reactor Period questions on Dresden 2007 #13 / Peach Bottom 07 #36 resulting in a SAT NRC Exam question.
Reworked distractor D which is now A and changed period to 10 seconds.
RFA 1125111 Approved 295022AA1.O1 23 C 2 X Y N Its common knowledge that with two CR out of position to scram the reactor. This Q has no discriminatory value.
Suggest reducing the stem to one CR out of position.
E This Q is U because the Q has no DV.
C
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q#/ LOKLOD (CIA) (1-5) Stem Cue TIE Cred Partial Job- Minuti #1 Back- Q SRO UIEIS Explanation Focu s . Link a units ward K/A Only s Dist.
RFA12113/10 S Do not agree no DV, one rod is only one notch and would not be considered mis positioned, agree that common knowledge for drifting control rods. Requires a applicant to determine if one or two notches is drifting. Validators rated at greater than two due to this fact. Dkz 12/23 Similar approach on Duane Arnold 07 #25 I Quad Cities 09 #90 I Susquehanna 07 #43 were determined to have DV Added a new distractor C and added 38-31 is selected in stem. Deleted immediately from A. Question was change to E, because only one distractor was determined to be non plausible.
RFA 1125111 Approved 24 295029EK2.02 C 3 X X Y N E Stem: Make Suppression Pool level 5 inches and add CS level 550 inches in order to increase DV.
RFA 12113/10 Added CST Level, level is in feet.
RFA 1125I11 Approved 25 295034EA2.02 C 3 Y N S No comment RFA 12/13/10 26 295036EK3.01 M 2 X Y N U D is the most intuitively obvious choice. Re-write the Q to have two choices each, each having one right and one wronq answer. D will have both choices correct. The E question as written has no DV.
RFA 12/14/10 S Disagree that it is LCD 1, two of eight validators missed this question, it provides DV. Worked on re write as requested.
Average LOD as rated by operations was 2.7 Contingency drafted at end of question Two validators chose distractor B, question was determined to be valid with minor editorial changes.
RFA 1125111 Approved S00000EK2.09 27 M 2 X Y N I do not believe that D is a valid distractor. However,, I will reconsider after the final validation if this Q has a high miss frequency. Consider replacing distractor D.
RFA 12/14/10 Final validation 2 operators missed one choose D.
4 total misses in validation, multiple distractors were chosen. Question accepted SAT as is.
RFA 1125111 Approved
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q#/ LOK LOD I
(C/A) (1-5) Stem Cue TIE Cred Partial Job- Minuti #1 Back- Q SRO UIEIS Explanation Focu s . Link a units ward K/A Only s Dist.
203000K3.04 28 C 3 Y N S No comment RFA 12/14/10 205000G2.2.22 29 M 2 X Y N U 90 degrees is NP. Change 90 degrees (A and C) to 100 degrees per hour and B and D to 100 degrees in any one
. hour. They are distinctly different.
This Q is U because of two NP distractors.
RFA 12/14/10 Changed as requested Jisagree with changing. Moves us further from validation and the distract rs are plausible. 90 degrees was selected by mu s. This distractor was r allowed .c9oldown rates on question but it is similar enough i have similar level of plausibility. It is been selected on both actual exams and previous lidations. The fact that BFN also has an Admin target o J degrees leads some candidates to believe 90 is the TS number. The distinction of whether this TS SR reads in one hour versus per hour may be minutia.
Contingency drafted at end of question, Accepted Contingency question RFA 1125111 Approved dded the word period after any one hour to choices and D to be consistent with TS.
FA 2/14/11 Approved UA3.05 30 C 3 Y N s No comment RFA 12/14/10 209001K1.07 31 C 3 X Y N Distractor A is NP. Its not feasible to think that with a loss of 250 VDC RMOV BD 2A that everything will work.
Replace A.
RFA 12/14/10
- of the validators chose A, this question was high miss n validation with a LOD of >3.
dditionally, this question is a Modified version of VY 200 S which contained this same distractor.
ontingency drafted ue to high miss frequency on distractor A, comment moved.
FA 1I25I11 Approved 11000A2.07 32 C 3 X Y N E Under the circumstances, distractor D is NP. The first two bullets_indicate_that_that_there_is_a_problem_with_at_least
iTh fl
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q#ILOKLOD I
(CIA) (1-5) Stem Cue TIE Cred Partial Job- Minuti #1 Back- 0= SRO UIE/S Explanation Focu s Link a units ward K/A Only s Dist.
one squib valve.
S Replace distractor D.
RFA 12/14/10 Bank 0801 #33 I To elaborate further on the plausibility, if a TIP squib has detonated, it is indicated by Squib Monitor lights illuminated. These systems having similar squib valves produce opposite indication when the squib valve actuates.
Contingency Drafted Changed distractor B to neither and simplified the language in both the stem and distractors.
RFA 1125111 Approved 212000A4.03 C 3 X Y N E Generic I RFA 12/14/10 s Fixed Generic 1 RFA 1125111 Approved 215003K12.01 M 2 Y N s No comment RFA 12/14/10 215004K5.01 M 2 Y N S No comment 215004K5.03 36 C 3 Y N S No comment RFA 12/15/10 215005A3.08 M 2 X Y N E Under these conditions, distractor C is NP. This one will be immediately eliminated. This is basic knowledge level.
Replace C.
RFA 12/15/10 Question was high miss during validation with 3 operators choosing C.
on validation, C was chosen three times FA 1125111 Approved 7000K2.02 38 M x Y N sk a two part 0 to increase level of difficulty. Sugqest
. of power to relay logic or EGM Control Box (Unit Jerence)
S Aswntten this is a basic go / no go Q with a low level of RFA 12/15/10
. K&A of 2.8, low value K&A, but the question is not LOD 1 for an initial applicant, logic power and EGM power is different three RCIC s stems and HPCI s stems
n
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q#I LOK LOD (C/A) (1-5) Stem Cue TIF Cred Partial Job- Minuti #1 Back Q= SRO UIEIS Explanation Focu S Link a units ward K/A Only S Dist.
with a rating of 2.4 LOU.
or review K/A is wide spread.
- 4/ Bruns 08 #32 I 52 I Crystal River 07
/Hatch09#18 rly identical I peach bottom 08 #6 I peach bottom 08
.!IRBSO7#3OIRBSO7#49/#61 /RBSO8#31 IVY
,J #3 Contingency Drafted Verify Contingent Question is correct Verified RFA 1125/11 Approved 1 7000K2.04 M 2 x Y N This Q is too similar to Q 37. Increase the level of difficulty by doing the same as on Q 37.
RFA 12/15/10 s NRC develops of 2.6, low value K&A, but the n initial applicant, three RCIC
. successful during validation comment as above Contingency Drafted Due to level of difficulty moved from 1 to
) (Thi v written.
1125111 Approved 218000G2.1.7 40 C 3 X Y N No action is required is not a good distractor especially since the applicants know that this Q was written from an outline where NONE would not address the KA.
S Consider changing it to a combination question.
RFA 12/15/10 n was modified from 1006 exam where no action red was correct answer. One operator chose A durin Ivahdation.
IContingency Drafted e to miss frequency of distractor A, question accepted i minor modification to distractor D.
A 1125111 Approved 223002K4.02 41 M 2 X Y N E Generic 1.
Consider rewriting as follows:
s A trip of BOTH division 1 (A,C) Reactor Water Cleanup Suction Isolation Valves low level This simplifies the Q.
RFA 12/15/10
C
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q#I LOKLOD (C/A) (1-5) Stem Cue TIF Cred Partial Job- Minuti #I Back- Q SRO UIEIS Explanation Focu s . Link a units ward K/A Only s Dist.
Reworked as requested RFA 1125111 Approved 42 223002K4.05 C 3 Y N S No comment RFA 12/18/10 Changed 3 X low to Low-Low-Low reactor water level due to post validation comments.
RFA 2/14/11 Approved 2390002K1.01 M 2 Y N S No comment RFA 12/18/10 259002A1.05 C 3 X Y N E Generic 1 S RFA 12/18/10 Added below RFA 1125111 Approved 1000K4.05 M 2 X Y N 3enericl Jistractors A and B are NP because the 70% is relative riidity. Suggest changing 70% to 95% based on ref L171.018, Para 7.a.
carbon beds are designed to remove at least 95% of ne in the form of methyl iodine and 99.9% of elemental ne.
This Q is U because of two NP distractors.
RFA 12/18/10 Two misses on validation.
)o not agree that 70% is not plausible, 70 is a common wmber associated with hvac trains and a less than ompetent operator may choose this number. Is knowing he difference between 95% and 99.9% not Minutia..
Reworked question as requested, need to evaluate validation data.
ontingent on miss rate for validation and validation omments eplaced question developed in Atlanta due to poor evalidation performance
\ Approved 2/14/11 46 M 2 X Y N E Generic 1 You do not need to say Based on the above plant s conditions This is implied.
Suggestion:
WOOTF completes the statement below?
C
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q#I LOK LOD (C/A) (1-5) Stem Cue IT/F Cred Partial Job- Minuti #1 Back- Q SRO U/E/S Explanation Focu s . Link a units ward K/A Only s Dist.
rhe Unit Preferred Inverter..
RFA 12118/10 Reworked as requested RFA 1125111 Approved 262002A2.02 M 2 X Y N E Generic I RFA 12/18/10 S Added below RFA 1!25I1 I Approved 48
..,J0K6.02 M I X Y N i is such an obvious correct answer that the other choices are NP.
Suggestion:
Make this Q a multipart such that one correct answer is in three choices,
- 1. AA (Correct answer
. AB BA BB I
This Q is U because there is no DV.
RFA 12/18/10
- I on NRC 0707 with one miss, LOD is not 1, request nhancement, question reworked as requested New Question from 0810 NRC Exam RFA 1!25I1 I Approved 4000K5.05
C 3 Y N s No comment RFA 12/18/10 300000K6.07 50 C 3 X Y N E B is NP. With this failure, the normal pressure band will immediately be deselected.
Replace distractor B.
RFA 12/18/10 B was chosen in Validation along with D, believe B to be plausible Contingency Drafted Change distractor and correct answer to match 01 setpoints.
RFA 1125I1 I Approved 00000K6.12 51 M 2 X Y N E Generic 1: Delete the describe phrase. It is not needed.
To increase plausibility for A and B, add that voltage was restored in 3 seconds since this is only true for G
n 1.
Q#I LOK LCD 2.
- 3. Psychometric Flaws J
t
- 4. Job Content Flaws 5. Other I
- 6. 7.
(C/A) (1-5) Stem Cue TIE Cred Partial Job- Minuti #1 Back- Q= SRO UIEIS Explanation Focu S Link a units ward K/A Only Dist compressor.
RFA 12/03/10 Fixed the generic comment, restore voltage in 3 seconds was already there.
RFA 1125111 Approved 52 400000A1.01 c
3 Y N RFA 12/03/10 400000A1.04 M 2 X Y N E Generic 1 RFA 12/03/10 s Fixed RFA 1I25I11 Approved 201002K5.05 C 3 X X Y N Generic 1 Stem: Do not state that the CRD pump is operating at pump runout. Provide adequate indications for the S applicant to determine that himself. This will lend Iplausibility of A and C.
is Q is U until this Q is modified FA 12/03/10 Fixed generic 1, eliminated pump runout.
Contingency Drafted
.Eliminated Pump runout from the stem.
RFA 1I25I1 I Approved 201003K1.01 M 2 X X Y N E Stem: On the WOOTF statement, Stop after Set of actions to be taken. The words difficult to withdraw.
are implied.
S If HCU lines were vented then it is also implied that air is NOT the problem. Therefore, delete and the problem is
.... This will lend credibility to distractor A.
RFA 12/03/10 Fixed as requested RFA 1I25/1 I Approved 215001K4.01 56 M 2 X Y N E Generic 1 RFA 12/03/10 Fixed as requested RFA 1125I1 I Approved 219000G2.4.31 C 3 Y N s RFA 12/03/10 58 230000K2.02
C)
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q#I LOKLOD (C/A) (1-5) Stem Cue TIE Cred Partial Job- Minuti #1 Back- Q SRO UIEIS Explanation Focu S Link a units ward KIA Ony s Dist.
T X V W Generic 1 RFA 12/03/10 s Fixed as requested RFA 1I25I1 I Approved 234000A4.02 M 2 X X Y N If the rod block occurs when the refuel platform is driven near the core, D could be correct if the refuel platform starts moving toward the core and it is near. This must be S. resolved. The distractors need to be tightened up.
Q is U until resolved with the facility. Potentially o ect answers.
12/03/10 ed the word Immediately to Distractor D 1125111 Approved
- 1 K5.03 60 M 2 X Y N E When would D be true?
D is potentially a NP distractor. Facility justify plausibility (when would the RFPT ramp up AND lock at the high speed stop?)
RFA 12/03/10 Reworked distractor D. Question needs additional work section 8.10 is not correct should be section 8.9. Section 8.10 changed to 8.9.
RFA 1I25I1 I Approved 271000K3.02 61 C 3 X Y N E Generic I RFA 12/03/10 Fixed as requested s RFA 1I26i11 Approved 288000A3.01 62 C 3 X Y N E Generic 1 Distractor D is NP because if you substitute in the words, I reads funny. Consider revising.
RFA 12/03/10 Fixed generic 1, do not agree that D reads funny why wouldnt it read funny for the other NOTs Bank 0707. D selected by 3 0707 validators.
Retracted non plausible D comment, due to validation results RFA 1126111 Approved 290001A1.01 63 C 3 X X Y N U Grammar error. The stem should read: On Ui SBGT, control switch 1HS-65-18A on panel 1-9-25 has been placed in the PTL position.
E Is there any equipment that will start if a switch is in PTL?
(Th C
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q#ILOKLOD (C/A) (1-5) Stem Cue TIE Cred Partial Job- Minuti #1 Back- Q SRO UIEIS Explanation Focu s . Link a units ward K/A Only s Dist.
If not then distractors A and D may not be plausible. This s Q is U until resolved.
Facility re-evaluate.
RFA 12/03/10 D distractor was chosen in validation, This component will start with the control switch in PTL Contingency Drafted(not used)
Fixed grammar, confirmed that distractor A and D are plausible, SBGTA switch 1-hs-65-18A, in pull to lock, will start.
RFA 1126111 Approved 64 290002A2.01 C 3 X X Y N ij Generic 1 2/3 core height is such a common number and is E associated with 215 inches. 180 inches is just NP in distractors A and B.
U because 2 distractors NP S RFA 12/09/10 Do not agree -215 is common number, -180 was chosen in validation, 2/3 core height is well known but seldom is a number associated with 2/3 core height. Numbers that they deal with daiiy during simulator workups is TAF -162,
-180 inches for ED, and -200 for steam cooling. dkz 12/27. -180 was selected by multiple validators. The 2/3 core height bypass switch for drywell sprays uses -183 as its setpoint.
A and B selected in validation by a number of validators due to -180 inches being a common number for BFN. Both distractors determined to be plausible A and B.
RFA 1/26/11 Approved Split part I and part 2 for ease of reading.
RFA approved 2I14I11 290003K6.01 65 M 2 X Y N E Please explain why A, B and D are plausible. Why would these choices be chosen?
This Q is E until explained.
3B and A should be in two of the other distractors RFA 12/09/10 A and B selected in validation Contingency made to address comments.
Contingency used, Strengthened plausibility argument.
Validators chose two of the questionable non plausible distractors RFA 1/26I1 I Approved G2.1.25
C I
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q#/ LOKLOD (C/A) (1-5) Stem Cue T/F Cred Partial Job- Minuti #1 Back- Q SRO UIEIS Explanation Focu s . Link a units ward KIA Only s Dist.
W Generic I RFA 12/09/10 S Fixed generic 1 RFA 1126111 Approved 67 G2.1.27 M 2 X Y N Distractor D is NP. Consider using the design basis for RHR or another core cooling system.
Replace D.
RFA 12/09/10 Fixed distractor D to RHR design bases as requested D selected in validation.
Non-plausible distractors chosen during validation, contingency question not used.
RFA 1I26!1 I Approved 68 G2.1.28 M 2 Y N S RFA 12/09/10 69 G2.2.2 M 2 X Y N E For the WOOTF statement, all you need to say is generic Single notch is specified in the second part of the stem.
s RFA 12/09/10 Believe fixed, not sure I understand the problem Redesigned and simplified the stem.
RFA 1/26111 Approved 70 G2.2.39 M 2 X Y N E Generic 1 RFA 12/09/10 s Fixed Redesigned and simplified the stem.
RFA 1I26I1 I Approved G2.4.,43 71 M 2 Y N S RFA 12/09/10 G2.3.13 72 C 2 X Y N E Increase the elevation and the room temperature to make distractors B and D more plausible.
s RFA 12/09/10 Ri drafted to address comment Increased elevation and room temperature per NRC recommendation.
RFA 1126111 Approved G2.3.5 M 2 X Y N Genericl
fl in
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q#I LOK LOD (C/A) (1-5) Stem Cue TIE Cred Partial Job- Minuti #I Back- Q SRO UIEIS Explanation Focu s . Link a units ward K/A Only s Dist.
RFA 12/09/10 Fixed S RFA 1126111 Approved G2.4.42 M 1 X Y N U -thisatwopartquestionfortheTSCandtheOSC.
. . i question, as written, has no DV because of the common knowledge associated with activation of the TSC
. This Q is U because there is no DV FA 12/09/10 This question was missed by 3 validators. It was also determined to have DV on Quad Cities 2009 #75. OPS ators rated LOD average 2.6 I OPS Reviewer rated
..,iat3 Contingency Drafted.
J UE to SAE, because UE non-plausible for
........,..JonofTSC.
RFA 1126111 Approved Added the words lowest classification and split the into two separate columns due to on comments.
FA 211 4I1 I Approved 2.4.47 C 3 X Y N E Generic I
- ........ RFA 12/09/Ip Fixcd RFA 1126111 Annrnved SRO ONLY Response to SRO in SRO Responses file 295001AA2.02 76 C 3 X X Y Y E Generic 1 C can be argued as correct because of the way the TS says completion time is 24 hrs. If they do it in 12 hours1.388889e-4 days <br />0.00333 hours <br />1.984127e-5 weeks <br />4.566e-6 months <br />, S then thats even better then what TS require.
RFA 11/25/10 Fixed, Question re-phrased to say uwithin a MAXIMUM of to eliminate potential subset.
RFA 1126111 Approved 295005G2.1.32 C 3 X X Y Y E Generic 1 Explain why RPV Pressure SL is plausible in distractors B andD.
s A. Add Reactor core MCPR B. Add Reactor coolant system RPV Pressure RFA 11/25/10 See Discussion Two validators chose RPV Pressure non plausible
C C)
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q#/ LOK LOD (C/A) (1-5) Stem Cue TIF Cred Partial Job- Minuti #1 Back- Q SRO UIEIS Explanation Focu s . Link a units ward K/A Only s Dist.
distractor, chose B and D are plausible RFA 1126111 Approved 78 C 3 X X Y Y U Genericl With Ref provided, A and B part 2 (Alert) are NP because it is a DLU. Once the applicant is on the reference page, S there is no discernment. A and B are plausible only without the reference.
i: The first fill in the blank sentence should read based on the SRV status, reactor power is is currently between The stem of the question does not provide the units initial status which is needed to make the SAE declaration.
What mode was the plant initially in? Now?
A can be argued correct because the stem of the question doesnt have enough info to suggest control not established.
This Q is U until resolved.
RFA 11/25110 Contingency I Accepted contingency question and Redrafted Stem and deleted provided reference.
FA 1126!11 Approved Added the word Twenty to correct a typo identified during validation.
A 2/14/11 approved
_...21G2.4.4 C 3 X Y Y E Generici Choices A and C: restate Emergency action level is exceeded.
How much of the EAL classification document will be provided to the applicant?
RFA 11/25/10 Fixed. Applicable EPIP Section 1 Changed distractor B and D to SAE. Changed exceeded to met. Modified stem to delete mode 4 and changed to a temperature of 180. Even though Mode 4 has been exceeded, still in alert because curve 1.5-S is satisfied because unit I remains in the safe region below 90 psig.
RFA 1I26I1 I Approved tA2.08 80 C 3 X .Juppression chamber (SC) pressure is 54 psig.
Technically D is the correct answer since the SC pressure has not exceeded 55psig The stem or the D distractor must be modified OR change the answer to D
n
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q#/ LOK LOD (C/A) (1-5) Stem Cue T/F Cred Partial Job- Minuti #/ Back Q= U/E/S Explanation Focu S Link a units ward K/A 1Only 5 Dist.
required to know the overall mitigation strategy containment pressure, (i.e. when and how the containment can be vented with extremely high pressures and the fact that the torus is preferred because of the scrubbing effect.
How is the KA being met? (Knowing the DW is 2500 R/hr does not affect the venting strategy)
In order to make the procedure selection (lOcfr55.43.b5) make each choice a procedure number and a title (only).
Furthermore, B is NP since nothing in the stem suggest
- PV pressure.
This Q is U because it is NOT SRO only and because the KA is not met.
.RFA 11/25/10 Contingency (IA satisfied, Venting irrespective of Rad Levels was added in contingency question. SRO only because we now have a release where we did not before.
RFA 1126111 Approved ouotA2.02 81 C 3 x Y N U Generic I The first fil in the blank statement provides a cue. You are Y E telling the applicant that ED is required. ROs know that C-2 is called ED. Rework the question to test the SROs knowledge of what pressure is required without telling S them that ED is required.
This Q is U because both parts can be answered with RO knowledge of the title of C-2. RFA 11/25/10 See Discussion Removed the wording Emergency Depressurization from the Stem.
This question is SRO Only because part one is SRO Only.
Therefore this question is downgraded to E due to minor stem changes.
RFA I I26I1 I Approved 295038G2.4.9 82 C 3 X Y Y E The WOOTF statement is written correctly here. Nothing above the WOOTF statement is need to answer the Q.
s RFA1I/25110 See discussion Removed Main Steam Line alarm and changed to 3X normal, and cleaned up the stem.
RFA I!26I1 I Approved 295017G2.2.44 83 C 3 x Y Y E Generic 1 The 4 th bullet provides the applicants with the information that a GE dose limit is being exceeded. The Q needs to
n
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q#/ LOKLOD (CIA) (1-5) Stem Cue T/E Cred Partial Job- Minuti #1 Back- Q SRO tJ/EIS Explanation Focu s . Link a units ward K/A Only s Dist.
be reworked to provide dose values and readings and let the applicant know if the threshold for ED is reached.
RFA 11/25/10 Contingency accepted RFA I 126I1 I Approved 84 D029G2.4.47 C 3 X Y m: Change inch to inches eneric 1 0 knowled can be used to answer both parts of this Q.
- ancelpii q configuration for pumping the torus to the ROs perform routinely. The ROs normal method for lowering torus level is to s involves a simple mathematic calc of how any gal per inch the torus is.
FA 11/25/10 Contingency question accepted with minor editorial corrections.
A 1126111 Approved 85 C 3 X X Y Y E The statement steam line leak resulted in degraded performance of a loop I Core Spray room cooler doesnt necessarily mean the room cooler is inoperable (partial or S no correct answer).
Providing references causes this Q to be a DLU.
RFA 11/25/10 See discussion Contingency question accepted, changed earliest to latest in stem.
RFA 1I26I1 I Approved Lvjuuuu2.2.4 86 C 3 x Y N U Generic 1 The choices A and C are NP since the stem starts in the Y E EOP An RO knows what procedures are used to perform jumpers in the EOP network. Please show an example S when the 01 directs jumpers in the EOP network.
RFA 11/25/10 See discussion leted lAW EOl-Appendix 7C from the stem. Since it wa en that Cl jumpers are used in the EOPs, defeating pressure interlocks on RHR injection valves, this iestion was downgraded to an E.
A 1!2611 I Approved 2001 G24.41 I am NOT convinced that the 30 mm in distractors B and D are plausible based solely on a the applicant erroneously
n n fl
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q#I LOKLOD (CIA) (1-5) Stem Cue T/F Cred Partial Job- Minuti #1 Back- Q SRO UIEIS Explanation Focu s . Link a units ward K/A Only s Dist.
adding the 15 mm segments together. (Based on s distractor analysis for B)
This Q is U until resolved with facility.
- 5 RFA 11/25/10 iContingency question accepted, with changing the correct nculr A. By changing the stem to make the highest n an ALERT 1126111 Approved lAdded Unit 3 to 1130 event due to post exam Ivalidation comments.
- 2I1 4111 Approved 88 C 3 X Y Y J The WOOTF statement is written correctly.
The second fill in the blank statement provides teaching to E the applicants. Just ask the applicant if a 4 hr report to thE NRC is required or not required lAW SPP-3.5 (no references provided)
S C and D are NP because one would not say TS does NOT require a 4 hour4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br /> report to the NRC in accordance with SPP-3.5 Furthermore, the applicant will not believe it is a 1 hr report because RO applicants are required to know 1 hr TS.
The Q is U because 2 distractors are NP.
RFA 11/25/1 Question was modified with minor wording added to increase distractor plausibility, therefore this question was downgraded to E.
RFA 1I26I1 I Approved Changed distractor and stem to read A hour report to the NRC is required when shutdown is commenced. Changed the choices for part 2 to four and one.
RFA 2114111 approved 4000A2.09 89 C 3 X Y Y Stem: Delete Based on the above conditions. This is mplied.
3eneric 1 ich alarm needs to listed exactly as on the panel (see Q c.). A and C are NP because of the way the grammar is sed (i.e. the DG will start only. This sounds wrong even i e applicant doesnt know the logic.
s Q is U because this Q can be answered solely based owledge of plant electrical distribution logic and the plant parametersd which lead to AOP entry.
RFA 11/25/10 Dontingency question 1 accepted, complete rewrite.
0
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q#/L0KL0D (C/A) (1-5) Stem Cue TIF Cred Partial Job- Minuti #1 Back- Q SRO U/E!S Explanation Focu s . Link a units ward K/A Only s Dist.
RFA 1126111 Approved 300000G2.2.36 90 C 3 X U Y U Generic 1 The KA states degraded power sources. This Q is E written around the control air system. I fail to see the connection.
This Q is U until the KA is resolved with the facility.
S This Q test P&Ls # 3.B in 3-Ol-32A. Typically P&Ls are RO knowledge.
C and D are NP because none of the other LCO action statements are 25% power.
Why are references NOT provided to the SRO applicants?
RFA 11/25/10 The P&L deals with application of Required Actions (Section 3) in accordance with rules of application requirements (Section 1) which is clearly a function unique to the SRO position. No reference because information is provided in a P and L.
Control Air is the same as instrument air so KA satisfied RFA 1I2611 I Approved 202001A2.13 91 C 3 X X Y N U Stem: Change channel to channels The second part is a 1 hr action which is also RO E knowledge. The Q does NOT meet SRO only criteria 1.
The stem should read The bases for the setpoint is to (instead of the RPS function). Look at the wording oi S TSbases page 3.3-18 A and B are NP because there is no TS concern with protecting the accuracy of reactor level instrumentation.
Accuracy is affected by DW temperature.
This Q is U until resolved with the facility, RFA 11/25/10 Downgrade to E due to minor one word change SRO only because first part is SRO only.
A and B are now plausible because we added core dp and level instruments. Stem clean up as requested.
RFA 1I26!1 I Approved 216000G2.4.45 92 C 3 X Y Y U This Q is U because A and C are NP because none of the stem condition include activity values or radiation values.
E RFA 11/25/10 This question was modified to add Drywell Radiation High alarm Only to the stem. Due to minor wording change only S this question was downgraded to E.
RFA 1I26I1 I Approved
Th
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q#I LOKLOD (CIA) (1-5) Stem Cue TIE Cred Partial Job- Minuti #1 Back- Q SRO UIEIS Explanation Focu s . Link a units ward K/A Only S Dist.
Changed Drywell Radiation High alarm in stem due to post validation comment identified that changed the correct answer. Changed to Dose equivalent lodine-131 sample results indicate 16 ici/gm.
RFA 2/14111 Approved 271000G2.2.41 C 3 X Y Y I fail to see the plausibility of 0600 as stated in A.2 and C.2. This is 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> BEFORE the error was discovered and two hours after the error was made. Therefore A and C S are NP. This Q is U until resolved.
RFA 11125/10 r ractors A and C were deemed plausible due to Uon. Therefore this question was reclassified as RFA 1126111 Approved i1000G2.2.41 C 3 X Y Y U I do not believe for a single moment that an SRO applican will consider NOT walking down the boards. This Q is U until it is heavily discussed with the utility. Distractors B E and Dare NP.
RFA 11/25/10 S Downgrade to E due to minor one word change Changed first SRO to Shift Manager, which changed the correct answer to B, which increased the plausibility.
Editorial changes made to stem.
RFA 1I26I1 I Approved G2.1.4 C 3 X X Y Y j Generic 1 The stem refers non licensed operators. Yet the stem is E asking a requirement for licensed operators. The Q appears ambiguous.
This Q is U because C and D are NP due to the way the S first fill in the blank statement is constructed. Need to test the applicants knowledge of whether or not an allowance exist to start the 40 hr break in without being current in license requal training.
RFA 11/25/10 OPDP-10 addresses license and non licensed operators.
Changing C and D to after standing now tests the applicants knowledge of the 40 hour4.62963e-4 days <br />0.0111 hours <br />6.613757e-5 weeks <br />1.522e-5 months <br /> break in.
Due to minor wording change to increase plausibility this question was downgraded to E.
RFA 1/26111 Approved G2.2.23 96 C 3 X Y Y E Generic 1 Remove the second bullet. This is teaching.
C Th
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.
Q#I LOKLOD I
(C/A) (1-5) Stem Cue TIF Cred Partial Job- Minuti #1 Back- Q SRO U/E/S Explanation Focu s . Link a units ward K/A Only s Dist.
RFA11/25/10 Editorial changes made to stem.
RFA 1127111 Approved G2.2.44 C 3 Y Y S RFA 11/25/10 Changed RPV pressure to 875 psig and decreased RPV level to (-)150 inches in the stem to increase plausibility of distractors and to ensure only one correct answer.
I RFA 2/14/11 Approved G2.3.12 98 C 3 X Y Y This Q is U because A and B are NP because of the way the first fill in the blank is constructed. Rework the Q to test the SRO applicants knowledge of the minimum S required approval to perform an initial DW entry at power lAW 1-GDI-200-2 RFA 11/25/10 I ubsequent review and discussion Chief Examiner found he question acceptable.
RFA 1I27I1 I Approved G2.3.7 C 3 X Y Y U This Q is U because A and D are NP because of the way the first fill in the blank is constructed. Rework the Q to test the SRO applicants knowledge of whether or not the E RADPRO Supervisor can authorize short term deviation of RWP without revising the RWP. No is NP. Change the second part of the A and B to is still required.
RFA 11/25/10 Editorial changes made to stem.
Subsequent review and discussion Chief Examiner found the question acceptable.
RFA 1I27I1 I Approved G2.4.22 100 C 3 Y Y S RFA 11/25/10 14 9/5) Us 50 34116) Es 36 32/4) Ss
ES-403, Rev. 9 Written Examination Grading Form ES-403-1 Quality Checklist Facility: Browns Ferry Date of Exam: February 18, 2011 Exam Level: ROISRO lnials Item_Description a
- 1. Clean answer sheets copied before grading rfa N;A rsb
- 2. Answer key changes and question deletions justified and rfa 1 N/A rsb documented
- 3. Applicants scores checked for addition errors rfa N/A rsb (reviewers spot check > 25% of examinations)
- 4. Grading for all borderline cases (80 +/-2% overall and 70 or 80, rfa N/A rsb as_applicable,_+/-4%_on_the_SRO-only)_reviewed_in_detail
- 5. All other failing examinations checked to ensure that grades rfa N/A rsb are_justified
- 6. Performance on missed questions checked for training rfa N/As rsb deficiencies and wording problems; evaluate validity of questions_missed_by_half_or_more_of the_applicants Printed Name/Signature Date
- a. Grader/Reviewer Ronald F. Aiello/
- b. Facility Reviewer(*) N/A
- c. NRC Chief Examiner (*) Richard S.
(since R. Aiello was the g ader)
- d. NRC Supervisor (*) Malcolm T. Widmann/
(*) The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.