ML120810237

From kanterella
Jump to navigation Jump to search
2012 Byron Station Initial License Examination Administrative Files
ML120810237
Person / Time
Site: Byron  Constellation icon.png
Issue date: 01/23/2012
From: Bielby M
NRC/RGN-III/DRS/OLB
To:
Shared Package
ML12079A212 List:
References
Download: ML120810237 (24)
v • d • e


Text

2012 BYRON STATION INITIAL LICENSE EXAMINATION ADMINISTRATIVE FILES

ES-201 Examination Preparation Checklist Form ES-201-1 Facility: B~ron Nuclear Station, Units 1 and 2 Date of Examination: Week of 1/23/2012 Developed by: Written - Facility 181 NRCD II Operating - Facility 181 NRC 0 Target Chief Date* Task Description (Reference) Examiner's Initials

-180 1. Examination administration date confirmed (C.1.a; C.2.a and b) meb

-120 2. NRC examiners and facility contact assigned (C.1.d; C.2.e) meb

-120 3. Facility contact briefed on security and other requirements (C.2.c) meb

-120 4. Corporate notification letter sent (C.2.d) meb

[-90] [5. Reference material due (C.1.e; C.3.c; Attachment 3)] NA

{-75} 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, meb ES-301-1, ES-301-2, ES-301-5, ES-D-1's, ES-401-1/2, ES-401-3, and ES-401-4, as applicable (C.1.e and f; C.3.d)

{-70} {7. Examination outline(s) reviewed by NRC and feedback provided to facility meb licensee (C.2.h; C.3.e)}

{-45} 8. Proposed examinations (including written, walk-through JPMs, and meb scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6, and any Form ES-201-3 updates), and reference materials due (C.1.e, f, g and h; C.3.d)

-30 9. Preliminary license applications (NRC Form 398's) due (C.1.1; C.2.g; meb ES-202)

-14 10. Final license applications due and Form ES-201-4 prepared (C.1.1; C.2.i; meb ES-202)

-14 11. Examination approved by NRC supervisor for facility licensee review meb (C.2.h; C.3.f)

-14 12. Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g) meb

-7 13. Written examinations and operating tests approved by NRC supervisor meb (C.2.i; C.3.h)

-7 14. Final applications reviewed; 1 or 2 (if >10) applications audited to confirm meb qualifications I eligibility; and examination approval and waiver letters sent (C.2.i; Attachment 5; ES-202, C.2.e; ES-204)

-7 15. Proctoring/written exam administration guidelines reviewed meb with facility licensee (C.3.k)

-7 16. Approved scenarios, job performance measures, and questions meb distributed to NRC examiners (C.3.i)

  • Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by case basis in coordination with the facility licensee.

[Applies only] {Does not apply} to examinations prepared by the NRC.

'Ytt9e- I ~ ~;;:~~tJ!;b/tt-ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of iJ#'3/j~ as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2. Post-Examination To the best of my knowledge, I <;lid not divulge to any unauthorized persons any information conceming the NRC licensing examinations administered during the week(s) of YtSj ~rom the date that' entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or proVide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

JOB TITLE I RESPONSIBILITY DATE~ATE NOTE vJ 1.

2. .

~l./4/ ~_"2JiJrz~ Iitv"' ,.,.)lcYt ~

f

3. /7 " C;;' hl,[1 Z.
4. /'J  ?-x- /,r ~n::::=-
5. E Fd-c. I(V. ~ 'Z 6.

7.

)('\01"\.

E.1'fY"\. \lAI.<k,*ho...)

c ""It""'- VAt..! ~l>tV t 17-

z. , Iz,,_ _
8. M~\ ("" 'r'E~ \lo...\~ d **.:\.\o",,- ~ __
9. R;~ -+n Ll ~ '" G IN'.. \t <", \.: Aa ...k ..... '" .;:t:.3...-~

if'.hI~~'-- ~~

---..+-~~~-il:lt-Ir..rr,....,..,~y\ "wr'L ~. ft;/-f"""i( ~O(' ~'l a ,;;t-1JO-If

JJ".~~ --.-

, * !lUI.! >JOWl V' .... C" .

. I<t1Nj!~1I4::.('WWI"L. xc IIIV'HI... y!C -~-- l,-l.-12..

.l0Cl R.~ VCt(,*d!.. ~r - 5';Vl . ~~

Y~l't-

'VtUft" d- Dt:l~~t(t~

ES*201 Examination Security Agreement Vorm ES*201*3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of yP3 f ~s of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been a horized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore. I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2. Post*Examination To the best of my knowled~id not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of !ka~~z. From the date that I entered into this security agreement until the completion of examination administration. I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations. except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE I RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE

1. 5-\"*,\4.- "'<.r,~ ,N'.,S 0 I U'd- hit L..... ,/7 _J_)_' ~

~~;'.I.,,1v' ~-/'"L 2.t!tl<-h Cuw.,l:tz:L 3 CII&, i.

4,

5. (f:

'~fA"£'i I=t

'Sj!O

=U'  : ~ ,~' ...."'"

6l~I¥'~IIJd'!I

.5/2.p{t/A:"//:)4'~

""1'"

~

l/#i!L i1.]-i:

g ~

7....

~l ~ V**Wi i1~71 lt~~

~: '~~i ~~li!~~ /~1!% ~ ~-IP-6.

9. !3ftr4v Lii"".,A./ "5'4\.01~/)",.,fY\",J hlbll' L
10. K..2M:~ )-hut.-:;)  :+/-vt~4 k'1A ~+/-G r ,:J.:iLLL ~ __
11. thmio""'f Mb(f!)Q ...,Sao 'Vp..LitAnon MH1 2-10" ~

12.:ToM. 6o.\e... ..,$01 \la.\'sMal4(") ~-:~~~~~_ _

13.J<'EY/". SA,..JPoIU) //At-I QA OQ*.) ~

14.C\";iV~'\",f* MR.",&(' >t?o/ VIo\I..II'J4rloV' ii-Ii'" :?~~.;:

15. Ctlf{.l~ AA.O,>.(.A.- /<..0 ~'1,--d)1t77'J;J /;J iZ -'--=-=_

NOTES:

I ES.201.CIa 27 of 28 I

"""I11III 17t'fe 3 cf~4J&iII't' ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination 1"]...

I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of '2${1:. ~ as ofthe date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been aut ~rized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of t..:.3 Ih~ii:I1from the date that I entered into this security agreement until the completion of examination administration, I did not t

instruct, evaluate, or provdE; performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE I RESPONSIBILITY DATE DATE NOTE 1.tJc.A;A/E~~S Ihdl- Z6jz,

2. f./..1 .I", 4 W<..i r Z-;s*/{.--

3.

4.

5.

It'2-==1.

6. ' ~==
7. Y.!:Jlz.
8. f\:ChAtl.d.l:1 w. H\~jo zit;~-ll---
9. S,r.eA.-zKcvj...~_ ...::ntSl'r<4L*roR  ;;... :L 10.MOIIlEl. .C,I).;CJ:'HAlJ ~ ~
11. pt1\ ill:!' k I JI.l~iJ 1

1 .------------------------------------------------------------------------------------------ ________________

1 _ _ __

1 NOTES:

  • ES-201 Examination Security Agreement Y01fe--r
  • Fonn ES*201-3
1. Pre-Examination I acknowledge that' have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of ¥~l../M~s of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct. evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. 'will Immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2. Post-examination To the best of my ~ge, I did not divulge to any unauthorized persons any information conceming the NRC licensing examinations administered during the week(s) of ~z.t Y!!!1i.". From the date that I entered into this security agreement until the completion of examination administration. I did not instruct. evaluate, or provide performance feedback to those applicants who were administered these licensing examinations. except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY .7SIGNATURE (1) DATE ~AATURE (2) DATE NOTE

1. ~jr 1M 1x!.Fltf'Si C9TPS/"Rellt~~ ,~cftlt1~
2. _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __

7Jr&~ ~i- ~ C[)

3. ---
4. _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __
5. _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ~ _ _ _ _ _ _ _ _ _ __
6. _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __
7. ---
8. ---
9. _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __

10._ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __

11. ---
12. ---
13. ---
14. ---
15. ---

NOTES: ,4.A ..,/. I I /7/1 ,/_.ls-k,tP-- -

Al ~ ~...( ~.. 'Y&(/~ 70 /l.h ( ~'t('

lY r~~' '0 ES-201 I. 27 of 28

ES-401 Record of Rejected KlAs Form ES*401-4 Tier 1 Randomly Reason for Rejection Group Selected KIA 111 000022K1.04 Unable to create RO level question that properly discriminates. Replaced (0. #4) with systematically selected KIA 000022K1.03 in same system and category to keep outline balanced. Updated ES-401-2.

1/1 000055.2.3.12 EPE that was randomly selected for KIA topic (Station Blackout) does not (0. #10) lend itself to generic KIA. Replaced with systematically selected KIA 000055.2.4.1. Using same EPE and a Generic KA keeps outline balanced Updated ES-401-2.

1/1 058.2.2.25 The Generic KA tied to this APE goes beyond required RO level of 0.#12 knowledge. Systematically selected a more appropriate generic KA 058.2.4.45 to keep outline balanced. Updated ES-401-2.

1/1 E11 EK3.4. Unable to create RO level question that properly discriminates. Replaced (0. #16) with systematically selected KIA E11 EK3.3. in same tier and category to keep outline balanced. Updated ES-401-2.

2/2 0033002.4.49 Randomly selected KIA (immediate actions) is not applicable to Spent Fuel (0. #60) Cooling system. Replaced with systematically selected KIA 0330002.4.31 to keep outline balanced. Updated ES-401-2.

1/1 0000272.4.1 Randomly selected KIA was previously sampled in RO portion of exam.

(0. #80) Re-sampled using a different EPE that has not been previously sampled with different generic selection to maintain outline balance. 056G.2.1.7 Updated ES-401-2 1/1 00062.2.4.13 Originally selected KA was for EOP action on lose of Service water. At 0#13 Byron, this is an abnormal procedure. Systematically selected generic 2.4.11 to tie to APE 062. Updated ES-401-2.

1/2 060AK3.01 Selected KIA is not the responsibility of the Reactor Operator. Randomly 024 selected a previously un-sampled APE but stayed within the same category to maintain outline balance .037AK3.03. Updated ES-401-2.

2/1 039A401 The originally selected KA is being sampled on the operating test.

043 Systematically replaced with A4.07 to maintain outline balance. 039A4.07 Updated ES-401-2.

2/1 0592.4.5 Unable to create RO level question that properly discriminates. Replaced with systematically selected KIA 0592.4.50 in same system and category to 045 keep outline balanced. Updated ES-401-2.

1/1 sro 0572.1.25 Kept generic KIA but changed system from Loss of Vital AC Instrument 081 Bus to more appropriate APE where graphs could be interpretted. 025 2.1.25. Updated ES-401-2.

212 sro 002.2.4.49 2.4.49 requires testing on 1m. Actions. Could not develop SRO level 091 question. Systematically selected generic KA applicable to SRO position.

Kept same system for outline balance.002.2.2.25 Updated ES-401-2.

2/1 061A2.01 AF pps do not operate with FW pps at Byron Station. Kept same system 046 and category (061A2) to maintain outline balance but changed KIA to A2.05 Air or MOV Failure. Added KA to Suppressed KA list. Updated ES 401-2..

1/2sro 0762.1.32 Asked similar question on Cert. Exam. Randomly selected area from same 83 Tier and Group to one that has not been sampled (024) and a generic KIA that had been sampled once previously. New KIA is 024.2.2.25 Updated ES-401-2.

3sro 2.4.44 Asked similar question on Cert exam. Randomly selected a generic KIA 99 that is in the same group. New KIA is 2.4.26 Updated ES-401-2.

ES-401, Page 27 of 33

3 sro 2.4.34 Could not write a discriminating question to this KA. Subsituted with KA 100 2.1.32 to maintain outline balance. Updated ES-401-2.

ES-403 FacUi .

Written Examination Grading Quality Checklist Date of Exam: ,

Form ES-403*1 Item Descri tion 1.

2. Answer key changes and question deletions justified and documented
3. Applicants' scores checked for addition errors reviewers s ot check> 25% of examinations
4. Grading for all borderline cases (80 +/-2% overall and 70 or 80, as a licable, +/-4% on the SRO-onl reviewed in detail
5. All other failing examinations checked to ensure that grades are 'ustified
6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of uestions missed b half or more of the a licants
a. Grader Date zj3b.q
b. Facility Reviewer(*) -Z-/S/r2
c. NRC Chief Examiner (*) ~/7!/2.-
d. NRC Supervisor (*) ~?/;z-(*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two inde endent NRC reviews are re uired.

ES-403, Page 6 of 6

ES-401 Written Examination Review Worksheet Form ES-401-9 B J anual) 2012 E

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LaD (F/H) (1-5) Stem Cues T/F Cree:!. Partial Job- Minutia #1 Back- Q= SRO B/MIN UtEtS Explanation Focus Dist Link units ward KIA Only 1 H 3 t/ N S 2 F 2 t/ N S 3 M 2 t/ N E NRC: Fundamental memory of seal outlet temperature trip criteria with simple math, not higher cognitive level.

F Licensee: Revised LOK to F.

Instructions

[Refer to Section D of ES401 and Appendix B for additional information regarding each of the following concepts.)

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2. Enter the level of difficulty (LaD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
3. Check the appropriate box if a psychometric flaw is identified:
    • The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

The answer choices are a collection of unrelated truelfalse statements.

The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

4.

  • Check the appropriate box if a job content error is identified:

One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

    • The question is not linked to the job requirements (I.e., the question has a valid KIA but, as written, is not operational in content).

The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

  • The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
  • Check questions that are sampled for conformance with the approved KIA and those that are The question requires reverse logic or application compared to the job requirements.
5. designated SRO-only (KIA and license level mismatches are unacceptable).
6. Enter question source: (B)ank, {M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES401 Section D.2.f.
7. Based on the reviewer's judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
8. At a minimum, explain any au* ratings (e.g., how the Appendix B psychometric attributes are not being met).

A "+" in the "0#" column indicates that question was reviewed as part of the representative sample of 30 questions.

Page 1 of9

ES-401 Written Examination Review Worksheet Form ES-401-9 Byron January 2012 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (FIH) (1-5) Stem Cues T/F Creel. Partial Job- Minutia #1 Back- Q= SRO B/M/N UIE/S Explanation Focus Dist. Unk units ward KIA Only 4 H 2 V. V' B Y NRC: "Same" is not a plausible distractor for charging flow and pressurizer level when no operator action with leakage. Therefore, A S

and B aren't plausible.

Licensee: Modified choices such that charging flow and pzr level are compatible, ie, same direction.

5+ H 3 V' N S 6 H 3 V' B S 7 ~ 2 V' V' N E NRC: a) Fundamental memory vice Higher cognitive level question of how to trip Rx for ATWS.

F b) If applicant knows both RDMGs are normally running, then can eliminate both A and B without reading further of how they are tripped. Replace/rewrite A or B.

Licensee: a) LOK=F. b) Replaced B. Opening the BYB breaker is plausible because during surveillance testing opening this breaker will result in a reactor trip.

8+ H 2 V' N E NRC: Clarify HFP and HZP. Errata: misspelled "transitioned".

Licensee: Clarified HFP and HZP, corrected misspelling.

9 H 2 V' to! V' B 2011 BWD crt exam U NRC: a) Replace A. Closing MSIVs is also a correct action.

b) B is an SRO action. The other choices are actions taken by the ROs. Either modify, or replace B.

Licensee: a) Replaced A with an incorrect action. b) ROs are required to know info such as SG levels below the 2BFR-H.1 transition level, but AF flow is met making this incorrect.

10 F 2 V' N S Yo twice 11 H 2 V' N S Yo twice

  • 12+ H 3 V' V' N U NRC: Band D implausible. B, loss of one battery charger would not cause trip. D, loss of both DC buses would not allow unit to stay on line. Rewrite or replace Band D.

Licensee: Incorporated comment by incorporating common term into stem, deleting the second column of choices (ie, Unit Status) and replacing Band D.

13 F 3 V' B S Page 2 of9

ES-401 Written Examination Review Worksheet Form ES-401*9 Byron-_.

Jal1l1~ 2012 Exam---_.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

0# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #I Back- Q= SRO B/M/N U/EIS Explanation Focus Dist. Link units ward KIA Only 14 H 3 .; N S 15 F 2 .; B E NRC: A needs clarification. Need to add "leak" between "likely" and "location".

Licensee: Incorporated comment.

16 F 2 .; B U NRC: Band C implausible. B. dumping steam at max rate would result in much larger cooldown than 100 deg Flhr. C. reduction to one train SI (RHR, CV. SI) would be about 4000 gpm from RWST; however, max makeup to RWST is only about 150 gpm. Replace. or rewrite Band C.

Licensee: Modified stem to include ..... currently at Step 12.

ESTABLISH ONE TRAIN OF ECCS FLOW: Replaced distracters B andC.

17+ H 2 t/ B S 2009 BWDILE 18 H 3 t/ N S 19+ F 2 .; B S 2011 BWD ILE 20 H 2 .; .; M E NRC: Delete " ... on PZR Hi Level" from heading in 3ni column of choices. Cuing applicants to consider a trip based on PZR level. let applicants determine if there is a trip without narrowing possibility of what to consider.

Licensee: Comment incorporated .

21 H 2 .; B S 22+ H 2 .; N S 23 H 3 .; N S 24+ F 2 .; B E 2010 BYR crt exam; % twice NRC: a) Add "ONLY" to end of 0 distractor.

b) Add a reason for Excess letdown in distractor A to make it resemble format of other choices.

c) Are operators required to memorize the number "75 gpm" from RNO Step 1b of 1BOA SEC-8? If not, then make "reasons* wrong for distracters.

Licensee: Comments incorporated. Operators are expected to know

'75gpm from RNO Step 1b of 1BOA SEC-B.

~~~ _~~ ~ ~~ L~_ ~~ ___ ~~

Page 3 of9

ES-401 Written Examination Review Worksheet Form ES-401-9 Bl'ron J_anJjal'Y 2012 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues TlF Credo Partial Job- Minutia #/ Back Q= SRO B/MiN UlE/S Explanation Focus Dist. Link units ward KIA Only 25 H 2 tI' N E V. twice F NRC: Fundamental memory of generator trip which causes Main Turbine and reactor trip and Fire Protection actuation due to UAT sudden pressure trip above P-8 vice Higher cognitive level question.

Licensee: LOK=F 26 F 2 tI' N E V. twice NRC: C and 0: insert "indicating lights" after "pump .. ." in C and after "Pump ... " in D.

Licensee: Comments incorporated.

27 F 3 tI' B S 28 F 2 tI' N S 29+ F 3 tI' N S 30 H 3 tI' N S V. twice 31+ F 3 tI' B S 2009 BWD crt exam 32 H 3 tI' N S 33 F 3 tI' N S 34 H 3 tI' B S 35+

36 H

F 3

2 tI' N

N S

S Y2twice Y2twice 37 F 2 tI' N S 38+ F 2 tI' N E NRC: Remove "status", not required to meet KA, only lowers difficulty of question.

Licensee: Comment incorporated.

39 H 2 tI' N S 40 H 3 tI' tI' N S 41 F 2 tI' N S Page 40f9

ES-401 Written Examination Review Worksheet Form ES-401-9 Byron January 2012 Exam I

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

0# LOK LOD (FIH) (1-5) Stem Cues TtF Credo Partial Job- Minutia #I Back 0= SRO BIM/N UtEtS Explanation Focus Dis!. Link units ward KIA Only 42+ H 2 t/ B S 43 H 2 t/ B S 44 F 2 t/ B S 45+ F 2 t/ B S 2011 BWD NRC exam 46 F 2 t/ N S  % twice 47 F 2 t/ N E NRC: Is " ... MAXIMUM flexibilily .. :a technical term understood by operators? If not, rephrase stem.

Licensee: Incorporated comment. I i

48 H 2 t/ B S 49+ F 2 t/ B S 2011 BWD crt exam; % twice 50 H 2 t/ N U NRC: Double jeopardy with 012, replace question.

Licensee: Replaced question.

51+ H 3 t/ N U NRC: a) Stem, last sentence, replace " .. .is most likely to .. ." with

" ... will ... ".

b) Will reduction in frequency cause DG output breaker to open on high current?

Licensee: a) Incorporated comment. B) Breaker is rated for 3000 amps, so answer is "No."

Page 5 of9

ES-401 Written Examination Review Worksheet Form ES-401*9 Byr!)n January 2012 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #/ Back Q= SRO B/M/N UlE/S Explanation Focus Dist. Link units ward KIA Only 52 H 2

.,. N E NRC: a) Stem, third sentence, delete " ... the GREATEST probability of...", and in last sentence, delete ..... MOST likely to be .. .". These imply more than one correct answer, and if there is more than one correct answer, then either rewrite or replace question.

b) If exposed for same time in all Cases, then for same point source, the further away, the less dose. But doesn't appear valid in all Cases if time and distance is varied. Explain justification for answer.

Note: The reference for distance states that DR decreases by a factor of d 1/(d 2 )2 , ie, Distancel divided by square of Distance2.

Reference does not support answer where the exposure time and distance vary.

Mathematically, the numerator could change less, or more, than the denominator, and the final exposure could be less, or more. Just depends on the relative time and distance changes.

D=(DR x t) x d 1/(d2f licensee: a) Comments incorporated. b) OPR02J measures dose rate, not dose; therefore DR2=DR 1XD 1/Dl 53 F 1 .,. N U NRC: a) Low LOD. Asking straight forward backup water supply question. b) B could also be correct answer, SX could be used as backup supply for SFP. c) KA asking for " ... physical connections ... "

the reference, System DeSCription, pg 35, provides the physical connection, ie, "backup water supply to ring header in AB".

licensee: Incorporated comments, rewrote question to meet KA, LOD=2, and only 1 correct answer .

54+ H 2

.,. N S 55 H 3 .,. B S 2011 BWD NRC exam; Va twice 56 H 3 .,. B S Reference; 57 H 2

.,. N S 58 H 3 .,. N S Va twice 59+ F 2

.,. N S 60 F 3 .,. B S 61 H 3 .,. B S Page 6 0[9

ES-401 Written Examination Review Worksheet Form ES-401-9 Byr!)n January 2012 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #I Back- Q= SRO B/MIN U/E/S Explanation Focus Dist. Link units ward KIA Only 62+ H 3 e/ B S 63 F 2 e/ N S 64 F 2 e/ N S NRC: Replace/rewrite Band C, not plausible.

Licensee: Replaced question.

65 H 3 e/ B S 2011 BWD NRC exam 66+ H 3 e/ N S Votwice 67 H 3 e/ N S 68 H 2 e/ e/ B U '12 twice NRC: Band C implausible, ie, boration equivalent to withdrawing rods. or dilution equivalent to inserting rods.

Licensee: Rewrote question. ,

69 F 2 e/ N S Votwice 70+ H 2 e/ B S 2011 BWD NRC exam 71 F 2 e/ B S 72+ F 2 e/ B S 2011 BWD NRC exam 73 F 1 e/ e/ B U NRC: a) Low LOD. B. C and D inform many personnel directly, while A only informs an individual. Without knowing correct answer. it is evident that A answers the question.

b) A not plausible because he is not notified directly by anyone.

Replace, or rewrite Question.

Licensee: Could not identify additional replacement plausible distracters, replaced Question.

74 F 2 e/ B S Votwice 75+ F 3 e/ B S For RO portion of Exam: N(i!:10%,8)=42/56%. M(S'11 )=1. B<<75%,56)=32143/%; LOK: F=36, H(50-60%,38)=39/52%; E=11, U(S'20%,15)=8 76 H 3 e/ e/ N S 77 H 3 e/ e/ N S

'----- -- - - - - - - - - - - -~

-_ ....... _ . -- ....... -~ .......-- .......-

Page 7of9

ES-401 Written Examination Review Worksheet Form ES-401*9 Byron January 2012 Exam

1. 2. 3, Psychometric Flaws 4. Job Content Flaws 5. other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/MIN UlElS Explanation Focus Dist. Link units ward KIA Only 78+ F 2 fI' fI' B S 79 H 3 fI' fI' N S 80+ H 3 fI' fI' N S Reference 81 H 2 fI' fI' B S Reference 82 H 2 fI' fI' B S 83+ F 3 fI' fI' fI' B E NRC: Eliminate possible cue in last line of stem. Replace when they all are concemed with SHUTDOWN MARGIN" with "for initiating boration".

Licensee: Incorporated comment.

84 H 3 fI' fI' N S 85 H 3 fI' fI' N S 86+ H 2 fI' fI' N S 87 H 2 fI' fI' X B U  % twice NRC: a) Not SRO only. Requires recall of whether valve is MOV or AOV (memory and RO knowledge). The procedure titles are self explanatory of the malfunction, and ROs would be expected to know the effects of the malfunction on AOVs or MOVs and the RH HX outlet temperature.

b) Doesn't seem clear that the question is addressing the plant as a whole (ie, the overall effect that increases RH HX temperature) or just the individual item listed.

Licensee: Replaced question.

88+ F 2 fI' fI' fI' N U  % twice 89 H 3 fI' fI' N S 90 H 3 fI' fI' B S 2011 BWD crt exam 91+ F 2 fI' fI' B S 2009 BWD crt exam 92 H 3 fI' fI' B S 93 H 3 fI' fI' N S

~_L~_~_ ~ ~~-

Page 8of9

ES-401 Written Examination Review Worksheet Form ES-401*9 Byron January 2012 Exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) 8tem Cues TtF Credo Partial Job- Minutia #I Back Q= 8RO B/M/N UlEt8 Explanation Focus Dist Link units ward KIA Only 94 F 2 II' II' B 8 2011 BWD crt exam 95+ F 2 II' II' II' II' N U NRC: a) 8 and C have cues to correct answer. Item 6 is obviously correct, who else other than Operations would ensure plant conditions?

b) D is implausible. Item 1, not believable that Operations would write an Electrical Engineering test procedure.

Licensee: Rewrote choices to revise stem items and reordered items for choices.

96+ F 2 II' II' N 8  % twice 97 F 3 II' II' N 8 98 F 2 II' II' B 8 2011 BWD NRC exam 99+ F 2 II' II' B 8 100 F 2 II' II' B 8 2011 BWD NRC exam For SRO portion of Exam: Nf~10%,3)=13152%, M(S4)=0, 8<<75%,19)=12148%; LOK: F=11, H(i!:50%,13)=14; E=1, U(S20%,5)=3/12%

Comments:

Arrange choices based on length of sentence, ie, from shortest to longest.

Are questions requiring references identified to the applicant? Put together in book, let applicant pick one he wants.

For SRO only questions, make sure "you" are in an SRO position in the question stem.

Could increase U's based on post-exam comments.

Page 90f9

There were no NRC comments on the licensee outlines for the 2012 Byron Initial License Examination.

NRC Exam Submittal Comments Byron Power Station, Units 1 and 2 Exam Date 01123/2012 Operating Test 2012-301 I Examiner Comment I Facility Action/Response Operating Test No comments on Outline Generic Use different colored paper for Comments material examiners give to applicant.

Only put cues that examiner needs to perform this JPM, ie, cues associated with simulator performance. (RA 3, SA 3, CR A, CR B, CR C, CR D, CR E, CR F, CR G, CR H)

Insert the associated TS Condition action, and time allowed to accomplish the task.

Pro"'posed RO Admin JPM RA Have a correctly filled out Reactivity Comment incorporated.

1a Change Determination Form Att. 1 of OP-AP-300-1004. (Information contained in JPM steps)

SRO Admin JPM Step 2 Identifying that the wrong unit Rewrote step, not critical.

SA 1a is marked not a critical step RO Admin JPM RA Examiners needs correctly filled out Data sheets prepared for exam.

1b Data Sheets so that he can compare with applicant's.

SRO Admin JPM Step 5 tolerance of hydrogen flow Incorporated comments.

SA 1b rate from ReS vent should be +/- 50 scfm not 100 scfm. Need to change max and min acceptance criteria in Step 6 to reflect +/- 50 scfm.

RO Admin JPM RA Low level of difficulty. Only has to Added two more steps to identify 2 identify two isolation points no electrical isolation on prints.

electrical components, no special considerations. Rewrite, or replace.

SRO/RO Admin Why is Alert Alarm set at High Alarm Adjusted alarm setpoint accordingly JPM RAISA 3 setpoint? Don't normally see that. to 3. 14E-04.

Add more to make SRO JPM, ie, TS, Revised SA 3 to be a review of BCP 10f3

NRC Exam Submittal Comments Byron Power Station, Units I and 2 Exam Date 01123/2012 Operating Test 2012-301 I Examiner Comment I Facility ActionlResponse or have SRO review and authorize 400 and determination that release release (Step 5). cannot be made.

SRO Admin JPM The NARS form that is provided for Comment incorporated.

SA4 the applicant is filled out correctly.

Need to provide applicant with blank NARSform.

SRO/RO JPM CR 1. Need to change Initiating 1. Incorporated comment.

A Cue to say Test only SID Bank E and Control Banks A 2. Yes. Leave as is.

through D.

2. Is step 5 critical?

JPM IPj Align U-2AF to Unit 1. Licensee Replaced with Local Emergency replaced due to procedure change. Start of the _B AFW Pump, D(direct) vice N(new), same Safety Function, revised outline.

SRO/RO JPM IP K Get rid of the useless pic that is Agreed.

provided. Just have them open the IB panel door.

Scenario 1 1. In event 1 please list what TS 1. Incorporated.

3.7.4 Condition A action is and what time is allowed to accomplish the task. Same for TS 3.6.3 Condition C. 2. Incorporated.

2. In event 5 when will BA pump trip? Also the scenario should list how much BA should be added rthe REMA.

Scenario 2 1. Licensee moved Event 5 to 1. Incorporated Event 2 2. Incorporated

2. Licensee originally had Events 2,3 and 4 run simultaneously, now Event 2 will run, then 3. Incorporated.

Events 3 and 4 will run simultaneously.

3. On page 5 there is a booth cue that needs to be changed. In 4. Incorporated.

the last line on 5an EO 20f3

NRC Exam Submittal Comments Byron Power Station, Units 1 and 2 Exam Date 01/23/2012 Operating Test 2012-301 r Examiner Comment I Facility ActionlResponse shouldn't be telling the RO where 1W0056A is. He should be asking the RO where it is.

4. In event 3 & 4 put BA volume from REMA in scenario for the examiners.

Scenario 3 1. Licensee changed Event 2 1. Incorporated from failing HIGH to failing LOW (Original Outline listed as failing LOW; however, the description on Pg 2 described 2. Incorporated.

it as failing HIGH).

2. Put note at the bottom of page 16 on the top of page 17.

30f3

Exelon Generation Company. LLC www.exeloncorp.com Byron Station Nuclear 4450 North German Church Road Byron, I L 61010-9794 PERSONAL PRIVACY INFORMATON WITHHOLD FROM PUBLIC DISCLOSURE UNDER 10 CFR 2.390(a)(6)

February 7,2012 LTR: BYRON 2012-0019 NUREG 1021 Rev. 9 File: 1.10.0101 Section ES-501 Cynthia Pederson Acting Regional Administrator, Region III U. S. Nuclear Regulatory Commission 2443 Warrenville Road Suite 210 Lisle, IL 60532-4352 Byron Station, Units 1 and 2 Facility Operating License Nos. NPF-37 and NPF-66 NRC Docket Nos. STN 50-454 and STN 50-455

Subject:

Submittal of 2012 Byron Initial License Examination Post-Examination Comments There are no post examination comments for the 2012 Byron Initial License Examination administered January 23 31, 2012.

In addition, the items listed below will be hand delivered to Mike Bielby, Chief Examiner, or his designee, at NRC Region III offices.

Graded written examinations with copy of each applicant's answer sheet Master examinations and answer keys Questions I answers during the written examination Written examination seating chart Results of any written examination performance analysis performed Original Form(s) ES-201-3, "Examination Security Agreement," with pre- and post-examination signatures will be delivered as soon as all the post-examination signatures have been completed.

Per our discussion with Mike Bielby, we request the NRC withhold public disclosure of the exam in ADAMS for 2 years so we can have the exam available for internal use.

Should you have any questions concerning this letter, please contact David T. Gudger, Regulatory Assurance Manager, at 815-406-2800. For questions concerning the enclosure materials, please contact William F.

Hochstetter at 815-406-3111 .

Respectfully,

///&/,4-Ti~J~TUIOn Si~ Vice President Byron Generating Station TJT/WFH/TLH/cy Attachments cc: NRC Senior Resident Inspector - Byron Station wlo attachments

ecc: Illinois Emergency Management Agency - Division of Nuclear Safety, wlo attachments Site Vice President - Byron Station, wlo attachments Vice President - Licensing and Regulatory Affairs. wlo attachments Regulatory Assurance Manager Byron Station, wlo attachments Director - Licensing and Regulatory Affairs - Braidwood and Byron, wlo attachments NRC License Coordinator - Byron Training, with attachments Exelon Document Control Desk Licensing, w/o attachments

Retrieved from "https://kanterella.com/w/index.php?title=ML120810237&oldid=2463634"