ML11167A287

2010 Clinton Power Station Initial License Examination Administrative Files

ML11167A287
Person / Time
Site:	Clinton
Issue date:	11/04/2010
From:	Moore C Operations Branch III
To:
References
Download: ML11167A287 (23)

Text

2010 CLINTON POWER STATION INITIAL EXAMINATION ADMINISTRATIVE FILES

ES-201 Examination Preparation Checklist Form ES-201-1 Facility: Clinton Date of Examination : 11/1/10 Examinations Developed by : Facilit)l Target Chief Date' Task Description (Reference) Examiner's Initials

-180 1. Examination administration date confirmed (C.1.a ; C.2.a and b) ~

-120 2. NRC examiners and facility contact assigned (C.1.d ; C.2.e) ~

-120 3. Facility contact briefed on security and other requirements (C.2 .c) ?JPiJ

-120 4. Corporate notification letter sent (C.2.d) ~

[-90] [5 . Reference material due (C .1.e; C.3 .c; Attachment 2)] al1

-75 6. Integrated examination outline(s) due, including Forms ES-201-2 ,

ES-201-3, ES-301-1, ES-301-2 , ES-301-5, ES-D-1's , ES-401-1 /2, ES-401-3 , and ES-401-4, as applicable (C .1e and f; C.3.d) ~

-70 7. Examination outline(s) reviewed by NRC and feedback provided to facility licensee (C.2.h ; C.3.e) 4IIf

-45 8. Proposed examinations (including written , walk-through JPMs, and scenarios , as applicable), supporting documentation (including Forms ES-301-3 , ES-301 -4, ES-301-5 , ES-301-6, and ES-401-6) , and reference aM materials due (C .1.e, f, g and h; C.3.d)

-30 9. Preliminary license applications (NRC Form 398's) due (C.1 .1; C.2 .g; ES-202) ~/(

-14 10. Final license applications due and Form ES-201-4 prepared (C .1.1; C.2.i; ES-202) ~y/

-14 11. Examination approved by NRC supervisor for facility licensee review (C.2.h ; C.3.f) 4

-14 12. Examinations reviewed with facility licensee (C .1.j; C.2.f and h; C.3 .g) .cJM

-7 13. Written examinations and operating tests approved by NRC supervisor (C.2.i ; C.3.h) CiUi

-7 14. Final applications reviewed ; examination approval and waiver letters sent (C.2.i ; Attachment 4; ES-204) ~

-7 15. Proctoring/written exam administration guidelines reviewed with facility licensee (C .3.k) C#~

-7 16. Approved scenarios , job performance measures , and questions distributed to NRC examiners (C.3.i) ~

. Target dates are keyed to the examination date identified in the corporate notification letter.

They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.

ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 11/1-8/10 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback) . Furthermore , I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised .

2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of 11/1-8/10. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate , or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY DATE NOTE

1. QWC/:£ Ilftwa t/(

2. L i&vfN fY1ITZ*I~L

3. 'H.f.611 Pe>ItBFKA

4. t Ift>tS'(iJftY S/lkU

5. l1 f/!..c /)A /,561/

6. ilit iunoV

7. QILH kl5j

~: 'f{!/ i;I!t:: k 10 . AA(?t Sf nV&

11 . (.11-; \.~ Ii IR 12.t.~1Id) 004£' tikI? 'I

13. '") -g;v'C kl4r K Y1 14.'1 11.",::---;1-1)(-(2 15 . ~

NOTES :

1;,-clh....,l.;r, v ES-201, F 27 of 28

ES-201 Examination Security Agreement Form ES-201-3

1. Pre~Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 11/1-8/10 as of the date of my signature . I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate , or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback) . Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised .

2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of 11/1-8/10 . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate , or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE I RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE 1

ES-201 , Page 27 of 28

ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 11/1-8/10 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration , except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback) . Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations andlor an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowledge , I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of 11/1-8/10 . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate , or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE 1 RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE i1!f~ :f~~::f~'Itl~i:.~:I \;):L-: .ru;: :~'-~ :~-. ,-...:=.==== ~~~~:~~~~~:~~~~~7l=-_-_~:~~~~:~:~~~:;:;~~~=~' ===

4.0/< 1':> 0rJlUJ ~S#(,,",,**)=>:'<""----------+-~~~~"'--~----'-'-'L!...!.:..::'--~U4~'{E:,£,=---~==

5. _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __

6. _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __ _ _ __ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __ _ _ _ _ _ _ __ __

7. _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __

8. _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __

9. _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __ _ __ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __

10._ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __

11. _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __ _ __ _ _ _ _ _ __ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __

12. _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __ ______________

13._ _ __ _ __ _ _ _ _ _ _ _ _ _ _ _ _ __ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __

14. _ _ _ _ _ _ _ _ _ _ _ _ _ __ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ________ _ _____

15. _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ __

NOTES:

ES-20 1, Page 27 of 28

ES- 401 Record of Rejected KIA's ES-401-4 Randomly Selected Tier / Group Reason for Rejection KIA 111 295025 1 2.2.4 The subject KIA isn't relevant at the subject facility .

112 295036 1 EKl.01 The subject KIA isn't relevant at the subject facility.

111 295031 1 2.2 .3 The subject KIA isn't relevant at the subject facility.

112 295022 1 AA1.04 The subject KIA isn't relevant at the subject facility .

112 295020 1 2.2.4 The subject KIA isn't relevant at the subject facility.

112 500000 1 2.4.41 Not appropriate license level 211 259002 1 A3.01 The subject KIA isn't relevant at the subject facility.

2/2 214000 1 2.4.41 Not appropriate license level 112 295032 12.06 Not possible to write a psychometrically valid question 112 500000 1 2.4.6 Over sampled 211 239002 16.03 Plant specific 2/2 286000 / 6.05 Not possible to write a psychometrically valid question 2 /2 223001 1 2.4.1 KIA wrong supposed to be 214000

ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Facility: Clinton Date of Exam: 11/08/10 Exam Level: RO ~ SRO D Initials Item Description a b c

1. Clean answer sheets copied before grading

2. Answer key changes and question deletions justified and documented

3. Applicants ' scores checked for addition errors (reviewers spot check >25% of examinations)

4. Grading for all borderline cases (80% +/- 2% overall and 70 or 80, as applicable, +/- 4% on the SRO-only) reviewed in detail ~

5. All other failing examinations checked to ensure that grades $

are justified I- #Jftt

6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants 0f- £ Printed Name / Signature Date

a. Author Tallian French /I/,q/;v

b. Facility Reviewer(*) II- 7-/0 IIU'1UO

c. NRC Chief Examiner( *)

d. NRC Supervisor(*)

(*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-403, Page 5 of 5

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 14. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem C ues T/F Credo Partial ~ob- Minuti #1 (F/H) (1-5) Focus iBack- k2= SRO Dist. Link a units ward KIA Only B/M I U/E/S Explanation

~

F ~ N E Is distractor C plausible??? Why would a vacuum breaker line ever be under water??? Need to change distractor C.

2({>, H X pc Y B U Is there enough info in the question stem to determine if you 're in an unsafe region of the pressure suppression 7*, pressure (N) chart, no level given??? Assuming normal level you could continue to spray until 0 psig in Cnmt. Question stem says your at 0. 1 psig, and explanation says you don ' t have to stop until 0 psig, so is there a correct answer???

What is cnmt negative design pressure?

Reso lution :

Question was rev ised to address all concel11s.

J <N* H 2 pc X Y B S 14 F 2 pc ~ B S 5 F 3 X ~ B E Why is distractor B incorrect???

Need to delete "for each RHR Shutdown Cooling Subsystem" Resolution:

Question was rev ised to address all concerns.

6 F 3 ~ B What does the procedure number mean??? If 4003 indicates RCIC system why wou ld anybody pick anything but D???

Why is C plausible, if a breaker trips why would I reclose it without first checking it out???

Resolution:

The Station ,vas ab le to explain why all distractors were plausib le therefore the question was satisfactory.

7 H 1.5 Y B S Seems like a very easy question .

8 F 1.5 pc X Y M E Change 'collaps ing voids ' to higher pressure in distractor A Does the MDRFP auto start on low Ivl???

Distractor 0 needs to be changed because I don't think it is plausible. Feedwater doesn't isolate on a turbine trip .

Reso lu tion:

Questio n "Nas revised to address all concel11s.

ES-401 Written Examination Review Worksheet Form ES-401*9 I. 2. 3. Psychometric Flaw s 14. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues IrIF C red o Parti al~ ob- Minuti #1 B ack- Q= SRO F/H) (1-5) Focus Dist. Link a units ward KIA Only 8 /MI iu/E/S ~xpl anation

~

4 pc Y 8 U Is there enough info in stem to answer questi on???

Reso lution :

Question was replaced.

0 F 2 pc X Y 8 ~ Not sure if A and C are plausible?

Resolution :

1 Question was revised to address all concerns. Only dist rac tor C needed to be changed.

II H 2 Y 8 E Seems li ke a very easy question. Not sure the second part of distractors A and 0 are plausible.

Resolution :

Q uestion was rev ised to add ress all concerns . Clinton operationa l philosophy may be to rema in at a low power condition wh ile a problem with SRM is fixed.

12 F 1.5 Y 8 S Seems like a very easy question . Straightforward setpoint question.

13 H 2 Y 8 S 14 H 2 Y 8 E Distractor C is no t plau sible. Change distractor C to be Throttle closed RHR 8 Hx Service W ater Outlet Valve.

Mu st also change questi on to ask th e procedurally required action to m aintain 50F/Hr C/D rate.

Resolution:

Question was rev ised to address a ll concems . Distractors 8 and C were edited to provide better distractors.

15 H 3 Y M E Reso lution:

Question was revised to address all concerns. Distractor D was edited as proposed.

16 F 1. 5 Y 8 S Seems like a very easy question.

17 H 3 X rr 8 S 18 H 2 X Y 8 S Do we need to state that the service air system is in its normal system alignment???

19 H 2 X Y 8 S 20 F 1. 5 Y M S Seems like a ve ry easy questi on. Requires knowledge of how to actu ate MSL isolation .

21 H 2 X Y 8 S Seems like a very easy question. Only need to kn ow what th e VG system flow rate is su pposed to be to answer it.

2

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues T /F Credo Partial Job- M inuti ~I Back- Q= SRO F/H) 1-5) Focus Dist. Link a iu nits ward KIA On ly BIMI U/E/S ~xpla nati on N

22 ~ 1.5 Y B S Seems like a very easy question.

23 H 3 Y B E Need to change the description of 1VF09Y it is " Fue l Building Supply Outboard Isolation Damper" .

Reso lu tion :

i

" Question ,vas revised to address all concerns. I VF09Y

""". term ino logy was revised as stated above.

24 F 2 Y B S Seems like a very easy question.

25 IF 3 Y B E In distractor D " double veri fied" should be capitalized so that it resembles the other distractors.

Resolution:

Q uestion was revised to address concel11S stated above.

26 F 1.5 Y N S Seem s like a very easy question.

27 H ~ N B S 28 H 3 ~ Y M S 29 H 3 Dc y N ES 1 don ' t thin k d istractor D is plausible. Change distrac tor D .

Reso lution:

Question was left as is based on exp lanation provided by the Station.

30 F ~ Y B S Easy setpoint question . Potentially minutia.

31 ~*h;; . . 3 N B E Need to add a comma after Lockout.

32 IF ), 2 Y B S Seem s like a ve ry easy question.

33 ~ 2 P< P< M E Change distractor ' D ' to 25 mi nutes . W hy isn ' t th is a d irect look-up???

Resolu tion:

Wi* Question was revised to address concerns stated above.

34 F 2 X N ~ E Need to make the > and < bold and larger. Distractors C and D need to be changed to state " the RP V Flange" not irrad iated fuel seated in the vessel.

Resolution:

Question was revised to address concerns st<lted above.

Distractor C was not changed to state' the RPV Flange' because if it were it would be a correct answer also.

35 F 3 X Y N U Question needs to di fferentiate between VC air hand ling 3

ES-401 Written Examination Review Worksheet Form ES-401-9 I. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem leues T/F !credo Partial Job- Minuti #1 lB ack- p= SRO F/H) (1 -5) Focus Dist. Link a units ~ ard KIA Only B/M I Ul E/S Explanation N

equipment and VC cooling equipment. You can ' t purge if you don' t have fans. Distractors A and C are not plausible and I' m not sure about distractor D.

Reso lution:

Question was rev ised to address concerns stated above.

Coo ling capacity was spec ified in the distTactors.

36 F 3 pc Y B S 37 F 2 pc Y N S Seems like a very easy question.

r 38 2. 5 Y B S 39 F 2 pc Y B S Seems like a very easy question.

40 H ii0 3 pc ~ N SE Pretty good question.

Resolution:

Question was revised to change the question stem to remove jlill:.. unnecessary info .

41 Ii " 3 Y B S 42 F 3 pc Y B ?U S Di stractor D says OVG02CA tripped on high cnmt pressure, this is incorrect according to key but if I VGO 1Y A closes does fa n trip on DP or another interlock??? If it does then

'i\'~(III; OVG02CA tripped as a result of high cnmt pressure.

Reso luti oll :

f.'.

Question was NOT revised to address concerns stated above. The Statioll prov ided reasonable assurance that d.istraetor D is not a COITect answer.

43 F 2 Y B E Need to change distractors C and D. C should read

" positive pressure to ensure the overall Auxil iary Building HVAC system fl ow is balanced".

D should read " positive pressure to ensure hydrogen gas is removed fro m the battery room and the room stays below the fl ammability limit" .

Reso lution:

Question was revised to address concerns stated above.

Distractors were revised to make them more selectab le.

~4 H 2 X Y B S

~5 H 3 Y N S Where is MC PR documented???

4

ES-401 Written Examination Review Worksheet Form ES-401*9 I. 2. 3. Psychometric F laws 4 . Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem iCues T /F Cred o PartialJob- Minuti ~I (FIH) 1-5) Focus Dist. Link a Back- R= SRO IUnits ward KIA Only BIMI U/E/S Explanati on

~

146 F ~ X pc Y N UE Why is d istractor "A" wrong??? If you add water to the pool w ith water that is < ] 04F, you are maxi m izing coo ling.

"D" is not plausible, need to change distractor. Perhaps go with a bl eed and feed di stractor.

Reso lution:

Question stem was rev ised to address concerns sta ted above .

The stem was changed to add a pool level which wou ld precl ude the addition of cooler water.

~7 1:'

1.5 pc Y ~ E Seems like a very easy question. Need to switch A(2) and 0 (2) to make distractors more plausible.

Resolution :

Ques ti on was rev ised to address concerns sta ted above.

148 F 2 Y ~ UE How is the amount of radiation released and b reak fl ow reduced fo llowing a scram??? Are distractors B & C plausible??? The wording of this question is very, very poor. Consider replacing question.

Reso lution:

Question was revised to address concerns stated above. The question stem was revised to enhance readabil ity and add clarity.

~9 F 2 Y B E S Will these feedwater valves fa il closed eventually???

Distractor D is not plaus ible. Change it to "Open to prevent Thermal transients on the fee dwater nozzles" .

" Resolution :

Question was NOT revised to address concerns stated above. Station was ab le to provide justitication as to why it ques tion was satisfactory.

50 F 2 Y B S Seems like a very easy question.

5] ~ ... 2 Y ~ E Is th is a d irect looku p??? A re you allowed to operate the DIG with negati ve KV A R's when para lleled wi th the grid??? Di stractor B is very close to need ing an adjustment to increase KVAR' s, need to get this indicatio n away fro m In* the capabili ty curve.

I!-

Resolution:

Question was revised to address concerns stated above.

5

ES-401 Written Examination Review Worksheet Form ES-401*9 I. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem ~ues 'r I F Credo Partial Job- M inuti flt l Back- Q= SRO (F/H ) (1-5) Focus I U/E/S Explanati on Dist. Link a iu nits ward KIA Only B/M N

t;:*' Provided indications were revised to make question exam liP) worthy.

52 F 2 pc X Y B U E A is not plausible because a defiagration shouldn 't occur if mixers and igniters wo rk. C is not plausible if these m ixi ng compressors are just fa ns that circul ate air within the drywell & cnmt.

Resolution:

Question was rev ised to address concerns stated above .

Distractor A was changed and the stati on was able to provide ass urance that distrac tor C is plaus ible because the appli cants may confu se the mixing compressors with recombiners.

53 H 2 N B U E I don' t have enough knowledge or material to know what is the correct answer fo r this question. Is bus I B I energized by the DIG or is it completely de-energized??? Not sure why picture of system is given, does it tell you where the leak is, or that the system is in an unusual alignment???

Resolution:

The Station was able to provide reasonable assurance that this question is acceptable as long as we changed the stem to state an overc urrenl condition exists on bus I B I .

54 F I Y B U E Why would anybody piek anything other than 4 when alternate power is lost???

Resolution:

The Station was abl e to provide reasonable assurance that th is question is acceptable based on common misconceptions .

55 F I Y B U E Seem s like a very easy question. LOD=1 Yo u don't even have to know what the setpoi nt is. You just need to know what systems actuate on hi MSL tunn el temp.

Resolution:

Question was revised to address concerns stated above . The stem was altered to get closer to the setpo int and dist ractor A was rep laced.

6

ES-401 Written Examination Review Worksheet Form ES-401-9 E Distractor A is not plausible and needs to be changed.

Distractor C needs ONLY deleted. Distractor D needs to have RHR C deleted.

Reso lution:

Question was revised to address concerns stated above .

Distractors C & D were rev ised and the Sta tion was able to reasonable ass urance that distractor A is lausible .

Why don ' t we need to give info in the stem regarding suppression pool temperature??? If it is 200F and RHR is taking a suction from the suppression pool is 'A' a concern ??? I don ' t like the way this question is asked, that is to find the exception . Asking this question in that style makes the question much easier than asking the applicant to detennine what they should consider when suppression pool level reaches 11ft.

Reso lution:

Question was NOT revised to address conccrns stated above. Station provided reasonable assurance that Rl-lR pump damage wi ll not occur from conditions stated in the stern .

E Somebody needs to explain to me why distractors A and C are plausible.

Resolution:

Question was revised to address concerns stated above.

Distractors A and C \vere edited to make them more likely to be selected.

7

ES-401 Written Examination Review Worksheet Form ES-401*9

1. 2. 3. Psychometric Flaws 14. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem lCues IrIF Credo Partial Job- iMinuti ~I ~ ack- Q= SRO (F/H) (1-5) Focus Dist. Link a tu nits w ard KIA Only ~IMI IU/E/S !Explanati on

~

61 F 1.5 X pc N ~ E U Seems like a very easy question. May want to change distractor D to 20 inches.

Needed to change the question stem so that only one correct answer was provided. No correct answer existed in original ques tion without an initial reactor power level.

62 H 2.5 Y B S Why not ask for the setpoint also??? G ive instrument readings of power and make applicants realize if they are above or below setpoint.

63 F I Y ~ U E LOD = 1 If you' re going to ask a power supply question it needs to be integrated into the question . Syste m integration ie power is lost to a bus and the Rx scrams, how does the plant respond?

Resolution:

Q uestion was revised to address concerns stated above . The stem was altered to make the question higher order, instead ora 'What's the po\ver supply to IC CCW pump" question.

64 H 3 ~ B E Need to capitalize only in distractor B Res oluti o n:

Q uestion was revised to add ress concerns sta ted above .

65 H 2 Y N E Why is distractor D.2 plausible??? Replace w ith improved mix mg.

Resolution:

Ques ti on was rev ised to address concerns stated above .

66 H 2 X ~ B U S Why are di stractor A and D plausible??? You tell them it' s a instrumentation problem and then distractor D says RR FCY dam age my occur, I don' t think so and I don ' t th ink anybody wo uld pick this distractor.

Reso lution:

Question was NOT revised to address concerns stated above. Station was able to provide reasonable assurance that distractors A an d D were in fact plausib le.

~~\'

67 X Y B U What transient occurred. Pick one that doesn ' t affect the question. What is normal RP V level at stem condi tions? If its norma lly 30 inches and stem ind icates 45 inches is that a In) concern??? Would any of the distractors be correct if I 8

ES-401 Written Examination Review Worksheet Form ES-401-9

l. 2. 3. Psychometric Flaws 4 . Job Content Flaws 5. Other 6. 7. 8.

p# LOK LOO Stem ~ues ((IF Credo Partial Job- ~ inuti 1#1 Back- Q= SRO F/H) ( 1-5) Focus B/M I U/E/S Explanation Oist. Link a iu nits ward KIA Only N

\IV expect RPY level to be 30 inches and its indicating 45 inches??? What I'm asking is, is there more than one correct answer based on the info given in the stem??? Is there enough info in the stem to answer??? Seems like your tes ting very basic knowledge on how level indication 68 l} ' X Y B U system works at reduced power.

Resolution:

Question was revised to address concerns stated above.

Question was rewritten to address concerns.

Need to explain why distractors B, C, and D are plausible.

Need to change B to Ensure 99% of total fi ssion products released from dropped fue l assembly 's rods is retained by the cavity water. C needs to be changed to Ensures a suffic ient water level to ensure dose rates to personnel are maintained below acceptable limits fo llowing a fue l handling accident. D need to be changed to Minimum leve l needed to provide an adequate heat sink in the event of a loss be RHR Shutdown Cooling.

Resolution:

Question was revised to address concellls stated above.

Distractors 8 an d C were revised to address the stated concerns.

69 H 2 X Y N U ..

E Why are distrae tors Band 0 plausible???

Resolution:

is';'i' Question was NOT revised to address concerns stated above. Station was able to exp lain why distractors Band D i( were plausible.

70 H 3 pc X N N U E Why arc distractors C and 0 plausible??? Is it possible fo r rad iation levels to in crease as a resul t of water entering the vessel poo l. Can this become an ai rborne contamination event???

Resolution:

Question was NOT revised to address concerns stated above. Station was ab le to provide reasonable assurance that distractors C and 0 arc plausible. The Station also 9

ES-401 Written Examination Review Worksheet Form ES-401-9

l. ~. 3. Psychometric Flaws 14. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem le ues T/F C redo Parti a ~ob- M inuti #1 Back- Q= SRO (FIH) 1-5) Focu s Dist. Link a units ward KIA pnly B/M! U/E/S Explanati on N

indicated that rad level will not increase due to the leakage based on previous plant experience.

71 H 1. 5 pc Y N S Seems like a very easy qu estion. Wh y not ask what A SLC pump tripped on??? Low suction pressure, Ove r current, Man ually turn ed off.

12 F I Y N U S Seems like a very easy question. This is a straight fo rwa rd power sup ply qu estion . If you ' re going to ask a power supp ly question it needs to be integrated into th e question . System integration i.e. power is lost to a bus and the Rx scrams, how does the plant respond?

Resolution :

Question was NOT rev ised to address concerns stated above. Station was able to clarify that this \-vas not a simple power supply question because you need to deternline the impact on pla nt operati on.

73 F 1.5 Y ~ S Seems like a ve ry easy qu estio n. Close to qu estion 72 above but better. It co uld still be a little more integrated.

74 H 2 pc Y N E Why is distractor 0 plausib le??? A should be changed to search area after receiving a locked high rad briefi ng . D should also be changed to after receivi ng a locked high rad briefi ng.

Resolution:

Question was NO'r revised to address concerns stated above. The question \-vas replaced because the station didn't want to make recommended changes. Tho;: new question was changed to replace "Incident Commander" with "Work Control Supervisor".

75 H 1.5 Y B U S Are you really suppose to close F006A before you open F004A??? and th en start th e A RHR Pp. How did the A RHR Pp trip??? It doesn't seem like there is a correct answer provided for this questi on. It also seems li ke a very easy question.

Ro;:solution:

Question was NOT revised to address concerns stated above. This is the guidance provided by the procedure.

10

ES-401 Written Examination Review Worksheet Form ES-401-9 I. 2. 3. Psychometric Flaws ~. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem Cues rr/F ~red . Partial Job- Minuti #1 ~ ack- Q= SRO (FIH ) (1-5) Focus Dist. Link a units ~a rd KIA Only 8 /MI U/E/S Explanation N

I 2

3

~

5 6

7 8

9 10 II 12 13 14 15 16 17 18 19 20 21 22 23 24 25 II

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job C ontent Flaws 5. Other 6. 7. 8.

Q# LOK LOD Stem ~ues T /F C redo Partial Job- ~v1inuti 1#1 Back- Q= SRO (F/H) (1-5) Icocus Di st. Link a !Units ward KIA !only ~/MI U/E/S Explanation

~

Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified :

The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed , or too much needless information).

The stem or distractors contain cues (Le. , clues , specific determiners, phrasing , length , etc).

• The answer choices are a collection of unrelated true/false statements .

• The distractors are not credible ; single implausible distractors should be repaired , more than one is unacceptable.

• One or more distractors is (are) partially correct (e.g. , if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified :

• • The question is not linked to the job requirements (Le. , the question has a val id KIA but, as written , is not operational in content).

The question requires the recall of knowledge that is too specific for the closed reference test mode (Le. , it is not required to be known from memory).

• The question contains data with an unrealistic level of accuracy or inconsistent units (e.g. , panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirements .

5. Check questions that are sampled for conformance with the approved KiA and those that are designated SRO-only (KiA and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified , or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.1.

7. Based on the reviewer's judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhan cement, or (S)atisfactory?

B. At a minimum , explain any "U" ratings (e .g., how the Appendix B psychometric attributes are not being met).

BANK 45 (60%)

NEW 25 (33 .3%)

MODIFIED 5 (6 .7%)

Fundamental 37 (49 .3%)

Higher 38 (50.7%)

Sat 22 Final number of Sat 40 Initially Unsat 26 Final number of Unsat 5 12

ES-401 Written Examination Review Worksheet Form ES-401*9 Initially Enhance 26 Final number of Enhancements 30 Initially Indeterminate 1 13

ES-401 Written Examination Review Worksheet Form ES-401*9 14

Operating Test Comments JPM Comments A1-RO Changed the time to be filled out on the operations MCR panel walkdown checks (online )

data sheet from 00 :00 to 02 :00 .

A2-RO On ESOMS Report of hours data sheet, we added information as to which position the RO held during each of his shifts . The applicants needed to know if the RO stood a credited watch position or was extra to determine if the RO got credit for the watch stood or not.

A3-RO No changes needed A4-RO No changes needed Sim/CRa Step 8.4 .2.3 is not a critical step Sim/CRb No chanqes needed Sim/CRc No chanqes needed Sim/CRd Make the note at step 8.1.5.4 bold to highlight the fact that this step mayor may not be performed depending on whether the applicant uses the Hard Card .

Sim/CRe Need to change the sequence of the JPM steps to coincide with the procedure CPS 4001.02C001 .

Sim/CRf Make the note at step 9 bold to highlight the fact that the following steps mayor may not be performed depending on whether the applicant uses the Emergency Stop Pushbutton or shuts down the DIG using the procedure . Change the Critical Step from opening the DG output bkr to Stopping the DG.

Sim/CRg Revised step 3 into two distinct actions instead of one action . Step 5 is not a criti cal step.

Sim/CRh Need to revise JPM to add steps to shutdown Continuous Containment Purge after it is determined that the UNFILT Mode does not work.

IPi No changes needed IPj No changes needed IPk Will provide a new picture of what is inside the left panel on 11P07E.

Scena ri o Comments Scenario #1 Event #4 need to add a step for the SRO to direct disarming control rod 28-33 in accordance with TS 3.1.3 The critical task identified to enter EOP-8 is not a critical task.

The critical task identified to verify the Turbine and Generator trip is not a critical task .

Scenario #2 Event #3 change BOP actions to Start standby CCW pump only. Delete the or shutdown running FC pump and close 1CC076A&B.

Event #5 delete BOP action #5 to transfer 4160V busses to RAT B because it is not necessary. System is already aligned to that way.

Event #8 The first critical task actions to insert control rods following the ATWS should be bolded to identify them as critical tasks .

Event #8 Need to add critical task actions to terminate and prevent RCIC injection during the ATWS .

Event #8 Need to delete RC IC and add Feedwater to the step to control RPV level. RCIC wi ll be unavailable .

Spare Event #7 Need to change the critical task from entering EOP-8 to Scraming the Rx prior to Scenario exceeding Max Safe Temp .

Outline Comments No Comments made on Examination Outline I IPagc

Post-Exam Comments No post-examination comments were received from Clinton Power Station following the completion of this examination.