ML11167A287

2010 Clinton Power Station Initial License Examination Administrative Files

ML11167A287
Person / Time
Site:	Clinton  (NPF-062)
Issue date:	11/04/2010
From:	Moore C Operations Branch III
To:
References
Download: ML11167A287 (23)

Text

2010 CLINTON POWER STATION INITIAL EXAMINATION ADMINISTRATIVE FILES

ES-201 Examination Preparation Checklist Form ES-201-1 Facility:

Clinton Date of Examination: 11/1/10 Examinations Developed by:

Facilit)l Target Chief Date' Task Description (Reference)

Examiner's Initials

-180

1.

Examination administration date confirmed (C.1.a; C.2.a and b)

~

-120

2.

NRC examiners and facility contact assigned (C.1.d; C.2.e)

~

-120

3.

Facility contact briefed on security and other requirements (C.2.c)

?JPiJ

-120

4.

Corporate notification letter sent (C.2.d)

~

[-90]

[5.

Reference material due (C.1.e; C.3.c; Attachment 2)]

al1

-75

6.

Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-5, ES-D-1's, ES-401-1 /2,

~

ES-401-3, and ES-401-4, as applicable (C.1e and f; C.3.d)

-70

7.

Examination outline(s) reviewed by NRC and feedback provided to facility 4IIf licensee (C.2.h; C.3.e)

-45

8.

Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms aM ES-301-3, ES-301 -4, ES-301-5, ES-301-6, and ES-401-6), and reference materials due (C.1.e, f, g and h; C.3.d)

-30

9.

Preliminary license applications (NRC Form 398's) due (C.1.1; C.2.g;

~/(

ES-202)

-14

10. Final license applications due and Form ES-201-4 prepared (C.1.1; C.2.i;

~y/

ES-202)

-14

11. Examination approved by NRC supervisor for facility licensee review 4

(C.2.h; C.3.f)

-14

12. Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g)

.cJM

-7

13. Written examinations and operating tests approved by NRC supervisor CiUi (C.2.i; C.3.h)

-7

14. Final applications reviewed; examination approval and waiver letters sent

~

(C.2.i; Attachment 4; ES-204)

-7

15. Proctoring/written exam administration guidelines reviewed C#~

with facility licensee (C.3.k)

-7

16. Approved scenarios, job performance measures, and questions

~

distributed to NRC examiners (C.3.i)

Target dates are keyed to the examination date identified in the corporate notification letter.

They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.

ES-201 Examination Security Agreement Form ES-201-3

1.

Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 11/1-8/10 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2.

Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of 11/1-8/10. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME

1. QWC/:£ Ilftwa t/(

2. L i&vfN fY1ITZ *I~L

3. 'H.f.611 Pe>ItBFKA

4. t Ift>tS'(iJftY S/lkU

5. l1f/!..c

/)A /,561/

6. ilit iunoV

7. QILH kl5j

~ : 'f{!/i;I!t:: k

10. AA(?t Sf nV&

11. (.11-;

\\.~ Ii IR 12.t.~ 1Id) 004£' tikI? 'I

13. '") -g;v'C kl4r K Y1 14.'1 1 1.",::---;1-1) (-(2 15.~

1;,-clh....,l.;r, NOTES:

JOB TITLE / RESPONSIBILITY DATE NOTE v

ES-201, F 27 of 28

ES-201 Examination Security Agreement Form ES-201-3

1.

Pre~Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 11/1-8/10 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2.

Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of 11/1-8/10. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE I RESPONSIBILITY SIGNATURE (1)

DATE SIGNATURE (2)

DATE NOTE 1

ES-201, Page 27 of 28

ES-201 Examination Security Agreement Form ES-201-3

1.

Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 11/1-8/10 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations andlor an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2.

Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of 11/1-8/10. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE 1 RESPONSIBILITY SIGNATURE (1)

DATE SIGNATURE (2)

DATE NOTE i 1!f~

f~~::f~'Itl~i:

. ~:II\\;):L-::.ru;:::-~~~.

~' :--,-.:.. =.==== ~~~~:~~~~~:~~~~~7l=-_-_~:~~~~:~:~~~:;:;~~~=~'===

4.0/< 1':>

0rJlUJ

~S#(,,",,**)=>:'<""----------+-~~~~"'--~----'-'-'L!...!.:..::'--~U4~'{E:,£,=---~==

5. _____________________________________________________ _

6. _________________ ________________________________ _

7. _____________________________________________________ _

8. _____________________________________________________ _

9. _____________________________________________________ _

10. __________ _ ____________________________________________ _

11. _______________________________________________________ _

12. _______________________________________________________ _

13. ________________________ _______________________________ _

14. __________________________________________________ _____ _

15. ________________________________________ _______________ _

NOTES:

ES-20 1, Page 27 of 28

ES-401 Record of Rejected KIA's ES-401-4 Tier / Group Randomly Selected Reason for Rejection KIA 111 295025 1 2.2.4 The subject KIA isn't relevant at the subject facility.

112 295036 1 EKl.01 The subject KIA isn't relevant at the subject facility.

111 295031 1 2.2.3 The subject KIA isn't relevant at the subject facility.

112 295022 1 AA1.04 The subject KIA isn't relevant at the subject facility.

112 295020 1 2.2.4 The subject KIA isn't relevant at the subject facility.

112 500000 1 2.4.41 Not appropriate license level 211 259002 1 A3.01 The subject KIA isn't relevant at the subject facility.

2 / 2 214000 1 2.4.41 Not appropriate license level 112 295032 12.06 Not possible to write a psychometrically valid question 112 500000 1 2.4.6 Over sampled 211 239002 16.03 Plant specific 2 / 2 286000 / 6.05 Not possible to write a psychometrically valid question 2 /2 223001 1 2.4.1 KIA wrong supposed to be 214000

ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Facility: Clinton Date of Exam: 11/08/10 Exam Level: RO ~ SRO D

1.

2.

3.

Item Description Clean answer sheets copied before grading Answer key changes and question deletions justified and documented Applicants' scores checked for addition errors (reviewers spot check >25% of examinations)

4.

Grading for all borderline cases (80% +/- 2% overall and 70 or 80, as applicable, +/- 4% on the SRO-only) reviewed in detail

5.

All other failing examinations checked to ensure that grades are justified

6.

Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed Name / Signature

a. Author Tallian French

b. Facility Reviewer(*)

c. NRC Chief Examiner(*)

d. NRC Supervisor(*)

Initials a

b c

~

I-

1. Jftt 0f- £ Date

/I/,q/;v II-7-/0 IIU'1UO *

(*)

The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-403, Page 5 of 5

ES-401 Written Examination Review Worksheet Form ES-401-9

1.

2.

3. Psychometric Flaws

14. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD Stem Cues T/F Credo Partial ~ob-Minuti #1 iBack-k2= SRO (F/H) (1-5) Focus Dist.

Link a units ward KIA Only B/MI U/E/S Explanation

~

F

~

N E

Is distractor C plausible??? Why would a vacuum breaker line ever be under water??? Need to change distractor C.

2({>, H X

pc Y

B U

Is there enough info in the question stem to determine if you're in an unsafe region of the pressure suppression 7*,

pressure (N) chart, no level given??? Assuming normal level you could continue to spray until 0 psig in Cnmt. Question stem says your at 0.1 psig, and explanation says you don 't have to stop until 0 psig, so is there a correct answer???

What is cnmt negative design pressure?

Resolution:

Question was revised to address all concel11s.

J <N* H 2

pc X

Y B

S 14 F

2 pc

~

B S

5 F

3 X

~

B E

Why is distractor B incorrect???

Need to delete "for each RHR Shutdown Cooling Subsystem" Resolution:

Question was revised to address all concerns.

6 F

3

~

B What does the procedure number mean??? If 4003 indicates RCIC system why would anybody pick anything but D???

Why is C plausible, if a breaker trips why would I reclose it without first checking it out???

Resolution:

The Station,vas ab le to explain why all distractors were plausible therefore the question was satisfactory.

7 H

1.5 Y

B S

Seems like a very easy question.

8 F

1.5 pc X

Y M

E Change 'collapsing voids ' to higher pressure in distractor A Does the MDRFP auto start on low Ivl???

Distractor 0 needs to be changed because I don't think it is plausible. Feedwater doesn't isolate on a turbine trip.

Resolution:

Question "Nas revised to address all concel11s.

ES-401 Written Examination Review Worksheet Form ES-401*9 I.

2.

3. Psychometric Flaws

14. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD Stem Cues IrIF C redo Partial ~ ob-Minuti #1 Back-Q=

SRO F/H) (1-5) Focus Dist.

Link a units ward KIA Only 8 /MI iu/E/S ~xpl anation

~

4 pc Y

8 U

Is there enough info in stem to answer question???

Resolution :

Question was replaced.

0 F

2 pc X

Y 8

~

Not sure if A and C are plausible?

Resolution:

1 Question was revised to address all concerns. Only distractor C needed to be changed.

II H

2 Y

8 E

Seems like a very easy question. Not sure the second part of distractors A and 0 are plausible.

Resolution:

Question was rev ised to address all concerns. Clinton operational philosophy may be to remain at a low power condition wh ile a problem with SRM is fixed.

12 F

1.5 Y

8 S

Seems like a very easy question. Straightforward setpoint question.

13 H

2 Y

8 S

14 H

2 Y

8 E

Distractor C is not plausible. Change distractor C to be Throttle closed RHR 8 Hx Service Water Outlet Valve.

Must also change question to ask the procedurally required action to maintain 50F/Hr C/D rate.

Resolution:

Question was revised to address all concems. Distractors 8 and C were edited to provide better distractors.

15 H

3 Y

M E

Resolution:

Question was revised to address all concerns. Distractor D was edited as proposed.

16 F

1.5 Y

8 S

Seems like a very easy question.

17 H

3 X

rr 8

S 18 H

2 X

Y 8

S Do we need to state that the service air system is in its normal system alignment???

19 H

2 X

Y 8

S 20 F

1.5 Y

M S

Seems like a very easy question. Requires knowledge of how to actuate MSL isolation.

21 H

2 X

Y 8

S Seems like a very easy question. Only need to know what the VG system flow rate is supposed to be to answer it.

2

ES-401 Written Examination Review Worksheet Form ES-401-9

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD Stem Cues T/F Credo Partial Job-Minuti ~I Back-Q=

SRO F/H) 1-5) Focus Dist.

Link a iunits ward KIA Only BIMI U/E/S ~xpla nati on N

22

~

1.5 Y

B S

Seems like a very easy question.

23 H

3 Y

B E

Need to change the description of 1 VF09Y it is "Fuel Building Supply Outboard Isolation Damper".

i "

Resolution :

Question,vas revised to address all concerns. I VF09Y term inology was revised as stated above.

24 F

2 Y

B S

Seems like a very easy question.

25 IF 3

Y B

E In distractor D "double verified" should be capitalized so that it resembles the other distractors.

Resolution:

Question was revised to address concel11S stated above.

26 F

1.5 Y

N S

Seems like a very easy question.

27 H

~

N B

S 28 H

3

~

Y M

S 29 H

3 Dc y

N E S 1 don't think distractor D is plausible. Change distractor D.

Resolution:

Question was left as is based on explanation provided by the Station.

30 F

~

Y B

S Easy setpoint question. Potentially minutia.

3 1

~*h;;.... 3 N

B E

Need to add a comma after Lockout.

32 IF

), 2 Y

B S

Seems like a very easy question.

33

~

2 P<

P<

M E

Change distractor 'D ' to 25 minutes. Why isn't this a direct look-up???

Resolution:

Wi*

Question was revised to address concerns stated above.

34 F

2 X

N

~

E Need to make the > and < bold and larger. Distractors C and D need to be changed to state " the RPV Flange" not irradiated fuel seated in the vessel.

Resolution:

Question was revised to address concerns st<lted above.

Distractor C was not changed to state' the RPV Flange' because if it were it would be a correct answer also.

35 F

3 X

Y N

U Question needs to differentiate between VC air handling 3

ES-401 Written Examination Review Worksheet Form ES-401-9 I.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD Stem leues T/F

!credo Partial Job-Minuti #1 lBack-p= SRO F/H) (1 -5) Focus Dist.

Link a units ~ard KIA Only B/MI UlE/S Explanation N

equipment and VC cooling equipment. You can't purge if you don't have fans. Distractors A and C are not plausible and I'm not sure about distractor D.

Resolution:

Question was revised to address concerns stated above.

Cooling capacity was specified in the distTactors.

36 F

3 pc Y

B S

37 F

2 pc Y

N S

Seems like a very easy question.

38 r

2.5 Y

B S

39 F

2 pc Y

B S

Seems like a very easy question.

40 H ii0 3 pc

~

N S E Pretty good question.

Resolution:

jlill:..

Question was revised to change the question stem to remove unnecessary info.

41 Ii "

3 Y

B S

42 F

3 pc Y

B

?U S Distractor D says OVG02CA tripped on high cnmt pressure, this is incorrect according to key but if I VGO 1 Y A closes

'i\\'~(III; does fan trip on DP or another interlock??? If it does then OVG02CA tripped as a result of high cnmt pressure.

Resolutioll :

f.'.

Question was NOT revised to address concerns stated above. The Statioll provided reasonable assurance that d.istraetor D is not a COITect answer.

43 F

2 Y

B E

Need to change distractors C and D. C should read "positive pressure to ensure the overall Auxiliary Building HVAC system flow is balanced".

D should read "positive pressure to ensure hydrogen gas is removed from the battery room and the room stays below the fl ammability limit".

Resolution:

Question was revised to address concerns stated above.

Distractors were revised to make them more selectable.

~4 H 2

X Y

B S

~ 5 H

3 Y

N S

Where is MCPR documented???

4

ES-401 Written Examination Review Worksheet Form ES-401*9 I.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD Stem iCues T/F Credo Partial Job-Minuti ~I Back-R= SRO (FIH) 1-5) Focus Dist.

Link a IUnits ward KIA Only BIMI U/E/S Explanation

~

146 F

~

X pc Y

N U E Why is distractor "A" wrong??? If you add water to the pool with water that is < ] 04F, you are maximizing cooling.

"D" is not plausible, need to change distractor. Perhaps go with a bleed and feed distractor.

Reso lution:

Question stem was revised to address concerns stated above.

The stem was changed to add a pool level which would preclude the addition of cooler water.

~7 1:'

1.5 pc Y

~

E Seems like a very easy question. Need to switch A(2) and 0(2) to make distractors more plausible.

Resolution:

Question was revised to address concerns stated above.

148 F

2 Y

~

U E How is the amount of radiation released and break flow reduced following a scram??? Are distractors B & C plausible??? The wording of this question is very, very poor. Consider replacing question.

Resolution:

Question was revised to address concerns stated above. The question stem was revised to enhance readabil ity and add clarity.

~9 F 2

Y B

E S Will these feedwater valves fail closed eventually???

Distractor D is not plausible. Change it to "Open to prevent Thermal transients on the feedwater nozzles".

Resolution:

Question was NOT revised to address concerns stated above. Station was able to provide justitication as to why it question was satisfactory.

50 F

2 Y

B S

Seems like a very easy question.

5]

~...

2 Y

~

E Is this a direct lookup??? Are you allowed to operate the DIG with negative KV AR's when paralleled with the grid??? Distractor B is very close to needing an adjustment In*

to increase KVAR's, need to get this indication away from the capability curve.

I!-

Resolution:

Question was revised to address concerns stated above.

5

ES-401 Written Examination Review Worksheet Form ES-401*9 I.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD Stem ~ues 'rIF Credo Partial Job-Minuti fltl Back-Q=

SRO (F/H) (1-5) Focus Dist.

Link a iunits ward KIA Only B/M I U/E/S Explanation N

t;:*'

Provided indications were revised to make question exam liP) worthy.

52 F

2 pc X

Y B

U E A is not plausible because a defiagration shouldn't occur if mixers and igniters work. C is not plausible if these mixing compressors are just fans that circulate air within the drywell & cnmt.

Resolution:

Question was revised to address concerns stated above.

Distractor A was changed and the station was able to provide assurance that distractor C is plausible because the applicants may confuse the mixing compressors with recombiners.

53 H

2 N

B U E I don't have enough knowledge or material to know what is the correct answer for this question. Is bus I B I energized by the DIG or is it completely de-energized??? Not sure why picture of system is given, does it tell you where the leak is, or that the system is in an unusual alignment???

Resolution:

The Station was able to provide reasonable assurance that this question is acceptable as long as we changed the stem to state an overcurrenl condition exists on bus I BI.

54 F

I Y

B U E Why would anybody piek anything other than 4 when alternate power is lost???

Resolution:

The Station was able to provide reasonable assurance that th is question is acceptable based on common misconceptions.

55 F

I Y

B U E Seems like a very easy question. LOD=1 You don't even have to know what the setpoint is. You just need to know what systems actuate on hi MSL tunnel temp.

Resolution:

Question was revised to address concerns stated above. The stem was altered to get closer to the setpoint and distractor A was replaced.

6

ES-401 Written Examination Review Worksheet Form ES-401-9 7

E Distractor A is not plausible and needs to be changed.

Distractor C needs ONLY deleted. Distractor D needs to have RHR C deleted.

Resolution:

Question was revised to address concerns stated above.

Distractors C & D were revised and the Station was able to reasonable assurance that distractor A is lausible.

Why don 't we need to give info in the stem regarding suppression pool temperature??? If it is 200F and RHR is taking a suction from the suppression pool is 'A' a concern ??? I don 't like the way this question is asked, that is to find the exception. Asking this question in that style makes the question much easier than asking the applicant to detennine what they should consider when suppression pool level reaches 11ft.

Resolution:

Question was NOT revised to address conccrns stated above. Station provided reasonable assurance that Rl-lR pump damage wi ll not occur from conditions stated in the stern.

E Somebody needs to explain to me why distractors A and C are plausible.

Resolution:

Question was revised to address concerns stated above.

Distractors A and C \\vere edited to make them more likely to be selected.

ES-401 Written Examination Review Worksheet Form ES-401*9

1.

2.

3. Psychometric Flaws

14. Job Content Flaws

5. Other

6.

7.

8.

Q# LOK LOD Stem lCues IrIF Credo Partial Job-iMinuti ~I

~ ack-Q=

SRO (F/H) (1-5) Focus Dist.

Link a tunits ward KIA Only ~IMI IU/E/S !Explanation

~

61 F

1.5 X

pc N

~

E U Seems like a very easy question. May want to change distractor D to 20 inches.

Needed to change the question stem so that only one correct answer was provided. No correct answer existed in original question without an initial reactor power level.

62 H

2.5 Y

B S

Why not ask for the setpoint also??? Give instrument readings of power and make applicants realize if they are above or below setpoint.

63 F

I Y

~

U E LOD = 1 If you' re going to ask a power supply question it needs to be integrated into the question. System integration ie power is lost to a bus and the Rx scrams, how does the plant respond?

Resolution:

Question was revised to address concerns stated above. The stem was altered to make the question higher order, instead ora 'What's the po\\ver supply to IC CCW pump" question.

64 H

3

~

B E

Need to capitalize only in distractor B Resolution:

Question was revised to address concerns stated above.

65 H

2 Y

N E

Why is distractor D.2 plausible??? Replace with improved mix mg.

Resolution:

Question was revised to address concerns stated above.

66 H

2 X

~

B U S Why are distractor A and D plausible??? You tell them it's a instrumentation problem and then distractor D says RR FCY damage my occur, I don't think so and I don't think anybody would pick this distractor.

Reso lution:

Question was NOT revised to address concerns stated above. Station was able to provide reasonable assurance that distractors A and D were in fact plausible.

67

~~\\'

X Y

B U

What transient occurred. Pick one that doesn' t affect the question. What is normal RPV level at stem conditions? If its normally 30 inches and stem indicates 45 inches is that a In) concern??? Would any of the distractors be correct if I 8

ES-401 Written Examination Review Worksheet Form ES-401-9

l.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

p# LOK LOO Stem ~ues ((IF Credo Partial Job- ~ inuti 1#1 Back-Q= SRO F/H) ( 1-5) Focus Oist.

Link a iunits ward KIA Only B/MI U/E/S Explanation N

\\IV expect RPY level to be 30 inches and its indicating 45 inches??? What I'm asking is, is there more than one correct answer based on the info given in the stem??? Is there enough info in the stem to answer??? Seems like your l

testing very basic knowledge on how level indication system works at reduced power.

Resolution:

Question was revised to address concerns stated above.

Question was rewritten to address concerns.

68 } '

X Y

B U

Need to explain why distractors B, C, and D are plausible.

Need to change B to Ensure 99% of total fission products released from dropped fuel assembly's rods is retained by the cavity water. C needs to be changed to Ensures a suffic ient water level to ensure dose rates to personnel are maintained below acceptable limits following a fuel handling accident. D need to be changed to Minimum level needed to provide an adequate heat sink in the event of a loss be RHR Shutdown Cooling.

Resolution:

Question was revised to address concellls stated above.

Distractors 8 and C were revised to address the stated concerns.

69 H

2 X

Y N

U

.. E Why are distraetors Band 0 plausible???

Resolution:

is';'i

Question was NOT revised to address concerns stated above. Station was able to explain why distractors Band D i(

were plausible.

70 H

3 pc X

N N

U E Why arc distractors C and 0 plausible??? Is it possible for radiation levels to increase as a result of water entering the vessel pool. Can this become an airborne contamination event???

Resolution:

Question was NOT revised to address concerns stated above. Station was able to provide reasonable assurance that distractors C and 0 arc plausible. The Station also 9

ES-401 Written Examination Review Worksheet Form ES-401-9

l.

~.

3. Psychometric Flaws

14. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD Stem leues T/F Credo Partia ~ob - M inuti #1 Back-Q=

SRO (FIH) 1-5) Focus Dist.

Link a units ward KIA pnly B/M! U/E/S Explanation N

indicated that rad level will not increase due to the leakage based on previous plant experience.

71 H

1.5 pc Y

N S

Seems like a very easy question. Why not ask what A SLC pump tripped on??? Low suction pressure, Over current, Manually turned off.

12 F

I Y

N U S Seems like a very easy question. This is a straight forward power supply question. If you're going to ask a power supply question it needs to be integrated into the question. System integration i.e. power is lost to a bus and the Rx scrams, how does the plant respond?

Resolution:

Question was NOT revised to address concerns stated above. Station was able to clarify that this \\-vas not a simple power supply question because you need to deternline the impact on plant operation.

73 F

1.5 Y

~

S Seems like a very easy question. Close to question 72 above but better. It could still be a little more integrated.

74 H

2 pc Y

N E

Why is distractor 0 plausible??? A should be changed to search area after receiving a locked high rad briefing. D should also be changed to after receiving a locked high rad briefing.

Resolution:

Question was NO'r revised to address concerns stated above. The question \\-vas replaced because the station didn't want to make recommended changes. Tho;: new question was changed to replace "Incident Commander" with "Work Control Supervisor".

75 H

1.5 Y

B U S Are you really suppose to close F006A before you open F004A??? and then start the A RHR Pp. How did the A RHR Pp trip??? It doesn't seem like there is a correct answer provided for this question. It also seems like a very easy question.

Ro;:solution:

Question was NOT revised to address concerns stated above. This is the guidance provided by the procedure.

10

ES-401 Written Examination Review Worksheet Form ES-401-9 I.

2.

3. Psychometric Flaws

~. Job Content Flaws

5. Other

6.

7.

8.

Q# LOK LOD Stem Cues rr/F

~red. Partial Job-Minuti #1

~ ack-Q= SRO (FIH) (1-5) Focus Dist.

Link a units ~ard KIA Only 8 /MI U/E/S Explanation N

I 2

3

~

5 6

7 8

9 10 II 12 13 14 15 16 17 18 19 20 2 1 22 23 24 25 II

ES-401 Written Examination Review Worksheet Form ES-401-9

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD Stem ~ues T/F Credo Partial Job-

~v1inuti 1#1 Back-Q=

SRO (F/H) (1-5) Icocus Dist.

Link a

!Units ward KIA !only ~/MI U/E/S Explanation

~

Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1.

Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2.

Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3.

Check the appropriate box if a psychometric flaw is identified:

The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc).

The answer choices are a collection of unrelated true/false statements.

The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4.

Check the appropriate box if a job content error is identified:

The question is not linked to the job requirements (Le., the question has a valid KIA but, as written, is not operational in content).

The question requires the recall of knowledge that is too specific for the closed reference test mode (Le., it is not required to be known from memory).

The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirements.

5.

Check questions that are sampled for conformance with the approved KiA and those that are designated SRO-only (KiA and license level mismatches are unacceptable).

6.

Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.1.

7.

Based on the reviewer's judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

B.

At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).

BANK 45 (60%)

NEW 25 (33.3%)

MODIFIED 5 (6.7%)

Fundamental 37 (49.3%)

Higher 38 (50.7%)

Sat 22 Initially Unsat 26 Final number of Sat 40 Final number of Unsat 5 12

ES-401 Initially Enhance 26 Initially Indeterminate 1 Written Examination Review Worksheet Form ES-401*9 Final number of Enhancements 30 13

ES-401 Written Examination Review Worksheet Form ES-401*9 14

Operating Test Comments JPM Comments A1-RO Changed the time to be filled out on the operations MCR panel walkdown checks (online) data sheet from 00:00 to 02:00.

A2-RO On ESOMS Report of hours data sheet, we added information as to which position the RO held during each of his shifts. The applicants needed to know if the RO stood a credited watch position or was extra to determine if the RO got credit for the watch stood or not.

A3-RO No changes needed A4-RO No changes needed Sim/CRa Step 8.4.2.3 is not a critical step Sim/CRb No chanqes needed Sim/CRc No chanqes needed Sim/CRd Make the note at step 8.1.5.4 bold to highlight the fact that this step mayor may not be performed depending on whether the applicant uses the Hard Card.

Sim/CRe Need to change the sequence of the JPM steps to coincide with the procedure CPS 4001.02C001.

Sim/CRf Make the note at step 9 bold to highlight the fact that the following steps mayor may not be performed depending on whether the applicant uses the Emergency Stop Pushbutton or shuts down the DIG using the procedure. Change the Critical Step from opening the DG output bkr to Stopping the DG.

Sim/CRg Revised step 3 into two distinct actions instead of one action. Step 5 is not a critical step.

Sim/CRh Need to revise JPM to add steps to shutdown Continuous Containment Purge after it is determined that the UNFIL T Mode does not work.

IPi No changes needed IPj No changes needed IPk Will provide a new picture of what is inside the left panel on 11P07E.

Scenario Comments Scenario #1 Event #4 need to add a step for the SRO to direct disarming control rod 28-33 in accordance with TS 3.1.3 The critical task identified to enter EOP-8 is not a critical task.

The critical task identified to verify the Turbine and Generator trip is not a critical task.

Scenario #2 Event #3 change BOP actions to Start standby CCW pump only. Delete the or shutdown running FC pump and close 1 CC076A&B.

Event #5 delete BOP action #5 to transfer 4160V busses to RAT B because it is not necessary. System is already aligned to that way.

Event #8 The first critical task actions to insert control rods following the ATWS should be bolded to identify them as critical tasks.

Event #8 Need to add critical task actions to terminate and prevent RCIC injection during the ATWS.

Event #8 Need to delete RCIC and add Feedwater to the step to control RPV level. RCIC will be unavailable.

Spare Event #7 Need to change the critical task from entering EOP-8 to Scraming the Rx prior to Scenario exceeding Max Safe Temp.

Outline Comments No Comments made on Examination Outline I IPagc

Post-Exam Comments No post-examination comments were received from Clinton Power Station following the completion of this examination.