ML070240193

NRC Comments to the Written Examination, ES-401-9, for the Kewaunee Retake Examination - August 2006

ML070240193
Person / Time
Site:	Kewaunee
Issue date:	01/23/2007
From:	Mcneil D NRC/RGN-III/DRS/OLB
To:
Shared Package
ML062910302	List: ML070240185 ML070240193 ML070240208 ML070240219 ML070240230
References
ES-401-9
Download: ML070240193 (9)

Text

NRC COMMENTS TO THE WRITTEN EXAMINATION, ES-401-9, FOR THE KEWAUNEE RETAKE EXAMINATION=AUGUST2006

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (FIH) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #I Back- Q= SRO UIElS Explanation Focus Dist. Link units ward WA Only 1 H 2 X S Bank. (1 of 30 - checked WA) 2 H 2 X S New. (1 of 30 - checked WA) 3 H 2.5 X U New. (1 of 30 - checked WA) Question f WA. Modified question.

4 H 2.5 X S New. (1 of 30 - checked WA) 5 F 2.0 X S Bank (1 of 30 - checked WA) 6 H 2.0 X S New (1 of 30 - checked WA) 7 F 2.0 X S New (1 of 30 - checked WA) 8 F 2.0 X 6U - -

New (1 of 30 checked WA) Post exam comment delete.

17 At a minimum, explain any "U" ratings (e g , how the Appendix B psychometric attributes are not being met)

ES-401 2 F o ESdOl-9

~

1 2 3 Psychometric Flaws 4 Job Content Flaws 5 Other 6 7 Q# LOK LOD (FIH) (1-5) Stem Cues TIF Cred Partial Job- Minutia #/ Back- Q= SRO UlEIS Explanation Focus Dist Link units ward WA Only 9 H 20 X S New (1 of 30 - checked WA)

New (1 of 30 - checked WA) Answering this question requires an 10 H 25 X U applicant to have memorized the sequence of actions in the subsequent steps of a procedure, which is not required Modified question.

11 H 20 X S New (1 of 30 - checked WA)

New (1 of 30 - checked WA) Add a condition to the stem or initial plan 12 H 20 X E conditions that prevents the applicant from assuming the rupture disk has ruptured and a is correct Modified question 13 F 20 X S Bank (1 of 30 - checked WA) 14 F 20 X S Bank (1 of 30 -checked WA) 15 H 25 X S Bank (1 of 30 - checked WA) 16 H 25 X S Bank (1 of 30 - checked KIA) 17 F 20 X S Bank (1 of 30 - checked WA) 18 F 20 X S Bank (1 of 30 -checked WA) 19 F 20 X S New (1 of 30 - checked WA)

- ~ ~~~ ~

20 F 20 X S Bank (1 of 30 - checked WA) 21 H 20 X S Modified 22 F 20 X S New New Distractor a has core exit T/C Distractor c has CETs Modify to 23 H 20 X E look the same, or put (CETs) behind core exit TIC in distractor a Modified question.

24 H 20 X S Bank 25 H 25 X S New 26 H 25 X S Bank

1 2 3 Psychometric Flaws 4 Job Content Flaws 5 Other 6 7 LOK LOD ~

(F/H) (1-5) Stem Cues T/F Cred Partial Job- Minutia #I Back- Q= SRO U/E/S Explanation Focus Dist Link units ward K/A Only New Distractor a may also be correct, giving two correct answers to F 20 X U this question Modified stem to eliminate distractor a. as a COtreCt answer.

H 20 X S Bank Bank This material is not required to be memorized Sequence of F 25 X steps that are not immediate actions steps Modified stem.

H 25 X S Bank F 20 X S Bank F 20 X S New H 20 X S New F 20 X S New F 20 X S Bank H 20 X S Bank F 20 X S New New This answer would always be correct and would be expected of a F 10 X applicant with only minimal training Replaced question.

F 20 X S New F 20 X S Bank New Capitalize the names of the Rad Monitor alarms Rad monitor H 20 X E alarms capitalized.

H 20 X S New H 25 X S Bank H 20 X S New H 20 X S New H 25 X S New

-3. Psychometric-Flaws

- 4 Job Content Flaws 5 Other

6. I 7 Stem >red. Job- UlElS Explanation

'OCUS Dist.

New. Question is SRO Only, not for ROs. (ROs don't declare equipment INOP.) Question is not fundamental - higher skill - applicants don't have to have precautions and limitations memorized, but when 47 F U given one, they should be able to explain the precautionllimitation. The procedure declares the diesel generator inoperable, not the reactor operator. Rewrote the question to clarify and use the procedure step.

4a F 2.0 S New.

New. Not a higher skill question. Appears to be a memory/fundamental 49 H 2.0 tt S item. Question has a thought path to get to the correct answer.

Question is higher skill.

New. Not a higher skill. The question is a memory item from an RNO.

50 H 2.0 t)S Question has a thought path to get to the correct answer. Question is higher skill.

51 F 2.0 S New.

52 H 2.5 S New.

Modified. Question WA. The WA asks for knowledge of power f

supplies. The question asks which pump is started first on a given bus.

53 H 2.0 ttS The given loads have other power supplies. Also, the operators are required to memorize the load auto-sequencer. Question was

- - changed to satisfactory.

54 H 2.0

- - S New.

55 F 2.0 S New 56 F 2.5 S Bank.

Bank. LOD = 1. Question WA. The WA asks for effects, the question f

asks for equipment considerations. In order to correctly answer the 57 F 1.o ttS question, an operator must know the effects of the equipment bein!

used. Question changed to satisfactory.

11

2. I 3. Psychometric Flaws I 4. Job Content Flaws I 5. Other I 6. 7.

vlinutia #I Back- Q= SRO UIEIS Explanation Focus Dist. Link units ward KIA Only Bank. Distractors a. and b. are implausible, making the question an easy 1 out of 2. Even though it is an air leak, cooling the containment would reduce containment pressure making distractor 58 H

a. plausible. Distractor b. works the other way, but could be plausible to a less-than-competent operator. Question changed to satisfactory, Post exam comment 2 correct answers.

59 F Bank. I Bank. LOD = 1. GET knowledge, not license operator knowledge.

60 F Replaced question.

Bank No correct answer. An ROlSRO may be able to clear the tag.

61 F Revised stem. RO/SROs do not clear tags in non-emergency time.

Bank. The KIA states: Ability to manipulate the console controls as required to operate the facility between shutdown and designated power 62 H levels. The question has no control manipulations associated with it, but only use of indications. Replaced question.

63 H 64 F Bank. II 65 F Bank.

Bank. Not an RO question. SROs select the procedures. Replaced distractor a. with another procedure the ROs have to have entry 66 H conditions memorized. Changed the classification from Not an RO question to one unacceptable distractor.

67 H Bank. II 68 H Modified.

69 H New.

70 H New. I 71 H Bank.

Modified. Not an RO question SROs select the procedures. Replaced 72 H question.

- ~~

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

LOD (1-5)

I Stem Cues

- 'ocus Q=

KIA UlElS Explanation

-2.0

-X

- S New S Bank.

-2.0 X New. The KIA states: Ability to operate andlor monitor the following as they apply to the ( High Containment Radiation ): Operating behavior characteristics of the facility. The question asks about action to be take1 to control radiation, not monitoring or operating equipment. Doesn't 2.0 match the KJA. Because the WA was not clear, the station made a best-guess at writing an acceptable question rather than reject the WA. Since the question was acceptable as written and partially matched the WA, grading was changed to Satisfactory. Post exam comment delete question.

New. (1 of 30 - checked KIA) Change COLF to COLD in the stem. Not 2.0 X U

- - an SRO ONLY question. Question replaced. COLF corrected.

~~

H 2.5 X S New. (1 of 30 - checked KIA)

New. (1 of 30 - checked KJA) Add plant conditions to establish pre-ever conditions. I.E., the rod control system was in a normal 100% power H 2.5 X EU line-up. Added initial plant conditions. Post examination comment delete question.

New. (1 of 30 checked KIA) Does not appear to be an SRO ONLY question. ROs should be able to diagnose this condition. Although H 2.5 X tts ROs may be able to make the calculations, they are not required to do so. SROs are specifically required to be able to make these

-- - - calculations by procedure. Changed from U to S.

~

S New. (1 of 30 - checked KIA)

H 2.0 X Bank. (1 of 30 - checked KIA) Question is not SRO ONLY. Answer F 2.0 X U comes from a caution in N-RVC-186 which is not required to be

- memorized. Replaced question.

H 2.0 S Modified. (1 of 30 - checked WA)

- - X Bank (1 of 30 - checked KIA) Distractors b and c are not plausible Venting a ruptured SIG to atmosphere IS implausible Distractor b. is H 2.0 X HE plausible. Because the S/G is isolated, the ruptured S/G would nor be discharging to atmosphere. Replace distractor c. Changed question status from unsat to enhancement.

7.

Explanation New. (1 of 30 - checked WA) Explain why the correct answer is the only correct answer. Under the given conditions the other answers cannot be assumed to be correct as stated in the justification section provided with the question. Changed from U to S.

New. (1 of 30 checked WA) Question is not SRO ONLY. Answer comes from a subsequent action that is available to ROs. Changed question to require an operability determination.

New. Question is not SRO ONLY. This is system knowledge. SRO makes the determination of procedure and fill rate which comes from the EOPs and is not system knowledge. Changed to Sat.

New. Question is not SRO ONLY. Immediate actions are required to be memorized by ROs. Replaced question.

New.

New. Question is not SRO ONLY. Auxiliary operators and ROs should know the requirements to enter containment at power. Plant requires SROs to control access to containment. SRO only responsibility.

Modified. Question is not SRO ONLY. Question is LOD = 1 . Plant requires SRO control access to the control room. SRO responsibility. Replaced weak distractor. Changed from U to E.

~~ ~

New. Question is not SRO ONLY. Replaced question. Post examination comment question has two correct answers.

New.

New. Question is not SRO ONLY. Replaced question.

~

Bank. Question is not SRO ONLY. SROs are required to know this material, ROs are not required to know material. This is an SROjoi resDonsibilitv at the station not taught in GET.

New. Post examination comment delete question.

New.

New.

1 2 3 Psychometric Flaws 4 Job Content Flaws 5 Other 6 7 Q# LOK LOD (FIH) (1-5) Stem Cues TIF Cred Partial Job- Minutia #I Back- Q= SRO UIEIS Explanation Focus Dist Link units ward WA Only 98 F 20 x S New 99 H 20 x S New 100 H 20 x S Modified