ML042190023

NRC Comments (Written)

ML042190023
Person / Time
Site:	Millstone
Issue date:	07/19/2004
From:	Caruso J NRC/RGN-I/DRS/OSB
To:	Conte R NRC/RGN-I/DRS/OSB
Conte R
References
50-423/04-301 50-423/04-301
Download: ML042190023 (26)

Text

Summary of Written Exam Changes on # Description of Change Eliminated distractor A (SIS without CIA not plausible). Added new distractor C.

Changed stem since pressure rapidly decreasing on instrument-tap vapor space break is not possible. Removed rapidly, and placed level control in manual, to prevent control system response from making two possible correct answers. Added the word trend to the distractors, and offscale high/low to the indications with the lost instrument tap.

Corrected typo on KIA. Changed to AA1.

Redrew WA. Changed new question to test interlocks for 3RHS*MV8701A,rather than the cold leg injection valve, which only required the power lockout switch to be operated. Included new references.

41

- Changed stem to state that the RCS rapidly depressurized to CTMT pressure.

44 Eliminated distractor C, and added a new longer distractor D, which adds valves that are checked on the FWI check in E-0, but close on the AFW pump start signal. This prevented the longest answer from being the

- correct answer.

J 46 Re-drew KA statement from same K5 category, to prevent going <2 topics in K5. New exam question is

- from the bank. Included new references.

48 Clarified stem, removing the word all. Changed power source for bus 34D from EDG to RSST in the stem based on final validation comment, since the RSST would energize the bus, not the EDG.

J -53 Re-drew KA. Wrote new question and included new references.

J 55 58 Re-drew KA. Wrote new question and included new references.

2 distractors showing 0°F subcooling during superheat conditions were not plausible. Changed question to add failed CETCs reading 5000°F, and changed distractors to test if failed CETCs are automatically or manually

- removed from scan.

64 Redrew KIA based on over-sample of Plant Air Systems. Redrew and rejected KA on CRDM temDeratures J prior to startup, based on validation minutia comment. New exam question is fiom the bank. Included new

- references.

65 Clarified stem wording and changed one distractor to have all actions taken fiom the control room at the Color Graphics unit. Changed distractors based on validation comment that deluge valves are not directly monitored at color graphics unit, but upstream manual valves are monitored. Color Graphics unit would confirm deluge

- valve opened by sensing water flow.

66

- Shortened stem to remove queuing.

68 Replaced old question reading a cooldown curve. New question requiring reading Shutdown Margin Curves.

Involves more than one curve on more than one page, and knowledge of interpolation rules. Included new

- references.

69 Distractor A changed based on validation comment. Plant has required a temporary modification tag in the past when using heaters to maintain safety related room temperature. Changed distractor to ensure there is not

- two correct answers.

73

- New question. Included new references.

74 Changed distractor A to avoid a possible queue. Distractor now deals with Pzr heaters rather than letdown, since restoring letdown during a loss of air is the correct answer in a previous question. Lengthened D to

- match length of A.

76

- Provided table to candidates, and lowered SG pressure so Caution does not apply.

77

- Changed which.. . actions should be taken.. . to which.. . actions are required.

78

- Removed procedure title from stem and replaced with appropriate contingency action procedure 79

- Changed implausible distractor B to new distractor, with wrong subcooling value.

80

- Provided RWST level, and changed PORV cycling rate to match KA, requiring entry into ECA-1.1.

81

- Changed PZR level to 64% to make distractor Bclearly wrong. Corrected typo.

82

- Corrected typo in references. 4.03 is now 4.04 86

- Removed reference to orange path in stem, and changed should to required in question.

J 92 94 New question (modified from the bank) due to old question not being SRO level. Included new references.

Removed distractor A since it was not plausible. Added new distractor D, which tests foldout page criteria.

97

- Changed condition in stem due to overlap with Simulator JPM.

98

- Reworded distractor C to have two yes distractors, and two no distractors.

99

- Corrected typo on KIA number. Changed to GEN.2.4.36 J 100

- Question was replaced with a new question, since the question was too easy. Included new references.

Page 1 of 1

ES-401 Millstone Point #3 Written Examination 7/04 Form ES-401-9 Review Worksheet NOTE I ; BOLD & Italics reflect resolution of comments

-3. Psychometric- Flaws 4. Job Content Flaws 5. Other I

I 6. I 7.

Stem :red. Q= ;Ro UIEIS Explanation

-0cus -

Dist.

WA M y X Y N E A really is not a credible distractor with High containment pressure.

- Revised distractors eliminated A and added new distractor C.

H 3 X Y N U Wiith a 3/4line break it is not credible that the pressurizer pressure decrease will affect both Lts

--- Revised stern and distractors H 3 Y H 3 Y H 3 Y N S Need to confirm answer with references not provide1 with question Used P&ID in lesson plan to confirm operation of

-- FCV-IIIA, I I I B and IIOA.

H 2 Y H 2 Y H 3 Y H 2 Y

I f

I

cn z Iz Z I

8

("2 0)

Z Z

r; r

. 'Of Jk 8

C 0

m K

-m Q

X W

v)

Z z m rn I r 8 0 m

3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

lob- 3ack- JlElS Explanation

.ink 34 35 36 3 Question meets first part of K/A which is arguably the most difficult, therefore WA match sat.

37 2 S Need to confirm answer with references not providec with question Confirmed the 45% setpoint for P-9 on page 25 of RPS lesson plan

3. Psychometric Flaws 4. Job Content Flaws 5. Other I 6. 7.

Stem Explanation

-0cus 3

2 Y Need to confirm answer with references not providec with question Confirmed on page 17 of CVS lesson plan that one supply and two exhaust fans are run when containment access is open.

2 X Y The stem needs to be tightened since "D" could be partially correct with the current stem wording.

Revised Stem

- 3. Psychometric Flaws

4. Job Content Flaws

5. Other 7.

Stem :red. Explanation

-0cus

-Dist.

F 2 S F 3 U " D -the longest answer is correct answer.

Distractors are not balanced. Made "C" the correc answer and revised "D".

F 2 S Need to confirm answer with references not provide(

with question Found information in OP 3203, step 4.3.49.

2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 7.

LOD (1-5) Stem :red. Explanation

-- -0CUE Dist.

1-2 Much too basic for an RO license exam. GFE level basic physics . Redrew WA and replaced question 3 Need to confirm answer with references not provide(

with question Confirmed 70% set-point on page 19 of 6.9 KV lesson plan 2 Electrical power supply question okay in limited numbers? Also is the word "all" necessary in the stem - seems awkward. Revised stem 2 S

U I I S

.-0 4-m 8

-m P

x W

Z Z I I m

IN r I LL LL I

0 ln Is; I2 s:

0 0

c c

0 m

c

-m Q

X W

v>

Z Z Iz Iz I

N L LL L r

C

.-0 e

m r-: -

C m

0.

X W

z z I Z I Z X

hl m IN r

. O* g

-Jb I I I I 03 cn 0 Y In In (0 (0

f c

0 m

f

-m 0.

X W

cn cn I1 W I

Z Z IZ z

> > >. I m m LL LL IL LL m

a W

c c

0 m

r-: -

c m

a I3 I

W Z

X X LL CD CD

3. Psychometric Flaws 4. Job Content Flaws 5. Other I 6. I 7 Explanation N S N S Shouldn't answer "D"be 24,800 since the exposure for the current year is already 200 mrem?

Determined okay as-is based on procedure guidance. Also this is a GET question and is acceptable in limited numbers since meets the WA.

N U Question is on controlling control room personnel exposure, not on controlling radiation release.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 7.

LOK LOD -

FIH) 11-5) Cred. Explanation

- - -Dist.

H 3 H 3 X 1) Cuing in the stem by mentioning step 27 and the wording of the stem you are leading the applicant I' Control RCS Pressure and Charging Flow to minimize RCS-to-Secondary Leakage". Modify stem wording, "Per E-3, what idare the required action(s) to be taken". 2) "A" is the answer choice with a 2 part answer and therefore it stands out and is leading. One of the distractors should be modified to include 2 parts. 3) "C"is not a plausible distract0 given a release in-progress and RCS pressure is already higher than S/Gpressure. Note: Questior fits 55.43(b)(5). Revised question and provided reference applicants must now interpret and apply table.

H 3 X "should" in stem based on EOP as opposed to required actions? Revised stern to which actions are required.

I. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 7.

LOK (1-5) Stem Cues T/F Cred. Explanation

[F/H)

Focus Dist. Link H 3 Y Y Modify last plant condition listed in the stem to deletc procedure title, this is leading and should be unnecessary.

H 3 X Y Y " B distractor is not credible since in the natural circ procedure an RCP would not be started. Revised distractor.

H 3 N Y Modified question is not directed at loss of emergency coolant recirculation. In order to make "C" plausible the level in the RWST should probably be provided at some point above the swap over point. Revised question to add RWST level and revised stern conditions to correctly apply WA.

H 3 X Y Y 1) With PZR level at 65% It appears that PZR level maybe out of band with temp. at 585F and this is a more restrictive spec that would make "B" correct - ii appears to be right on the line when evaluating the graph. 2) Spelling error in stem "Pressurizer" Revised PZR level and corrected typo.

r-:

" I" 0 I

t I t t i t >-

i i

3. Psychometric Flaws I 4. Job Content Flaws 5. Other 6. 7.

JlElS Explanation 90 H Y Y S 91 F 3 Y Y S

- - I 92 F 2 Y N U I)Does not meet 55.43(b)(5), no selection of procedure required, 2) RO level set point question regarding H/U limits during S/U, 3) "A" distractor does not appear to be credible at this temp. basic simple knowledge. Replaced question with SRO level.

93 H 3 Y Y S

c c

0 m

r-: -

c m

a d

+

0 c

v) 1-c b

0 c

2

.-v)

U a

I w cn cn 2 @-

u1 t t t

X I LL LL 8 In rn IS

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK (FIH) (1-5) Stem Cues TIF Cred. Partial Job- Minutia #/ Back- Q= SRO UlElS Explanation Focus Dist. Link units ward WA Only Instructions

Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

I. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are x c e ptable).

NUREG-I 021, Draft Revision 9