ML052220533

Written Examination Review Worksheet, ES-401-9 (Folder 2)

ML052220533
Person / Time
Site:	Nine Mile Point
Issue date:	06/22/2005
From:	Barr S, Suzanne Dennis Operations Branch I
To:	Shortell T Constellation Energy Group
Conte R
References
50-220/05-302
Download: ML052220533 (20)

Text

ES-401 NMPl Written Retake Examination June 2005 Form ES-401-9

~~

Written Examination Review Worksheet NOTE : 1. BOLD & Italics reflect resolution of comments

2. Reviewed by S. Barr and S. Dennis 7.

3. Psychometric Flaws 9

%US Explanation 1 the stem phrase "blind controller failure" a commonly understood irase? t I ? C SRC$ I{

1 4-v +I+ crk

• I F 2 I

F 15 luestion asks the extent of the DC power loss. Distractors C and D tate NO power loss. Need to rephrase question. Also, this is a very low

,vel of difficulty question.

H 2 F 2 Disagree with LOK=H, should be F 1 H 2  !

H 3 Need to verify references provided were insufficient. 'dJ F 2 need to specify procedure which designates 'major" loads Inquestion stem H 2 Based on references provided it appears there is NO correct answer F 2

B a

W I"

3. Psychometric Flaws I 4. Job Content Flaws 5. Other 7.

Explanation Dist. Link Add to stem required per EOPs (or procedure..)

L J

2 jistractor A - grammar check,,J ,;If f->v mswer D Ensure operation... Operation of What?

(/A mismatch -

WA mismatch - this question applicable to 295031 EK1.01 not the WA H

2 referenced for the question - - 7, H 3 X o reference material was that distractors B and C are torcrc.1 c 4 ~

H 2 Question stem focus in regard to Rx power is not clear. Need to change tense of initial sentence to ..The plant was operating at 100% power...

If a fuel failure occurred, why wouldnt the reactor be scrammed from thi

-- answer d

secondary containment isolation signal. There appears to be no correct

-hyo f u q b , i H 2 S F

-2 -

WA Mismatch - should be 295002 AA1.03 or 1.06 not AA2.01

N I

In N

L& 1 i. Psychometric Flaws (1-5) Stem Cues

4. Job Content Flaws Ainutia I 5. Other 7.

Explanation Focus 2

3 3 S 2 SIE This was classified as a modified question, however, the change to the question was minimal. Should be considered a bank question J\.,, do 2 S I 3 S

-II 0

9 T3c m

r-c V

m 5

E k sd3 Y

0

-0 V

.-z

'0 a

n c

0 X

X cu IN b LL N

I I- lr CY

.-0) 0 0

-I v)

E Y

9 0

m m

X X

N m

~

I I I (D PI Q) m 0 0 I

w Iu)

N I

I' I"

-a 9

\ U I c II 0

C Y

3 P U

0) C n m 0

3 0

3 6 0 e

c V

c E

a B

v)

Cdg W 3

X I

N I" I" E;

3. Psychometric Flaws

4. Job Content Flaws

-I

5. Other 6. I 7.

red. 3ack-  ;RO u/E/s Explanation

- - My S

H E Sequenec of actions in correct answer do not appear to exactly m tch 3

those in the reference provided. 2 H 2 E Does "backup" for compressor #12 mean the same as Position #2 as noted in your reference? Clarify.

3 H

2 I s 1 F 1 I ,dI LOD=l. Correct Answer stands out among selections H 1.5 I I E Stem statement is cluttered. Restate. Easy question once you decifer the stem.

I I

X Y

I a,

v)

C 0

a (0

2 a,

73 c

._0, v)

\a, 3

C cE c

0 v) m C r; c ._0 m c e

W u) 3 0,

U

.-C C

.-c 0

.-0 73

?

a c

0 2

a, 0

-m a

0,

[r

C c

0 ai C

-Q Q.

X W

X I I m cu I

m lr In I

(D (D

L& 1Fmusi.Psychometric Flaws 7-51 Stem Cues 4.Job Content Flaws Ainutia

5. Other 7.

Explanation 69 H 2 In accordance with what procedure? J 70 F 2 E In accordance with what procedure?

71 H 2 E Reference shows 2 correct answers C and D. Which one is it?

72 F 2 Need to review more references to ensure that the other alarms would not justify stopping the discharge.

-J\

J 73 F 1

- X u,.: LOD=1, distractors not credible IAW d d pc' 74 F 2 E enhance stem. The # of fb members listed may be a minimum but their could be more. \F ' c d i ' un'f-b t < s d J i?.

1

3. Psychometric Flaws

- 4. Job Content Flaws

- 5. Other I 6. I 7.

>red.

-Dist.

iq-7 units 3ack-I

RO u/E/s Explanation Instructions Refer to Section D of ES-401and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. - - -

Enter the level of difficulty (LOD) of each question using a 1 5 (easy difficult) rating scale (questions in the 2 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc).

The answer choices are a collection of unrelated true/false statements.

One or more thm-medistractors is not credible.

One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

The question Is not linked to the job requirements (Le., the question has a valid WA but, as written, is.not operational in content).

The question requires the recall of knowledge that IS too specific for the closed reference test mode (i.e., it is not required to be known from memory).

The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirements.

5. Check questions that are samDled for conformance with the approved WA and those that are desianated SRO-only (WA and license level mismatches are unacceptable).

6. Based on the reviewer's judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

7. At a minimum, explain any "U"ratings (e.g., how the Appendix B psychometric attributes are not being met).

NUREG-1021, Draft Revision 9

EXAMINATION A N S M B KEY .a%'.*

UNIT 1 REACTOR OPERATOR 2005 EXAM A plant startup and heatup are in progress, with the following:

0 IRM channel 11 is reading 86/125 on range 7 e REFUEL INST TRIP BYPASS 11 switch in COINCIDENT e REFUEL INST TRIP BYPASS 12 switch in COINCIDENT e The operator down ranges IRM 11 to range 6 Which one of A.

B. Only a rod block C. Rod block and only a half scram D. Rod block and full reactor scram Answer: C Associated objective(s):

Development Area (FIO)

OPS-UNIT1 Page: 113 of 236 06/22/05

EXA KE The plant is operating at power, with the following:

e Shift Manager has declared an UNUSUAL EVENT due to Seismic Event 0 The extra Reactor Operator normally assigned to the WEC is dispatched to the Reactor Building to perform damage control actions 0 While in the Reactor Building, a station announcement is made upgrading the event to an ALERT Which one of the following actions is Damage Control?

A. Immediately report to the WEC and wait to be assigned to a repair team B. Immediately report to the OSC and wait to be assigned to a repair team C. Contact the Shift Manager from the Reactor Building for directions D. Contact the OSC Coordinator from the Reactor Building for directions Answer: C Associated objective(s):

Development Area (FIO)

OPS-UNIT1 Page: 234 of 236 06/22/05

EXAMgNATION ANSWER KEY

&kr 1 REACTOR OPERATOR dkk E l k M The plant is at 100% power when an event occurs, with the following conditions:

e Reactor Water Cleanup (RWCU) System is in service e Power Board 16B is de-energized All running RBCLC pumps trip Which one of the following describes the impact on RWCU?

A. RWCU pumps trip and the system isolates, BV-33-02R, CU SUPPLY ISOLATION VALVE 11 (INSIDE) fails to close B. Remains running, Manual RWCU isolation required, BV-33-01R, CU RETURN ISOLATION VALVE 1 (INSIDE) fails to close C. RWCU pumps trip and the system isolates, BV-33-01R, CU RETURN ISOLATION VALVE 1 (INSIDE) fails to close D. Remains running, manual RWCS isolation required, BV-33-02R, CU SUPPLY ISOLATION VALVE 11 (INSIDE) fails to close Answer: A Associated objective(s):

Development Area (FIO)

EXAMtNATIONANSWER KEY UNIT 1 REACTOR OPERATOR &05 EXAM Question Type: Multiple Choice Topic: RETAKE RO 56 System ID: 21380 User ID:

Status: Active Must Appear: No Difficulty: 0.00 Time to Complete: 0 Point Value: 1.oo Cross

Reference:

User Text:

User Number 1: 0.00 User Number 2: 0.00 Comment: 0 1-0PS-001-204-1-01, EO-1.5b Answer: A: is correct - Loss of the RBCLC pumps and flow will cause NRHX outlet temperature to exceed 140°F immediately, which results in an automatic isolation signal for RWCU.

The pumps are interlocked with the IV such that the pumps will trip when the system isolates. Loss of power on PB16B(161B) prevents closure of BV 33-02R.

Distractor: B: is not correct - Auto isolation signal is received as explained above. BV-33-01R is powered from PB178(171B) and will close when the isolation signal is received.

Distractor: C: is not correct - BV-33-01R will close upon receipt of the auto isolation signal because it is powered from PB17B( 171B).

Distractor: D: is not correct - An automatic system isolation is received as explained in A above.

REFERENCE:

N1-OP-3 RWCU Pages 8 and 207 REFERENCES PROVIDED TO THE CANDIDATE:

NONE OPS-UNIT1 Page: 176 of 236 06/22/05

MINATIONI.ANSWER KEY UN~T1 REAOTOR O P E ~ T O R 2005 EXAM Coqnitive Level

- 2

-DRW

- C-19437-C Rev. NA

- C-198594 Rev. NA NUREG 1123 KA Cataloa Rev. 2

- 204oOO A3.03 3.W3.6 Response to system isolations Level of Difficulty

- Level 2: System operation and response LP

- 01-0PS-00 t -204-1-01Rev. na Question Source

- New PROC

_ I_

- N1-OP-3 Rev. NA

- N1-SOP-11.1, Rev. NA Question Settinq

- C1 (Licenseclass closed reference)

OPS-UNIT1 Page: 177 of 236 06/22/05