ML12298A500

NRC Comments on Draft Licensee-Developed Exam (Written) (Folder 2)

ML12298A500
Person / Time
Site:	Beaver Valley (DPR-028)
Issue date:	09/14/2012
From:	David Silk Operations Branch I
To:	Rudolph W FirstEnergy Nuclear Operating Co
Jackson D
Shared Package
ML12136A033	List: ML12142A240 ML12263A060 ML12298A500 ML12299A089 ML12299A110 ML12299A182 ML12299A202 ML12299A226 ML12299A229 ML12299A276 ML12299A280 ML12307A237 ML12314A266
References
TAC U01850
Download: ML12298A500 (6)

Text

ES-401 BEAVER VALLEY UNIT 2 Written Examination Review Worksheet Form ES*401*9 Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus 1

H 2

2 H

2 X

3 F

2 4

H 3

5 H

3 X

6 H

2 X

7 H

2 8

F 1

X

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO 8/MIN utE/S Explanation Dist.

Link units ward KIA Only B

S NOTE: Change DROPPING to LOWERING thru out exam M

E Delete LHSI from B for parallelism B

S N

S N

E Replace "Mode 5" with RCS press &temp. Add AOP2.10.1 to 8 B

E Add PORV response as 3m response.

N S

N U

Re-write I restructure Q to increase discriminatory value Instructions

[Refer to Section 0 of ES-401 and Appendix B for additional information regarding each of the following concepts.}

1.

Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2.

Enter the level of difficulty (LOD) of each question using a 1 5 (easy difficult) rating scale (questions in the 2 - 4 range are acceptable).

3.

Check the appropriate box if a psychometric flaw is identified:

The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc).

The answer choices are a collection of unrelated true/false statements.

The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4.

Check the appropriate box if a job content error is identified:

The question is not linked to the job requirements (I.e., the question has a valid KIA but, as written, is not operational in content).

The question requires the recall of knowledge that is too specific for the closed reference test mode (I.e., it is not required to be known from memory).

The question contains data with an unrealistic level of accuracy or inconsistent units (e.g.* panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirements.

5.

Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable).

6.

Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7.

Based on the reviewer's judgment. is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement. or (S)atisfactory?

8.

At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).

ES*401 2

Form ES-401-9

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q=

SRO B/M/N utE/S Explanation Focus Dis!.

Link units ward KIA Only 9

H 2

X N

E Replace 1. To increase discriminatory value 10 H

2 N

S 11 H

2 N

S 12 H

3 N

13 H

3 X

N E

Delete "is acknowledged" from 1st circled bullet 14 F

2 C

N E

Replace C with ASDV 15 H

3 N

S 16 F

2 D

N E

Replace D with aux building sump level decreasing. Highlight lAW.

17 H

2 B

S 18 H

3 X

B E

Change RWST level to 29 inches.

19 F

3 N

S 20 F

2 X

N U

KIA is vague. Reselect KIA 21 F

2 A

B E

Make distractor A Halon only.

22 F

3 N

S 23 F

3 A

N E

Modify A 24 F

2 X

N U

Provide RCP status in stem and modify A&C 25 F

2 D

B E

Replace D (PZR) with PZR surge line welds.

26 H

2 X

N E

Provide breaker position vs stating LOOP. Make C/D rate 20 F/hr.

27 H

2 B

S 28 H

3 N

S

ES-401 3

Form ES-401-9

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. /

Back-Q=

SRO B/M/N utE/S Explanation Focus Dist.

Link units ward KIA Only 29 H

3 X

N E

Specify that both units trip.

30 H

2 N

S 31 H

3 X

N E

Provide multiple figures to avoid DLU. Delete 3m part.

32 H

3 X

D N

U De!ete uf\\w~ode 4." S! actuation could make 0 correct.

33 F

3 N

S 34 H

2 N

S 35 H

1 N

U Tests same concept as Q3 - replace.

36 H

2 C

N E

Change C to have B/U heaters OFF.

37 H

2 N

S 38 H

3 B

S 39 H

3 N

S 40 F

1 N

U Restructure to make more discriminating 41 F

2 X

N E

Remove "ADMINISTRATIVE" from stem.

42 H

3 X

B E

Need to state "NSA" wrt header alignment?

43 F

2 B

B E

Change B to Less AFW flow.

44 H

2 B

S 45 F

2 A,B,D B

U Why plausible for grid voltage to rise? Replace/restructure 46 H

3 X

N E

Change stem to imply NI-41 is still energized.

47 H

3 N

S

,118 F

3 N

S

ES-401 4

Form ES-401-9

1. I 2. I

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

00 I LOK LOD (F/H) (1-5) IStem Cues T/F Credo Partial Job-Minutia

1. I Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 49 I H

I 2

I A.S S

E Plausible to think EDG would trip? Add non emergency EDG trip.

50 H

I E Replace A 3 I I I I A I I I I I I I I N I

I I

I I

I I

I I

I I

I 3

I 51 H

52 H

2 53 F

2 N

S 54 H

1 N

U INo CIS needed. Make applicant consider Phase AlB actuation.

55 I F

I 2 I X I I

I A

I I

I I

I I

I I

N E IChange distractor A and modify D S

I 56 F

2 N

57 F

3 N

S 58 F

2 X

N E

Channel vs channels. Delete "for control and protection" in D.

59 J H I 2 I I I I I

I I I I I I I B I s 60 I H I 3 I I I I D I I I I I I I I N I E Modify D to parallel choice A.

S X I I

I I

I I

I I

I I

I N

I E

Make separate bullet for "defeated". Add impact on fuel movement.

X I

I N

I E

I Remove 3mbullet.

X x

t Filenet is available &replace two days with week in D.

X N

E IAdd the directing of operators to disctractors NUl Choose from among systems how to verify alarms. Modify Q.

ES-401 5

Form ES-401-9

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

7.

8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. /

6ack Q=

SRO 6/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 69 H

2 X

N U

Track TS vs entering TS. Re-writel replace Q.

70 H

2 N

S 71 F

2 N

S 72 F

1 X

B U

Replace with emergency dose kno\\\\4edge 73 F

3 N

S 74 H

3 N

S 75 F

2 A,C N

U Conditions in A&C degrade plant therefore not plausible. Replace.

76 H

4 N

S 77 H

3 X

N E

Typo in first sentence add "occurred" 78 H

2 X

N E

Add "as soon as" to 6&D.

79 H

3 X

N E

Remove "Mode 3" and provide RCS P&T.

80 H

3 N

S 81 H

3 N

S 82 H

2 X

N U

Answerable by systems knowledge and AOP purpose. Modify Q.

83 H

2 X

N E

Add PSMS & DRMS to bullets as appropriate.

84 H

2 X

N E

SG pressure should be higher.

85 H

4 X

N E

Delete 0 phrases and last part of question 86 H

3 X

N E

Provide press & temp vs "Mode 4.

ES-401 6

Form ES-401-9

1.

2.

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

8.

7. I 00 I LOK LOD (F/H)

(1-5)

Stem Cues T/F Credo Partial Job-Minutia

1. 1 Back-Q= SRO B/M/N UtE/S Explanation Focus Dist.

Link units ward KIA Only 2

N S

"I H ;

88 H

2 X

N E 1Do, mode ""'9' wdh ri,k,,,,,,moot "'''Y.

89 I H I 2

X B,D N

E I Replace dilution with loss of FW heater. Add "lAW.." to A&B.

I S

I 90 I H 2

N I H 2

N S

F 2

D B

E o not plausible.

H N

S I 3 94 I H I 3 X

N E

6 & 7 too close therefore one is wrong. C contains only 6.

N S

96 I H I 2 X

N E

Clarify which manager in B&C.

97 F

2 N

S 98 H

2 N

S N

S U

3rd EP Q and 4th fuel handling Q - Re-select & replace 95 I H I 2