ML091050228

CP-2009-03-Draft Written Exam Comments

ML091050228
Person / Time
Site:	Comanche Peak
Issue date:	04/03/2009
From:	Mckernon T Operations Branch I
To:	Blevins M Luminant Generation Co
References
50-445/09-301, 50-446/09-301 50-445/09-301, 50-446/09-301
Download: ML091050228 (7)

Text

ES-401 Written Examination Review Worksheet Form ES-401-9 CP-2009-03 Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 B 5 (easy B difficult) rating scale (questions in the 2 B 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

The answer choices are a collection of unrelated true/false statements.

The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7. Based on the reviewer=s judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any AU@ ratings (e.g., how the Appendix B psychometric attributes are not being met).

Page 1 of 7 OBDI 202 - IOLE Process

3. Psychometric Flaws

4. Job Content Flaws

5. Other Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only

6.

B/M/N

7.

U/E/S

8.

Explanation 1

H 3

B S

2 F

2 U

N U

No information in the stem is needed to answer this question except the phrase attached to the beginning of each answer.

3 F

2 B

S 4

F 3

N S

5 H

2 B

S 6

F 3

U B

U How does this tie to an ARP. This is simply asking the cooldown flowpath of the PRT.

7 H

3 N

S 8

F 2

N S

9 H

3 M

S

ES-401 2

Form ES-401-9 CP-2009-03 Page 2 of 7 OBDI 202 - IOLE Process

3. Psychometric Flaws

4. Job Content Flaws

5. Other Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only

6.

B/M/N

7.

U/E/S

8.

Explanation 10 H

3 M

S 11 H

3 M

S 12 H

2 B

S 13 H

3 M

S 14 H

3 N

S 15 H

3 B

S 16 F

2 B

S 17 H

3 B

S 18 F

2 B

S 19 H

3 B

S 20 F

3 B

S 21 F

3 U

B U

The design feature is a mechanical interlock according to the attached references.

Explain why D is correct and supports the KA.

22 H

2 B

S 23 H

2 N

S 24 F

2 B

S 25 H

3 U

U B

U Does the RO initiate permits and/or deal with the administrative requirements of a release? The applicable steps are deep within the procedure.

26 F

3 B

U References do not support the answer. The references state that the shell side should be isolated and drained. CCW is on the shell side?

27 H

3 U

M U

Need to provide a current pressure. Applicant could assume a higher pressure, and then C could be considered correct. Explain correct answer since references do not provide enough info.

28 F

2 U

N U

2 nd bullet after Which ONE of the following: does not flow syntactically. Does not address the KA.

29 F

2 N

S 30 H

2 N

S

ES-401 3

Form ES-401-9 CP-2009-03 Page 3 of 7 OBDI 202 - IOLE Process

3. Psychometric Flaws

4. Job Content Flaws

5. Other Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only

6.

B/M/N

7.

U/E/S

8.

Explanation 31 H

3 N

S 32 H

2 N

S 33 F

3 N

S 34 H

3 U

U N

U Recommend changing the correct answer to monitoring the plant computer thermocouple map as indicated in the procedure. This will tie better to the KA.

35 F

2 N

S 36 H

3 N

S 37 H

4 N

S 38 F

2 N

S 39 H

2 B

S 40 H

2 N

S 41 H

3 B

S 42 H

3 U

N U

D is also correct. The second sentence is a true statement.

43 H

3 B

E Explanation for A: What actions? See Markups.

44 H

2 B

E See markup 45 H

3 N

S 46 H

2 B

S 47 F

3 B

E See markup 48 H

2 N

S 49 H

2 B

S 50 H

2 B

S 51 H

3 B

S 52 H

2 B

S 53 H

3 B

E Procedure E0.0 foldout states level >43%NR. Change stem or explain.

54 H

2 B

S

ES-401 4

Form ES-401-9 CP-2009-03 Page 4 of 7 OBDI 202 - IOLE Process

3. Psychometric Flaws

4. Job Content Flaws

5. Other Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only

6.

B/M/N

7.

U/E/S

8.

Explanation 55 F

2 U

N U

KA mismatch 56 H

3 N

E See markup 57 H

2 N

S 58 F

2 B

S 59 H

3 U

N U

This question sets up a condition where operators have violated procedure. The caution statement says pressure SHALL be maintained below 400psig. The heatup 12 degress above the required transition point may be too excessive. See markup for minor editorial comment.

60 H

4 N

S 61 F

3 B

S 62 H

3 B

S 63 F

3 B

E See markup. This is a fundamental question.

64 F

3 B

S 65 H

2 B

E See markup.

66 H

2 B

E See markup.

67 F

2 B

S 68 H

2 B

S 69 F

3 U

B U

SRO question, since the question has the applicant apply tech spec actions and motherhood statements without reference.

70 F

2 B

E See markup.

71 F

2 B

E See markup.

72 F

2 N

U Explain. STA-620 states that the detectors should be tagged out of service. No mention of storage.

73 F

2 B

S 74 F

2 B

S 75 H

3 B

S 76 H

2 N

S

ES-401 5

Form ES-401-9 CP-2009-03 Page 5 of 7 OBDI 202 - IOLE Process

3. Psychometric Flaws

4. Job Content Flaws

5. Other Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only

6.

B/M/N

7.

U/E/S

8.

Explanation 77 H

3 N

S 78 H

3 U

N U

See markup. KA mismatch.

79 H

3 B

S 80 H

3 N

E See markup.

81 F

2 B

S 82 H

3 U

N U

KA mismatch. Going to mode 3 is condition C, normal plant shutdown - mode 3 in 6 hours6.944444e-5 days <br />0.00167 hours <br />9.920635e-6 weeks <br />2.283e-6 months <br />. No tie to EOP. >1hr tech spec with no reference provided.

83 H

3 N

U What were the conditions that led up to the current conditions? Is this the middle of a normal plant cooldown? What procedure is the crew operating in?

84 H

3 B

S 85 H

3 N

E See markup.

86 H

3 N

E CSFST reference is from unit 2. (Similar to Q93 and 94 FRZ-0.1) 87 F

2 N

S 88 H

2 N

S 89 H

2 N

S 90 H

3 N

S 91 H

3 U

N U

RO question. All of the answers have the same procedure, and the applicant is not selecting the appropriate procedure IAW 55.43. The TS srvl time requirement in the correct answer comes from the P&L section of a procedure.

92 H

3 N

UE See editorial comments on 401-5 93 H

3 B

UE Question is similar (ie. CONTAINMENT CSF FRZ-0.1) to Q86.

94 H

2 N

UE Question is similar to 93 and 86 (FRZ-0.1 again) 95 H

2 M

S 96 F

2 B

S 97 F

2 N

S 98 H

2 E

B E

The correct answer is the only one that has a one hour time requirement. If the applicant knows to memorize 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> requirements, then this is a que.

ES-401 6

Form ES-401-9 CP-2009-03 Page 6 of 7 OBDI 202 - IOLE Process

3. Psychometric Flaws

4. Job Content Flaws

5. Other Q#

1.

LOK (F/H)

2.

LOD (1-5)

Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

1. /

units Back-ward Q=

K/A SRO Only

6.

B/M/N

7.

U/E/S

8.

Explanation 99 F

2 N

S 100 F

2 N

S B=

F= 29 / 39%

E=

M=

H= 46 / 61%

U=

RO TOTALS:

N=

Additional Notes:

B=

F=

E=

M=

H=

U=

SRO TOTALS:

N=

Additional Notes:

GENERAL COMMENT

S:

1. Bank questions are indicated by B; Modified are indicated by M; New questions are indicated by N.

2.

Chief Examiner comments are indicated in blue.

3.

Average difficulty is __ ___ on the RO exam and ___ on the SRO exam.

4.

The 10CFR55.41/43 distribution is: RO / SRO 41.1 =

43.1 =

41.2 =

43.2 =

41.3 =

43.3 =

41.4 =

43.4 =

41.5 =

43.5 =

41.6 =

43.6 =

41.7 =

43.7 =

41.8 =

41.9 =

41.10 =

41.11 =

41.12 =

41.13 =

41.14 =

5.

The answer distribution is: RO / SRO A = 13 (17%)

/

6 (24%)

B = 16 (22%)

/

7 (28%)

C = 21 (28%)

/

5 (20%)

ES-401 7

Form ES-401-9 CP-2009-03 Page 7 of 7 OBDI 202 - IOLE Process D = 25 (33%)

/

7 (28%)

6.

There are questions with attachments provided.