ML13169A288

2013 Byron Nuclear Station Initial License Examination Form ES-401-9

ML13169A288
Person / Time
Site:	Byron
Issue date:	04/29/2013
From:	Mcneil D Operations Branch III
To:	Exelon Generation Co
References
50-454/13-301, 50-455/13-301
Download: ML13169A288 (5)

Text

ES-401 Written Examination Review Worksheet Form ES-401-9

1. questions reviewed in depth.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 1 H 2.0 B S 2 F 2.0 N S 3 F 2.0 N S 4 H 2.0 N S 5 H 2.0 N E 3rd bullet - change tense of actuates to actuated Change made.

6 H 2.0 N S 7 H 2.0 N S 8 H 2.0 N S Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

• The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

• The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

• The answer choices are a collection of unrelated true/false statements.

• The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

• One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

• The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

• The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

• The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

• The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).

ES-401 2 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 9 H 2.0 N S 10 H 2.5 N S 11 H 2.5 B S 12 H 2.5 N S 13 F 2.0 B S 14# H 2.0 N S 15 F 2.0 N E Specify what CS (loops, trains, etc) Material added.

16# H 2.0 B S 17 H 2.0 N S 18 H 2.0 B S 19# H 2.0 N S 20 H 2.0 B S 21 F 2.0 N S 22# H 2.0 N S 23 H 2.5 N S 24 F 2.5 B S 25# H 2..0 N S 26 H 2.0 B S 27 H 2.0 N S 28# H 2.0 B S 29 F 2.0 N S 30 H 2.0 B S 31# H 2.0 N S 32 H 2.0 N S

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 33 H 2.0 N S 34# H 2.0 N S 35 H 2.0 N S 36 H 2.0 N S 37# F 2.0 B S 38 F 2.5 B S Probably should be higher cog. Analysis is required. Agreed.

39 F 2.0 N S 40# H 2.0 N S 41 F 2.0 N S Probably should be higher cog - Analysis is required. Agreed 42 H 2.5 B S 43# H 2.5 B S 44 F 2.0 N S 45 F 2.0 B S 46# F 2.0 N S probably should be higher cog - Analysis is required Agreed 47 H 2.0 N S 48 F 2.0 B S 49# F 2.0 N S 50 F 2.0 N S 51 F 2.0 N S 52# H 2.0 N S 53 H 2.0 B S 54 F 2.0 B S 55# F 2.0 B S 56 H 2.0 N S 57 F 2.0 B S 58# F 2.0 B S

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 59 F 2.0 V S 60 F 2.0 N S 61# H 2.0 B S 62 F 2.0 B S 63 F 2.0 N S 64# F 2.0 N S 65 H 2.0 N S 66 F 2.0 B S 67 F 2.0 N S 68 F 2.0 N S 69 H 2.0 N S 70 H 2.0 B S 71 F 2.0 B S 72 F 2.0 B S 73 H 2.0 B S 74 F 2..0 B S 75 F 2.0 B S 76# F 2.0 x N S The first sentence of the question is providing training. Delete the 77 F 2.0 x B E first sentence of the question. Modified question to remove training.

78 H 2.0 x N S 79# H 2.0 x B S 80 H 2.0 x N S 81 H 2.0 x N S 82# H 2.0 x N S 83 H 2.0 x M S

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 84 F 2.0 x B S 85# F 2.0 x N S 86 H 2.0 x B S 87 F 2.0 x N S 88# F 2.0 x N S 89 H 2.5 x N S 90 F 2.0 x N S 91# H 2.0 x N S 92 F 2.0 x N S 93 H 2.0 x B S 94# H 2.0 x N S 95 F 2.0 x B S 96 F 2.0 x N S 97 F 2.0 x B S 98 F 2.0 x B S 99 F 2.0 x B S Can be answered with RO knowledge. The steps taken are 100 H 2.0 x N U immediate actions required to be memorized. Agreed. Question replaced.