ML14281A079

2014 DC Cook Nuclear Power Plant Initial License Examination Form ES-401-9

ML14281A079
Person / Time
Site:	Cook
Issue date:	08/01/2014
From:	McNeil D R NRC/RGN-III/DRS/OLB
To:	American Electric Power, Indiana Michigan Power Co
Shared Package
ML13093A427	List: ML14279A062 ML14279A076 ML14280A074 ML14281A073 ML14281A079
References
50-315/14-301, 50-316/14-301 50-315/OL-14, 50-316/OL-14
Download: ML14281A079 (6)

Text

ES-401 Written Examination Review Worksheet Form ES-401-9 # questions reviewed in depth.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 1 2 H 5.0 N U Question asks for a step buried in the subsequent actions of a procedure. Replaced question.

3 F 3.0 x N U Question asks for trivial information from the station's accident analysis. Replaced question 4 F 2.0 x N U Question requires sequence memorization. Replaced question.

5 F 2.0 M S 6 H 5.0 N U Question needs references to answer. Replaced question.

7 F 2.0 M U Station identified they do not have emergency

-only heaters. Replaced K/A, Question.

Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

The stem lacks sufficient focus to elicit the correct answer (e.g.,

unclear intent, more information is needed, or too much needless information).

The stem or distractors contain cues (i.e.,

clues, specific determiners, phrasing, length, etc).

The answer choices are a collection of unrelated true/false statements.

The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

One or more distractors is (are) partially correct (e.g.,

if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

The question is not linked to the job requirements (i.e.,

the question has a valid K/A but, as written, is not operational in content). The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e.,

it is not required to be known from memory). The question contains data with an unrealistic level of accuracy or inconsistent units (e.g.,

panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A

, and those that are designated SRO

-only (K/A and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES

-401 Section D.2.f.

7. Based on the reviewer's judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any "U" ratings (e.g.,

how the Appendix B psychometric attributes are not being met).

ES-401 2 Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 8 2.0 N x x N U Question does not ask how to interpret valve position indications. Replaced question.

9 2.0 H M S 10 2.0 H N S 11 2.0 H B E Identified answer is incorrect. Updated correct answer.

12 2.5 F B E Update material to current station nomenclature. Updated procedure names.

13 2.0 F B S 14# 2.5 H B U Same as Question #42. Selected new K/A and question.

15 2.0 F N S 16# 2.0 F N S 17 2.0 H B S 18 2.0 F B E Update correct answer. Updated correct answer.

19# 2.0 H M S 20 2.0 H M S 21 2.0 H B S 22# 2.0 F M S 23 2.0 F B S 24 2.0 F N S 25# 2.5 F x M U Requires memorization of details that should be reviewed prior to a reactivity change. Replaced question.

26 2.0 H B E Update correct answer to current procedures. Updated correct answer. 27 2.0 H B S 28# 2.0 F B S 29 2.0 H N E Correct the answer key. Should be (c.). Corrected answer key.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 30 2.0 H B S 31# 2.0 H x S E Delete the time

-critical aspect of the question

- not necessary, not part of the K/A. Removed the time critical portion of the question and answer.

32 2.0 F N S 33 2.5 H B S 34# 2.0 H B S 35 2.0 H B S 36 2.0 F B S 37# 2.0 H N S 38 2.0 F M S 39 2.5 H N S 40# 2.0 H B S 41 2.0 H B S 42 2.0 H B S Original question #14.

43# 2.0 H B S 44 2.0 F N E Correct answer. Corrected answer 45 1.0 F x N U Question asks trivia. Replace Question Replaced question 46# 2.0 H B S 47 2.0 F x B U Replaced question 48 2.0 H B S 49# 2.5 H B S 50 2.0 F N S 51 2.0 F N S 52# 2.5 H x B U Doesn't address second part of the K/A.

Replace Question Replaced question 53 2.0 F B S Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 54 2.0 F N U Ice Condenser Containment

- slight differences. Re

-work question. Reworked question 55# 2.0 F x M U Replaced question 56 2.0 F N S 57 2.0 F M S 58# 2.0 H M S 59 2.5 H B S 60 2.0 H B S 61# 2.5 H B S 62 2.0 F x M U Doesn't distinguish between competent/less

-than competent operator. Replace question Replaced question 63 2.0 H B S 64# 2.0 H B S 65 2.0 H N E Correct answer is (b.)

- should be (a.) Corrected answer key 66 2.0 F N S 67 2.0 H B S 68 2.0 H B E Correct answer is (a.)

- should be (b.) Corrected answer key 69 2.5 F N S 70 2.0 H N S 71 2.0 F N S 72 2.5 F B S 73 2.0 F M S 74 2.0 H B U Question requires SRO knowledge to make a transition to another procedure. Replace question. Replaced question.

75 2.0 F N S 76# 2.5 H x B S 77 2.0 H x N S Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 78 2.0 F x N S 79# 2.0 H x M E Remove unnecessary material from stem. Removed fluff.

80 2.5 H x M S 81 2.5 H x B S 82# 2.5 H x M S 83 2.0 H x N S 84 5.0 H x N E Station stated this tech spec call would be determined with the assistance of engineering and is beyond the normal control room technical specification calls

. Replaced question.

85# 5.0 F x N E Hydrostatic test referred to is an infrequent activity. Site engineering would participate in the application of the tech spec. Replaced question.

86 2.0 H x N S 87 2.5 F x B U Question is RO level. This is a system question. Replaced question.

88# 3.0 F x N E Rework question to conform with Palisades language. Revised question.

89 2.5 H x N E Some minor tweaks to the wording of the stem. Made revisions.

90 2.0 H x B S 91# 2.5 H x N S Moved question to #99. Selected new K/A & Question for #91.

92 2.0 H x N S 93 2.5 H x N S 94# 2.0 F x B S 95 2.0 F x N S 96 2.5 H x B E Fix the answer and replace bad distractor. Added requirements to the answer, replaced one distractor.

97 2.0 H x B S 98 2.0 F x B S 99 2.5 H x B E Question was replaced by Q#91

- better question for determining operator ability.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws

4. Job Content Flaws

5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SRO Only 100 2.0 F x N U Not required from memory

- direct lookup if reference is provided. Replaced question