ML100640178

Initial License Exam, 401-9 Sheets

ML100640178
Person / Time
Site:	Quad Cities
Issue date:	11/30/2009
From:	NRC/RGN-III
To:	Exelon Generation Co
References
50-254/09-301, 50-265/09-301, ES-401, ES-401-9 50-254/09-301, 50-265/09-301
Download: ML100640178 (7)

Text

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 1 F 2 Y N S 2 H 3 Y M S Will EDG load a bus after an OC condition? Load shedding occur?

RE: Yes, bus is deenergized and picked up by EDG.

3 H 3 Y M S 4 F 1 X N N U OP Bkrs open after 30 seconds? Closed not a creditable distractor with question as is? K/A is ability question not a knowledge question. Question too easy. RE: Changed second bullet to when breaker opens ..

5 H 2 N S 6 H 3 Y N S 7 H 2 Y N S 8 H@ 2 Y B S 9 H 2 Y B S 10 F 2 Y M S 11 H 3 Y M S Licensee provided TS Bases as reference to RO question, RE:

Licensee has included same information in lesson plans for ROs.

TS Bases provided to NRC review for information only. Ref to TS basis (and TS basis) removed.

12 F@ 2 Y N S 13 F 2 Y B S 14 F 3 Y B S 15 F 3 Y B S K/A asks for effect to NPSH not vortexing! RE: Same symptoms but different causes. RE: Keep question as is!

16 H@ 3 Y B S 17 F 3 Y B S 18 F 3 Y N S 1

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 19 H 2 Y B S 20 H@ 2 N M S K/A requires using EOPS in conjunction with AOPs. AOPs not included in stem or distractors. RE: Actions in distractors are from AOPs. Will keep question as is.

21 H 3 Y N S Is this information that would be know by an RO. RE: Yes 22 H@ 2 Y N S 23 F 3 Y N S 24 H 2 Y B S 25 H@ 3 Y M S 26 F 2 Y N S 27 F 3 Y B S 28 H 3 Y B S 29 H@ 2 X Y M E Per the explanation, distractor C is correct, not distractor A as indicated. Why is B not correct? RE: Information provided to support correct answer is in error. Will change justification for correct answer. Since Q & A were correct, changed this from U to E

30 H 3 Y N S 31 H 2 Y B S 32 H@ 2 Y B S 33 F 2 Y M S Why is A incorrect. Chief believed that rods would indicate 00 post-scram? RE: If ind. Rod scram sw. held in position, rod would indicate on full core display, not 00 34 H 2 Y M S 35 F 2 Y M S 36 H@ 2 Y B S 37 H 3 Y M S 2

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 38 F 2 Y B S 39 F 2 Y B S 40 H 2 Y B S 41 F@ 3 Y B S 42 H 2 Y M S 43 H 2 Y N S 44 F 2 Y N S 45 F@ 3 Y B S 46 H 3 Y M S 47 H 3 Y N S 48 F@ 2 Y B E Remove is after DG. RE: Comment incorporated.

49 H 3 Y M S 50 F 2 Y M S Need procedural guidance for 11 oclock position. RE: provided in QCOP 6600-02, step F.2.j!

51 F 2 Y M S 52 F 2 Y M S Is 1B SWP normally selected for standby? RE: Yes, its the only SWP with an auto start feature.

53 F@ 2 Y B S 54 F@ 2 Y B S 55 H 4 Y B S What value, Blocks to Full on RWM? K/A ask effect of loss of malfunction of RWM. RE: Malfunction is in DFWLC which inputs to RWM. Blocks to Full disabled = doesnt enforce rod blocks above 10% pwr.

56 H@ 2 Y B S 57 H@ 2 Y B S 3

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 58 F 2 Y B S 59 F 2 Y B S 60 H@ 2 Y N S 61 H 2 Y N S 62 H 2 Y M S 63 F@ 3 Y B S 64 H 2 Y N S 65 F 2 Y B S 66 F 2 Y M S 67 F@ 2 Y B S 68 H 2 Y M S 69 F 3 Y B S 70 F 2 Y M S 71 F@ 2 Y N S 72 F 2 Y N S 73 F 2 Y B S 74 H 3 Y M S 75 F@ 2 Y B E Switch B and A distractors so that they are in order from least significant to most significant! RE: Comment incorporated.

1 H 3 Y Y N S Per QCOA 0202-04, D.2 actions to insert CRAM rods appears to be correct action! Why is distractor A incorrect? RE: Insert ALL CRAM rods is in correct! Only insert enough to get out of Region II.

4

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 2 H 3 Y Y N S 3 M 4 Y Y N S 4 H 2 Y Y N S 5 H@ 2 Y Y N S 6 H 2 Y Y N S 7 H 3 Y Y N S 8 H 2 Y Y M S 9 H@ 2 Y Y N S 10 H 3 Y Y N S K/A asks for H concentrations and H monitoring availability. RE:

Providing H concentration provides no additional information to question. Stem already has SRO in QGA 200-5, Hydrogen Control.

11 H 3 Y Y N S 12 F@ 3 Y Y N S If RCIC flow controller placed in Manual at 400 gpm, would that still render RCIC inoperable? D distractor, would RCIC eventually need to be declared inoperable for this condition? RE: Yes, RCIC is still inoperable. Yes, RCIC eventually would be declared inop.

Stem asks for IMMEDIATE actions!

13 H 3 N Y N S K/A A2 requires predicting impact and procedure to correct. TS is used as procedure but no predicting of impact in answer. RE: In order to deduce the correct TS, applicant would need to know what impact was.

14 H 3 N Y N U K/A A2 requires predicting impact AND procedure to correct control or mitigate. Missing procedure reference. RE: Procedure references were pulled out to make the question look neater.

Reference procedures put back in distractors.

15 H@ 3 Y Y N S 16 H 2 Y Y N S 17 H 2 Y Y M S 18 H@ 2 Y Y N S 5

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 19 H 2 Y Y M S 20 F 3 Y Y B S 21 F@ 2 Y Y B E Remove temporary from stem since answer contains temporary.

RE: Will replace with portable.

22 F 2 Y Y M S 23 F 2 Y Y B S 24 F 2 Y Y N S 25 H@ 3 X Y Y B U Last bullet in stem states, .. ready to provide SAMG decision making. Correct distractor includes entering into SAMGs. Clue in stem (SAMG) needs to be deleted. RE: moved bullet from stem to distractor A.

Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

• The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

• The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

• The answer choices are a collection of unrelated true/false statements.

• The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

• One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

• The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

• The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

• The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

• The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).

6

ES-401 Written Examination Review Worksheet Form ES-401-9

@ - Denotes 30 initial review questions that verified references, K/A conformance, level of difficulty and level of knowledge.

RKWalton 10/20/2009 7