ML070360643

Facility Comments to the Proposed Written Examination ES-401-9 for the LaSalle Initial Examination - November 2006

ML070360643
Person / Time
Site:	LaSalle
Issue date:	11/13/2006
From:	NRC/RGN-III/DRS/OLB
To:	Exelon Generation Co
Shared Package
ML070230277	List: ML070360607 ML070360618 ML070360628 ML070360643 ML070360696
References
50-373/06-301, 50-374/06-301
Download: ML070360643 (7)

Text

FACILITY COMMENTS TO THE PROPOSED WRITTEN EXAMINATION, ES-401-9 FOR THE LASALLE INITIAL EXAMINATION NOVEMBER 2006

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (FIH) (1-5) Stem Cues TIF Cred. Partial Job- Minutia #I Back- Q= SRO UIEIS Explanation Focus Dist. Link units ward WA Only new. Not enough info provided in the stem to arrive at a correct answer.

1 H 2.0 x Which rod blocks are being tested? Replace the question. Replaced.

new. Two correct answers. Based on allowable assumptions, Distract0 2 H 2.0 X U c. is correct, but distractor b. is correct under the given conditions.

Modify the stem to eliminate b. as a correct answer. Stem modified.

~

3 H 2.0 S new.

4 F 2.5 S new.

new. Two correct answers. Term shortly subject to interpretation 5 H 2.0 X making b. and d. correct answers. Replace the question. Replaced.

6 F 2.0 S new.

7 H 2.5 S modified.

I 8 F 2.0 E bank. damper should be valve Replaced damper w/ valve Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc).

The answer choices are a collection of unrelated truelfalse statements.

The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

The question is not linked to the job requirements (i.e.. the question has a valid WA but, as written, is not operational in content).

The question requires the recall of knowledge that is too specific for the closed reference test mode (Le., it is not required to be known from memory).

The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirements.

5. Check Questionsthat are samoled for conformance with the approved WA and those that are designated SRO-only (WA and license level mismatches are unacceptable).

6. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (Eyitorial enhancement, or (S)atisfactoV I

7. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).

1 2 3 Psychometric Flaws 4 Job Content Flaws 5 Other 6 7 Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred Partial Job- Minutia #/ Back- Q= SRO UlElS Explanation Focus Dist Link units ward K/A Only 9 F 2 E new Re-format the distractors No changes made.

10 F 20 E modified Clarification added to stem to clarify bundle status.

H 20 E new Replace "Primary Containment" with "drywell" Replaced.

-11 new Modify distractor c to prevent being a second correct answer 12 H 20 E Modified by changing reason for cooling down.

new Replace "should be monitored" with "SHALL be determined" 13 H 25 E Replacement text inserted.

14 F 20 S new modified Restore negatives to water levels in bullet 3 Cutandpaste 15 F 25 E error; corrected using LaSalle specific numbers for L3 and L8.

new Replace first bullet w/"NOT all rods are inserted " SLC IS SBLC Capitalize NOT in distractors b and d , and restore negative to vessel 16 H 25 E level on distractor b Replace phrase as requested, Changed SLC to SBLC, capitalized NOT, and restored negative to -185.

17 H 30 S new I I (1 19 20 F

F 25 20 X U S

new Not RO Replaced 0 with RO question from BANK..

new new Two correct answers with the provided initial conditions Change 21 H 25 X E "decreasing slowly" in the last two initial conditions to make d the Only correct distractor Changed "decreasing slowly to "steady" new Unable to verify correct answer Question is beyond knowledge o 22 H 20 X U control room operators Requires engineer to determine correct answer Replaced question w/comparablebank question.

new. Replace "Fault" with "Trouble" capitalize "NOT"Replaced Fault 8 25 H 2.0 E capitalized NOT.

new. Add noun description of Figure S Curve. Replaced reference to 26 F 2.0 E "S" curve with inability to maintain below specified limit.

1 2 3 Psychometric Flaws 4 Job Content Flaws 5 Other 6 7 Q# LOK LOD (FIH) (1-5) Stem Cues T/F Cred Partial Job- Minutia #IBack- Q= SRO UIEIS Explanation Focus Dist Link units ward K/A Only 27 F 20 S new new Beyond knowledge level required for ROISRO Replaced with Q 28 F 40 X ti om^^^^.

29 F 20 E new CorrectLPSC TypedLPCS.

30 H 25 E new Put stem in past tense Replaced is with was.

31 H 20 S new 32 H 20 E new Change SensoP to "indicator" Made suggested enhancement.

new Change flow to 7500 gpm in stem to clearly indicate above design 33 H 20 E flow of 71 75 pm Changed given flow to 7500 gpm.

new Correct typos Changed rapid to rapidly, reformatted last 34 F 20 E sentence of stem.

35 F 20 S new new Swap lRMs and S R M s Moved B and D to SRMs, moved B, D, 36 H 25 E F, and H to IRMs.

new Add "on Range 1" to last bullet, add "with no operator actions " to 37 H 25 E the stem, add SRM to the front of distractor b for correct terminology Made suggested cbanges, resequenced distractors.

38 H 25 S new 39 F 20 S new modified Add five psig to distractors & 130 psig to ensure applicant 40 H 20 S understanding Correct answer is on the setpoint No changes were made.

41 H 20 S bank 42 H 20 S new new Add ONLY to distractors b and c to ensure only one correct 43 F 20 X E answer a is a subset of the correct answer and is therefore, also correct Added ONLY.

44 H 20 E new Correct typo Changed know to known.

45 H 25 S new