ML070360643
| ML070360643 | |
| Person / Time | |
|---|---|
| Site: | LaSalle  |
| Issue date: | 11/13/2006 |
| From: | NRC/RGN-III/DRS/OLB |
| To: | Exelon Generation Co |
| Shared Package | |
| ML070230277 | List: |
| References | |
| 50-373/06-301, 50-374/06-301 | |
| Download: ML070360643 (7) | |
Text
FACILITY COMMENTS TO THE PROPOSED WRITTEN EXAMINATION, ES-401-9 FOR THE LASALLE INITIAL EXAMINATION - NOVEMBER 2006
ES-401 Written Examination Review Worksheet Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
Q# LOK LOD (FIH) (1-5) Stem Cues TIF Cred. Partial Job-Minutia
- I Back-Q= SRO UIEIS Explanation Focus Dist.
Link units ward WA Only new. Not enough info provided in the stem to arrive at a correct answer.
Which rod blocks are being tested? Replace the question. Replaced.
new. Two correct answers. Based on allowable assumptions, Distract0 Modify the stem to eliminate b. as a correct answer. Stem modified.
1 H
2.0 x
2 H
2.0 X
U
- c. is correct, but distractor b. is correct under the given conditions.
~
3 H
2.0 S
new.
4 F
2.5 S
new.
5 H
2.0 X
6 F
2.0 S
new.
7 H
2.5 S
modified.
new. Two correct answers. Term shortly subject to interpretation making b. and d. correct answers. Replace the question. Replaced.
I 8
F 2.0 E
bank. damper should be valve Replaced damper w/ valve Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1.
- 2.
- 3.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated truelfalse statements.
The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
The question is not linked to the job requirements (i.e.. the question has a valid WA but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (Le., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
- 4.
Check the appropriate box if a job content error is identified:
- 5.
Check Questions that are samoled for conformance with the approved WA and those that are designated SRO-only (WA and license level mismatches are unacceptable).
- 6.
Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (Eyitorial enhancement, or (S)atisfactoV II
- 7.
At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
1 2
3 Psychometric Flaws 4 Job Content Flaws 5 Other 6
7 Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Cred Partial Job-Minutia
- /
Back-Q= SRO UlElS Explanation Focus Dist Link units ward K/A Only 9
F 2
E new Re-format the distractors No changes made.
10 F
2 0 E
modified Clarification added to stem to clarify bundle status.
11 H
2 0 E
new Replace "Primary Containment" with "drywell" Replaced.
12 H
2 0 new Modify distractor c to prevent being a second correct answer Modified by changing reason for cooling down.
new Replace "should be monitored" with "SHALL be determined" E
E Replacement text inserted.
13 H
2 5 14 F
2 0 S
new 15 F
2 5 E
modified Restore negatives to water levels in bullet 3 Cutandpaste error; corrected using LaSalle specific numbers for L3 and L8.
new Replace first bullet w/"NOT all rods are inserted " SLC IS SBLC Capitalize NOT in distractors b and d, and restore negative to vessel level on distractor b Replace phrase as requested, Changed SLC to SBLC, capitalized NOT, and restored negative to -185.
E 16 H
2 5 S
new 17 H
3 0 I
I (1 19 20 21 22 F
2 5 X
U new Not RO Replaced 0 with RO question from BANK..
F 2 0 S
new new Two correct answers with the provided initial conditions Change H
2 5 X
E "decreasing slowly" in the last two initial conditions to make d the Only correct distractor Changed "decreasing slowly to "steady" new Unable to verify correct answer Question is beyond knowledge o H
2 0 X
U control room operators Requires engineer to determine correct answer Replaced question w/comparable bank question.
25 E
new. Replace "Fault" with "Trouble" capitalize "NOT" Replaced Fault 8 capitalized NOT.
H 2.0 26 E
new. Add noun description of Figure S Curve. Replaced reference to "S" curve with inability to maintain below specified limit.
F 2.0
Q#
27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 1
2 3 Psychometric Flaws 4 Job Content Flaws 5 Other 6
7 LOK LOD (FIH)
(1-5) Stem Cues T/F Cred Partial Job-Minutia #I Back-Q= SRO UIEIS Explanation Focus Dist Link units ward K/A Only F
2 0 S
new F
4 0 X
F 2 0 E
new CorrectLPSC TypedLPCS.
H 2 5 E
new Put stem in past tense Replaced is with was.
H 2 0 S
new H
2 0 E
new Change SensoP to "indicator" Made suggested enhancement.
H 2 0 new Beyond knowledge level required for ROISRO Replaced with Q ti om^^^^.
E new Change flow to 7500 gpm in stem to clearly indicate above design flow of 71 75 pm Changed given flow to 7500 gpm.
new Correct typos Changed rapid to rapidly, reformatted last sentence of stem.
E F
2 0 F
2 0 S
new H
2 5 new Swap lRMs and SRMs Moved B and D to SRMs, moved B, D, F, and H to IRMs.
new Add "on Range 1" to last bullet, add "with no operator actions " to the stem, add SRM to the front of distractor b for correct terminology Made suggested cbanges, resequenced distractors.
E H
2 5 E
H 2 5 S
new S
new F
2 0 modified Add five psig to distractors & 130 psig to ensure applicant made.
H 2 0 S
understanding Correct answer is on the setpoint No changes were H
2 0 S
bank H
2 0 S
new new Add ONLY to distractors b and c to ensure only one correct F
2 0 X
E answer a is a subset of the correct answer and is therefore, also correct Added ONLY.
H 2 0 E
new Correct typo Changed know to known.
H 2 5 S
new