ML12111A189

From kanterella
Jump to navigation Jump to search

NRC Comments on Draft Licensee-Developed Exam (Written) (Folder 2)
ML12111A189
Person / Time
Site: Beaver Valley
Issue date: 03/20/2012
From: David Silk
Operations Branch I
To:
FirstEnergy Nuclear Operating Co
Jackson D
Shared Package
ML113320121 List:
References
TAC U01846
Download: ML12111A189 (6)
v • d • e


Text

ES-401 BEAVER VALLEY UNIT 1 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues TtF Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N utEtS Explanation Focus Dist. Link units ward KIA Only 1 H 2 B S 2 H 2 B S Previous BV2 exam question.

3 H 2 B S Previous BV2 exam question. Strengthen justification.

4 H 3 N S 5 H 3 N S 6

7 H

H 1

2 X N N

U S

Replace/Reword Q to increase LOD. Similar to 86.

Strengthen justification.

I 8 H 2 X All N U Reword Q to increase LOD and improve plausibility.

Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F}undamental or (H)igher cognitive level.
2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
3. Check the appropriate box if a psychometric flaw is identified:
    • The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

The stem or distractors contain cues (I.e., clues, specific determiners, phrasing, length, etc).

    • The answer choices are a collection of unrelated true/false statements.

The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

4.

  • One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

Check the appropriate box if a job content error is identified:

    • The question is not linked to the job requirements (I.e., the question has a valid KIA but, as written, is not operational in content).

The question requires the recall of knowledge that is too specific for the closed reference test mode (I.e., it is not required to be known from memory).

    • The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable).
6. Enter question source: (B}ank, (M}odified, or (N}ew. Check that {M)odified questions meet criteria of ES-401 Section D.2.f.
7. Based on the reviewer's judgment, is the question as written {U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
8. At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).

ES-401 2 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (FfH) (1*5) Stem Cues T/F Credo Partial Job- Minutia #/ Back* Q= SRO B/M/N UtE/S Explanation Focus Dist. Link units ward KIA Only 9 F 2 D N E Replace D.

10 H 2 C N E Make C 75 gpm.

11 F 2 N S 12 H 3 B N E Choices in B are illogical. Reword Q stem.

13 F 2 A,C B E A&C are essentially the same. Make A different.

14 F 2 B S Previous BV2 exam question.

15 H 3 C B E C not plausible given bus voltage. Reword.

th 16 H 2 X N E Separate the 6 bullet as a subsequent emerging condition ..

17 H 2 N S 18 F 2 B S Previous BV2 exam question.

19 H 2 N S 20 H 3 M S 21 F 3 N S 22 F 2 A N E Make A Halon and CO2.

23 F 2 X N E Modify stem to include "system alignment."

24 H 3 B S 25 H 2 B S 26 H 2 N S 27 F 1 B,D B U Add CCR to B&D 28 H 2 N S

ES-401 3 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 29 H 3 N S 30 H 2 N S 31 H 1 N U Replace/reword Q to address LOD.

32 H 2 B S 33 F 1 C;D N U PRT not used at BV to draw bubble. Reselect.

I 34 F 2 N S 35 H 2 X B E Move "one minute" phrase to stem. Previous BV2 exam question.

36 H 2 N S 37 H 1 N U Modify bullets to test knowledge of channel test and increase LOD.

38 F 2 B S 39 H 2 N S 40 H 2 X N E Make RWST level 37'. Add lAW in stem.

41 F 2 M S Strengthen justification.

42 H 2 B S Previous BV1 exam question.

43 H 1 N U Reword to ask about header flow and increase LOD.

44 H 3 N S 45 H 2 M S 46 F 2 M S 47 H 2 N S Strengthen justification.

~18 H 2 X N E Control room Team vs crew.

ES-401 4 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N UlEtS Explanation Focus Dis!. Link units ward KIA Only 49 F 2 N U Too similar to Q61 - replace.

50 H 2 N S 51 H 2 N S 52 F 2 N S 53 F 2 N S 54 F 2 N S 55 F 3 N S 56 H 3 N S 57 F 4 N S 58 F 3 N S 59 H 3 N S 60 H 2 X N E Initial response or at ten seconds? Clarify.

61 F 2 M S 62 H 2 B S 63 F 1 N U Delete 4th bullet to raise LOD.

64 H 2 N S 65 F 2 N S 66 H 2 X N E Change "non-passive" wording.

67 F 2 N S Q9;8 F 2 X 0 B E Modify initial conditions to have multiple actions.

ES-401 5 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #/ Back- Q= SRO B/M/N utE/S Explanation Focus Dist. Link units ward KIA Only 69 H 2 A,C N U Modify A&C to insert rod after selecting Control Bank D.

70 F 2 N S 71 F 1 X N U Apply BV-specific limits.

72 F 2 A B E "OFF" not plausible. Replace A with other actions.

73 H 2 N S I 74 F 3 N S 75 F 2 D B E Modify stem (RIL 10 alarm) and D (emergency borate).

76 F 2 C,D N U Replace MTC as a distractor.

77 H 3 X B E Delete unnecessary phrase on first line.

78 H 3 N S 79 H 2 X B E Modify to ensure SRO-only status to know specific procedure details.

80 H 3 X N U A is correct. Modify Q.

81 H 3 B S Previous BV2 exam question.

82 H 2 X B E Indent annunciators in initial conditions.

83 H 2 X B B E Modify Q to consider a manual SI and/or emergency boration.

84 H 2 N S 85 H 3 N S 86 H 2 X B,D N U Pumps vs Rumps. Add SG level. Reword TS call.

ES-401 6 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N utE/S Explanation Focus Dist. Link units ward KIA Only 87 F 2 N S 88 H 2 X N E Re-arrange pump order (A, B, then C) 89 H 2 X N U KA mismatch. Reselect KA for system.

90 H 2 X M E Delete "activity" from 3rd bullet.

91 H 3 N S 92 H 2 X N E Strengthen justification. Change temperature and pO'vver trend.

93 F 2 B S 94 H 2 M S Previous BV2 exam question.

95 H 2 M S Previous BV2 exam question.

96 H 2 X N E C&D add "the next" (12 hours1.388889e-4 days <br />0.00333 hours <br />1.984127e-5 weeks <br />4.566e-6 months <br />.)

97 H 3 B S Previous BV2 exam question.

98 F 2 B S Previous BV2 exam question.

99 H 3 N S 100 F 1 B U Reselect KA or modify Q to increase LOD.

Retrieved from "https://kanterella.com/w/index.php?title=ML12111A189&oldid=2101742"