ML14080A501

From kanterella
Jump to navigation Jump to search
NRC Comments on Draft Licensee-Developed Exam (Written) (Folder 2)
ML14080A501
Person / Time
Site: Indian Point Entergy icon.png
Issue date: 02/04/2014
From: David Silk
Operations Branch I
To:
Entergy Nuclear Indian Point 2
Jackson D
Shared Package
ML13252A147 List:
References
UO1890
Download: ML14080A501 (6)
v • d • e


Text

ES-401 INDIAN POINT 2 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #I Back- Q= SRO B/M/N UIE/S Explanation Focus Dist. Link units ward KIA Only 1 F 2 X N E Change "if to "of'.

2 H 2 X N E Remove 2"d sentence.

3 F 2 X B E Delete first sentence in stem. Why is 1000# plausible? F vs H.

4 H 3 X N E Adjust modify indications to strengthen KA connection.

5 F 2 X N E Add lAW to stem and ensure A is not an acceptable answer.

6 H 3 X N E Modify to strengthen KA connection. Change to >15 hours.

7 F 3 M s 8 H 3 X B N E Delete loss of 22/22A bus. Replace B with checking boron.

Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2. Enter the level of difficulty (LOD) of each question using a 1 -5 (easy- difficult) rating scale (questions in the 2-4 range are acceptable).
3. Check the appropriate box if a psychometric flaw is identified:

.. The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information) .

.. The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc) .

The answer choices are a collection of unrelated true/false statements .

. The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable .

One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem) .

4.

..Check the appropriate box if a job content error is identified:

The question is not linked to the job requirements (i.e., the question has a valid KIA but, as written, is not operational in content) .

.. The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory) .

The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons) .

The question requires reverse logic or application compared to the job requirements .

5. Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable).
6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
7. Based on the reviewer's judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
8. At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).

ES-401 2 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #I Back- Q= SRO B/M/N U/E/S Explanation Focus Dis!. Link units ward KIA Only 9 H 2 A,C,D B u Modify distractors. Only one obvious choice. Delete E-3 steps.

10 H 2 X B E Delete 2"d part of choices; reword A.

11 H 3 B s 12 H 3 B s Explain how is KIA met.

13 H 2 A N E Modify A.

14 H 2 X A M E Change PZR level to "lowering. "

15 H 2 B s 16 H 1 B,C B u Good concept but weak Q. Replace Q.

17 H 2 M s 18 F 2 B s 19 F 2 X N E Q is mute if Rx trip required. Modify Q or reselect KA.

20 H 2 X B E Typo in B. (FNH???)

21 H 2 X N E Delete 2"d column. Edit C&D.

22 H 3 B s 23 H 2 M s 24 H 2 B E Add last bullet to Q stem.

25 F 2 X B E Capitalize ONLY is A. F vs H 26 H 3 B s Correct explanation.

27 H 3 D B u D is subset of A. Modify Q.

28 H 2 B s

ES-401 3 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #I Back- Q= SRO 8/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 29 H 2 X B u H vs F. Rework Q or get new Q.

30 F 2 B s F vs H 31 F 2 B s 32 H 2 X D B E Delete first part of 2nd sentence (RCS leak). Replace D.

33 F 3 B s F vs H 34 H 2 X B u KAMM. There is no loss of CCW in the Q.

35 H 2 X B u Replace Q.

36 H 3 B s 37 F 3 N s 38 H 3 X M E Modify B, C, & D.

39 H 2 c N E H vs F. Change B to "REDUCED" to be more plausible.

40 F 2 N E Add a loss of bus to raise discriminatory value.

41 F 3 N s 42 H 1 N u Why is this discriminating if input nor set point change? Fix.

43 H 2 X N E Add lAW to stem. Delete first two columns.

44 H 3 X N E Capitalize REQUIRE.

45 H 2 B s 46 H 2 X B E Fix typos in stem and choices C & D.

47 F 2 X N E F vs H. Delete 2nd part of all choices.

ii8 H 2 X C,D M u Modify Q to raise discriminatory value.

ES-401 4 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #I Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 49 H 3 X B N E Delete info about alarm. Fix stem and D.

50 H 2 B s 51 H 2 A,C,D X N u KAMM -ARMs vs PRMs. Rework or reselect.

52 H 3 X B E Delete last bullet- let applicant make the assessment.

53 F 2 X B E Be consistent with Nitrogen.

54 F 2 X N E Provide plant mode or power level.

55 F 2 X B E Add procedure.

56 F 3 X B E Add space after "approximately."

I 57 H 3 X B E H vs F. Replace "if' with "when" in stem so A is not subset of B.

58 F 1 X B u Low LOD. How is KA met? Rework or replace.

59 F 1 N u Low LOD. Answer obvious among choices. Rework or replace.

60 F 2 X B,D N u F vs H. RCPs vs RCP. Add CNMT and RVLIS info.

61 H 3 B s H vs F 62 F 3 B s 63 F 2 X N E Replace "or' with "and" for clarity.

64 F 2 B s 65 F 2 N s 66 H 1 X B u Too simplistic. KAMM. Modify or replace.

67 F 2 X B E Re-word A to avoid confusion. Fix wording in D.

~Q~8 H 2 ,_ B E H VS F.

ES-401 5 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #I Back- Q= SRO B/M/N UIE/S Explanation Focus Dist. Link units ward KIA Only 69 F 2 8 s 70 H 2 8 s 71 F 2 X 8 u Doesn't meet the KA. Replace.

72 F 2 8 s 1

73 H 2 X 8 E H vs F. Edit 4 h bullet. Make last bullet 4R/hr.

74 F 2 8 s 75 F 2 8 s 76 H 2 N s 77 H 2 B s 78 H 2 X X B u Modify format or replace Q to fit SRO-only criteria.

79 F 3 M s Explain why it is SRO-only.

80 H 2 X M E Make format change to stem. Reword C.

81 H 2 X 8 E Change stem to event vs LOCA. Put procedure name/step in B&C.

82 H 2 N s 83 F 3 c N E STA ED duties not plausible.

84 H 2 B s 85 H 2 B s 86 H 3 N s

ES-401 6 Form ES-401-9 I I 1. I 2. I 3. Psychometric Flaws I 4. Job Content Flaws I 5. Other I 6. 7. I 8. I Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #I Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 87 H 3 X B E Delete "When."

88 H 3 X B E Delete 3rd bullet.

89 H 3 N s 90 H 2 X X N E Fix last bullet. Explain why Q meets SRO-only criteria.

91 H 2 X N E Replace "increase" with "indication"?

92 F 2 X N E Modify distractors 93 H 3 X B u KAMM. Reselect or Replace.

94 H 2 X N E Modify for clarity. Provide why Q is SRO-only.

95 F 2 X B E Remove "are" from first line. Capitalize "not" in stem.

96 H 2 B N E Remove "the" from Q. Modify B to be plausible.

97 F 2 X N E Modify and explain why Q is SRO-only.

98 H 2 B s 99 H 2 N s 100 H 2 N s -

Retrieved from "https://kanterella.com/w/index.php?title=ML14080A501&oldid=2453361"