ML15008A062

From kanterella
Jump to navigation Jump to search
NRC Comments on Draft Licensee-Developed Exam (Written)(Folder 2)
ML15008A062
Person / Time
Site: Millstone Dominion icon.png
Issue date: 01/05/2015
From: Peter Presby
Operations Branch I
To: Cote M
Dominion Nuclear
Shared Package
ML14043A009 List:
References
U01891
Download: ML15008A062 (6)


Text

ES-401 Written Examination Review Worksheet Form ES-401-9

-~

~-- - - - - - - - -

-~

1.
2.
3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.
7.
8.

Q#

LOK LOD (F/H)

(1-5)

Stem Cues T/F Cred. Partial Job-Minutia

  1. I Back-Q=

SRO B/M/N U/E/S Explanation Focus Dis!.

Link units ward KIA Only 1

F N

s 2

F N

E Modified stem to delete irrelevant information. Changed distractor wording to align with the modified stem.

3 F

B E

Minor stem changes for clarity.

4 H

B E

Used on 2009 MS2 exam. Moved repeated information from all choices into the stem. Changed initial conditions to address a technical issue.

5 H

B s

6 H

N E

Changed Choice B to eliminate possibility of 2"d correct answer. Minor wording changes to Choices A, C, and D to maintain symmetry.

7 H

N Modified choices to eliminate possibility of a 2"d correct answer, to E

eliminate overlap with 0#66 and to adjust LOD. Added specific step reference to step.

8 H

B E

Added power level to the stem to make KA match more explicit.

9 H

B s

10 H

B s

11 H

M s

12 F

N E

Minor nomenclature changes.

I 13 H

B s

14 H

N E

Modified stem to provide more realistic indications for the plant conditions.

I 15 H

M E

Changed components referenced in two distractors to reflect equipment normally in operation for the given conditions.

I 16 F

N E

Modified initial conditions to at-power operation.

17 H

B s

L__

L_

L__- L__

Page 1

ES-401 2

Form ES-401-9

-~

---~ ----

--~ --**--

-~

1.
2.
3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.
7.
8.

LOK LOD Q#

(F/H)

(1-5)

Stem Cues T/F Cred. Partial Job-Minutia

  1. I Back-Q=

SRO 8/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 18 H

N s

19 H

N E

Minor modification to stem conditions to change cause from operator error to circuit malfunction.

20 H

N s

21 H

N E

Modified a stem parameter to ensure desired plant response.

22 H

B s

23 H

N E

Minor change to stem conditions. Minor wording changes to dis tractors.

24 F

B u

Q overlaps with op-test JPM. Replaced the Q.

25 F

N E

Minor formatting changes.

26 H

N E

Minor stem nomenclature correction.

27 H

B u

This bank Q is no longer valid as written because of plant procedure and operating philosophy changes. Replaced with another bank Q.

28 H

N E

Modified Q stem to enhance clarity.

29 H

B E

Minor wording change 30 H

B E

Minor format, wording changes.

31 F

N s

32 F

N E

Reworded stem to provide more clarity as to plant conditions and equipment functionality.

33 F

N s

34 H

M s

35 H

B u

Replaced with a bank Q testing the same KIA.

36 F

N E

Minor wording changes to choices to reduce choice length. ---

Page 2

ES-401 2

Form ES-401-9

1.
2.
3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.
7.
8.

LOK LOD 0#

(F/H)

(1-5)

Stem Cues T/F Cred. Partial Job-Minutia

  1. I Back-0= SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 37 H

B E

Minor modifications to improve clarity and ensure given conditions are representative of SG pressure.

38 H

B u

Bank 0 is technically obsolete due to plant design changes.

Replaced with a different bank 0.

39 F

M s

40 H

N E

Minor modification to stem conditions to ensure components can be manually operated.

41 F

B s

42 H

N E

Corrected nomenclature error in stem.

43 H

N E

Minor wording changes in stem and choices. Corrected typo on key.

44 F

B u

Replaced 0#44 because it overlapped with 0#1 0.

45 F

B E

Minor formatting changes.

46 H

B s

Used on 2011 MS2 exam. Changed cognitive level designation to higher order.

47 F

N s

48 H

B E

Changed stem conditions to align with a plant design modification.

Minor wording change in one choice.

49 H

N E

Modified key answer wording to ensure technically accurate.

50 F

B E

Minor stem changes.

51 F

B E

Replaced the 0 because of oversampling of the system.

52 F

N s

Minor wording changes to some choices for improved symmetry.

Changed trend direction in one distractor to fix the distractor.

53 F

X N

E Replaced another distractor and swapped answer choice order for symmetry. Changed stem conditions and choices to clarify question and move repetitive text from choices to stem.

54 F

B s

Page 3

ES-401 2

Form ES-401-9

1.
2.
3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.
7.
8.

LOK LOD Q#

(F/H)

(1-5)

Stem Cues T/F Cred. Partial Job-Minutia

  1. I Back-Q=

SRO B/M/N UIE/S Explanation Focus Dist.

Link units ward KIA Only 55 F

N E

Corrected typo in Choice B. Labeled Q source on justification page.

56 H

M E

Added information to stem to reduce complexity of Q. Changed a distractor to eliminate confusion due to low initial power level.

57 H

B s

Used on 2009 MS2 exam.

58 F

B E

Corrected minor typos.

59 F

B s

60 F

B s

61 H

N E

Minor wording change in stem to clarify intent of Q.

62 H

B E

Minor wording change in stem to clarify conditions and intent of Q.

63 F

B s

64 F

B s

65 H

N E

Replaced the Q because of oversampling of the system.

66 H

B u

Replaced Q based on overlap with 07 Corrected categorization, new not modified. Minor wording changes 67 F

N E

to stem and distractors to eliminate confusion over how/when the testing is performed.

68 F

B u

Not testing RO knowledge. Replaced the Q.

69 F

N E

Minor stem wording improvements.

70 F

N E

Added to choices to eliminate possibility of subset answers.

71 F

B E

Corrected justification statements.

72 F

N E

Added information to stem related to extent of damage and condition of assembly to better match intended initial conditions.

73 H

B s

Used on 2009 MS2 exam.

Page4

ES-401 2

Form ES-401-9

1.
2.
3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.
7.
8.

LOK LOD Q#

(F/H)

(1-5)

Stem Cues T/F Cred. Partial Job-Minutia

  1. I Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 74 H

B E

Corrected operator position designators consistent with facility convention. Minor modification to one distractor.

75 F

N s

76 H

N E

Changed parameter in stem to one that is instrumented.

77 F

B E

Modified one distractor to avoid subset problem.

78 H

B E

Used on 2009 MS2 exam. This question reworded to match the as-administered version on the 2009 NRC exam.

79 H

N E

Modified choices to enhance symmetry.

H Changed affected component in stem to align with initial conditions.

80 M

E Minor stem and choice wording and format changes to improve clarity.

Minor modification to a condition in the stem to ensure no confusion 81 H

N E

over the time at which the component was lost. Added information to eliminate any possible misunderstanding about equipment status.

82 H

B E

Modified operator titles consistent with new station convention.

Clarified condition in the stem.

83 H

N u

Replaced Q because of overlap with an op-test JPM.

84 H

B E

Minor wording changes.

85 H

X N

u Replaced with a bank Q that matched the KA.

86 H

N E

Modified some stem conditions such that all could exist concurrently, to ensure operational validity.

87 H

N E

Changed makeup from auto to manual in stem, consistent with normal plant operation. Changed wording in choices.

88 H

B s

89 H

B s

Used on 2009 MS2 exam.

90 H

N s

~-

Page 5

ES-401 2

Form ES-401-9

1.
2.
3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.
7.
8.

LOK LOD Q#

(F/H)

(1-5)

Stem Cues T/F Cred. Partial Job-Minutia

  1. I Back-Q=

SRO B/M/N U/E/S Explanation Focus Dist.

Link units ward KIA Only 91 H

B E

Modified Q conditions.

92 H

M s

93 F

N u

Q not technically correct. Replaced with another new Q.

94 F

N s

95 H

B u

Q not technically correct. Replaced with another new Q.

96 H

N E

Changed one choice to make technically correct for all conditions.

97 H

M s

I 98 H

B s

I 99 F

N s

100 F

N u

Not operationally valid. Replaced with a new Q.

I

~-....____ -

Page 6