ML20056C655

From kanterella
Jump to navigation Jump to search
ES-401-9
ML20056C655
Person / Time
Site: Byron  Constellation icon.png
Issue date: 12/16/2019
From: Joseph Demarshall
NRC Region 1
To:
Exelon Generation Co, NRC/RGN-III/DRS/OLB
Demarshall J
Shared Package
ML17214A840 List:
References
50-454/19-01, 50-455/19-01 50-454/OL-19, 50-455/OL-19
Download: ML20056C655 (7)
v • d • e


Text

ES-401 Written Examination Review Worksheet Form ES-401-9 Facility: BYRON NUCLEAR GENERATING STATION Exam Date: Oct 28 - Nov 12, 2019 Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2. Enter the level of difficulty (LOD) of each question using a 1 (easy) to 5 (difficult); questions with a difficulty between 2 and 4 are acceptable.
3. Check the appropriate box if a psychometric flaw is identified:

Stem Focus: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

Cues: The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length).

T/F: The answer choices are a collection of unrelated true/false statements.

Cred. Dist>: The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

Job Link: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory).

  1. /Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

Backward: The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only. (K/A and license-level mismatches are unacceptable).
6. Enter question source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet criteria of ES-401 Section D.2.f.
7. Based on the reviewers judgment, is the question, as written, (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
8. At a minimum, explain any U status ratings (e.g., how the Appendix B psychometric attributes are not being met).

Page 1 of 7 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation NRC developed exam. ES-401-9 only used for statistical / metric documentation.

Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only 1

H 3

N 2

H 3

B NRC 2006 Byron ILE 3

H 2

B NRC 2017 Byron ILE (previous 2 NRC Exams) 4 H

3 N

5 H

2 B

6 H

3 N

7 F

3 N

8 H

3 N

9 H

4 M

ES-401 2

Form ES-401-9 Facility: BYRON NUCLEAR GENERATING STATION Exam Date: Oct 28 - Nov 12, 2019 Page 2 of 7 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation NRC developed exam. ES-401-9 only used for statistical / metric documentation.

Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only 10 F

3 N

Question 10 deleted during the grading process. Final written examination and answer key revised to reflect the deletion. Reference Byron Exam Report 05000454/2019302; 05000455/2019302, Enclosure 2, for NRC disposition of the post-exam comments submitted by the Licensee for this question.

11 F

3 N

12 F

3 B

NRC 2014 Braidwood ILE 13 H

3 B

14 F

2 B

NRC 2014 Byron ILE 15 H

3 N

16 F

3 B

NRC 2010 Ginna ILE 17 H

3 N

18 F

2 B

19 H

3 N

20 F

3 M

21 H

3 N

22 H

3 M

23 F

3 N

24 F

3 N

25 F

3 M

26 F

2 N

27 F

2 B

28 F

2 N

29 H

3 B

30 F

2 B

ES-401 3

Form ES-401-9 Facility: BYRON NUCLEAR GENERATING STATION Exam Date: Oct 28 - Nov 12, 2019 Page 3 of 7 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation NRC developed exam. ES-401-9 only used for statistical / metric documentation.

Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only 31 H

3 B

32 H

2 N

33 H

3 M

34 H

2 N

Embedded Graphic: Plant Computer Data Handout for PRT.

35 H

3 N

36 H

3 N

37 F

2 B

38 H

3 B

39 H

3 B

40 H

3 N

41 H

2 N

Reference provided: BAR 2-4-B3, SOLID STATE PROT CAB GENERAL WARNING 42 F

2 M

43 H

2 B

44 H

2 N

45 F

2 N

46 H

2 N

47 F

3 N

48 H

4 N

49 H

3 B

50 H

3 N

51 F

3 N

52 F

3 N

53 F

2 N

54 H

3 N

ES-401 4

Form ES-401-9 Facility: BYRON NUCLEAR GENERATING STATION Exam Date: Oct 28 - Nov 12, 2019 Page 4 of 7 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation NRC developed exam. ES-401-9 only used for statistical / metric documentation.

Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only 55 H

3 N

56 F

2 N

57 H

4 N

58 F

2 B

NRC 2012 Prairie Island ILE 59 H

2 B

NRC 2016 Byron ILE 60 F

3 N

61 H

2 B

62 F

2 N

63 F

3 B

64 F

3 B

NRC 2013 Braidwood ILE 65 H

3 N

66 H

3 N

Reference Provided: BTC 1.3, Boric Acid Storage Tanks 1/2AB03T 67 F

2 B

NRC 2009 Braidwood ILE 68 F

2 N

69 F

2 N

70 H

2 N

71 F

3 N

72 F

2 B

NRC 2011 Salem ILE 73 H

2 N

74 F

2 M

NRC 2009 DAEC ILE 75 F

2 N

76 H

3 N

Reference Provided: EAL Matrix 77 F

3 N

78 H

4 N

Reference Provided: FIGURE 1BOA RCP-1-1, NO. 1 SEAL NORMAL OPERATING RANGE

ES-401 5

Form ES-401-9 Facility: BYRON NUCLEAR GENERATING STATION Exam Date: Oct 28 - Nov 12, 2019 Page 5 of 7 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation NRC developed exam. ES-401-9 only used for statistical / metric documentation.

Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only 79 H

3 N

Reference Provided: LCO 3.8.1, AC Sources - Operating 80 H

3 N

81 F

3 N

82 H

2 N

Reference Provided: EAL Matrix 83 H

3 N

84 H

3 N

85 H

2 B

NRC 2014 Byron ILE 86 H

3 N

87 H

3 N

88 H

3 N

Reference Provided: LCO 3.8.4, DC Sources - Operating 89 H

3 N

Reference Provided: LCO 3.8.1 90 F

2 N

91 F

3 N

92 F

2 N

Correct answer for Question 92 changed from choice C to A during the grading process. Final written examination and answer key revised to reflect the answer change. Reference Byron Exam Report 05000454/2019302; 05000455/2019302, Enclosure 2, for NRC disposition of the post-exam comments submitted by the Licensee for this question.

93 H

2 N

94 F

4 N

Question 94 deleted during the grading process. Final written examination and answer key revised to reflect the deletion. Reference Byron Exam Report 05000454/2019302; 05000455/2019302, Enclosure 2, for NRC disposition of the post-exam comments submitted by the Licensee for this question.

95 H

3 N

96 H

2 N

97 H

2 N

ES-401 6

Form ES-401-9 Facility: BYRON NUCLEAR GENERATING STATION Exam Date: Oct 28 - Nov 12, 2019 Page 6 of 7 Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. Other
6.

B/M/N

7.

U/E/S

8.

Explanation NRC developed exam. ES-401-9 only used for statistical / metric documentation.

Stem Focus Cues T/F Cred.

Dist.

Partial Job-Link Minutia

  1. /

units Back-ward Q=

K/A SRO Only 98 H

2 N

99 F

3 M

NRC 2016 Byron ILE 100 F

2 N

ES-401 Written Examination Review Worksheet Form ES-401-9 Facility: BYRON NUCLEAR GENERATING STATION Exam Date: Oct 28 - Nov 12, 2019 Page 7 of 7 RO TOTALS:

B= 24 F= 35 34*

E= N/A Additional Notes: NRC developed exam. ES-401-9 only used for statistical documentation.

  • RO Question 10 deleted during the grading process.

M= 7 H= 40 U= N/A N= 43*

SRO TOTALS:

B= 1 F= 8 7**

E= N/A Additional Notes: NRC developed exam. ES-401-9 only used for statistical documentation.

SRO Question 92 answer changed from choice C to A during the grading process.

    • SRO Question 94 deleted during the grading process.

M= 1 H= 17 U= N/A N= 23 22**

GENERAL COMMENT

S:

1. There are 3 (RO)/ 6 (SRO) questions with references/attachments provided.
2.

Questions from the previous 2 NRC Exams: __1__(RO)/__0__(SRO)

3.

Average difficulty is _2.63 2.62*_ on the RO exam and 2.72 2.71** on the SRO exam.

Retrieved from "https://kanterella.com/w/index.php?title=ML20056C655&oldid=4483571"