ML061450053
| ML061450053 | |
| Person / Time | |
|---|---|
| Site: | San Onofre  |
| Issue date: | 10/28/2005 |
| From: | Operations Branch IV |
| To: | Southern California Edison Co |
| References | |
| 50-361/05-301, 50-362/05-301 | |
| Download: ML061450053 (5) | |
Text
2005 October SONGS NRC Written Exam Exam Item Analysis Analysis items selected using ES-403-1 guidelines. Number 6...;evaluate validity of questions missed by half or more of the applicants. Exam item analysis identified the following questions as being missed by half or more of the ROs and SROs applicants for questions 1-75, or in the case of the SRO only questions76-100, questions missed by half or more of the SRO applicants only.
Question #37 65% failure rate This question was found to be technically valid. One distracter was selected, which could indicate a common mis-conception in the topic area and/or test talung techniques. Examinees will be provided with remedial training focused on Steam Bypass Control System (SBCS). The training program will be evaluated for inclusion of these weaknesses.
Question #70 65% failure rate This question was found to be technically valid. Two different distracters were selected, which would indicate a generic weakness in this topic area.
Examinees will be provided with remedial training focused on Source Range Nuclear Instrumentation OPERABILITY and the applicable Technical Specifications. The training program will be evaluated for inclusion of these weaknesses.
SRO-only Question #92 77% failure rate This question was found to be technically valid. Three different distracters were selected, which could indicate a generic weakness in this topic area. Examinees will be provided with remedial training focused on RCS Pressure Safety Limit Basis. The training program will be evaluated for inclusion of these weaknesses.
SRO-only Question #98 50% failure rate This question was found to be technically valid. Three different distracters were selected, which could indicate a generic weakness in this topic area. Examinees will be provided with remedial training focused on 10CFR100 Radiation Release limits. The training program will be evaluated for inclusion of these weaknesses.
SRO-only Question #99 83% failure rate This question was found to have some technical issues. The fire burning for 20 minutes meets the threshold for an Unusual Event, which was the distracter. The information in the stem identifying the control room being evacuated was intended for the correct answer to be an Alert but lacked the information as to weather or not control of shutdown systems was established locally or at the shutdown panel. The question will be modified prior to future use. The training program will be evaluated for inclusion of these weaknesses.
2005B NRC Vi'ritten Exam Standard Item Analysis Report On NRC - Exam1 Version A 1
I Correci Gio~ip Responses 1 poinl 1 correct Response Frequencies 1 Non 1
100.00% 100.00%
100.00%
0.00 A
5 0
0 0
1 BCD 2
1oo.ooo/b 100.00%
100.00%
0.00 C
0 0
5 0
A3D 3
/ I O G. O O %
100.00%
100.00%
0.00 C
0 0
5 0
ABD 4
100.00%/ 100.00%
100.00%
0.00 A
5 0
1 0
0 1 BCD 5
loo.oo%l ~ 0 o. O o ~ G ~00.00%
0.00 A
I 5
0 0
0 BCD 6
100.00% 100.00%
100.00%
0.00 C
0 0
5
/
0 ABD No.
Total Upper 27% Lowei-27% Biserial Answer A
B C
D 1 Disrractor 7
100.00% 100.00%
100.00~0 0.00 C
0 0
5 0
I
' ABD 8
100.00%] 100.00%
100.00%
0.00 1
c 0
0 1
5 0
A3D 9
~loo.oo~o/
100.00%
100.00%
0.00 5
0 5
0 0
ACD
/IO /100.00%/ 100.00%
100.00%
0.00 D
0 0
0 1
5 j
' 1 1
/IOO.OOYo~ 100.00% 1 100.00%
0.00 A
5 01 01 0
BCD 12
~loo.oo~/o 100.00% 1 100.0056 0.00 A
5 0
0 1
0 1 BCD 13 100.00% 100.00%
100.00%
0.00 A
5 /
0 0
0' j
I BCD 14 100.00% 100.00%
100.00%
0.00 C
0 0
5 0
15 1 80.00%
100.00%
100.00%
0.26 B
0 1 4 0
1 AC 16 6G.OO%
100.00%
0.00%
0.86 B
0 3
0 2
AC 17 100.00% 100.00%
100.00%
0.00 1 C
0 0
5 0
ABD 18 100.00% 100.00%
100.00%
0.00 k
5 0
0 0
BCD 19 80.00%
0.00%
100.00%
-0.53 A
4 0
1 0
BD 20 60.00% 100.00%
0.00%
0.65 B
1 3
1 0
D 21 100.00% 100.00%
100.00%
0.00 D
0 0
0 5
ABC 22 100.00% 100.00%
100.00%
0.00 B
0 5
0 0
ACD 23 100.00% 100.00%
100.00%
0.00 D
0 0
0 5
ABC 24 100.00% 100.00%
100.00%
0.00 B
0 5
0 0
ACD 25 100.00% 100.00%
100.00%
0.00 3
0 5
0 0
ACD 26 100.00% 100.00%
100.00%
0.00 C
0 0
5 0
ABD 27 100.00% 100.00%
100.00%
0.00 D
0 0
0 5
ABC 28 8O,0O0h 100.00%
0.00%
0.79 I B
0 4
0 1
AC 29 40.00% 100.00%
0.00%
0.43 B
0 2
2 1
A 30 100.00% 100.00%
100.00%
0.00 A
5 0
0 0
BCD 31 100.00%' 100.00%
100.00%
0.00 C
0 0
5 0
ABD 32 100.00% 100.00%
100.00%
0.00 A
5 0
0 0
BCD 33 100.00% 100.00%
100.00%
0.00 A
5 0
0 0
BCD 34 100.00% 100.00%
100.00%
0.00 A
5 0
0 0
BCD 35 100.00% 100.00%
100.00%
0.00 A
5 0
0 0
BCD 36 100.00% 100.00%
100.00%
0.00 D
0 0
0 5
ABC I
I ABD Course 8. 2005B NRC RO Course
Title:
2005BNRCR Day 'Tim 1
Lnstructor:
Whitehouse
==
Description:==
2005B NRC RO Exain TermiYear: 10i2UOj
~
~~~~~
Toral Possible Points:
75.00 Median Score:
70.00 I-Iighest Score:
72.00 Student in this group:
5 Mean Score:
70.00 Lowest Score:
67.00 Standard Deviation:
1.90 Reliability Coefficient (RR20):
0.14 Page 1 10/23/05
2005B NRC Written Exam Standard Item Analysis Report On NRC-Exam1 Version A Course #:
2005B NRC RO Course
Title:
2005BNRCR DayiTiine:
Instructor:
Whitehouse
==
Description:==
2005B NRC RO Exam TennlYear: 10/2SlO5 Total Possible Points:
Student in this group:
Standard Deviation :
75.00 Median Score:
70.00 Highest Score:
Lowest Score:
5 Mean Score:
70.00 1.90 Reliability Coefficient (IW20):
0.14 72.00 67.00 Page 2 10128105
2005B NRC Written Exam Standard Item Analysis Report On I\\TRC-ExamI Version A 1
Correct Group Responses I poinL 1 correct No.
Total Upper 17% Lower 2?0/b Biserial Answer Course #:
2005B NRC RO Course
Title:
2005SNRCR DayiTime:
Response Frequencies 1 Non Distracto:
A B
C D
Instructor:
Uqiitehouse
==
Description:==
2005B NRC RO Exam TeniiiYear: 10!28/05 Total Possible Points:
75.00 Median Score:
70.00 Highest Score :
72 00 Student in this group:
5 Mean Score:
70.00 Lowest Score:
67 00 Standard Deviation:
1.90 Reliability Coefficient ( W O ) :
0.14 Page 3 10128/05
2005B NRC Written Exam Standard Item Analysis Report On NRC - Exam1 Version A 1
j T o z r l e ~ t Group Res~ollses 1 Point I Correct Response Frequencies
-No Upper 27% Lower 2790 Biserial 4nswer A
B C
D 1
10000% 10000%
10000%
000 A
6 0
0 0
'2 10@00%1 10000%
10000%
000 C
1 0
0 6
0 3
100 00%
100 00%
100 00%
0 00 C
0 0
6 0
4 100 00%
100 00%
100 00%
0 00 A
6 0
0 0
5 10000% 10000%
10000%
000 A
6 0
0 0
6
~10000% 10000%
10000%
000 C
0 0
6 0
Course #:
2005B NRC SRO Course
Title:
2005BNRCS DayiTinie:
Noli Distractoi BCD ABD ABD BCD BCD ABD Instrilctor: Whitehouse
==
Description:==
2005B NRC SRO Exam TennlYear: 1 012SIOj 7
l l O O O O %
10000%
10000%
000 C
8 83 33% 100 00%
100 00%
0 09 C
9 10000% 10000%
10000%
000 B
110 10000%
10000%
10000%
000 D
11 10000%
10000%
10000%
000 A
1 6
0 0
0 12 10000% 10000%
10000%
000 A
13 8333% 10000%
10000%
009 A
14 33 33%
50 00%
50 00%
0 15 C
'15 10000%/ 10000%
10000%
000 B
0 6
16 6667% 10000%
000%
0 81 B
17 10000% 10000%
10000%
000 C
18 10000% 10000%
10000%
000 A
19 10000% 10000%
10000%
000 A
20 10000%
10000%
10000%
000 B
21 10000%
1 0 0 ~ ~ % ~ ~ 0 0 0 % 000 D
22 83 33%
50 00%
10000%
-043 B
23 10000% 10000%
10000%
000 D
24 10000%
10000%
10000%
000 B
25 6667%
5000%
5000%
027 B
26 10000% 100 00%
100 00%
0 00 C
27 10000% 100 00%
100 00%
0 00 D
28 10000% 10000%
10000%
000 B
29 8333%
50 00%
100 00%
-043 B
30 8333% 100 00%
50 00%
026 A
31 10000% 10000%
10000%
000 C
32 100 00%
100 00%
100 00%
0 00 A
33 10000% 10000%
10000%
000 A
34 10000% 10000%
10000%
000 A
35 100 00%
100 00%
100 00%
0 00 A
36 I 6667%
5000%
5000%
0 2 7 D
I
~~
Total Possible Points:
100.00 Median Score:
89.50 Highest Score:
93.00 Student in this group:
6 Mean Score:
89.50 Low est Score:
85.00 Standard Deviation:
2.63 Reliabiliq Coefficient (IW.20):
0.19 0
0 6
0 1 ABD AD ACD 0
1 5
0 0
6 0
0 0
0 0
6 ABC 1
BCD 6
0 0
0 BCD 5
1 0
0 CD 1
1 2
2 j
0 0
ACD 0
4 0
2 AC 0
0 6
0 ABD 6
0 0
0 BCD 6
0 0
0 BCD 0
6 0
0 ACD 0
0 0
6 ABC 1
5 0
0 CD 0
0 0
6 1
ABC 0
6 0
0 ACD 0
4 0
2 AC 0
0 6
0 ABD 0
0 0
6 ABC 0
6 0
0 ACD 0
5 1
0 AD 5
0 0
1 BC 0
0 6
0 ABD 6
0 0
0 BCD 6
0 0
0 BCD 6
0 0
0 BCD 6
0 0
0 BCD 0
2 0
4 AC i oiza105 Page 1