ML061450053
| ML061450053 | |
| Person / Time | |
|---|---|
| Site: | San Onofre  |
| Issue date: | 10/28/2005 |
| From: | Operations Branch IV |
| To: | Southern California Edison Co |
| References | |
| 50-361/05-301, 50-362/05-301 | |
| Download: ML061450053 (5) | |
Text
2005 October SONGS NRC Written Exam Exam Item Analysis Analysis items selected using ES-403-1 guidelines. Number 6 . ..;evaluate validity of questions missed by half or more of the applicants. Exam item analysis identified the following questions as being missed by half or more of the ROs and SROs applicants for questions 1-75, or in the case of the SRO only questions76-100, questions missed by half or more of the SRO applicants only.
Question #37 65% failure rate This question was found to be technically valid. One distracter was selected, which could indicate a common mis-conception in the topic area and/or test talung techniques. Examinees will be provided with remedial training focused on Steam Bypass Control System (SBCS). The training program will be evaluated for inclusion of these weaknesses.
Question #70 65% failure rate This question was found to be technically valid. Two different distracters were selected, which would indicate a generic weakness in this topic area.
Examinees will be provided with remedial training focused on Source Range Nuclear Instrumentation OPERABILITY and the applicable Technical Specifications. The training program will be evaluated for inclusion of these weaknesses.
SRO-only Question #92 77% failure rate This question was found to be technically valid. Three different distracters were selected, which could indicate a generic weakness in this topic area. Examinees will be provided with remedial training focused on RCS Pressure Safety Limit Basis. The training program will be evaluated for inclusion of these weaknesses.
SRO-only Question #98 50% failure rate This question was found to be technically valid. Three different distracters were selected, which could indicate a generic weakness in this topic area. Examinees will be provided with remedial training focused on 10CFR100 Radiation Release limits. The training program will be evaluated for inclusion of these weaknesses.
SRO-only Question #99 83% failure rate This question was found to have some technical issues. The fire burning for 20 minutes meets the threshold for an Unusual Event, which was the distracter. The information in the stem identifying the control room being evacuated was intended for the correct answer to be an Alert but lacked the information as to weather or not control of shutdown systems was established locally or at the shutdown panel. The question will be modified prior to future use. The training program will be evaluated for inclusion of these weaknesses.
2005B NRC Vi'ritten Exam Standard Item Analysis Report On NRC-Exam1 Version A Course 8. 2005B NRC RO Lnstructor: Whitehouse Course
Title:
2005BNRCR
Description:
2005B NRC RO Exain Day ' T i m TermiYear: 10i2UOj
~ ~~~~~
Toral Possible Points: 75.00 Median Score: 70.00 I-Iighest Score: 72.00 Student in this group: 5 Mean Score: 70.00 Lowest Score: 67.00 Standard Deviation: 1.90 Reliability Coefficient (RR20): 0.14 1
No.
I Correci G i o ~ i pResponses Total Upper 27% Lowei- 27% Biserial 1 1 poinl correct Answer A B C Response Frequencies D
1 1
Non Disrractor 1 100.00% 100.00% 100.00% 0.00 A 5 0 0 0 1 BCD 2 1oo.ooo/b 100.00% 100.00% 0.00 C 0 0 5 0 A3D 3 /IOG.OO% 100.00% 100.00% 0.00 C 0 0 5 0 ABD 4 100.00%/ 100.00% 100.00% 0.00 A 5 0 1 0 0 1 BCD 5 loo.oo%l ~0o.Oo~G ~00.00% 0.00 A I 5 0 0 0 BCD 6 100.00% 100.00% 100.00% 0.00 C 0 0 5 / 0 ABD 7 100.00% 100.00% 100.00~0 0.00 C 0 0 5 0 I ' ABD 1 8 100.00%] 100.00% 100.00% 0.00 1 c 0 0 1 5 0 A3D 9 ~loo.oo~o/ 100.00% 100.00% 0.00 5 0 5 0 0 ACD
/IO /100.00%/100.00% 100.00% 0.00 D 0 0 0 1 5 j ABC
'11 /IOO.OOYo~ 100.00% 1 100.00% 0.00 A 5 01 01 0 BCD 12 ~ l o o . o o ~ / o100.00% 1 100.0056 0.00 A 5 0 0 1 0 1 BCD 13 100.00% 100.00% 100.00% 0.00 A 5/ 0 0 0' j I BCD 14 15 1 100.00% 100.00%
80.00% 100.00%
100.00%
100.00%
0.00 0.26 C
B 0
0 1 4 0
0 5
1 0
I I ABD AC 16 6G.OO% 100.00% 0.00% 0.86 B 0 3 0 2 AC 17 100.00% 100.00% 100.00% 0.00 1 C 0 0 5 0 ABD 18 100.00% 100.00% 100.00% 0.00 k 5 0 0 0 BCD 19 80.00% 0.00% 100.00% -0.53 A 4 0 1 0 BD 20 60.00% 100.00% 0.00% 0.65 B 1 3 1 0 D 21 100.00% 100.00% 100.00% 0.00 D 0 0 0 5 ABC 22 100.00% 100.00% 100.00% 0.00 B 0 5 0 0 ACD 23 100.00% 100.00% 100.00% 0.00 D 0 0 0 5 ' ABC 24 100.00% 100.00% 100.00% 0.00 B 0 5 0 0 ACD 25 100.00% 100.00% 100.00% 0.00 3 0 5 0 0 ACD 26 100.00% 100.00% 100.00% 0.00 C 0 0 5 0 ABD 27 100.00% 100.00% 100.00% 0.00 D 0 0 0 5 ABC 28 8O,0O0h 100.00% 0.00% 0.79 I B 0 4 0 1 AC 29 40.00% 100.00% 0.00% 0.43 B 0 2 2 1 A 30 100.00% 100.00% 100.00% 0.00 A 5 0 0 0 BCD 31 100.00%' 100.00% 100.00% 0.00 C 0 0 5 0 ABD 32 100.00% 100.00% 100.00% 0.00 A 5 0 0 0 BCD 33 100.00% 100.00% 100.00% 0.00 A 5 0 0 0 BCD 34 100.00% 100.00% 100.00% 0.00 A 5 0 0 0 BCD 35 100.00% 100.00% 100.00% 0.00 A 5 0 0 0 BCD 36 100.00% 100.00% 100.00% 0.00 D 0 0 0 5 ABC Page 1 10/23/05
2005B NRC Written Exam Standard Item Analysis Report On NRC-Exam1 Version A Course #: 2005B NRC RO Instructor: Whitehouse Course
Title:
2005BNRCR
Description:
2005B NRC RO Exam DayiTiine: TennlYear: 10/2SlO5 Total Possible Points: 75.00 Median Score: 70.00 Highest Score: 72.00 Student in this group: 5 Mean Score: 70.00 Lowest Score: 67.00 Standard Deviation : 1.90 Reliability Coefficient (IW20): 0.14 Page 2 10128105
2005B NRC Written Exam Standard Item Analysis Report On I\TRC-ExamI Version A Course #: 2005B NRC RO Instructor: Uqiitehouse Course
Title:
2005SNRCR
Description:
2005B NRC RO Exam DayiTime: TeniiiYear: 10!28/05 Total Possible Points: 75.00 Median Score: 70.00 Highest Score : 72 00 Student in this group: 5 Mean Score: 70.00 Lowest Score: 67 00 Standard Deviation: 1.90 Reliability Coefficient ( W O ) : 0.14 No.
1 Correct Group Responses I 1 poinL Total Upper 17% Lower 2?0/b Biserial correct Answer A B C Response Frequencies D
1 Non Distracto:
Page 3 10128/05
2005B NRC Written Exam Standard Item Analysis Report On NRC-Exam1 Version A Course #: 2005B NRC SRO Instrilctor: Whitehouse Course
Title:
2005BNRCS
Description:
2005B NRC SRO Exam DayiTinie: TennlYear: 1012SIOj
~~
Total Possible Points: 100.00 Median Score: 89.50 Highest Score: 93.00 Student in this group: 6 Mean Score: 89.50 Low est Score: 85.00 Standard Deviation: 2.63 Reliabiliq Coefficient (IW.20): 0.19 1
-No j T o z r l e ~Group t Res~ollses 1 I Point Upper 27% Lower 2790 Biserial Correct 4nswer A B C Response Frequencies D ,
Noli Distractoi 1 10000% 10000% 10000% 000 A 6 0 0 0 BCD
'2 10@00%1 10000% 10000% 000 C 1 0 0 6 0 ABD 3 100 00% 100 00% 100 00% 0 00 C 0 0 6 0 ABD 4 100 00% 100 00% 100 00% 0 00 A 6 0 0 0 BCD 5 10000% 10000% 10000% 000 A 6 0 0 0 BCD 6 ~10000% 10000% 10000% 000 C 0 0 6 0 ABD 7 llOOOO% 10000% 10000% 000 C 0 0 6 0 1 ABD 8 83 33% 100 00% 100 00% 0 09 C 0 1 5 0 j AD 9 10000% 10000% 10000% 000 B 0 6 0 0 ACD 110 10000% 10000% 10000% 000 D 0 0 0 6 ABC 11 10000% 10000% 10000% 000 A 1 6 0 0 0 1 BCD 12 10000% 10000% 10000% 000 A 6 0 0 0 BCD 13 8333% 10000% 10000% 009 A 5 1 0 0 CD 14 33 33% 50 00% 50 00% 0 15 C 1 1 2 2
'15 10000%/ 10000% 10000% 000 B 0 6 0 ' 0 ACD 16 6667% 10000% 000% 0 81 B 0 4 0 2 AC 17 10000% 10000% 10000% 000 C 0 0 6 0 ABD 18 10000% 10000% 10000% 000 A 6 0 0 0 BCD 19 10000% 10000% 10000% 000 A 6 0 0 0 BCD 20 10000% 10000% 10000% 000 B 0 6 0 0 ACD 21 10000% 1 0 0 ~ ~ % ~ ~ 0 0 0 % 000 D 0 0 0 6 ABC 22 83 33% 50 00% 10000% -043 B 1 5 0 0 CD 23 10000% 10000% 10000% 000 D 0 0 0 6 1 ABC 24 10000% 10000% 10000% 000 B 0 6 0 0 ACD 25 6667% 5000% 5000% 027 B 0 4 0 2 AC 26 10000% 100 00% 100 00% 0 00 C 0 0 6 0 ABD 27 10000% 100 00% 100 00% 0 00 D 0 0 0 6 ABC 28 10000% 10000% 10000% 000 B 0 6 0 0 ACD 29 8333% 50 00% 100 00% -043 B 0 5 1 0 AD 30 8333% 100 00% 50 00% 026 A 5 0 0 1 BC 31 10000% 10000% 10000% 000 C 0 0 6 0 ABD 32 100 00% 100 00% 100 00% 0 00 A 6 0 0 0 BCD 33 10000% 10000% 10000% 000 A 6 0 0 0 BCD 34 10000% 10000% 10000% 000 A 6 0 0 0 BCD 35 100 00% 100 00% 100 00% 0 00 A 6 0 0 0 BCD 36 I I
6667% 5000% 5000% 027 D 0 2 0 4 AC Page 1 i oiza105