ML063110472
| ML063110472 | |
| Person / Time | |
|---|---|
| Site: | Byron |
| Issue date: | 11/06/2006 |
| From: | Palagi B NRC/RGN-III/DRS/OLB |
| To: | |
| Shared Package | |
| ML062260233 | List: |
| References | |
| TQ-AA-104-3001, Rev 2 | |
| Download: ML063110472 (2) | |
Text
~
FOR THE BYRON INITIAL EXAMINATION - JUNE 2006
Exel c!m.
Reference Nuclear Remarks DATE:
7/6/06 EXAM: WRI77EN / WALK-THROUGH I
Test Item
\\
I TQ-AA-104-3001 Revision 2 5 Exam Comment Sheet Page 1 of 1 SUBMITTED BY:
Martv J. Jorrrensen RO/SRO SlMULATOR SCENARIO (C~I Concern or Problem The question was written based on action requirements of 1 BOA PRI-5. however the 1 D SG Level indication is not available on the Fire Hazards Panel; 1 A/ I B SG Levels only.
Sheet 1 of I le one)
I Recommended Resolution Based on the indication available at the Fire Hazards Panel and the distracton being actions outside of the procedure, there is no correct answer to choose from. Recommend deleting this question.
Additional comments:
Exam Analyzer cpmments:
&&Od 1.3 $!lL&frn.
Final Resolution:
Rcviewcd by:
?i&?k
~~
~
Approved by:
NOTE: This document shall be retained until all regulatory actions associated with the exam are complete, at which time it may be discarded.
c TQ-AA-210-5108 Revision 0 Page 1 of 2 Nuclear Post Examination Test Item Analysis Lesson Plan / Course:
Examination No./
Title:
ILT 04-la Byron ILT 04-la NRC Final Exam Check the results of the examination.
Small class (56) and some questions were missed by three (3) or more trainees. Analysis required for these questions.
0 Large class (>6) and some questions were missed by more than 30% of the class. Analysis required for these questions.
Analysis of questions requested by individual.
17 None of the above apply and no further analysis is necessary.
If an analysis is to be performed, list the question number(s) on the worksheet and review each using the following guidelines. Record the results on the worksheet.
- 1. Review each question to ensure it is worded clearly and is not ambiguous. Ensure that it is properly constructed. Refer to TQ-AA-210-2302, Test Item Design and Approval Job Aid.
- 2. Review each question to ensure that it ties properly to the learning objectives condition, performance, and standard.
- 3. Review each question to ensure that it is technically accurate.
- 4. Review each question to ensure that adequate material was presented to allow for achievement of the associated learning objective.
u Determine if action is required for problem questions (e.9. delete from examination bank; revise question, revise lesson plan, etc.). When action is required, ensure a request is initiated, per the Training Management System, for documentation and tracking purposes.
I Completed By: Steve Raine I Date: 07/03/06 I
Request Tracking Number(s):
- c) 459 I
Answer Key Change I Examination Re-grade Authorized by:
Grow Lead Comments:
The threshold being used for question analysis is questions which were missed by >30% of the candidates (per TQ-AA-104-3001, Attachment 14). This is more restrictive than the threshold listed above. SMR I 07/03/06 Recommend remove question #99 and re-grade exams (see explanation). SMR 7/5/06
-P
TQ-AA-210-5108 Revision 0 Page 2 of 2 QUESTION ANALYSIS WORKSHEET L
Question Number Questions missed by >30% of students
- 3 Construction Objective OK?
Based?
(Y - N)
(Y - N)
Y Y
Y Y
Technically Accurate?
(Y - N)
Y Y
(Y - N)
(Y - N)
- 13 Y
Y Y
Y N
- 23 Y
Y Y
Y N
- 2 6 Y
Y Y
Y N
- 28 Y
Y Y
Y N
- 33 Y
Y Y
Y N
- 36 Y
Y Y
Y N
- 38 Y
Y Y
Y N
- 4:
Y Y
Y Y
N
- 43
- 82 I
Y I
Y I
Y I
Y
- 90 Y
Y Y
Y N
- 9 1 Y
Y Y
Y N
- 93 Y
Y Y
Y N
- 95 Y
Y Y
Y N
- 97 Y
Y Y
Y N
- 9!
l y
l y
N I
y I
y M:\\GenCo\\NGG\\Exelon Nuclear Training\\Byron and Braidwood Simulator\\Byron Records\\SIM04-01\\Exam analysis\\Byron ILT 04-1 a NRC Final exam analysis.doc
TQ-AA-210-5108 Revision 0 Page 3 of 2 L
Questions missed by >30% of students:
- 3: No change to grading needed. See question Explanation block on NRC exam for reason.
- 6: No change to grading needed. See question Explanation block on NRC exam for reason.
- 13: No change to grading needed. See question Explanation block on NRC exam for reason.
- 23: No change to grading needed. See question Explanation block on NRC exam for reason.
- 26: No change to grading needed. See question Explanation block on NRC exam for reason.
- 28: No change to grading needed. See question Explanation block on NRC exam for reason.
- 33: No change to grading needed. See question Explanation block on NRC exam for reason.
- 36: No change to grading needed. See question Explanation block on NRC exam for reason.
- 38: No change to grading needed. See question Explanation block on NRC exam for reason.
- 42: No change to grading needed. See question Explanation block on NRC exam for reason.
- 43: No change to grading needed. See question Explanation block on NRC exam for reason.
- 47: No change to grading needed. See question Explanation block on NRC exam for reason.
- 58: No change to grading needed. See question Explanation block on NRC exam for reason.
- 59: No change to grading needed. See question Explanation block on NRC exam for reason.
- 65: No change to grading needed. See question Explanation block on NRC exam for reason.
- 68: No change to grading needed. See question Explanation block on NRC exam for reason.
- 70: No change to grading needed. See question Explanation block on NRC exam for reason.
- 79: No change to grading needed. See question Explanation block on NRC exam for reason.
- 82: No change to grading needed. See question Explanation block on NRC exam for reason.
- 90: No change to grading needed. See question Explanation block on NRC exam for reason.
- 91: No change to grading needed. See question Explanation block on NRC exam for reason.
- 93: No change to grading needed. See question Explanation block on NRC exam for reason.
- 95: No change to grading needed. See question Explanation block on NRC exam for reason.
L d
M:\\GenCo\\NGG\\Exelon Nuclear Training\\Byron and Braidwood Simulator\\Byron Records\\SIM04-01\\Exam analysis\\Byron ILT 04-1 a NRC Final exam analysisdoc
TQ-AA-210-5108 Revision 0 Page 4 of 2
- 97: No change to grading needed. See question Explanation block on NRC exam for reason.
- 99: Recommend question be removed from exam. Question Explanation block on NRC exam lists the actions to take for no indication on ID S/G level and pressure. Upon further review, the Fire Hazards panel only has indications for 1A and 1B S/Gs. For future use of the question, the stem, answer and distractors should be changed to either 1A or 1B S/G, which will then make it procedurally correct.
Supporting reference is Remote Shutdown Panel LP, chapter 62, page 11.
M:\\GenCo\\NGG\\Exelon Nuclear Training\\Byron and Braidwood Simulator\\Byron Records\\SIM04-01 \\Exam analysis\\Byron ILT 04-1 a NRC Final exam analysisdoc
___I-I 1:
I G) 0 I
A I
I h
(n I
I:
I 7
cv 0
c\\JQ b l I
z i
m
L I
Irl I
Is:
-1 I
( O I a
I-I x v a I C U I
I.a
c iternal ITraining Department Identified Issue
~
2006 ILT NRC
~
~-
examanalysis
~~
~
~
I
~
~~
R
~TSD Item:
Yes j
[TAC Issue: No ISRC Issue: Yes
~
Request:
2uestion #99 on the 2006 ILT NRC exam asks for actions in IBOA PRI-5, when RSP indications are not available, and
- he procedure directs obtaining the data from the FHP. As stated the question refers to obtaining 1D SG level, however this is not available on the FHP. Only 1A and 1B SG levels and pressures are available on the FHP.
Recommend changing the stem and answer possibilities to refer to 1A or 1B SG parameters, if this question is to be retained for use in the Byron VISION exam bank.
~
~
~~
Action Plan:
Evaluate whether this question will be added to the Byron VISION exam bank.
[fit is to be added, change the stem and answer possibilities to refer to 1A or 1B SG and delete reference to ID SG.
Final Actions:
~~
TR Requested By 1
Prepared By/Date I
Cog Person/Due 1 Action AssignedlDue ;ActionApproval Jorgensen, Marty J.
Jorgensen, Marty J.
~
~
i 7/7/2006 I
8/6/2006 j Closure Date j Commitment: 1 Priority:
I I
l N
o I
I I
( F e
3 c
0 ' c B
l e
0 C
0
I C 0
C
- / 1 2 A rpU C
D
- I 1 3 A
0
..8.
D 1 4 -
0 C
D 1 5 -
I B C
D
-1;::; -
E t = I 19 A I 0
C e 2 0 A B 'b D
2 1 A 0
D h-
- -~ -~~
3 -
z rn 0 -
2 2 A B
C e
t 2 3 A 0 e D
9 -
m % 2 4 A
0 D
B -
25-0 C
D 26-0 C
D 0 -
g -
2 7 a b 0 C1 D
z 2 8 A I 81 C
2 9 A 0
C
+
3 0 -
B C
D I'
~~~
31-0 C
I D 3 2 r A br I C D
c 3 3 l A 1 0 D
3 4 r A + C D
3 5 l A 0
br D
3 6 A
- C D
3 7 A 0
C r
3 8 A B
C r
b 3 9 A B
C 4 0 A B
C ubr 9 -
4 1 A B
C. I p r ii i---
~
4 2 A C
D 4 3 l A le C
D 4 4 r A 0
PC D
4 5 A 0
C u g U I
N -
I
'n - -
4 6 A 0 0 D
Y 4 7 A C
D 4 - -
c w
N 4
a
~
B e D
4 9
A 0
C e
- 5 0 A Ue C D
PART 1
m.. be r"r,brll"* i)omn
- n. L re I-0".*>
9 8
7 6
5 I
PART 2 KEY r9r 3 -
r6..
5 1 A B
.C D
5 2 r A B
D t
5 3 A B
rb.
D 5 4 r k.
B C
D 55-B C
D m -
56 A i B a D 5 7 A B
D 5 8 A B
rgU D
5 9 r A B
r0.
D 6 0 A B
Pe D
6 1 A B
C 43-6 2 - B C
D 6 3 A B
C r) 6 4 A B
rC D
6 5 A e C D
66-B C
D 6 7 r A B
C 68 A I B C
rb 6 9 A
- C D
7 0 A e C D
7 1 A 0
r9.
D I % -
rn 0 -
7 2 A.rb C
D 7 3 6 B C
D z
74-0 C
D m,
7 5 r A B e D 9 -
7 6 A B
C D
2 0 -
2 -
77 A 1 B
C D
78 A T B
C D
7 9 A B
C D
i g 8 0 - A B
C D
7
-1 t
L- -~
- -E-::
r B C :
D
-LFA B
C -D a
4
~
B c
D a
5
~
B c
D a
7
~
B c
D a
a
~
B c
D 8 6 A B
C D
8 9 A B
C D
91 A
- B C
D 9 2 A B
C D
9 3 A B
C D
94 A J B C
D 9 5 A B
C D
8 1
9 6 A B
C D
9 7 A B
C D
9 a
~
B c
D 7
9 9
A B
C D
I 0 0 A B
C D
25+
0 C
D 2 6 r k 0
C D
2 7 4 -
0 r C D
2 9 A 0
C 3 0 +
0 C I D 3 1 3 r 0
C D
3 2 A C
D 3 3 A 0
D 34 A
I C D 3 5 l A 0
I(cr D
3 6 l A 4-C D I 3 7 A 0
C 2
a
~
0 C - B -
~
3a A
0 c1 -e 3 9 A B
C d r ~
40 A
0 1 C rP.
41 A i 0
C 4 2 A C
D 43 - A 43-C D
4 4 A 0
D 45 A
0 I C Up 4 6 A 0
.C D
4 7 r A 4 W I C D
~
4 a l ~ 0 Q
D ]
4 9 A 0
c Ip.
50 40 30 20 10 1 4
3 2
1 0
100 90 ao r70 9 1 a
7 6
Y 88 A 89 A 90 A I 91 A 92 1 A 93-94 A 95 rcru 96 A I 97 A 98 1 A D
D D
D D
D D
D D
D
- D 4
D D
D *
.9p D
D D
D D
D D
D D
D D
D D
4 3 -
r%
D D
D D
C C
C
- C C
C C
- 6.
(.Qp D
D D
D D
D D
D D
D KEY u6 El PART 2 TOTAL J
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
1 2
3 4
5 6
7 8
9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 Answer :
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer :
Answer:
Answer:
B D
C D
D B
B A
D A
C B
C A
A D
D B
D C
C D
C C
A A
A D
D
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer :
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
A A
B C
B C
B D
D D
D D
B B
C D
C 0
C D
B C
C C
A A
C C
C
Quest No:
u Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
L Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
L.
Quest No:
59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer :
Answer:
Answer :
Answer :
Answer :
Answer:
C C
D A
D C
B A
D D
B B
C B
A A
C A
A B
B A
C D
D B
B B
B
Quest No:
d Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
Quest No:
88 89 90 91 92 93 94 95 96 97 98 Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
Answer:
D B
B C
B A
B A
C C
Quest No:
99 Answer:
Quest No:
100 Answer:
A