ML063110472

From kanterella
Jump to navigation Jump to search
Facility Post Examination Comments for the Byron Initial Examination - June 2006
ML063110472
Person / Time
Site: Byron  Constellation icon.png
Issue date: 11/06/2006
From: Palagi B
NRC/RGN-III/DRS/OLB
To:
Shared Package
ML062260233 List:
References
TQ-AA-104-3001, Rev 2
Download: ML063110472 (2)


Text

~

FOR THE BYRON INITIAL EXAMINATION JUNE 2006

\ I Exelc!m. Attachment 15 TQ-AA-104-3001 Revision 2 Nuclear Exam Comment Sheet Page 1 of 1 DATE: 7/6/06 SUBMITTED BY: Martv J. Jorrrensen RO/SRO Sheet 1 of I EXAM: WRI77EN / WALK-THROUGH SlMULATOR SCENARIO (C~I le one)

I Test Item I Concern or Problem Recommended Resolution Reference Remarks The question was written Based on the indication available at based on action requirements the Fire Hazards Panel and the of 1 BOA PRI-5. however the distracton being actions outside of 1 D SG Level indication is not the procedure, there is no correct available on the Fire Hazards answer to choose from. Recommend Panel; 1 A/ I B SG Levels only. deleting this question.

Additional comments:

Exam Analyzer cpmments: &&Od 1.3 $!lL&frn.

Final Resolution:

~~ ~

Rcviewcd by: ?i&?k Approved by:

NOTE: This document shall be retained until all regulatory actions associated with the exam are complete, at which time it may be discarded.

c TQ-AA-210-5108 Revision 0 Page 1 of 2 Nuclear Post Examination Test Item Analysis Lesson Plan / Course: ILT 0 4 - l a Examination No./

Title:

Byron ILT 0 4 - l a NRC Final Exam Check the results of the examination.

Small class (56) and some questions were missed by three (3) or more trainees. Analysis required for these questions.

0 Large class (>6) and some questions were missed by more than 30% of the class. Analysis required for these questions.

Analysis of questions requested by individual.

17 None of the above apply and no further analysis is necessary.

If an analysis is to be performed, list the question number(s) on the worksheet and review each using the following guidelines. Record the results on the worksheet.

1. Review each question to ensure it is worded clearly and is not ambiguous. Ensure that it is properly constructed. Refer to TQ-AA-210-2302, Test Item Design and Approval Job Aid.
2. Review each question to ensure that it ties properly to the learning objectives condition, performance, and standard.

u

3. Review each question to ensure that it is technically accurate.
4. Review each question to ensure that adequate material was presented to allow for achievement of the associated learning objective.

Determine if action is required for problem questions (e.9. delete from examination bank; revise question, revise lesson plan, etc.). When action is required, ensure a request is initiated, per the Training Management System, for documentation and tracking purposes.

I Completed By: Steve Raine I Date: 07/03/06 I Request Tracking Number(s): - c) 459 I Answer Key Change I Examination Re-grade Authorized by: Grow Lead Comments:

The threshold being used for question analysis is questions which were missed by >30% of the candidates (per TQ-AA-104-3001, Attachment 14). This is more restrictive than the threshold listed above. SMR I 07/03/06 Recommend remove question #99 and re-grade exams (see explanation). SMR 7/5/06 -P

TQ-AA-210-5108 Revision 0 Page 2 of 2 L

QUESTION ANALYSIS WORKSHEET Construction Objective Technically Question Number OK? Based? Accurate?

(Y - N) (Y - N) (Y - N) (Y - N) (Y - N)

Questions missed by >30% of students

  1. 3 Y Y Y Y Y Y
  1. 13 Y Y Y Y N
  1. 23 Y Y Y Y N
  1. 2 6 Y Y Y Y N
  1. 28 Y Y Y Y N
  1. 33 Y Y Y Y N
  1. 36 Y Y Y Y N
  1. 38 Y Y Y Y N
  1. 4: Y Y Y Y N
  1. 43
  1. 82 I Y I Y I Y I Y
  1. 90 Y Y Y Y N
  1. 9 1 Y Y Y Y N
  1. 93 Y Y Y Y N
  1. 95 Y Y Y Y N
  1. 97 Y Y Y Y N
  1. 9!

l y l y N I y I y M:\GenCo\NGG\ExelonNuclear Training\Byron and Braidwood Simulator\Byron Records\SIM04-01\Exam analysis\Byron ILT 04-1a NRC Final exam analysis.doc

TQ-AA-210-5108 Revision 0 Page 3 of 2 L

Questions missed by >30% of students:

  1. 3: No change to grading needed. See question Explanation block on NRC exam for reason.
  1. 6: No change to grading needed. See question Explanation block on NRC exam for reason.
  1. 13: No change to grading needed. See question Explanation block on NRC exam for reason.
  1. 23: No change to grading needed. See question Explanation block on NRC exam for reason.
  1. 26: No change to grading needed. See question Explanation block on NRC exam for reason.
  1. 28: No change to grading needed. See question Explanation block on NRC exam for reason.
  1. 33: No change to grading needed. See question Explanation block on NRC exam for reason.
  1. 36: No change to grading needed. See question Explanation block on NRC exam for reason.
  1. 38: No change to grading needed. See question Explanation block on NRC exam for reason.
  1. 42: No change to grading needed. See question Explanation block on NRC exam for reason.

L

  1. 43: No change to grading needed. See question Explanation block on NRC exam for reason.
  1. 47: No change to grading needed. See question Explanation block on NRC exam for reason.
  1. 58: No change to grading needed. See question Explanation block on NRC exam for reason.
  1. 59: No change to grading needed. See question Explanation block on NRC exam for reason.
  1. 65: No change to grading needed. See question Explanation block on NRC exam for reason.
  1. 68: No change to grading needed. See question Explanation block on NRC exam for reason.
  1. 70: No change to grading needed. See question Explanation block on NRC exam for reason.
  1. 79: No change to grading needed. See question Explanation block on NRC exam for reason.
  1. 82: No change to grading needed. See question Explanation block on NRC exam for reason.
  1. 90: No change to grading needed. See question Explanation block on NRC exam for reason.
  1. 91: No change to grading needed. See question Explanation block on NRC exam for reason.
  1. 93: No change to grading needed. See question Explanation block on NRC exam for reason.
  1. 95: No change to grading needed. See question Explanation block on NRC exam for reason.

d M:\GenCo\NGG\Exelon Nuclear Training\Byron and Braidwood Simulator\Byron Records\SIM04-01\Exam analysis\Byron ILT 04-1a NRC Final exam analysisdoc

TQ-AA-210-5108 Revision 0 Page 4 of 2

- #97: No change to grading needed. See question Explanation block on NRC exam for reason.

  1. 99: Recommend question be removed from exam. Question Explanation block on NRC exam lists the actions to take for no indication on I D S/G level and pressure. Upon further review, the Fire Hazards panel only has indications for 1A and 1B S/Gs. For future use of the question, the stem, answer and distractors should be changed to either 1A or 1B S/G, which will then make it procedurally correct.

Supporting reference is Remote Shutdown Panel LP, chapter 62, page 11.

M:\GenCo\NGG\Exelon Nuclear Training\Byron and Braidwood Simulator\Byron Records\SIM04-01\Exam analysis\Byron ILT 04-1a NRC Final exam analysisdoc

___I-I :1 I :I I

7 cv

. 0 c\JQ I

G) 0 bl I h

I A I (n

z i m I

L I Irl

-1 I Is:

I I a (OI I- xva I II C.a U

iternal ITraining Department Identified Issue ~TSDItem: Yes j I

~

~

R 2006 ILT NRC~-

~ examanalysis

~~ ~ ~

~ ~~

[TAC Issue: N o ISRC Issue: Yes Request:

2uestion #99 on the 2006 ILT NRC exam asks for actions in IBOA PRI-5,when RSP indications are not available, and

he procedure directs obtaining the data from the FHP. As stated the question refers to obtaining 1D SG level, however this is not available on the FHP. Only 1A and 1B SG levels and pressures are available on the FHP.

Recommend changing the stem and answer possibilities to refer to 1A or 1B SG parameters, if this question is to be retained for use in the Byron VISION exam bank.

~ ~

~~

Action Plan:

Evaluate whether this question will be added to the Byron VISION exam bank.

[fit is to be added, change the stem and answer possibilities to refer to 1A or 1B SG and delete reference to ID SG.

c Final Actions:

I

~~

TR Requested By 1 Prepared By/Date Cog Person/Due 1 Action AssignedlDue ;ActionApproval Jorgensen, Marty J. Jorgensen, Marty J. ~

7/7/2006 ~

8/6/2006 j Closure Date i

I j Commitment:

I 1 Priority: I

..- l N o I I I

(F PART 1 e 3

  • c 0 ' c B l e 0 C 0 ' C 4 b IC ro, IC 0 I C 0 C

- / 1 2 A rpU C D

--I13

- 14-A 0 0

..8.

C D

D E

15- I B C D

-1;:

t 3

rn

=I h

19 2 0 A 2 1 A A I 0

B-~ 'b 0 -

C

-~~

e D

D 0 - 2 2 A B C e t 9 -

z 2 3 A 0 e D m % 2 4 A 0 D B -

z 0 -

25-26-0 0

C C

D D

g- 2 7 a b 0 C1 D ii 28 A I 2 9 A 30-81 0

B C

C C

+

D I

31-32 r A br 0 C I C

~~~

I D D

c 3 3 l A 34rA 1 0

+ C D

D 3 5 l A 3 6 A

  • 0 br C

D D

3 7 A 3 8 A 0

B C r &

C r b

- 3 9 A 4 0 A B

B C -

C ubr i -- -

9-

~

4 1 A B C . I p r

-I -

- 4 2 A 43lA le C

C D

D N 44rA 0 PC D I

'n 4

4 5 A 4 6 A 0

0 0 C u g U D

Y 4 7 A C D c

w

- N 4 a ~B e D

- 4 9 A 0 C e

- 5 0 A Ue C D

-- 9 8 7 6 5 m.. b e r"r,brll"* i)omn

n. L r e I-0" .*>

m  %

I r9r 3 - KEY r6..

PART 2

- 5 1 A 52rA B

B

.C D D

t -

5 3 A 54rk.

B B

rb.

C D

D 55-56 A i B

B a C D D

5 7 A 5 8 A B

B rgU D

D 59rA 6 0 A B

B r0.

Pe D

D 7

6 1 A 6 2 - B B C C

43-D

-- 6 3 A 6 4 A B

B rC C r)

D 6 5 A e C D

-1

- 66-67rA B

B C

C D

t I % -

rn 68 A 6 9 A 7 0 A L-7 1 A e

I B

-~

0 C

C C

r9.

rb D

D D

z -

0 -

m, 7 2 A 7 3 6

.rb B

C C

D D

74- 0 C D 9 - 75rA B e D 2

0 - 7 6 A B C D 2-i --E-::

g 77 A1 B C D 78 AT B C D 7 9 A B C D 80-A B C D rB C  :

D

- a 4 ~B c D a

8 6 A 5 ~B B

c C

D D

- a a

7 a

~B

~B c

c D

D

-LFA 8 9 A B B

C C -D D

91 9 2 A A -B B

C C

D D

- 9 3 A 94 A J B

B C

C D

D 1 -

9 5 A 9 6 A B

B C

C D

D 8

- 9 7 A 9 a ~B B C c

D D

7 9 9 A B C D I 0 0 A B C D

25+ 0 C D 2 6 r k 0 C D 274- 0 r C D 2 a ~0 C - B -

2 9 A 0 C *

~

30+ 0 C I D 3 1 3 r 0 C D 3 2 A C D 3 3 A 0

  • D 34 A IC D 35lA 0 I(cr D 36lA 4- C D I 3 7 A 0 C %

3a A 0 c1 -e 3 9 A B C d r ~

_ 40 _ A _0 1 ~ C rP.

41 A i 0 C 4 2 A C D 43 - A 43- C D 4 4 A 0 D 45 A 0 I C Up 4 6 A 0 .C D 47rA 4W IC D 4 a l ~ 0 Q D ]

4 9 A 0 c Ip. $

100 50 91 90 40 a

ao 30 7

r70 20 6

10 1 Y 4 3 2 1 0 J TOTAL KEY PART 2 u6 D

D D

D D

D D

D D

D D

4 D

D D

.9p D

D D

D D

D D

D D

D D

D D

43-r%

D D

D D

88 A C

  • 89 A C D

_90

_ A I C D 91 A

  • D 92 1 A C D 93- C D 94 A C D 95 rcru C D 96 A I 6 . D 97 A D 98 1 A (.Qp D El

Quest No: 1 Answer : B Quest No: 2 Answer: D Quest No: 3 Answer: C Quest No: 4 Answer: D Quest No: 5 Answer: D Quest No: 6 Answer: B Quest No: 7 Answer: B Quest No: 8 Answer: A Quest No: 9 Answer: D Quest No: 10 Answer: A Quest No: 11 Answer: C Quest No: 12 Answer: B Quest No: 13 Answer: C Quest No: 14 Answer: A Quest No: 15 Answer: A Quest No: 16 Answer: D Quest No: 17 Answer: D Quest No: 18 Answer: B Quest No: 19 Answer: D Quest No: 20 Answer: C Quest No: 21 Answer: C Quest No: 22 Answer: D Quest No: 23 Answer: C Quest No: 24 Answer: C Quest No: 25 Answer: A Quest No: 26 Answer: A Quest No: 27 Answer : A Quest No: 28 Answer: D Quest No: 29 Answer: D

Quest No: 30 Answer: A Quest No: 31 Answer: A Quest No: 32 Answer: B Quest No: 33 Answer: C Quest No: 34 Answer: B Quest No: 35 Answer: C Quest No: 36 Answer: B Quest No: 37 Answer: D Quest No: 38 Answer: D Quest No: 39 Answer: D Quest No: 40 Answer: D Quest No: 41 Answer: D Quest No: 42 Answer: B Quest No: 43 Answer : B Quest No: 44 Answer: C Quest No: 45 Answer: D Quest No: 46 Answer: C Quest No: 47 Answer: 0 Quest No: 48 Answer: C Quest No: 49 Answer: D Quest No: 50 Answer: B Quest No: 51 Answer: C Quest No: 52 Answer: C Quest No: 53 Answer: C Quest No: 54 Answer: A Quest No: 55 Answer: A Quest No: 56 Answer: C Quest No: 57 Answer: C Quest No: 58 Answer: C

Quest No: 59 Answer: C u Quest No: 60 Answer: C Quest No: 61 Answer: D Quest No: 62 Answer: A Quest No: 63 Answer: D Quest No: 64 Answer: C Quest No: 65 Answer: B Quest No: 66 Answer: A Quest No: 67 Answer: D Quest No: 68 Answer: D Quest No: 69 Answer: B Quest No: 70 Answer: B Quest No: 71 Answer: C Quest No: 72 Answer: B L

Quest No: 73 Answer: A Quest No: 74 Answer: A Quest No: 75 Answer: C Quest No: 76 Answer: A Quest No: 77 Answer: A Quest No: 78 Answer: B Quest No: 79 Answer: B Quest No: 80 Answer: A Quest No: 81 Answer: C Quest No: 82 Answer : D Quest No: 83 Answer: D Quest No: 84 Answer : B Quest No: 85 Answer : B L.

Quest No: 86 Answer : B

, Quest No: 87 Answer: B

Quest No: 88 Answer: D d Quest No: 89 Answer: B Quest No: 90 Answer: B Quest No: 91 Answer: C Quest No: 92 Answer: B Quest No: 93 Answer: A Quest No: 94 Answer: B Quest No: 95 Answer: A Quest No: 96 Answer: C Quest No: 97 Answer: C Quest No: 98 Answer:

Quest No: 99 Answer:

Quest No: 100 Answer: A