ML081221015
| ML081221015 | |
| Person / Time | |
|---|---|
| Site: | Waterford  |
| Issue date: | 03/24/2008 |
| From: | Division of Reactor Safety IV |
| To: | Entergy Operations |
| References | |
| 50-382/08-301 | |
| Download: ML081221015 (17) | |
Text
OBDI 202 - INITIAL OPERATOR LICENSING PROCESS DRAFT ASSIGNMENT TICKLER Chief: Brian T. Larson 1 Facility: w3 First Date of Exam: 3/21/2008 1 Written Exam Developed I
By: NRC / Facility I Operating Test Developed By: NRC / Facility 11 Due Date I Descrintion 1 DateComalete I Initials I Nntas produced by Chief Examiner
ES-20 I Examination Outline Quality Checklist Form ES-201-2 Waterford 3 Date of Examination: 3/24/08 Task Description Initials
- a. Verify that the outline(s) fit(s) the appropriate model per ES-402.
- b. Assess whether the outline was systematically and randomly prepared in accordance with Section D.l of ES-401 and whether all WA categories are appropriately sampled.
- c. Assess whether the outline over-emphasizesany systems, evolutions, or generic topics.
- d. Assess whether the justifications for deselected or rejected WA statements are I appropriate.
/I li
- a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, and major transients.
- b. Assess whether there are enough scenario sets (and spares) to test the projected number and mix of applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity; and ensure that each applicant can be tested using at least one new or significantly modified scenario, that no scenarios are duplicated from the applicants' audit test(s), and scenarios will not be repeated on subsequent days.
- c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative and quantitative criteria specified on Form ES-301-4 and described in Appendix D.
- a. Verify that systems walk-through outline meets the criteria specified on Form ES-301-2:
(I)the outline(s) contain(s) the required number of control room and in-plant tasks, distributed among the safety functions as specified on the form (2) task repetition from the last two NRC examinations is within the limits specified on the form, (3)' no tasks are duplicated from the applicants' audit test(s)
(4) the number of alternate path, low-power. emergency and RCA tasks meet the criteria on the form.
b Verify that the administrative outline meets the criteria specified on Form ES-301-1 (1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task ISrepeated from the last two NRC licensing examinations i[
I!
I I
- c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.
- a. Assess whether plant-specific priorities (inciuding PRA and IPE insights) are covered in the appropriate exam section.
- b. Assess whether the IOCFR 55.41/43 and 55.45 sampling is appropriate.
- c. Ensure that WA importance ratings (except for plant-specific priorities) are at least 2.5.
A d. Check for duplication and overlap among exam sections.
- e. Check the entire exam for balance of coverage.
- a. Author
- b. Facility Reviewer (")
- c. NRC Chief Examiner (#)
- d. NRC Supervisor
/ NOTE: # Independent NRC reviewer initial items in Column "c", chief examiner concurrence required.
NUREG-1021, Revision 9
ES-401 Written Examination Q ~ ~ Checklist l i ~ Form ES-401-6 Rev 3 n I 2, a. NRC WAS are rekrenced for a l questions.
b F a c i l i learning ob)ecttves are referenced as available.
- 3. SRO questions are appropriate in accordance wlfh Section D.2.d of ES401 KV ,@
I I 1 The ramplmg process was random and systematic (If more than 4 RO or 2 SRO questions were repented from the last 2 NRC licensing exams, consult the NRR Ot program office).
c
- 5. Question duplication frm the license wreeningiaudit exam was controlled as indicated below (check the ltem that applies) and appears appropriate:
- the audit exam was systematically and randomly developed; or the audk exam was cwnpteted before the lioense exam was started:or I _
the exzsminations were developed independently; or x, the iicansee certifka ffiat there is no duplication; or
- olher (explain) 2;
- 8. Referenceslttandouts provided do not give away answers or aid in the elimination of disiradors. Kv
- 9. Question content conforms with specific WA statements in the previously approved examination outfine and is appropriate for the tlcar to which they are assigned; deviations are justified.
I 1 10. Question psychometric quality and format meet the guidelines in ES Appendix 8.
The exam contains the required number of onapoint, multiple choice Rems: the total Is correct
- b. Facility Reviewer (7 c NRC Chief Examiner (#)
- d. NRC Regional Supervkor Note:
- The facicty reviewers initilslsignature are flat appliwbk?for NRC-developed examinations.
- Independent NRC reviewer initial items in Column c; chlef examiner concumnce required.
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: WAERFORD 3 Date CF ~xarn-l I Initial
- /
-RJ
- 5. Questlon duplication from the lieens ntrolkd as indicated below (check the item that applies) and ap
-the auelit exam was 8ystmatiCrmy and randwnly developed, or
- the audit exam was comp the examinations were de exam was started; or or K J x t h e licensee cert@kis that there is no d u p ~ ior~ ~ ;
- other (explain)
Bank use meets lbnits (no more than 75 percent '
from the bank, at least l R percent new, snd the rest new
- 7. Behveen 50 and 60 Dement of the questions on Me RO I Memory 1 I l l exam ana written at be comprehensionl analysis level; the SRO exam may exceed 60 percent if #e randomly selected WAS S U D D O ~the
~ hkrher coanitiie levels; enter 34 /45.3% 41 f54.7%
I the actual RO I SkO queslion distrib;tbn(s) at right. . I I I
- 8. Refetenmshandouts provided do not give away r, .
qnswers or aid in the e ~ ~ ~ i ~ aoft distractors.
ion I kJ
- 9. Question content conforms with specifi pmvtwsly approved examination outline and is appropriate far the tler to d deviations are justified.
- 11. The exam contains the required numbdrof arik%@l&,multipls choice items; the total is c0mc.t and agrees with the value on the cover &*bet. 1 Printed Name I Signature Date a, Author 41212008
- b. Facility Reviewer r)
C. NRC ChCerf Examiner (#)
- d. NRC Regional Supervim
ES-301 Operating Test Quality Checklist Form ES-301-3 Exam Submittal Rev. 1 Facility: Waterford 3 Date of Examination: 3/24/2008 Operating Test Numl r: 1 nitials
- 1. General Criteria The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).
- b. There is no day-to-day repetition between this and other operating tests to be administered during this examination.
C. The operating test shall not duplicate items from the applicants' audit test(s). (see Section D.1.a.)
- d. Overlap with the written examination and between different parts of the operating test is within acceptable limits.
- e. It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license level.
- 2. Walk-Through Criteria
- a. Each JPM includes the following, as applicable:
initial conditions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee operationally important specific performance criteria that include:
- detailed expected actions with exact criteria and nomenclature
- system response and other examiner cues
- statements describing important observations to be made by the applicant
- criteria for successful completion of the task
- identification of critical steps and their associated performance standards
- restrictions on the sequence of steps, if applicable
- b. Ensure that any changes from the previously approved systems and administrativewalk-through outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.
- 3. Simulator Criteria The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-301-4 and a copy is attached.
Date
- a. Author 311 712008
- b. Facility Reviewer(*) 311 712008
- c. NRC Chief Examiner (#)
- d. NRC Supervisor NOTE:
- The facility signature is not applicable for NRC-developedtests.
- Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.
WF3 2008 Exam Submittal Rev 2 Date of Exam: 0312412003 Scenario Numben: 1 I 2 I 3 I4
- 1. The initial conditions are realistic in that some
- 3. Each event descriptionconsists of the point in the scenario when it is to be initiated
- the malfunction(s) that are entered to initiatethe event the symptomdcues that will be! vislble to the crew
- the expected operator actions (by shif! position) the event ~ e ~ ~point ~ (itaapplicable}
~ i ~ n incorporatedinto the smnarfo tima compression techniques are dS@, t perators have sufficient time to carry out
- 9. The scenarbs have been validated. Pursuantto 10 CFR 55.46(d), any open simulator performancedeficiencies or deviations from the. keferencd ofant have bwn evvafuated Target Quantkative Attributes (Per Scanaria; See Section D.5.d) I Actual Attributes:
$121314 I-
- 3. Abnomtal events (24) ~____
- 4. Major transieilts (1-2) I litlili I 1CV
ES-403 Written Examination Grading Form ES-403-1 Quality Checklist z
C Printed Name/Signature Date
- a. Grader
- b. Facility Reviewerr)
- c. NRC Chief Examiner (*)
- d. NRC Supervisor (*)
(*) The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.
ES-403, Page 5 of 5
c:
z 2m z-5:
5 c: 6 c:
z Z z Z Z 4
n a
n 5
n 5
n 2 m m m m m 2 i Z- i i 5: 5: 5: $ 5 :
N 6
m 6
m 0
m m 8 0 0 0 0 0 0 N N cu
\
~ ~
0 0 E
2a, 0
IC:
0 g 0 dd 0
0 5 8
-is c
c 2
4 -r 4 8 L is b P L
m c
m
-m c
B z
c c c g I-" 8 0 0 0 0 8 8 8 8 Y Y Y Y 0 0 0 0 3 3 3 3 8 8 8 (I) (I) cn 8
(I) 0 0 0 0 B0 B $2 $2 (I) (I) (I) 0 0
co 0
co g
5 c
2L P
c m
I-"
0 BY N
3 Brn v)
N 8m B v) if I
i i
!d.
. I -I
- B a d
.-5 0) a, a
m 0
ln m
f
.-s c1) rpc'
c K
w 2
n il
/I 1
t SOOS-BEZ-EZj7 Message Page 1 o f 2 VINES, KEITH EDGAR
. ~ m : COBLE, BILLY N Sent: Monday, April 07, 2008 7:47 AM To: VINES, KEITH EDGAR
Subject:
RE: NRC Exam Security
- Keith, I did comply with the W3 NRC Post-Examination requirements and give my permission to sign me off the W3 NRC Exam security agreement per this e-mail and telecon.
Bill Coble AN0 Unit 2 OPS Training Instructor Office: (479) 858-6816 or 8-759-6816 Cell: (479) 747-2026 Home: (479) 967-2436
Original Message-----
From: VINES, KEITH EDGAR Sent: Tuesday, April 01, 2008 1O:OO AM To: LEWIS, HORACE 3; ROHE, THOMAS A; BRIGGS, JAMES; LIETZKE, BRYON V; DEL UNO, JAMES C; MCDOUGALD, GLENN M; JONES, ROGER D; ALDAY, CLINT L; WESLEY, WESLEY D; MBRY, JIM M; COLLINS, VICTOR T; VIATOR, ERNEST P; LAJAUNIE, BERNARD A; Bailey, Ronald ;GORDON, WILLIAM KIRK; WILLSON, HUEY; LITOLFF, DAVID F; CHESTER, ARTHUR K; BERRY, TRACY; JORY, DAVID S; COBLE, BILLY N; DODDS, RALPH A; Pendergrass, William H
Subject:
FW: NRC Exam Security ES-201-3 form Exam security agreement must be signed off and submitted as part of the post exam submittal package.
The 30 day clock for the NRC to have licensing decisions starts when the post exam submittal is received.
So it is important to get everyone on the security agreement signed off is a timely manner to get the post exam submittal package to the NRC as quickly as possible.
Therefore if any one knows that they will not be available to sign off of the agreement please let me know so we can make alternative arrangements to comply with the requirements.
This may be satisfied by a phone coinmunication andlor ernail verifying the following; ( this will occur after 4/4/2008 until 4/10/2008)
- 2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week@) o f . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.
Actual signatures are the expectation but the above method can be substituted on a LIMITEB basis. Such as being out of state on vacation.
Bill Pendergrass Exam support AI Dodds Operations manager Bill Coble External Assessment AN0 David Jory Ops Validation 4/7/2008
Page 1 of3 VINES, KEITH EDGAR Im: DEL CANO, JAMES C Sent: Monday, April 07, 2008 7:OO AM To: VINES, KEITH EDGAR
Subject:
FW: NRC Exam Security
Original Message-----
From: Yves Lacombe [1]
Sent: Thursday, April 03, 2008 7:41 PM To: DEL CANO, JAMES C
Subject:
RE: NRC Exam Security This message serves to affirm the statements below regarding NRC licensing exam security.
Yves Lacombe Thunder Simulation Saint Marys, Georgia From: DEL CANO, JAMES C [2]
Sent: Thursday, April 03, 2008 4:18 PM To: yves.lacombe@thundersim.com r--VINES, KEITH EDGAR xt: Fw: NRC Exam Security
- Yves, Please reply verifying the following:
Jim deGCano Simulator Support (504) 739-6153 ES-201-3 form Exam security agreement must be signed off and submitted as part of the post exam submittal package.
The 30 day clock for the NRC to have licensing decisions starts when the post exam submittal is received.
So it is important to get everyone on the security agreement signed off is a timely manner to get the post exam submittal package to the NRC as quickly as possible.
Therefore if any one knows that they will not be available to sign off of the agreement please let me know so we can make alternative arrangements to comply with the requirements.
This may be satisfied by a phone communication and/or email verifying the following; ( this will occur after 4/4/2008 until 4/10/2008)
- 2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) o f . From the date that I entered into this security agreement until the completion of examination administration, I did not
.ct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations,
\. at as specifically noted below and authorized by the NRC.
4/7/2808