ML13128A120
| ML13128A120 | |
| Person / Time | |
|---|---|
| Site: | Vermont Yankee File:NorthStar Vermont Yankee icon.png |
| Issue date: | 03/18/2013 |
| From: | Todd Fish Operations Branch I |
| To: | Entergy Nuclear Vermont Yankee |
| Jackson D | |
| Shared Package | |
| ML13017A074 | List: |
| References | |
| TAC U01898 | |
| Download: ML13128A120 (6) | |
Text
ES*201 Examination Preparation Checklist Form ES-201-1 Facility: V'j ..
WrL*ffen ~e.Jo.ke -G: Date of Examination: 3LSkCi.~
Developed by: Written - Facility d NRC /I Operating 7.EaGility bJ f.lIRG [d-Q\ll\
Target Chief Date* Task Description (Reference) Examiner's Initials
-180
/
- 1. Examination administration date confirmed {C.1 .a; C.2.a and b} -(f
-120 2. NRC examiners and facility contact assigned (C.1.d; C.2.e) 'Tf'
-120 3. Facility contact briefed on security and other requirements (C.2.c) -rf
-120 4. Corporate notification letter sent (C.2.d) -rf
[-90] [5. Reference material due (C. 1.e; C.3.c; Attachment 2)] N{\
{-75} 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-30H, ES-301-2, ES-301-5, ES-D-1's, ES-401-1f2, ES-401-3, and ES-401-4, as applicable (C.1.e and f; C.3.d) If
{-70} {7. Examination outline(s) reviewed by NRC and feedback provided to facility licensee (C.2.h; C.3.e)} rr-
{-45} 8. Proposed examinations (including written, walk-through .IPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6, and any Form I~
ES-201-3 updates), and reference materials due (C.1.e, f, 9 and h; C.3.d)
-30 9. Preliminary license applications (NRC Form 398's) due (C.1.!; C.2.g; ES-202) TP
-14 10. Final license applications due and Form ES-201-4 prepared (C.1.!; C.2.i; ES-202) ff
-14 11. Examination approved by NRC supervisor for facility licensee review (C.2.h; C.3.f) -rIP
-14 12. Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g)
If"
-7 13. Written examinations and operating tests approved by NRC supervisor (C.2.i; C.3.h) If
-7 14. Final applications reviewed; 1 or 2 (if >10) applications audited to confirm qualifications I eligibility; and examination approval and waiver letters sent (C.2.i; Attachment 4; ES-202. C.2.e; ES-204)
-rr
-7 15. Proctoringlwritten exam administration guidelines reviewed with facility licensee (C.3.k) l~
N~
-7 16. Approved scen'arios. job performance measures, and questions distributed to NRC examiners (C.3,i)
- Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by case basis in coordination with the facility licensee,
[Applies only] {Does not apply} to examinations prepared by the NRC.
ES-201, Page 24 of 27
ES-201 Examination Outline Quality Checklist Form ES-201-2 acility: Vermont Yankee Date of Examination: "/}S If3 Initials 1~_lte_m__~____________________________T_a_s_k_D_e_~_n_'p_ti_o_n____________________________+-~a~~b-*=~
- 1. ~a-.-V-e-r-i~-t-h-m-~-e--om--lin-e-(S-)-fi-t(-S)-t-he--a-pp_r_op_r_ia_te_m__od_e_I,_i_n_acco_m_a_nc_e
__ __ E_S_-4_O_1._ _________~'~~~p ~
M_'th__
W
~ ~ttt Iff R b. Assess whe~er the outline was systematically and randomly prepared in accordance wi~
I Section 0.1 of ES-401 and whether all KIA categories are appropriately sampled.
T T c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.
E N d. Assess whe~er the justifications for deselected or rejected KIA statements are appropriate.
- 2. a. Using Form ES-301-5, verify that the proposed ~enario sets cover ~e required number of normal evolutions, instrument and component failures, technical specifications, S and major transients.
I M
U L
- b. Assess whe~er there are enough scenario sets (and spares) to test ~e projected number and mix of applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity, and ensure ~at each applicant can be tested using at least one new or significantly modified ~enario, that no ~enarios are duplicated
\
A T from the applicants' audit testes), and that ~enarios will not be repeated on subsequent days.
o c. To the extent posSible, assess whe~er the omline(s) conform(s) wi~ the qualitative R
and quantitative criteria specified on Form ES-301-4 and described in Appendix D.
- 3. a. Verify that the systems walk-through omline meets the criteria specified on Form ES-301-2:
(1) ~e outline(s) contain(s) the required number of control room and in-plant tasks
!V\If W distribmed among ~e safety functions as specified on the form I (2) task repetition from ~e last two NRC examinations is wi~in the limits specified on the form T (3) no tasks are duplicated from the applicants' audit testes) \
(4) the number of new or modified tasks meets or exceeds ~e minimums specified on ~e form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form.
- b. Verify that the administrative omline meets the criteria specified on Form ES-301-1: \
(1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations
- c. Determine if there are enough different outlines to test ~e projected number and mix \
of applicants and ensure that no items are duplicated on subsequent days. ~
- 4. a. Assess whether plant-specific priorities (including PRA and IPE inSights) are covered l (\\ ~ ~
in the appropriate exam sections.
1-----'-'---'----------+-'-1"
"'.D l' G
E b. Assess whe~er the 10 CFR 55.41/43 and 55.45 sampling is appropriate. I~ 9~f -{~
- c. Ensure ~at KIA importance ratings (except for plant-specific priorities) are at least 2.5. I~ 9tlf 1~
N E
A R d. Check for duplication and overlap among exam slections. l~ ~~tl L r-e_._C_h_ec__k_~_e_e_n_t_ire__e_xa_m__ro_r_b_a_'a_nc
__e_o_fc_o_v_e_m~g~e_.______________________________~~ ~f 1~__--~f~.~A~ss~es~s~w~h~e~th~e~r~t~he~ex~a~m~fit~s~t~he~a~pp~r~o~pr~ia~t~e~jo~b~~I~ev~e~I~(R~O~o~r~S~R~O~)~.__________________ -U~~~~41 l'
- a. Author 1~1~~th
- b. Facility Reviewer (*) l-17-'H
- c. NRC Chief Examiner (#) 1->>*/3
- d. NRC Supervisor r/:srJ' 3
~e: # Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.
- Not applicable for NRC-prepared examination omlines
LICENSED OPERATOR REQUAL EXAMINATION SECURITY AGREEMENT Pre-examination y k7 I
We aCk~ge that(exam 1
I have acquired spec' cycle and week) dge about the <-)Vy<....., l.1t'nit) t <
exam type, e.g.:r;;;;;;;l JPM, all, etc.)
examination. I agree that I will not knowingly divulge any information about these examinations to any persons wh have not een authorized by the Exam Team Leader. I understand that I am not to participate in any instruction, evaluation, scheduling, or other training-related activities involving those individuals scheduled to be administered these examinations from this date until completion of the examination listed above, except as authorized by the Training Superintendent (e.g., simulator booth operator or communicator, non-technical classes such as GET or general supervisor courses). I further understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or Entergy. I will immediately report to the Training Manager any indications or suggestions that examination security may have been compromised.
Post-examination To the best of my knowledge, I did not divulge any information concerning this examination. From the date that I entered into this security agreement, until the completion of examination administration, I did not participate in any training-related activities involving those individuals who were administered these examinations except as authorized by the Training Superintendent.
Printed Name Job Title I Pre-examination Date Briefed On Security Post-examination Date Responsibi lity Signature Requirements of Signature EN-TQ-217 by:
Sianature I Date\*
1.
1 1.3 I/n/,"!>
l.K~'~ 1<:0 I ~--~.~. I '-I {liS
- The individual who performs the briefing on exam security requirements of EN-TQ-217 signs in this space. ~ S\SI\~ &:~ J~t~L-Il'lr.t*1 \
3-S.~\s ~
ENTERGY NUCLEAR Page 1 of 2 E*DOC TITLE I E-DOC NO. REVISION NO.
EXAM SECURITY AGREEMENT I TQF-217-SEC 0
LICENSED OPERATOR REQUAL EXAMINATION SECURITY AGREEMENT (Continuation Sheet)
Printed Name Job Title! Pre-examination Date Briefed On Security Post-examination Date Responsibility Signature Requirements of Signature EN-TQ-217 By:
(Signature! Date)*
o L,
Ro
?-.o s,"'i2:.c::> Ie..
()M C:R.o
~ I C(ZD UP5 %1' (h.eY'""
20.
'The individual who performs the briefing on exam security requirements of EN-TQ-217 signs in this space. +3'>1~~':),
Completed exam security agreement is to be filed in the Master Exam File.
ENTERGY NUCLEAR Page 2 of2 E-DOCTITLE I E-DOCNO. REVISION NO.
EXAM SECURITY AGREEMENT I TQF-217-SEC 0
ES-401 Written Examination Quality Checklist Form ES-401-6 I Facility: vermont Yankee Date of Exam: 3*5*13 Exam Level: ROX SRO[]
Initial Item Description a b' c'
- 1. Questions and answers are technically accurate and aQQlicable to the facility I\l'i ~f 'fF
~?i ~t..f?
- 2. a.
b.
NRC KJAs are referenced lor all questions.
Facility learning objectives are referenced as available.
t\
\! .* -rF
- 3. SAO questions are appropriate in accordance with Section D.2.d of ES*401 N/A NIl'. N/A
- 4. The sampling process was random and systematic (II more than 4 RO or 2 SRO quastions were repeated from the last 2 NRC licensing exams, consult the NRR OL prOQram office). IF
- 5. Question duplication from the license screening/audit exam was controlled as indicated below (check the Item that applies) and appears appropriate:
the audit exam was systematically and randomly developed; or Yf
-.~,
II r
\~\\ ~'If the audit exam was completed before the license exam was started; or the examinations were developed independently; or
~ __ ~ the licensee certifies that there is no duplication; or
_X_ other (explain) This re*take exam was systematically and randomly developed.
- 6. Bank use meets limits (no more than 75 percent Bank Modified New from the bank. at least 10 percent new, and the rest new or modified): enter the actual RO I SRO*only question distribution(s) at right.
431 N/A E>I NIl'. 271 N/A ~
\}. t (l~f' Tr 7_ Between 50 and 60 percent of the questions on the RO Memory CIA t.
~X nr;.f exam are written at the comprehensionl analYSIS level:
the SRO exam may exceed 60 percent if the randomly selected KJAs support the higher cognitive levels; enler 301 N/A 45/ N/A \:\1 I'F .
'./ ~
the actual AO! SAO question distribution(sl at right.
- 8. References/handouts provided do not give away answers or aid in the elimination of distractors. \~~
., I
/;RI' .-rr
- 9. Question content conforms with specific KJA statements in the previously approved examination outline and is appropriate for the lier to which they are assigned; deviations are justified.
\]) 9f f' rP f
~. f..r' I 10. Question psychometric quality and format meet the guidelines in ES Appendix 8. '1 ' IF I 11. The exam contains the required number of one'point multiple chOice items; the total is correct and agrees with the value on the cover sheet. '7" f' (F
"". \\~':inte~e I Signature Date a, Author Brian Stewartl'",\;.,,:-~'t~r~~::- .. ) c. _._ .. ~ ____ ~ \ \**H~
- b. Facility Reviewer n James Paradis! *.;...>,,.,..,,,....- tf-L/~~:!:-£!:.~ ..
') .. ~ \ ,
"~T\~
~~_~
f!!t~J
~~~
---~---~
- c. NRC Chief Examiner (#) Todd Fish!
- d. NRC Regional Supervisor Don Jackson! . f'/--~ -~-~----- ... -.. ",.~.------
.'i._
Note: ' The facility reviewer'S initials/signature are not applicable for NRC*develooed examinations.
- Independent NRC reviewer initial Items in Column "c"; chief examiner concurrence required.
ES-403 Written Examination Grading Form ES-403*1 Quality Checklist Facility: ~\'V'IQnT YFtn (.(It Date of Exam: 3-s;.-l3 Exam Level: R~ SROL J Initials Item Description a b c
- 1. Clean answer sheets copied before grading "---~ U1tf {r N/(i
- 2. Answer key changes and question deletions justified and documented ~
tVA tJ~
- 3. Applicants' scores checked for addition elTors (reviewers spot check> 25% of examinations) ~ f'/A \f
- 4. Grading for all borderline cases (80 +/-2% overall and 70 or 80, as applicable, +/-4% on the SRO-only) reviewed in detail ~ rV~ N~
rJ/4
- 5. All other failing examinations checked to ensure that grades are justified ~ NJ{i tJA
- 6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants
~ t'it~ i'r
~~0~:~im~na&
Date
- a. Grader 3-S-J3
- b. Facility Reviewer(*) \i(, Nt, VV\.J-P l-i-.j ) ~ 3 [S;[13
- c. NRC Chief Examiner (*) TAhb f{1f}-t 711~ ~.L"'? :?/'7Lls
- d. NRC Supervisor (*) n.~..u.ljJ4U:~
l / MJ..~
/ Vf../..'i I J/tiV 0.
\ ./
(*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are reQuired.
ES-403, Page 6 of 6