ML052240124
| ML052240124 | |
| Person / Time | |
|---|---|
| Site: | Palisades  |
| Issue date: | 05/23/2005 |
| From: | Palagi B NRC/RGN-III/DRS/OLB |
| To: | Nuclear Management Co |
| Shared Package | |
| ML051930236 | List: |
| References | |
| 50-255/05-301 50-255/05-301 | |
| Download: ML052240124 (11) | |
Text
VARIOUS CHECKLISTS FOR THE PALISADES INITIAL EXAMINATION - MAY 2005
FORMS FROM AD M I N I STRATI V E S U B M ITTAL:
ES-201 Examination Preparation Checklist Form ES-201-1 Task Description (Reference)
- 1.
Examination administration date confirmed (C.l.a; C.2.a and b)
Date of Examination: fi 200s
/;s odes Facility: pa Examinations Developed by:
I Chief Examiner's Initials n/
Target Date'
- 15.
Reference material due (C.1.e; C.3.c; Attachment 2)]
- 6.
Integrated examination outline(s) due, including Forms ES-201-2. ES-201-3, ES-301-1, ES-301-2, ES-301-5, ES-D-l's, ES-401-1/2, ES-401-3, and ES-401-4. as aoolicabie fC.l.e and f C.3.d)
-1 80
-120 BP O f
-120
-120 8
Proposed examinations (including written. walk-throu h JPMs. and scenarios. as appl caole). supporting documentation &clucling Forms ES-301-3. ES-301-4. ES-301-5, ES-301-6. and ES-401-6). an0 reference mater.als clue (C 1 e. 1. g and h. C 3.d)
[-901 (3p
-75
-70
-45
-30
-14
-14
-14
-7
-7
-7
-7
~
~
~
- 2.
NRC examiners and facility contact assigned (C.1.d; C.2.e)
I D P
- 3.
- 4.
Facility contact briefed on security and other requirements (C.2.c)
Corporate notification letter sent (C.2.d)
- 7. Examination outline(s) reviewed by NRC and feedback provided to facility licensee IC.2.h: C.3.e)
- 9.
Preliminaly license applications (NRC Form 398's) due (C.1.I; C.2.g; ES-202)
I RP
~~
~
~
- 11. Examination approved by NRC supervisor for facility licensee review (C.2.h; C.3.f)
- 12. Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g) 84
- 13. Written examinations and operating tests approved by NRC supervisor (C.2.i: C.3.h) 14 Final applicat,ons reviewed: examination approval and waiver letters sent (C.2.t: Attachment 4; ES-204) 15 Proctoringlwritten exam administration guioelines reviewed with lac lity licensee (C 3 6)
- 16. Approved scenarios, job performance measures, and questions distributed to NRC examiners (C.3.i)
Target dates are keyed to the examination date identified in the corporate notification letter.
They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.
Applies only to examinations prepared by the NRC.
[ ]
ES-201, Rev. 9 Examination Security Agreement Form ES-201-3
- 1.
Pre-Examination Palisades Initial Licensina Exam I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week@) of Mav23. 2005 and Mav 30, 2005 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
- 2.
Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of Mav 23. 2005 and Mav 30,2005. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.
PRINTED NAME JOB TITLE I RESPONSIBILITY SIGNATURE (1)
DATE SIGNATURE (2)
DATE NOTE
ES-401 Record of Rejected WAS Form ES-401-4 Tier I Randomly Group Selected WA Reason for Rejection 1 /I 1 I1 K2 K1 Group K2 for SGTR importance ratings were all less than 2.5 There were no entries for this WA (Loss of Vital AC Elect.
111 112 2/1 211 211 212 1 I1 21 1 K 2 K1 K5 A2 K5 K2 A I K6 Group K2 for Loss of DC Power importance ratings were all less than 2.5 There were no entries for this WA (Loss of Condenser Vacuum)
Group K5 for Emergency Diesel Generators importance ratings were all less than 2.5 Group A2 for Instrument Air importance ratings were all less than 2.5 There were no entries for this WA (Containment)
Group K2 for Fuel Handling importance ratings were all less than 2.5 Several attempts were made to write an adequate question but one could not be written for this WA.
Several attempts were made to write an adequate question but one could not be written for this WA.
~
AA2.01 Several attempts were made to write an adequate question but one could not be written for this WA.
1 I1 3
AA2.05 G 2.1.7 Several attempts were made to write an adequate question but one could not be written for this WA.
Several attempts were made to write an adequate question but one could not be written for this WA.
ES-403 Written Examination Grading Form ES-403-1 Quality Checklist
- 4.
- 5.
- 6.
Grading for all borderline cases (80 t2% overall and 70 or 80, as applicable, i4% on the SRO-only) reviewed in detail All other failing examinations checked to ensure that grades are justified Performance on missed questions checked for training of questions missed by half or more of the applicants deficiencies and wording problems; evaluate validity Facility:
Date of Exam:
Exam Level: RO/SRO Initials 444
~l;c Item Description a
b
- 1.
- 2.
Clean answer sheets copied before grading Answer key changes and question deletions justified and documented
&t
&%I
- 3.
Applicants' scores checked for addition errors (reviewers spot check > 25% of examinations) ll Printed NameEignature Date
- a. Grader 2!&-
- b. Facility Reviewerr)
- c. NRC Chief Examiner (
- d. NRC Supervisor r) 7-6 -04 r)
The fadlity reviewer's signature is not applicable for examinations graded by the NRC; ES-403. Page 5 of 5
FORMS FROM PROPOSED EXAMINATION SUBMITTAL:
ES-301 Operating Test Quality Checklist Form ES-301-3 Facility:
Date of Examination:
Operating
- 1. General Criteria
- a.
The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).
There is no day-to-day repetition between this and other operating tests to be administered
- b.
Test Number:
Initials a
b*
c#
/b *d &@
The operating test shall not duplicate items from the applicants audit test($. (see Section D.1.a,)
I e during this examination.
arc/ SP
- a.
Each JPM includes the foliowing. as applicable:
initial conditions initiating cues references and tools, including associated procedures reasonable and validated t i m m (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee operationally important specific performance criteria that include:
detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important obsarvations to be made by the applicant criteria for successful completion of the task identification of critical steps and their associated performance standards restrictions on the sequence of steps, if applicable ll I
- d.
Overlap with the written examination and between different parts of the operating test is within acceptable limits.
It appears that the operating test will differentiate between competent and less-than-competent
- e.
Ens& that any changes from lhe prev o~sly appmved systems an0 adm n strat ve wa k-tnrobgn o ~ t ne5 (Forms ES.301-1 and 2) have no1 cadsed tne test to oev ate trom any 01 lhe acceptance cr lei a (e g tern d str bLtion oand ~ s e repel lion from the lasl 2 NRC exam nar onsl s ~ e c i l ea II ACWBP 1
on those forms and Form ES-201-2 I!
1 -
6 applicants at the designated license level.
- 2. Walk-Through Crlterla Aac/B6 6f Tne aSSOCiateO s mJ alor operating tests (scenario sets) have been rev ewed n accoraance with Form ES.301 4 ana a copy 1s attacnea I
- 3. Slmulator Crlterla II Printed Name / Signature Date a
Author rJ e=
b Reviewe&
c NRC Chief Examiner (#)
d NRC Supervisor NOTE:
The facility signature is not applicable for NRC-developed tests.
Independent NRC reviewer initial items in Column C; chief examiner concurrence required.
rc/zz/os
ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Facility:
Date of Exam:
Scenario Numbers:
I I
Operating Test NO.:
OUALITATIVE ATTRIBUTES Initials a
Eh ilM/ d/
The scenarios consist mostly of related events.
6%
BP
- 1.
The initial conditions are realistic, in that some equipment andlor instrumentation may be out of service, but it does not cue the operators into expected events.
- 2.
@ c # -
u / 2 4 J '
- 9.
The scenarios have been validated. Pursuant to 10 CFR 55.46(d). any open simulator oerforrnance deficiencies or deviations from the referenced plant have been evaluated I
I
.- it-to ensure that functional fidelity is maintained while running the planned scenarios.
Every operator will be evaluated using at least one new or significantly modified scenario.
All other scenarios have been altered in accordance with Section D.5 of ES-301 IwIop 4/+f to.
, as verified using Form ES-301-6
ES-301 Competencies Checklist Form ES-301-6 Notes:
(1)
(2)
Optional for an SRO-U.
(3)
Only applicable to SROs.
Includes Technical Specification compliance for an RO Instructions:
Circle the applicanfslicense type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.
Author:
NRC Reviewer:
Y/Z z/Ds
ES-401 Written Examination Quality Checklist Form ES-401-6 tne ad11 exam was Systematlcat~y and random y deve opeo the aJa t exam was compneteo before the icense exam was Slaned X r n e exam nations were aeveloped naepenaently tne I censee cen lies Inat there IS no dLpl catfon
- other (exp a n) 6 Banr Lse meets mils (no more Inan 75 percent Ban6 Modited hew from the Dank, at least 10 percent new, an0 the rest new or mod fed) enter tne actJal RO I SRO.only qLest8on distr bution@) at right 4 I 0 1 0 7 f Z +
- 2.
- a.
NRC WAS are referenced for all questions.
h h
the actual RO / SRO question distrib;tion(s) at right.
I I
Between 50 and 60 percent of the questions on the RO selected WAS SUDDO~ the hiqher Coqnitive levels; enter exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly
- 7.
I I
9 CLestion content conforms w tn Spec f c KIA statements n the prev,oLs y approved examinat on 011 ne and s appropriate tor tne I er 10 wh cn tney are ass gned.
aev at ons are lustitled to Chest on psychometrtc qLa -dy ana format meet the QL del ne5 In ES Appendix B 11 The exam conla ns the required nLmber of onepoint. mLltiple Cho ce tems the tola s correct ana agrees w In tne va Le on the Cover Sneet t
wu 4f h! a d / P kb ReJ &'P
- a/ af 6P
- 8.
Referenceslhandouts provided do not give away answers or aid in the elimination of distractors.
I hole
' Tne fact iry revmwer's in tiaisls gnature are not applcao e tor NRC-deve opeo exam nat.ons f( lnaependent NRC rev ewer.nil a. terns n Co Lmn 'c' cn el examiner concLrrence reqmea