ML061720256

Final Qa/Related Forms (Folder 1)

ML061720256
Person / Time
Site:	Millstone
Issue date:	03/21/2006
From:	Operations Branch I
To:	Dominion Nuclear Connecticut
References
Download: ML061720256 (5)

Text

ES-201 Examination Preparation Checklist Form ES-201-1 Facility: pq I LL 570d E- POI+( & M f i - L Date of Examination: ?,k/ /QL developed by: Written - F a c i l i t y B NRC

~

I! Operating - Facility fl NRC

~ ~ ~

N/4 ~

Target Chief Date* Task Description (Reference) Examiner's Initials

-180 1. Examination administration date confirmed (C.1 .a; C.2.a and b)

- pa4

-120 2. NRC examiners and facility contact assigned (C.1.d; C.2.e)

-120 3. Facility contact briefed on security and other requirements(C.2.c) f l a"k

-120 4. Corporate notification letter sent (C.2.d) b4

[-go]

(-75)

(5.

6.

Reference material due (C.1.e; C.3.c; Attachment 2)]

Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3,

&x.

ES-301-1, ES-301-2, ES-301-5, ES-D-l's, ES-401-1/2, ES-401-3, and ES401-4, as applicable (C.1.e and f; C.3.d)

(-70) I (7. Examination outline(s) reviewed by NRC and feedback provided to facility licensee (C.2.h; C.3.e))

(-45) 8. Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6, and any Form ES-201-3 updates), and reference materials due (C.l.e, f, g and h; C.3.d)

-30 I 9. Preliminary license applications (NRC Form 398's) due (C.l .I; C.2.g; ES-202) I

-I4 I 10. Final license applications due and Form ES-201-4 prepared (C.1.I; C.2.i; ES-202)

-14 I 11. Examination approved by NRC supervisor for facility licensee review (C.2.h; C.3.f)

-14 12. Examinations reviewed with facility licensee (C.l .j; C.2.f and h; C.3.g) &Q,,b

-7 13. Written examinations (C.2.i; C.3.h) T approved by NRC supervisor 4

-7 15. Proctoringhitten exam administration guidelines reviewed with facility licensee (C.3.k)

I

-7 16. Approved scenarios, job performan& measures, and questions distributedto NRC examiners (C.3.i) Cwe , y ~ Q &lg L !,I")

~  ?!!A Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.

[Applies only] (Does not apply} to examinations prepared by the NRC.

ES-201,Page 24 of 27

ES-ZQ1 ExaminatJonOutline Quality Checklist F o ES-2014

~

Item 1.

W R b. Assesswhetherthe I

f 7

E

-N 2

S I

M U

L A

T 0

R

-3.

W

-. I T

-4.

G E

N E

R A

-L

0 4

I N

Ei U

1. Pre-Examlnatlw .., , a)

I I acknowledge @at 1 have aqulnrrJspa

ES-401 Written Examination Quality Checklist Form ES-401-6 Initial Item Description a

1. Questions and answers are technically accurate and applicable to the facility. ,

2. a. NRC K/As are referenced for all questions. &w

3. SRO questions are appropriate in accordance with Section D.2.d of ES-401 N/A

4. The sampling process was random and systematic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR OL program office). '@

5. Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item that applies) and appears appropriate:

-- the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or p(_ the examinationswere developed independently; or

-- the licensee certifies that there is no duplication; or

__ other (explain)

6. Bank use meets limits (no more than 75 percent from the bank, at least I O percent new, and the rest new or modified); enter the actual RO l SRO-only question distribution(?.) at right.

7. Between 50 and 60 percent of the questions on fhe RO exam are written at the comprehension/analysis level; I I I the SRO exam may exceed 60 percent if the randomly selected WAS support the higher cognitive levels; enter the actual RO / SRO question distribution(s)at right.

a. Referenceslhandoutsprovided do not give away answers or aid in the elimination of distractors.

9. Question content conforms with specific WA statements in the previouslyapproved examination outline and is appropriate for the tier to which they are assigned; deviations are justified.

IO. Question psychometricquality and format meet the guidelines in E S Appendix B.

11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet.

Printed Name l Signature

a. Author

b. Facility Reviewer (*)

c. NRC Chief Examiner (#)

d. NRC Regional Supervisor

~~~ ~ ~~

Note:

• The facility reviewer's initials/signatureare not applicable for NRC-developed examinations.

1. Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.

ES-401, Page 29 of 33

ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Facility: Millstone Unit Two Date of Exam: 03/21/06 Exam Level: R O H S R O O Initials Item Description a b C I. Clean answer sheets copied before grading

2. Answer key changes and question deletions justified and documented

3. Applicants' scores checked for addition errors (reviewers spot check > 25% of examinations)

4. Grading for all borderline cases (80 k2% overall and 70 or 80, as applicable, k4% on the SRO-only) reviewed in detail

5. All other failing examinations checked to ensure that grades are justified

6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed Name/Sig nature Date

a. Grader

b. Facility Reviewerr)

C. NRC Chief Examiner (*) I-

d. NRC Supervisor (*)

(*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-403, Page 5 of 5

---