ML032690520

Examination Preparation Checklist

ML032690520
Person / Time
Site:	Salem
Issue date:	05/13/2003
From:	Reid J Public Service Enterprise Group
To:	Conte R NRC/RGN-I/DRS/OSB
Conte R
References
50-272/03-301, 50-311/03-301
Download: ML032690520 (5)

Text

ES-201 Examination Preparation Checklist Form ES-201-1 Target Chief Date* Task Description / Reference Examiner's Initials

-1 80 1. Examination administrationdate confirmed (C.l .a; C.2.a & b) 7F

-120 I 2. NRC examiners and facility contact assigned (C.1 .d; C.2.e) I 7-riS 1 -120 I 3. Facilitycontact briefed on security & other requirements (C.2.c) I TF 1 -120 I 4. Corporate notification letter sent (C.2.d) I TF

[-go] [5. Reference material due (C.l .e; C.3.c)] -

-75 6. Integrated examination outline(s) due (C.1 .e & f; C.3.d) 7-F

-70 7. Examination outline(s) reviewed by NRC and feedback provided to facility licensee (C.2.h; C.3.e) -rF

-45 8. Proposed examinations, supporting documentation, and reference materials due (C.l .e, f, g & h; C.3.d) TF

-30 9. Preliminary license applicatio ue (C.l .I; C.2.g; ES-202) -rr

-14 10. Final license application&!!ue and assignment sheet prepared (C.1 .I; C.2.g; ES-202) r

1) -14 I 11. Examination approved by NRC supervisor for facility licensee review (C.2.h; C.3.f)

(1 -14 I /'

12. Examinationfieviewed with facility licensee (C.1.j; C.2.f & h; C.3.g) I Tf=

(1 -7 I 13. Written examination$

NRC supervisor (C.2.i; C.3.h)

' approved by

)I -7 I 14. Final applicatior-$&iewed; q ( C . 2 4 , ES-204)

15. Proctonng/writtenexam administration guidelines reviewed

-7 facility licensee and authorization granted to give written exa (if applicable) (C.3.k)

• Target dates are keyed to the examination date identified in the coiporate notification letter.

They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.

[ 1 Applies only to examinations prepared by the NRC.

NUREG-1021, Revision 8, Supplement 1 22 of 24

ES-201 Examination Outline Form ES-201-2 Quality Checklist

-Facili Date of Examination:

Initials Item Task Description

- a b' cf I

,l. a. Verify that the outline(s) fn(s) the appropriatemodel per ES-401.

W I I R

T I

b. Assess whether the outline was systematicallyand randomly prepared in accordance with Section D.1 of ES-401 and whether all WA cateqories are appropriatelysampled. I T

E

c. Assess wtrether the outline over-emphasizesany systems, evolutions, or generic topics.

WITi 1 I

- N d. Assess whether thejustifications for deselected or rejected WA statements are appropriate. ' I&

2. a. Using Fonn ES-301-5, verify that the proposed scenario sets cover the requirednumber of normal evolutions, instrument and component failures. and major transients.

S I b. Assess whether there are enough scenario sets (and spares) to test the projected number and M mix of applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity; ensure each applicant can be tested using at least one new or significantly modified scenario, that no scenarios are duplicatedfrom the applicants' audit test and scenarios will not be repeated over successive days. '

c. To the extent possible. assess whether the outline(s) conform(s) with the qualitative and

- quantitative criteria specified on Form ES-301-4 and described in Appendix D.

3. a. Verifythat:

(1) the outline(s) contain(s) the required number of control room and in-planttasks, W (2) no more than 30% of the test material is repeated from the last NRC examination, I (3)' no tasks are duplicatedfrom the applicants' audit test(s), and T (4) no more than 80% of any operatinqtest is taken directly from the licensee's exam banks.

b. Verify that:

(1) the tasks are distributedamong the safety function groupings as specified in ES-301, (2) one task is conducted in a low-power or shutdown condition.

(3) 40% of the tasks require the applicant to implement an allemate path procedure.

(4) one in-plant task tests the applicant's response to an emergency or abnormal condition, and (5) the in-plant walk-thrwqh requires the applicant to enter the RCA.

e requiredadministrativetopics are covered, with emphasis on performance-Date

a. Author /-Io~03

b. F a c i l i Reviewer c)

c. NRC Chief Examiner (t)

d. NRCSupervisor Note:

Not applicablefor NRC-developedexaminations.

Independent NRC reviewer initial items in Column IC chief examiner concurrence required.

I.

23 of 24 NUREG-1021, Revision 8, Supplement 1

ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination Iacknowledge that Ihave acquired specializedknowledge about the NRC licensingexaminations scheduled for the week@)of 5k1Io3 as of the date of my signature. I agree that Iwill not knowingly divulge any informatlon about these examinations to any persons who have not been authorized by the NRC chief examiner. Iunderstandthat Iam not to Instruct, evaluate, or provide performance feedback to those applicants scheduled to be administeredthese licensingexaminationsfrom this date until completion of examination administration, except as specifically noted below and authorizedby the NRC.Furthermore, Iam aware of the physicalsecurity measures and requirements (as documented in the facility licensees procedures) and understandthat violation of the conditions of this agreement may result in cancellationof the examinationsand/or an enforcement action against me or the faclity Ilcensee. Iwill immediately report to facility management or the NRC chief examfner any indicationsor suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowled e, Idid not divulge to any unauthorized persons any information concerningthe NRC licensing examinationsadministered during the week@)of d q % 3 . From the date that Ientered into this security agreement until the completionof examinationadministration, I did not instruct, evaluate, or provide performancefeedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATENOTE

13. --

14. --

15. --

NOTES: f i I {J :[; :l! I :\

NUREG-1021, Revision 8, Supplement 1 24 of 24 e t- +.

tS-401 Written Examination Form ES-401-7 Quality Checklist Facility: Date of Exam: Exam Level: AQ/SRC Item Description a

1. Questions and answers technically accurate and applicable to facility 1

2. a. NRC WAS referenced for all questions

b. Facility learninq objectives referenced as available a- .I 3.

@O/SRO o v e r l a 3 ho more than 75 percent, and SRO questions are appropriate per Section D.2.d of ES-407

4. Question selection and duplication from the last two NRC licensing exams appears consistent with a systematic sampling process I

s he audit exam was completed before the license exam was started; or the examinations were developed independently; or

-the licensee certifies that there is no duplication: or

- other (explain)

6. Bank use meets limits (no more than 75 Bank Modified New percent from the bank at least 10 percent new, - *A and the rest modified); enter the actual question distribution at riqht 46 99

7. Between 50 and 60 percent of the questions on Memory the exam (including 10 new questions) are written at the comprehensiodanalysis level; enter the actual question distribution at riqht 44 5-63

9. Question content conforms with specific WA statements in the previously approved examination outline and is appropriate for the Tier to which they are assiqned; deviations are justified

10. Question psychometric quality and format meet ES.Appendix 6. guidelines /$ a+q-T

11. The exam contains 100, one-point, multiple choice items: the total is correct and agrees with value on cover sheet W7-F inted Name / Si Date

a. Author &/H

b. Facility Reviewer ()

c. NRC Chief Examiner (#)

d. NRC Regional Supervisor Note: The facility reviewers initialslsignature are not applicable for NRC-developed examinations.

1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

NUREG-1021, Revision 8, Supplement 1 42 of 46

ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Item Description a b C

1. Clean answer sheets copied before grading ,/$ 7F

2. Answer key changes and question deletionsjustified and documented

3. Applicants' scores checked for addition errors (reviewers spot check > 25% of examinations)

4. Grading for all borderline cases (80% +/- 2%) reviewed in

5. All other failing examinations checked to ensure that grades are justified

6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants L Printed Name / Signature Date 11I (*) The facility reviewer's signature is not applicable for examinations graded NRC; two independent NRC reviews are required.

- by the 5 of 5 NUREG-1021, Revision 8, Supplement 1