ML032690520

Examination Preparation Checklist

ML032690520
Person / Time
Site:	Salem
Issue date:	05/13/2003
From:	Reid J Public Service Enterprise Group
To:	Conte R NRC/RGN-I/DRS/OSB
Conte R
References
50-272/03-301, 50-311/03-301
Download: ML032690520 (5)

Text

ES-201 Examination Preparation Checklist Form ES-201-1 Target Date*

Task Description / Reference

-1 80

1. Examination administration date confirmed (C.l.a; C.2.a & b)

Chief Examiner's Initials 7 F

-1 20 I 2. NRC examiners and facility contact assigned (C.1.d; C.2.e)

I 7-riS

[-go]

-75

-70 11

-120 I 3. Facility contact briefed on security & other requirements (C.2.c)

I T F

[5. Reference material due (C.l.e; C.3.c)]

6. Integrated examination outline(s) due (C.1.e & f; C.3.d) 7-F

-rF

7. Examination outline(s) reviewed by NRC and feedback provided to facility licensee (C.2.h; C.3.e) 11

-120 I 4. Corporate notification letter sent (C.2.d)

I TF

-45

-30

-1 4

8. Proposed examinations, supporting documentation, and reference materials due (C.l.e, f, g & h; C.3.d)

TF

9. Preliminary license applicatio ue (C.l.I; C.2.g; ES-202)

-rr r

10. Final license application&!!ue and assignment sheet prepared (C.1.I; C.2.g; ES-202)

-7

11. Examination approved by NRC supervisor for facility licensee

1)

-14 I review (C.2.h; C.3.f)

15. Proctonng/written exam administration guidelines reviewed facility licensee and authorization granted to give written exa (if applicable) (C.3.k)

/'

(1

-14 I 12. Examinationfieviewed with facility licensee (C.1.j; C.2.f & h; C.3.g) I Tf=

(1

-7 I 13. Written examination$

' approved by NRC supervisor (C.2.i; C.3.h)

14. Final applicatior-$&iewed; #

)I

-7 I q ( C. 2 4, ES-204)

Target dates are keyed to the examination date identified in the coiporate notification letter.

They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.

Applies only to examinations prepared by the NRC.

[ 1 NUREG-1021, Revision 8, Supplement 1 22 of 24

ES-201 Examination Outline Form ES-201-2 Quality Checklist Note:

Not applicable for NRC-developed examinations.

1. Independent NRC reviewer initial items in Column IC;.

chief examiner concurrence required.

I.

Facili -

Item -

,l.

W R I T

T E

N

2.

S I

M

3.

W I T

Date of Examination:

Initials Task Description a

b' I

cf I

I

a. Verify that the outline(s) fn(s) the appropriate model per ES-401.

I

b. Assess whether the outline was systematically and randomly prepared in accordance with Section D.1 of ES-401 and whether all WA cateqories are appropriately sampled.

c. Assess wtrether the outline over-emphasizes any systems, evolutions, or generic topics.

WITi 11

d. Assess whether the justifications for deselected or rejected WA statements are appropriate. ' I&

I

a. Using Fonn ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures. and major transients.

b. Assess whether there are enough scenario sets (and spares) to test the projected number and mix of applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity; ensure each applicant can be tested using at least one new or significantly modified scenario, that no scenarios are duplicated from the applicants' audit test and scenarios will not be repeated over successive days.

c. To the extent possible. assess whether the outline(s) conform(s) with the qualitative and quantitative criteria specified on Form ES-301-4 and described in Appendix D.

a. Verifythat:

(1) the outline(s) contain(s) the required number of control room and in-plant tasks, (2) no more than 30% of the test material is repeated from the last NRC examination, (3)' no tasks are duplicated from the applicants' audit test(s), and (4) no more than 80% of any operatinq test is taken directly from the licensee's exam banks.

b. Verify that:

(1) the tasks are distributed among the safety function groupings as specified in ES-301, (2) one task is conducted in a low-power or shutdown condition.

(3) 40% of the tasks require the applicant to implement an allemate path procedure.

(4) one in-plant task tests the applicant's response to an emergency or abnormal condition, and (5) the in-plant walk-thrwqh requires the applicant to enter the RCA.

e required administrative topics are covered, with emphasis on performance-Date

a. Author

/-Io ~03

b. Facili Reviewer c)

c. NRC Chief Examiner (t)

d. NRCSupervisor 23 of 24 NUREG-1021, Revision 8, Supplement 1

ES-201 Examination Security Agreement Form ES-201-3

1.

Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week@) of 5k1Io3 date of my signature. I agree that I will not knowingly divulge any informatlon about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to Instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the faclity Ilcensee. I will immediately report to facility management or the NRC chief examfner any indications or suggestions that examination security may have been compromised.

as of the

2.

Post-Examination To the best of my knowled e, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week@) of d q % 3. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1)

DATE SIGNATURE (2) DATENOTE

13.

14.

15.

NOTES:

f i

I

\\

I {J :[; :l!

NUREG-1021, Revision 8, Supplement 1 24 of 24 e

t-

+

tS-401 Written Examination Form ES-401-7 Quality Checklist he audit exam was completed before the license exam was started; or s

the examinations were developed independently; or the licensee certifies that there is no duplication: or other (explain) percent from the bank at least 10 percent new, and the rest modified); enter the actual question distribution at riqht New

6.

Bank use meets limits (no more than 75 Bank Modified 99 46 Facility:

Date of Exam:

Exam Level: AQ/SRC

• A Item Description a

1.

Questions and answers technically accurate and applicable to facility 1

7.

Between 50 and 60 percent of the questions on the exam (including 10 new questions) are written at the comprehensiodanalysis level; enter the actual question distribution at riqht

2.

a. NRC WAS referenced for all questions

b. Facility learninq objectives referenced as available a

.I Memory 44 5 - 6 3

3.

@O/SRO o v e r l a 3 ho more than 75 percent, and SRO questions are appropriate

4.

per Section D.2.d of ES-407 Question selection and duplication from the last two NRC licensing exams appears consistent with a systematic sampling process I

9.

Question content conforms with specific WA statements in the previously approved examination outline and is appropriate for the Tier to which they are assiqned; deviations are justified

10.

Question psychometric quality and format meet ES. Appendix 6. guidelines

/$ a+q-T W7-F

11.

The exam contains 100, one-point, multiple choice items: the total is correct and agrees with value on cover sheet inted Name / Si Date

a. Author

&/H

b. Facility Reviewer ()

c. NRC Chief Examiner (#)

d. NRC Regional Supervisor Note:

The facility reviewers initialslsignature are not applicable for NRC-developed examinations.

1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

NUREG-1 021, Revision 8, Supplement 1 42 of 46

Written Examination Grading Form ES-403-1 ES-403 Quality Checklist a

Item Description

1.

Clean answer sheets copied before grading

,/$

b C

7F 1

2.

3.

4.

Answer key changes and question deletions justified and documented Applicants' scores checked for addition errors (reviewers spot check > 25% of examinations)

Grading for all borderline cases (80% +/- 2%) reviewed in

(*)

The facility reviewer's signature is not applicable for examinations graded by the

5.

6.

All other failing examinations checked to ensure that grades are justified Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed Name / Signature L Date I1 NRC; two independent NRC reviews are required.

5 of 5 NUREG-1021, Revision 8, Supplement 1