ML052220398

Final Qa/Related Forms (Folder 1)

ML052220398
Person / Time
Site:	Peach Bottom, Limerick
Issue date:	06/13/2005
From:	Rich C Exelon Generation Co
To:	Conte R Operations Branch I
Conte R
References
Download: ML052220398 (10)

Text

ES-201 Examination Preparation Checklist Form ES-201-1 Facility: L//n4/rb&./ 6-75

/

Examinations Developed by: Facility / NRC (cirdeone)

I Target Chief Date* Task Description (Reference) Examiner's Initials

-180 1. Examination administration date confirmed (C.l .a; C.2.a and b)

-120 2. NRC examiners and facility contact assigned (C.1.d; C.2.e) z//3

-120 3. Facility contact briefed on security and other requirements (C.2.c) 2 / 3 2/13

-120 4. Corporate notification letter sent (C.2.d) 1 3 /lJ

[-90] [5. Reference material due (C.1.e; C.3.c; Attachment 211 i 3/3d

6. Integratedexamination outline(s) due. W i n g Forms ES-201-2, ES-201-3, ES-301-1. ES-301-2, ES-301-5. ES-Dl'S. ES-401-1/2, ES E W 0 1 - 4 . as applicable (C.1 .e and f; C.3.d)

$7, s+,

1-3,

/4

-70 7. Examination outline(s) reviewed by NRC and feedback provided to licensee (C.2.h; C.3.e)

8. Proposed examinabions (including written, walk-through JPMs, a

1. 2 9 scenarios, as applicable), supporting documentation (including Forms ES-301-3. ES-3014, ES-301-5, ES-3016, and ES-401-6). and reference materials due (C.1.e. f, g - and h; C.3.d)

9. Preliminary license applications (NRC Form 398s) due (C.l.1; C.2.g; q/3 ES-202) 1

~ 7Tt

-7 ES-202) 2/ 3 0 ,

10. Final license applications due and Form ES-201-4 prepared (C.1.l; C.2.i;

-141

~

11. Examination approved by NRC supervisor for facility licensee review Y3 (C2.h; C.3.f) 5 '30

-14 12. Examinations reviewed with facility licensee (C-1.j; C2.f and h; C . 3 . d ,

-7 13. Written examinations and operating tests approved by NRC s u p e n 7 w b/6 (C.2.i; C.3.h) 1

-7 14. Final applications reviewed; examination approval and waiver letters sen/

(C.2.i; Attachment 4; ES-204) f

-7 15. ProctoringEwritten exam administration guidelines reviewed 615 with facility licensee (C.3.k)

-7 16. Approved scenarios. job performance measures, and questions distributed to NRC examiners (C.3.i) 4

. Target dates are keyed to the examination date identified in the corporate notification l e t t d They are for planning purposes and may be adjusted on a case-by-case basis in Coordination with the facility licensee.

[ J Applies only to examinations prepared by the NRC.

ES-201, Page 24 of 27

ES-701 Facilit LSRO Examination Outline Quality Checklist Form ES-701-5 Date of Examination:

I i

I Initials Item Task Description

- a b ' &

W

1. a. Verify that the outline fits the model in accordance with ES-701. kss-I 4% I .

R b. Assess whether the outline was systematically and randomly prepared in accordance with I Section D.l of ES-401 and whether all KIA categories are sampled at least once.

T T

E

c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics. lmI 4

- N d. Assess whether the justifications for deselected or rejected KIA statements are appropriate.

I&I q'fl I I I// -

2. a. Verify that the overall operating test:

(1) includes at least two tasks that require the use of technical specifications 0 (2) does not duplicate any tasks from the applicants' audit test(s)

P E b. Verify that the administrative tasks:

R (1) are distributed among the four administrative topics described in ES-301 A

T (2) include no more than one repeat from the last two NRC licensing examinations (3) include at least one task that is new or significantly modified

@d I

e. Verify that the systems walk-through includes:

N G (1) two tasks requiring the manipulationof fuel handling equipment (2) two additional tasks related to Tier 2 systems other than fuel handling equipment (3) two tasks requiring implementation of alternative path procedures (4) no more than one repeat from the last two NRC licensing examinations (5) at least one task that is new or significantly modified y.

e. Determine whether there are enough different outlines to test the projected number

- of applicants and ensure that no items are duplicated on subsequent days.

3. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered inthe appropriate exam section.

G E

N

b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.

34 A

E R

c. Assess whether the sampling process adequately considered plant-specific refueling components, systems, and procedures that are not included in the generic models. f&

L d. Ensure that K/A importance ratings (except for plant-specific priorities) are at least 2.5.

e. Check for duplication and overlap among exam sections.

cd I

1. Check the entire exam for balance of coverage.

I

- g. Assess whether the proposed sample is consistent with the LSRO's job responsibilities. I

a. Author Facility Reviewer r)

II NRC Chief Examiner (#) I I

I Note: # Independent NRC reviewer initial items in Column "c'; chief examiner concurrence required. I

I i

LSRO Written Examination Form ES-701-6 Qualitv Checklist I

I

- Initial I

I

6. Bank use meets limits (no more than 30 questions '

Bank Modified New frwn the bank, at least4 new, and the rest m o d i ) ;

enter the actual auestion distribution at riaht.

• 6 7 37

7. Between 50 and 60 percent (20 and 24) Memory CIA of the questions on the exam are written at the comprehensionlanalysis level; enter the actual question distribution at right.

• 21 24 I

3 I 11. The exam contains 40 one-point, multiple choice items; the total is correct and agrees with value on cover sheet.

I Printed Name ISignature Date I 3. Author ___ de/*.-

I ). Facility Reviewer (*)

I  :. NRC Chief Examiner (#)

I I. NRC Regional Supervisor I

I dote: The facility reviewer's initialslsignature are not applicable for NRCdeveloped examinations.

1. Independent NRC reviewer initial items in Column 'c"; chief examiner concurrence required.

I + 50 &e,s-&A 6 J A A I

ES-701, Page 16 of 18

ES-701 LSRO Operating Test Quality Checklist Form ES-701-7 FacW ,y- Date of Examination 6/13/05 Operating Test Number Initi; Item Description

1. The operating test conforms with the LSRO's job responsibilities and the previously approved outline (Form ES-701-4).

2. Any changes from the previously approved outline have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last two NRC examinations)specified on the outline.

3. There is no day-today repetition between this and other operating tests to be administered during this examination.

4. The operating test does not duplicate items from the applicants' audit test@).

(SeeSection D.1.a of ES-301).

5. Overlap betweenthe written examinationand the operating test is within acceptable limits.

6. It appears that the operating test will differentiate between competent and less-than-competent applicants.

7. Each JPM includes the following, as applicable:

initial conditions initiatingcues references and tools. including associated procedures reasonableand validated time limits (average time allowed for completion) and specific

- designation if deemed to be time-criticalby the facility licensee specific performance criteria that include:

- detailed expected actions with exact criteria and nomenclature

- system response and other examiner cues

- statements describing important observations to be made by the applicant

- criteriafor successful completion of the task

- identification of critical steps and their associated performance standards

- restrictions on the sequence of steps, if applicable Printed Name I Signatyre NOTE: The facility signature is not applicable for NRCdeveloped tests.

1. Independent NRC reviewer initial items in Column 'c"; chief examiner concurrencerequired.

ES-701, Page 17 of 18

ES-701 LSRO Examination Outline Qualitv Checklist Form ES-701-5 Initials item Task Description

~~ ~

a bo c#

1. a. Verify that the outline fits the model in accordance with ES-701.  %- '-

W R b. Assess whether the outline was systematically and randomly prepared in accordance with I Section D.l of ES-401 and whether ail K/A categories are sampled at least once.

T I I I T

E I c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.

~- - ~-

Iw I 4 1(I& I L-1

~ ~~

N I d. Assess whether the justifications for deselected or rejected K/A s t a t e m i s are appropriate-

2. a. Van'fy that the overall operating lest:

(1) includes at least two tasks that require the use of technical specifications 0 (2) does not duplicate any tasks from the applicants' audit test(s)

P E b. Verify that the administrative tasks:

R (1) are distributed among the four administrativetopics described in ES-301 A (2) include no more than one repeat frwn the last two NRC licensing examinations T (3) include at least one task that is new or Significantly modified I

N e. Verify that the systems walk-through includes:

G (1) two tasks requiring the manipulation of fuel handling equipment (2) two additional tasks related to Tier 2 systems other than fuel handling equipment (3) two tasks requiring implementation of alternative path procedures (4) no more than one repeat from the last two NRC licensing examinations (5) at least one task that is new or significantly modified 3.

G E

N E

R A

L

1. Check the entire exam for balance of coverage.

g. Assess whether the proposed sample is consistent with the LSROs job responsibilities.

a. Author

b. Facility Reviewer (*)

I

c. NRC Chief Examiner (#)

d. NRC Supervisor Note: # Independent NRC reviewer initial items in Column 'c"; chief examiner concurrence required.

ES-701, Page 15 of 18

ES-701 LSRO Written Examination Form ES-701-6 Quality Checklist

9. Question content conforms with specific WA statements in the previously approved

a. Author

b. Facility Reviewer r)

c. NRC Chief Examiner (#)

d. NRC Regional Supervisor The facility reviewer's initialskignatwe are not applicable for NRC-developed examinations.

1. Independent NRC reviewer initial items in Column "c;"chief examiner concurrence required.

ES-701, Page 16 of 18

I ES-403 Written Examination Grading Form ES-403-1

, Quality Checklist Date of Exam: Exam Level: ROlSRO I Initials Item Description a b C

1. Clean answer sheets copied before grading cq I-y I

, 2. Answer key changes and question deletions justified and documented tqk +

3. Applicants' scores checked for addition errors (reviewers spot check > 25% of examinations)

CJ+ '

6. Performance on missed questions checked for training Printed NameBignature Date

~~ ~

(*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-403, Page 5 of 5

ES-201 Examination Security Agreement . Form ES-201-3

1. Pre-ExamlnatioQ I acknowledge that I have acquired specialized knowledge about the NRC licensing examinaUons scheduled for the week(s) of- , as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that Iam not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the indhridual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellalion of the examinations andlor an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination A-.

To the best of my know1 ge. I did not divulge to any unauthorized persons any Information concerning the NRC licensing examinations administered during the week(s) of 6 13 0 5 From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE 0

'p 0

m ES-201, '  ? 26 of 27 J

r UP924 ,'cot-s3 c?

N In 0

0 N

0 0

a, a

m

)

0 2

a ro U

ro (c

U m

0 0

I 0

p 0

D m 0

df tb 0

0 VI rl I

w w