ML041980594

ANO 1 - Initial Exam - 01/2004 - Public Forms

ML041980594
Person / Time
Site:	Arkansas Nuclear
Issue date:	12/03/2003
From:	Kelly Clayton Operations Branch IV
To:	Entergy Operations
References
Download: ML041980594 (12)

Text

APPENDIX I Operations Branch Assignment Check Sheet:

(Includes ES-201-1 & ES-501-1 Rev. 8 information)

P:\\ANOl\\ANOlchsheet.wpd as of:

12/10/03 Chief: Gage FacilitylTask: AN01 Exam Task Start Date: 1/12/2004 ITEM DESCRIPTION I DUEDATE I INlT I DATE 0

Exam/lnspection Schedule Agreement Jul 16, 2003 ATG 6/9/2003 1

NRC Staff & Fac. Contact Assigned Jul 16,2003 ATG 6/9/2003 I

I I

2 Facility contact briefed on security & other issues Jul 16, 2003 ATG 6/9/2003 3

Corp. Notification Letter Sent Jul 16,2003 7123303 3a Inspection Announcement Letter Sent (PIR & LORT if reqd)

Nov28,2003 NA NA 4

Task Expectations, Issues, & Standards Discussed w/ BC Oct 14,2003 &

5

[Reference Material Due]

Sep 14,2003 I

I 6

Integrated Exam Outlines Due Sep 14,2003 9 7

Outlines reviewed by NRC & Feedback Sent Sep28,2003 a I

I 8

Preliminary Applications Due Dec 13,2003 3 9

Draft Exams wl Doc./Ref. Due Nov 13,2003 14 NRC Supervisor Approved Final Exams Jan5,2004 15 Final Appl. Recd & Waivers Sent Jan5,2004 #

16 Proctor Rules Reviewed wl Fac. & Written Authorized Jan5,2004 -q 9 I3Gl0.3 I 2/4 lo 3 I

I I

I 17 Exam/lnsp Material to Team I Jan 5,2004 I.$ I i/5-/0+

18 Fac. graded exam & Comments Recd Jan 24,2004 L

19 NRC Written Grading Completed Jan27,2004 20 Examiners Finished Grading Op. Tests Jan27,2004.??

21 NRC Ch. Ex. Review Completed Feb6,2004 &

22

• NRC BC Review Completed Feb7,2004 jw i

23 RPS/IP Examinees Updated Before Report Issued Feb 12,2004 24 License/Denials Siqned & Report Issued Feb 12,2004. -9 I

I

\\

I 25 Package Closed Out Mar4,2004

&J9 I 4 5 w Final Inspection Report Issued, Exam Package to OLA, Facility. Contact Notified of Results

• Note Supervisor or Independent Reviewer initials required in for lines 10, 11, 14, & 22.

[I Required NRC-auth. exams only for line 5.

s ~~~~~§~~~ N(X 0 TEMPJlr; i~g). =

Item

a. Verify that the outline(s) fit(s) the appropriate model per ES401.

k.EclNA I.&I Initials a

b' c#

Task Description

b. Assess whether the outline was systematically and randomly prepared in accordance with Section D.l of ES401 and whether all WA categories are appropriately sampled.

2.

S I c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.

((d I

a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, and major transients.

@c I d. Assess whether the justifications for deselected or rejected WA statements are appropriate.

lcacl I

M

b. Assess whether there are enough scenario sets (and spares) to test the projected number and mix of applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity; ensure each applicant can be tested using at least one new or significantly modified scenario, that no scenarios are duplicated from the applicants' audit test(s)',

fcoe and scenarios will not be repeated over successive days.

1.IA $

c. To the extent possible. assess whether the outline(s) conform(s) with the qualitative and quantitative criteria specified on Form ES-3014 and described in Appendix D.

be

3.

a. Verify that:

W

/

T (1) the outline(s) contain(s) the required number of control room and in-plant tasks, +

(2) no more than 30% of the test material is repeated from the last NRC examination,@

(3)' no tasks are duplicated from the applicants' audit test(s), and 8.

(4) no more than 80% of any operating test is taken directly from the licensee's exam banks.

b. Verifythat:

(1) the tasks are distributed among the safety function groupings as specified in ES-301, (2) one task is conducted in a low-power or shutdown condition, (3) 40% of the tasks require the applicant to implement an alternate path procedure, (4) one in-plant task tests the applicanrs response to an emergency or abnormal condition, and (5) the in-@antrWk-through requires the applicant to enter the RCA.

c. Verify that the required administrative topics are covered, with emphasis on performance-based activities.

!!a bc I +

d. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on successive days.

4.

f. Assess whether the exam fits the appropriate job level (RO or SRO).

b c

a. Author

b. Facility Reviewer r)

c. NRC Chief Examiner (#)

d. NRC Supervisor Note:

Not applicable for NRC-developed examinations.

1. Independent NRC reviewer initial items in Column %:"chief examiner concurrence required.

I I

I I

23 of 24 NUREG-1021, Revision 8, Supplement 1

ES-401 Written Examination Form ES-401-7 (R8, S1)

Quality Checklist Facility: Arkansas Nuclear One Unit 1 Date of Exam: January 12,2004 Exam Level: RO Initial were developed independently; or fies that there is no duplication; or Date

a. Author Kelly Clavton 5&N h Y

/ W X b

c. NRC Chief Examiner (#)

Paul Gaae c

u

b. Facility Reviewer (*)

d. NRC Regional Supervisor Note:

The facility reviewers initialskignatur le for NRC-developed examinations.

1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

Not Applicable Tonv Godv

ES-401 Written Examination Form ES-401-7 (R8, SI)

Quality Checklist Facility: Arkansas Nuclear One Unit 1 Date of Exam: January 12,2004 Exam Level: SRC Initial I

Item Description

1.

2.

Questions and answers technically accurate and applicable to facility

a. NRC WAS referenced for all questions

b. Facility learning objectives referenced as available RO/SRO overlap is no more than 75 percent, and SRO questions are appropriate per Section D.2.d of ES-401 Question selection and duplication from the last two NRC licensing exams appears consistent with a systematic sampling process Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:

-the audit exam was systematically and randomly developed; or

-the audit exam was completed before the license exam was started; or x the examinations were developed independently; or the licensee certifies that there is no duplication; or other (explain)

Percent from the bank at least 10 Percent new.

3.

1.

5.

6.

Bank use meets limits (no more than 75 Bank Modified New and the rest modified); enter the actual question 52 7

41 distribution at right I

7.

Between 50 and 60 percent of the questions on Memory CIA the exam (including 10 new questions) are written at the comprehension/analysis level; enter the actual question distribution at right Referencedhandouts provided do not give away answers Question content conforms with specific WA statements in the previously approved examination outline and is appropriate for the Tier to which they are assigned; deviations are justified 41 59

8.

9.

1) 10.

Question psychometric quality and format meet ES, Appendix B, guidelines

1) 1 1.

The exam contains 100, one-point, multiple choice items; the total is correct and aarees with value on cover sheet b*

M A U

Note:

• The facility reviewers initialdsignature are not applicable for NRC-developed examinations.

1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

ES-301 Operating Test Quality Checklist Form ES-301-3 (R8, SI)

Facility:

ANO-1 Date of Examination: Jan 12, 2004 Operating Test Nur

1. GENERAL CRITERIA

a.

The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).

There is no day-to-day repetition between this and other operating tests to be administered during this examination.

The operating test shall not duplicate items from the applicants' audit test(s)(see Section D.l.a).

Overlap with the written examination and between operating test categories is within acceptable limits.

It appears that the operating test will differentiate between competent and less-than-competent

b.

C.

d.

e.

applicants at the designated license level.

2. WALK-THROUGH (CATEGORY A & B) CRITERIA

a.

Each JPM includes the following, as applicable:

. initial conditions

. initiating cues

. references and tools, including associated procedures

. reasonable and validated time limits (average time allowed for completion) and specific

. specific performance criteria that include:

designation if deemed to be time critical by the facility licensee

- detailed expected actions with exact criteria and nomenclature

- system response and other examiner cues

- statements describing important observations to be made by the applicant

- criteria for successful completion of the task

- identification of critical steps and their associated performance standards

- restrictions on the sequence of steps, if applicable

b.

The prescripted questions in Category A are predominantly open reference and meet the criteria in of ES-301.

Repetition from operating tests used during the previous licensing examination is within acceptable limits (30% for the walk-through) and do not compromise test integrity.

At least 20 percent of the JPMs on each test are new or significantly modified.

C.

d.

3. SIMULATOR (CATEGORY C) CRITERIA

a.

The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-301-4 and a copy is attached.

Printed Name / Signature Ier: 20041 Date

a. Author

b. Facility Reviewerr)

c. NRC Chief Examiner (#)

d. NRC Supervisor NOTE: ' The facility signature is not applicable for NRC-developed tests.

1. Independent NRC reviewer initial items in Column "c;" chief examiner concurrence required NUREG-I021, Revision 8, Supplement 1 I

ES-301 Simulator Scenario Quality Checklist Form ES-301-4 (R8, SI 1 QUALITATIVE ATTRIBUTES Initials I

I

13.

The level of difficulty is appropriate to support licensing decisions for each crew position.

I I

I I

I I

NUREG-1021, Revision 8, Supplement 1

ES-301 Transient and Event Checklist Form ES-301-5 (R8, S1)

OPERATING TEST NO.:ANO Unit 1 2004 Der 4

NIA NIA NIA NIA NIA I

I Reactivity 1

4 Reactivity Normal RO 0

4 6

NIA I

I Major I

1 7

Normal I

4 Reactivity 1

1 1

2 I I NIA Normal Instrument I As RO I strumentl

&om ponent 7

Major 1

Reactivity 0

SRO-I 4

2,3,5, 1,3,4, 1,4,5, 6,8 5,7,8 6,8,9 2

Normal Instrument I As SRO I

1

enari 2

6 7

) Nun -

3 3 -

7 -

NIA N/A NIA NIA NIA NIA NIA I

I I

7 7

Major 1

Instructions: (1)

Enter the operating test number and Form ES-D-1 event numbers for each evolution type.

Section C.2.a of Appendix D.

to the applicants competence count toward the minimum requirement.

(2)

Reactivit manipulations may be conducted under normal or controlled (3)

Whenever ractical, both instrument and component malfunctions should abnorma Y conditions (refer to Section D.4.d) but must be significant per be include dp ; only those that require verifiable actions that provide insight Author:

NRC Reviewer:

NRC Reviewer:

I NUREG-1021, Revision 8, Supplement 1

ES-301 ComDetencies Checklist Form ES-301-6 (R8. S1)

AN0 Unit 1 Januaw 2004 Exam Competencies Notes:

(1) Includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

nstructions:

Circle the applicant's license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

NUREG-1021, Revision 8, Supplement 1

ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Item Description

1.

Clean answer sheets copied before grading Facility:

A U Q i-1. 1 Date of Exam: I -@ -Qq Exam LevelmSRO Initials a

b Skpt,&

U/A

4.

Grading for all borderline cases (80% +/- 2%) reviewed in detail I

lJlA

5.

All other failing examinations checked to ensure that grades are justified

$114 NIP C

6.

Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of Printed Name / Signature Date SAP pd

a. Grader i 4

b. Facility Reviewer(*)

1-04-of 1-22-ny-f -d x-P Y

c. NRC Chief Examiner (*)

d. NRC Supervisor (*)

V

(*)

The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

5 of 5 NUREG-1021, Revision 8, Supplement 1

ES-403 Written Examination Grading Form ES-403-1 Quality Checklist

4.

Grading for all borderline cases (80% +/- 2%) reviewed in detail

3.

Applicants' scores checked for addition errors 414 MA M A I 1

5.

All other failing examinations checked to ensure that grades are justified

~~~

$/A

6.

Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants J-A P

a. Grader i- 03-GLJ

b. Facility Reviewer(*)

13w4 I-2 2 - sy-e -af+&/

c. NRC Chief Examiner (*)

3. NRC Supervisor (*)

[*)

The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

5 of 5 NUREG-1021, Revision 8, Supplement 1

ES-201 Examination Security Agreement Form ES-Z013(R8,SI)

1.

Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 119 thru 1/16/2004 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Forthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that

2.

Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of 1/9 thru 1/16/2004. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

. examination security may have been compromised.

3 Pagel of1 02lO3l2004 09:31:38 Report 21 Operator Licensing Exam Schedule From 10/01/2003 To 09/30/2004 Region: 4 Phase Code: 5 Operational 0811 812003 Arkansas Nuclear One I 05000313 12004301 Prep NNN GAGE, PAUL C.

CLAYTON, KELLY D.

1211512003 Arkansas Nuclear One I 05000313 / 2004301 Prep GAGE, PAUL C.

CLAYTON, KELLY D.

GAGE, PAUL C.

GAGE, PAUL C.

MCKERNON, THOMAS 0.

TAC #: X02257 TAC #: X02257 Adrnin GAGE, PAUL C.

CLAYTON, KELLY D.

01 I1 32004 Arkansas Nuclear One I 0500031 3 I 2004301 RO-5 SROl - 1 TAC #: X02257 SROU - 3 GAGE, PAUL C.

MCKERNON, THOMAS 0.

MURPHY, MICHAEL E.

GAGE, PAUL C.

MCKERNON, THOMAS 0.

GAGE, PAUL C.

GAGE, PAUL C.

0111 912004 Arkansas Nuclear One I 0500031 3 12004301 Doc NNN GAGE, PAUL C.

CLAYTON, KELLY D.

TAC #: X02257 Arkansas Nuclear One I 05000313 12004004 Procedure #: 71 1 1 1 1 1 B Arkansas Nuclear One I 05000368 I 2004004 Procedure #: 71 1 11 11 B GAGE, PAUL C.

GAGE, PAUL C.

0711 912004 0711 912004 Sites: AN0 Orgs:4620 Exam Author:ALL