ML032600677

Final Qa/Related Forms

ML032600677
Person / Time
Site:	Salem
Issue date:	11/04/2002
From:	Diane Jackson Public Service Enterprise Group
To:	Conte R NRC/RGN-I/DRS/OSB
Conte R
References
50-272/02-301, 50-311/02-301 50-272/02-301, 50-311/02-301
Download: ML032600677 (28)

Text

Examination Preparation Checklist Form ES-201-1 (R8, SI)

I eveloaed Hv:l Salem Task Description / Reference Initials I 08-May-02

~~

1. Examination administration date confirmed (C.1.a; C.2.a & b) ro7-Jul-02 12. NRC examiners and facility contact assigned (C. 1.d; C.2.e)

I 07-Jul-02 13. Facility contact briefed on security & other requirements (C.2.c)

F 0 7 - J u l - 0 2 1 C o r p z notification t e letter sent (C.2.d)

I 06-Aug-02 I[5. Reference material due (C.l .e; C.3.c)l I 21-Aug-02 16. Integrated examination outline(s) due (C.1.e & f; C.3.d)

I 26-Aug-02 I7. Examination outline(s) reviewed by NRC and feedback provided to facility licensee fC.2.h: C.3.e)

8. Proposed examinations, supporting documentation, and reference materials 20-Sep-02 due (C.l.e, f, g & h; C.3.d)

I 05-Oct-02 19. Preliminary license applications due (C.l .I; C.2.g; ES-202)

10. Final license applications due and assignment sheet prepared (C.1.l; C.2.g; 21-0ct-02 ES-202)

11. Examination approved by NRC supervisor for facility licensee review (C.2.h; 21 -0ct-02 C.3.f)

I 21-Oct-02 112. Examinations reviewed with facility licensee (C.1.j; C.2.f & h; C.3.g)

13. Written examinations and operating tests approved by NRC supervisor 28-0ct-02 (C.2.i; C.3.h)

14. Final applications reviewed; assignment sheet updated; waiver letters sent 28-Oct-02 (C.2.g, ES-204)

I 28-0ct-02 I 15. Proctoring/written exam administration guidelines reviewed with facility licensee and authorization granted to give written exams (if applicable) (C.3.k)

I 28-0ct-02 I 16. Approved scenarios, job performance measures, and questions distributed to NRC examiners (c.3.i)

Target dates are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-bv-case basis in coordination with the facilitv licensee.

ES-201-1 Page 1 1/ 1 1 / 0 2

ES-201 Examination Outline Form ES-201-2 Quality Checklist Initials Item Task Description I I I 1 a I b ' I c l I I

I uired number of

c. To the extent possible. assess whether the outlinc(s) c o n f m ( s ) with the qualitative and quantitative criteria specified on Form ES-301-4 and described in Appendix D.

3.

W I

T

d. Determine ifthere are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on successive days.

I Author I Facility Reviewer ('1 8V4-02 NRC Chief Examiner (#)

I NRCSupervisor I W

Jote: Not applicable for NRC-developedexaminations.

1. Independent NRC reviewer initial items in Column "c:. chief examiner concurrence required. I 23 of 24 NUREG-1021, Revision 8, Supplement 1

ES-201 . Examination Security Agreement Form ES-201-3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of tjdg'$#M as of the date of my signature. I agree that Iwill not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Furthermore, 1 am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditigns of this agreement may result in cancellation of the examinations andlor an enforcement action against me or the facility licensee. Iwill immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of & ! From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY NOTES: I . ..

NUREG-1021, Revision 8, Supplement 1 24 of 24

ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of ]I- y- as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations andlor an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week($ of , I / , 4 ( 1 , / ~ . From the dale that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performancefeedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE I RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATENOTE NOTES;.. ... ..., ',...ss*,.,,#,rn., ., ,,/, llcl, ,,,,,..

.. . I . . ..

I ..... .. ...C ....,.. ^ . j _... .. I ? . , .- )I.,- - .

NUREG-1021 Revision 8; Supplement 1 I 24 of 24

ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination Jf -0 a-I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of //- d*./"' as of the date of my signature. I agree that Iwill not knowingly divulge any informationabout these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellationof the examinations andlor an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my know edge, I did not divulge to any unauthorized persons any informationconcerning the NRC licensing examinations administered during the week(s) of 4 ~ , / ~ .l From the date that Ientered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE I RESPONSIBILITY SIGVATURE (1) DATE SIGNfiTURE (2) DATENOTE NOTES:

NUREG-1021 Revision 8, Supplement 1 24 of 24

ES-301 Operating Test Quality Checklist Form ES-301-3 rest Number:

1. GENERAL CRITERIA I

a. The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g.. 10 CFR 55.45, operational importance, safety function distribution).

b. There is no day-to-day repetition between this and other operating tests to be administered during this examination.

C. The operating test shall not duplicate items from the applicants audit test(s)(seeSection D.1.a).

d. Overlap witfi the Written examination and between operating test categories is within acceptable limits.

e. It appears that the operatingtest will differentiatebetween competent and less-thancompetent applicants at the designated license level.

2. WALK-THROUGH (CAEGORY A & B) CRITERIA

a. Each JPM includes the following, as applicable:

. initial conditions

. initiatingcues

. references and tools, including associatedprocedures reasonable and validated time limits (average time allowed for completion) and specific I designation if deemed to be time critical by the facility licensee

. specific performance criteriathat include:

--- detailed expected actions with exact criteriaand nomenclature system response and other examiner cues statements describing important observations to be made by the applicant

- criteria for successful completion of the task

- identification of critical steps and their associated performancestandards

b. The prescriptedquestions in Category A are predominantlyopen reference and meet the criteria in Attachment 1 of ES-301.

a. Author

b. Facility Reviewerr)

c. NRC Chief Examiner (#) I

d. NRC Supervisor NOTE:

• The facility signature is not applicable for NRC-develoGd tests.

1. IndependentNRC reviewer initial items in Column c; chief examiner concurrence required. I 23 of 26 NUREG-1021, Revision 8, Supplement 1

ES-301 Simulator Scenario Quality Checklist Form ES-301-4 I.

QUALITATWE ATTFUBUTES I ,Initial; I

TARGET QUANTITATIVE AITRIBUTES (PER SCENARIO; SEE SECTION D.4.D) Actual Attributes - I

1. Total malfunctions (5-8)

NUREG-1021, Revision 8, Supplement 1 24 of 26 l...

ES-301 Transient and Event Checklist Form ES-301-5 OPERATING TEST NO.: RO-1 Applicant Evolution Minimum Scenario Number TY Pe TY Pe Number 1 2 3 4

/

PO RO Reactivity 1 4 Normal 1 1 \

RO Instrument/ 4 6B,7 1,2,7 6 Component Reactivity 1 Normal 0 As RO Instrument/ 2 Com ponent Major 1 SRO-I As SRO SRO-U Instructions: (1) Enter the operating test number and Form ES-D-Ievent numbers for each evolution (2) #:&tivity manipulations ma be conducted under normal or controlled abnormal conditions (refer to Section d.4.d) but must be significant per Section C.2.a of Appendix D.

(3) Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirement.

Author: FJ Kaminski NRC Reviewer: L\*7 25 of 26 NUREGI 021, Revision 8, Supplement 1

ES-301 Transient and Event Checklist Form ES-301-5

~~

OPERATING TEST NO.: RO-2 RO Reactivity 1 Normal 0 As RO Instrument/ 2 Component Major 1 SRO-I Reactivity 0 Normal 1 As SRO Instrument/ 2 Component Major 1 Normal SRO-U Maior Instructions: (1) Enter the operating test number and Form ES-D-1 event numbers for each evolution (2) %%ivity manipulations ma be conducted under normal or controlled abnormal 8

conditions (refer to Section .4.d) but must be significant per Section C.2.a of Appendix D.

(3) Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirement.

Author: JK Lloyd NRC Reviewer:

25 of 26 NUREG1021 Revision 8, Supplement 1

~

ES-301 Transient and Event Checklist Form ES-301-5 OPERATING TEST NO.:RO-3 Applicant Evolution Minimum Scenario Number TY Pe TY Pe Number 1 2 3 4 PO RO Reactivity 1 4 Normal 1 1 RO Instrument/ 4 6B,7 1,2,7 Component Major 1 4,6A 5,6 As RO SRO-I Reactivity 0 Normal 1 As SRO Instrument/ 2 Component Major 1 Instructions: (I) Enter the operating test number and Form ES-D-1 event numbers for each evolution (2) %&tivity manipulations ma be conducted under normal or controlled abnormal conditions (refer to Section d.4.d) but must be significant per Section C.2.a of Appendix D.

(3) Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's competence count toward the minimum requirement.

Author: FJ Kaminski NRC Reviewer:

i 25 of 26 NUREG-1021, Revision 8, Supplement 1

ES-30 1 Transient and Event Checklist Form ES-301-5 OPERATING TEST NO.: RO-4 I Applicant Type Evolution TY Pe Minimum Scenario Number Reactivity Normal RO Instrument/

Component Major Reactivity 1 Normal 0 As RO Instrumentl 2 Component Major 1 Reactivity I 0 Normal As SRO Component Major 1 1 Normal SRO-U Instrument/

Component Major II 2 1 Instructions: (1) Enter the operating test number and Form ES-D-1 event numbers for each evolution (2) #i%tivity manipulations ma be conducted under normal or controlled abnormal conditions (refer to Section 8.4.d) but must be significant per Section C.2.a of Appendix D.

(3) Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable act!ons that provide insight to the applicants competence count toward the minimum requirement.

Author:

NRC Reviewer:

25 of 26 NUREGI 021, Revision 8, Supplement 1

ES-301 Transient and Event Checklist Form ES-301-5 OPERATING TEST NO.: RO-5 Applicant Evolution Minimum I Scenario Number TY Pe TY Pe Reactivity Normal RO Instrument/

Component Major Reactivity 1 Normal 0 As RO Instrument/ 2 Component Major 1 SRO-I As SRO Reactivity 0 Normal 1 SRO-U Instrument/ 2 Component Major 1 Instructions: (1) Enter the operating test number and Form ES-D-1 event numbers for each evolution (2) 8:gctivity manipulations ma be conducted under normal or controlled abnormal conditions (refer to Section d.4.d) but must be significant per Section C.2.a of Appendix D.

(3) Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirement.

Author:

NRC Reviewer:

25 of 26 NUREGl021, Revision 8, Supplement 1

ES-301 Transient and Event Checklist Form ES-301-5 OPERATING TEST NO.: SROU-I Applicant I Evolution I Minimum I Scenario Number TY Pe I Type I Number I I 2 1 3 1 4 1 Reactivity 1 I Normal I 1 I I I RO Reactivity 1 As RO SRO-I As SRO Instructions:

Author: JK Lloyd NRC Reviewer:

25 of 26 NUREGl021, Revision 8, Supplement 1

ES-301 Transient and Event Checklist Form ES-301-5 OPERATING TEST NO.: SROU-f2 Reactivity 1 As RO SRO-I As SRO

-l-7

~ ~

Reactivity 0 Normal 1 1 SRO-U Instrument/ 2 Component Major 1 4,6A

~Pn;e* I 1 Instructions: . . - Ilumbers for each evolution (2) 8E:ctivity manipulations ma be conducted under normal or controlled abnormal J

conditions (refer to Section .4.d) but must be significant per Section C.2.a of Appendix D.

(3) Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's competence count toward the minimum requirement.

Author: FJ Kaminski NRC Reviewer:

25 of 26 NUREGl021, Revision 8, Supplement 1

ES-301 Transient and Event Checklist Form ES-301-5 OPERATING TEST NO.: SROU-73 Applicant Evolution Minimum Scenario Number TY Pe TY Pe Number RO As RO SRO-I As SRO Reactivity

?k Normal SRO-U Instrument/

Component Major 1 4,6A 5.b Instructions:

Author: FJ Kaminski NRC Reviewer:

25 of 26 NUREGl021, Revision 8, Supplement 1

ES-301 Transient and Event Checklist Form ES-301-5 OPERATING TEST NO.: SROU-$4 Major 1 As RO SRO-I I I I I I As SRO Instrument/ I 2 Instructions:

(2) #&tivity manipulations ma be conducted under normal or controlled abnormal ry conditions (refer to Section .4.d) but must be significant per Section C.2.a of Appendix D.

(3) Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirement.

Author: FJ Kaminski NRC Reviewer:

\

f 25 of 26 NUREGl021, Revision 8, Supplement 1

ES-30 I Transient and Event Checklist Form ES-301-5 OPERATING TEST NO.: SROI-1 Applicant TY Pe 1 2 3 4 RO Major I 1 I Reactivity 1 1 Normal 0 As RO Instrument/ 2 Ax Component 568, 7

Major 1 SRO-I Reactivity 0 Normal 1 4 As SRO Instrument/ 2 12, Component 3,73 Major 1 5,6 SRO-U Instructions: (1) Enter the operating test number and Form ES-D-I event numbers for each evolution (2) %&tivity manipulations ma be conducted under normal or controlled abnormal 8

conditions (refer to Section .4.d) but must be significant per Section C.2.a of Appendix D.

(3) Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirement.

Author: FJ Kaminski NRC Reviewer:

25 of 26 NUREG1021, Revision 8, Supplement 1

ES-301 Transient and Event Checklist Form ES-301-5 OPERATING TEST NO.: SROI-2 Applicant Evolution Minimum Scenario Number TY Pe TY Pe RO Reactivity 1 1 Normal 0 As RO Instrument/ 2 Component Major SRO-I As SRO I Normal I I 1 4 1 I Instrument/

Component Major Reactivity I 0 I I I I SRO-U Instructions: (1) Enter the operating test number and Form ES-D-1 event numbers for each evolution (2) %&tivity manipulations ma be conducted under normal or controlled abnormal conditions (refer to Section rY.4.d) but must be significant per Section C.2.a of Appendix D.

(3) Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirement.

Author: FJ Kaminski NRC Reviewer:

25 of 26 NUREGI 021, Revision 8, Supplement 1

ES-301 Transient and Event Checklist Form ES-301-5 OPERATING TEST NO.: SROI-3 Applicant Evolution Minimum Scenario Number TY Pe TY Pe Number RO I Reactivity I I

1 1 Normal As RO Instrument/

Component I Major l l SRO-I I Reactivity I 0 I I I I I I Normal I 1 I 1 4 1I I I

I As SRO Instrument/ 2 12% I Component 3,7 I I Major 1 I 56 I Instructions: (1) Enter the operating test number and Form ES-D-1 event numbers for each evolution (2) #k%ivity manipulations ma be conducted under normal or controlled abnormal conditions (refer to Section d.4.d) but must be significant per Section C.2.a of Appendix D.

(3) Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirement.

Author:

NRC Reviewer:

25 of 26 NUREGl021, Revision 8, Supplement 1

ES-301 Transient and Event Checklist Form ES-301-5 OPERATING TEST NO.: SROI-4 I Applicant Type RO I I I I I I I As RO SRO-I As SRO I Norma' I ' I I I I I Instrument/ 2 12, Component 3,7,8 Instructions: (1) Enter the operating test number and Form ES-D-1 event numbers for each evolution (2) #E&tivity manipulations ma be conducted under normal or controlled abnormal 8

conditions (refer to Section .4.d) but must be significant per Section C.2.a of Appendix D.

(3) Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's competence count toward the minimum requirement.

Author: FJ Kaminski NRC Reviewer:

25 of 26 NUREG-1021, Revision 8, Supplement 1

ES-301 Competencies Checklist Form ES-301-6 SROU-1 SROI-1 RO-1 GOLF CREW A Competencies SCENARIO SCENARI0 SCENARIO t

314 Understand and Interpret Annunciators and Alarms Diagnose Events and Conditions Understand Plant and System Response Comply With and Use Procedures (1)

Operate Control Boards (2)

Communicate and Interact With the Crew Demonstrate Supervisory q-Ability (3) lrLL I

Comply With and Use Tech. Specs. (3)

Instructions:

Circle the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

Author: F J K a m Chief Examiner: \, G-7 NUREG-I 021, Revision 8

ES-301 Competencies Checklist Form ES-301-6 SROU-2 SROI-2 RO-2 GOLF CREW B Competencies L-SF SR PO 4

SCENARIO

-PO 1

SCENARIO 3 -5 Understand and Interpret 234 6,7 4,7 6A.7 Annunciators and Alarms 0 3.b, Diagnose Events and 5,6A 4,7 7,b Conditions 27 Understand Plant and System Response Comply With and ALL Use Procedures (1) 3.4, Operate Control N/A s, 4 Boards (2) 7.8 Communicate and Interact With the Crew 1 ALL 1 ALL ALL Demonstrate Supervisory ALL N/A Ability (3)

Comply With and 23 N/A

\

Use Tech. Specs. (3)

Instructions:

Circle the applicant's license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

Author: FJ &Qmirs.ki Chief Examiner: \.w NUREG-I 021, Revision 8

ES-301 Competencies Checklist Form ES-301-6 SROU-3 SROI-3 RO-3 GOLF CREW C ComDetencies I I

SCENARIO SCENARI0 -SCENARIO I SR 1

1 PO RO 2

4.7 Understand and Interpret Annunciators and Alarms 2;;

Diagnose Events and 5,6A Conditions ,7 Understand Plant and I 1,2,3 System Response Comply With and Use Procedures (1)

I ALL ALL ALL Operate Control NIA 1,4, Boards (2) 6A, 1

6B Communicate and Interact With the Crew 1 ALL ALL ALL Demonstrate Supervisory q

, NIA NIA Ability (3)

Comply With and NIA NIA Use Tech. Specs. (3)

Notes:

(1) Includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Circle the applicant's license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

NUREG-I 021, Revision 8

ES-301 Competencies Checklist Form ES-301-6 SROU-4 SROI-4 RO-4 GOLF CREW D Competencies I SCENARIO SC ENARlO SCENARIO I I Understand and Interpret Annunciators and Alarms 3f6 Diagnose Events and 5,6A 7,8 Conditions ,7 3A Understand Plant and 123 5fb 4,6A System Response 7,g 63 6B I-Comply With and Use Procedures (1)

Operate Control I IALL N/A ALL 3,4 ALL 1,2,3 ALL N/A ZC.

Boards (2) 7,s 5,6A 6B,7 2

Communicate and Interact With the Crew I IALL ALL ALL ALL Demonstrate Supervisory Ability (3)

Comply With and I IALL N/A N/A ALL 1

Use Tech. Specs. (3)

Notes:

( I ) Includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Circle the applicant's license type and enter one or more event numbers t h t will allow the examiners to evaluate every applicable competency for every applicant.

Author: FAKawhs!kki Chief Examiner: \ F 7 NUREG-1021, Revision 8

ES-301 Competencies Checklist Form ES-301-6 RO-5 GOLF CREW A Competencies I 1 SCENARIO 2

SCENARIO SCENARIO PO Understand and Interpret Annunciators and Alarms Diagnose Events and Conditions Understand Plant and System Response Comply With and Use Procedures (1)

Operate Control Boards (2)

Communicate and ALL Interact With the Crew Demonstrate Supervisory N/A Comply With and NIA Use Tech. SDecs. (3)

Notes:

(I) Includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Circle the applicant's license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

Author:

Chief Examiner:

NUREG-1021, Revision 8

ES-401 Written Examination Form ES-401-7 Quality Checklist am Level: R ~ S R O

..LJ Initial Item Description J-FrT

1. Questions and answers technically accurate and applicable to facility

2. a. NRC WAS referenced for all questions

b. Facility learning objectives referenced as available

3. RO/SRO overlap is no more than 75 percent, and SRO questions are appropriate per Section D.2.d of ES-401

4. Question selection and duplication from the last two NRC licensing exams appears consistent with a systematic sampling process

5. Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item that applies) and appears appropriate:

2.C the audit exam was systematically and randomly developed: or

-the audit exam was completed before the license exam was started; or

-the examinationswere developed independently; or

-the licensee certifies that there is no duplication; or

-other (explain)

6. Bank use meets limits (no more than 75 Bank Modified New percent from the bank at least t O percent new, and the rest modified); enter the actual question distribution at right 27 2 CPQ

7. Between 50 and 60 percent of the questions on Memory CIA the exam (including 10 new questions) are written at the comprehensionlanalysislevel; enter the actual question distribution at right y6 5-4

8. Referenceshandoutsprovided do not give away answers

9. Question content conforms with specific WA statements in the previously approved examination outline and is appropriate for the Tier to which they are assigned; deviations are iustified

10. Question psychometricquality and format meet ES,Appendix B, guidelines

11. The exam contains 100, one-point, multiple choice items; the total is correct and agrees with value on cover sheet

a. Author

b. Facilii Reviewer r)

c. NRC Chief Examiner (#)

d. NRC Regional Supervisor Note: The facility reviewer's initialdsignature are not applicablefor NRC-developed examinations.

1. 1. independent NRC reviewer initial items in Column "c;" chief examiner concurrence required.

NUREG-1021, Revision 8, Supplement 1 42 of 46

ES-401 Written Examination Form ES-401-7 Quality Checklist

-Initial b'

2. a. NRC WAs referencedfor all questions 4 $7 t

5. Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:

-#( the audit exam was systematically and randomly developed: or

-the audit exam was completed before the license exam was started; or

-the examinationswere developed independently; or

-the licensee certifies that there is no duplication; or

-other (explain) I I I at least 10 percent new, enter the actual question

a. Author

b. Facility Reviewer (*)

c. NRC Chief Examiner (#)

d. NRC Regional Supem'sor I, Note:

• The facility reviewer's initials/signature are not applicable for NRCdeveloped examinations.

1. Independent NRC reviewer initial items in Column "c;" chief examiner concurrence required.

NUREG-1021, Revision 8, Supplement 1 42 of 46

ES-403 Written Examination Grading Form ES-403-1 Quality Checklist 11 Facility: Date of Exam: Exam Level: RO/SRO l

I 1 .initials Item Description a b C

1. Clean answer sheets copied before grading

2. Answer key changes and question deletionsjustified and documented

3. Applicants' scores checked for addition errors (reviewers spot check > 25% of examinations)

4. Grading for all borderline cases (80% +/- 2%) reviewed in detail

5. All other failing examinations checked to ensure that grades are justified

6. Performance on missed questions checked for training deficiencies and wording pr~blems;evaluate validtty of questions missed by half or more of the applicants K QGJ T 5 v

(*) The faciltty reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

5 of 5 NUREG-1021, Revision 8, Supplement 1