ML022100226

From kanterella
Jump to navigation Jump to search
Final - Qa/Related Forms
ML022100226
Person / Time
Site: Peach Bottom, Limerick  Constellation icon.png
Issue date: 05/24/2002
From: Conte R
NRC/RGN-I/DRS/OSB
To: Wasong A
Exelon Nuclear
References
50-277/02301, 50-278/02301, 50-352/02301, 50-353/02301
Download: ML022100226 (35)


Text

Examination Preparation Checklist Form ES-201-1 (R8, Si)

Target Date* Task Description / Reference F :xam11 Initials 05-Dec-01 1. Examination administration date confirmed (C.1.a; C.2.a & b) Z=

03-Feb-02 2. NRC examiners and facility contact assigned (C.1.d; C.2.e) 03-Feb-02 3. Facility contact briefed on security & other requirements (C.2.c) 03-Feb-02 4. Corporate notification letter sent (C.2.d) 05-Mar-02 [5. Reference material due (C.1.e; C.3.c)] Ala 20-Mar-02 6. Integrated examination outline(s) due (C.1.e & f; C.3.d) 25-Mar-02 7. Examination outline(s) reviewed by NRC and feedback provided to facility 2-a-2 licensee_(c.2.h;_C.3.e) ' A-Zi~o *o.

19-Apr-02 8. Proposed examinations, supporting documentation, and reference materials 4.4 2 due (C.1.e, f, g & h; C.3.d) 2 04-May-02 9. Preliminary license applications due (C.1.1; C.2.g; ES-202) '

20-May-02 10. Final license applications due and assignment sheet prepared (C.1.1; C.2.g; 20My-2 ES-202)

  • S;I2AI0 20-May-02 11. Examination approved by NRC supervisor for facility licensee review (C.2.h;

_____ _C .3 .f) k 5 (f 20-May-02 12. Examinations reviewed with facility licensee (C.1.j; C.2.f & h; C.3.g) o0

13. Written examinations and operating tests approved by NRC supervisor 27-May-02 (C.2.i; C.3.h) k 9/Z4:/'o 2 27-May-02 14. Final applications reviewed; assignment sheet updated; waiver letters sent (C.2.g, ES-204) 7i 27-May-02 15. Proctoring/written exam administration guidelines reviewed with facility licensee and authorization granted to give written exams (if applicable) (C.3.k)
  • 3 I_.
16. Approved scenarios, job performance measures, and questions distributed 27-May-02 to NRC examiners (C.3.i) T"- .6jZY1.0Z ES-201-1 Page 1 1/1 1/02

ES-201 LSRO Examination Outline Modified Form ES-201-2 Quality Checklist Facility: 4 i/..l/ (Ctz ;4-C-0t 3077rA4 Date of Examination: (-0/3 0 Item Initials Task Description a b* c#

1. a. Verify that the outline(s) fit(s) the appropriate model per ES-701.

W R b. Assess whether the outline includes appropriate fuel handling K/As as listed in I ES-701 D.1 and whether all K/A categories are appropriately sampled.

T T c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.

N d. Assess whether the outline includes fuel handling reactor theory and thermodynamic topics. , I

2. a. Using criteria specified in ES-701, verify that the proposed scenario sets cover the required J1 number of instrument or component failures and major transients.

I p b. Assess whether there are enough scenario sets to test the projected number of applicants o without compromising exam integrity; ensure each applicant can be tested using at least one new or significantly modified scenario, that np scenarios are duplicated exactly from the applicants' audit test(s)*. and scenarios will not be repeated over successive days.

c To the extent possible, assess whether thc outline(s) conform(s) with the qualitative and quantitative criteria specified in ES-701. r,

3. a. Verify that:

(1) the outline(s) contain(s) the required number of in-plant tasks, W (2) no more than 30% of the test material is repeated from the last NRC examination, 14

/ (3)* no tasks are duplicated from the applicants' audit test(s), and T (4) no more than 80% of any operating test is taken directly from the licensee's exam banks. __"

b. Verify that:

(1) the tasks are distributed among the safety function groupings as specified in ES-701, (2) one task includes actual movement of dummy elements, assemblies, or modules when feasible 7A (3) 40% of the tasks require the applicant to implement an alternate path procedure, (4) one in-plant task tests the applicant's response to an emergency or abnormal condition, and (5) the in-plant walk-through requires the applicant to enter the RCA. Pr

c. Verify that the required administrative topics are covered, with emphasis on performance based activities. -,1
d. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on successive days.
4. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam section.

E b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate. __J ___,

N __

E c. Ensure that K/A importance ratings (except for plant-specific priorities) are at least 2.5. _ _,, _

R A d. Check for duplication and overlap among exam sections. ,('

L e. Check the entire exam for balance of coverage.

f. Assess whether the exam fits the appropriate job responsibilities (LSRO). ____

- .Pinted Name / SJraure , ,lateJ"J_

a. Author * 5*

T",, 7 re D_9

b. Facility Reviewer (*) B 0.300N. IV<. LTZ /i- -O2 1
c. NRC Chief Examiner (#); N.k W¶c I
d. NRC Supervisor I I a

Note:

  • Not applicable for NRC-developed examinations.
  1. Independent NRC reviewer initial items in Column "c;" chief examiner concurrence required. I 23 of 24 NUREG-1021, Revision 8, Supplement 1

March 20, 2002 MEMORANDUM TO: Exam File Exelon LSRO - Peach Bottom / Limerick Station FROM: Alan Blamey Senior Operations Engineer ' "

SUBJECT:

COMMENTS ON PEACH BOTTOM / LIMERICK STATION LIMITED SENIOR REACTOR OPERATOR EXAM OUTLINE.

The purpose of this memorandum is to document comments on the Peach Bottom / Limerick Station exam outline received on Monday, March 18, 2002. The exam outline was reviewed by A. Blamey, Senior Operations Engineer. The comments were provided to J. Stevens, Examination Developer, Exelon on March 20, 2002. The comments are as follows.

Modified ES-201-2, Examination Outline Quality Checklist Section 1. Written S5/ /o b. The Exelon modified form ES-201-2, does not verify that the outline has been randomly and systematically selected. This is 54{.

required to prevent inadvertent biasing of the exam.

This issue was discussed with J. Stevens and the following method was used to obtain a random outline, with slight bias toward the Fuel Handling Equipment.

Exelon has performed a job task analysis (JTA) for the LSRO position. This K/A base is used to randomly select K/As in the following manor. (This forms the basis for deselecting K/A in the BWR catalog - NUREG 1123).

1. The Exelon developed JTA - K/As are characterized into the four subject area listed in ES-701 section D. 1.
2. System and procedures are randomly selected within these categories.
3. Once the system or procedure(EOP or Abnormal) is selected the final K/A is randomly selected within the system or procedure.

S514o- c. The modified form ES-201-2, does not verify that the deselected s.A. topics were acceptable. This was performed by a JTA that was

performed for the LSRO position. Exelon JTA was NOT reviewed as part of this exam outline review.

Section 2. Integrated Plant Operation (IPO)

b. Must verify that:

that no scenarios will be duplicated from the applicants audit exam. This will be completed when the audit exam outline is completed. Exelon is aware of this condition and will plans to prevent exam overlap.

s L4. The scenarios will not be repeated on successive days.

The schedule can not be finalized at this time, it will be finalized during the preparation week. (Use of the refueling bridge)

Section 3. Walk Through - Job Performance Measures (JPM)

To 513/cZ. a. (3) No scenarios are duplicated from the applicants audit exam.

Since the audit exam has not been developed this must be verified prior to administering the exam. Exelon is aware that the walk through (JPMs) exams can not be a duplicated from the audit exam.

Section 4. General e k a. Ensure the K/A importance ratings are at least 2.5.

The facility walk-through exam dose not have K/A importance assigned to the tasks. This includes section A and B. (ES-301-2, Section D.1.c) V

Ž' -$3/s , b. Check for duplication and overlap among exam sections.

-s4.

The outline appears acceptable; however, the NRC can not make a final determination until the exam is drafted and the individual questions can be reviewed.

S5//3I - c. Check the entire exam for balance of coverage.

The outline appears balanced; however, can not make a final determination until the exam is drafted and the individual questions can be reviewed.

Comment:

Peach Bottom Section A, JPM A.3, "Drywell Access Restriction During Fuel Handling," (page 9 of 15) is very similar to the first component failure in the Limerick scenario No. 1 (page 12 of 15).

This scenario requires inspection of the drywell upper seal plate and because of access to this area fuel moves must be stopped.

NRC Action: In the past we have issued a dual license for Limerick and Peach Bottom LSROs.

We plan to continue this process in Region I; however, Exelon has requested to change the LSRO exam. In the past each applicant was given a common written exam and a full operating test at each site. Exelon has requested to change this test methodology as listed below.

1. A 50 question written examination that covers both Peach Bottom and Limerick. No Change.
2. In the past a total of 10 administrative JPMs were performed. Five administrative JPM at Limerick and five administrative JPMs at Peach Bottom.

REQUESTED CHANGE Exelon requested a change to have a total of five administrative JPMs combined for Limerick and Peach Bottom.

BASIS: The administrative procedures are very similar between the sites. In addition, there is one administrative JPM that specifically looks at differences between the sites.

3. A total of 10 JPMs will be performed. Five JPM at Limerick and five JPMs at Peach Bottom. No Change.
4. A total of 4 IPOs will be tested. There will be 2 at Limerick and 2 at Peach Bottom. No Change. No Change.

April 17, 2002 MEMORANDUM TO: Exam File Exelon LSRO - Peach Bottom I Limerick Station FROM: Alan Blarney ý Z i37 Senior Operations Enginee"

SUBJECT:

CHANGE TO PEACH BOTTOM (PBAPS) / LIMERICK (LGS)

STATION LIMITED SENIOR REACTOR OPERATOR EXAM OUTLINE IN REFERENCE TO ROI 02-04.

The purpose of this memorandum is to document the change to the PBAPS I LGS exam outline in reference to the incorporation of ROI 02-04. The exam outline was reviewed in reference to ROI 02-04 and found to meet the condition specified in the ROI. The outline changes are listed below.

ROI 02-04 changes - Category A JPM A.1-2 Was changed to specifically examine differences between PBAPS and LGS.

JPM A.3 Was changed from a JPM to 2 questions to make the task more PBAPS specific.

Written Exam (Unrelated Changes)

Question 3-12 Fuel handling equipment question changed from a PBAPS to a LGS question.

Question 3-16 Equipment control question changed from a LGS to a common question.

In both cases the K/A remained the same only the effected unit changed. The distribution of the exam is still evenly distributed among PBAPS (28%), LGS (28%) and Common (44%).

Based on these changes the original ES-201-2, "LSRO Examination Outline Quality Checklist,"

was re-reviewed and found to be still valid. A revised ES-201-2 form will not be issued.

Re-reviiewed Approved

6/2000 Operator Licensing Interaction No.:

Report on Interaction (ROI) 02-04

Subject:

Revision to LSRO Administrative JPM Exam Methodology Type of Action: Waiver: Policy Interpretation: X Request for HQ Action:

From: R. Conte, Chief Operational Safety Branch Date: 3/27/02 To: R1/DRS/OSB D. Trimble, Chief, IOHS Proposed Due Date,: "033/28/02 Info.: *If this is reviewed and approved by 3/28/02 Exelon will develop 5 Administrative JPMs and not 10. (The exam outline supports both 5 or 10 administrative JPMs)

Background / Issue:

Region I requests that the LSRO exam composition administrative JPMs (5 at Limerick and 5 at Peach be modified by reducing the total number of 10 Bottom) to a total of 5 administrative JPMs.

NRC Region I issues dual facility licenses for Peach Bottom and Limerick (Exelon) Limited Senior Reactor Operators (LSRO). This is allowed by ES-701 since same vendor. ROI 91-49, "Approval of LSRO Licensethe facilities are both BWR designs manufactured by the approved the test methodology to perform this dual That is Valid for Both Peach Bottom and Limerick,"

facility license. The methodology is as follows:

a. One written exam that will cover both facilities.
b. Two operating exams - one at each facility composed of the following.
1. 10 Administrative JPMs (5 at Limerick and 5 at Peach
2. Bottom) 10 JPMs (5 at Limerick and 5 at Peach Bottom)
3. 4 Integrated plant operation scenarios (2 at Limerick With respect to b. 1 above, Exelon has requested and 2 at Peach Bottom) total number of 10 administrative JPMs (5 at Limerick that the LSRO exam composition be modified by reducing and 5 at Peach Bottom) to 5 administrative JPMs. the basis for this request is that both facilities use a common The continue to test differences between the facilities in / similar set of administrative procedures. The the administrative JPMs, as well as the rest of the exam will exam.

Recommended Action / Resolution: In light of the common administrative procedures Region I recommends reducing the LSRO Administrative Topics (Category A) to 5 administrative question, specifically including differences between the facilities. This meets the requirements discrimination of operator performance during all portion of ES-701 and will continue to allow for of the LSRO exam. See Attached 1 - ES-701 Analysis Final Action / Resolution: The recommended resolution is approved subject to the following conditions: (1) Category A will consist of 5 JPMs clarifications/

or two questions per topic for which a JPM is at least two of the five topics will be tested at not performed; (2) each facility; and (3) at least two of the five topics will focus on differences between the facilities.

File Subject s : 10CFR55: NUREG-1021: ES-701 Specify Other: ROI 91-49 Distribution: OLBCs, ROI logbook I Post on Web: Yes or No?

Signatures / Concurrences Originator: R. Conte, Chief, Operational Safety Branch Date: 03/27/02 R1/DRS/OSB OGC: N/A (if needed) Date::

IOHS CH: D. C. Trimble, Chief, IOHS/IEHB IRA/ Date:; -3/29/02 IOLB CH: T. Quay, Chief, IEHB IRA/ (If needed) Date:' 4/1/02 Page 1 of 2

ROI 02-04 Revision to LSRO Administrative JPM Exam Methodology Attachment I - Analysis of Change Results of Analysis:

Reducing the LSRO Administrative JPMs, specifically including Topics (Category A) to 5 differences between the facilities,administrative requirements of ES-701 and meets the will still allow for continued operator performance during discrimination of all portion of the LSRO exam.

Analysis of Change - ES-701, "Administration of Initial Examinations for Senior Operations Limited for Fuel Handling."

C.2 RESPONSIBILITIES - NRC Regional Office The NRC regional office is responsible for the same activities unrestricted ES with the following specified in the exceptions and modifications:

2. With the concurrence of the NRR operator licensing program regional office may issue office, the LSRO licenses that are valid than one site provided the for units at more units are manufactured by and are of similar design. the same vendor The applicant must pass addresses the differences an examination that' in the design, procedures, administrative controls of technical data, and the separate facilities for which being sought. the license is E. 1 OPERATING TEST INSTRUCTIONS The LSRO operating test shall generally be prepared, documented in accordance administered, and with ES-301, ES-302, and sampling requirements will ES-303. However, the be less than those required for an SRO applicant.

ES-301, "Preparing Initial Operating Tests," Require JPMs (administrative). a total of five category A A. 1 "Conduct of Operations" A.2 2 Questions "Equipment Control" A.3 1 Question "Radiation Control" A.4 1 Question "Emergency Plan" 1 Question Therefore, ES-701 requires section and reducing the a 5 question administrative LSRO section to 5 administrative topic (category A) differences between the facilities question, addressing meets the requirements of ES-701.

Page 2 of 2

q4.÷ NRC cORM 503 U.S. NUCLEAR REGULATORY COMMISSION 1. SUBJECT OLe MC 160 ATTACHMENT'I APPROVAL OF LSROBOTTOMLICENSE THAT IS VALID

,6.maw REPORT ON INTERACTION FOR BOTH PEACH ATOMIC POWER STATION AND LIMERICK GENERATING STATION.

2. ORIGINATOR 3. DATE 4. TYPE OF ACTION H. WILLIAMS/R. CONTE/L. BETTENHAUSEN NOV. 6, 1991 WAIVER 5.CIIN C O DFrir/91 POLICY INTERPRETATION R. GALT0, CHIEF, 0LB___ X REQUEST FOR HO ACTION
7. OTHER PARTIES L. MILLEt, 8. PROPOSED DUE DATE T. PEEBLES, RII, J. PELLET, RIV, G. WRIGHT, RIll, RV
9. BACKGROUND SEE ATTACHED
10. SPECIFIC:PROPOSED ACTION REQUIRED SEE ATTACHED
11. RECOMMENDED RESOLUTION SEE ATTACHED
12. FINAL RESOLUTION Concur with region's recacuidation. The region rrust ensure that significant differences betxeen the facilities are tested on the written exam, as appropriate.
13. FOLLOW-UP ACTION REQUIRED (Crd.ec**apropnareboxi 14. FILE SUBJECT 15. DISTRIBUTION ISPec$i'f OGC CONCURRENCE 10 CFR 55. WDean log book SOGC ACTION ES- 701 RGal Io Regional BCs/SCs OTHER ($eitv) OTHER (Specifyi RLo 0LB Rauting
16. SI-A-TRE GINAL BRA CH CHIEF 117. DATE 18. DISTRIBUTION 19. DATE 1_/*E/
20. SIG7r G

CH IE H HE 21. DAHCE COMPLETED

,, *o.,;RLEqF OLBSEC ETARY ,

MARCFO*M 503 (6.88)

Page . 1Z- 0.o

4, .* £ REPORT ON INTERACTION Item 9 Background Draft ES-701 (dated 871/91) Paragraph .B.2.d states, "At the discretion of the Chief, Operator Licensing Branch, an individual may be issued an LSRO license that is valid for units at more than one site that are from a single vendor of similar design."

PECo is currently training personnel for a dual LSRO license exam for Peach Bottom and Limerick.

NRC is scheduled to give the exam during the week of January 13, 1992.

Item 10 Proposed Action Region I plans to give a written exam which will cover both sites and conform to the guidance in ES-701. An operating exam will be given at each site to each candidate.

This approach was discussed and agreed with in principal at meetings earlier this year between Region I and OLB.

Item 11 Recommended Resolution Recommend concurrence with proposed action and approval of issuance, as appropriate, of a single LSRO license for both sites.

ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of /o z as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2. Post-Examination To the best of my knowleoige, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of (e13 it)Z_. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGN TURE (2) DATENOTE 2~~tt4~jo ----

j- --- --------

73.

4. Li___. ,. . -6 . 41--Xp

' N41eX6j )IL'--9L

'w4)OA Lc÷.- aK7)f Oiw-v -* .z4I _ _ .-- -o*

X -~s~---- r l)f-- - - ------------------

4 ------

Y 5.--J,¥- _ -: ,- ,,-,-- _

12. 3 T-4A 04 -1

-M I l -& I A A,-- - ,- -.-.-

13.

14.

15.

NOTES: ,-r /*,,V", c., ,

NUREG-1021, Revision 8, Supplement 1 24 of 24

3CC2 cSAq (I

(

ES-201 Examination Security Agreement Form ES-201-3

1. Pru-Exam [nation I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of (137/ Z as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that Iam not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Furtherrnore, I am aware of the physical security measures and requirements (as documented in the facility Iicensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2. Post-Examination To the best of my know~e~lgp, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of -- &TZ.. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

0 PRINTED NAME JOB TITLE f RESPONSIBILITY SIGNATURE (1) DATE SIGN TURE(2) DATENOTE CD Eýý\ t. 5'-zF1'.q.

U

  • _*o Z"_b ,2 ".**o Cien rl13 7giýlaweg CP'-'r Qlni-o tfAJ~TtE 7r/ eNwr 54, JY L4S~C

-TZsn4rt,4sf0 Q Q291. JL.

rgscamc/'1AWreS A . _o**el7

  • hl*" * **W

._1 N

CE" 14. RuIS.MNE. Ctscg __

u_

s 12. Inrk-udv W74;, -tr 7&

it:

13. _ _ _ _
14. r 115.

NOTES:

c1oCV2tZ NUREG-1021, Revision 8, Supplement 1 24 of 24 O'Q

ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination LS KC -. ,

I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 6/3/02 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowled e, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of \\ Z_ From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATENOTE

2. a a-s-) -- --- ----- W _Zi Z - --

~~

3.L@~4 ~ s~ ~ ~ )fo~~- ------- -- A----- - A 4 / 2 ---- AI~ A~~/

4.

5._

6.

7.

8._

9._

10.

11.

12.

13.

14.

15.

NOTES: V'A--7?

VAI+7 - '--eT- A,,4-L Nsion 8C, S 1 NUREG-1021, Revision 8, Supplement 1 24 of 24

ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination LS ,R/ R P I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 6/3/02 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2. Post-Examination To the best of my knowl~ed e, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of - From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATENOTE AL /L - ....

4. _
4. --------------------------------------------

6.

6-----------------------------------------------

7._ ------ --------------------- ----- ----

8.,8 - - - - - - - - - - - - - - - - - - - - --

9. - - - - - - - - - -

10.

10.---------------------------------------------------

11 ------------ -------------------------------------- ------ -------------------- -----

12. ----

13.

14.

15.

NOTES:

NUREG-1021, Revision 8, Supplement 1 24 of 24

ES-2U1 Examination Security Aqreement Form ES-201-3

1. Pre-Examination (LSRO Examination)

I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 6/3/02 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowl pcge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provi e performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESP ONSIBILITY SIGNýAý (1) DATE SIGNAT (2) DATENOTE 2.

3. 9WL--c Z,

ý04 d-b., -ýAMt -----------

V--- --- 41

4. ----------- -------------------- ------ --------------------- ----- -

5.

6.

7.

8.

9.

10. --------- -------------------------- ------ --------- ---------- ----- ----
11. ------------- --------------------------- ------ -- ---------------- ----- ----
12. ------------- --------- ---------- ------ -------------------- ----
13. ------------- --------- ---------- ------ -------------------- ----
14. --------- --------------------------- ------ --------- ---------- ----- ----
15. ------------- --------------------------- ------ -------------------- ----- -- --

NOTES:

NUREG-1021, Revision 8, Supplement 1 24 of 24

jSzo / Ht1 ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 6/3/02 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Furthermore, Iam aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2. Post-Examination To the best of my knowldg e, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of \ . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGN TURE (1) DATE SIGNATURE (2) DATENOTE Lst, First LSRO Bridge Team

3. -.
2. K . . . .

-L~

---~ j 4 4._

5._

6.

7. ----------------------------------------- ------------- ------ ------ ---------------------- ----- ----

8.,4 ---------------------------------------------------------------- ------ --------------------- ----- ----

9._

10.

11.

12.

13.

14.

15.

11 - - ------ ---------------------------------- -- ----------------------------------------------------

NOTES: ( 4 S//li NUREG-1021, Revision 8, Supplement 1 24 of 24

N)

C:

ES-201 Examination Security Agreement Form ES-201-3 R)

1. Pre-Examrnation I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 613/02 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that r am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except authorized by the NRC.Furthermore, I am aware of the physical security measures and requirements (as documented as specMically noted below and in the facility licensee's -I procedures) and understand that violation of the conditions of this agreement may result in cancellation action against me or the facility licensee. I will immediately report to facifity management or of the examinations and/or an enforcement the NRC chief examiner any indications or suggestions that m examination security may have been compromised.
2. Post-Examination C)

To the best of my kno IpdpIe, I did not divulge to any unauthorized persons any information concerning duding the week(s) of the NRC licensing examinations administered

. From the date that I entered into this security agreement until the completion of examination instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except administration, I did not as specifically z noted below and authorized by the NRC.

a) if)

PRINTED NAME JOB TITLE I RESPONSIBILiTY SIG TURE (1)

L.st, First DAT NA RE (2) DATEN0TE m LSRO Brdge Team _ -7

2. .- R10_ _ _

Z~

4.

5. -
6. CD 7 ,.0 8.

10.

oD

11. - - _ _ _ _ _ _ _ _ _

12,.0 13, _ _ _ _

_ _ _ o__

14. __ _ _ __ _ _ _

15.C NOTES:

NUREG-1021, Revision 8, Supplement 1 24 of 24 7) rS)

7`1 ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 6/3/02 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2. Post-Examination To the best of my knowlp qge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of &[3-\' . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATENOTE

1. Guarino, Edward PBAPS Refuel Platform System Manager 2.

3.

4.

5.

6.

7.

8.

9.

10.

11.

12.

13.

14.

15.

NOTES: CF-,

a1:

NUREG-1021, Revision 8, Supplement 1 24 of 24

(

(

ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination (LSRO Examination)

I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 6/3/02 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowlqdge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of 7 L._ From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATENOTE i~ //A~ -- -- -- ----- ---

2.Z_

3._

4._

5._

6.

7.

8. --------------------------------------- ------ ---- ------ ----- ----

9._ --------------- ----------------- ------ --------------------- ----- -- -

10.

11. --------------- ----------------- ------ --------------------- ----- -- --

12.

13.

14.

15.

NOTES: O _.* ,* )*A1 " $V'-

NUREG-1021, Revision 8, Supplement I 24 of 24

ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination (LSRO Examination)

I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 6/3/02 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowl d1e, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of (j,' \-7 . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATENOTE 1.*_.*** _._ C (o* ']_o*JA 5S O.rv ,a- o *___ 2* (4 Jo., -a*" *_ik_ 7_-_2~--0

3. _

3--------------7 ---------------------- ---------- ------ --------------------- -----

4._

4 ------------------------------ --- ------

5.

6.

7. _
8. ------------ ------------------- ------- --------------- ----------------------- -- -
9. ------------

10.

11. 11-- - - - ---- - - - - - - - - - - - - - - - - - -- - - - - ------

12.

13.

14.

15.

NOTES:

NUREG-1021, Revision 8, Supplement 1 24 of 24

") _

ES-201 Examination Securnty Agreement Form ES-201-3

1. Pre-Examination (LSRO Examination) CN I acknowledge that I have acquired specda[ized knowledge about ft NRC licensing examinations scheduled for the week(s) of 6/3/02 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized Co by the NRC chief examiner. [ understand that Iam not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be co administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and -n authorized by the NRC.Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's 70 procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2. Post-Examination To the best of my know[qdge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered 7 during the week(s) of (4- From the date that I entered into this security agreement until the completion of examination administration, instruct, evaluate, or provide4 performance feedback to those applicants who were administered these I did not licensing examinations, except as specifically noted below and authorized by the NRC.

Z PRINTED NAME JOB TITLE I RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATENOTE M Z

2.

4. OD
4. 0_

Go_

6. __0 910.

o__

Co 12.

OD

  • Lfl 03 CD o

14.

15.___

0

--4 NOTES:

3D rM NUREG-1021, Revision 8, Supplement 1 24 of 24 CD Ci

/ (

ES-201 Examination Security Aareement Form ES-201-3 ES-201 Examination Security Acireement Form ES-201-3

1. Pre-Examination (LSRO Examination)

Iacknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 6/3/02 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowlpdie, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of A;VtZ&.. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATENOTE

2. 6,
1. _JeffreyW.Holley Sr. Reactor Enpineer 3/22 Rec, Leý fýý ---------- 47-ev

:6 ----------- ----

4._ ------------------ ----- ----

5.

6._

7._

8._

9.

10.

11.

12.

13.

14.

15.

NOTES: C -. C.-- J .** s -5" NUREG-1021, Revision 8, Supplement 1 24 of 24

F L_-ZUlI Examination Security Aareement Form ES-201-3

1. Pre-Examination (LSRO Examination)

I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 6/3/02 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowl pdl e, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of 041) L . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATENOTE

1. _Jeffrey W. Holley .... Sr. Reactor Engineer
2. W~k~j R. 'IQe -0 4._

5._

6._

7._

8, 9._

10.

11._

12.

13.

14.

15.

NOTES:

NUREG-1021, Revision 8, Supplement 1 24 of 24

F5 C70 1)0,1 r ,.3-/_. U I I::-nrm Fq:._?n 17_

Examination Security Aaireement P~mF~9l~

1. Pre-Examination (LSRO Examination)

I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 6/3/02 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of btj L.. From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATENOTE

1. -JeffreyW.Holley Sr. Reactor Engineer---------
2. ; wý 41.0%.
4. _

5._ ---------------- --------- --

6. ----- ---- -------- ------------------------ ----- ----
7. --------------- -------------- ------------------------- ----- ----

8._ --------------- ------------- ------------------------ ----- ----

9._ --------------- ------------- ------------------------ ----- ----

10. --------------- ------------- ------------------------ ----- ----
11. --------------- ------------- ------------------------ ----- ----

12.

13. --------------- -- ------------ ----------------------- ----- ----
14. --------------- -- ------------ ----------------------- ----- -----

15.

NOTES:

NUREG-1021, Revision 8, Supplement 1 24 of 24

ES-201 Examination Security Agreement Form ES-201-3

1. Pre-Examination (LSRO Examination)

I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 6/3/02 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination To the best of my knowlpdge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of &,';VU . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATENOTE

1. Jeffrey W. Holley 4Sr.. Reactor Enpineer 3/Vz404.

" L,eh ---- .-

2. ýJA -. -- - - - - -

4--------------- ---- -------------- --------------------------- ------ --------------------- ----- ----

5._

5---- -------------------------------------------- ------ --------------------- ----- --

6._

6---- -------------------------------------------- ------ --------------------- ----- --

7.

7---- -------------------------------------------- ------ --------------------- ----- --

8._

9._

10.

1----------------------------------------------- ------ -------------------- ----- ----

11._

12.

13.

14.

15.

NOTES:

NUREG-1021, Revision 8, Supplement 1 24 of 24

f 1 C (

ES-201 Examination Security Agreement Form ES-201-3 Security Agreement for Individuals Having Access to Refueling Area Video Monitors

1. Pre-Examination During NRC Examination Activities I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of 6/3/02 as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC.Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of 6/3/02 . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.

PRINTED NAME JOB TITLE / RESPONSIBILITY DATENOTE

1. -Last, First Station Security P -E igntur
2. ----- -g --------- n Sigatue _P9_

__atr

3. +__* ez ------
4. j------_r j*_ cj - -- JJA

--j -

5. C,W
6. __, _-z-,
7. ~~- ---------- -- -- - -- - --

8.

9._ -~~~~--- ---------------

10.

11. ------------- ----------------------- --------

12.

13. --------------------- ----- ----
14. ------------- ----------------------- ---- ---

15.

NOTES: Individuals on this security agreement have access to video images of the refueling floor as part of their duties. They do not normally provide training to LSRO candidates. During NRC exam validation and performance, individuals having access to refuel floor video displays should activate only those displays required for conditions, and should minimize the time the exam activities are displayed by avoiding following examiners with movable cameras. NUREG-1021, Revision 8, Supplement 1 24 of 24

ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: , /Date of Examination: -01,_ Operatin9 Test Number:

Initials

1. GENERAL CRITERIA a b* c#
a. The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution). *. ____
b. There is no day-to-day repetition between this and other operating tests to be administered during this examination. / ,- K I,
c. The operating test shall not duplicate items from the applicants' audit test(s)(see Section D.A.a). _
d. Overlap with the written examination and between operating test categories is within acceptable limits.
e. It ap'pears that the operating test will differentiate between competent.and less-than-competent applicants at the designated license level.
2. WALK-THROUGH (CATEGORY A & B) CRITERIA
a. Each JPM includes the following, as applicable:
  • initial conditions /- '
  • initiating cues -asoitd i ireferences and tools, including associated procedures  ;. f.2 reasonable and validated time limits (average time allowed for completion) and specific designation ifdeemed to be time critical by the facility licensee
  • specific performance criteria that include:

- detailed expected actions with exact criteria and nomenclature'

- system response and other examiner cues /

- statements describing important observations to be made by the applicants

- criteria for successful completion of the task .'

- identification of critical steps and their associated performance standards

- restrictions on the sequence of steps, if applicable "

b. The prescripted questions in Category A are predominantly open reference and meet the criteria in Attachment 1 of ES-301.
c. Repetition from operating tests used during the previous licensing examination is within acceptable limits (30% for the walk-through) and do not compromise test integrity. .
d. At least 20 percent of the JPMs on each test are new or significantly modified.  ; t*s, 4/
3. e;;*ftUATfM "CATEGORY C+)CRITERIA. . .
a. The associated-sitnte eEa operating tests (scenario sets) have been reviewed in accordance with FrES314andacopy is attached. -d Printed Name / Signature Date
a. Author -. /¢ .. *" /**g /61LZ"F**IS*.¢

/A

b. Facility Reviewer(*) 2ý" V"'.*,J."_*

%J_',.. /*/ *-IO c.NRC Chief Examiner (#) A la

  • R*/JictVw 510 3 102-.
d. NRC Supervisor 16 <

-14/C.,/) /"C k*, y ** *"

NOTE:

  • The facility signature is not applicable for NRC-developed tests.
  1. Independent NRC reviewer initial items in Column "c;" chief examiner concurrence required.

23 of 26 NUREG-1021, Revision 8, Supplement 1 Al, ke / - e0mWfW1/5 d0,Woe 4 2J 0-1~ 4y&1z.o W""

Sk,~et 4,'r 1SC:/ i4.I z - F"ý sd Alea" owW (tj* -5i r

ES-301 Simlate&e- Scenario Quality Checklist Form ES-301-4 Facility: ')V'Paq Zi07z,1 Date of Exam: 6, 31& . Scenario Numbers: I / /, Operating Test No.:

QUALITATIVE ATTRIBUTES Initials a b* c#

1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events. _ _
2. The scenanos consist mostly of related events.
3. Each event description consists of the point in the scenario when it is to be initiated the symptoms/cues that will be viribl te the crz '-4 V 4 4. 1, , &,t,_

the expected operator actions (by shif#pcsitfen)v the event termination point (if applicable)

4. No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event. *r
5. The events are valid with regard to physics and thermodynamics.
6. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.
7. If time compression techniques are used, the scenario summary clearly so indicates. Operators have sufficient time to carry out expected activities without undue time constraints. Cues are given. ___ "
8. Th simulata moeln is nulteL ed.
9. The scenarios have been validated. ARy OPIn siF..latGr pG.f4craRGc d "

't',ted to cnisur that fu,.ctccl fidc*lty is maintAincd while runni.ngth pla*ncd zznorcs. __

10. Every operator will be evaluated using at least one new or significantly modified scenario. 1l other scenarios have been altered in accordance with Section D.4 of ES-301. A1-4'VC J 11.~~~~~

viua ~ e ..... vlieea efiduigFs~-S34 ..........

,p~ee .eGbubmit /// /

tileAfel- 11

...... V.oi!..... 18tfft ~ fi*

l2 Each applicant will be significantly involved in the minimum number of transients and events /

specified c.g Form.*, EG OEMF (submit th-, forF,, Yvith the r)ndc*

I*ucc Qs.- '7D) 1F, 3

13. The level of difficulty is appropriate to support licensing decisions, Z5514 C r89k_ _.

TARGET QUANTITATIVE ATTRIBUTES (PER SCENARIO; SEE SECTION D.4.D) Actua Attrutes

2. Haf. HOM , ECaftul2 '~~Q - inx.4~ ~ 5 43
3. n r . r vents Aib-2+)

ano. / /

4. P .; , ,,8 u Lv2U / /
6. E'.jr CuIl IIulI.uijub Ie4uii I bubstadilive acUliuaisU-2) / /
7. C6;t;i-; tasko (2-3) / /

NUREG-1021, Revision 8, Supplement 1 24 of 26

ES-301 Competencies Checklist Form ES-301-6 (R8, Si)

NRC Review of PB / LIM LSRO IPO Applicant #1- 4 Applicant #2 Applicant #3 LSRO RO/SRO-I/SRO-U RO/SRO-I/SRO-U Competencies SCENARIO SCENARIO SCENARIO P P L L2 1 2 3 4 1 2 3 4 1 2 1 Understand and Interpret 2 2 1 Annunciators and Alarms Diagnose Events 1, 1, 1, 1, and Conditions 2 2 2 2 Understand Plant 2 2 1, and System Response 2 Comply With and 2 2 2 1 Use Procedures Operate Control Boards (1)

Communicate and 2 1, 1, 1 Interact With the Crew 2 2 Demonstrate Supervisory 1, 1, 1, 1, Ability 2 2 2 2 Comply With and 1 Use Tech. Specs. (2)

Notes:

(1) LSRO Operates the equipment during the Cat. B portion of the exam.

(2) TS are discussed in several other areas (written).

NRC Reviewer: -ýý 2 / --

NRCReviewer:\

Kr. ŽI5) 5/zz

ES-401 Written Examination Form ES-401-7 Quality Checklist Facility: Pf 4oy"lov tg. Date of Exam: 61S0/s . Exam Level: R@RO Initial Item Description a b* c' 1 Questions and answers technically accurate and applicable to facility A0

2. a. NRC K/As referenced for all questions
b. Facility learning objectives referenced as available
4. Question selection and duplication from the last two NRC licensing exams
  • appears consistent with a systematic sampling process
5. Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:

the audit exam was systematically and randomly developed; or

__ the audit exam was completed before the license exam was started; or

_the examinations were developed independently; or the licensee certifies that there is no duplication; or other (explain)

6. Bank use meets limits (no more than 75 Bank Modified New percent from the bank at least 10 percent new, and the rest modified); enter the actual question distribution at right
7. Between 50 and 60 percent of the questions on Memory C/A the exam (including 10 new questions) are written at the comprehension/analysisatlevel; Xf .- I ý1 right enter the actual question distribution
8. References/handouts provided do not give away answers
9. Question content conforms with specific K/A statements inthe previously approved examination outline and is appropriate for the Tier to which they are _:ZS assigned; deviations are justified I'0
10. Question psychometric quality and format meet ES, Appendix B, guidelines
11. The exam contains a, one-point, multiple choice items; the total is correct and agrees with value on cover sheet Printed Name / e DStn,
a. Author -"-
b. Facility Reviewer (*) -A--//9- ', 4-i'O2
c. NRC Chief Examiner (#) kS ! j 5'_-e
d. NRC Regional Supervisor J&-i ._ 4 Note:
  • The facility reviewer's initials/signature are not applicable for NRC-developed examinations.
  1. Independent NRC reviewer initial items in Column c;" chief examiner concurrence required.

NUREG-1021, Revision 8, Supplement 1 42 of 46 Ak2. Fl:ý :5,,,A*19r5

?; (; 4

April 26, 2002 MEMORANDUM TO: Exam File Exelon LSRO - Peach Bottom / Limerick Station FROM: Alan Blamey 4/z*/0 4.- .

Senior Operations Engineer

SUBJECT:

COMMENTS ON PEACH BOTTOM / LIMERICK STATION LIMITED SENIOR REACTOR OPERATOR EXAM.

The purpose of this memorandum is to document comments on the Peach Bottom I Limerick Station exam received on Tuesday, April 16, 2002. The exam was reviewed by A. Blamey, Examiner / Inspector and C. Sisco, Examiner / Inspector. The comments were provided to J.

Stevens, Examination Developer, Exelon on April 26, 2002. The comments are as follows.

Section 1. Written 5_1_!16 z._____ _ Comments documented on ES-401-9, "Written Examination Review Cj-. Worksheet."

Section 2. Integrated Plant Operation (IPO)

All scenarios do not denote critical tasks.

Section 3. Walk Through - Job Performance Measures (JPM)

CategqoýyA JPM A2, should use detector locations other than the "A" detector to ensure that the applicants know the actual location of the detectors.

Questions A3-1 is a direct look up if allowed to use reference material.

Based on ES-301, Attachment 1, this question should be closed reference

-6114-102- questions.

Category B Limerick

_____4/___- JPM LG-1, "Movement of the Dummy Fuel Bundle in the Spent Fuel 54..- wil* *.-I m,,-,

lPool," contains procedure $97.1.A, but for the purpose of this JPM the dcrk SPM. procedure should be completed so the candidate can perform the fuel movement.

5/14/oz ,_ JPM LG-2, "LPRM Removal," should have procedure M-C-774-010 Sc,. completed to the step that the applicant will be required to perform.

-2 5147-) JPM LG-3, "Movement of Fuel From the Fuel Prep. Machine," should have the prerequisites of FH-1 06 signed off as per the initial condition of the JPM.

___________)JPM LG-5, "Defeat Unit 1 & 2 Refuel Floor HVAC High Radiation Isolation

  • .i. Signals," should have the first step of the procedure completed, suspending fuel handling activities.

Peach Bottom

. ,4OZ,* JPM PB-2, "Full Automatic Fuel Transfer Within the Spent Fuel Pool,"

  • should have a completed copy of procedure FH-35 to allow fuel movement.

f,

.- JPM PB-3, "Control Blade Removal Using the Combined Grapple," does Sý-. not have a core map that is required in JPM step 2.

JPM PB-5, "Abnormal WRNM Response During Core Alterations," should S-f. have procedure FH-6C with the prerequisites completed.

Section 4 General Comments Punch List Items

, Complete the following items during the week of May 12, 2002 during the prep.

week.

SVerify no overlap on the operating test with the Audit Exam.

that no SVerify significant overlap with the last NRC LSRO Exam.

  • Verify that the above changes have been made.

3 Complete checklist signatures when verification complete.

May 21, 2002 MEMORANDUM TO: Exam File Exelon LSRO - Peach Bottom / Limerick Station FROM: Alan Blamey /2

51Z '/40 Senior Operations Engineer

SUBJECT:

VALIDATION COMMENTS ON PEACH BOTTOM / LIMERICK STATION LIMITED SENIOR REACTOR OPERATOR EXAM.

The purpose of this memorandum is to document comments / corrections on the Peach Bottom /

Limerick LSRO exam that occurred during the exam validation week (May 13, 2002). The exam was validated by A. Blamey, Examiner/ Inspector, J. Caruso, Examiner / Inspector, and J.

Stevens, Exelon Exam Developer. The comments were provided to J. Stevens, Examination Developer, during the review. The comments were incorporated and are listed below.

Section 1. Written None Section 2. Integrated Plant Operation (IPO)

Peach Bottom IPO 1 Event 1, step 1 should be a critical task.

IPO 2 Add the Peach Bottom EALs for the applicant Section 3. Walk Through - Job Performance Measures (JPM) 'Ifl Category A None Category B Limerick JPM LG-1, More clearly specified the actions that are expected when the target location is obstructed and added more detail on revising the CCTAS.

JPM LG-3, Steps 19a, 19e are not critical tasks they are verify steps.

JPM LG-4, Added the alarm window description.

-2 Peach Bottom JPM PB-1, Removed the critical task from step 5. This is a verification step. Remove the aids that were used to perform the in-office review.

JPM PB-2, Step 5 & 27 are not critical steps, they are verifications only.

Delete step 21c because it is a duplicate verification.

JPM PB-3, Include a core map in the JPM for the candidate to identify the proper location.

JPM PB-4, Changed the initial location of the Tri-Nuc filter and added a critical step to determine if movement could occur while secondary containment was not operating.

ES-403 Written Examination Grading Form ES-403-1 Quality Checklist Facility: L/-'4 *, c i A, C--, &' DF**ate of Exam: 3.A1A,,4,1 j.)?. FYrnm I AvwI.

  • c)

Initials Item Description a b c

1. Clean answer sheets copied before grading _ _)
2. Answer key changes and question deletions justified and /,/9 ,'k~

documented (/,A Ct-/,1,&)(I---) __ / V

3. Applicants' scores checked for addition errors (reviewers spot check > 25% of examinations)
4. Grading for all borderline cases (80% +/- 2%) reviewed in detail
5. All other failing examinations checked to ensure that grades
  • are justified
6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed Name / Signature Date
a. Grader _._-y K!. $/- * (*
b. Facility Reviewer(*) __ ,,___.
c. NRC Chief Examiner (*) - il _1a*ie* Lo/,3Ioz
d. NRC Supervisor (*) _.___.__ _ --

(*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

AWC: C, 5,-5&0 e*,,. sy-,Aýý 3 -lv% -- AAJ1oo 5 of 5 NUREG-1021, Revision 8, Supplement 1