ML13248A050

From kanterella
Jump to navigation Jump to search
Initial Exam 2013-301 Final Administrative Documents
ML13248A050
Person / Time
Site: Oconee  Duke Energy icon.png
Issue date: 09/04/2013
From:
NRC/RGN-II
To:
Duke Energy Carolinas
References
50-269/13-301, 50-270/13-301, 50-287/13-301
Download: ML13248A050 (39)
v • d • e


Text

ES-201 Examination Preparation Checklist Form ES-201-1 Facility: Oconee 2013-301 Date of Examination: 06/10/2013 Facility NRC Examinations Developed by:

Written / Operating Test Written / Operating Test Chief Target Task Description (Reference) Examiners Date*

Initials

-180 1. Examination administration date confirmed (C.1.a; C.2.a and b) 12/10/2012

-120 2. NRC examiners and facility contact assigned (C.1.d; C.2.e) 12/18/2012

-120 3. Facility contact briefed on security and other requirements (C.2.c) 12/18/2012

-120 4. Corporate notification letter sent (C.2.d) 12/18/2012

[-90] [5. Reference material due (C.1.e; C.3.c; Attachment 2)] 12/31/2012

{-75} 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-5, ES-D-1's, ES-401-1/2, ES-401-3, and ES-401-4, as 03/25/2013 applicable (C.1.e and f; C.3.d)

{-70} {7. Examination outline(s) reviewed by NRC and feedback provided to facility 03/28/2013 licensee (C.2.h; C.3.e)}

{-45} 8. Proposed examinations (including written, walk-through JPMs, and scenarios, as 04/24/2013 applicable), supporting documentation (including Forms ES-301-3, ES-301-4, (O)

ES-301-5, ES-301-6, and ES-401-6), and reference materials due (C.1.e, f, g and 04/01/2013 h; C.3.d) (W)

-30 9. Preliminary license applications (NRC Form 398's) due (C.1.l; C.2.g; ES-202) 05/10/2013

-14 10. Final license applications due and Form ES-201-4 prepared (C.1.l; C.2.i; ES-202) 05/28/2013

-14 11. Examination approved by NRC supervisor for facility licensee review 04/01/2013 (C.2.h; C.3.f) (Licensee prepared examination).

-14 12. Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g) 04/25/2013 05/28/2013 (O)

-7 13. Written examinations and operating tests approved by NRC supervisor 05/30/2013 (W)

(C.2.i; C.3.h)

-7 14. Final applications reviewed; 1 or 2 (if >10) applications audited to confirm qualifications / eligibility; and examination approval and waiver letters sent 06/04/2013 (C.2.i; Attachment 4; ES-202, C.2.e; ES-204)

-7 15. Proctoring/written exam administration guidelines reviewed with facility licensee 07/10/2013 (C.3.k)

-7 16. Approved scenarios, job performance measures, and questions distributed to 06/10/2013 NRC examiners (C.3.i)

  • Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.

[Applies only] {Does not apply} to examinations prepared by the NRC.

ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility: Oconee Date of Examination: June 10, 2013 Item Initials Task Description a b* c#

1 a, Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401.

w R b. Assess whether the outline was systematically and randomly prepared in accordance with If I Section D.1 of ES-401 and whether all K/A categories are appropriately sampled.

T T c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics.

d. Assess whether the justifications for deselected or rejected KA statements are appropriate.
2. a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, S and major transients.

M b. Assess whether there are enough scenario sets (and spares) to test the projected number u and mix of applicants in accordance with the expected crew composition and rotation schedule L without compromising exam integrity, and ensure that each applicant can be tested using A at least one new or significantly modified scenario, that no scenarios are duplicated T from the applicants audit test(s), and that scenarios will not be repeated on subsequent days.

c. To the extent possible, assess whether the outline(s) conform(s) with the qualitetive and quantitative criteria specified on Form ES-301 -4 and described in Appendix D.
3. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301 -2:

(1) the outline(s) contain(s) the required number of control room and in-plant tasks W distributed among the safety functions as specified on the form T

I (2) task repetition from the last two NRC examinations is within the limits specified on the form (3) no tasks are duplicated from the applicants audit test(s)

(4) the number of new or modified tasks meets or exceeds the minimums (5) the number of alternate path, low-power, emergency, and RCA tasks meet specified on the form the criteria on the form.

b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:

(1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations \

c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.
4. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections.

G E b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.

N

c. Ensure that K/A importance ratings (except for plant-specific priorities) are E at least 2.5.

R d. Check for duplication and overlap among exam sections.

L e. Check the entire exam for balance of coverage.

f. Assess whether the exam fits the appropriate job level (RD or SRO).

.z, 7

P j ri u nte

a. Author
b. Facility Reviewer (*) 4z / i4 ZI C. NRC Chief Examiner (#) e1z LJ t,*ez.tcP ü.
d. NRC Supervisor 1 LL1 h ,AL *iAr\(JLt kL ,Ai /

Note: 7

  1. Independent NRC reviewer initial items in Column c; chief examiner concurrence Not applicable for NRC-prepared examination outlines required.

ES-301 Administrative Topics Outline Form ES-301-1 Facility: Oconee Date of Examination: 6/10/13 Examination Level: RO X SRO Operating Test Number: 1 Administrative Topic Type Describe activity to be performed (see Note) Code*

Admin-131, Perform manual RCS Leakage Conduct of Operations M, R Calculation

[KA G2.1.7 (4.4/4.7)]

(RO ONLY) (18 min)

Admin-142, Determine Time for SFP to reach Conduct of Operations M, R 180ºF

[KA G2.1.25 (3.9/4.2)]

(BOTH) (15 min)

Admin-240, Perform SG Downcomer Temperature Equipment Control M, R Surveillance

[KA G2.2.12 (3.7/4.1)]

(RO ONLY) (18 min)

Admin-306, Calculate the Maximum Permissible Radiological Control D, R Stay Time Within Emergency Dose Limits (EDLs)

[KA G2.3.4 (3.2/3.7)] (BOTH) (20 min)

Emergency Plan N/A NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.

  • Type Codes & Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank ( 3 for ROs; 4 for SROs & RO retakes)

(N)ew or (M)odified from bank ( 1)

(P)revious 2 exams ( 1; randomly selected)

ES-301 Administrative Topics Outline Form ES-301-1 Facility: Oconee Date of Examination: 6/10/13 Examination Level: RO SRO X Operating Test Number: 1 Administrative Topic Type Describe activity to be performed (see Note) Code*

Admin-130, Perform manual RCS Leakage Conduct of Operations M, R Calculation and TS determination

[KA G2.1.7 (4.4/4.7)]

(SRO ONLY) (18 min)

Admin-142, Determine Time for SFP to reach Conduct of Operations M, R 180ºF

[KA G2.1.25 (3.9/4.2)]

(BOTH) (15 min)

Equipment Control Admin-241, Complete a Surveillance Evaluation N, R

[KA G2.2.12 (3.7/4.1)] (SRO ONLY) (20 Minutes)

Admin-306, Calculate the Maximum Permissible Radiological Control D, R Stay Time Within Emergency Dose Limits (EDLs)

[KA G2.3.4 (3.2/3.7)] (BOTH) (20 min)

Admin-412, Determine Emergency Classification Emergency Plan and complete the initial Emergency Notification M, R

[KA G2.4.38 (2.4/4.4)] form (SRO ONLY) (20 min)

NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.

  • Type Codes & Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank ( 3 for ROs; 4 for SROs & RO retakes)

(N)ew or (M)odified from bank ( 1)

(P)revious 2 exams ( 1; randomly selected)

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 Facility: Oconee Date of Examination: 06/10/13 Exam Level: RO X SRO-I SRO-U Operating Test No.: 1 Control Room Systems (8 for RO); (7 for SRO-I); (2 or 3 for SRO-U, including 1 ESF)

System / JPM Title Type Code* Safety Function

a. CRO-106, Place Spare Deborating IX in Service D, L, S 1 OP/1/A/1103/004 C, Deborating IXs Encl. 4.9 (Spare Deborating IX for RCS Purification (Rx at Power))

[KA: 004 A4.17 (2.7/2.7)] (15 min)

b. CRO-204, ES Recovery D, L, S 2 Unit 1 EOP Encl. 5.41 (ES Recovery)

[KA: 006 A4.08 (4.2/4.3)] (15 min)

c. CRO-303, Perform Required Actions for a Failed LPI M, A, EN, L, 3 Train S

Unit 1 EOP Encl. 5.1 (ES Actuation)

[KA: EPE 011 EA1.04 (4.4/4.4)] (10 min)

d. CRO-409, Depressurize SGs and Feed with CBPs Unit 1 EOP Rule 3 (Loss of Main or Emergency FDW) D, L, S 4S

[KA: APE 054 AA1.01 (4.5/4.4)] (12 min)

e. CRO-413, Initiate HPI Forced Cooling M, A, L, S 4P Unit 1 EOP Rule 4 (Initiate HPI Forced Cooling)

[KA: EPE 074 EA1.08 (4.2/4.2)] (3 min)

f. CRO-507, Perform EOP Encl. 5.35 (Containment 5 D, A, L, S Isolation)

Unit 1 EOP Encl. 5.35 (Containment Isolation)

[KA: 103 G2.1.23 (4.3/4.4)] (10 min)

g. CRO-605, Energize Main Feeder Buses from CT-4 M, L, S 6 Unit 1 EOP Encl. 5.38 (Restoration of Power)

[KA: EPE 055 EA2.03 (3.9/4.7)] (15 min)

h. CRO-902, Place Reactor Building Purge in Operation M, A, L, S 8 OP/1/A/1102/014, Encl. 4.1 (RB Purge Release)

[KA: 029 A2.03 (2.7/3.1)] (15 min)

In-Plant Systems (3 for RO); (3 for SRO-I); (3 or 2 for SRO-U)

i. NLO-100, Trip the Reactor from the Control Rod Drive Breakers M, E 1 Unit 3 EOP RULE 1 (ATWS/Unanticipated Nuclear Power Production)

[KA: EPE 029 EA1.11 (3.9*/4.1)] (4 min)

j. NLO-606, Makeup to Unit 1 CBAST from Unit 1 & 2 BAMT During a Unit 2 Blackout N, E, R 6 Unit 2 EOP Encl. 5.39 (Makeup to the BWST During Blackout)

[KA: B/WE14 EA1.1 (3.8/3.6)] (12 min)

k. NLO-802, Start Diesel Air Compressors and Align to Service Air Header D, A, E 8 AP/2/A/1700/022 (Loss of Instrument Air) Encl. 5.4 (Emergency Start of the Diesel Air Compressor) and 5.7 (Manual Start of Diesel Air Compressors)

[KA: APE 065 AA1.04 (3.5*/3.4*)] (20 min)

@ All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

  • Type Codes Criteria for RO / SRO-I / SRO-U (A)lternate path 4-6 / 4-6 / 2-3 (C)ontrol room (D)irect from bank 9/8/4 (E)mergency or abnormal in-plant 1/1/1 (EN)gineered safety feature - / - / 1 (control room system)

(L)ow-Power / Shutdown 1/1/1 (N)ew or (M)odified from bank including 1(A) 2/2/1 (P)revious 2 exams 3 / 3 / 2 (randomly selected)

(R)CA 1/1/1 (S)imulator

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2 Facility: Oconee Date of Examination: 06/10/13 Exam Level: RO SRO-I SRO-U X Operating Test No.: 1 Control Room Systems (8 for RO); (7 for SRO-I); (2 or 3 for SRO-U, including 1 ESF)

System / JPM Title Type Code* Safety Function

a. N/A
b. N/A
c. CRO-303, Perform Required Actions for a Failed LPI M, A, EN, L, 3 Train S

Unit 1 EOP Encl. 5.1 (ES Actuation)

[KA: EPE 011 EA1.04 (4.4/4.4)] (10 min)

d. N/A
e. CRO-413, Initiate HPI Forced Cooling M, A, L, S 4P Unit 1 EOP Rule 4 (Initiate HPI Forced Cooling)

[KA: EPE 074 EA1.08 (4.2/4.2)] (3 min)

f. N/A
g. N/A
h. CRO-902, Place Reactor Building Purge in Operation M, A, L, S 8 OP/1/A/1102/014, Encl. 4.1 (RB Purge Release)

[KA: 029 A2.03 (2.7/3.1)] (15 min)

In-Plant Systems (3 for RO); (3 for SRO-I); (3 or 2 for SRO-U)

i. NLO-100, Trip the Reactor from the Control Rod Drive Breakers M, E 1 Unit 3 EOP RULE 1 (ATWS/Unanticipated Nuclear Power Production)

[KA: EPE 029 EA1.11 (3.9*/4.1)] (4 min)

j. NLO-606, Makeup to Unit 1 CBAST from Unit 1 & 2 BAMT During a Unit 2 Blackout N, E, R 6 Unit 2 EOP Encl. 5.39 (Makeup to the BWST During Blackout)

[KA: B/WE14 EA1.1 (3.8/3.6)] (12 min)

k. N/A

@ All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.

  • Type Codes Criteria for RO / SRO-I / SRO-U (A)lternate path 4-6 / 4-6 / 2-3 (C)ontrol room (D)irect from bank 9/8/4 (E)mergency or abnormal in-plant 1/1/1 (EN)gineered safety feature - / - / 1 (control room system)

(L)ow-Power / Shutdown 1/1/1 (N)ew or (M)odified from bank including 1(A) 2/2/1 (P)revious 2 exams 3 / 3 / 2 (randomly selected)

(R)CA 1/1/1 (S)imulator

ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: Oconee Date of Examination: 6/10/13 Operating Test Number: 1 Initials

1. General Criteria a b* c#
a. The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).
b. There is no day-to-day repetition between this and other operating tests to be administered during this examination.
c. The operating test shall not duplicate items from the applicants audit test(s). (see Section D.1 .a.)
d. Overlap with the written examination and between different parts of the operating test is within acceptable limits.
e. It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license level.
2. Walk-Through Criteria --
a. Each JPM includes the following, as applicable:
  • initial conditions
  • initiating cues
  • references and tools, including associated procedures
  • reasonable and validated time limits (average time allowed for completion) and specific designation it deemed to be time-critical by the facility licensee
  • operationally important specific performance criteria that include:

detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important observations to be made by the applicant criteria for successful completion of the task identification of critical steps and their associated performance standards restrictions on the sequence of steps, if applicable

b. Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-3d -1 and 2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201 -2.
3. Simulator Criteria The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-301-4 and a copy is attached.

Printed Name / Signature Date

a. Author iii 1 b_

P 4

/c r- i- i

b. Facility Reviewer(*) /#y2 c6/z3/i3
c. NRC Chief Examiner (#) J. kc+/ 5J2cf/ZV1
d. NRC Supervisor ALa*3A T.Utw.J NOTE:
  • The facility signature is not applicable for NRC-developed tests.
  1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Facilty: Oconee Date of Exam: 6/10/13 Scenario Numbers: 1/ 2 /3 Operating Test No.: 1 QUALITATIVE ATTRIBUTES Initials a c#

1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events.
2. The scenarios consist mostly of related events.

Q2L)

3. Each event description consists of

. the point in the scenario when it is to be initiated

. the malfunction(s) that are entered to initiate the event

  • the symptoms/cues that will be visible to the crew

. the expected operator actions (by shift position)

  • the event termination point (if applicable)
4. No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event.

4h1

5. The events are valid with regard to physics and thermodynamics.
6. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.
7. If time compression techniques are used, the scenario summary clearly so indicates.

Operators have sufficient time to carry out expected activities without undue time constraints.

Cues are given.

8. The simulator modeling is not altered.
9. The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.
10. Every operator will be evaluated using at least one new or significantly modified scenario.

All other scenarios have been altered in accordance with Section 0.5 of ES-301.

1 1. All individual operator competencies can be evaluated, as verified using Form ES-301 -6 (submit the form along with the simulator scenarios).

cIli.

12. Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).

c.a,

13. The level of difficulty is appropriate to support licensing decisions for each crew position.

Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes -- - - -- -

1. Total malfunctions (58) 7/ 6 /8
2. Malfunctions after EOP entry (12) 1 /1 /2
3. Abnormal events (24) 4 / 4 /4
4. Major transients (12) 2 / 1 /1
5. EOPs entered/requiring substantive actions (12) 2 / 1 / 1
6. EOP contingencies requiring substantive actions (02) 1 / 1 /2 q2Li
7. Critical tasks (23) 3/ 2/ 2

ES-301 Transient and Event Checklist Form ES-301-5

[ Facility: Oconee Date of Exam: 6/10/13 Operating Test No.: 1 A E Scenarios P V 1 2 3 4 T M P E L N CREW CREW CREW CREW T N I T POSITION POSITION POSITION POSITION L S A B S A B M S A B S A B L A T R T 0 A T 0 A T u

0 A T 0 M(*)

N Y 0 C P 0 C P 0 C P 0 C P T P R IU E

RO RX 110 X NOR SAC-I 1 iii I/C 1,2,3 2,4 2,4,5 4 4 2 SRO-U MAJ 6 7 7 2 2 1 D TS 022 RO RX 5 1 110 X NOR iii SO-I I/C 4,5 3,6 3,4,6 4 4 2 o-u MAJ 6 7 7 221 D TS 022 NOR o-I/C 1,2,3 2,3,4 2,3,4 4 4 2 SRO-U 4,5 6 5,6 X MAJ 6 7 7 221 TS 1,3 2,4 4,5 0 2 2 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-contr ols (ATC) and balance-of-plant (BOP) positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on 1 -for-i a basis.
3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

ES-301 Competencies Checklist Form ES-301 -6 Facility: Oconee Date of Examination: 6/10/13 Operating Test No.: 1 APPLICANTS RD X P0 X RD El io El SRO-l El SRO-l El SRO-l El SRO-l El sno-u El SRO-U El SRO-U X SRO-U El Competencies CNAIO_ SCENAFO SCENAPO 1234123412341234 Interpret/Diagnose 2,3, 2,3, 1,3, 1,2, 1,2 2,4, 1,2, 1,2, 1,2, 4,5, 4,5, 4,5, 3,4, 3,4, 5,7 Events and Conditions 3,4, 3,4, 3,4, 6 6,7 6 7 5,6, 5,6, 5,6, 7 7 Comply With and 4,5, 3,5, 1,3, 1,2 1,2, 2,4, 1,2, 1,2, 1,2, 6 6,7 Use Procedures (1)

Operate Control 4,5, 3,5, 1,3, 1,2, 1,2, 2,4,

,. 6 6,7 4,5, 3,6 3,4, 5,7 oarus )

6,7 5,7 Communicate 1,2, 1,2, 1,2, 1.2, 1,2, 1,2, 1,2, 1,2, 1,2, 3,4, 3,4, 3,4, 3,4, 3,4, 3,4, 3,4, and Interact 5,6 5,6, 5,6, 3,4, 3,4, 6 5,7 5,7 5,6, 5,7 5,6, 7 7 7 Demonstrate 1,2, 1,2, 1,2, Supervisory Ability (3) 3,4, 3,4, 3,4, 5,6 5,7 5,6, 7

Comply With and 1,3 2,4 4,5 Use Tech. Specs. (3) = = = = = = = = =

Notes:

(1) Includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SAGs.

Instructions:

Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

ES-401 Record of Rejected K/As Form ES-401-4 Tier /

Group I Selected Randomly KA Reason for Rejection 1/ 2 APEO51 2.2.12 Q(84) Could not write SRO level question to this KA.

2/ 1 SYSOO8 A2,07 Q(86) Could not write SRO level question.

2/2 001 K5.65 Q(56) - Could not write a non-GFE-level question to KA 001 K5.96.

ES-401, Rev. 9 Oconee 2013-301 NRC Written Examination Review Worksheet Final Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO (F/H) (1-5) U/E Explanation Focus Dist. Link units ward K/A Only

/S Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 B 4 range are acceptable).
3. Check the appropriate box if a psychometric flaw is identified:
  • The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
  • The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
  • The answer choices are a collection of unrelated true/false statements.
  • The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
  • One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
4. Check the appropriate box if a job content error is identified:
  • The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
  • The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
  • The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
  • The question requires reverse logic or application compared to the job requirements.
5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
6. Based on the reviewer=s judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
7. At a minimum, explain any AU@ ratings (e.g., how the Appendix B psychometric attributes are not being met).
1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO (F/H) (1-5) U/E Explanation Focus Dist. Link units ward K/A Only

/S 1 H 2 X X U 007EG2.2.42 K/A does not appear to be matched.

This K/A is under the topic of Reactor Trip Stabilization/Recovery. The question states the plant is at 100%. Need to have the reactor tripped, and the crew in the EOP stabilizing the plant.

S NEW 2/4/2013 (Dan Bacon) Changed all distractors. Selection of procedure used to control HPI flow. Licensee needs to confirm only one correct answer. 2/21/2013 Otherwise SAT 2 H 2 X E 008G2.4.45 Question appears to meet the K/A. We will change RCS pressure to indicate 2190 psig, and change stem statement change should to shall or required to be NEW 2/4/2013 (Dan Bacon)

Made Changes as described. 2/21/2013 SAT 3 H 2 S 009EA1.01 Question kind of matches the K/A, if the idea is to operate based on RCS Pressure. (LPI pumps must be secured due to RCS pressure being greater than shutoff head of LPI pumps).

NEW 2/4/2013 (Dan Bacon)

May need to change the wording of the statements, does not really read well. 2/21/2013 Dan will work on wording.

4 H 2 X U 011EG2.2.44 Question is for a large break LOCA, but I dont think RCPs would be running at the current time.

Replaced question, with modified bank question SAT 3/21/2013

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO (F/H) (1-5) U/E Explanation Focus Dist. Link units ward K/A Only

/S 5 H 2 S 015AK2.07 Question appears to match the K/A.

Appears to be SAT NEW2/4/2013 (Dan Bacon) 6 H 2 X E 022AK1.04 Question kind of matches the K/A in a backwards fashion. It appears we are testing if we meet the conditions for getting the controller in automatic, we can clear the alarm. Will Discuss.

NEW 2/21/2013 Discussed question with writer (K/A was from manual to auto) determined question was SAT 3/20/2013 7 H 2 S 025AK2.01 Question appears to match the K/A.

SAT 02/25/2013 MODIFIED 2012-302 Question 6 8 F 2 S 026AA1.03 Question kind of matches K/A. SWS as a backup to the CCWS At Oconee RCW performs some of the functions of CCW. Only RCW has a backup. Therefore, question asked on RCW.

NEW 2/21/2013 SAT

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO (F/H) (1-5) U/E Explanation Focus Dist. Link units ward K/A Only

/S 9 H 2 X E 027AK3.03 Question kind of matches the K/A is a backwards way. The malfunction appears to be reduced spray flow due to the RCP being secured.

With reduced sprays another method is required to reduce RCS pressure. It appears the reason for the steps in the procedure is the limits on pressurizer spray nozzle T. This is being tested as well as what is used to determine them. (Reason is not readily apparent) Will discuss.

NEW 2/21/2013 Question writer thought that using the LDST or BWST was testing the reason for T. Will allow 3/21/2013 10 H 2 S 029EK2.06 Question appears to match the K/A. SAT NEW 2/21/2013 11 H 2 S 038EA2.03 Question appears to match the K/A. SAT MODIFIED 2009 NRC Exam 2/25/2012 12 F 2 S 040AA2.04 Question appears to match the K/A. SAT This question and number 41 are testing the same concept, need to change one of them.

Changed 41 Now SAT NEW 2/25/2013 13 F 2 S 054AA2.01 Question appears to match the K/A. SAT MODIFIED 2011-302 Q # 25

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO (F/H) (1-5) U/E Explanation Focus Dist. Link units ward K/A Only

/S 14 H 2 S 055EK1.02 Question appears to match K/A SAT MODIFIED 2011-302 question BANK 15 F 2 X U 056AK3.01 Question does not really meet the K/A.

There are no reasons. This is a good questions and was used before for a different K/A. It could be modified to work by asking why these things happen BANK 2007 Exam Question 15 replaced. 3/25/2013 SAT.

16 H 2 S 057AA1.02 Question appears to match the K/A.

This appears to be a BANK question, otherwise SAT.

BANK 2004 Exam 17 H 2 S 058AK1.01 Question appears to meet the K/A.

Wording may need some work. Otherwise SAT.

MODIFIED 2012-301 NRC Exam 18 H 2 S 062AK3.03 Question appears to match the K/A. SAT NEW 19 H 2 S 005AA1.03 Question appears to match the K/A.SAT BANK 2009-302 NRC Exam 20 H 2 S 024AK3.02 Question appears to match the K/A. Is this operationally valid? Will discuss Changed power to 11%. I believe the question is more operationally valid, MODIFIED BANK SAT 3/21/2013

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO (F/H) (1-5) U/E Explanation Focus Dist. Link units ward K/A Only

/S 21 H 2 S 051AA1.04 Question appears to match the K/A. SAT NEW 22 F 2 S 036AK3.02 Question appears to match the K/A.

SAT MODIFIED BANK 23 H 2 S 069AG2.2.44 Question appears to match the K/A.

SAT NEW 24 F 2 S 076AA2.02 Question appears to match the K/A. SAT NEW 25 F 2 S BA07AK1.1 Question kind of matches K/A. SAT NEW 26 H 2 S BWE03EA2.2 Question appears to match the K/A.

SAT Licensee to verify actual HPI flow limit.

NEW 27 H 2 S BW/E09EK2.2 Question kind of matches the K/A.

SAT NEW 003A1.06 Question appears to match the K/A. SAT 28 H 2 S NEW

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO (F/H) (1-5) U/E Explanation Focus Dist. Link units ward K/A Only

/S 29 F 2 S 003K4.02 Question appears to match the K/A. SAT NEW 30 F 2 S 004G2.1.32 Question appears to match the K/A.

SAT NEW 31 H 3 S 005K3.07 Question appears to match the K/A. SAT NEW 32 H 2 S 006K6.01 Question appears to match the K/A. SAT NEW 33 H 2 S 007A2.04 Question appears to match the K/A. SAT NEW 34 F 2 S 008A1.02 Question appears to match the K/A. SAT Need to ensure no subset issue exists.

MODIFIED 2010-302 NRC exam.

35 H 2 S 008A3.04 Question appears to match the K/A. SAT BANK 2006-301 (Q # 12) NRC exam 36 F 2 S 010K2.01 Question appears to match the K/A. SAT MODIFIED 2010-301 (Q # 57) NRC exam.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO (F/H) (1-5) U/E Explanation Focus Dist. Link units ward K/A Only

/S 37 H 2 S 012K6.04 Question appears to match the K/A. SAT MODIFIED 2010-301 (Q # 37) NRC exam.

38 H 2 S 013A1.10 Question appears to match the K/A. SAT MODIFIED 2011-301 (Q # 18) NRC exam 39 H 2 S 022K4.02 Question appears to match the K/A. SAT MODIFIED 2010-301 (Q # 41) NRC exam 40 F 2 S 026K4.09 Question appears to match the K/A. SAT BANK 2012-301 (Q # 40) NRC exam 41 H 2 S 026G2.4.46 Question appears to match K/A. This question and number 12 are testing the same concept; need to change one of them.

BANK 2010-302 (Q # 41) NRC exam Replaced question (Due to question overlap)

Question appears to match the K/A. SAT MODIFIED from 2006 Oconee License exam.

42 H 2 S 039K 5.01 Question appears to match the K/A. SAT NEW 43 H 2 S 059K1.04 Question appears to match the K/A. SAT BANK 2007-301 (Q # 39) NRC exam

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO (F/H) (1-5) U/E Explanation Focus Dist. Link units ward K/A Only

/S 44 H 2 S 061K3.02 Question appears to match the K/A. SAT NEW 45 H 2 S 061K5.01 Question appears to match the K/A. SAT MODIFIED 2007-301 (Q# 40) 46 H 2 S 062A3.05 Question appears to match the K/A. SAT MODIFIED BANK Oconee # EL041301.

47 F 2 S 062A4.03 Question appears to match the K/A. SAT NEW 48 H 2 S 063A3.01 Question appears to match the K/A. SAT MODIFIED 2009-301 (Q# 40) NRC exam 49 H 2 S 064K2.03 Question appears to match the K/A. SAT BANK 2009-301 (Q# 51)NRC exam 50 F 2 S 073A4.03 Question appears to match the K/A. SAT NEW 51 H 2 S 076A2.02 Question appears to match the K/A. SAT BANK Oconee 2009-301

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO (F/H) (1-5) U/E Explanation Focus Dist. Link units ward K/A Only

/S 52 H 2 S 078K2.01 Question appears to match the K/A. SAT BANK 2007-301 NRC exam 53 F 2 S 078K3.01 Question appears to match the K/A. SAT BANK 54 H 2 S 103K1.01 Question appears to match the K/A. SAT Licensee to verity correct answer BANK 2009 55 H 2 S 103K1.08 Question appears to match the K/A. SAT BANK 2008 Oconee NRC exam.

Licensee to Verify that this is still correct.

56 F 2 001K5.96 Question matches K/A. GFES level May need to select a new K/A. Changed K/A to 001K5.65 S

Modified a bank Oconee Question from 2009B exam. SAT 57 H 2 S 002K3.03 Question appears to match the K/A. SAT BANK 2006-301 NRC exam 58 F 2 S 014A4.01 Question appears to match the K/A.

Not very discriminating.

NEW 59 F 2 S 015A1.04 Question appears to match the K/A.

SAT MODIFIED BANK

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO (F/H) (1-5) U/E Explanation Focus Dist. Link units ward K/A Only

/S 60 F 2 S 017K6.01 Question appears to match the K/A.

SAT BANK 61 F 2 S 029K4.03 Question appears to match the K/A. SAT Licensee to verify noun name of RIA-45 MODIFIED 2004-301(Q # 56) NRC exam 62 H 2 S 033K1.02 Question appears to match the K/A. SAT NEW 63 H 2 S 041K2.02 Kind of matches the K/A. SAT MODIFIED BANK 64 H 2 S 068A3.01 Question appears to match the K/A.

SAT BANK 2007 Oconee NRC exam 65 F 2 S 075K2.01 Question appears to match the K/A. SAT NEW 66 F 2 S G2.1.8 Question appears to match the K/A. SAT BANK 2011-301 (Q # 67) 67 F 2 S G2.1.14 Question appears to match the K/A. SAT BANK

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO (F/H) (1-5) U/E Explanation Focus Dist. Link units ward K/A Only

/S 68 H 2 S G2.1.45 Question appears to match K/A. SAT MODIFIED 2007 A Oconee NRC exam 69 F 2 S G2.2.2 Question appears to match the K/A. SAT NEW 70 F 2 S G2.2.39 Question appears to match the K/A. SAT NEW 71 F 2 S G2.2.42 Question appears to match the K/A. SAT BANK 2009 Oconee NRC exam 72 F 2 S G2.3.5 Question appears to match the K/A. SAT BANK 2011B Oconee NRC exam 73 F 2 S G2.3.11 Question appears to match the K/A. SAT BANK 2010 Oconee NRC exam.

74 H 2 S G2.4.34 Question appears to match the K/A. SAT BANK 2010 Oconee NRC exam.

75 F 2 S G2.4.46 11 Question appears to match the K/A. SAT NEW

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO (F/H) (1-5) U/E Explanation Focus Dist. Link units ward K/A Only

/S 2 Sats, 4 Unsats, and 4 Enhancements

ES-401, Rev. 9 Oconee 2013-301 SRO Written Examination Review Worksheet Final (3/20/2013) Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO (F/H) (1-5) U/E Explanation Focus Dist. Link units ward K/A Only

/S Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 B 4 range are acceptable).
3. Check the appropriate box if a psychometric flaw is identified:
  • The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
  • The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
  • The answer choices are a collection of unrelated true/false statements.
  • The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
  • One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
4. Check the appropriate box if a job content error is identified:
  • The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
  • The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
  • The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
  • The question requires reverse logic or application compared to the job requirements.
5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
6. Based on the reviewer=s judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
7. At a minimum, explain any AU@ ratings (e.g., how the Appendix B psychometric attributes are not being met).
1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO (F/H) (1-5) U/E Explanation Focus Dist. Link units ward K/A Only

/S 76 H 3 S 007EA2.04 Question appears to match the K/A.

Appears to be SRO only. SAT NEW 77 S 009EG2.4.21 Question kind of matches K/A. (Not in the Westinghouse sense of the KA, but it is looking at parameters and heat removal will allow.) Appears to be SRO only. SAT MODIFIED 3/20/2013 78 H 2 X E 038EG2.4.20 Question appears to match the K/A.

Appears to have an SRO aspect to it. What does the stem state that steaming of 1A SG has been discontinued? The first part of the question states continue steaming or discontinue steaming, this makes C and D very confusing. Need to restate the stem.

NEW Reworded stem to make C and D clearer. SAT 3/20/2013 79 H 2 S BE05EA2.1 Question appears to match the K/A.

Appears to be SRO only. SAT NEW 80 H 2 S 057AA2.06 Question appears to match the K/A.

Appears to be SRO only. Need to ensure the references do not answer any part of this or other questions. Otherwise SAT NEW

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO (F/H) (1-5) U/E Explanation Focus Dist. Link units ward K/A Only

/S 81 H 2 X E 062AG2.1.28 Appears to match the K/A. Appears to have an SRO aspect to it. Wording in stem needs to be fixed. Required to be operable on (1) required LPSW.

Choices are: all running required LPSW pumps, this sounds okay, but the other choice only non-running required LPSW pumps does not flow well. Will discuss.

NEW Changed C and D to read B only and changed the stem slightly for better wording.

SAT 3/20/2013 82 H 2 S 003AG2.4.50 Question appears to match the K/A.

Appears to have an SRO aspect to it. SAT NEW 3/20/2013 83 H 2 X S 005AA2.02 Question appears to match the K/A.

Appears to have an SRO aspect to it. How does one know rod 7-3 is stuck, a runback has just been initiated. Could we say rod is jammed? Removed stuck. Now SAT NEW 3/20/2013 84 H 3 S 051AG2.2.12 Question kind of matches the K/A.

(Unique way to hit the K/A.) Appears to have an SRO aspect to it. SAT NEW 3/20/2013 85 H 2 S BA05AA2.1 Question appears to match the K/A.

Appears to have an SRO aspect to it.

SAT NEW 3/20/2013

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO (F/H) (1-5) U/E Explanation Focus Dist. Link units ward K/A Only

/S 86 H 2 S 008A2.07 Question appears to match the K/A. Not sure if the second part is procedure entry is RO knowledge, or if the note makes is SRO only will have another chief look at it. Sent question to Phil and Amanda. Based on feedback from Amanda and Phil and Dan, changed all distractors.

NEW SAT 3/20/2013 87 H 2 S 010G2.4.50 Question appears to match the K/A.

Appears to be SRO only. SAT NEW 3/20/2013 88 H 2 S 022G2.4.46 Question appears to match the K/A.

Borderline SRO will get a second opinion. (even though this is basis, it is also system function). Upon further discussion decided question was acceptable due to information from basis. SAT NEW 3/20/2013 89 H 2 S 026G2.4.47 Question appears to match the K/A.

Appears to be SRO only. SAT NEW 3/20/2013 90 H 2 S 059A2.04 Question kind of matches the K/A. EOP basis is not always considered SRO only knowledge, however in this case it is the basis of actions is a table, will allow.

SAT NEW 3/20/2013

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO (F/H) (1-5) U/E Explanation Focus Dist. Link units ward K/A Only

/S 015G2.4.20 Question appears to match the K/A.

91 H 2 S Appears to be SRO only SAT NEW 92 H 2 S 034G2.4.11 Question appears to match the K/A.

Appears to have an SRO aspect to it. SAT NEW 3/20/2013 93 H 2 E 056A2.04 Question kind of matches the K/A.

Appears to be SRO only. Will have another examiner verify K/A match.

MODIFIED BANK 3/20/2013 After discussions with question writer, and other staff, rewrote question to better match the K/A.

Question has been changed to new. SAT 3/25/2013 94 H 2 E G2.1.19 Question appears to match the K/A. Not sure it is SRO only will get another examiner to verify. After discussion will allow.

NEW 3/20/2013 95 H 2 S G2.1.25 Question appears to match the K/A.

Appears to be SRO only knowledge. SAT NEW

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO (F/H) (1-5) U/E Explanation Focus Dist. Link units ward K/A Only

/S 96 F 2 S G2.2.5 Question appears to match the K/A. Appears to be SRO only knowledge. SAT NEW 97 H 3 S G2.2.12 Question appears to match the K/A.

Appears to be SRO only knowledge. SAT NEW 98 H 2 S G2.3.4 Question appears to match the K/A. Appears to be SRO only knowledge. SAT NEW 99 F 2 S G2.4.23 Question appears to match the K/A.

Appears to be SRO only knowledge. SAT NEW 100 F 2 S G2.4.38 Question kind of matches the K/A. Appears to be SRO only knowledge.SAT NEW

ES-401 Written Examination QualIty Checklist Form ES-401-6 gJL0I3 1

)

Facility: Oconee Nudear Slation Da of Exasm 4/JOj13- Exam Level: RO SRO Initial Item Desaipbon a b c

1. Questions and answers are technically accurate and applicable to the facility. /A4,
2. a. NRC K/As are referenced for all questions.
b. Facity learning objectives are referenced as available. 9V)
3. SRO questions are appropriate In accordance with Section D.2.d of ES-40l
4. The sampling process was random arid systematic (It more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR OL program office).
5. Question duplication from the license screening/audit exam was controlled as Indicated below (check the Item that applies) and appears appropriate:

the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or Z the examinations were developed Independently; or the licensee certifies that there is no duplication; or other (explain)

6. Bank use meets limits (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only fJ question distribution(s)at right. 14 I 1 27 i 3 34 i 21
7. Between 50 and 60 percent of the questions on the RO Memory C/A exam are written at the comprehension analysis level; the SRO exam may exceed 60 percent if the randomly selected 1</As support the higher cognifive levels; enter the actual RO / SRO question distribution(s) at right.

33 / 4 42 I 21

8. References/handouts provided do not give away answers or aid in the elimination of distractors.
9. Question content conforms with specific K/A statements in the previously approved examination ouUine and is appropriate for the tier to which they are assigned; deviations are justified.
10. Question psychometric quality and format meet the guidelines in ES Appendix B.
11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet. (1 Printed Name I Signature Date
a. Author . o*%

Facility Reviewer ()

b. A//4 i i .i /
c. NRC Chief Examiner (#) G,,)_W._l.65k:A 1 .. .. 5f/R
d. NRC Regional Supervisor ,L4LLJ4 1 Note: The facitity reviewers initials/signature are not applicable for NRC-developed examinations.
  1. Independent NRC reviewer Initial items in Column c; chief examiner concurrence required.

Oconee 2013-301 The Final Sample Plan is the combination of the ES-401-4 and the Draft Sample Plan.

ES-403, Rev. 9 Written Examination Grading Form ES-403-1 Quality Checklist Facility: Oconee Nuclear Plant Date of Exam: 07/11/2013 Exam Level: ROISRO Item Description

1. Clean answer sheets copied before grading
2. Answer key changes and question deletions justified and documented
3. Applicants scores checked for addition errors (reviewers spot check > 25% of examinations)
4. Grading for all borderline cases (80+/-2% overall and 70 or 80, as applicable, +/-4% on the SRO-only) reviewed in detail
5. All other failing examinations checked to ensure that grades are justified
6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of Questions missed by half or more of the Printed Name/Signature
a. Grader I

/ J

\2 \

b. Facility Reviewer(*)
c. NRC Chief Examiner (*)
d. NRC Supervisor (*)

(*) The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.

Retrieved from "https://kanterella.com/w/index.php?title=ML13248A050&oldid=2455534"