ML102210215: Difference between revisions

From kanterella
Jump to navigation Jump to search
(Created page by program invented by StriderTol)
(Created page by program invented by StriderTol)
Line 16: Line 16:


=Text=
=Text=
{{#Wiki_filter:2010 PERRY NUCLEAR POWER PLANT IN ITlAL EXAM1 NATION PROPOSED EXAM FILES FENOC - FirstEnergy Nuclear Operating Company Perry Nuclear Power Station 10 Center Road Pep Ohio 4408 1 Mark 6. Bezilla Mce President April 13, 2010 L-10-125 440-280-5382 Fax: 440-280-8029 10 CFR 55 ATTN: Mr. Dell McNeil, Chief Examiner U. S. Nuclear Regulatory Commission 2443 Warrenville Road, Suite 210 Lisle, IL 60532-4352  
{{#Wiki_filter:2010 PERRY NUCLEAR POWER PLANT INITlAL EXAM1NATION PROPOSED EXAM FILES
 
-
FENOC FirstEnergy Nuclear Operating Company Mark 6.Bezilla Perry Nuclear Power Station 10 Center Road P e p Ohio 4408 1 440-280-5382 Mce President                                                                                  Fax: 440-280-8029 April 13, 2010 L-10-125                                                              10 CFR 55 ATTN: Mr. Dell McNeil, Chief Examiner U. S. Nuclear Regulatory Commission 2443 Warrenville Road, Suite 210 Lisle, IL 60532-4352


==SUBJECT:==
==SUBJECT:==
Perry Nuclear Power Plant Docket No. 50-440, License No. NPF-58 NRC Initial License Examination Submittal In accordance with NUREG-I 021, ES-201, "Initial Operator Licensing Examination Process," enclosed are the proposed examinations, supporting documentation, and reference materials for the NRC initial license examination scheduled to be administered at the Perry Plant starting June 14, 201 0. The examination materials were developed in accordance with the guidelines specified in NUREG-I 021, "Operator Licensing Examination Standards for Power Reactors," Revision 9, Supplement
 
: 1. NUREG-I021 Forms ES-201-3, ES-301-1, ES-301-2, ES-301-3, ES-301-4, ES-301-5, ES-301-6, ES-401-1, ES-401-3, ES-401-4, ES-401-6, ES-D-1 and ES-D-2 are enclosed with the supporting documentation. Form ES-301-6 has been completed based on the projected class size and license type at this time.
Perry Nuclear Power Plant Docket No. 50-440, License No. NPF-58 NRC Initial License Examination Submittal In accordance with NUREG-I 021, ES-201, Initial Operator Licensing Examination Process, enclosed are the proposed examinations, supporting documentation, and reference materials for the NRC initial license examination scheduled to be administered at the Perry Plant starting June 14, 2010. The examination materials were developed in accordance with the guidelines specified in NUREG-I 021, Operator Licensing Examination Standards for Power Reactors, Revision 9, Supplement 1.
The class size and makeup may change prior to the examination date. The NRC initial license examination outlines were previously sent to you on March 1, 201 0. A complete set of outline forms for both the RO and SRO examinations are included in this submittal. It is requested that the enclosed examination materials be withheld from public disclosure until after the initial license examinations are completed.
NUREG-I021 Forms ES-201-3, ES-301-1, ES-301-2, ES-301-3, ES-301-4, ES-301-5, ES-301-6, ES-401-1, ES-401-3, ES-401-4, ES-401-6, ES-D-1 and ES-D-2 are enclosed with the supporting documentation.
There are no regulatory commitments contained in this letter. If there are questions or if additional information is required, please contact Mr.
Form ES-301-6 has been completed based on the projected class size and license type at this time. The class size and makeup may change prior to the examination date.
Raymond Torres at (440) 280 -5277.
The NRC initial license examination outlines were previously sent to you on March 1, 2010. A complete set of outline forms for both the RO and SRO examinations are included in this submittal.
Perry Nuclear Power Plant Page 2 L-I 0-125 None of the materials being sent are considered Safeguards information.
It is requested that the enclosed examination materials be withheld from public disclosure until after the initial license examinations are completed.
Raymond Torres Nuclear Qualification Instructor David W. O'Donnell Facility Representative Mark Bezilla
There are no regulatory commitments contained in this letter. If there are questions or if additional information is required, please contact Mr. Raymond Torres at (440) 280 -5277.
:  
 
Perry Nuclear Power Plant L-I 0-125 Page 2 None of the materials being sent are considered Safeguards information.
Raymond Torres                                 David W. ODonnell Nuclear Qualification Instructor               Facility Representative Mark Bezilla
:


==Enclosures:==
==Enclosures:==


A Operator License Examination B Supporting Documentation C Reference Material D Job Performance Measures Examination E Form ES-201-3, Examination Security Agreement F Form ES-301-1, Administrative Topics Outline (RO & SRO) G Form ES-301-2, Control Room/ln-Plant Systems Outline (RO, SRO-I, SRO-U) H Form ES-301-3, Operating Test Quality Checklist I Form ES-301-4, Simulator Scenario Quality Checklist J Form ES-301-5, Transient and Event Checklist K Form ES-301-6, Competencies Checklist L Form ES-401-1, BWR Examination Outline M Form ES-401-3, Generic Knowledge and Abilities Outline-Tier 3 N Form ES-401-4, Record of Rejected KlAs 0 Form ES-401-6, Written Examination Quality Checklist P Form ES-D-1, Scenario Outlines Q Form ES-D-2, Required Operator Actions cc: NRC Document Control Desk w/o Enclosures NRC Project Manager w/o Enclosures NRC Region Ill Branch Chief w/o Enclosures NRC Resident Inspector w/o Enclosures ES-301 Operating Test Quality Checklist Form ES-301-3 Facility:
A Operator License Examination B Supporting Documentation C Reference Material D Job Performance Measures Examination E Form ES-201-3, Examination Security Agreement F Form ES-301-1, Administrative Topics Outline (RO & SRO)
Perry Date of Examination:
G Form ES-301-2, Control Room/ln-Plant Systems Outline (RO, SRO-I, SRO-U)
June 2010 Operating Test Number: 201 0-01 1. General Criteria
H Form ES-301-3, Operating Test Quality Checklist I Form ES-301-4, Simulator Scenario Quality Checklist J Form ES-301-5, Transient and Event Checklist K Form ES-301-6, Competencies Checklist L Form ES-401-1, BWR Examination Outline M Form ES-401-3, Generic Knowledge and Abilities Outline-Tier 3 N Form ES-401-4, Record of Rejected KlAs 0 Form ES-401-6, Written Examination Quality Checklist P Form ES-D-1, Scenario Outlines Q Form ES-D-2, Required Operator Actions cc:   NRC Document Control Desk w/o Enclosures NRC Project Manager w/o Enclosures NRC Region Ill Branch Chief w/o Enclosures NRC Resident Inspector w/o Enclosures
 
ES-301                                         Operating Test Quality Checklist                             Form ES-301-3 Facility:   Perry                   Date of Examination:   June 2010                       Operating Test Number: 201 0-01 Initials
: 1. General Criteria
: a. The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).
: a. The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).
: b. There is no day-to-day repetition between this and other operating tests to be administered during this examination.
: b. There is no day-to-day repetition between this and other operating tests to be administered during this examination.
: c. The operating test shall not duplicate items from the applicants' audit test(s). (see Section D.l .a.) d. Overlap with the written examination and between different parts of the operating test is within acceptable limits. e. It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license level.
: c. The operating test shall not duplicate items from the applicants' audit test(s). (see Section D.l .a.)
: 2. Walk-Through Criteria a. Each JPM includes the following, as applicable:
: d. Overlap with the written examination and between different parts of the operating test is within acceptable limits.
initial conditions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee operationally important specific performance criteria that include: - - - - - detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important observations to be made by the applicant criteria for successful completion of the task identification of critical steps and their associated performance standards restrictions on the sequence of steps, if applicable
: e. It appears that the operating test will differentiate between competent and less-than-competent
: b. Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301-1 and
                                                                                                                , nn applicants at the designated license level.
: 2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.
1
: 3. Simulator Criteria The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-301-4 and a copy is attached. Printed Name  
: 2. Walk-Through Criteria
/ Signature Date Initials , nn 1 w 9. Author 44 -10 5. Facility Reviewer(*)
: a.       Each JPM includes the following, as applicable:
q*/3* JO u. NRC Chief Examiner
initial conditions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee operationally important specific performance criteria that include:
(#) NOTE:
              -     detailed expected actions with exact criteria and nomenclature
* The facility signature is not applicable for NRC-developed tests.  
              - system response and other examiner cues
# Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.
              - statements describing important observations to be made by the applicant criteria for successful completion of the task
ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Target Quantitative Attributes (Per Scenario; See Section D.5.d) 1. Total malfunctions (5-8) 3. Malfunctions after EOP entry (1-2) 3. Abnormal events (2-4) Facility:
              - identification of critical steps and their associated performance standards
Perry Date of Exam: Jun. 201 0 Scenario Numbers:
              - restrictions on the sequence of steps, if applicable
1/2/3 Operating Test No.: 201 0-01 QUALITATIVE ATTRIBUTES Initials Actual Attributes IR 71715 -4w 41212 Y 11312 a b* I 1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events.
: b.       Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.
: t. Major transients (1-2) 5. 3. EOPs enteredlrequiring substantive actions (1-2) EOP contingencies requiring substantive actions (0-2)
: 3. Simulator Criteria The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-301-4 and a copy is attached.                                                                         w Printed Name / Signature                             Date
: 2. The scenarios consist mostly of related events.
: 9. Author                                                                                       4 4 -10
21212 1 I1 13 L 211 12 1 I\ I/ 7. Critical tasks (2-3) 3. Each event description consists of the point in the scenario when it is to be initiated the malfunction(s) that are entered to initiate the event the symptomslcues that will be visible to the crew the expected operator actions (by shift position) the event termination point (if applicable)
: 5. Facility Reviewer(*)                                                                         q * / 3 JO
I 51315 / 4. No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event.
                                                                                                          *
: 5. 6. The events are valid with regard to physics and thermodynamics. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives. If time compression techniques are used, the scenario summary clearly so indicates. Operators have sufficient time to carry out expected activities without undue time constraints.
: u. NRC Chief Examiner (#)
Cues are given. I/ The simulator modeling is not altered.
NOTE:
The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios. Every operator will be evaluated using at least one new or significantly modified scenario.
* The facility signature is not applicable for NRC-developed tests.
All other scenarios have been altered in accordance with Section D.5 of ES-301. All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the form along with the simulator scenarios).
        # Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.
Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).
 
1 7. 8. 3. IO. 11. < I 12. 13. The level of difficulty is appropriate to support licensing decisions for each crew position.
ES-301                                   Simulator Scenario Quality Checklist                             Form ES-301-4 Facility:   Perry     Date of Exam:   Jun. 201 0         Scenario Numbers: 1/2/3           Operating Test No.: 201 0-01 QUALITATIVE ATTRIBUTES                                                     Initials a     b*     C#
v-I IW C#
I
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility:
: 1.     The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events.
Perry Date of Exam: June 2010 Exam Level:
I\
RO SRO Initial a b* c# Item Description
: 2.     The scenarios consist mostly of related events.                                                   I/
: 3.       Each event description consists of the point in the scenario when it is to be initiated the malfunction(s) that are entered to initiate the event I
the symptomslcues that will be visible to the crew the expected operator actions (by shift position) the event termination point (if applicable)
: 4.       No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event.
: 5.     The events are valid with regard to physics and thermodynamics.
: 6.      Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.
1
: 7.      If time compression techniques are used, the scenario summary clearly so indicates.
Operators have sufficient time to carry out expected activities without undue time constraints.
Cues are given.                                                                                   I/
: 8.      The simulator modeling is not altered.
: 3.      The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.
IO. Every operator will be evaluated using at least one new or significantly modified scenario.
All other scenarios have been altered in accordance with Section D.5 of ES-301.
                                                                                                          <
: 11. All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the form along with the simulator scenarios).                                               I
: 12. Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).
: 13. The level of difficulty is appropriate to support licensing decisions for each crew position.       v-I IW Target Quantitative Attributes (Per Scenario; See Section D.5.d)                  Actual Attributes I R
: 1.      Total malfunctions (5-8)                                                            71715          -4w
: 3.      Malfunctions after EOP entry (1-2)                                                  41212        Y
: 3.      Abnormal events (2-4)                                                              11312
: t.      Major transients (1-2)                                                              21212
: 5.      EOPs enteredlrequiring substantive actions (1-2)                                    1 I 1 13      L
: 3.      EOP contingencies requiring substantive actions (0-2)                              2 1 1 12        1
: 7.      Critical tasks (2-3)                                                                51315
                                                                                                            /
 
ES-401                                       Written Examination Quality Checklist                             Form ES-401-6 Facility: Perry                                             Date of Exam: June 2010               Exam Level: RO     SRO Initial Item Description a     b*     c#
: 1. Questions and answers are technically accurate and applicable to the facility.
: 1. Questions and answers are technically accurate and applicable to the facility.
: 2. a. NRC K/As are referenced for all questions.
: 2. a. NRC K/As are referenced for all questions.
: b. Facility learning objectives are referenced as available.
: b. Facility learning objectives are referenced as available.
: 5. Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate: - X the audit exam was systematically and randomly developed; or - X the audit exam was completed before the license exam was started; or Ill II ! _. the examinations were developed independently; or - X- the licensee certifies that there is no duplication; or - other (explain) , il \ Bank 1 'L Modified New
: 5. Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:
: 6. Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest question distribution(s) at right. new or modified);
      - X the audit exam was systematically and randomly developed; or I l l
enter the actual RO  
      - X the audit exam was completed before the license exam was started; or                                     I        I
/ SRO-only 45%146% 7% 14% 48%150% I I C/A 7. Between 50 and 60 percent of the questions on the RO exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly selected K/As support the higher cognitive levels; enter the actual RO / SRO question distribution(s) at right. Memory 41% 116% 59y0 /84?4 8. Referencedhandouts provided do not give away answers or aid in the elimination of distractors. Question content conforms with specific WA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are justified.
_ . the examinations were developed independently; or
: 10. Question psychometric quality and format meet the guidelines in ES Appendix B. 9. 11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet.
      -X- the licensee certifies that there is no duplication; or
: a. Author b. Facility Reviewer (*) n. Printed Name / Signature c - >*, j ' *. c. NRC Chief Examiner
                                                                                                                      \
(#) d. NRC Regional Supervisor@/  
      -other (explain)                                                                                       , il
\ Date - Note:
                                                                                                                    !
* The facility reviewer's initials/signature are not applicable for NRC-developed examinations.  
: 6. Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO / SRO-only Bank Modified 45%146% 7% 14% 48%150%
## Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.}}
New 1      'L question distribution(s) at right.                                                                          I I
: 7. Between 50 and 60 percent of the questions on the RO Memory          C/A exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly selected K/As support the higher cognitive levels; enter                   41% 116%      59y0 /84?4 the actual RO / SRO question distribution(s) at right.
: 8. Referencedhandouts provided do not give away answers or aid in the elimination of distractors.
: 9. Question content conforms with specific WA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are justified.
: 10. Question psychometric quality and format meet the guidelines in ES Appendix B.
: 11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet.
                                                                                                                            \
n.
                                                                      -
Printed Name / Signature c
Date
: a. Author                                                    >*,   j   ' *.
: b. Facility Reviewer (*)
: c. NRC Chief Examiner (#)
: d. NRC Regional Supervisor@/
                                                                                          -
Note:
* The facility reviewer's initials/signature are not applicable for NRC-developed examinations.
            ## Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.}}

Revision as of 15:55, 13 November 2019

2010 Perry Nuclear Power Plant Initial Examination Proposed Exam Files
ML102210215
Person / Time
Site: Perry FirstEnergy icon.png
Issue date: 06/14/2010
From:
NRC/RGN-III
To:
Shared Package
ML100621108 List:
References
Download: ML102210215 (6)


Text

2010 PERRY NUCLEAR POWER PLANT INITlAL EXAM1NATION PROPOSED EXAM FILES

-

FENOC FirstEnergy Nuclear Operating Company Mark 6.Bezilla Perry Nuclear Power Station 10 Center Road P e p Ohio 4408 1 440-280-5382 Mce President Fax: 440-280-8029 April 13, 2010 L-10-125 10 CFR 55 ATTN: Mr. Dell McNeil, Chief Examiner U. S. Nuclear Regulatory Commission 2443 Warrenville Road, Suite 210 Lisle, IL 60532-4352

SUBJECT:

Perry Nuclear Power Plant Docket No. 50-440, License No. NPF-58 NRC Initial License Examination Submittal In accordance with NUREG-I 021, ES-201, Initial Operator Licensing Examination Process, enclosed are the proposed examinations, supporting documentation, and reference materials for the NRC initial license examination scheduled to be administered at the Perry Plant starting June 14, 2010. The examination materials were developed in accordance with the guidelines specified in NUREG-I 021, Operator Licensing Examination Standards for Power Reactors, Revision 9, Supplement 1.

NUREG-I021 Forms ES-201-3, ES-301-1, ES-301-2, ES-301-3, ES-301-4, ES-301-5, ES-301-6, ES-401-1, ES-401-3, ES-401-4, ES-401-6, ES-D-1 and ES-D-2 are enclosed with the supporting documentation.

Form ES-301-6 has been completed based on the projected class size and license type at this time. The class size and makeup may change prior to the examination date.

The NRC initial license examination outlines were previously sent to you on March 1, 2010. A complete set of outline forms for both the RO and SRO examinations are included in this submittal.

It is requested that the enclosed examination materials be withheld from public disclosure until after the initial license examinations are completed.

There are no regulatory commitments contained in this letter. If there are questions or if additional information is required, please contact Mr. Raymond Torres at (440) 280 -5277.

Perry Nuclear Power Plant L-I 0-125 Page 2 None of the materials being sent are considered Safeguards information.

Raymond Torres David W. ODonnell Nuclear Qualification Instructor Facility Representative Mark Bezilla

Enclosures:

A Operator License Examination B Supporting Documentation C Reference Material D Job Performance Measures Examination E Form ES-201-3, Examination Security Agreement F Form ES-301-1, Administrative Topics Outline (RO & SRO)

G Form ES-301-2, Control Room/ln-Plant Systems Outline (RO, SRO-I, SRO-U)

H Form ES-301-3, Operating Test Quality Checklist I Form ES-301-4, Simulator Scenario Quality Checklist J Form ES-301-5, Transient and Event Checklist K Form ES-301-6, Competencies Checklist L Form ES-401-1, BWR Examination Outline M Form ES-401-3, Generic Knowledge and Abilities Outline-Tier 3 N Form ES-401-4, Record of Rejected KlAs 0 Form ES-401-6, Written Examination Quality Checklist P Form ES-D-1, Scenario Outlines Q Form ES-D-2, Required Operator Actions cc: NRC Document Control Desk w/o Enclosures NRC Project Manager w/o Enclosures NRC Region Ill Branch Chief w/o Enclosures NRC Resident Inspector w/o Enclosures

ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: Perry Date of Examination: June 2010 Operating Test Number: 201 0-01 Initials

1. General Criteria
a. The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).
b. There is no day-to-day repetition between this and other operating tests to be administered during this examination.
c. The operating test shall not duplicate items from the applicants' audit test(s). (see Section D.l .a.)
d. Overlap with the written examination and between different parts of the operating test is within acceptable limits.
e. It appears that the operating test will differentiate between competent and less-than-competent

, nn applicants at the designated license level.

1

2. Walk-Through Criteria
a. Each JPM includes the following, as applicable:

initial conditions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee operationally important specific performance criteria that include:

- detailed expected actions with exact criteria and nomenclature

- system response and other examiner cues

- statements describing important observations to be made by the applicant criteria for successful completion of the task

- identification of critical steps and their associated performance standards

- restrictions on the sequence of steps, if applicable

b. Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.
3. Simulator Criteria The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-301-4 and a copy is attached. w Printed Name / Signature Date
9. Author 4 4 -10
5. Facility Reviewer(*) q * / 3 JO
u. NRC Chief Examiner (#)

NOTE:

  • The facility signature is not applicable for NRC-developed tests.
  1. Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.

ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Facility: Perry Date of Exam: Jun. 201 0 Scenario Numbers: 1/2/3 Operating Test No.: 201 0-01 QUALITATIVE ATTRIBUTES Initials a b* C#

I

1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events.

I\

2. The scenarios consist mostly of related events. I/
3. Each event description consists of the point in the scenario when it is to be initiated the malfunction(s) that are entered to initiate the event I

the symptomslcues that will be visible to the crew the expected operator actions (by shift position) the event termination point (if applicable)

4. No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event.
5. The events are valid with regard to physics and thermodynamics.
6. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.

1

7. If time compression techniques are used, the scenario summary clearly so indicates.

Operators have sufficient time to carry out expected activities without undue time constraints.

Cues are given. I/

8. The simulator modeling is not altered.
3. The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.

IO. Every operator will be evaluated using at least one new or significantly modified scenario.

All other scenarios have been altered in accordance with Section D.5 of ES-301.

<

11. All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the form along with the simulator scenarios). I
12. Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).
13. The level of difficulty is appropriate to support licensing decisions for each crew position. v-I IW Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes I R
1. Total malfunctions (5-8) 71715 -4w
3. Malfunctions after EOP entry (1-2) 41212 Y
3. Abnormal events (2-4) 11312
t. Major transients (1-2) 21212
5. EOPs enteredlrequiring substantive actions (1-2) 1 I 1 13 L
3. EOP contingencies requiring substantive actions (0-2) 2 1 1 12 1
7. Critical tasks (2-3) 51315

/

ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: Perry Date of Exam: June 2010 Exam Level: RO SRO Initial Item Description a b* c#

1. Questions and answers are technically accurate and applicable to the facility.
2. a. NRC K/As are referenced for all questions.
b. Facility learning objectives are referenced as available.
5. Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:

- X the audit exam was systematically and randomly developed; or I l l

- X the audit exam was completed before the license exam was started; or I I

_ . the examinations were developed independently; or

-X- the licensee certifies that there is no duplication; or

\

-other (explain) , il

!

6. Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO / SRO-only Bank Modified 45%146% 7% 14% 48%150%

New 1 'L question distribution(s) at right. I I

7. Between 50 and 60 percent of the questions on the RO Memory C/A exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly selected K/As support the higher cognitive levels; enter 41% 116% 59y0 /84?4 the actual RO / SRO question distribution(s) at right.
8. Referencedhandouts provided do not give away answers or aid in the elimination of distractors.
9. Question content conforms with specific WA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are justified.
10. Question psychometric quality and format meet the guidelines in ES Appendix B.
11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet.

\

n.

-

Printed Name / Signature c

Date

a. Author >*, j ' *.
b. Facility Reviewer (*)
c. NRC Chief Examiner (#)
d. NRC Regional Supervisor@/

-

Note:

  • The facility reviewer's initials/signature are not applicable for NRC-developed examinations.
    1. Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.