ML13165A156

From kanterella
Jump to navigation Jump to search
2013 Braidwood Station Initial License Examination Proposed Exam Files
ML13165A156
Person / Time
Site: Braidwood  Constellation icon.png
Issue date: 02/07/2013
From: Enright D
Exelon Generation Co
To:
Region 3 Administrator
Shared Package
ML11354a333 List:
References
BW130008
Download: ML13165A156 (11)
v • d • e


Text

2013 BRAIDWOOD STATION INITIAL LICENSE EXAMINATION PROPOSED EXAM FILES

Exelon Generation Company, LLC Exelon Generation Braidwood Station 35100 South Route 53, Suite 84 Braceville, IL 60407-9619 www .exeloncorp.corn February 7, 2013 BW130008 10 CFR 55.40(b)

U. S. Nuclear Regulatory Commission Regional Administrator, Region Ill 2443 Warrenville Road, Suite 210 Lisle, IL 60532-4352 Braidwood Station, Units 1 and 2 Facility Operating License Nos. NPF-72 and NPF-77 NRC Docket Nos. STN 50-456 and STN 50-457

Subject:

Submittal of Integrated Initial License Training Examination Materials Enclosed are the examination materials that Braidwood Station is submitting in support of the Initial License Examination scheduled during the weeks of March 25 and April 1, 2013 at Braidwood Station.

This submittal includes the Reactor Operator Written Examination, Senior Reactor Operator and Reactor Operator Job Performance Measures, and Integrated Plant Operation Scenario Guides.

As granted by the Chief Examiner, the Senior Reactor Operator Written Examination will be submitted not later than February 15, 2013.

These examination materials have been developed in accordance with NUREG-1021, "Operator Licensing Examination Standards for Power Reactors," Revision 9, Supplement 1. Please note that reference materials are attached to each individual examination question or item.

Some minor modifications have been made to the Integrated Examination Outline, JPM Outlines and written examination outlines based on NRC feedback and internal validation results. These changes improve examination quality and are in compliance with NUREG-1 021, Revision 9, Supplement 1.

Some additional modifications or adjustments to the examination material may be required due to procedural changes.

In accordance with NUREG 1021, Revision 9, Supplement 1, Section ES-201, "Initial Operator Licensing Examination Process," please ensure that these materials are withheld from public disclosure until after the examinations are complete.

Should you have any questions concerning this letter, please contact Mr. Chris VanDenburgh, Regulatory Assurance Manager, at (815} 417-2800. For questions concerning examination materials, please contact Ken Norris at (815} 458-7690.

U. S. Nuclear Regulatory Commission February 7, 2013 Page2

Enclosures:

(Hand delivered to Bruce Palagi, Chief Examiner, Region Ill)

  • RO/SRO Composite Examination with references attached
  • Integrated Plant Operation Scenario Guides
  • Completed Checklists:

- Operating Test Quality Checklist (Form ES-301-3)

- Simulator Scenario Quality Checklist (Form ES-301-4)

- Transient and Event Checklist (Form ES-301-5)

- Competencies Checklist (Form ES-301-6)

- Written Exam Quality Checklist (Form ES-401-6)

  • Examination Security Agreements (Form ES-201-3)

cc: (without attachments)

Chief, NRC Operator Licensing Branch NRC Senior Resident Inspector- Braidwood Station

Lxelon Generation Company. Ll .C Exelon Generation Braidwood Stalion 15100 South Route 53. Suite 84 Bracevillc,IL 60407-9619 www.exeloncorp.ccnn February 12, 2013 10 CFR 55.40(b)

BW130015 U.S. Nuclear Regulatory Commission Regional Administrator, Region Ill 2443 Warrenville Road, Suite 210 Lisle, IL 60532-4352 Braidwood Station, Units 1 and 2 Facility Operating License Nos. NPF-72 and NPF-77 NRC Docket Nos. STN 50-456 and STN 50-457

Subject:

Submittal of Integrated Initial License Training Examination Materials Enclosed is the balance of the examination materials that Braidwood Station is submitting in support of the Initial License Examination scheduled during the weeks of March 25 and April 1, 2013 at Braidwood Station.

This portion of the submittal is comprised of the Senior Reactor Operator Written Examination. All other sections of the examination were submitted previously (ref. cover letter dated Feb. 7, 2013 from D. Enright to USNRC Region Ill).

These examination materials have been developed in accordance with NUREG-1021, "Operator Licensing Examination Standards for Power Reactors," Revision 9, Supplement 1. Please note that reference materials are attached to each individual examination question or item.

Some minor modifications have been made to the Integrated Examination Outline. These changes improve examination quality and are in compliance with NUREG-1 021, Revision 9, Supplement 1.

In accordance with NUREG 1021, Revision 9, Supplement 1, Section ES-201, "Initial Operator Licensing Examination Process," please ensure that these materials are withheld from public disclosure until after the examinations are complete.

Should you have any questions concerning this letter, please contact Mr. Chris VanDenburgh, Regulatory Assurance Manager, at (815) 417-2800. For questions concerning examination materials, please contact Ken Norris at (815) 458-7690.

Daniel Enright Site Vice President Braidwood Station

U.S. Nuclear Regulatory Commission Page 2 of 2

Enclosures:

(Hand delivered to Bruce Palagi, Chief Examiner, Region Ill)

  • SRO Written Examination with references attached
  • Completed Checklists:
  • Written Exam Quality Checklist (Form ES-401-6) cc: (without attachments)

Chief, NRC Operator Licensing Branch NRC Senior Resident Inspector- Braidwood Station

ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: Braidwood Date of Examination: 03/25/2013 Operating Test Number: 2013-1 Initials

1. GENERAL CRITERIA a b* c#

The operating test conforms with the previously approved outline; changes are consistent with a.

sampling requirements {e.g., 10 CFR 55.45, operational importance, safety function distribution). 4 ~ erv;

b. There is no day-to-day repetition between this and other operating tests to be administered during this examination. W_ A M
c. The operating test shall not duplicate items from the applicants' audit test{s){see Section D.1.a).

I// {2.. .c/1';

d. Overlap with the written examination and between different parts of the operating test is within acceptable limits. l;f__ ~ .~
e. It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license level.

IA1 f2- CfJ1

2. WALK-THROUGH CRITERIA -- -- --
a. Each JPM includes the following, as applicable:
  • initial conditions
  • initiating cues
  • references and tools, including associated procedures
  • reasonable and validated time limits {average time allowed for completion) and specific designation if deemed to be time critical by the facility licensee
  • operationally important specific performance criteria that include:

- detailed expected actions with exact criteria and nomenclature J! P-system response and other examiner cues

~

statements describing important observations to be made by the applicant

- criteria for successful completion of the task

- identification of critical steps and their associated performance standards

- restrictions on the sequence of steps, if applicable

b. Ensure that any changes from the previously approved systems and administrative walk-through outlines {Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance criteria {e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.
3. SIMULATOR CRITERIA w --

!2 O'.h:

f *~ cYVJ The associated simulator operating tests {scenario sets) have been reviewed in accordance with Form ES-301-4 and a copy is attached.

a. Author Ken Norris/

~?!!N!&e 2/5/13 Date

b. Facility Reviewer{*) Pete Moodie/ ~ ~ ,....._ 2/5/13
c. NRC Chief Examiner{#) C~v /tz-S D. 2co;~ I ~1 R- l)S:,_ / 1-L?-J //3
d. NRC Supervisor ~ Jlv-oHIJj/; fJ~n-~~/..~ /~~ - ~/!!f/1.1

'7 i;-z /J )r-I

/V v ~

NOTE:

  • The facility signature is not applicable for NRC-developed tests
  1. Independent NRC reviewer initial items in Column "c"; chief examiner concurrence is required.

ES-301, Page 24 of 27

  • ES-301 Facility: Braidwood Simulator Scenario Quality Checklist Date of Exam: 03/25/13 QUALITATIVE A TIRIBUTES Form ES-301-4 Scenario Numbers: 1 /2/3 Operating Test Number: 2013-1 Initials a b* c:#
1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events.

~ /}:_ .~

2. The scenarios consist mostly of related events.

111 P- IWJ

3. Each event description consists of
  • the point in the scenario when it is to be initiated
  • the malfunction(s) that are entered to initiate the event
  • the symptoms/cues that will be visible to the crew
  • the expected operator actions (by shift position)
  • the event termination point (if applicable)

'(/ tl D11j I

4. No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event. If I Cl'1
5. The events are valid with regard to physics and thermodynamics.
  1. ~ 'C#/

1/ ;2

6. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.

0'1 7.

rJ ~

If time compression techniques are used, the scenario summary clearly so indicates.

Operators have sufficient time to carry out expected activities without undue time constraints.

Cues are given. c/Y)

J! !0...

8. The simulator modeling is not altered. UM
9. The scenarios have been validated. Pursuant to 10CFR55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios. 4 '/)_ on-;

~ 'f.l- rM1

10. Every operator will be evaluated using at least one new or significantly modified scenario.

All other scenarios have been altered in accordance with Section 0.5 of ES-301.

11. All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the form along with the simulator scenarios). 11 *~ tn}

w~ !J- IV?

12. Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).
13. The level of difficulty is appropriate to support licensing decisions for each crew position. IJI !1- C/11"1 Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes -- -- --
1. Total malfunctions (5-8) 8 I 8 I 7

/l I!A fr1

2. Malfunctions after EOP entry (1-2) 2 I2 I2 I d.," I~ 0'-\
3. Abnormal events (2-4) 4 I4 I5 /I ra. of7
4. Major transients (1-2) 2 I 1 I 1 'vf, ~ I LJV\.
5. EOPs entered/requiring substantive actions (1-2) 3 I2 I 1 d. lA (__,.h
6. EOP contingencies requiring substantive actions (0-2) 1 I 1 I0 P1 rOr-. (/1/',
7. Critical tasks (2-3) 2 I2 I4 /1 VA (/1 ES-301, Page 25 of 27
  • ES-301 wood Simulator Scenario Quality Checklist Date of Exam: 03/25/13 QUALITATIVE AITRIBUTES Scenario Numbers: 4/ Sp I Op Form ES-301-4

.. '>nl::\-1 Initials a b* c#

1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected events. tf !2 ~
2. The scenarios consist mostly of related events. /1 a.- Cv-1
3. Each event description consists of
  • the point in the scenario when it is to be initiated
  • the malfunction(s) that are entered to initiate the event the symptoms/cues that will be visible to the crew the expected operator actions (by shift position) the event termination point (if applicable)
rt /{ P'-1
4. No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event.

'4. /)- t4 It ..,.v~

5. The events are valid with regard to physics and thermodynamics. /1 lh 6.

7.

Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.

If time compression techniques are used, the scenario summary clearly so indicates.

11 ltL I~

Operators have sufficient time to carry out expected activities without undue time constraints.

Cues are given.

11 ~ --?

J/1 VA--

8. The simulator modeling is not altered. Qt-)
9. The scenarios have been validated. Pursuant to 10CFR55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios. I! ~ -?
10. Every operator will be evaluated using at least one new or significantly modified scenario.

All other scenarios have been altered in accordance with Section 0.5 of ES-301. ;1 ll ~

11. All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the form along with the simulator scenarios). ;I ~ <:>-')
12. Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).

t2 ~ .e:-J

13. The level of difficulty is appropriate to support licensing decisions for each crew position.

f/ ~

Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes -- -- r

1. Total malfunctions (5-8) 9 I 9 I

/l Ia 04-1

2. Malfunctions after EOP entry (1-2) 2 I 3 I fl ~ ,,d-.,

11 ~

/

3. Abnormal events (2-4) 4 I 5 I Ov1
4. Major transients (1-2) 1 I 1 I v1 ~ M
5. EOPs entered/requiring substantive actions (1-2) 2 I 1 I PI ;A ~

I

6. EOP contingencies requiring substantive actions (0-2) 0 I 1 I It '(4.. b'\../1
7. Critical tasks (2-3) 3 I 2 I ?I /A ltv-?

ES-301, Page 25 of 27

ES-401 Written Examination Quality Checklist Form ES-401-6

  • Facility: Braidwood Date of Exam: 03/25/2013 Item Description Exam Level: RO a

12J SRO 0 Initial b* c#

1. Questions and answers are technically accurate and applicable to the facility. ,)/'_ ~ 0-'~.l 2.

3.

a. NRC K!As are referenced for all questions.
b. Facility learning objectives are referenced as available.

SRO questions are appropriate in accordance with Section D.2.d of ES-401 4 N/A

/)._

N/A

~

N/A

4. The sampling process was random and systematic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exam, consult the NRR OL program office).

Cf'l7

5. Question duplication from the license screening/audit exam was controlled /

as indicated below (check the item that applies) and appears appropriate:

_ the audit exam was systematically and randomly developed; or 2L the audit exam was completed before the license exam was started; or

_ the examinations were developed independently; or 6.

_ the licensee certifies that there is no duplication; or

_ other (explain)

Bank use meets limits (no more than 75 percent Bank Modified New 4  !?- ~

from the bank, at least 10 percent new, and the rest 14 9 52 7.

new or modified); enter the actual RO I SRO-only question distribution(s) at right.

Between 50 and 60 percent of the questions on the RO 19%

Memory 12%

CIA 69%

1/1 fZ OJ exam are written at the comprehension /analysis level; the SRO exam may exceed 60 percent if the randomly 33 42 selected KAs support the higher cognitive levels; enter Vl /{ 7 44% 55%

the actual RO I SRO question distribution(s) at right.

8. References/handouts provided do not give away answers or aid in the elimination of distractors. /) j2 0?] /
9. Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the Tier to which they are assigned; deviations are justified

/; ~ CfJ;

10. Question psychometric quality and format meet the guidelines in ES Appendix B.

tf V...( lvfvi

11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with value on cover sheet /l /) "c?J

/Z'JI!:;':"~

Date

a. Author Ken Norris/ 02/01/13
b. Facility Reviewer(*) Pete Moodie/ Db_L ~ 02/05/13

( 1_Q P'S]_ ~{-:) ~(~ /cl. .v l"s D_lcl(

.~

c. NRC Chief Examiner (#)
d. NRC Regional Supervisor ~I .I ffil"t? n~rt /};~~ Zd'~/~ */ y

.... J

~

Note:

  • The facility reviewer's initials/signature are not applicable for NR<i-"developed examinations.
  1. Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.

/1/@fe J a10 ((f) sfc-.Jdit} -R/~ ;f/l?J/!dc'tl P--1 tht? c£..4-1. ~c~~

~/111 175- t-;CJI- (p ~t,~//1 )~ ovJ.-77/~cl .v/lh Jk s~o J/!11/ft<- /lf~/,m/lfr~.

ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: Braidwood Date of Exam: 03/25/2013 Exam Level: R00SRO~

Initial Item Description a b* r!

1. Questions and answers are technically accurate and applicable to the facility. /__ W- _C#'Vj
2. a. NRC KJAs are referenced for all questions.
b. Facility learning objectives are referenced as available. */; F cry
3. SRO questions are appropriate in accordance with Section D.2.d of ES-401 */1 i0 Y"!'7
4. /

The sampling process was random and systematic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exam, consult the NRR OL program office).

07/

5. Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:

_ the audit exam was systematically and randomly developed; or 2L the audit exam was completed before the license exam was started; or 1£ j2

_ the examinations were developed independently; or

_ the licensee certifies that there is no duplication; or

_ other (explain)

.~

6. Bank use meets limits (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the rest

!I ;2 4 2 19 new or modified); enter the actual RO I SRO-only 16% 8% 76%

question distribution(s) at right.

~

7. Between 50 and 60 percent of the questions on the RO Memory CIA I exam are written at the comprehension /analysis level; the SRO exam may exceed 60 percent if the randomly 10 15 selected KAs support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at right.

40% 60%

I ~ tf7 8.

9.

References/handouts provided do not give away answers or aid in the elimination of distractors.

Question content conforms with specific KJA statements in the previously approved d VA f)Y't examination outline and is appropriate for the Tier to which they are assigned; deviations are justified If!/ ;2- lew?

10. Question psychometric quality and format meet the guidelines in ES Appendix B. I// V..l ~
11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with value on cover sheet  :;; liZ I~

z;z;_s~"""ro Date

a. Author Ken Norris/ .d' 02/11/13
b. Facility Reviewer (*) Pete Moodie/ r _ £ £ ~- 02/12/13

(~ ){_~_ , ('\ .( ~ / C hvla- 'D/1~; a

c. NRC Chief Examiner (#)
d. NRC Regional Supervisor Note:

~~/.I Jlvr~lJ£~~ CJ .d,;;;::-~fZ/"-

  • The facility reviewer's initials/signature are not applicable for NRC-6eveloped examinations.
  1. Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required .
Retrieved from "https://kanterella.com/w/index.php?title=ML13165A156&oldid=2456543"