ML052010438
| ML052010438 | |
| Person / Time | |
|---|---|
| Site: | Monticello  |
| Issue date: | 05/02/2005 |
| From: | Ruth J Nuclear Management Co |
| To: | Office of Nuclear Reactor Regulation |
| Shared Package | |
| ML051680154 | List: |
| References | |
| 50-263/05-301, ES-301, ES-301-3 50-263/05-301 | |
| Download: ML052010438 (8) | |
Text
PROPOSED EXAMINATION SUBMITTAL LETTER AND CHECKLISTS FOR THE MONTICELLO INITIAL EXAMINATION - MAY 2005
Monticello Proposed Operating Test and Written Examination Contains the following:
ES-301-3 Operating Test Quality Checklist ES-301-4 Simulator Scenario Quality Checklist ES-301-6 Competencies Checklist ES-401-6 Written Examination Quality Checklist ES-401-9 Written Examination Review Worksheet The following were provided on magnetic media:
Three (3) RO administrative job performance measures One (1) RO&SRO administrative job performance measures Four (4) SRO administrative job performance measures Ten (IO) RO&SRO operating job performance measures One (1) RO operating job performance measures Four (4) dynamic simulator scenario guides (ES-D-I & ES-D-2 equivalent for each scenario)
Written examination (1 00 questions are independently marked as RO or SRO)
Written examination question comments. Form ES-401-9 used to document facility comments.
Operating Test Comments Changes made to the exam during validation of the exam.
Monticello Nuclear Generatina Plant Operated by Nuclear Management Company, LLC March 1,2005 L-MT-05-02 1 10 CFR Part 55.40 Regional Administrator, Region 111 US Nuclear Regulatory Commission 2443 Warrenville Road, Suite 210 Lisle, Illinois 60532-4352 Attention: Dell McNeil Monticello Nuclear Generating Plant Docket 50-263 License No. DPR-22 Written Examination For The Initial Licensina Examination To Be Conducted The Weeks of Mav 2,2005 and Mav 9,2005 Reference 1 : NUREG 1021, Operator Licensing Examination Standards for Power Reactors, Revision 9 In accordance with the requirements of 10 CFR 55.40(b)(4). a power reactor facility licensee must receive NRC approval of their proposed written examination and operating tests. Further, 1 OCFR55.40(a) requires that examinations meet the requirements of Reference 1. Therefore, enclosed for your review are the proposed examination materials for the initial license examinations for our operator license applicants In accordance with IOCFR 55.49, "Integrity of Examinations and Tests" and Reference 1, Section ES-201, Attachment 1, "Examination Security and Integrity Guidelines," the Nuclear Management Company, LLC requests that the enclosed materials be withheld from public disclosure until after the examinations are complete, and further that the enclosed materials only be viewed by the NRC examiner, Mr. Dell McNeil.
The proposed examination materials were prepared per the guidelines of Reference 1, sections ES-301 and ES-401. The proposed examination materials have been prepared by the Monticello facility for six (6) Reactor Operator license candidates, one (1) Senior Reactor Operator (SRO) - Upgrade license candidate and five (5) SRO -
Instant license candidates.
2807 West County Road 75 Monticello, Minnesota 55362-9637 Telephone: 763-295-51 51 Fax: 763-295-1454
USNRC Page 2 Enclosed are the following items for your review:
Book 1 - ROlSRO written exams, ES-401-6, Written Examination Quality Checklist Book 2 - ROlSRO written exam key and references Book 3 -Written exam reference materials provided to candidates Book 4 - Job Performance Measures, ES-301-3. Operating Test Quality Checklist Book 5 - Scenarios, ES-301-4. Simulator Scenario Quality Checklist, and ES-301-6, Book 6 - MNGP Technical Specifications (candidate reference)
Competencies Checklist This letter makes no new commitments and no revisions to existing commitments.
T h o k s J. Palmisano U Site Vice President, Monticello Nuclear Generating Plant Nuclear Management Company, LLC Enclosures cc:
Administrator, Region 111, USNRC (w/o attachments)
Project Manager, Monticello, USNRC (w/o attachments)
Resident Inspector, Monticello, USNRC (w/o attachments)
ES-301 Operating Test Quality Checklist Form ES-301-3 Zacility Monticello Nuclear Generating Plant Date of Exam 5/2/05 Operating Te:
- 1. General Criteria I.
The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g. IO CFR 55.45, operational importance, safety function distribution.)
There is no day-to-day repetition between this and other operating tests to be administered during this examination.
The operating test shall not duplicate items from the applicants audit test(s)s. (see Section D.1.a)
Overlap with the written examination and between different parts of the operating test is within acceptable limits.
It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license level.
- b.
- 1.
- 2. Walk-Through Criteria 1
Each JPM includes the following, as applicable.
initial conditions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee operationally important specific performance criteria and nomenclature.
- detailed expected actions with exact criteria and nomenclature
- system response and other examiner cues
- statements describing important observations to be made by the applicant
- criteria for successful completion of the task
- identification of critical steps and their associated performance standards
- restrictions on thc sequence of steps. if applicable.
- b.
Ensure that any changes from the presiously approved systems and 3dminisuative walk-through nutlines (Fornls ES-301-1 and 2) have nnt caused the test 10 deviate from any of the icceptance criteria (e.. item distribution, bank use. repetition from the last 2 NRC examinations) spccific on those f(irms and Form ES-201-2.
- 3. Simulator Criteria The associated simulator operating tests (scenario sets) have been reviewed in accordance with 1:nrm ES-301-4 and a copy IS attached Printed NamelSienature (umber:
W90115
- a. Author 2/28/05
- c. NRC Chief Examiner (#)
- d. NRC Supervisor
- b. Facility Reviewer (*)
&la&kK Note:
- The facility reviewers initialdsignature are not applicable for NRC-developed examinations.
- Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Target Quantitative Attributes (Per Scenario; See Section D.5.d)
I.
Total malfunctions (5-8)
- 2.
Malfunctions after EOP entry (1-2)
- 3.
Abnormal events (2-4)
- 4.
Major transients (1-2)
- 7.
Critical tasks (2-3)
- 5.
- 6.
EOPs enteredlrequiring substantive actions (1-2)
EOP contingencies requiring substantive actions (1-2) acility MNGP Date of Exam 5lU05 Scenario Numbers:
I I 2 13 I 4 Operating TI QUALITATNE ATTRIBUTES Actual Attributes 7 1 5 1 5 1 6 2 1 1 I I
I 2
3 1 4 1 4 I 4
2 1 2 I I
I I
2 1 2 I I
1 2 1 1 1 I I
/
I 3 1 3 1 3 I 2
I, L.
- 1.
The initial conditions are realistic, in that some equipment andlor instrumentation may be out of service, but it does not cue the operators into expected events.
The scenarios consist mostly of related events.
Each event description consists of No more than one non-mechanistic failure (e.& pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event.
The events are valid with regard to physics and thermodynamics.
Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.
If time compression techniques are used, the scenario summary clearly so indicates.
Operators have sufficient time to carry out expected activities without undue time constraints. Cues are given.
The simulator modeling is not altered.
The scenarios have been validated. Pursuant to IO CFR 44.45(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.
Every operator will be evaluated using at least one new or significantly modified scenario. All other scenarios have been altered in accordance with Section D.5 of The point in the scenario when it is to be initiated The malfunction(s) that are entered to initiated the event The symptomslcues that will be visible to the crew The expected operator actions (by shift position)
The event termination point (if applicable)
- 1.
- 5.
5,
- 7.
- 3.
- 9.
IO.
Number:
W90115 Initial
ES-301 Competencies Checklist Form ES-301-6 perating Test Number:
W90115 Notes:
( I )
(2) Operation for an SRO-U.
(3)
Only applicable to SROs.
Includes Technical Specification compliance for an RO.
Instructors:
Circle the applicants license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.
Author:
J. Ruth NRC Reviewer:
ES-401 Written Examination Quality Checklist Form ES-401-6 the examinations were developed independently X the licensee certifies that there is no duplication other (explain) the bank, at least IO percent new, and the rest new or modified); enter the actual ROISRO-only question 26/8 13/12 61/80 distribution(s) at right.
Between 50 and 60 percent of the questions on the RO
- 6.
Bank use meets limits (no more than 75 percent) from Bank Modified New 9
- 7.
Item Description L
b exam are written at the comprehensionlanalysis level; the SRO exam may exceed 60 percent if the randomly I
Memory I
selected WAS support the higher cognitive levels; enter I 44/32 I
56/68 1
I I-distractors.
Question content conforms with specific WA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviation are justified.
Question psychometric quality and format meet the guidelines in ES Appendix B.
The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet.
- 9.
- 10.
- 11.
L B. -
i?r L k -
a Lu,
- a. Author 2/28/05
- b. Facility Reviewer (*)
- c. NRC Chief Examiner (#)
- d. NRC Regional Supervisor Note:
- The facility reviewers initialslsignature are not applicable for NRC-developed examinations.
- Independent NRC reviewer initial items in Column c; chief examiner concurrence required.