ML051380556
| ML051380556 | |
| Person / Time | |
|---|---|
| Site: | Limerick  |
| Issue date: | 01/26/2005 |
| From: | Jason White Exelon Generation Co |
| To: | Conte R NRC/RGN-I/DRS/OSB |
| Conte R | |
| References | |
| 50-352/05-301, 50-353/05-301, ES-201, ES-201-1 50-352/05-301, 50-353/05-301 | |
| Download: ML051380556 (14) | |
Text
ES-201 Examination Preparation Checklist Form ES-2014 Date of Examination: I / Io [OS-Examinations Developed by: @
/ NRC (circle one)
I Chief Examiner's Initials Target Date" Task Description (Reference)
-180 I 1.
Examination administration date confirmed (C.l.a: C.2.a and b)
-120 I 2.
NRC examiners and facility contact assigned (C.1.d; C.2.e)
-120
-120
- 4.
Corporate notification letter sent (C.2.d) 1-901
- 15. Reference material due (C.1.e: C.3.c; Attachment 211
- 3.
Facility contact briefed on security and other requirements (C.2.c)
-7 5
- 6.
Integrated examination outline(s) due, including Forms ES-201-2. ES201-3, ES-301-1, ES-301-2, ES-301-5, ES-D-l's, ES-401-112, ES401-3, and ES-4014. as apphcable (C.1.e and f; C.3.d)
Examination outline(s) reviewed by NRC and feedback provided to facility licensee (C.2.h; C.3.e)
-70
- 7.
-45
- 8.
Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Fons ES-301-3. ES-3014, ES-301-5.
ES-301-6, and ES401-6), and reference materials due (C.1.e. f, 9 and h; C.3.d)
TF
~
-30
- 9.
Preliminary license applications (NRC Form 398's) due (C.1.l; C.2.g; ES-202)
-14
-14
- 11. Examination approved by NRC supervisor for facility licensee review (C.2.h; C.3.f)
-14
- 12. Examinations reviewed with facility licensee (C.1.j; C2.f and h; C.3.g)
-7
- 13. Written examinations and operating tests approved by NRC supervisor (C.2.i; C.3.h)
-7
- 14. Final applications reviewed; examination approval and waiver letters sent (C.2.i; Attachment 4; ES-204)
-7
- 15. Proctoringlwntten exam administration guidelines reviewed with facility licensee (C.3.k)
-7
- 16. Approved scenarios, job performance measures, and questions distributed to NRC examiners (C.3.i)
Target dates are keyed to the examination date identified in the corporate notification letter.
They are for planning purposes and may be adjusted on a case-by-case basis m coordination with the facility licensee.
Amlies only to examinations prepared by the NRC.
I 1 ES-201, Page 24 of 27
ES-201 Examination Outline Quality Checklist Form ES-201-2
- a. Verify that the sptems vdk-through outline meets the criteria specifed on Form ES-301-2:
(1) the outline(s) contain(s) the required number ofcontrol room and in-plant tasks distributed among (2) task repetition tom the last tvzo NRC examinations is ucithin the limits speciled on the form the safety functions as speciled on the form L.
U Facili Item
- 1.
w R
I T
T E
N
- 2.
S I
M
- 3.
w
/
T r: Limerick Date of Examination: 1/10/05 b s k Description
- a. Verify that the outline(s) it(s) the appropriate model per ES-401.
- b. Assess Wether the outline vas systematically and randomly prepared in accordance ucith Section D.l of ES-401 and whether all KA categories are appropriatelysampled.
- c. Assess vhether the outline over-emphasizes any systems, evolutions, or generic topics.
- d. Assess Mether the justifications for deselected or rejected WA statements are appropriate.
- a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number ohormal evolutions, instrument and component Bilures, technical specifcations, and major transients.
I
- b. Assess &tether there are enough scenario sets (and spares) to test the projected number and mix of applicants in accordance wth the ewected crew composition and rotation schedule wthout compromising exam integrity ensure each applicant can be tested using at least one newx significantly modified scenario, that no scenarios are duplicated fom the applicants' audit test(s), and scenarios ucill not be repeated on subsequent dap.
U
- b. Verify that the administrative outline meets the criteria speciied on Form ES-301-1:
(1) the tasks are distributed among the topics as speciled on the form (2) at least one task is newor significantly modified
- 13) no more than one task is reneateri fnm the last hhn NRC lirsnsinn emminitinns
- c. Determine if there are enough different outlines to test the projected number and mixof applicants and ensure that no items are duplicated on subsequent dag.
- a. Assess vhether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam section.
- f. Assess Wether the exam fits the appropriate job level (ROor SRO).
l@Ie'I -r
- a. Author
- b. Facility Reviewer (*)
- c. NRC Chief Examiner (#)
- d. NRC Supervisor ES 201-2, Page 25 of 27
ES-201 Examination Security Agreement Form ES-201-3
- 1.
Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of Z ~ J
, 7, LVas of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
r4
,), C LV.5
- 2.
Post-Examination To the best of my knoylep$e, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week@) of &,,;%!J.
From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.
PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1)
DATE SIGNATURE (2)
DATE NOTE le 26 Of 27 ES-201.
ES-201 Examination Security Agreement Form ES-201-3
- 1.
Pre-Examination
, ; / c i U 5 I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of / /17/0r date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
as of the I
i I
I
- 2.
Post-Examination To the best of my knowled e, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of &.
From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.
/ I 0 1 2 PRINTED NAME JOB TITLE I RESPONSIBILITY SIGNATURE (1)
DATE SIGNATURE (2)
DATE NOTE i
II 26 Of 27 ES-201 a
ES-301 Operating Test Quality Checklist Form ES-301-3 Facility.
Limerick Date of Examination:
1/10/05 qerating Tc
- Number:
I.
GENERAL CRITERIA II
- a.
- b.
The operating test conbrms with the previously approved outline; changes are consistent vith sampling requirements (e.g., 10 CFf? 55.45, operational importance, sabty function distribution).
There is no dayto-day repetition betwen this and other operating tests to be administered during this ewrnination.
The operating test shall not duplicate items fom the applicants' audit test(s)(see Section D.1.a).
Overlap with the witten examination and betwen different parts of the operating test is \\nithin acceptable limits.
It appears that the operating test dl differentiate betwen competent and less-than-competent applicants at the designated license level.
C.
- d.
- e.
- 2. WALK-THROUGH CRITERIA
- a.
Each JPM includes the bllowing, as applicable:
. initial conditions
. initiating cues
. references and tools, including associated procedures
. reasonable and validated time limits (average time alloved for completion) and specilc designation if deemed to be time critical bythe facility licensee
. operationally important specific performance criteria that include:
- detailed e v c t e d actions with exact criteria and nomenclature
- sFtem response and other eziminer cues
- statements describing important observations to be made bghe applicant
- criteria br successful completion of the task
- identiication of critical steps and their associated perbrmance standards
- restrictions on the sequence ofsteps, if applicable
- b.
Ensure that any changes from the previously approved systems and administrative wlk-through outlines (Forms ES-301-1 and 2) have not caused the test to deviate b m any of the acceptance criteria (e.g., item distribution, bank use, repetition fom the last 2 NRC emminations) specified on those forms and Form ES-20102.
- 3. SIMULATOR CRITERIA The associated simulator operating tests (scenario sets) have been reviewd in accordance Ath Form ES-3014 and a copyis attached.
- a. Author
- b. Facility Reviewer?)
- c. NRC Chief Examiner (#)
- d. NRC Supervisor (*)
Date NOTE:
The facility signature is not applicable br NRC-developed tests
- Independent NRC reviewer initial items in Column "c;" chiefexaminer concurrence is required.
ES-301, Page 24 of 27
ES-301 Simulator Scenario Qualitv Checklist Form ES-301-4 Facility. Limerick Date of Exam: 1110105 ScenarioNumbers: 1 I 3 1 4 OperatingTest No.:
Initials a
I I. v I ~ #
QUALITATIVE ATTRIBUTES
- 1.
- 2.
- 3.
The initial conditions are realistic, in that some equipment and/or instrumentation mape out of service, but it does not cue the operators into epected events.
The scenarios consist mostlyof related events.
Each event description consists of the point in the scenario h e n it is to be initiated the malfunction(s) that are entered to initiate the event the symptomslcues that Mill be visible to the crew the expected operator actions (by shift position) the event termination point (ifapplicable)
No more than one non-mechanistic Bilure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event.
- 4.
- 5.
The events are valid with regard to physics and thermodynamics.
- 6.
- 7.
Sequencing and timing of events is reasonable, and allow the examination team to obtain complete evaluation results commensurate A h the scenario objectives.
If time compression techniques are used, the scenario summatyAearly so indicates. Qerators have sufficient time to canyout expected activities wthout undue time constraints. Cues are given.
The simulator modeling is not altered.
The scenarios have been validated. Pursuant to 10CR55.46(d) any open simulator perbrmance deficiencies have been evaluated to ensure that Onctional fidelity is maintained Mile running the planned scenarios.
Every operator will be evaluated using at least one newor significantly modified scenario. All other scenarios have been altered in accordance A h Section D.5 ofES-301.
- a.
- 9.
- 10.
- 11.
- 12.
All individual operator competencies can be evaluated, as verikd using Form ES-301-6 (submit the form along with the simulator scenarios).
Each applicant vlill be significantly involved in the minimum number oftransients and events sDecified on Form ES-301-5 (submit the brm with the simulator scenarios).
- 13.
The level of difficulty is appropriate to support licensing decisions br each crew position.
I W!%%/I Tf.
TARGET QUANTITATIVE ATTRIBUTES (PER SCENPRIO; SEE SECTION D.5.d)
I Actual Attributes I -'
I - I -
- 1.
Total malfunctions (5-8)
- 2.
Malfunctions after EOP entry (1-2) 2 I 3 1 3
- 3.
Abnormal events (2-4) 3 I 2 1 2
- 4.
Major transients (1-2)
- 5.
EOPs enteredlrequiring substantive actions (1-2)
- 6.
EOP contingencies requiring substantive actions (0-2) 1 I 1 I 2
- 7.
Critical tasks (2-3) 2 1 4 I 2
W ES-301, Page 25 of 27
ES-301 Transient and Event Checklist Form ES-301-5 RO SRO-I SRO-U RO SRO-I SRO-U RO SRO-I SRO-U RO SRO-I SRO-U lnstructio imerick Date of Exam: 1 /I 0/05 Operating Test Number:
Scenarios
- 1.
Circle the applicant level and enter the operating test number and Itwin ES-D-1 event numbers breach event We; TS are n.ot ap likble for RO applicants. RCh musfserve in both the "a!-thecontrols (AC)" and 'balance-of-plant (BOP)"
positions; fnstant SRCk must do one scenano. including at least tvo instrument or component (IC) malfinctions and one major transient. in the A X wsition.
- 2.
- 3.
Reactivity,man~pulations may be conducted under noyal or controlled abnormal conditions rebr to Section D.5.d) but must be significant per Section C.2.a ofAppendix D.
Reactivityand normal evolutions maybe replaced dth additional instrument or component malhnctions on a I-br-1 basis.
Whenever ractical. both instrument and component malfinctions should be included; onlythose that require verilable actions tharprovide insight to the applicant's competence count towd the minimum requirement.
Author:
NRC Reviewer:
W ES-301, Page 26 of 27 Revision 3
ES-301 Transient and Event Checklist Form ES-301-5 Faci I i ty:
A P
P RO SRO-I SRO-U RO SRO-I SRO-U RO SRO-I SRO-U RO SRO-l SRO-U lnstructioi
- 1.
herick Date of Exam: 1/10/05 Operating Test Number:
Author:
NRC Reviewer:
I
~
1' 1'
4' F 4' F 4' qz 1'
4' ircle the a plicant level and enter the o erating test number and brm ES-D-1 event numbers br each event e' TS are n.ot ap kable b r RO applicants. R& must serve in both the 'at-the-controls (AC)" and "balance-of-plant#b) positrons; Pnstant SRQ must do one scenano. including at least tvo instrument or component (VC) malfinctions and one major transient, in the ASC position.
Reactivity,manipulations may be conducted under n o y a l or controlled abnormal cqnditions rekr to Section D.5.d). but must be significant per Section C.2.a ofAppendix D.
Reactivityand normal evolutions maybe replaced wth additional instrument or component malhnctions on a 1-for-1 basis.
Whenever ractical. both instrument and component malbnctions should be included; onlythose that require verilable actions thafprovide insight to the applicant's competence count towd the minimum requirement.
- 2.
- 3.
ES-301, Page 26 Revision 3
ES-301 Transient and Event Checklist Form ES-301-5 Facility: Limerick Date of Exam: 1/10/05 Operating Test Number: I E
Scenarios V
E N
1 2
3 4
T T 0 T
A L
A P
P L I A
6 Crew Position Crew Position Crew Position Crew Position C
Instructions:
- 1.
Circle the a plicant level and enter the o erating test number and brm ES-D-1 event numbers br each event
. TS are not ap &able for RO applicants. R& must serve in both the 'at-thecontrols (AC)" and 'balance-of-plant?8?&)"
positrons; Pnstant SR(1; must do one scenano. including at least hm instrument or component (IC) malfrnctrons and one major transient, in the AT2 position.
Reactivity manipulations maybe conducted under norpal or controlled abnormal cqnditions rebr to Section D.5.d). but must be signifcant per Section C.2.a ofAppendix D.
Reacbvilyand normal evolutrons maybe replaced wth additronal instrument or component malbnctions on a I-for-1 basis.
Whenever ractiFl,.bo$ instrument and component malbnctions should be jnduded; onlythose that require veriiable actions tharprovide insight to the applicant's competence count towd the minimum requirement.
- 2.
- 3.
Author:
NRC Reviewer:
ES-301, Page 26 of 27 Revision 3
ES-301 ComDetencies Checklist Form ES-301-6 Facility:
Limerick Date ofExamination: 1/10/05 Operating Est No.: t Competencies (ROISRO-VSRO-u I(RO')SRO-I/SRO-U ~SRO-IISRO-u ~ S R O - V S R O - u I
APPLICANTS -
SCENARIO 3
2 -
3 2 -
3 1
2.3, 4
ATC -
3,4, 5
1.2, 4.5 1.2, 3.4, 5.6 In terpretl Diagnose Events and Conditions Comply With 3.4.
1-4, 3.4, and Use s a 5
5,6, 5 Procedures( I)
Operate I
Communicate 1,2, 1 2, 1.2, 3,4, 3,4, 3.4, 56, 5 5 and Interact 5,6 Demonstrate Supervisory Ability (3)
Comply With and Use Tech Specs. (3)
Notes:
(1) Includes Technical Specification compliance for an RO.
(2) Optional for an SRO-U.
(3) Only applicable to SROs.
Instructions:
Circle the applicant's license type and enter one or nvre event numbers that will allow the examiners to evaluate every applicable conpetency for every applicant.
Author:
NRC Reviewer:
ES-301, Page 27 of 27 Revision 1
Competencies APPLIi RO/SRO-l[SRO-L.)
RO/SRO-I S C E N A R ~ SCENAW ES-301 Competencies Checklist Form ES-301-6 Facilitv:
Limerick Date ofExamination: 1 /I 0/05 Operating Bst No.: I 2
2 3
Interpret/
Diagnose Events and Conditions Comply With and Use Procedures(1 )
Operate Control Boards (2)
Communicate and Interact Supervisory Ability (3)
Comply With and Use Tech Specs. (3)
Notes:
(1) Includes Technical Specification compliance for an RO.
(2) Optional for an SRO-U.
(3) Onlv aDDlicable to SROs.
Instructions:
Circle the applicant's license type and enter one or m r e event numbers that will allow the examiners to evaluate every applicable conpetency for every applicant.
Author:
NRC Reviewer:
ES-301, Page 27 of 27 Revision 1
ES-301 Comaetencies Checklist Form ES-301-6 RO@RO-]SRO-U RO(SRO-~RO-U S m A R I O S ~ A R I O Facilitv:
Limerick Date ofExamination: 1 /I 0/05 Operatinn Bst No.: I RO(SRO-$RO-U S ~ N A R I O Competencies Interpret/
Diagnose Events and Conditions Comply With and Use Procedures(1)
Operate Control Boards (2)
Communicate and Interact Demonstrate Supervisory Ability (3)
Comply With and Use Tech Specs. (3)
Notes:
(1) Includes Technical Specification compliance for an RO.
(2) Optional for an SRO-U.
(3) Onlv aDDlicable to SROs.
2 RO/SRO-VSRO-U SCENARIO 3
Instructions:
Circle the applicant's license type and enter one or m r e event numbers that w'll allow the examiners to evalua Author:
NRC Reviewer:
able conpetency for every applicant.
ES-301, Page 27 of 27 Revision 1
- 6.
Bank use meets limits (no more than 75 percent foni the bank, at least 10 percent new and the rest newor modified); enter the actual RO/ SRO-only question distribution(s) at right ES-401 Written Examination Quality Checklist Form ES-401-6 Facility Limerick Date of Exam: 1/10/05 Exam Level: RCYSRO Initial New Bank Modified 0 / 0 0 / 0 7 5 / 2 5 Item Description a
- 1.
- 2.
Questions and answrs are technically accurate and applicable to the Bcility
- a. NRC WAS are rebrenced for all questions
- b. Facility learning objectives are referenced as available
- 7.
Between 50 and 60 percent of the questions on the RO exam are witten at the comprehension /analyis level; the SRO exam may exceed 60 percent if the randomly selected KAs support the higher cognitive levels; enter the actual ROI SROquestion distribution(s) at right I ?J CIA 30 I 5 45 I 20 II 3.
SRO questions are appropriate in accordance wth Section D.2.d of ES-401 I (!?A If more than bur RO and two SRO questions are repeated tom the last bo NRC licensing exam, the facility licensee's sampling process w s random and systematic.
IO.
- 11.
Question psyAometric qualityand format meet the guidelines in ES, AppendixB.
The exam contains the required number ofone-point. multiple choice items; the total is correct and agrees 14th value on cover sheet Printed Name / Signature I
Date
- a. Author
- b. Facility Reviewer (')
- c. NRC Chief Examiner (#)
- d. NRC Regional Supervisor I -
I I
Note:
- The facility reviewer's initialslsignature are not applicable br NRC-devuped examinations.
- Independent NRC reviewr initial items in Column "c;" chiefexaminer concurrence required.
ll 1/13 /a-
ES-403 Written Examination Grading Form ES-403-1 Item Description
- 1.
Clean answer sheets copied before grading Quality Checklist a
b F
ak.4
@,@+
- Facility: L 65 Date of Exam: j / 2 i / 0 s Exam Level: RO/SRO I
- 2.
Answer key changes and question deletions justified e-9
- 4.
Grading for all borderline cases (80 k2% overall and 70 or 80, as applicable, +4% on the SRO-only) reviewed in detail
- 3.
Applicants' scores checked for addition errors (reviewers spot check > 25% of examinations) e@.
<f
- 5.
All other failing examinations checked to ensure that grades are justified
- 6.
Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed Name/Signature Date
- a. Grader hqg-
- b. Facility Reviewer(*)
- c. NRC Chief Examiner (*)
(*)
The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.
ES-403, Page 5 of 5