ML082970764: Difference between revisions
Jump to navigation
Jump to search
StriderTol (talk | contribs) (Created page by program invented by StriderTol) |
StriderTol (talk | contribs) (StriderTol Bot change) |
||
| (2 intermediate revisions by the same user not shown) | |||
| Line 20: | Line 20: | ||
=Text= | =Text= | ||
{{#Wiki_filter:ES-201 Examination Preparation Checklist Form ES-201-1 Facility: | {{#Wiki_filter:ES-201 Examination Preparation Checklist Form ES-201-1 Facility: 59La - Date of Examination: FhFhm Examinations Developed by: I N R C (circle one) | ||
59La - Date of Examination: | Target Date* Task Description (Reference) | ||
FhFhm Examinations Developed by: I | -180 1. Examination administration dat | ||
-120 2. NRC examiners and facility cor -120 3. Facility contact briefed on secu -120 4. Corporate notification letter ser [-go] [5. Reference material due (C.l .e; 6. | -120 2. NRC examiners and facility cor | ||
-120 3. Facility contact briefed on secu | |||
-7 14. Final applications reviewed; 1 or 2 (if >IO) applications audited to confirm qualifications | -120 4. Corporate notification letter ser | ||
/ eligibility; and examination approval and waiver letters sent (C.2.i; Attachment 4; ES-202, C.2.e; ES-204) 15. Proctoring/written exam adminis tration guidelines reviewed | [-go] [5. Reference material due (C.l .e; | ||
: 6. Integratedexamination outline(s)due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-5, ES-D-l's, ES-401-1/2, ES-401-3, and ES-401-4, as applicable (C.l .e and f; C.3.d) | |||
-7 16. Approved scenarios, job performance measures, and questions distributed to NRC examiners (C.3.i) | {7. Examination outline(s) reviewed by NRC and feedback provided to facility licensee (C.2.h; C.3.e)) | ||
* Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. | (-45) 8. Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6), and reference materials due (C.l.e, f, g and h; C.3.d) | ||
They are for planning purposes and may be adjusted on a case-by- case basis in coordination with the facility licensee. [Applies only] {Does not apply} to examinations prerlared by the NRC. ES-201, Page 24 of 27 ES-201 Examination Outline Quality Checklist Form ES-201 Facility: | : 9. Preliminary license applications (NRC Form 398's) due (C.l .I; C.2.g; | ||
5, LW Date of Examination: | : 10. Final license applications due and Form ES-201-4 prepared (C.1.l; C.2.i; ES-202) | ||
8 aa g I Itern Task 1 a Verify that the outlme(s) fit(s) the appropria w R b Assess whether the outline was systematic I Section D 1 of ES-401 and whether all | -14 I 11. Examination approved by NRC supervisor for facility licensee review (C.2.h; C.3.f) | ||
: 12. Examinations reviewed with facility licensee (C.l .j; C.2.f and h; C.3.g) | |||
(*) #. NRC Supervisor lote: # Independent NRC reviewer initial items in Co lumn "c"; chief examiner concurrence required. | : 13. Written examinations and operating tests approved by NRC supervisor (C.2.i; C.3.h) | ||
* Not applicable for NRC-prepared examination outlines ES-:201, Page 26 of 28 ES-201 Examination Security Agreement Form ES-201-3 1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of | -7 14. Final applications reviewed; 1 or 2 (if >IO) applications audited to confirm qualifications / eligibility; and examination approval and waiver letters sent (C.2.i; Attachment 4; ES-202, C.2.e; ES-204) | ||
I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations andfor an enforcement action against me or the facility licensee. | -7 I 15. Proctoring/written exam adminis tration guidelines reviewed with facility licensee (C.3.k) | ||
I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised. | -7 16. Approved scenarios, job performance measures, and questions distributed to NRC examiners (C.3.i) | ||
: 2. Post-Examination TO the best of my know edge, I id not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered | * Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee. | ||
I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. | [Applies only] {Does not apply} to examinations prerlared by the NRC. | ||
I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations andlor an enforcement action against me or the facility licensee. | ES-201, Page 24 of 27 | ||
I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examinatirn security may have been compromised. | |||
ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility: 5, LW | |||
: 2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specificaly noted below and authorized by the NRC. | - Date of Examination: 8 aa g I | ||
PRINTED NAME 44 '3 ES-301 Operating | Itern Task 1 a Verify that the outlme(s) fit(s) the appropria w | ||
* references and tools including associated pi ocedures reasonable and validatec time limits (average ti me zllowed for compietioni and soecific oesignaiion if deemeo to be time-c ritical b) the faciliiy licensee operationally imoortant specific performance criteria that include | R b Assess whether the outline was systematic I Section D 1 of ES-401 and whether all W A T | ||
c Assess whether the outline over-emphasize E | |||
N d. Assess whether the justifications for deselei | |||
are realislit iri !ha some equianleill | : 2. a. Using Form ES-301-5, verify that the propc of normal evolutions, instrument and corn S and major transients. | ||
* the syrnplomsicues tha will be vrstblt 10 the cren !ne expecled operalo' acli ons Ibt shif' positioni | I M b. Assess whether there are enough scenario U and mix of applicants in accordance with th L without compromising exam integrity, and t. | ||
* tne event terrntnal~ | A at least one new or significantly rnodifi ed s T from the applicants' audit test(s), and that - | ||
fatlure (e g wttnoui c7 credible preceding lnct den suck as E setsmi: ev The event? are valtcl wttr reaarri IC phvslcs | 0 c. To the extent possible, assess whether t ht R and quantitative criteria specified on Form mits specified on the form I. Author I. Facility Reviewer (*) | ||
#. NRC Supervisor lote: # Independent NRC reviewer initial items in Co lumn "c"; chief examiner concurrence required. | |||
ROs must serve in both the | * Not applicable for NRC-prepared examination outlines ES-:201, Page 26 of 28 | ||
Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component ( | |||
Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1 -for-I basis. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the | ES-201 Examination Security Agreement Form ES-201-3 | ||
ES301 Page 26 of 27 | : 1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of g b ( 6 as of the date of my Signature I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations andfor an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised. | ||
: 2. Post-Examination during the week(s) of$ | |||
5 la uv\ Date of Exam: 9 8 ExamLevel. Item Descriptioii | w TO the best of my know edge, I id not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered instruct, evaluate, or provide below and authorized by the NRC. | ||
: 1. | From the date that I entered into this security agreement until the completion of examination administration, I did not rformance feedback to those applicants who were administered these licensing examinations, except as specifically noted PRINTED NAME JOB TITLE I RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE ES-201, Page 27 of 28 U | ||
: | |||
SRO questions are appropriate in accordance wiih Section D.2.d of ES-401 The sampling process was random and systemat ic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR OL program office). Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item that applies) and appears appropriate: - the audit exam was | ES-201 Examination Security Agreement Form ES-201-3 | ||
: 1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of Q k h as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations andlor an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examinatirn security may have been compromised. | |||
: 6. Bank use meets limits (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO | : 2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specificaly noted below and authorized by the NRC. | ||
PRINTED NAME 44 | |||
(+) : NRC Chief Examiner | '3 | ||
(#) I NRC Regional Supervisor Jote: | |||
* The facility | ES-301 Operating T e s t Quality Checklist Form ES-301-3 | ||
# Independent NRC reviewer initial items in Column | : 1. General Cnterla a b' c# | ||
ES-401, Page 29 of 33 ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: | a The operating test conlorms with the previ ously a sampling reouirements i e g 10 CFP 55 45 oper, b There is no day-to-dav repetition between this an during this examination C The operating test shall not duplicate items from th d Overlap with the writteri examination and betweer acceotable limits e It appears that the operating test will differ entiate applicants at the designated license level 2 Walk-Through I | ||
Sa (err\ Date of Exam: 4 8 Exam Level: | a Each JPM includes the following, as applicable initial conditions initiating cues | ||
RO E Item Description 1 Questions and answers are technically accurate i 2. a. NRC WAS are referenced for all quesOo b Facility learning objectives are referenc 3 SRO questions are appropriate in accordance wit1 4 The sampling process was random and systemat were repeated from the last 2 NRC licensing ex ar 5. Question duplication from the | * references and tools including associated pi ocedures | ||
>e licensee certifies that there is no duplication; or | * reasonable and validatec time limits (average ti me zllowed for compietioni and soecific | ||
Between 50 and 60 percent of the questions on the RO exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly selected WAS support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at | - oesignaiion if deemeo to be time-c ritical b) the faciliiy licensee operationally imoortant specific performance criteria that include | ||
- detailed exDected actions with exac! cr teria and nomenclature | |||
(#) j NRC Regional Supelvisor | - system response and other examiner cues | ||
\iote: | - statements describing important obsenations to be made by the ,3pplicant | ||
* The facility | - criteria for successful completion of the task | ||
# Independent NRC reviewer initial items in Colurrtn | - identification of critical steps and their .issociated performance standards | ||
ES-401, 13age 29 of 33 ES-403 Written Examination Grading Form ES-403-1 Qualiity Checklist Facility: | - restrictions on the sequence of steps i i apolicade i b Ensure that any changes from the previous ly apprc ved systems and aclminisvativewalk-through I outlines (Forms ES-301-1 and 2) have not caused the te st to deviate from any of the acceptance criteria (e g item distribution bank use repet itio ifrom the last 2 NRC examinations) specified on those forms and Form ES-201-2 The associated simulator operatins tests (scenar io SetSJhade been reviewed in accordance with Y | ||
Printed tdame / Signature Date a Author J | |||
R | b Facility Reviewer(') s h n &v Rc!! | ||
: 1. Clean answer sheets copied before fl P- 2. | c NRC Chief Examiner (if)e)c, u&%@ | ||
> 25% of exa Grading for all borderline cases (80 as applicable, +4% on the SRO-onl! | d NRCSupervisor NOTE | ||
All other failing examinations check1 are justified Performance on missed questions checked for training deficiencies and wording problems; of questions missed by half or more | * The facility signature IS not apdicable for NFC-developed tests | ||
: c. NRC Chief Examiner | # IndeDendent NRC reviewer initial items in Cclumn c chief examiner concurrence required ES-301, Page 24 of 27 | ||
(*) d. NRC Supervisor | |||
(*) S-G*,P/ /6/63h (*) The facility | ES-301 SI mu 1 a tor S c e n a ri o Quality C h e c k 11s t Form ES-301-4 QUALITATIVE ATTRIBUTES 1 T t l t tniiial condition:. are realislit iri !ha some equianleill z n n servtct bul 11 doec nul LUF. the opEralOr5 tncc erpecrrn r' 2 Tnc szenarlos consis' niosth of related events Each event descrrptton consis& of 3 | ||
- t n E poinl irt the scenaric, wherl It 15 to be inilialed the rnalfuncttonis) lhal are eniered IC rnltiate the even | |||
* the syrnplomsicues tha will be vrstblt 10 the cren | |||
!ne expecled operalo' acli ons Ibt shif' positioni | |||
* tne event terrntnal~onmini /I' applicablei 4 IJo more than one non-mechanisttc.fatlure ( e g pipe break.) is rncorporaled I n l G the ScenanO wttnoui c7 credible preceding lnct den suck as E setsmi: ev 5 The event? are valtcl wttr reaarri IC phvslcs a n d lhermodyr E Sequencing ann timing 0 1 eventi is reasonable ana allu comDl?le evalualtor resuits cummensuratr wrt- toe scerti Goerators have sutiicien' timF tc carry ou: exper red actiwtie Tne szenanoc have h e e i ~vaiioared Pursuant ti I[, C i F 5E 46ic, anv oper SimUlabr penxmance aeticieniies G' oeviauons i. orr the refer 15 mr- inlainec wnilt- runr I: ensare l n a I U ' I ~ [ I C ~ ~ BIIOE!~! | |||
Ai'otnc- szenarios have Deer, altered ir acsoraanct wit1 ES-301, Page 25 of 27 | |||
ES-301, Rev. 9, Supp. 1 Transient and Event Checklist Form ES-301-5 | |||
-acility: Salem Generating Station Date of Etam: 08/25/2008 Operating Test No.: 07-01 NRC Scenarios ESG-5 (Spare- not M included in TOTAL) I N | |||
POSITION I M | |||
U M(*) | |||
istructions: | |||
Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions: Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component ( I K ) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position. | |||
Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-I basis. | |||
Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns. | |||
ES301 Page 26 of 27 | |||
ES-301 Competencies C hecklist Form ES-307-6 Date of Examination Operating Test No : | |||
C l :2 1 RO SRO-I SRO-U Z | |||
Z 1 FZO 5RO-I 5RO-Ll - | |||
1 SRO-I SRO-U KO Lli SRO-I SRO-U ' | |||
RO I | |||
Competencies InterpreifDiagnose | |||
)omply With a n d I p x a t e Control | |||
:ommunicate tnd Interact | |||
)em0n stra te 1 lnclcldes Technica Specification compliance for an RO illc4cJs SlLOtl 4 C/Lc 5 | |||
? Optional for an SRO-U 5Jic-42 S=cf 3 Onl\ appiicable to SROs zC7 I pmt CtJeci the applicants iicense fype and ente, one more evenf numbers tha' 01 Wlj' a/lOfl' the examiners to evaiuate ever} applicable corn9efen;y fo; every applicant ES-301, Page 27 of 27 | |||
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: 5 la uv\ Date of Exam: 9 8 ExamLevel. | |||
Initial Item Descriptioii | |||
: 1. Questions and answers are technically accurate and applicable to the facility. | |||
: 2. a. NRC WAS are referenced for all questions. | |||
: b. Facility learning objectives are referenlzd as available. | |||
: 3. SRO questions are appropriate in accordance wiih Section D.2.d of ES-401 | |||
: 4. The sampling process was random and systemat ic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR OL program office). | |||
: 5. Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item that applies) and appears appropriate: | |||
-the audit exam was systematicallyand randomly developed; or | |||
-the audit exam was completed before the licerise exam was started; or the examinations were developed independently; or z h e licensee certifies that there is no duplication; or | |||
: 6. Bank use meets limits (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO ISRO-only question distribution(s) at right. $ | |||
4 | |||
!! 137% 5 7 % > if?- 3q | |||
: 7. Between 50 and 60 percent of the questions on the RO Memory CIA exam are written at the comprehension1analysis level; . | |||
the SRO exam may exceed 60 percent if the randmly selected WAS support the higher cognitive levels; enter the actual RO ISRO question distribution(s) at right. | |||
35 I 47% 40 I f;sz | |||
: 5. Referencedhandouts provided do not give away answers or aid in the elimination of distractors. | |||
: 3. Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are justified. | |||
v-IO. Question psychometric quality and format meet the guidelines in ES Appendix B. | |||
: 11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on thc cover sheet. | |||
?a-Printed Name ISignatare , A I Author | |||
) Facility Reviewer (+) | |||
: NRC Chief Examiner (#) | |||
I NRC Regional Supervisor Jote: | |||
* The facility reviewers initialdsignat ure are not applicable for NRC-developed examinations. | |||
# Independent NRC reviewer initial items in Column c; chief examiner concurrence required. | |||
ES-401, Page 29 of 33 | |||
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: Sa (err\ Date of Exam: 4 8 Exam Level: RO E Item Description 1 Questions and answers are technically accurate i | |||
: 2. a. NRC WAS are referenced for all quesOo b Facility learning objectives are referenc 3 SRO questions are appropriate in accordance wit1 4 The sampling process was random and systemat were repeated from the last 2 NRC licensing ex ar | |||
: 5. Question duplication from the k e n s e screeninglaudit exam was controlled as indicated below (check the item that applies) arid appears appropriate: | |||
-the audit exam was systematically and randomly developed; or | |||
-the audit exam was completed before the license exam was started; or the examinations were developed independenily; or | |||
>e licensee certifies that there is no duplication; or | |||
: 6. Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only question distribution(s) at right. | |||
: 7. Between 50 and 60 percent of the questions on the RO exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly selected WAS support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at rigit. | |||
: a. Referenceshandouts Drovided do not aive awav answers or aid in the elimination of distractors. | |||
: 9. Question content conforms with specific KIA state1 examination outline and is appropriate for the deviations are justified. | |||
: 10. Question psychometric quality and format meet th, | |||
: 11. The exam contains the required number of one-pc the total is correct and agrees with the value on thc 3 Author I Facility Reviewer r) | |||
: NRC Chief Examiner (#) | |||
j NRC Regional Supelvisor k e | |||
\iote: | |||
* The facility reviewers initialskignat ure are not applicable for NRC-developed examinations. | |||
# Independent NRC reviewer initial items in Colurrtn c; chief examiner concurrence required. | |||
ES-401, 13age 29 of 33 | |||
ES-403 Written Examination Grading Form ES-403-1 Qualiity Checklist Facility: L | |||
& (9 Date of Exam Q (4/a Exam Level: R S R d I | |||
Initials Item Description | |||
: 1. Clean answer sheets copied before fl P- | |||
: 2. Answer key changes and question deletions justified and documented | |||
: 3. Applicants scores checked for addi (reviewers spot check > 25% of exa | |||
: 4. Grading for all borderline cases (80 as applicable, +4% on the SRO-onl! | |||
: 5. All other failing examinations check1 are justified | |||
: 6. Performance on missed questions checked for training deficiencies and wording problems; of questions missed by half or more Printed NameKignature Date | |||
: a. Grader | |||
: b. Facility Reviewer(*) | |||
: c. NRC Chief Examiner (*) | |||
: d. NRC Supervisor (*) S-G*,P/ /6/63h | |||
(*) The facility reviewers signature is noi applicable for examinations graded by the NRC; two independent NRC reviews are rlsquired. | |||
ES-403, Page 6 of 6}} | |||
Latest revision as of 20:17, 12 March 2020
| ML082970764 | |
| Person / Time | |
|---|---|
| Site: | Salem  |
| Issue date: | 08/25/2008 |
| From: | Division of Reactor Safety I |
| To: | |
| Hansell S | |
| Shared Package | |
| ML080030005 | List: |
| References | |
| TAC U01686 2008-301 | |
| Download: ML082970764 (11) | |
Text
ES-201 Examination Preparation Checklist Form ES-201-1 Facility: 59La - Date of Examination: FhFhm Examinations Developed by: I N R C (circle one)
Target Date* Task Description (Reference)
-180 1. Examination administration dat
-120 2. NRC examiners and facility cor
-120 3. Facility contact briefed on secu
-120 4. Corporate notification letter ser
[-go] [5. Reference material due (C.l .e;
- 6. Integratedexamination outline(s)due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-5, ES-D-l's, ES-401-1/2, ES-401-3, and ES-401-4, as applicable (C.l .e and f; C.3.d)
{7. Examination outline(s) reviewed by NRC and feedback provided to facility licensee (C.2.h; C.3.e))
(-45) 8. Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6), and reference materials due (C.l.e, f, g and h; C.3.d)
- 9. Preliminary license applications (NRC Form 398's) due (C.l .I; C.2.g;
-14 I 11. Examination approved by NRC supervisor for facility licensee review (C.2.h; C.3.f)
- 12. Examinations reviewed with facility licensee (C.l .j; C.2.f and h; C.3.g)
- 13. Written examinations and operating tests approved by NRC supervisor (C.2.i; C.3.h)
-7 14. Final applications reviewed; 1 or 2 (if >IO) applications audited to confirm qualifications / eligibility; and examination approval and waiver letters sent (C.2.i; Attachment 4; ES-202, C.2.e; ES-204)
-7 I 15. Proctoring/written exam adminis tration guidelines reviewed with facility licensee (C.3.k)
-7 16. Approved scenarios, job performance measures, and questions distributed to NRC examiners (C.3.i)
- Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.
[Applies only] {Does not apply} to examinations prerlared by the NRC.
ES-201, Page 24 of 27
ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility: 5, LW
- Date of Examination: 8 aa g I
Itern Task 1 a Verify that the outlme(s) fit(s) the appropria w
R b Assess whether the outline was systematic I Section D 1 of ES-401 and whether all W A T
c Assess whether the outline over-emphasize E
N d. Assess whether the justifications for deselei
- 2. a. Using Form ES-301-5, verify that the propc of normal evolutions, instrument and corn S and major transients.
I M b. Assess whether there are enough scenario U and mix of applicants in accordance with th L without compromising exam integrity, and t.
A at least one new or significantly rnodifi ed s T from the applicants' audit test(s), and that -
0 c. To the extent possible, assess whether t ht R and quantitative criteria specified on Form mits specified on the form I. Author I. Facility Reviewer (*)
- . NRC Supervisor lote: # Independent NRC reviewer initial items in Co lumn "c"; chief examiner concurrence required.
- Not applicable for NRC-prepared examination outlines ES-:201, Page 26 of 28
ES-201 Examination Security Agreement Form ES-201-3
- 1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of g b ( 6 as of the date of my Signature I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations andfor an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
- 2. Post-Examination during the week(s) of$
w TO the best of my know edge, I id not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered instruct, evaluate, or provide below and authorized by the NRC.
From the date that I entered into this security agreement until the completion of examination administration, I did not rformance feedback to those applicants who were administered these licensing examinations, except as specifically noted PRINTED NAME JOB TITLE I RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE ES-201, Page 27 of 28 U
ES-201 Examination Security Agreement Form ES-201-3
- 1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of Q k h as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations andlor an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examinatirn security may have been compromised.
- 2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specificaly noted below and authorized by the NRC.
PRINTED NAME 44
'3
ES-301 Operating T e s t Quality Checklist Form ES-301-3
- 1. General Cnterla a b' c#
a The operating test conlorms with the previ ously a sampling reouirements i e g 10 CFP 55 45 oper, b There is no day-to-dav repetition between this an during this examination C The operating test shall not duplicate items from th d Overlap with the writteri examination and betweer acceotable limits e It appears that the operating test will differ entiate applicants at the designated license level 2 Walk-Through I
a Each JPM includes the following, as applicable initial conditions initiating cues
- references and tools including associated pi ocedures
- reasonable and validatec time limits (average ti me zllowed for compietioni and soecific
- oesignaiion if deemeo to be time-c ritical b) the faciliiy licensee operationally imoortant specific performance criteria that include
- detailed exDected actions with exac! cr teria and nomenclature
- system response and other examiner cues
- statements describing important obsenations to be made by the ,3pplicant
- criteria for successful completion of the task
- identification of critical steps and their .issociated performance standards
- restrictions on the sequence of steps i i apolicade i b Ensure that any changes from the previous ly apprc ved systems and aclminisvativewalk-through I outlines (Forms ES-301-1 and 2) have not caused the te st to deviate from any of the acceptance criteria (e g item distribution bank use repet itio ifrom the last 2 NRC examinations) specified on those forms and Form ES-201-2 The associated simulator operatins tests (scenar io SetSJhade been reviewed in accordance with Y
Printed tdame / Signature Date a Author J
b Facility Reviewer(') s h n &v Rc!!
c NRC Chief Examiner (if)e)c, u&%@
d NRCSupervisor NOTE
- The facility signature IS not apdicable for NFC-developed tests
- IndeDendent NRC reviewer initial items in Cclumn c chief examiner concurrence required ES-301, Page 24 of 27
ES-301 SI mu 1 a tor S c e n a ri o Quality C h e c k 11s t Form ES-301-4 QUALITATIVE ATTRIBUTES 1 T t l t tniiial condition:. are realislit iri !ha some equianleill z n n servtct bul 11 doec nul LUF. the opEralOr5 tncc erpecrrn r' 2 Tnc szenarlos consis' niosth of related events Each event descrrptton consis& of 3
- t n E poinl irt the scenaric, wherl It 15 to be inilialed the rnalfuncttonis) lhal are eniered IC rnltiate the even
- the syrnplomsicues tha will be vrstblt 10 the cren
!ne expecled operalo' acli ons Ibt shif' positioni
- tne event terrntnal~onmini /I' applicablei 4 IJo more than one non-mechanisttc.fatlure ( e g pipe break.) is rncorporaled I n l G the ScenanO wttnoui c7 credible preceding lnct den suck as E setsmi: ev 5 The event? are valtcl wttr reaarri IC phvslcs a n d lhermodyr E Sequencing ann timing 0 1 eventi is reasonable ana allu comDl?le evalualtor resuits cummensuratr wrt- toe scerti Goerators have sutiicien' timF tc carry ou: exper red actiwtie Tne szenanoc have h e e i ~vaiioared Pursuant ti I[, C i F 5E 46ic, anv oper SimUlabr penxmance aeticieniies G' oeviauons i. orr the refer 15 mr- inlainec wnilt- runr I: ensare l n a I U ' I ~ [ I C ~ ~ BIIOE!~!
Ai'otnc- szenarios have Deer, altered ir acsoraanct wit1 ES-301, Page 25 of 27
ES-301, Rev. 9, Supp. 1 Transient and Event Checklist Form ES-301-5
-acility: Salem Generating Station Date of Etam: 08/25/2008 Operating Test No.: 07-01 NRC Scenarios ESG-5 (Spare- not M included in TOTAL) I N
POSITION I M
U M(*)
istructions:
Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions: Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component ( I K ) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-I basis.
Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.
ES301 Page 26 of 27
ES-301 Competencies C hecklist Form ES-307-6 Date of Examination Operating Test No :
C l :2 1 RO SRO-I SRO-U Z
Z 1 FZO 5RO-I 5RO-Ll -
1 SRO-I SRO-U KO Lli SRO-I SRO-U '
RO I
Competencies InterpreifDiagnose
)omply With a n d I p x a t e Control
- ommunicate tnd Interact
)em0n stra te 1 lnclcldes Technica Specification compliance for an RO illc4cJs SlLOtl 4 C/Lc 5
? Optional for an SRO-U 5Jic-42 S=cf 3 Onl\ appiicable to SROs zC7 I pmt CtJeci the applicants iicense fype and ente, one more evenf numbers tha' 01 Wlj' a/lOfl' the examiners to evaiuate ever} applicable corn9efen;y fo; every applicant ES-301, Page 27 of 27
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: 5 la uv\ Date of Exam: 9 8 ExamLevel.
Initial Item Descriptioii
- 1. Questions and answers are technically accurate and applicable to the facility.
- 2. a. NRC WAS are referenced for all questions.
- b. Facility learning objectives are referenlzd as available.
- 4. The sampling process was random and systemat ic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR OL program office).
- 5. Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item that applies) and appears appropriate:
-the audit exam was systematicallyand randomly developed; or
-the audit exam was completed before the licerise exam was started; or the examinations were developed independently; or z h e licensee certifies that there is no duplication; or
- 6. Bank use meets limits (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO ISRO-only question distribution(s) at right. $
4
!! 137% 5 7 % > if?- 3q
- 7. Between 50 and 60 percent of the questions on the RO Memory CIA exam are written at the comprehension1analysis level; .
the SRO exam may exceed 60 percent if the randmly selected WAS support the higher cognitive levels; enter the actual RO ISRO question distribution(s) at right.
35 I 47% 40 I f;sz
- 5. Referencedhandouts provided do not give away answers or aid in the elimination of distractors.
- 3. Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are justified.
v-IO. Question psychometric quality and format meet the guidelines in ES Appendix B.
- 11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on thc cover sheet.
?a-Printed Name ISignatare , A I Author
) Facility Reviewer (+)
- NRC Chief Examiner (#)
I NRC Regional Supervisor Jote:
- The facility reviewers initialdsignat ure are not applicable for NRC-developed examinations.
- Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
ES-401, Page 29 of 33
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: Sa (err\ Date of Exam: 4 8 Exam Level: RO E Item Description 1 Questions and answers are technically accurate i
- 2. a. NRC WAS are referenced for all quesOo b Facility learning objectives are referenc 3 SRO questions are appropriate in accordance wit1 4 The sampling process was random and systemat were repeated from the last 2 NRC licensing ex ar
- 5. Question duplication from the k e n s e screeninglaudit exam was controlled as indicated below (check the item that applies) arid appears appropriate:
-the audit exam was systematically and randomly developed; or
-the audit exam was completed before the license exam was started; or the examinations were developed independenily; or
>e licensee certifies that there is no duplication; or
- 6. Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only question distribution(s) at right.
- 7. Between 50 and 60 percent of the questions on the RO exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly selected WAS support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at rigit.
- a. Referenceshandouts Drovided do not aive awav answers or aid in the elimination of distractors.
- 9. Question content conforms with specific KIA state1 examination outline and is appropriate for the deviations are justified.
- 10. Question psychometric quality and format meet th,
- 11. The exam contains the required number of one-pc the total is correct and agrees with the value on thc 3 Author I Facility Reviewer r)
- NRC Chief Examiner (#)
j NRC Regional Supelvisor k e
\iote:
- The facility reviewers initialskignat ure are not applicable for NRC-developed examinations.
- Independent NRC reviewer initial items in Colurrtn c; chief examiner concurrence required.
ES-401, 13age 29 of 33
ES-403 Written Examination Grading Form ES-403-1 Qualiity Checklist Facility: L
& (9 Date of Exam Q (4/a Exam Level: R S R d I
Initials Item Description
- 1. Clean answer sheets copied before fl P-
- 2. Answer key changes and question deletions justified and documented
- 3. Applicants scores checked for addi (reviewers spot check > 25% of exa
- 4. Grading for all borderline cases (80 as applicable, +4% on the SRO-onl!
- 5. All other failing examinations check1 are justified
- 6. Performance on missed questions checked for training deficiencies and wording problems; of questions missed by half or more Printed NameKignature Date
- a. Grader
- b. Facility Reviewer(*)
- c. NRC Chief Examiner (*)
- d. NRC Supervisor (*) S-G*,P/ /6/63h
(*) The facility reviewers signature is noi applicable for examinations graded by the NRC; two independent NRC reviews are rlsquired.
ES-403, Page 6 of 6