ML082970764

From kanterella
Revision as of 08:59, 20 September 2018 by StriderTol (talk | contribs) (Created page by program invented by StriderTol)
Jump to navigation Jump to search
Final Qa/Related Operator Licensing Exam Forms, Salem Units 1&2 (Folder 1)
ML082970764
Person / Time
Site: Salem  PSEG icon.png
Issue date: 08/25/2008
From:
Division of Reactor Safety I
To:
Hansell S
Shared Package
ML080030005 List:
References
TAC U01686 2008-301
Download: ML082970764 (11)
v • d • e


Text

ES-201 Examination Preparation Checklist Form ES-201-1 Facility:

59La - Date of Examination:

FhFhm Examinations Developed by: I NRC (circle one) Target Date* Task Description (Reference) -180 1. Examination administration dat

-120 2. NRC examiners and facility cor -120 3. Facility contact briefed on secu -120 4. Corporate notification letter ser [-go] [5. Reference material due (C.l .e; 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-5, ES-D-l's, ES-401-1/2, ES-401-3, and ES-401-4, as applicable (C.l .e and f; C.3.d) Examination outline(s) reviewed by NRC and feedback provided to facility licensee (C.2.h; C.3.e))

{7. (-45) 8. Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6), and reference materials due (C.l.e, f, g and h; C.3.d) 9. Preliminary license applications (NRC Form 398's) due (C.l .I; C.2.g; 10. Final license applications due and Form ES-201-4 prepared (C.1.l; C.2.i; ES-202) -14 I 11. Examination approved by NRC supervisor for facility licensee review (C.2.h; C.3.f) 12. Examinations reviewed with facility licensee (C.l .j; C.2.f and h; C.3.g) 13. Written examinations and operating tests approved by NRC supervisor (C.2.i; C.3.h)

-7 14. Final applications reviewed; 1 or 2 (if >IO) applications audited to confirm qualifications

/ eligibility; and examination approval and waiver letters sent (C.2.i; Attachment 4; ES-202, C.2.e; ES-204) 15. Proctoring/written exam adminis tration guidelines reviewed

-7 I with facility licensee (C.3.k)

-7 16. Approved scenarios, job performance measures, and questions distributed to NRC examiners (C.3.i) -

  • Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter.

They are for planning purposes and may be adjusted on a case-by- case basis in coordination with the facility licensee. [Applies only] {Does not apply} to examinations prerlared by the NRC. ES-201, Page 24 of 27 ES-201 Examination Outline Quality Checklist Form ES-201 Facility:

5, LW Date of Examination:

8 aa g I Itern Task 1 a Verify that the outlme(s) fit(s) the appropria w R b Assess whether the outline was systematic I Section D 1 of ES-401 and whether all WA T c Assess whether the outline over-emphasize E N 2. S I M U L A T 0 R - d. Assess whether the justifications for deselei a. Using Form ES-301-5, verify that the propc of normal evolutions, instrument and corn and major transients.

b. Assess whether there are enough scenario and mix of applicants in accordance with th without compromising exam integrity, and t. at least one new or significantly rnodifi ed s from the applicants' audit test(s), and that - c. To the extent possible, assess whether t ht and quantitative criteria specified on Form mits specified on the form I. Author I. Facility Reviewer

(*) #. NRC Supervisor lote: # Independent NRC reviewer initial items in Co lumn "c"; chief examiner concurrence required.

  • Not applicable for NRC-prepared examination outlines ES-:201, Page 26 of 28 ES-201 Examination Security Agreement Form ES-201-3 1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of gb(6 as of the date of my Signature I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner.

I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations andfor an enforcement action against me or the facility licensee.

I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.

2. Post-Examination TO the best of my know edge, I id not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of$ instruct, evaluate, or provide w rformance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC. PRINTED NAME From the date that I entered into this security agreement until the completion of examination administration, I did not SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE JOB TITLE I RESPONSIBILITY ES-201, Page 27 of 28 U ES-201 Examination Security Agreement Form ES-201-3 1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of Qkh of my signature.

I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner.

I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations andlor an enforcement action against me or the facility licensee.

I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examinatirn security may have been compromised.

as of the date

2. Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specificaly noted below and authorized by the NRC.

PRINTED NAME 44 '3 ES-301 Operating Test Quality Checklist Form ES-301-3 1. General Cnterla a b' c# a The operating test conlorms with the previ ously a sampling reouirements ie g 10 CFP 55 45 oper, There is no day-to-dav repetition between this an during this examination b C The operating test shall not duplicate items from th d Overlap with the writteri examination and betweer acceotable limits It appears that the operating test will differ entiate applicants at the designated license level e 2 Walk-Through a Each JPM includes the following, as applicable - initial conditions - initiating cues *

  • references and tools including associated pi ocedures reasonable and validatec time limits (average ti me zllowed for compietioni and soecific oesignaiion if deemeo to be time-c ritical b) the faciliiy licensee operationally imoortant specific performance criteria that include - - - - - - - detailed exDected actions with exac! cr teria and nomenclature system response and other examiner cues statements describing important obsenations to be made by the ,3pplicant criteria for successful completion of the task identification of critical steps and their .issociated performance standards restrictions on the sequence of steps ii apolicade I ib Ensure that any changes from the previous ly apprc ved systems and aclminisvative walk-through criteria (e g item distribution bank use repet itio i from the last 2 NRC examinations) specified on those forms and Form ES-201-2 I outlines (Forms ES-301-1 and 2) have not caused the te st to deviate from any of the acceptance

__ _. _- The associated simulator operatins tests (scenar io SetSJ hade been reviewed in accordance with Y Printed tdame / Signature Date a Author J b Facility Reviewer(')

sh n &v Rc!! c NRC Chief Examiner (if) e) c , u&%@ d NRCSupervisor NOTE * # IndeDendent NRC reviewer initial items in Cclumn c chief examiner concurrence required The facility signature IS not apdicable for NFC-developed tests ES-301, Page 24 of 27 ES-301 SI m u 1 a tor S c ena ri o Quality Check 11s t Form ES-301-4 QUALITATIVE ATTRIBUTES 1 Ttlt tniiial condition:.

are realislit iri !ha some equianleill zn n servtct bul 11 doec nul LUF. the opEralOr5 tncc erpecrrn r' Tnc szenarlos consis' niosth of related events Each event descrrptton consis& of - tnE poinl irt the scenaric, wherl It 15 to be inilialed the rnalfuncttonis) lhal are eniered IC rnltiate the even

  • the syrnplomsicues tha will be vrstblt 10 the cren !ne expecled operalo' acli ons Ibt shif' positioni
  • tne event terrntnal~on mini /I' applicablei IJo more than one non-mechanisttc.

fatlure (e g wttnoui c7 credible preceding lnct den suck as E setsmi: ev The event? are valtcl wttr reaarri IC phvslcs and lhermodyr Sequencing ann timing 01 eventi is reasonable ana allu comDl?le evalualtor resuits cummensuratr wrt- toe scerti 2 3 4 pipe break.) is rncorporaled InlG the ScenanO 5 E Goerators have sutiicien' timF tc carry ou: exper red actiwtie Tne szenanoc have heei~ vaiioared Pursuant ti I[, CiF 5E 46ic, anv oper SimUlabr penxmance aeticieniies G' oeviauons

i. orr the refer I: ensare lna IU'I~[IC~~B IIOE!~! 15 mr- inlainec wnilt- runr Ai' otnc- szenarios have Deer, altered ir acsoraanct wit1 ES-301, Page 25 of 27 ES-301, Rev. 9, Supp. 1 Transient and Event Checklist Form ES-301-5 -acility: Salem Generating Station Date of Etam: 08/25/2008 Operating Test No.: 07-01 NRC Scenarios ESG-5 (Spare- not included in TOTAL) POSITION M I N I M U M(*) istructions: Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants.

ROs must serve in both the "at-the-controls (ATC)" and "balance-of-plant (BOP)" positions:

Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (IK) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.

Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1 -for-I basis. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's competence count toward the minimum requirements specified for the applicant's license level in the right-hand columns.

ES301 Page 26 of 27

- ES-301 Competencies C hecklist Form ES-307 -6 Competencies InterpreifDiagnose )omply With and Ipxate Control :ommunicate tnd Interact )em0 n stra te Operating Test No : 2 Cl: 1 Date of Examination 11 KO Lli RO RO Z 11 FZO SRO-I 5RO-I SRO-I SRO-I SRO-U Z 5RO-Ll - SRO-U SRO-U 'I illc4cJs SlLOtl 4 C/Lc 5 ? Optional for an SRO-U 5Jic-42 S=cf zC7 I pmt 1 3 Onl\ appiicable to SROs lnclcldes Technica Specification compliance for an RO CtJeci the applicants iicense fype and ente, one 01 more evenf numbers tha' Wlj' a/lOfl' the examiners to evaiuate ever} applicable corn9efen;y fo; every applicant ES-301, Page 27 of 27 ES-401 Written Examination Quality Checklist Form ES-401-6 Facility:

5 la uv\ Date of Exam: 9 8 ExamLevel. Item Descriptioii

1. 2. a. NRC WAS are referenced for all questions.
3. 4. Questions and answers are technically accurate and applicable to the facility. b. Facility learning objectives are referenlzd as available.

SRO questions are appropriate in accordance wiih Section D.2.d of ES-401 The sampling process was random and systemat ic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR OL program office). Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item that applies) and appears appropriate: - the audit exam was systematically and randomly developed; or - the audit exam was completed before the licerise exam was started; or zhe licensee certifies that there is no duplication; or

5. the examinations were developed independently; or
6. Bank use meets limits (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only question distribution(s) at right. exam are written at the comprehension1 analysis level; the SRO exam may exceed 60 percent if the rand'mly selected WAS support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at right. Referencedhandouts provided do not give away answers or aid in the elimination of distractors. Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; deviations are justified. Question psychometric quality and format meet the guidelines in ES Appendix B. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on thc cover sheet.

!4!$ 137% 5 '7%> if?- 3q 7. Between 50 and 60 percent of the questions on the RO Memory CIA . 35 I 47% 40 I f;sz 5. 3. IO. 11. Initial v- ?a- Printed Name I Signatare ,A I Author ) Facility Reviewer

(+) : NRC Chief Examiner

(#) I NRC Regional Supervisor Jote:

  • The facility reviewer's initialdsignat ure are not applicable for NRC-developed examinations.
  1. Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.

ES-401, Page 29 of 33 ES-401 Written Examination Quality Checklist Form ES-401-6 Facility:

Sa (err\ Date of Exam: 4 8 Exam Level:

RO E Item Description 1 Questions and answers are technically accurate i 2. a. NRC WAS are referenced for all quesOo b Facility learning objectives are referenc 3 SRO questions are appropriate in accordance wit1 4 The sampling process was random and systemat were repeated from the last 2 NRC licensing ex ar 5. Question duplication from the kens e screeninglaudit exam was controlled as indicated below (check the item that applies) arid appears appropriate: - the audit exam was systematically and randomly developed; or - the audit exam was completed before the license exam was started; or

>e licensee certifies that there is no duplication; or the examinations were developed independenily; or 6. Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only question distribution(s) at right.

Between 50 and 60 percent of the questions on the RO exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly selected WAS support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at rig'it. 7. a. Referenceshandouts Drovided do not aive awav answers or aid in the elimination of distractors.

" Question content conforms with specific KIA state1 examination outline and is appropriate for the deviations are justified. Question psychometric quality and format meet th, The exam contains the required number of one-pc the total is correct and agrees with the value on thc 9. 10. 11. ke 3 Author I Facility Reviewer r) : NRC Chief Examiner

(#) j NRC Regional Supelvisor

\iote:

  • The facility reviewer's initialskignat ure are not applicable for NRC-developed examinations.
  1. Independent NRC reviewer initial items in Colurrtn "c"; chief examiner concurrence required.

ES-401, 13age 29 of 33 ES-403 Written Examination Grading Form ES-403-1 Qualiity Checklist Facility:

L& (9 Date of Exam" Q (4 /a Exam Level:

R SRd I Initials Item Description

1. Clean answer sheets copied before fl P- 2. 3. 4. Answer key changes and question deletions justified and documented Applicants' scores checked for addi (reviewers spot check

> 25% of exa Grading for all borderline cases (80 as applicable, +4% on the SRO-onl!

All other failing examinations check1 are justified Performance on missed questions checked for training deficiencies and wording problems; of questions missed by half or more 5. 6. Printed NameKignature Date a. Grader b. Facility Reviewer(*)

c. NRC Chief Examiner

(*) d. NRC Supervisor

(*) S-G*,P/ /6/63h (*) The facility reviewer's signature is noi applicable for examinations graded by the NRC; two independent NRC reviews are rlsquired. ES-403, Page 6 of 6

Retrieved from "https://kanterella.com/w/index.php?title=ML082970764&oldid=1058989"