ML111460125: Difference between revisions

From kanterella
Jump to navigation Jump to search
(Created page by program invented by StriderTol)
 
(Created page by program invented by StriderTol)
Line 22: Line 22:
==Dear Mr. Palagi:==
==Dear Mr. Palagi:==
Entergy Nuclear Operations, Inc.
Entergy Nuclear Operations, Inc.
is submitting the initial license examination for the Palisades Nuclear Plant, in accordance with NUREG-1 021 , "Operator Licensing Examination Standards for Power Reactors," Revision 9, Supplement  
is submitting the initial license examination for the Palisades Nuclear Plant, in accordance with NUREG-1 021 , "Operator Licensing Examination Standards for Power Reactors," Revision 9, Supplement
: 1. The initial license examination is scheduled for August 16 through August 27, 201 0. The following materials are enclosed: . . ES 201 -3, Examination Security Agreement (updated)
: 1. The initial license examination is scheduled for August 16 through August 27, 201 0. The following materials are enclosed: . . ES 201 -3, Examination Security Agreement (updated)
ES 301 -3, Operating Test Quality Checklist . ES 301 -4, Simulator Scenario Quality Checklist ES-301-5, Transient and Event Checklists (updated) (2) . ES 301 -6, Competencies Checklist . System/Control Room Job Performance Measures (1 1) . Administrative Job Performance Measures (9) . Scenarios (4) . Operating Test Schedule (updated)
ES 301 -3, Operating Test Quality Checklist . ES 301 -4, Simulator Scenario Quality Checklist ES-301-5, Transient and Event Checklists (updated) (2) . ES 301 -6, Competencies Checklist . System/Control Room Job Performance Measures (1 1) . Administrative Job Performance Measures (9) . Scenarios (4) . Operating Test Schedule (updated)
Line 39: Line 39:
* The facility signature is not applicable for NRCdeveloped tests  
* The facility signature is not applicable for NRCdeveloped tests  
# Independent NRC reviewer initial items in Cdumn "c": chief examiner concurrence is required.
# Independent NRC reviewer initial items in Cdumn "c": chief examiner concurrence is required.
ES-301, Page 24 of 27 ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Facilii: Palisades Date of Exam: August 2010 Scenario Numbers: 1 12 I3 Operating Test Number: 1 Initials a b' c# QUALITATIVE ATTRIBUTES  
ES-301, Page 24 of 27 ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Facilii: Palisades Date of Exam: August 2010 Scenario Numbers: 1 12 I3 Operating Test Number: 1 Initials a b' c# QUALITATIVE ATTRIBUTES
: 1. The initial conditions are realistic, in that some equipment andlor instrumentation may be out of service, but it does not cue the ormators into exmcted events. 2. 3. The scenarios consist mostly of related events. Each event description consists of the point in the scenario when it is to be initiated the malfunction(s) that are entered to initiate the event the symptomslcues that will be visible to the crew the expected operator actions (by shift position) the event termination point (if applicable)
: 1. The initial conditions are realistic, in that some equipment andlor instrumentation may be out of service, but it does not cue the ormators into exmcted events. 2. 3. The scenarios consist mostly of related events. Each event description consists of the point in the scenario when it is to be initiated the malfunction(s) that are entered to initiate the event the symptomslcues that will be visible to the crew the expected operator actions (by shift position) the event termination point (if applicable)
No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event. The events are valid with regard to phvsics and thermdynamics.  
No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event. The events are valid with regard to phvsics and thermdynamics.
: 4. 5. 6. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario obiectives.
: 4. 5. 6. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario obiectives.
If time compression techniques are used, the scenario summary clearly so indicates.
If time compression techniques are used, the scenario summary clearly so indicates.
Line 49: Line 49:
Every operator will be evaluated using at least one new or significantly modiiied scenario.
Every operator will be evaluated using at least one new or significantly modiiied scenario.
All other scenarios have been altered in accordance with Section D.5 of ES-301. All individual operator competencies can be evaluated.
All other scenarios have been altered in accordance with Section D.5 of ES-301. All individual operator competencies can be evaluated.
as verified using Form ES-301-6 (submit the form along with the simulator scenarios).  
as verified using Form ES-301-6 (submit the form along with the simulator scenarios).
: 10. 11. 12. 13. Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarias).
: 10. 11. 12. 13. Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarias).
The level of difficulty is apprmriate to support licensing decisions for each crew position.
The level of difficulty is apprmriate to support licensing decisions for each crew position.
4- Target Quantitative Attributes (Per Scenario:
4- Target Quantitative Attributes (Per Scenario:
See Section D.5.d) I Actual Attributes I - 1. Total malfunctions (5-8) 2. Malfunctions after EOP entry (1-2) 11212 3. Abnormal events (2-4) 41314 4. Major transients (1 -2) 11111 If 5. EOPs enteredlrequiring substantive actions (1-2) 11111 6. EOP contingencies requiring substantive actions (0-2)  
See Section D.5.d) I Actual Attributes I - 1. Total malfunctions (5-8) 2. Malfunctions after EOP entry (1-2) 11212 3. Abnormal events (2-4) 41314 4. Major transients (1 -2) 11111 If 5. EOPs enteredlrequiring substantive actions (1-2) 11111 6. EOP contingencies requiring substantive actions (0-2)
: 7. Critical tasks (2-3)
: 7. Critical tasks (2-3)
ES-301, Page 25 of 27 ES-301 Competencies Checklist Form ES-301-6 Facility:
ES-301, Page 25 of 27 ES-301 Competencies Checklist Form ES-301-6 Facility:
Line 69: Line 69:
August 201 0 Operating Test No.: 1 I APPLICANTS - CREW #1 I Competencies Notes: (1) (2) Optional for an SRO-U. (3) Only applicable to SROs. Includes Technical Specification compliance for an RO. Instructions: Check the applicant's license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.
August 201 0 Operating Test No.: 1 I APPLICANTS - CREW #1 I Competencies Notes: (1) (2) Optional for an SRO-U. (3) Only applicable to SROs. Includes Technical Specification compliance for an RO. Instructions: Check the applicant's license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.
P D c ES-301, Page 27 of 27 ES-401 Written Examination Quality Checklist Form ES-401-6 11 Facility:
P D c ES-301, Page 27 of 27 ES-401 Written Examination Quality Checklist Form ES-401-6 11 Facility:
Palisades Date of Exam: August 2010 Exam Level: RO Ix) SRO II Item Description Initial [G 4 Ttk e(3 1. 2. Questions and answers are technically accurate and applicable to the facility.  
Palisades Date of Exam: August 2010 Exam Level: RO Ix) SRO II Item Description Initial [G 4 Ttk e(3 1. 2. Questions and answers are technically accurate and applicable to the facility.
: a. NRC K/As are referenced for all questions.  
: a. NRC K/As are referenced for all questions.
: b. Facility learning objectives are referenced as available.  
: b. Facility learning objectives are referenced as available.
: 3. 4. 5. SRO questions are appropriate in accordance with Section 0.2.d of ES-401 The sampling process was random and systematic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exam, consult the NRR OL program office). Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item that applies) and appears appropriate: - X the audit exam was systematically and randomly developed; or - the audit exam was completed before the license exam was started; or - the examinations were developed independently; or - the licensee certifies that there is no duplication; or - other (explain) Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only 59/52 5/12 36/36 question distribution(s) at right. Bank Modified New 6. 44 I16 56 I 84 7. Between 50 and 60 percent of the questions on the RO exam are written at the comprehension /analysis level; the SRO exam may exceed 60 percent if the randomly selected KAs support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at right. 8. Referenceslhandouts provided do not give away answers or aid in the elimination of I1 distractors.
: 3. 4. 5. SRO questions are appropriate in accordance with Section 0.2.d of ES-401 The sampling process was random and systematic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exam, consult the NRR OL program office). Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item that applies) and appears appropriate: - X the audit exam was systematically and randomly developed; or - the audit exam was completed before the license exam was started; or - the examinations were developed independently; or - the licensee certifies that there is no duplication; or - other (explain) Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only 59/52 5/12 36/36 question distribution(s) at right. Bank Modified New 6. 44 I16 56 I 84 7. Between 50 and 60 percent of the questions on the RO exam are written at the comprehension /analysis level; the SRO exam may exceed 60 percent if the randomly selected KAs support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at right. 8. Referenceslhandouts provided do not give away answers or aid in the elimination of I1 distractors.
Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the Tier to which they are assigned; deviations are // " iustified 11 10. Question psychometric quality and format meet the guidelines in ES Appendix 6. I d I 6'+l 11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with value on cover sheet II a Author Jeffrev lliff I 6 ?";"-lo b Facility Reviewer  
Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the Tier to which they are assigned; deviations are // " iustified 11 10. Question psychometric quality and format meet the guidelines in ES Appendix 6. I d I 6'+l 11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with value on cover sheet II a Author Jeffrev lliff I 6 ?";"-lo b Facility Reviewer
(*) I /J/h Timothy Horan / &s.'o~ ,Gr 5/inatwe5 Note:
(*) I /J/h Timothy Horan / &s.'o~ ,Gr 5/inatwe5 Note:
* The facility reviewer's initials/signature are not applicable for NRC-developed examinations.  
* The facility reviewer's initials/signature are not applicable for NRC-developed examinations.  
# Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.
# Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.
ES-401, Page 29 of 33 ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: Palisades Date of Exam: August 2010 Exam Level: RO SRO Initial Item Description a  
ES-401, Page 29 of 33 ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: Palisades Date of Exam: August 2010 Exam Level: RO SRO Initial Item Description a
: 1. 2. Questions and answers are technically accurate and applicable to the facility.  
: 1. 2. Questions and answers are technically accurate and applicable to the facility.
: a. NRC WAS are referenced for all questions.  
: a. NRC WAS are referenced for all questions.
: b. Facility learning obiectives are referenced as available.  
: b. Facility learning obiectives are referenced as available.
: 5. Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item that applies) and appears appropriate: - X the audit exam was systematically and randomly developed; or - the audit exam was completed before the license exam was started; or - the examinations were developed independently; or - the licensee certifies that there is no duplication; or k Bank Modified New 6. Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only question 59/52 5/12 36136 distribution(s) at right. exam are written at the comprehension /analysis level; the SRO exam may exceed 60 percent if the randomly selected KAs support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at right. Referenceshandouts provided do not give awav answers or aid in the elimination of distractors.  
: 5. Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item that applies) and appears appropriate: - X the audit exam was systematically and randomly developed; or - the audit exam was completed before the license exam was started; or - the examinations were developed independently; or - the licensee certifies that there is no duplication; or k Bank Modified New 6. Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only question 59/52 5/12 36136 distribution(s) at right. exam are written at the comprehension /analysis level; the SRO exam may exceed 60 percent if the randomly selected KAs support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at right. Referenceshandouts provided do not give awav answers or aid in the elimination of distractors.
: 7. Between 50 and 60 percent of the questions on the RO MelllW CIA 45 I16 55 I84 a. 9. Question content conforms with specific WA statements in the previously approved examination outline and is appropriate for the Tier to which they are assigned; deviations are justified  
: 7. Between 50 and 60 percent of the questions on the RO MelllW CIA 45 I16 55 I84 a. 9. Question content conforms with specific WA statements in the previously approved examination outline and is appropriate for the Tier to which they are assigned; deviations are justified
: 10. 11. Question psychometric quality and format meet the guidelines in ES Appendix B. The exam contains the required number of onepoint, multiple choice items; the tdal is correct and agrees with value on cover sheet  
: 10. 11. Question psychometric quality and format meet the guidelines in ES Appendix B. The exam contains the required number of onepoint, multiple choice items; the tdal is correct and agrees with value on cover sheet
: a. Author b. Facility Reviewer (*) 7(%-?/1a c. NRC Chief Examiner (#) d. NRC Supervisor Note:
: a. Author b. Facility Reviewer (*) 7(%-?/1a c. NRC Chief Examiner (#) d. NRC Supervisor Note:
* The facility reviewer's initialslsignature are not applicable for NRCdeveloped examinations.  
* The facility reviewer's initialslsignature are not applicable for NRCdeveloped examinations.  
# Independent NRC reviewer initial items in Cdumn 'c"; chief examiner concurrence required.
# Independent NRC reviewer initial items in Cdumn 'c"; chief examiner concurrence required.
ES-401, Page 29 of 33}}
ES-401, Page 29 of 33}}

Revision as of 13:44, 30 April 2019

2010 Palisades Nuclear Plant Initial Examination Proposed Exam Files
ML111460125
Person / Time
Site: Palisades Entergy icon.png
Issue date: 08/16/2010
From: Nixon H
Entergy Nuclear Operations
To: Palagi B B
NRC/RGN-III/DRS/OLB
Shared Package
ML102070539 List:
References
Download: ML111460125 (12)


Text

2010 PALISADES NUCLEAR PLANT INITIAL EXAMINATION PROPOSED EXAM FILES

."zs2r Entergv I Palisades Nuclear Plant Dockets 50-255 and 72-07 License No. DPR-20 Entergy Nuclear Operations, Inc.

Palisades Nuclear Plant 27780 Blue Star Memorial Highway Covert, MI 49043 I Initial License Examination Materials June 16,2010 Hugh Nixon Training Manager NUREG-1 021 Mr. Bruce Palagi U.S. Nuclear Regulatory Commission Region 111 2443 Warrenville Road Suite 210 Lisle, IL 60532-4352

Dear Mr. Palagi:

Entergy Nuclear Operations, Inc.

is submitting the initial license examination for the Palisades Nuclear Plant, in accordance with NUREG-1 021 , "Operator Licensing Examination Standards for Power Reactors," Revision 9, Supplement

1. The initial license examination is scheduled for August 16 through August 27, 201 0. The following materials are enclosed: . . ES 201 -3, Examination Security Agreement (updated)

ES 301 -3, Operating Test Quality Checklist . ES 301 -4, Simulator Scenario Quality Checklist ES-301-5, Transient and Event Checklists (updated) (2) . ES 301 -6, Competencies Checklist . System/Control Room Job Performance Measures (1 1) . Administrative Job Performance Measures (9) . Scenarios (4) . Operating Test Schedule (updated)

Mr. Bruce Palagi Page 2 ES 401 -6, Written Examination Quality Checklist ES 401-7, RO Written Examination Coversheet RO Written Examination (ready to give with handouts)

RO Written Examination Data Sheets with supporting references RO Written Examination Key ES-401-8, SRO Written Examination Coversheet SRO Written Examination (ready to give with handouts)

SRO Written Examination Data Sheets with supporting references SRO Written Examination Key In accordance with NUREG-1 021 , ES-201, Attachment 1 , these materials shall be withheld from public disclosure until after the examinations are complete. Please contact Jeffrey lliff at (269) 764-2974 if you have any questions regarding this submittal.

Summaw of Commitments This letter contains no new commitments and no revisions to existing commitments.

Enclosure (1 ) CC Administrator, Region 111, USNRC (w/o enclosure)

Project Manager, Palisades, USNRC (w/o enclosure) Resident Inspector, Palisades, USNRC (w/o enclosure)

Document Control Desk, USNRC (w/o enclosure)

WITHHOLD ENCLOSURE FROM PUBLIC DISCLOSURE IN ACCORDANCE WITH NUREG-1021, REVISION 9, SUPPLEMENT 1 ENCLOSURE PALISADES NUCLEAR PLANT INITIAL LICENSE EXAMINATION MATERIALS ES-301 Operating Test Quality Checklist Form ES-301-3 I Facility: Palisades Date of Examination:

Auaust 2010 Operating Test Number: 1 1. GENERAL CRITERIA Initials k 2. WALK-THROUGH CRITERIA I a. Each JPM includes the following, as applicable:

initial conditions initiating cues references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time critical by the facility licensee operationally important specific performance criteria that include: - - - - - - detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important observations to be made by the applicant criteria for successful completion of the task identification of critical steps and their associated performance standards restrictions on the sequence of steps, if applicable k b. Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301-1 and 2) have nd caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.

I 3. SIMULATOR CRITERIA I- The associated simulator operating tests (scenario sets) have been reviewed in accordance with I Form ES-301-4 and a copy is attached.

Ik a. Author b. Facility Reviewer (*) NOTE:

  • The facility signature is not applicable for NRCdeveloped tests
  1. Independent NRC reviewer initial items in Cdumn "c": chief examiner concurrence is required.

ES-301, Page 24 of 27 ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Facilii: Palisades Date of Exam: August 2010 Scenario Numbers: 1 12 I3 Operating Test Number: 1 Initials a b' c# QUALITATIVE ATTRIBUTES

1. The initial conditions are realistic, in that some equipment andlor instrumentation may be out of service, but it does not cue the ormators into exmcted events. 2. 3. The scenarios consist mostly of related events. Each event description consists of the point in the scenario when it is to be initiated the malfunction(s) that are entered to initiate the event the symptomslcues that will be visible to the crew the expected operator actions (by shift position) the event termination point (if applicable)

No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event. The events are valid with regard to phvsics and thermdynamics.

4. 5. 6. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario obiectives.

If time compression techniques are used, the scenario summary clearly so indicates.

Operators have sufficient time to carry out expected activities without undue time constraints.

Cues I 7. are given. - I I I 8. The simulator modeling is not altered. 6 9. The scenarios have been validated.

Pursuant to 10CFR55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.

Every operator will be evaluated using at least one new or significantly modiiied scenario.

All other scenarios have been altered in accordance with Section D.5 of ES-301. All individual operator competencies can be evaluated.

as verified using Form ES-301-6 (submit the form along with the simulator scenarios).

10. 11. 12. 13. Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarias).

The level of difficulty is apprmriate to support licensing decisions for each crew position.

4- Target Quantitative Attributes (Per Scenario:

See Section D.5.d) I Actual Attributes I - 1. Total malfunctions (5-8) 2. Malfunctions after EOP entry (1-2) 11212 3. Abnormal events (2-4) 41314 4. Major transients (1 -2) 11111 If 5. EOPs enteredlrequiring substantive actions (1-2) 11111 6. EOP contingencies requiring substantive actions (0-2)

7. Critical tasks (2-3)

ES-301, Page 25 of 27 ES-301 Competencies Checklist Form ES-301-6 Facility:

Palisades Date of Examination:

August 2010 Operating Test No.: 1 APPLICANTS - CREW #1 Competencies Notes: (1 ) (2) Optional for an SRO-U. (3) Only applicable to SROs. Includes Technical Specification compliance for an RO. Instructions: Check the applicant's license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

ES-301, Page 27 of 27 ES-301 Competencies Checklist Fo~ ES-301-6 I Facility:

Palisades Date of Examination:

August 201 0 Operating Test No.: 1 Com petencies APPLICANTS - CREW #2 thw #4 I RO 0 RO 0 RO IXI SRO-I SRO-I SRO-I c] SRO-U 0 SRO-U 0 SRO-U c] I Comply With and Use Procedures (1) I 12345 I 1-8 I 13568 I 13456 I 256 I 1-8 I ~ 125- I 123678 I 1267 I Operate Control Boards (2) N/A N/A 13568 13456 256 N/A 125 123678 1267 Communicate and Interact Demonstrate Supervisory Ability (3) I 12345 I 1-8 1 N/A 1 N/A 1 N/A I 1-8 I N/A I N/A I N/A Notes: (1) (2) Optional for an SRO-U. (3) Only applicable to SROs. Includes Technical Specification compliance for an RO. Instructions:

Check the applicant's license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

ES-301, Page 27 of 27 ES-301 Competencies Checklist FO~ ES-301-6 Facility:

Palisades Date of Examination: August 2010 Operating Test No.: 1 APPLICANTS - CREW #2 thru #4 Competencies RO 0 SRO-I SRO-U 0 RO 0 SRO-I SRO-U 0 RO El SRO-I 0 SRO-U 0 Notes: (1) (2) Optional for an SRO-U. (3) Only applicable to SROs. Includes Technical Specification compliance for an RO. Instructions:

Check the applicant's license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

ES-301, Page 27 of 27 ES-301 Competencies Checklist Fo~ ES-301-6 Facility:

Palisades Date of Examination:

August 201 0 Operating Test No.: 1 I APPLICANTS - CREW #1 I Competencies Notes: (1) (2) Optional for an SRO-U. (3) Only applicable to SROs. Includes Technical Specification compliance for an RO. Instructions: Check the applicant's license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

P D c ES-301, Page 27 of 27 ES-401 Written Examination Quality Checklist Form ES-401-6 11 Facility:

Palisades Date of Exam: August 2010 Exam Level: RO Ix) SRO II Item Description Initial [G 4 Ttk e(3 1. 2. Questions and answers are technically accurate and applicable to the facility.

a. NRC K/As are referenced for all questions.
b. Facility learning objectives are referenced as available.
3. 4. 5. SRO questions are appropriate in accordance with Section 0.2.d of ES-401 The sampling process was random and systematic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exam, consult the NRR OL program office). Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item that applies) and appears appropriate: - X the audit exam was systematically and randomly developed; or - the audit exam was completed before the license exam was started; or - the examinations were developed independently; or - the licensee certifies that there is no duplication; or - other (explain) Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only 59/52 5/12 36/36 question distribution(s) at right. Bank Modified New 6. 44 I16 56 I 84 7. Between 50 and 60 percent of the questions on the RO exam are written at the comprehension /analysis level; the SRO exam may exceed 60 percent if the randomly selected KAs support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at right. 8. Referenceslhandouts provided do not give away answers or aid in the elimination of I1 distractors.

Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the Tier to which they are assigned; deviations are // " iustified 11 10. Question psychometric quality and format meet the guidelines in ES Appendix 6. I d I 6'+l 11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with value on cover sheet II a Author Jeffrev lliff I 6 ?";"-lo b Facility Reviewer

(*) I /J/h Timothy Horan / &s.'o~ ,Gr 5/inatwe5 Note:

  • The facility reviewer's initials/signature are not applicable for NRC-developed examinations.
  1. Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required.

ES-401, Page 29 of 33 ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: Palisades Date of Exam: August 2010 Exam Level: RO SRO Initial Item Description a

1. 2. Questions and answers are technically accurate and applicable to the facility.
a. NRC WAS are referenced for all questions.
b. Facility learning obiectives are referenced as available.
5. Question duplication from the license screeninglaudit exam was controlled as indicated below (check the item that applies) and appears appropriate: - X the audit exam was systematically and randomly developed; or - the audit exam was completed before the license exam was started; or - the examinations were developed independently; or - the licensee certifies that there is no duplication; or k Bank Modified New 6. Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only question 59/52 5/12 36136 distribution(s) at right. exam are written at the comprehension /analysis level; the SRO exam may exceed 60 percent if the randomly selected KAs support the higher cognitive levels; enter the actual RO I SRO question distribution(s) at right. Referenceshandouts provided do not give awav answers or aid in the elimination of distractors.
7. Between 50 and 60 percent of the questions on the RO MelllW CIA 45 I16 55 I84 a. 9. Question content conforms with specific WA statements in the previously approved examination outline and is appropriate for the Tier to which they are assigned; deviations are justified
10. 11. Question psychometric quality and format meet the guidelines in ES Appendix B. The exam contains the required number of onepoint, multiple choice items; the tdal is correct and agrees with value on cover sheet
a. Author b. Facility Reviewer (*) 7(%-?/1a c. NRC Chief Examiner (#) d. NRC Supervisor Note:
  • The facility reviewer's initialslsignature are not applicable for NRCdeveloped examinations.
  1. Independent NRC reviewer initial items in Cdumn 'c"; chief examiner concurrence required.

ES-401, Page 29 of 33