ML24173A156: Difference between revisions

From kanterella
Jump to navigation Jump to search
(StriderTol Bot insert)
 
(StriderTol Bot change)
 
Line 18: Line 18:
{{#Wiki_filter:Form 2.3-4 Written Examination Quality Checklist
{{#Wiki_filter:Form 2.3-4 Written Examination Quality Checklist


Facility:                                               Date of Exam:                                         Exam Level:   RO               SRO
Facility: Date of Exam: Exam Level: RO SRO


Item Description                                                                                     (Y)es / (N)oa       b*     c#
Item Description (Y)es / (N)oa b* c#
: 1. Questions and answers are technically accurate and applicable to the facility. Each question                                                                               Y includes a technical reference.
: 1. Questions and answers are technically accurate and applicable to the facility. Each question Y includes a technical reference.
: 2. a. All questions reference NRC knowledge and abilities (K/As) requirements.
: 2. a. All questions reference NRC knowledge and abilities (K/As) requirements.
: b. Facility learning objectives are referenced as available.                                                                                                             Y
: b. Facility learning objectives are referenced as available. Y
: c. All questions include an explanation of the correct answer explanation and a distractor analysis.
: c. All questions include an explanation of the correct answer explanation and a distractor analysis.
: 3. Senior reactor operator (SRO) questions test at the SRO license level.                                                                                                     Y
: 3. Senior reactor operator (SRO) questions test at the SRO license level. Y
: 4. The sampling process was random and systematic. (If more than four reactor operator (RO) or two SRO questions were repeated from the last two NRC licensing exams, including full                                                                                     Y (100-question) retake examinations, consult the NRC Office of Nuclear Reactor Regulation operator licensing program office.)
: 4. The sampling process was random and systematic. (If more than four reactor operator (RO) or two SRO questions were repeated from the last two NRC licensing exams, including full Y (100-question) retake examinations, consult the NRC Office of Nuclear Reactor Regulation operator licensing program office.)
: 5. Question duplication from the licensee screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:
: 5. Question duplication from the licensee screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:
__ The audit exam was systematically and randomly developed.
__ The audit exam was systematically and randomly developed.
__ The audit exam was completed before the license exam was started.                                                                                               Y
__ The audit exam was completed before the license exam was started. Y
__ The examinations were developed independently.
__ The examinations were developed independently.
__ The licensee certifies that there is no duplication.
__ The licensee certifies that there is no duplication.
__ Other (explain):
__ Other (explain):
: 6. Bank use meets limits (no more than 75% from the bank, at least                                             Bank     Modified     New                                     Y 10% new (at the comprehension/analysis level), and the rest new or modified); enter the actual RO/SRO-only question distribution >                                           29   /               /               / 1 / 016               Y
: 6. Bank use meets limits (no more than 75% from the bank, at least Bank Modified New Y 10% new (at the comprehension/analysis level), and the rest new or modified); enter the actual RO/SRO-only question distribution > 29 / / / 1 / 016 Y
: 7. Between 38 and 45 questions of the questions on the RO exam and                                                   Memory             C/A                                 Y at least 13 of the questions on the SRO-only portion of the exam are written at the comprehension/analysis level; enter the actual                                             31         /                     / 0544 / 20 RO/SRO-only question distribution >                                                                                                                                         Y
: 7. Between 38 and 45 questions of the questions on the RO exam and Memory C/A Y at least 13 of the questions on the SRO-only portion of the exam are written at the comprehension/analysis level; enter the actual 31 / / 0544 / 20 RO/SRO-only question distribution > Y
: 8. References/handouts provided do not give away answers or aid in the elimination of distractors.                                                                             Y
: 8. References/handouts provided do not give away answers or aid in the elimination of distractors. Y
: 9. Question content conforms to specific K/A statements in the previously approved examination                                                                                 Y outline and is appropriate for the K/A statements assigned tier; deviations are justified.
: 9. Question content conforms to specific K/A statements in the previously approved examination Y outline and is appropriate for the K/A statements assigned tier; deviations are justified.
: 10. Question psychometric quality and format meet the instructions and guidelines in ES-4.2.                                                                                     Y
: 10. Question psychometric quality and format meet the instructions and guidelines in ES-4.2. Y
: 11. The exam contains the required number of one-point, multiple-choice items; the total is correct                                                                             Y and agrees with the value on the cover sheet.
: 11. The exam contains the required number of one-point, multiple-choice items; the total is correct Y and agrees with the value on the cover sheet.
Dh k.W'F rEW l /kr.&hWF                                               4r.WF r$   ,&.)ih                           9999999999999999999999999999999999999999999999999999999999999F9999999999F
Dh k.W'F rEW l /kr.&hWF 4r.WF r$,&.)ih 9999999999999999999999999999999999999999999999999999999999999F9999999999F
  $   orm 2 .3FQWa W(WhFs!           9999999999999999999999999999999999999999999999999999999999999F9999999999F m$     Q-FQWa W(WhFs"             9999999999999999999999999999999999999999999999999999999999999F9999999999F Q-F-) WtFenrE kWhF               9999999999999999999999999999999999999999999999999999999999999F9999999999F Q-FQW/ ikr2Fl&cWha CihF       9999999999999999999999999999999999999999999999999999999999999F9999999999F
  $ orm 2.3FQWa W(WhFs! 9999999999999999999999999999999999999999999999999999999999999F9999999999F m$ Q-FQWa W(WhFs" 9999999999999999999999999999999999999999999999999999999999999F9999999999F Q-F-) WtFenrE kWhF 9999999999999999999999999999999999999999999999999999999999999F9999999999F Q-FQW/ ikr2Fl&cWha CihF 9999999999999999999999999999999999999999999999999999999999999F9999999999F
* The facility licensee signature is not applicable for NRC-developed tests.
* The facility licensee signature is not applicable for NRC-developed tests.
# An independent NRC reviewer performs steps in column c. This may be the NRC Chief Examiner if he/she did not develop the written examination under review.}}
# An independent NRC reviewer performs steps in column c. This may be the NRC Chief Examiner if he/she did not develop the written examination under review.}}

Latest revision as of 13:06, 4 October 2024

Ile Form 2.3-4 Written Examination Quality Checklist
ML24173A156
Person / Time
Site: Quad Cities  Constellation icon.png
Issue date: 05/02/2024
From:
NRC/RGN-III/DORS/OB
To:
Exelon Generation Co
Bryan Bergeon
Shared Package
ML22251A228 List:
References
Download: ML24173A156 (1)


Text

Form 2.3-4 Written Examination Quality Checklist

Facility: Date of Exam: Exam Level: RO SRO

Item Description (Y)es / (N)oa b* c#

1. Questions and answers are technically accurate and applicable to the facility. Each question Y includes a technical reference.
2. a. All questions reference NRC knowledge and abilities (K/As) requirements.
b. Facility learning objectives are referenced as available. Y
c. All questions include an explanation of the correct answer explanation and a distractor analysis.
3. Senior reactor operator (SRO) questions test at the SRO license level. Y
4. The sampling process was random and systematic. (If more than four reactor operator (RO) or two SRO questions were repeated from the last two NRC licensing exams, including full Y (100-question) retake examinations, consult the NRC Office of Nuclear Reactor Regulation operator licensing program office.)
5. Question duplication from the licensee screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:

__ The audit exam was systematically and randomly developed.

__ The audit exam was completed before the license exam was started. Y

__ The examinations were developed independently.

__ The licensee certifies that there is no duplication.

__ Other (explain):

6. Bank use meets limits (no more than 75% from the bank, at least Bank Modified New Y 10% new (at the comprehension/analysis level), and the rest new or modified); enter the actual RO/SRO-only question distribution > 29 / / / 1 / 016 Y
7. Between 38 and 45 questions of the questions on the RO exam and Memory C/A Y at least 13 of the questions on the SRO-only portion of the exam are written at the comprehension/analysis level; enter the actual 31 / / 0544 / 20 RO/SRO-only question distribution > Y
8. References/handouts provided do not give away answers or aid in the elimination of distractors. Y
9. Question content conforms to specific K/A statements in the previously approved examination Y outline and is appropriate for the K/A statements assigned tier; deviations are justified.
10. Question psychometric quality and format meet the instructions and guidelines in ES-4.2. Y
11. The exam contains the required number of one-point, multiple-choice items; the total is correct Y and agrees with the value on the cover sheet.

Dh k.W'F rEW l /kr.&hWF 4r.WF r$,&.)ih 9999999999999999999999999999999999999999999999999999999999999F9999999999F

$ orm 2.3FQWa W(WhFs! 9999999999999999999999999999999999999999999999999999999999999F9999999999F m$ Q-FQWa W(WhFs" 9999999999999999999999999999999999999999999999999999999999999F9999999999F Q-F-) WtFenrE kWhF 9999999999999999999999999999999999999999999999999999999999999F9999999999F Q-FQW/ ikr2Fl&cWha CihF 9999999999999999999999999999999999999999999999999999999999999F9999999999F

  • The facility licensee signature is not applicable for NRC-developed tests.
  1. An independent NRC reviewer performs steps in column c. This may be the NRC Chief Examiner if he/she did not develop the written examination under review.