ML20151D658
| ML20151D658 | |
| Person / Time | |
|---|---|
| Site: | Shoreham File:Long Island Lighting Company icon.png |
| Issue date: | 06/10/1988 |
| From: | James Smith LONG ISLAND LIGHTING CO. |
| To: | |
| Shared Package | |
| ML20151D407 | List:
|
| References | |
| 5.02, NUDOCS 8807250193 | |
| Download: ML20151D658 (8) | |
Text
. _.
OTP 5.02 REV.
O ggg p 0FFICE OF TRAINING g,,,,,i,, o,,, _ q. c.. g e PROCEDURES TITLE: FORMULATING TESTS FROM QUESTION AND ANSWER BANKS AND ADMINISTERING T 1.0 PURPOSE The purpose of this procedure is to provide directions for formulating a test using the questions from a question and answer bank.
In addition it establishes the administrative controls for administering tests.
20 SCOPE i
This procedure establishes the methods and outlines the responsibilities for creating, administering and grading written and oral tests.
This procedures does not address the administration of job performance measures.
The licensed Reactor Operator and Senior Reactor Operator programs may use Nuclear Regulatory Commission exams when exam banks do not exist.
3.0 DEFINITIONS 3.1 Alternative Exam - The questions in the alternative exam, while the same as in the regular exam, appear in a different order.
Alternative exams are administered when seating in the classroom designated for testing cannot appropriately accommodate students (i.e., students separated by a empty desk or the equivalent space).
4.0 DISCUSSION l
Tes+.s are designated confidential by the Office of I
Training.
Unauthorized duplication or distribution of their contents is subject to disciplinary action up to i
and including dismissal.
5.0 RESPONSIBILITY AND AUTHORITY 5.1 The instructor responsible for administration of a particular course also has responsibility for selection / development of exam questions and for scoring of exams.
g7250193000715
- ~
~ ~ ~
ADOCK 050003pp p
1 PNU f[
Q"[
l l
,ih}L u[i AL 4, 10 1988 sai o j APPROVED BY/DATE 3 9
l l
5.2 The appropriate section supervisor is responsible for review and approval of examinations.
5.3 The administration section is responsible for inclusion of drawings / figures into exams, and for exam reproduction.
6.0 REFERENCES
h"uR EO 1021, Operator Licensing Examiner Standards; October 1987 7.0 -ACTIONS 7.1 Developing Tests Using an Exam Bank of Questions 7.1.1 The instructor assigned the responsibility for creating a written or oral test should request a hard copy of the question and answer bank for the appropriate program from the administration section.
7.1.2 The instructor reviews Appendix 8.1; Objective / Test Hatrix for the program or course, and selects the objectives to be covered by the test being created.
Consideration should be given to l
covering a.11 lesson enabling objectives in a series of tests administered over the term of the course or program.
The instructor selects test questions, based upon the objectives to be covered, from the program question and answer bank by writing the record number of the question in the appropriate box on Appendix 8.1.
Appendix 8.1 is then transmitted to the administration section.
7.1.3 In preparing for the administration of an oral examination the examiner may request question from the question bank or choose to formulate other questions.
When formulating questions they must be based upon'the approved objectives.
t OTp 5.02 Rev. O page 2 l
3
'I 7.1.3.1 In the case of oral exams it is the responnibility of the instructor to provide the training supervisor with a copy of the exam quest' ions for approval.
They shall be prepared in the form of an official oral exam guide which indicates the objectives or the questions that will be used.
The questions should be written such that they are grouped by objectives.
Space should be allotted below each question to permit evaluator comments.
7.1.3.2 The training section supervisor shall indicate' approval by signing the cover page of the oral exam guide.
7.1.4 The administrative section shall provide a hard copy printout of the exam with the requested exam questions / answers or objectives in the case of an oral test, to the instructor.
In addition Appendix 8.1 is returned to the instructor.
7.1.5 The instructor shall review the printout (s) to ensure that the l
appropriate questions / objectives have l
been selected, and indicate such by l
signing the printout.
l I
7.1.6 When satisfied that the appropriate questions and objectives have been selected, the instructor shall forward the exam and Appendix 8.1 to the section i
l supervisor for approval.
l 7.1.7 The training section supervisor shall review and approve for adequacy and distribution of questions with regard to the established objectives.
Approval is indicated by signing the cover page of l
the examination.
7.1.8 The section supervisor shall forward the entire exam package to the training administration section for inclusion of drawings / figures.
l OTp 5,02 Rev. 0 l
psge 3
7.1.9 The Office of Training administration section shall forward the exam, with drawings / figures included, to the originating training instructor.
NOTE:
All examination cover sheets are to include the following statement to be signed by the examinees:
"All work done on this examination is my own.
I have neither given nor received aid."
i 7.1.10 The training instructor shall review the approved exam with drawings / figures attached and, when satisfied with the
' quality and appropriateness of the j
drawings / figures, shall sign the exam.
l 7.2 preparing Exams for Administration 7.2.1 The training instructor responsible for administering approved exams completes the appropriate request form to indicate number of exam copies and date needed.
Tnis form, with the signed copy of the exam atteched, is forwarded to the administration section.
7.2.2 Exam hard copies (original and copies) are to be transmitted in a sealed envelope.
7.3 Administering Exams 7.3.1 Exams are administered at appropriate times during the lesson or course.
7.3.2 Exams are administered following accepted guidelines for exam administration, including the following:
o Exams are administered in classrooms with adequate space (students separated by an empty desk) for all being tested, to assure test integrity.'
o When students are unable to be appropriately accommodated in the designated testing space, an l
alternative test is administered, as necessary.
l l
l OTp 5.02 Rev. 0 page 4
i NOTE:
In the case of NRC licensed operator examinations, the administration of alternate exams may not be acceptable to the NRC.
A ruling should be obtained from the NRC prior to selecting this option.
o Student desks are cleared of all extraneous material during testing.
o All references not approved for use during the examination are removed from the view of the examinee.
o An examination proctor shall be present at all times and maintain surveillance of the examinees during the examination period.
o Oral examinations may be administered at on-the-job locations.
Special care should be takan in this case to ensure that the exam is not affected by the environment in which it is administered such as, noise, work activity, area accessibility.
o When additional or spontaneous questions are generated during an oral exam, they must be related to the objectives tested.
Each additional question and an evaluation of the response shall be entered by the instructor beneath the referenced objective.
7.3.3 Administering and Scoring a Test 7.3.3.1 In the administration and scoring of the test, the aim is to emphasize objectivity.
7.3.3.2 The following are a few practices to aid instructors in administering a test.
Prepare the test far enough in advance so that
^
o clear copies can be assured for each student.
OTP S.02 Rev. O Page 5
o time estimates can be made for completing each I
section, and this information added to the test.
o directions for completing the different types of items can be tried out on peers or a supervisor to eliminate ambiguity and modify as needed; and o
an explicit key for scoring can be completed.
7.3.3.3 When the test is being administered, create an atmosphere that allows students to concentrate on taking the test.
See that the room is quiet and free from distractions, that the temperature is comfortable, and that the lighting is adequate.
Give any instructions prior to the test.
Explain the purpose of the test, how it will be graded, and any instructions for taking it that are not l
included in the written
[
directions.
You want to have students raise their hands when help is needed.
7.3.3.4 In scoring the test, you can l
l be more efficient if you check the whole test, one section at a time (the same way you constructed it).
For example, if the test is composed of 30 multiple-choice items, 20 matching items, and 10 essay items, correct all of the multiple-choice items, then the matching items, and finally each of the essay items one-by-one.
I OTP 5.02 Rev. O Page 6
~
]
i 7.4 Examination Grading 7.4.1 Written examinations containing other than essay type questions are graded strictly in accordance with the answer key formulated from the question answer bank.
7.4.2 Written examinations containing essay type questione are scored for consistency according to an explicit examination key, one question a.t a time, before subsequent essay questions are scored.
7.4.3
' Oral examinations are scored such that the response to a question or series of questions related to an objective is evaluated as being from~0%
to 100% correct.
The questions asked can be hand written following the associated objective on the oral l
l examination guide along with the instructor's evaluation of the response in percent correct.
The instructor should include comments with respect to incorrect responses to oral questions on a section of.the guide that containe the specific question in order to substantiate scoring.
7.5 Test Storage l
7.5.1 The administration section maintains the approved original copy of the exam in j
the appropriate program file.
8.0 APPENDICES 8.1 Objective / Test Matrix f
OTP 5.02 Rev. O Page 7 l
i Appendix 8.1 Page 1 of 1 OBJECTIVE / TEST MATRIX
. yiiVia TEST 1 TEST 2 TEST 3 TBST4 TESTS TEST 6 TEST 7 TEST 8 i.
e a
e e
a e
a s
a e
a s
e e
a e
a e
e a
e e
a e
i a
t t
e e
e a
a f
G 0
0 0
a e
a e
e a
a e
I 0
e a
e a
e s
e e
e I
a E
8 8
4 0
9 1
I I
I I
a I
'8 0
e a
i A
A a
e a
l I
e 0
e a
a e
a 0
0 t
0 0
0 0
0 m
a e
e e
a a
e 0
0 t
t 0
0 8
0 e
a e
a a
e e
e 1
9 6
B O
a e
a a
a e
a n
l 8
8 9
0 0
8 0
0 e
a e
a e
a e
a I
8 5
4 4
0 0
0 6
e e
e a
a e
a e
4 9
9 9
0 0
a a
a a
e n
a a
9 e
0 0
0 0
0 e
a a
e a
e e
e B
8 0
8 I
B l
I 1
a a
a a
e a
e I
l I
0 0
0 8
a a
e a
a a
e e
i B
I 9
8 0
8 6
e a
e a
a e
a a
0 0
0 4
0 8
6 5
e e
e a
e a
a e,
0 0
0 0
t i
I e
a a
a a
e a
a e
4 8
0 0
I I
B a
e a
e a
e a
n 0
8 0
5 9
e a
e a
e a
e e
0 0
0 8
8 8
8 8
a e
e e
e e
a a
0 8
8 0
4 0
0 0
e t
a a
a e
a e
G 8
0 4
4 0
a e
a e
a a
a e
4 0
0 4
4 8
a e
e a
e a
n a
t 0
4 0
0 0
0 i
a e
a a
a a
a a
i 0
0 4
0 4
4 4
8 e
a a
a e
a e
n I
e e
s e
e a
s e
a a
a a
e r
i e
a e
l
~
n a
a a
e i
e e
e a
e e
a a
i.
i.
e.
i.
i.
i a
I e
e.
e e
A e
e a
a 1
A e
e a
I f
1 I
I B
I a
a a
i e
a a
a a
a a
a g
e e
a 1
i OTP 6.02 Rev. O i
e Page 8
__.