ML021160212
| ML021160212 | |
| Person / Time | |
|---|---|
| Site: | Perry  |
| Issue date: | 03/05/2002 |
| From: | Dave Hills NRC/RGN-III/DRS/OLB |
| To: | |
| References | |
| 50-440/02301, ES-401-9 | |
| Download: ML021160212 (23) | |
Text
PERRY INITIAL LICENSE EXAM MARCH 5 THRU 13, 2002 Form ES-401-9, "Written Examination Review Worksheet"
ES-401 PERRY Written Examination Form ES-401-9 Review Worksheet
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws 5.Other
- 6.
- 7.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues TIF Cred. IPartial Job-Minutiaj #1 Back-QI SRO UIE/S Explanation FocusI I
Dist.
Link 1units ward K/A Only I
I 1.*
H 3
S Q=K/A and reference material reviewed.
2.*
F 3
S Q=K/A and reference material reviewed.
3*
F 3
X U
See attached comments, Q=K/A, and, reference material reviewed.
4.*
F 2
E See attached comments, Q=K/A, and reference material reviewed.
5.*
H 3
S Q=K/A and reference material reviewed.
6.*
F 3
E See attached comments, Q=K/A, and, reference material reviewed.
7.*
F 3
S Q=K/A and reference material reviewed.
8.*
H 3
S Q=K/A and reference material reviewed.
9.*
H 3
S Q=KIA and reference material reviewed.
10..
F 3
S Q=K/A and reference material reviewed.
Instructions
[Refer to Section D of ES-401 andAppendix B for additional information regarding each of the following concepts.]
- 1.
Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2.
Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).
- 3.
Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
The answer choices are a collection of unrelated true/false statements.
More than one distractor is not credible.
One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4.
Check the appropriate box if a job content error is identified:
The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
- 5.
Check the appmprrate box/f the amped question doesnotmatch thaapproved K/kor anSRO-onl jquestionr isnot at the-SRO level.
i6, Based on the reviewers judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
1167.
For any "U" ratings, at a minimum, explain how the Appendix B psychometric attributes are not being met.
- Question used for "30 question" initial review.
NUREG-1021, Revision 8 June 2000
ES-401 2
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws 5 5Other
- 6.
- 7.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Cred. jPartial Job-Minutia
- /I Back-Q; SRO U/E/S Explanation Focus Dist.I__ Link lunitslward JK/A OnlyJ_
11.*
H 4
S Q=K/A and reference material reviewed.
12.*
H 3
S Q=K/A and reference material reviewed.
13.*
H 4
S Q=KIA and reference material reviewed.
14.*
F 2
S Q=KIA and reference material reviewed.
15.*
F 3
X U
See attached comments, Q=K/A, and reference material reviewed.
16.*
H 3
S Q=K/A and reference material reviewed.
17.*
F 3
X U
See attached comments, Q=K/A, and reference material reviewed.
18.*
H 3
S Q=K/A and reference material reviewed.
19.*
F 3
X U
See attached comments, Q=K/A, and reference material reviewed.
20.*
F 3
S Q=K/A and reference material reviewed.
21.*
H 3
X U
See attached comments, Q=K/A, and reference material reviewed.
22.*
H 3
S Q=K/A and reference material reviewed.
23.*
H 3
S Q=K/A and reference material reviewed.
24.*
F 3
S Q=K/A and reference material reviewed.
25.*
F 4
S Q=K/A, and reference material reviewed.
26.*
H 4
E See attached comments, Q=K/A, and reference material reviewed.
27.*
H 3
X U
See attached comments, Q=K/A, and reference material reviewed.
28.*
H 3
E See attached comments, Q=K/A, and reference material reviewed.
29.*
H 3
S Q=K/A and reference material reviewed.
[30*
H 3
S Q=K/A and reference material reviewed.
- Question used for "30 question" initial review.
NUREG-1021, Revision 8 June 2000
ES-401 3
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws 5 Other
- 6.
- 7.
Q#
LOK LOD (F/H)
(1-5)
Stem CuesI TIF Cred. Partial Job-Minutia
- /
Back-Q, SRO U/E/S Explanation FocusI I Dist.
Link unitsfward K/A I Only
- 31.
H 2
E See attached comments, Q=KIA, and reference material reviewed.
- 32.
F 3
S Q=KIA, and reference material reviewed.
- 33.
H 3
X U
See attached comments, Q=K/A, and reference material reviewed.
- 34.
H 3
S Q=KJA and reference material reviewed.
- 35.
H 3
X U
See attached comments, Q=KIA, and reference material reviewed.
- 36.
F 3
X U
See attached comments, Q=KIA, and reference material reviewed.
- 37.
F 3
X U
See attached comments, Q=K/A, and reference material reviewed.
- 38.
H 4
S Q=KIA and reference material reviewed.
- 39.
F 3
X U
See attached comments, Q=KIA, and reference material reviewed.
- 40.
H 2
S Q=K/A and reference material reviewed.
- 41.
H 3
X U
See attached comments, Q=KIA, and reference material reviewed.
- 42.
F 3
S Q=KJA and reference material reviewed.
- 43.
F 3
X U
See attached comments, Q=KIA, and reference material reviewed.
- 44.
H 4
S Q=K/A and reference material reviewed.
- 45.
H 3
S Q=K/A and reference material reviewed.
- 46.
F 5
X U
See attached comments, Q=KIA, and reference material reviewed.
- 47.
H 3
S Q=KIA and reference material reviewed.
- 48.
F 5
X U
See attached comments, Q=KIA, and reference material reviewed.
June 2000 NUREG-1021, Revision 8
ES-401 4
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
Q#
LOK LOD (F/H)
(1-5)
Stem Cues T/F Cred. IPartial Job-Minutia
- / IBack-1 Q SRO1 U/E/S Explanation Focus I Dist.
Link I Iunits ward 1K/A.Onlyl
- 49.
F 3
S Q=K/A and reference material reviewed.
- 50.
H 3
X U
See attached comments, Q=K/A, and reference material reviewed.
- 51.
F 3
E See attached comments, Q=KIA, and reference material reviewed.
- 52.
H 3
S Q=K/A and reference material reviewed.
- 53.
F 5
X U
See attached comments, Q=K/A, and reference material reviewed.
- 54.
F 5
X U
See attached comments, Q=K/A, and reference material reviewed.
- 55.
H 3
S Q=K/A and reference material reviewed.
- 56.
F 3
E See attached comments, Q=K/A, and reference material reviewed.
- 57.
H 3
E See attached comments, Q=K/A, and reference material reviewed.
- 58.
H 3
S Q=K/A and reference material reviewed.
- 59.
F 3
S Q=K/A and reference material reviewed.
- 60.
F 3
X U
Q=K/A and reference material reviewed.
- 61.
H 3
S Q=K/A and reference material reviewed.
- 62.
F 3
S Q=K/A and reference material reviewed.
- 63.
H 3
S Q=K/A and reference material reviewed.
- 64.
H 3
E See attached comments, Q=K/A, and reference material reviewed.
- 65.
H 2
S Q=K/A and reference material reviewed.
- 66.
H 3
S Q=K/A and reference material reviewed.
June 2000 NUREG-1021, Revision 8
ES-401 5
Form ES-401-9
- 1.
2,
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
Q#
LOK LOD (F/H) (1-5)
Stem Cues T/F ýCred. Partial Job-Minutia
- /
Back-Q,- SRO U/E/S Explanation Focus Dist.
Link J
units ward K/A Oniy
- 67.
F 3
S Q=KJA and reference material reviewed.
- 68.
H 5
X U
See attached comments, Q=K/A, and reference material reviewed.
- 69.
F 2
X U
See attached comments, Q=K/A, and reference material reviewed.
- 70.
F 3
S Q=K/A and reference material reviewed.
- 71.
F 3
S Q=K/A and reference material reviewed.
72(ro).
H 3
S Q=K/A and reference material reviewed.
73(ro).
H 3
S Q=K/A and reference material reviewed.
74(ro).
F 2
X U
See attached comments, Q=KIA, and reference material reviewed.
75(ro).
F 2
S Q=K/A and reference material reviewed.
76(ro).
F 3
S Q=K/A and reference material reviewed.
77(ro).
F 5
X U
See attached comments, Q=KJA, and reference material reviewed.
78(ro).
H 3
S Q=K/A and reference material reviewed.
79(ro).
H 2
E See attached comments, Q=K/A, and reference material reviewed.
80(ro).
F 3
S Q=K/A and reference material reviewed.
81(ro).
F 3
S Q=K/A and reference material reviewed.
82(ro).
H 4
S Q=K/A and reference material reviewed.
83(ro).
H 4
S Q=K/A and reference material reviewed.
84(ro).
H 3
S Q=K/A and reference material reviewed.
June 2000 NUREG-1021, Revision 8
ES-401 6
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
Q#
LOK LOD fItI1 (F/IH) (1-5) Stem Cues T/F TCred. jPartial Job-Minutia
- 1 Back-j Q*
SRO U/E/S Explanation Focus
__ J "Dist.
Link IunitsJ ward K/A Only 85(ro).
H 3
E See attached comments, Q=K/A, and reference material reviewed.
86(ro).
F 3
S Q=K/A, and reference material reviewed.
87(ro).
H 3
S Q=K/A and reference material reviewed.
88(ro).
F 2
S Q=K/A and reference material reviewed.
89(ro).
F 3
S Q=K/A and reference material reviewed.
90(ro).
H 4
S Q=K/A and reference material reviewed.
91(ro).
H 3
E See attached comments, Q=K/A, and reference material reviewed.
92(ro).
F 2
S Q=KIA and reference material reviewed.
93(ro).
F 3
S Q=K/A and reference material reviewed.
94(ro).
F 3
S Q=K/A and reference material reviewed.
95(ro).
F 3
S Q=K/A and reference material reviewed.
96(ro).
F 3
S Q=K/A and reference material reviewed.
97(ro).
H 3
S Q=K/A and reference material reviewed.
98(ro).
H 3
S Q=K/A and reference material reviewed.
99(ro).
F 3
X U
See attached comments, Q=K/A, and reference material reviewed.
I00(ro).
F 3
S Q=K/A and reference material reviewed.
72(sro).
H 3
X E
See attached comments, Q=K/A, and reference material reviewed.
3(sro).
F 3
X X
U See attached comments, Q=K/A, and reference material reviewed.
June 2000 NUREG-1021, Revision 8
0 ES-401 7
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws 5.Other
- 6.
- 7.
Q#
LOK LOD (F/H) (1-5) Stem Cues 1 T/F Cred. Partial Job-1 Minutia
- /
Back-Q, SRO U/E/S Explanation Focus II I
Dist. I Link l unitsward K/A Only 74(sro).
F 3
S Q=K/A and reference material reviewed.
75(sro).
H 3
S Q=K/A and reference material reviewed.
76(sro).
H 3
S Q=K/A and reference material reviewed.
77(sro).
H 3
S Q=K/A and reference material reviewed.
78(sro).
H 3
S Q=K/A and reference material reviewed.
79(sro).
H 4
S Q=K/A and reference material reviewed.
30(sro).
H 3
U See attached comments, Q=K/A, and reference material reviewed.
1(sro).
F 3
S Q=K/A and reference material reviewed.
32(sro).
F 3
S Q=K/A and reference material reviewed.
33(sro).
F 3
X X
U See attached comments, Q=K/A, and reference material reviewed.
34(sro).
H 3
S Q=K/A and reference material reviewed.
35(sro).
H 3
S Q=K/A and reference material reviewed.
36(sro).
H 3
X E
See attached comments, Q=K/A, and reference material reviewed.
37(sro).
H 3
X E
See attached comments, Q=K/A, and reference material reviewed.
38(sro).
F 3
E See attached comments, Q=K/A, and reference material reviewed.
L9(sro).
F 3
S Q=K/A and reference material reviewed.
0(sro).
F 2
X U
See attached comments, Q=K/A, and reference material reviewed.
1(sro).
F 2
E See attached comments, Q=K/A, and reference material reviewed.
June 2000 NUREG-1021, Revision 8
ES-401 8
Form ES-401-9
- 1.
- 2.
- 3. Psychometric Flaws
- 4. Job Content Flaws
- 5. Other
- 6.
- 7.
Q#
LOK LOD (F/H) (1-5)
Stem Cues TIF Cred. Partial Job-Minutial #/Back-Q, SRO UIE/S Explanation Focus Dist.
II ILink units ward K/A Only 92(sro).
H 3
X U
See attached comments, Q=K/A, and reference material reviewed.
93(sro).
H 4
E See attached comments, Q=K/A, and reference material reviewed.
94(sro).
F 3
X U
See attached comments, Q=K/A, and reference material reviewed.
95(sro).
H 4
S Q=K/A and reference material reviewed.
96(sro).
H 3
S Q=K/A and reference material reviewed.
97(sro).
H 4
S Q=K/A and reference material reviewed.
98(sro).
H 3
E See attached comments, Q=K/A, and reference material reviewed.
99(sro).
H 3
S Q=K/A and reference material reviewed.
100(sro).
F 3
S Q=K/A and reference material reviewed.
NUREG-1021, Revision June 2000
Comments on PERRY Written Exam Material Question Number Comment(s)
- 3.
NRC:
Psychometric Flaw; one or more distractors are partially correct. Distractor "D" is also correct. A low SFP level could UNSAT1 cause the SFP surge tank level to decrease resulting in a FPCC pump trip.
LICENSEE
RESPONSE
The licensee modified distractor "D" to be clearly wrong.
- 4.
NRC:
Get rid of "Note." You didn't give a partial list as a possible answer.
LICENSEE
RESPONSE
The licensee agreed and deleted this from the question.
- 6.
NRC:
This is a MEMORY LEVEL question. The applicant is expected to know the automatic and immediate actions for annunciators, including MSL high rads.
LICENSEE
RESPONSE
The licensee agreed and changed the designation to MEMORY level.
- 15.
NRC:
Psychometric Flaw; distractors "B" and "C" are implausible.
UNSAT 2 LICENSEE
RESPONSE
The licensee agreed and improved the distractors for plausability.
- 17.
NRC:
Psychometric Flaw; one or more distractors are partially correct. Distractor "B" is also correct. "Minimizing the amount UNSAT 3 of water injected into the reactor vessel" REGARDLESS of the source is synonymous with "preventing flooding of the main steam lines."
LICENSEE
RESPONSE
The licensee modified distractors "B" and "D" to be clearly wrong.
Sheet 1 of 14
Comments on PERRY Written Exam Material Question Number Comment(s)
- 19.
NRC:
Psychometric Flaw; one or more distractors are partially correct. Distractor "C" is also correct. "continue executing PEI UNSAT4 B13" is synonymous with "re-enter PEI-B13."
LICENSEE
RESPONSE
The licensee modified distractor "C" to be clearly wrong.
- 21.
NRC:
Psychometric Flaw; one or more distractors are partially correct. Distractor "D" is also correct. The system isolates at a UNSAT 5 tank pressure of 9-psig. The stem states that the IA system is at 89 psig. This is too close to the set point. The valves may have not closed yet.
LICENSEE
RESPONSE
The licensee modified the stem and distractor "D" to ensure the distracor was clearly wrong.
- 26.
NRC:
State "half-scram" in distractors "C" and "D."
LICENSEE
RESPONSE
The licensee agreed and modified the distractors to include the term "half-scram."
- 27.
NRC:
Psychometric Flaw; distractors "A" and "D" are implausible. When would power decrease and period remain UNSAT 6 stable and positive? When would power rise yet period be negative?
LICENSEE
RESPONSE
The licensee modified distractors "A" and "D" to be "more plausible."
Sheet 2 of 14
Comments on PERRY Written Exam Material Question Number Comment(s)
- 28.
NRC:
Will reactor pressure go from 1090 to <1083 in 25 seconds or less (particularly under ATWS conditions)? If not, one or more distractors would be correct.
LICENSEE
RESPONSE
The licensee will enhance the stem to make the 20 second time frame, discussed in the stem, clear.
- 31.
NRC:
By giving a value of suppression pool level and temperature right on the line, the LOD is < 2.0. However, if you gave values between such that the applicant would have to "higher" or "lower" lAW the graph, that would increase LOD.
LICENSEE
RESPONSE
The licensee will enhance the question by providing values that require application of the notes on the graph to interpret.
- 33.
NRC:
Psychometric Flaw; one or more distractors are partially correct. Distractor "C" is also correct. The question asks for UNSAT 7 the "most effective" method. Distractors "A" and "B" would not result in rod motion thus would not be effective. The methods described in distractors "C" and "D" would cause rod motion but how would the applicant determine if "C" or "D" were the most effective?
LICENSEE
RESPONSE
The licensee modified distractor "C" to be clearly wrong.
Sheet 3 of 14
Comments on PERRY Written Exam Material Question Number Comment(s)
- 35.
NRC:
Psychometric Flaw; no correct answer is provided. The basis provided in the answer only applies under DBA conditions.
UNSAT 8 Since DBA conditions do not exist, the basis for LLS is simply to minimize valve cycling and prolong the life of the SRVs.
LICENSEE
RESPONSE
The licensee modified the correct answer, "A," to be based on the basis provided in the student text for LLS.
- 36.
NRC:
The question does not match the referenced K/A. The K/A concerns reactor low water level and the reasons for spray UNSAT 9 cooling. The question simply asks which system responds to the conditions in the stem. The applicant need only know that HPCS initiated. No knowledge of the reasons for the concept of spray cooling is required to answer the question.
LICENSEE
RESPONSE
The licensee re-wrote the question and provided it to the NRC for review. The re-written question was also unsat, in that, it was considered a memory level question concerning ECCS acceptance criteria from 10 CFR 50. The licensee again re wrote the question and was able to develop a question that met the K/A.
- 37.
NRC:
Psychometric Flaw; one or more distractors are partially correct. Distractors "C" is also be correct. The basis states UNSAT 10 that the temperature limits are based on "equipment qualifications." Why doesn't this include the qualifications of the cooling units?
LICENSEE
RESPONSE
The licensee modified distractor "C" to be clearly wrong.
Sheet 4 of 14
Comments on PERRY Written Exam Material Question Number Comment(s)
- 39.
NRC:
Psychometric Flaw; one or more distractors are partially correct. Distractor "A" is also correct. "Maintenance UNSAT11 representatives" assigned to a crew are typically also "operating representatives."
LICENSEE
RESPONSE
The licensee modified distractor "A" to be clearly wrong.
- 41.
NRC:
Psychometric Flaw; one or more distractors are partially correct. Distractor "C" may also be correct. Won't run out UNSAT 12 eventually lead to cavitation thus distractor "C" would also be correct.
LICENSEE
RESPONSE
The licensee included pump flow information in the stem that precludes the concept of run-out from being a possible answer.
- 43.
NRC:
Psychometric Flaw; one or more distractors are partially correct. Distractor "A" is also correct. Reactor pressure less UNSAT 13 than 250 psig would prevent an operator from manually opening the SRV.
LICENSEE
RESPONSE
The licensee replaced this question. The new question meets NUREG-1021 requirements.
- 46.
NRC:
Tech Spec basis questions are not appropriate for an RO exam. It would; however, be considered an "SRO only" UNSAT 14 question.
LICENSEE
RESPONSE
The licensee decided to use this as-is on the SRO exam. The proposed replacement question for the RO exam did not meet the intent of the K/A. The replacement question meets NUREG 1021 requirements.
Sheet 5 of 14
Comments on PERRY Written Exam Material Question Number Comment(s)
- 48.
NRC:
This EOP basis question is not appropriate for an RO exam.
It would; however, be considered an "SRO only" question.
UNSAT15 LICENSEE
RESPONSE
The licensee decided to use this as-is on the SRO exam.
Modified the RO version to test at the appropriate level.
NRC:
LICENSEE
RESPONSE
NRC:
LICENSEE
RESPONSE
The question does not match the referenced K/A. The K/A concerns manipulation of controls. The questions tests the applicant's knowledge of a procedural limitation on rod withdrawal.
The licensee replaced this question. The proposed replacement had two correct answers. The licensee replaced it with a question from their bank. The new question meets NUREG 1021 requirements.
Not modified in accordance with NUREG-1021. In order for a question to be considered modified, lAW NUREG-1021, you must:
Change at least 1 pertinent condition in the stem; and
° Change at least 1 distractor.
OR Change the conditions in the stem such that one of the three distractors in the original question becomes the correct answer.
In this case, no pertinent condition in the stem was changed.
The licensee agreed and changed the designation to BANK.
Sheet 6 of 14
- 50.
- UNSAT1,
Comments on PERRY Written Exam Material Question Number 51.
Comment(s)
NRC:
LICENSEE
RESPONSE
Not modified in accordance with NUREG-1021. In order fora question to be considered modified, lAW NUREG-1021, you must:
Change at least 1 pertinent condition in the stem; and Change at least 1 distractor.
OR Change the conditions in the stem such that one of the three distractors in the original question becomes the correct answer.
In this case, no pertinent condition in the stem was changed.
The licensee agreed and will change the designation to BANK.
- 53.
NRC:
This EOP question is not appropriate for an RO exam. It would; however, be considered an "SRO only" question.
UNSAT 17 LICENSEE
RESPONSE
The licensee decided to use this as-is on the SRO exam. The replacement RO exam question meets NUREG-1 021 requirements.
- 54.
NRC:
This Tech Spec basis question is not appropriate for an RO exam. It would; however, be considered an "SRO only" UNSAT 18 question.
LICENSEE
RESPONSE
The licensee replaced this with a question that meets NUREG 1021 requirements.
- 56.
NRC:
This is a MEMORY LEVEL question. The applicant is expected to know the automatic response of the ATWS inverter to an undercurrent condition.
LICENSEE
RESPONSE
The licensee agreed and changed the designation to MEMORY level.
Sheet 7 of 14
Comments on PERRY Written Exam Material Question Number Comment(s)
- 57.
NRC:
Where does the basis for condenser over pressurization come from?
LICENSEE
RESPONSE
The licensee produced a GE "design document" that discusses this. They will incorporate this basis into the system lesson plan.
- 60.
NRC:
Psychometric Flaw; one or more distractors are partially correct. Distractor "D" is also correct. If the Superintendent of UNSAT 19 Plant Operations can be a licensed senior reactor operator, distractor "D" is also correct.
LICENSEE
RESPONSE
The licensee modified distractor "D" to indicate that the Plant Manger is not licensed.
- 64.
NRC:
Poor distractor balance. Should modify distractors "B" and "C" to remove the term "automatic."
LICENSEE
RESPONSE
The licensee agreed and removed the term "automatic."
- 68.
NRC:
This EOP question is not appropriate for an RO exam. It would; however, be considered an "SRO only" question.
UNSAT 20 LICENSEE
RESPONSE
The licensee decided to use this as-is on the SRO exam. The licensee re-wrote the RO exam question. The licensee reworded the distractors and the question now meets NUREG 1021 requirements.
Sheet 8 of 14
Comments on PERRY Written Exam Material Question Number Comment(s)
- 69.
NRC:
The question does not match the referenced K/A. The K/A concerns EOPs, high suppression pool temperature, and UNSAT21 temperature monitoring. The question test the applicant's knowledge of how CAMS works.
LICENSEE
RESPONSE
The licensee replaced this with a question from a previous NRC exam.
74(ro).
NRC:
Psychometric Flaw; one or more distractors are partially correct. Distractor "D" is also correct. Halon will coat the fuel UNSAT 22 source and, via chemical reaction, prevents oxygen from reaching the fuel.
LICENSEE
RESPONSE
The licensee modified distractor "D" to be clearly wrong.
77(ro).
NRC:
This EOP question is not appropriate for an RO exam. It would; however, be considered an "SRO only" question. If the UNSAT 23 question is really a systems fundamental question (i.e.,
knowledge of system arrangements or component elevations, etc.), we will allow it. In this case, the RO would have to know the basis of the SRV tail pipe limit and HCTL to answer the question.
LICENSEE
RESPONSE
The licensee modified the question to test a "concept" rather than requiring the memorization of EOP basis by an RO.
79(ro).
NRC:
The reference material does not state whether the EDG will start with only one air bank available or not.
LICENSEE
RESPONSE
The discussion of this concept, from TS basis, will be incorporated into the system lesson plan.
Sheet 9 of 14
Comments on PERRY Written Exam Material Question Number 85(ro).
Comment(s)
NRC:
LICENSEE
RESPONSE
Not modified in accordance with NUREG-1021. In order for a question to be considered modified, lAW NUREG-1021, you must:
Change at least 1 pertinent condition in the stem; and Change at least 1 distractor.
OR Change the conditions in the stem such that one of the three distractors in the original question becomes the correct answer.
In this case, no pertinent condition in the stem was changed.
The licensee agreed and changed the designation to BANK.
91 (ro).
NRC:
The stem asks "which of the following describes the adverse consequences of this event?" Distractors "B", "C" and "D" describe conditions that may not be adverse.
LICENSEE
RESPONSE
The licensee modified the stem so as not to cue the applicant.
99(ro).
NRC:
Psychometric Flaw; no correct answer provided. According to the reference provided and given the conditions in the stem, UNSAT24 M25-FO10A remains closed and M25-FO20B remains open since train "A" was shutdown. This response is not included in the answers provided.
LICENSEE
RESPONSE
The licensee corrected the stem of the question such that there is a correct answer.
72(sro).
NRC:
This question is not considered "SRO only." You asked the same question to ROs in question 82(ro).
LICENSEE
RESPONSE
The licensee changed the designation to a "Both" question.
Sheet 10 of 14 i
Comments on PERRY Written Exam Material Question Number Comment(s) 73(sro).
NRC:
I'll have to see some strip chart data that clearly indicates that a high pressure scram would not also occur based on the given UNSAT 25 plant conditions.
LICENSEE
RESPONSE
The licensee ran this on the simulator and found that their original correct answer was not correct. the question was modified and is now correct but is no longer "SRO only."
80(sro).
NRC:
Psychometric Flaw; all answers partially correct. Can the Plant Manager also be assigned as the Duty Management UNSAT 21 Representative? If he/she can, "A" is also correct. Also, FTI B0002, Note 3 states that contacting the reactor engineer to obtain verbal direction for rod recovery is considered "expeditious." Therefore, distractors "C" and "D" are correct.
LICENSEE
RESPONSE
The licensee modified the stem to indicate no "Duty Management Representative" had been assigned. Also, the licensee modified distractors "C" and "D" to be clearly wrong.
83(sro).
NRC:
Psychometric Flaw; ineffective distractors. Distractors "A" and "B" are ineffective. A reasonable supervisor would not stop UNSAT 27 an operator from taking mitigating actions unless their life were in danger.
LICENSEE
RESPONSE
The licensee rewrote the question. The new question meets NUREG-1021 requirements.
NRC:
This question is not be considered "SRO only." ROs are also required to know RO responsibilities for emergency plan implementation. Need to see RO responsibilities form EPI-B5 and compare them to shift supervisor responsibilities to see if there is a "significant delta."
LICENSEE
RESPONSE
The licensee changed the designation of this to a "Both" question.
Sheet 11 of 14
Comments on PERRY Written Exam Material Question Number Comment(s) 86(sro).
NRC:
This question is not considered "SRO only." ROs are also required to know SJAE system automatic responses to alarming conditions. An RO would be expected to also know that vacuum pump operation is limited to 5% reactor.
LICENSEE
RESPONSE
Although the question remains on the SRO exam, the licensee changed the designation to a "Both" question.
87(sro).
NRC:
This question is not considered "SRO only." ROs are also required to know the impact on shutdown cooling when E12 F008 closes. An RO would also be expected to know alternate means of shutdown cooling.
LICENSEE
RESPONSE
Although the question remains on the SRO exam, the licensee changed the designation to a "Both" question.
88(sro).
NRC:
The K/A concerns EOPs, high drywell pressure, and drywell pressure. The question tests the applicant's knowledge of the basis of the Tech Spec limit for containment differential pressure but the tie to EOPs is weak.
LICENSEE
RESPONSE
The licensee replaced the question with a question from their bank. No longer considered "SRO only." Also, not considered UNSAT due to having been used on a previous NRC exam.
90(sro).
NRC:
This question is not be considered "SRO only." ROs are also required to know which instruments are considered post UNSAT2 8 accident monitoring instruments.
LICENSEE
RESPONSE
The licensee modified to be a "SRO only" question.
Sheet 12 of 14
Comments on PERRY Written Exam Material Question Number Comment(s) 91 (sro).
NRC:
Not modified in accordance with NUREG-1021. In order for a question to be considered modified, lAW NUREG-1021, you must:
° Change at least 1 pertinent condition in the stem; and
° Change at least 1 distractor.
OR Change the conditions in the stem such that one of the three distractors in the original question becomes the correct answer.
In this case, no pertinent condition in the stem was changed.
LICENSEE
RESPONSE
The licensee agreed and changed the designation to BANK.
92(sro).
NRC:
This question is not be considered "SRO only." ROs are also required to know the immediate actions in ARPs. ROs are UNSAT 29 also expected to know entry conditions into off-normal procedures.
LICENSEE
RESPONSE
Although the question remains on the SRO exam, the licensee changed the designation to a "Both" question.
93(sro).
NRC:
No basis was provided that discusses carbon buildup in the exhaust system.
LICENSEE
RESPONSE
The licensee provided a letter stating the "official station stance" on this issue and it supports the question.
Sheet 13 of 14
Comments on PERRY Written Exam Material NRC:
LICENSEE
RESPONSE
The question does not match the referenced K/A. The K/A concerns AOPs, high drywell pressure, and leak rates. The question tests the applicant's knowledge of Tech Spec entry conditions.
The licensee re-wrote the question. The new question meets NUREG-1021 requirements. Although the question remains on the SRO exam, the licensee changed the designation to a "Both" question.
98(sro)
NRC:
Distractor "B" appears implausible. Why would an operator determine that an inoperable piece of equipment was required to be operable yet think that no action was required?
LICENSEE
RESPONSE
The licensee modified distractor "D" to be "more plausible."
Sheet 14 of 14 94(sro).
UNSAT 30