ML12298A500: Difference between revisions
StriderTol (talk | contribs) (Created page by program invented by StriderTol) |
StriderTol (talk | contribs) (StriderTol Bot change) |
||
(2 intermediate revisions by the same user not shown) | |||
Line 19: | Line 19: | ||
=Text= | =Text= | ||
{{#Wiki_filter:ES-401 BEAVER VALLEY UNIT 2 Written Examination Review Worksheet Form ES*401*9 | {{#Wiki_filter:ES-401 BEAVER VALLEY UNIT 2 Written Examination Review Worksheet Form ES*401*9 | ||
N S N U Re-write I restructure Q to increase discriminatory value Instructions | : 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. | ||
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO 8/MIN utE/S Explanation Focus Dist. Link units ward KIA Only 1 H 2 B S NOTE: Change DROPPING to LOWERING thru out exam 2 H 2 X M E Delete LHSI from B for parallelism 3 F 2 B S 4 H 3 N S 5 H 3 X N E Replace "Mode 5" with RCS press & temp. Add AOP2.10.1 to 8 X m 6 H 2 B E Add PORV response as 3 response. | |||
7 H 2 N S 8 F 1 X N U Re-write I restructure Q to increase discriminatory value Instructions | |||
[Refer to Section 0 of ES-401 and Appendix B for additional information regarding each of the following concepts.} | [Refer to Section 0 of ES-401 and Appendix B for additional information regarding each of the following concepts.} | ||
: 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level. 2. Enter the level of difficulty (LOD) of each question using a 1 5 (easy difficult) rating scale (questions in the 2 -4 range are acceptable). 3. Check the appropriate box if a psychometric flaw is The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, The answer choices are a collection of unrelated true/false The distractors are not credible; single implausible distractors should be repaired, more than one is One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by 4. Check the appropriate box if a job content error is The question is not linked to the job requirements (I.e., the question has a valid KIA but, as written, is not operational in The question requires the recall of knowledge that is too specific for the closed reference test mode (I.e., it is not required to be known from The question contains data with an unrealistic level of accuracy or inconsistent units (e.g .* panel meter in percent with question in The question requires reverse logic or application compared to the job | : 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level. | ||
: 5. Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable). | : 2. Enter the level of difficulty (LOD) of each question using a 1 5 (easy difficult) rating scale (questions in the 2 - 4 range are acceptable). | ||
: 6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f. 7. Based on the reviewer's judgment. | : 3. Check the appropriate box if a psychometric flaw is identified: | ||
is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement. | The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information). | ||
or (S)atisfactory? | The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc). | ||
: 8. At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met). | ** The answer choices are a collection of unrelated true/false statements. | ||
ES*401 2 Form ES-401-9 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job-Minutia #1 Back-Q= SRO B/M/N utE/S Explanation Focus Dis!. Link units ward KIA Only 9 H 2 X N E Replace 1. To increase discriminatory value 10 H 2 N S 11 H 2 N S 12 H 3 N '" | The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable. | ||
Highlight lAW. 17 H 2 B S 18 H 3 X B E Change RWST level to 29 inches. 19 F 3 N S 20 F 2 X N U KIA is vague. Reselect KIA 21 F 2 A B E Make distractor A Halon only. 22 F 3 N S 23 F 3 A N E Modify A 24 F 2 X N U Provide RCP status in stem and modify A&C 25 F 2 D B E Replace D (PZR) with PZR surge line welds. 26 H 2 X N E Provide breaker position vs stating LOOP. Make C/D rate 20 F/hr. 27 H 2 B S 28 H 3 N S ES-401 3 Form ES-401-9 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job-Minutia #/ Back-Q= SRO B/M/N utE/S Explanation Focus Dist. Link units ward KIA Only 29 H 3 X N E Specify that both units trip. 30 H 2 N S 31 H 3 X N E Provide multiple figures to avoid DLU. Delete 3 | * One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem). | ||
43 F 2 B B E Change B to Less AFW flow. 44 H 2 B S 45 F 2 A,B,D B U Why plausible for grid voltage to rise? Replace/restructure 46 H 3 X N E Change stem to imply NI-41 is still energized. | : 4. Check the appropriate box if a job content error is identified: | ||
47 H 3 N S , | * The question is not linked to the job requirements (I.e., the question has a valid KIA but, as written, is not operational in content). | ||
55 I F I 2 I X I I I A I I I I I I I I N E | * The question requires the recall of knowledge that is too specific for the closed reference test mode (I.e., it is not required to be known from memory). | ||
Delete "for control and protection" in 59 J H I 2 I I I I I I I I I I I I B I 60 I H I 3 I I I I D I I I I I I I I N I E Modify D to parallel choice S X I I I I I I I I I I I N I E Make separate bullet for "defeated". | The question contains data with an unrealistic level of accuracy or inconsistent units (e.g .* panel meter in percent with question in gallons). | ||
Add impact on fuel movement. | The question requires reverse logic or application compared to the job requirements. | ||
X I I N I E I Remove 3 | : 5. Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable). | ||
&replace two days with week in D. X N E I Add the directing of operators to disctractors | : 6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f. | ||
ES-401 5 Form ES-401-9 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job-Minutia #/ Q= SRO 6/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 69 H 2 X N U Track TS vs entering TS. Re-writel replace Q. 70 H 2 N S 71 F 2 N S 72 F 1 X B U Replace with emergency dose kno\\4edge 73 F 3 N S 74 H 3 N S 75 F 2 A,C N U Conditions in A&C degrade plant therefore not plausible. | : 7. Based on the reviewer's judgment. is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement. or (S)atisfactory? | ||
Replace. 76 H 4 N S 77 H 3 X N E Typo in first sentence add "occurred" 78 H 2 X N E Add "as soon as" to 6&D. 79 H 3 X N E Remove "Mode 3" and provide RCS P&T. 80 H 3 N S 81 H 3 N S 82 H 2 X N U Answerable by systems knowledge and AOP purpose. Modify Q. 83 H 2 X N E Add PSMS & DRMS to bullets as appropriate. | : 8. At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met). | ||
84 H 2 X N E SG pressure should be higher. 85 H 4 X N E Delete 0 phrases and last part of question 86 H 3 X N E Provide press & temp vs "Mode 4. | |||
6 Form ES-401-9 | ES*401 2 Form ES-401-9 | ||
: 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. | |||
& replace | Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N utE/S Explanation Focus Dis!. Link units ward KIA Only 9 H 2 X N E Replace 1. To increase discriminatory value 10 H 2 N S 11 H 2 N S 12 H 3 N '" | ||
st 13 H 3 X N E Delete "is acknowledged" from 1 circled bullet 14 F 2 C N E Replace C with ASDV 15 H 3 N S 16 F 2 D N E Replace D with aux building sump level decreasing. Highlight lAW. | |||
17 H 2 B S 18 H 3 X B E Change RWST level to 29 inches. | |||
19 F 3 N S 20 F 2 X N U KIA is vague. Reselect KIA 21 F 2 A B E Make distractor A Halon only. | |||
22 F 3 N S 23 F 3 A N E Modify A 24 F 2 X N U Provide RCP status in stem and modify A&C 25 F 2 D B E Replace D (PZR) with PZR surge line welds. | |||
26 H 2 X N E Provide breaker position vs stating LOOP. Make C/D rate 20 F/hr. | |||
27 H 2 B S 28 H 3 N S | |||
ES-401 3 Form ES-401-9 | |||
: 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. | |||
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #/ Back- Q= SRO B/M/N utE/S Explanation Focus Dist. Link units ward KIA Only 29 H 3 X N E Specify that both units trip. | |||
30 H 2 N S m | |||
31 H 3 X N E Provide multiple figures to avoid DLU. Delete 3 part. | |||
32 H 3 X D N U De!ete uf\w~ode 4." S! actuation could make 0 correct. | |||
33 F 3 N S 34 H 2 N S 35 H 1 N U Tests same concept as Q3 - replace. | |||
36 H 2 C N E Change C to have B/U heaters OFF. | |||
37 H 2 N S 38 H 3 B S 39 H 3 N S 40 F 1 N U Restructure to make more discriminating 41 F 2 X N E Remove "ADMINISTRATIVE" from stem. | |||
42 H 3 X B E Need to state "NSA" wrt header alignment? | |||
43 F 2 B B E Change B to Less AFW flow. | |||
44 H 2 B S 45 F 2 A,B,D B U Why plausible for grid voltage to rise? Replace/restructure 46 H 3 X N E Change stem to imply NI-41 is still energized. | |||
47 H 3 N S | |||
,118 F 3 N S | |||
ES-401 4 Form ES-401-9 00 I 1. | |||
LOK I 2. | |||
LOD I 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. | |||
(F/H) (1-5) I Stem Cues T/F Focus Credo Partial Job- Minutia #I Back-Dist. Link units ward Q= SRO B/M/N U/E/S KIA Only Explanation 49 I H I 2 I A.S S E Plausible to think EDG would trip? Add non emergency EDG trip. | |||
50 H 3 I I I I A I I I I I I I I N I E Replace A 51 H 3 I I I I I I I I I I I I I 52 H 2 53 F 2 N S 54 H 1 N U INo CIS needed. Make applicant consider Phase AlB actuation. | |||
55 I F I 2 I X I I I A I I I I I I I I N E IChange distractor A and modify D 56 F 2 N S I 57 F 3 N S 58 F 2 X N E Channel vs channels. Delete "for control and protection" in D. | |||
59 J H I 2 I I I I I I I I I I I I B I s 60 I H I 3 I I I I D I I I I I I I I N I E Modify D to parallel choice A. | |||
S X I I I I I I I I I I I N I E Make separate bullet for "defeated". Add impact on fuel movement. | |||
X I I N I E I Remove 3 mbullet. | |||
X x t Filenet is available & replace two days with week in D. | |||
X N E I Add the directing of operators to disctractors N U l Choose from among systems how to verify alarms. Modify Q. | |||
ES-401 5 Form ES-401-9 | |||
: 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. | |||
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #/ 6ack Q= SRO 6/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 69 H 2 X N U Track TS vs entering TS. Re-writel replace Q. | |||
70 H 2 N S 71 F 2 N S 72 F 1 X B U Replace with emergency dose kno\\4edge 73 F 3 N S 74 H 3 N S 75 F 2 A,C N U Conditions in A&C degrade plant therefore not plausible. Replace. | |||
76 H 4 N S 77 H 3 X N E Typo in first sentence add "occurred" 78 H 2 X N E Add "as soon as" to 6&D. | |||
79 H 3 X N E Remove "Mode 3" and provide RCS P&T. | |||
80 H 3 N S 81 H 3 N S 82 H 2 X N U Answerable by systems knowledge and AOP purpose. Modify Q. | |||
83 H 2 X N E Add PSMS & DRMS to bullets as appropriate. | |||
84 H 2 X N E SG pressure should be higher. | |||
85 H 4 X N E Delete 0 phrases and last part of question 86 H 3 X N E Provide press & temp vs "Mode 4. | |||
ES-401 6 Form ES-401-9 00 I 1. | |||
LOK (F/H) 2. | |||
LOD (1-5) | |||
: 3. Psychometric Flaws Stem Cues T/F | |||
: 4. Job Content Flaws Credo Partial Job- Minutia #1 Back- | |||
: 5. Other 6. | |||
7. | |||
Q= SRO B/M/N UtE/S I 8. | |||
Explanation Focus Dist. Link units ward KIA Only "I | |||
88 89 I H H | |||
H I | |||
2 2 | |||
2 | |||
; X X | |||
B,D N | |||
N N | |||
S E | |||
E 1Do , mode ""'9' wdh ri,k ,,,,,,moot "''''''''Y. | |||
I Replace dilution with loss of FW heater. Add "lAW.." to A&B. | |||
90 I H I 2 N S I I 2 N S H | |||
F 2 D B E o not plausible. | |||
H I 3 N S 94 I H I 3 X N E 6 & 7 too close therefore one is wrong. C contains only 6. | |||
95 I H I 2 N S 96 I H I 2 X N E Clarify which manager in B&C. | |||
97 F 2 N S 98 H 2 N S N S U 3rd EP Q and 4th fuel handling Q - Re-select & replace}} |
Latest revision as of 22:30, 1 March 2020
ML12298A500 | |
Person / Time | |
---|---|
Site: | Beaver Valley |
Issue date: | 09/14/2012 |
From: | David Silk Operations Branch I |
To: | Rudolph W FirstEnergy Nuclear Operating Co |
Jackson D | |
Shared Package | |
ML12136A033 | List: |
References | |
TAC U01850 | |
Download: ML12298A500 (6) | |
Text
ES-401 BEAVER VALLEY UNIT 2 Written Examination Review Worksheet Form ES*401*9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO 8/MIN utE/S Explanation Focus Dist. Link units ward KIA Only 1 H 2 B S NOTE: Change DROPPING to LOWERING thru out exam 2 H 2 X M E Delete LHSI from B for parallelism 3 F 2 B S 4 H 3 N S 5 H 3 X N E Replace "Mode 5" with RCS press & temp. Add AOP2.10.1 to 8 X m 6 H 2 B E Add PORV response as 3 response.
7 H 2 N S 8 F 1 X N U Re-write I restructure Q to increase discriminatory value Instructions
[Refer to Section 0 of ES-401 and Appendix B for additional information regarding each of the following concepts.}
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 5 (easy difficult) rating scale (questions in the 2 - 4 range are acceptable).
- 3. Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc).
- The answer choices are a collection of unrelated true/false statements.
The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
- One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
- The question is not linked to the job requirements (I.e., the question has a valid KIA but, as written, is not operational in content).
- The question requires the recall of knowledge that is too specific for the closed reference test mode (I.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g .* panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable).
- 6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7. Based on the reviewer's judgment. is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement. or (S)atisfactory?
- 8. At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).
ES*401 2 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N utE/S Explanation Focus Dis!. Link units ward KIA Only 9 H 2 X N E Replace 1. To increase discriminatory value 10 H 2 N S 11 H 2 N S 12 H 3 N '"
st 13 H 3 X N E Delete "is acknowledged" from 1 circled bullet 14 F 2 C N E Replace C with ASDV 15 H 3 N S 16 F 2 D N E Replace D with aux building sump level decreasing. Highlight lAW.
17 H 2 B S 18 H 3 X B E Change RWST level to 29 inches.
19 F 3 N S 20 F 2 X N U KIA is vague. Reselect KIA 21 F 2 A B E Make distractor A Halon only.
22 F 3 N S 23 F 3 A N E Modify A 24 F 2 X N U Provide RCP status in stem and modify A&C 25 F 2 D B E Replace D (PZR) with PZR surge line welds.
26 H 2 X N E Provide breaker position vs stating LOOP. Make C/D rate 20 F/hr.
27 H 2 B S 28 H 3 N S
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #/ Back- Q= SRO B/M/N utE/S Explanation Focus Dist. Link units ward KIA Only 29 H 3 X N E Specify that both units trip.
30 H 2 N S m
31 H 3 X N E Provide multiple figures to avoid DLU. Delete 3 part.
32 H 3 X D N U De!ete uf\w~ode 4." S! actuation could make 0 correct.
33 F 3 N S 34 H 2 N S 35 H 1 N U Tests same concept as Q3 - replace.
36 H 2 C N E Change C to have B/U heaters OFF.
37 H 2 N S 38 H 3 B S 39 H 3 N S 40 F 1 N U Restructure to make more discriminating 41 F 2 X N E Remove "ADMINISTRATIVE" from stem.
42 H 3 X B E Need to state "NSA" wrt header alignment?
43 F 2 B B E Change B to Less AFW flow.
44 H 2 B S 45 F 2 A,B,D B U Why plausible for grid voltage to rise? Replace/restructure 46 H 3 X N E Change stem to imply NI-41 is still energized.
47 H 3 N S
,118 F 3 N S
ES-401 4 Form ES-401-9 00 I 1.
LOK I 2.
LOD I 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
(F/H) (1-5) I Stem Cues T/F Focus Credo Partial Job- Minutia #I Back-Dist. Link units ward Q= SRO B/M/N U/E/S KIA Only Explanation 49 I H I 2 I A.S S E Plausible to think EDG would trip? Add non emergency EDG trip.
50 H 3 I I I I A I I I I I I I I N I E Replace A 51 H 3 I I I I I I I I I I I I I 52 H 2 53 F 2 N S 54 H 1 N U INo CIS needed. Make applicant consider Phase AlB actuation.
55 I F I 2 I X I I I A I I I I I I I I N E IChange distractor A and modify D 56 F 2 N S I 57 F 3 N S 58 F 2 X N E Channel vs channels. Delete "for control and protection" in D.
59 J H I 2 I I I I I I I I I I I I B I s 60 I H I 3 I I I I D I I I I I I I I N I E Modify D to parallel choice A.
S X I I I I I I I I I I I N I E Make separate bullet for "defeated". Add impact on fuel movement.
X I I N I E I Remove 3 mbullet.
X x t Filenet is available & replace two days with week in D.
X N E I Add the directing of operators to disctractors N U l Choose from among systems how to verify alarms. Modify Q.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #/ 6ack Q= SRO 6/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 69 H 2 X N U Track TS vs entering TS. Re-writel replace Q.
70 H 2 N S 71 F 2 N S 72 F 1 X B U Replace with emergency dose kno\\4edge 73 F 3 N S 74 H 3 N S 75 F 2 A,C N U Conditions in A&C degrade plant therefore not plausible. Replace.
76 H 4 N S 77 H 3 X N E Typo in first sentence add "occurred" 78 H 2 X N E Add "as soon as" to 6&D.
79 H 3 X N E Remove "Mode 3" and provide RCS P&T.
80 H 3 N S 81 H 3 N S 82 H 2 X N U Answerable by systems knowledge and AOP purpose. Modify Q.
83 H 2 X N E Add PSMS & DRMS to bullets as appropriate.
84 H 2 X N E SG pressure should be higher.
85 H 4 X N E Delete 0 phrases and last part of question 86 H 3 X N E Provide press & temp vs "Mode 4.
ES-401 6 Form ES-401-9 00 I 1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws Stem Cues T/F
- 4. Job Content Flaws Credo Partial Job- Minutia #1 Back-
- 5. Other 6.
7.
Q= SRO B/M/N UtE/S I 8.
Explanation Focus Dist. Link units ward KIA Only "I
88 89 I H H
H I
2 2
2
- X X
B,D N
N N
S E
E 1Do , mode ""'9' wdh ri,k ,,,,,,moot "'''Y.
I Replace dilution with loss of FW heater. Add "lAW.." to A&B.
90 I H I 2 N S I I 2 N S H
F 2 D B E o not plausible.
H I 3 N S 94 I H I 3 X N E 6 & 7 too close therefore one is wrong. C contains only 6.
95 I H I 2 N S 96 I H I 2 X N E Clarify which manager in B&C.
97 F 2 N S 98 H 2 N S N S U 3rd EP Q and 4th fuel handling Q - Re-select & replace