ML12298A500: Difference between revisions
StriderTol (talk | contribs) (Created page by program invented by StriderTol) |
StriderTol (talk | contribs) (StriderTol Bot change) |
||
(One intermediate revision by the same user not shown) | |||
Line 27: | Line 27: | ||
: 2. Enter the level of difficulty (LOD) of each question using a 1 5 (easy difficult) rating scale (questions in the 2 - 4 range are acceptable). | : 2. Enter the level of difficulty (LOD) of each question using a 1 5 (easy difficult) rating scale (questions in the 2 - 4 range are acceptable). | ||
: 3. Check the appropriate box if a psychometric flaw is identified: | : 3. Check the appropriate box if a psychometric flaw is identified: | ||
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information). | The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information). | ||
The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc). | The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc). | ||
Line 36: | Line 35: | ||
* The question is not linked to the job requirements (I.e., the question has a valid KIA but, as written, is not operational in content). | * The question is not linked to the job requirements (I.e., the question has a valid KIA but, as written, is not operational in content). | ||
* The question requires the recall of knowledge that is too specific for the closed reference test mode (I.e., it is not required to be known from memory). | * The question requires the recall of knowledge that is too specific for the closed reference test mode (I.e., it is not required to be known from memory). | ||
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g .* panel meter in percent with question in gallons). | The question contains data with an unrealistic level of accuracy or inconsistent units (e.g .* panel meter in percent with question in gallons). | ||
The question requires reverse logic or application compared to the job requirements. | The question requires reverse logic or application compared to the job requirements. | ||
Line 47: | Line 45: | ||
: 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. | : 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. | ||
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N utE/S Explanation Focus Dis!. Link units ward KIA Only 9 H 2 X N E Replace 1. To increase discriminatory value 10 H 2 N S 11 H 2 N S 12 H 3 N '" | Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N utE/S Explanation Focus Dis!. Link units ward KIA Only 9 H 2 X N E Replace 1. To increase discriminatory value 10 H 2 N S 11 H 2 N S 12 H 3 N '" | ||
st 13 H 3 X N E Delete "is acknowledged" from 1 circled bullet 14 F 2 C N E Replace C with ASDV 15 H 3 N S 16 F 2 D N E Replace D with aux building sump level decreasing. Highlight lAW. | st 13 H 3 X N E Delete "is acknowledged" from 1 circled bullet 14 F 2 C N E Replace C with ASDV 15 H 3 N S 16 F 2 D N E Replace D with aux building sump level decreasing. Highlight lAW. | ||
17 H 2 B S 18 H 3 X B E Change RWST level to 29 inches. | 17 H 2 B S 18 H 3 X B E Change RWST level to 29 inches. | ||
Line 54: | Line 51: | ||
26 H 2 X N E Provide breaker position vs stating LOOP. Make C/D rate 20 F/hr. | 26 H 2 X N E Provide breaker position vs stating LOOP. Make C/D rate 20 F/hr. | ||
27 H 2 B S 28 H 3 N S | 27 H 2 B S 28 H 3 N S | ||
ES-401 3 Form ES-401-9 | ES-401 3 Form ES-401-9 | ||
Line 104: | Line 100: | ||
Explanation Focus Dist. Link units ward KIA Only "I | Explanation Focus Dist. Link units ward KIA Only "I | ||
88 89 I H H | 88 89 I H H | ||
H | H I | ||
I | |||
2 2 | 2 2 | ||
2 | |||
; X X | ; X X | ||
B,D N | |||
B,D | |||
N N | N N | ||
S E | S E | ||
E 1Do , mode ""'9' wdh ri,k ,,,,,,moot "''''''''Y. | E 1Do , mode ""'9' wdh ri,k ,,,,,,moot "''''''''Y. |
Latest revision as of 22:30, 1 March 2020
ML12298A500 | |
Person / Time | |
---|---|
Site: | Beaver Valley |
Issue date: | 09/14/2012 |
From: | David Silk Operations Branch I |
To: | Rudolph W FirstEnergy Nuclear Operating Co |
Jackson D | |
Shared Package | |
ML12136A033 | List: |
References | |
TAC U01850 | |
Download: ML12298A500 (6) | |
Text
ES-401 BEAVER VALLEY UNIT 2 Written Examination Review Worksheet Form ES*401*9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO 8/MIN utE/S Explanation Focus Dist. Link units ward KIA Only 1 H 2 B S NOTE: Change DROPPING to LOWERING thru out exam 2 H 2 X M E Delete LHSI from B for parallelism 3 F 2 B S 4 H 3 N S 5 H 3 X N E Replace "Mode 5" with RCS press & temp. Add AOP2.10.1 to 8 X m 6 H 2 B E Add PORV response as 3 response.
7 H 2 N S 8 F 1 X N U Re-write I restructure Q to increase discriminatory value Instructions
[Refer to Section 0 of ES-401 and Appendix B for additional information regarding each of the following concepts.}
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 5 (easy difficult) rating scale (questions in the 2 - 4 range are acceptable).
- 3. Check the appropriate box if a psychometric flaw is identified:
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc).
- The answer choices are a collection of unrelated true/false statements.
The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
- One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
- The question is not linked to the job requirements (I.e., the question has a valid KIA but, as written, is not operational in content).
- The question requires the recall of knowledge that is too specific for the closed reference test mode (I.e., it is not required to be known from memory).
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g .* panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable).
- 6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7. Based on the reviewer's judgment. is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement. or (S)atisfactory?
- 8. At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).
ES*401 2 Form ES-401-9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N utE/S Explanation Focus Dis!. Link units ward KIA Only 9 H 2 X N E Replace 1. To increase discriminatory value 10 H 2 N S 11 H 2 N S 12 H 3 N '"
st 13 H 3 X N E Delete "is acknowledged" from 1 circled bullet 14 F 2 C N E Replace C with ASDV 15 H 3 N S 16 F 2 D N E Replace D with aux building sump level decreasing. Highlight lAW.
17 H 2 B S 18 H 3 X B E Change RWST level to 29 inches.
19 F 3 N S 20 F 2 X N U KIA is vague. Reselect KIA 21 F 2 A B E Make distractor A Halon only.
22 F 3 N S 23 F 3 A N E Modify A 24 F 2 X N U Provide RCP status in stem and modify A&C 25 F 2 D B E Replace D (PZR) with PZR surge line welds.
26 H 2 X N E Provide breaker position vs stating LOOP. Make C/D rate 20 F/hr.
27 H 2 B S 28 H 3 N S
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #/ Back- Q= SRO B/M/N utE/S Explanation Focus Dist. Link units ward KIA Only 29 H 3 X N E Specify that both units trip.
30 H 2 N S m
31 H 3 X N E Provide multiple figures to avoid DLU. Delete 3 part.
32 H 3 X D N U De!ete uf\w~ode 4." S! actuation could make 0 correct.
33 F 3 N S 34 H 2 N S 35 H 1 N U Tests same concept as Q3 - replace.
36 H 2 C N E Change C to have B/U heaters OFF.
37 H 2 N S 38 H 3 B S 39 H 3 N S 40 F 1 N U Restructure to make more discriminating 41 F 2 X N E Remove "ADMINISTRATIVE" from stem.
42 H 3 X B E Need to state "NSA" wrt header alignment?
43 F 2 B B E Change B to Less AFW flow.
44 H 2 B S 45 F 2 A,B,D B U Why plausible for grid voltage to rise? Replace/restructure 46 H 3 X N E Change stem to imply NI-41 is still energized.
47 H 3 N S
,118 F 3 N S
ES-401 4 Form ES-401-9 00 I 1.
LOK I 2.
LOD I 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
(F/H) (1-5) I Stem Cues T/F Focus Credo Partial Job- Minutia #I Back-Dist. Link units ward Q= SRO B/M/N U/E/S KIA Only Explanation 49 I H I 2 I A.S S E Plausible to think EDG would trip? Add non emergency EDG trip.
50 H 3 I I I I A I I I I I I I I N I E Replace A 51 H 3 I I I I I I I I I I I I I 52 H 2 53 F 2 N S 54 H 1 N U INo CIS needed. Make applicant consider Phase AlB actuation.
55 I F I 2 I X I I I A I I I I I I I I N E IChange distractor A and modify D 56 F 2 N S I 57 F 3 N S 58 F 2 X N E Channel vs channels. Delete "for control and protection" in D.
59 J H I 2 I I I I I I I I I I I I B I s 60 I H I 3 I I I I D I I I I I I I I N I E Modify D to parallel choice A.
S X I I I I I I I I I I I N I E Make separate bullet for "defeated". Add impact on fuel movement.
X I I N I E I Remove 3 mbullet.
X x t Filenet is available & replace two days with week in D.
X N E I Add the directing of operators to disctractors N U l Choose from among systems how to verify alarms. Modify Q.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #/ 6ack Q= SRO 6/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 69 H 2 X N U Track TS vs entering TS. Re-writel replace Q.
70 H 2 N S 71 F 2 N S 72 F 1 X B U Replace with emergency dose kno\\4edge 73 F 3 N S 74 H 3 N S 75 F 2 A,C N U Conditions in A&C degrade plant therefore not plausible. Replace.
76 H 4 N S 77 H 3 X N E Typo in first sentence add "occurred" 78 H 2 X N E Add "as soon as" to 6&D.
79 H 3 X N E Remove "Mode 3" and provide RCS P&T.
80 H 3 N S 81 H 3 N S 82 H 2 X N U Answerable by systems knowledge and AOP purpose. Modify Q.
83 H 2 X N E Add PSMS & DRMS to bullets as appropriate.
84 H 2 X N E SG pressure should be higher.
85 H 4 X N E Delete 0 phrases and last part of question 86 H 3 X N E Provide press & temp vs "Mode 4.
ES-401 6 Form ES-401-9 00 I 1.
LOK (F/H) 2.
LOD (1-5)
- 3. Psychometric Flaws Stem Cues T/F
- 4. Job Content Flaws Credo Partial Job- Minutia #1 Back-
- 5. Other 6.
7.
Q= SRO B/M/N UtE/S I 8.
Explanation Focus Dist. Link units ward KIA Only "I
88 89 I H H
H I
2 2
2
- X X
B,D N
N N
S E
E 1Do , mode ""'9' wdh ri,k ,,,,,,moot "'''Y.
I Replace dilution with loss of FW heater. Add "lAW.." to A&B.
90 I H I 2 N S I I 2 N S H
F 2 D B E o not plausible.
H I 3 N S 94 I H I 3 X N E 6 & 7 too close therefore one is wrong. C contains only 6.
95 I H I 2 N S 96 I H I 2 X N E Clarify which manager in B&C.
97 F 2 N S 98 H 2 N S N S U 3rd EP Q and 4th fuel handling Q - Re-select & replace