ML12298A500: Difference between revisions

From kanterella
Jump to navigation Jump to search
(Created page by program invented by StriderTol)
(StriderTol Bot change)
 
(6 intermediate revisions by the same user not shown)
Line 2: Line 2:
| number = ML12298A500
| number = ML12298A500
| issue date = 09/14/2012
| issue date = 09/14/2012
| title = Beaver Valley Unit 2 - NRC Comments on Draft Licensee-Developed Exam (Written) (Folder 2)
| title = NRC Comments on Draft Licensee-Developed Exam (Written) (Folder 2)
| author name = Silk D
| author name = Silk D
| author affiliation = NRC/RGN-I/DRS/OB
| author affiliation = NRC/RGN-I/DRS/OB
| addressee name = Rudolph W J
| addressee name = Rudolph W
| addressee affiliation = FirstEnergy Nuclear Operating Co
| addressee affiliation = FirstEnergy Nuclear Operating Co
| docket = 05000412
| docket = 05000412
| license number = DPR-028
| license number = DPR-028
| contact person = Jackson D E
| contact person = Jackson D
| case reference number = TAC U01850
| case reference number = TAC U01850
| package number = ML12136A033
| package number = ML12136A033
| document type = License-Operator, Part 55 Examination Related Material
| document type = License-Operator, Part 55 Examination Related Material
| page count = 6
| page count = 6
| project = TAC:U01850
| stage = Draft Other
}}
}}


=Text=
=Text=
{{#Wiki_filter:ES-401 BEAVER VALLEY UNIT 2 Written Examination Review Worksheet Form ES*401*9 Q# 1. LOK (F/H) 2. LOD (1-5) Stem Focus 1 H 2 2 H 2 X 3 F 2 4 H 3 5 H 3 X 6 H 2 X 7 H 2 8 F 1 X 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. Cues T/F Credo Partial Job-Minutia #1 Back-Q= SRO 8/MIN utE/S Explanation Dist. Link units ward KIA Only B S NOTE: Change DROPPING to LOWERING thru out exam M E Delete LHSI from B for parallelism B S N S N E Replace "Mode 5" with RCS press &temp. Add AOP2.10.1 to 8 B E Add PORV response as 3 m response.
{{#Wiki_filter:ES-401       BEAVER VALLEY UNIT 2                               Written Examination Review Worksheet                                                                       Form ES*401*9
N S N U Re-write I restructure Q to increase discriminatory value Instructions
: 1.      2.          3. Psychometric Flaws                4. Job Content Flaws          5. Other      6.      7.                                    8.
[Refer to Section 0 of ES-401 and Appendix B for additional information regarding each of the following concepts.}
Q# LOK LOD (F/H) (1-5)     Stem Cues        T/F    Credo Partial Job- Minutia #1          Back-    Q=    SRO 8/MIN utE/S                                    Explanation Focus                   Dist.          Link            units ward      KIA    Only 1   H       2                                                                                               B      S    NOTE: Change DROPPING to LOWERING thru out exam 2     H       2       X                                                                                     M      E    Delete LHSI from B for parallelism 3   F       2                                                                                               B      S 4     H       3                                                                                               N      S 5   H       3       X                                                                                     N      E    Replace "Mode 5" with RCS press & temp. Add AOP2.10.1 to 8 X                                                                                                                              m 6    H      2                                                                                              B      E    Add PORV response as 3 response.
: 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level. 2. Enter the level of difficulty (LOD) of each question using a 1 5 (easy difficult) rating scale (questions in the 2 -4 range are acceptable). 3. Check the appropriate box if a psychometric flaw is The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, The answer choices are a collection of unrelated true/false The distractors are not credible; single implausible distractors should be repaired, more than one is One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by 4. Check the appropriate box if a job content error is The question is not linked to the job requirements (I.e., the question has a valid KIA but, as written, is not operational in The question requires the recall of knowledge that is too specific for the closed reference test mode (I.e., it is not required to be known from The question contains data with an unrealistic level of accuracy or inconsistent units (e.g .* panel meter in percent with question in The question requires reverse logic or application compared to the job  
7    H      2                                                                                              N      S 8    F       1       X                                                                                      N      U    Re-write I restructure Q to increase discriminatory value Instructions
: 5. Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable).  
[Refer to Section 0 of ES-401 and Appendix B for additional information regarding each of the following concepts.}
: 6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f. 7. Based on the reviewer's judgment.
: 1.         Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement.
: 2.        Enter the level of difficulty (LOD) of each question using a 1   5 (easy    difficult) rating scale (questions in the 2 - 4 range are acceptable).
or (S)atisfactory?  
: 3.         Check the appropriate box if a psychometric flaw is identified:
: 8. At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).
The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
ES*401 2 Form ES-401-9 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job-Minutia #1 Back-Q= SRO B/M/N utE/S Explanation Focus Dis!. Link units ward KIA Only 9 H 2 X N E Replace 1. To increase discriminatory value 10 H 2 N S 11 H 2 N S 12 H 3 N '"'" 13 H 3 X N E Delete "is acknowledged" from 1 st circled bullet 14 F 2 C N E Replace C with ASDV 15 H 3 N S 16 F 2 D N E Replace D with aux building sump level decreasing.
The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc).
Highlight lAW. 17 H 2 B S 18 H 3 X B E Change RWST level to 29 inches. 19 F 3 N S 20 F 2 X N U KIA is vague. Reselect KIA 21 F 2 A B E Make distractor A Halon only. 22 F 3 N S 23 F 3 A N E Modify A 24 F 2 X N U Provide RCP status in stem and modify A&C 25 F 2 D B E Replace D (PZR) with PZR surge line welds. 26 H 2 X N E Provide breaker position vs stating LOOP. Make C/D rate 20 F/hr. 27 H 2 B S 28 H 3 N S ES-401 3 Form ES-401-9 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job-Minutia #/ Back-Q= SRO B/M/N utE/S Explanation Focus Dist. Link units ward KIA Only 29 H 3 X N E Specify that both units trip. 30 H 2 N S 31 H 3 X N E Provide multiple figures to avoid DLU. Delete 3 m part. 32 H 3 X D N U De!ete 4." S! actuation could make 0 correct. 33 F 3 N S 34 H 2 N S 35 H 1 N U Tests same concept as Q3 -replace. 36 H 2 C N E Change C to have B/U heaters OFF. 37 H 2 N S 38 H 3 B S 39 H 3 N S 40 F 1 N U Restructure to make more discriminating 41 F 2 X N E Remove "ADMINISTRATIVE" from stem. 42 H 3 X B E Need to state "NSA" wrt header alignment?
          **          The answer choices are a collection of unrelated true/false statements.
43 F 2 B B E Change B to Less AFW flow. 44 H 2 B S 45 F 2 A,B,D B U Why plausible for grid voltage to rise? Replace/restructure 46 H 3 X N E Change stem to imply NI-41 is still energized.
The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
47 H 3 N S ,11 8 F 3 N S 4 Form ES-401-9 1. I 2. I 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. 00 I LOK LOD (1-5) I Stem Cues T/F Credo Partial Job-Minutia #I Back-Q= SRO B/M/N U/E/S Focus Dist. Link units ward KIA 49 I H I 2 I A.S S E Plausible to think EDG would trip? Add non emergency EDG trip. 50 H I E Replace A 3 I I I I A I I I I I I I I N I I I I I I I I I I I I 3 I 51 H 52 H 2 53 F 2 N S 54 H 1 N U I No CIS needed. Make applicant consider Phase AlB actuation.
* One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
55 I F I 2 I X I I I A I I I I I I I I N E I Change distractor A and modify D S I 56 F 2 57 F 3 N 58 F 2 X N E Channel vs channels.
: 4.        Check the appropriate box if a job content error is identified:
Delete "for control and protection" in 59 J H I 2 I I I I I I I I I I I I B I 60 I H I 3 I I I I D I I I I I I I I N I E Modify D to parallel choice S X I I I I I I I I I I I N I E Make separate bullet for "defeated".
* The question is not linked to the job requirements (I.e., the question has a valid KIA but, as written, is not operational in content).
Add impact on fuel movement.
* The question requires the recall of knowledge that is too specific for the closed reference test mode (I.e., it is not required to be known from memory).
X I I N I E I Remove 3 m bullet. X x t Filenet is available  
The question contains data with an unrealistic level of accuracy or inconsistent units (e.g .* panel meter in percent with question in gallons).
&replace two days with week in D. X N E I Add the directing of operators to disctractors NUl Choose from among systems how to verify alarms. Modify Q.
The question requires reverse logic or application compared to the job requirements.
ES-401 5 Form ES-401-9 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8. Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job-Minutia #/ Q= SRO 6/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 69 H 2 X N U Track TS vs entering TS. Re-writel replace Q. 70 H 2 N S 71 F 2 N S 72 F 1 X B U Replace with emergency dose kno\\4edge 73 F 3 N S 74 H 3 N S 75 F 2 A,C N U Conditions in A&C degrade plant therefore not plausible.
: 5.       Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable).
Replace. 76 H 4 N S 77 H 3 X N E Typo in first sentence add "occurred" 78 H 2 X N E Add "as soon as" to 6&D. 79 H 3 X N E Remove "Mode 3" and provide RCS P&T. 80 H 3 N S 81 H 3 N S 82 H 2 X N U Answerable by systems knowledge and AOP purpose. Modify Q. 83 H 2 X N E Add PSMS & DRMS to bullets as appropriate.
: 6.       Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
84 H 2 X N E SG pressure should be higher. 85 H 4 X N E Delete 0 phrases and last part of question 86 H 3 X N E Provide press & temp vs "Mode 4.
: 7.         Based on the reviewer's judgment. is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement. or (S)atisfactory?
6 Form ES-401-9 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 8. 7. I 00 I LOK (F/H) (1-5) Stem Cues T/F Credo Partial Job-Minutia #1 Back-Q= SRO B/M/N UtE/S Focus Dist. Link units ward KIA N SH ; ; ; ; ; ; ; ; ; ;
: 8.     At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).
; ; ; ;H 2 X N E 1 Do , mode ""'9' wdh ri,k ,,,,,,moot 89 I H I 2 X B,D N E I Replace dilution with loss of FW heater. Add "lAW . ." to I S I H 2 H 2 N F 2 D B E o not H N 3 I H I 3 X N E 6 & 7 too close therefore one is wrong. C contains only 6. N 96 I H I 2 X N E Clarify which manager in 97 F 2 N 98 H 2 N S U 3rd EP Q and 4th fuel handling Q -Re-select  
 
& replace 95 H I 2}}
ES*401                                                                         2                                                                 Form ES-401-9
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws     5. Other   6. 7.                                     8.
Q# LOK   LOD (F/H) (1-5) Stem Cues T/F     Credo Partial Job- Minutia #1     Back- Q=   SRO B/M/N utE/S                             Explanation Focus             Dis!.         Link         units ward   KIA   Only 9   H     2     X                                                                     N     E   Replace 1. To increase discriminatory value 10   H     2                                                                           N     S 11   H     2                                                                           N     S 12   H     3                                                                           N     '"
st 13   H     3     X                                                                     N     E   Delete "is acknowledged" from 1 circled bullet 14   F     2                       C                                                 N     E   Replace C with ASDV 15   H     3                                                                           N     S 16   F     2                       D                                                 N     E   Replace D with aux building sump level decreasing. Highlight lAW.
17   H     2                                                                           B     S 18   H     3     X                                                                     B     E   Change RWST level to 29 inches.
19   F     3                                                                           N     S 20   F     2                                                               X         N     U   KIA is vague. Reselect KIA 21   F     2                       A                                                 B     E   Make distractor A Halon only.
22   F     3                                                                           N     S 23   F     3                       A                                                 N     E   Modify A 24   F     2     X                                                                     N     U   Provide RCP status in stem and modify A&C 25   F     2                       D                                                 B     E   Replace D (PZR) with PZR surge line welds.
26   H     2     X                                                                     N     E   Provide breaker position vs stating LOOP. Make C/D rate 20 F/hr.
27   H     2                                                                           B     S 28   H     3                                                                           N     S
 
ES-401                                                                           3                                                                 Form ES-401-9
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws     5. Other 6. 7.                                     8.
Q#   LOK LOD (F/H) (1-5) Stem Cues T/F     Credo Partial Job- Minutia #/     Back- Q= SRO B/M/N utE/S                               Explanation Focus             Dist.         Link         units ward   KIA Only 29   H     3     X                                                                   N   E   Specify that both units trip.
30   H     2                                                                         N   S m
31   H     3     X                                                                   N   E   Provide multiple figures to avoid DLU. Delete 3 part.
32   H     3     X                       D                                         N   U   De!ete uf\w~ode 4." S! actuation could make 0 correct.
33   F     3                                                                         N   S 34   H     2                                                                         N   S 35   H     1                                                                         N   U   Tests same concept as Q3 - replace.
36   H     2                       C                                               N   E   Change C to have B/U heaters OFF.
37   H     2                                                                         N   S 38   H     3                                                                         B   S 39   H     3                                                                         N   S 40   F     1                                                                         N   U   Restructure to make more discriminating 41   F     2     X                                                                   N   E   Remove "ADMINISTRATIVE" from stem.
42   H     3     X                                                                   B   E   Need to state "NSA" wrt header alignment?
43   F     2                       B                                               B   E   Change B to Less AFW flow.
44   H     2                                                                         B   S 45   F     2                     A,B,D                                               B   U   Why plausible for grid voltage to rise? Replace/restructure 46   H     3     X                                                                   N   E   Change stem to imply NI-41 is still energized.
47   H     3                                                                         N   S
,118  F     3                                                                         N   S
 
ES-401                                                                                4                                                                     Form ES-401-9 00 I 1.
LOK I   2.
LOD I     3. Psychometric Flaws           4. Job Content Flaws     5. Other   6. 7.                                       8.
(F/H)  (1-5) I Stem Cues T/F Focus Credo Partial Job- Minutia #I Back-Dist.          Link          units ward Q= SRO B/M/N U/E/S KIA Only Explanation 49 I H     I 2     I                     A.S                                                   S   E   Plausible to think EDG would trip? Add non emergency EDG trip.
50     H       3   I       I     I I     A   I     I I           I I         I     I   I N I E    Replace A 51    H      3  I       I     I   I       I     I     I       I     I     I     I   I    I 52     H       2 53     F       2                                                                               N   S 54     H       1                                                                               N   U INo CIS needed. Make applicant consider Phase AlB actuation.
55 I   F   I   2   I X I         I   I   A   I     I     I       I     I     I     I   I N   E IChange distractor A and modify D 56     F       2                                                                               N    S  I 57     F       3                                                                               N   S 58     F       2       X                                                                       N   E   Channel vs channels. Delete "for control and protection" in D.
59 J   H   I   2   I       I I I             I     I I           I I         I I I         B I s 60 I   H   I   3   I       I I I         D   I     I I           I I         I I I         N I E   Modify D to parallel choice A.
S X   I     I   I       I     I     I       I     I     I     I   I N I E   Make separate bullet for "defeated". Add impact on fuel movement.
X   I                                                                 I N I E I Remove 3 mbullet.
X x                                                                                           t Filenet is available & replace two days with week in D.
X                                                                       N   E I Add the directing of operators to disctractors N U l Choose from among systems how to verify alarms. Modify Q.
 
ES-401                                                                       5                                                                 Form ES-401-9
: 1. 2.       3. Psychometric Flaws         4. Job Content Flaws   5. Other   6. 7.                                   8.
Q#   LOK LOD (F/H) (1-5) Stem Cues T/F     Credo Partial Job- Minutia #/ 6ack    Q=   SRO 6/M/N U/E/S                             Explanation Focus             Dist.         Link         units ward KIA   Only 69   H     2                                                             X         N     U   Track TS vs entering TS. Re-writel replace Q.
70   H     2                                                                         N     S 71   F     2                                                                         N     S 72   F     1                                             X                           B     U   Replace with emergency dose kno\\4edge 73   F     3                                                                         N     S 74   H     3                                                                         N     S 75   F     2                       A,C                                               N     U   Conditions in A&C degrade plant therefore not plausible. Replace.
76   H     4                                                                         N     S 77   H     3     X                                                                   N     E   Typo in first sentence add "occurred" 78   H     2     X                                                                   N     E   Add "as soon as" to 6&D.
79   H     3     X                                                                   N     E   Remove "Mode 3" and provide RCS P&T.
80   H     3                                                                         N     S 81   H     3                                                                         N     S 82   H     2                                                                   X   N     U   Answerable by systems knowledge and AOP purpose. Modify Q.
83   H     2     X                                                                   N     E   Add PSMS & DRMS to bullets as appropriate.
84   H     2     X                                                                   N     E   SG pressure should be higher.
85   H     4     X                                                                   N     E   Delete 0 phrases and last part of question 86   H     3     X                                                                   N     E   Provide press & temp vs "Mode 4.
 
ES-401                                                                              6                                                                   Form ES-401-9 00 I 1.
LOK (F/H) 2.
LOD (1-5)
: 3. Psychometric Flaws Stem Cues T/F
: 4. Job Content Flaws Credo Partial Job- Minutia #1 Back-
: 5. Other 6.
7.
Q= SRO B/M/N UtE/S I                                  8.
Explanation Focus              Dist.        Link         units ward   KIA Only "I
88 89 I H H
H I
2 2
2
                    ;  X X
B,D N
N N
S E
E 1Do , mode ""'9' wdh ri,k ,,,,,,moot       "''''''''Y.
I Replace dilution with loss of FW heater. Add "lAW.." to A&B.
90 I   H  I  2                                                                          N    S   I I           2                                                                         N    S H
F       2                         D                                               B   E     o not plausible.
H 3                                                                         N    S 94 I H     I   3             X                                                           N   E     6 & 7 too close therefore one is wrong. C contains only 6.
95 I  H  I  2                                                                          N    S 96 I  H  I  2      X                                                                  N    E      Clarify which manager in B&C.
97    F      2                                                                          N    S 98    H      2                                                                          N    S N   S U     3rd EP Q and 4th fuel handling Q - Re-select & replace}}

Latest revision as of 22:30, 1 March 2020

NRC Comments on Draft Licensee-Developed Exam (Written) (Folder 2)
ML12298A500
Person / Time
Site: Beaver Valley
Issue date: 09/14/2012
From: David Silk
Operations Branch I
To: Rudolph W
FirstEnergy Nuclear Operating Co
Jackson D
Shared Package
ML12136A033 List:
References
TAC U01850
Download: ML12298A500 (6)


Text

ES-401 BEAVER VALLEY UNIT 2 Written Examination Review Worksheet Form ES*401*9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO 8/MIN utE/S Explanation Focus Dist. Link units ward KIA Only 1 H 2 B S NOTE: Change DROPPING to LOWERING thru out exam 2 H 2 X M E Delete LHSI from B for parallelism 3 F 2 B S 4 H 3 N S 5 H 3 X N E Replace "Mode 5" with RCS press & temp. Add AOP2.10.1 to 8 X m 6 H 2 B E Add PORV response as 3 response.

7 H 2 N S 8 F 1 X N U Re-write I restructure Q to increase discriminatory value Instructions

[Refer to Section 0 of ES-401 and Appendix B for additional information regarding each of the following concepts.}

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2. Enter the level of difficulty (LOD) of each question using a 1 5 (easy difficult) rating scale (questions in the 2 - 4 range are acceptable).
3. Check the appropriate box if a psychometric flaw is identified:

The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc).

    • The answer choices are a collection of unrelated true/false statements.

The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

  • One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
4. Check the appropriate box if a job content error is identified:
  • The question is not linked to the job requirements (I.e., the question has a valid KIA but, as written, is not operational in content).
  • The question requires the recall of knowledge that is too specific for the closed reference test mode (I.e., it is not required to be known from memory).

The question contains data with an unrealistic level of accuracy or inconsistent units (e.g .* panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable).
6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
7. Based on the reviewer's judgment. is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement. or (S)atisfactory?
8. At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met).

ES*401 2 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N utE/S Explanation Focus Dis!. Link units ward KIA Only 9 H 2 X N E Replace 1. To increase discriminatory value 10 H 2 N S 11 H 2 N S 12 H 3 N '"

st 13 H 3 X N E Delete "is acknowledged" from 1 circled bullet 14 F 2 C N E Replace C with ASDV 15 H 3 N S 16 F 2 D N E Replace D with aux building sump level decreasing. Highlight lAW.

17 H 2 B S 18 H 3 X B E Change RWST level to 29 inches.

19 F 3 N S 20 F 2 X N U KIA is vague. Reselect KIA 21 F 2 A B E Make distractor A Halon only.

22 F 3 N S 23 F 3 A N E Modify A 24 F 2 X N U Provide RCP status in stem and modify A&C 25 F 2 D B E Replace D (PZR) with PZR surge line welds.

26 H 2 X N E Provide breaker position vs stating LOOP. Make C/D rate 20 F/hr.

27 H 2 B S 28 H 3 N S

ES-401 3 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #/ Back- Q= SRO B/M/N utE/S Explanation Focus Dist. Link units ward KIA Only 29 H 3 X N E Specify that both units trip.

30 H 2 N S m

31 H 3 X N E Provide multiple figures to avoid DLU. Delete 3 part.

32 H 3 X D N U De!ete uf\w~ode 4." S! actuation could make 0 correct.

33 F 3 N S 34 H 2 N S 35 H 1 N U Tests same concept as Q3 - replace.

36 H 2 C N E Change C to have B/U heaters OFF.

37 H 2 N S 38 H 3 B S 39 H 3 N S 40 F 1 N U Restructure to make more discriminating 41 F 2 X N E Remove "ADMINISTRATIVE" from stem.

42 H 3 X B E Need to state "NSA" wrt header alignment?

43 F 2 B B E Change B to Less AFW flow.

44 H 2 B S 45 F 2 A,B,D B U Why plausible for grid voltage to rise? Replace/restructure 46 H 3 X N E Change stem to imply NI-41 is still energized.

47 H 3 N S

,118 F 3 N S

ES-401 4 Form ES-401-9 00 I 1.

LOK I 2.

LOD I 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

(F/H) (1-5) I Stem Cues T/F Focus Credo Partial Job- Minutia #I Back-Dist. Link units ward Q= SRO B/M/N U/E/S KIA Only Explanation 49 I H I 2 I A.S S E Plausible to think EDG would trip? Add non emergency EDG trip.

50 H 3 I I I I A I I I I I I I I N I E Replace A 51 H 3 I I I I I I I I I I I I I 52 H 2 53 F 2 N S 54 H 1 N U INo CIS needed. Make applicant consider Phase AlB actuation.

55 I F I 2 I X I I I A I I I I I I I I N E IChange distractor A and modify D 56 F 2 N S I 57 F 3 N S 58 F 2 X N E Channel vs channels. Delete "for control and protection" in D.

59 J H I 2 I I I I I I I I I I I I B I s 60 I H I 3 I I I I D I I I I I I I I N I E Modify D to parallel choice A.

S X I I I I I I I I I I I N I E Make separate bullet for "defeated". Add impact on fuel movement.

X I I N I E I Remove 3 mbullet.

X x t Filenet is available & replace two days with week in D.

X N E I Add the directing of operators to disctractors N U l Choose from among systems how to verify alarms. Modify Q.

ES-401 5 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #/ 6ack Q= SRO 6/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 69 H 2 X N U Track TS vs entering TS. Re-writel replace Q.

70 H 2 N S 71 F 2 N S 72 F 1 X B U Replace with emergency dose kno\\4edge 73 F 3 N S 74 H 3 N S 75 F 2 A,C N U Conditions in A&C degrade plant therefore not plausible. Replace.

76 H 4 N S 77 H 3 X N E Typo in first sentence add "occurred" 78 H 2 X N E Add "as soon as" to 6&D.

79 H 3 X N E Remove "Mode 3" and provide RCS P&T.

80 H 3 N S 81 H 3 N S 82 H 2 X N U Answerable by systems knowledge and AOP purpose. Modify Q.

83 H 2 X N E Add PSMS & DRMS to bullets as appropriate.

84 H 2 X N E SG pressure should be higher.

85 H 4 X N E Delete 0 phrases and last part of question 86 H 3 X N E Provide press & temp vs "Mode 4.

ES-401 6 Form ES-401-9 00 I 1.

LOK (F/H) 2.

LOD (1-5)

3. Psychometric Flaws Stem Cues T/F
4. Job Content Flaws Credo Partial Job- Minutia #1 Back-
5. Other 6.

7.

Q= SRO B/M/N UtE/S I 8.

Explanation Focus Dist. Link units ward KIA Only "I

88 89 I H H

H I

2 2

2

X X

B,D N

N N

S E

E 1Do , mode ""'9' wdh ri,k ,,,,,,moot "'''Y.

I Replace dilution with loss of FW heater. Add "lAW.." to A&B.

90 I H I 2 N S I I 2 N S H

F 2 D B E o not plausible.

H I 3 N S 94 I H I 3 X N E 6 & 7 too close therefore one is wrong. C contains only 6.

95 I H I 2 N S 96 I H I 2 X N E Clarify which manager in B&C.

97 F 2 N S 98 H 2 N S N S U 3rd EP Q and 4th fuel handling Q - Re-select & replace