Text

October 2002 Exam 50-321/2002-301 Administrative Documents
	ML030640096
Person / Time
Site:	Hatch
Issue date:	01/09/2003
From:	Ernstes M; Operator Licensing and Human Performance Branch
To:	Sumner H; Southern Nuclear Operating Co
References
	50-321/02-301, 50-366/02-301, ES-201, ES-201-1, NUREG-1021, Rev 8, Suppl 1 50-321/02-301, 50-366/02-301
	Download: ML030640096 (78)
	v • d • e

Administrative Documents E. I. HATCH NUCLEAR PLANT EXAM 2002-301 50-321 & 50-366 OCTOBER 16 - 18, 21 - 25, &

OCTOBER 30, 2002,

............. ES-201-1

/,

1. / Exam Preparation Checklist ........

............. ES-201-2 /

2. >Exam Outline Quality Checklist .....

............. ES-201-3 ,-Exam Security Agreement .........

ES-301-1 v" 4. X-/Administrative Topics Outline (Final) . .............

5. -- Control Room Systems and Facility Walk-through Test Outline V, r*

(F ina l) . .. . . .. .. .. . .. . .. . .. . .. . . .. .- S-3U1 -L

......... ES-301-3 7 6. J>Operating Test Quality Check Sheet ...

ES-301-4 7

......... Simulator Scenario Quality Check Sheet

......... ES-301-5 T*ransient and Event Checklist ........

......... ES-301-6 v 9. -"Competencies Checklist ...............

......... ES-401-7 /

10. -VWritten Exam Quality Check Sheet ......

......... ES-401-9g 11. 4Written Exam Review Worksheet ........

......... ES-403-1 12. 4 AWritten Exam Grading Quality Checklist

......... ES-501-1 /

13. vKost-Exam Check Sheet ..............

9/30 0P,-e tO/1 -1 I ycka , t '. m201 Examination Preparation Checklist Form ES-201-1 ES-201 Facility: 14 PT-rT H Date of Examination: Ot*.

Examinations Developed by: Facility / NRC circle one)

Chief xaminer's Date* Task Description / Reference Initials M l,,,l

.a; C.2.a & b) 0 administration date confirmed ( . Examination-120 2. NRC examiners and facility contact assigned (C.1.d; C.2.e) ,.

(C.2.c)

-120 3. Facility contact briefed on security & other requirements-120 4. Corporate notification letter sent (C.2.d)

3/z z/o*

[-90] [5. Reference material due (C.1 .e; C.3.c)]

-75 6. Integrated examination outline(s) due (C.1 .e & f; C.3.d)

provided-70 7. Examination outline(s) reviewed by NRC and feedback to facility licensee (C.2.h; C.3.e)

-45 8. Proposed examinations, supporting documentation, and reference materials due (C.1 .e, I, g & h; C.3.d)

-30 9. Preliminary license applications due (C.1.1; C.2.g; ES-202)

-14 10. Final license applications due and assignment sheet prepared (C.1.1; C.2.g; ES-202)

licensee * -,

-14 11. Examination approved by NRC supervisor for facility review (C.2.h; C.3.f)

C.2.f & h; C.3.g)

-14 12. Examinations reviewed with facility licensee (C.1.j;

>

-7 13. Written examinations and operating tests approved by NRC supervisor (C.2.i; C.3.h)

-7 14. Final applications reviewed; assignment sheet updated; waiver letters sent (C.2.g, ES-204)

15. Proctoring/written exam administration guidelines written reviewed with to give exams-7 facility licensee and authorization granted (if applicable) (C.3.k)

questions-7 16. Approved scenarios, job performance measures, and distributed to NRC examiners (C.3.i)

in the corporate notification lette Target dates are keyed to the examination date identified a case-by-case basis in coordination They are for planning purposes and may be adjusted on with the facility license Applies only to examinations prepared by the NR C

[1]

'3/4 NUREG-1021, Revision 8, Supplement 1 22 of 24

ES-201 Examination Outline Form ES-201 -2 Quality Checklist I Feci -_.*

13rDte fl, of Examination: & 2O

. . . Initials Task Description a b* c#

Item a. Verify that the outline(s) fit(s) the appropriate model per ES-40 w in accordance with R b. Assess whether the outline was systematically and randomly prepared -A Section DA1 of ES-401 and whether all K/A categories are aproiately sample I T

topic T c. Assess whether the outline over-emphasizes any systems, evolutions, or generic E f66 I N d. Assess whether the justifications for deselected or rejected K/A statements are appropriat it cover the required number of a. Using Form ES-301-5. verify that the proposed scenario sets major transient normal evolutions, instrument and compnent failures, and spares) to test the projected number and I b. Assess whether there are enough scenario sets (andcompositionusing rotation schedule without applicant can be tested and at crew least one new or mix of applicants M M compromising exam significantly modified integrity; ensure in accordance with the each expected scenario, that no scenarios are duplicated from the applicants'

audit test(s)* '

--4/

and scenarios will not be rpated over successive day c. To the extent possible, assess whether the outline(s) conform(s)

uantitative criteria specified on Form ES-301-4 and with the qualitative and described in Appe ndix F- a. Verify that:

(1) the outline(s) contain(s) the required number of control roomlast and in-plant tasks, than 30% of the test material is repeated from the NRC examination, W (2) no more (3)' no tasks are duplicated from the applicants' audit test(s), and

/ from the licensee's exam bank T (4) no more than 80% of any operating test is taken directly b. Verify that:

as specified in ES-301, (1) the tasks are distributed among the safety function groupings (2) one task is conducted in a low-power or shutdown condition, (3) 40% of the tasks require the applicant to implement anemergency alternate path procedure, A task tests the applicant's response to an or abnormal condition, and (4) one in-plant requires the applicant to enter the RC (5) the in-plant'walk-through with emphasis on performance c. Verify that the required administrative topics are covered, based activitie the projected number and mix of d. Determine if there are enough different outlines to test applicants and ensure that no items are duplicated on successive da and IPE insights) are covered in the 'to a. Assess whether plant-specific priorities (including PRA appropriate exam sectio G 55.45 sampling is appropriat E b. Assess whether the 10 CFR 55.41143 and N

t for pIant-s ecitfic riofities are at least NE c. Ensure that K/A impodance ratin s ýexce among exam section A d. Check for duplication and overlap L a. Check the entire exam for balance of covera (RO or SRO .

f. Assess whether the exam fits the appropriate job level Date Printed Name/ Si rg_

7-Z -02-7, a. Author /, P"a["/"q b. Facility Reviewer (1 'd I,* I

'I St 1S. 1%At4-J J160 hU c. NRC Chief Examiner (#j 4k i'i ,4A L A NC s /Vej d. NRC Supervisor Note: Not applcable for NRC-developed examination oncurrence require NRC reviewer initial items in Coumn "C;" chief examinercoureerqied I ~~ Inde~penen 23 of 24 NUREG-1021, Revision 8, Supplement 1

NRC EXAMINATION SECURITY AGREEMENT Attachment Page 1 of 1 ES-201 Examination Security Agreement Form ES-201-3 Pre-Examination I acknowledge that I have acquired specialized 4-2-9 knowledge about the NRC licensing examinations scheduled for the week(s) of 41Ž1Lz4¶? as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized bx the NRC chief exminer. I understand that I am not to participate in any instruction, evaluation, or other z* tFng4teS

- prinvolving those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration. I further understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromise . Post-Examination To the best of my knowledge, I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of 6WV 1, z/ . From the

?-O&Z*to date I entered into this security agreement until the completion of examination administration, I did not participate in any training related activities involving those applicants who were administered those licensing examination PrintedName Job Title Signature (1) Date Signature (2) Date Respopsiblity . ___ X,,hprd Qh,,d SMi!A ifcL-w., 4o&:*

- r $4-1,s~* e ,J* / .z~2 " /

IC;,,/

Ren S...-k PA4 -s~md- 092 to0 Z/03/ a 7 mth P ta-ga*S.&w'A nsr., vi~w1 for', MI

___________IN\__X___ T

& 1 &,V~ AMttp jrý / V(o,ff~--.3 /'90 2o2

_

,,

.S Tl,'2 tol ______

Lv tClewOf~ 46oe~X~fr _____ II 5-9 of 9 DEC 4 t'0?

NRC EXAMINATION SECURITY AGREEMENT Attachment Page 1 of 1 Form ES-201-3 ES-201 ExaminationSecurity Agreement Pre-Examination about the NRC licensing examinations I acknowledge that I have acquired specialized knowledge of my signature. I agree that I will not scheduled for the week(s) of (-t4 .i lzco as of the'date to any persons who have not been authorized knowingly divulge any information about these examinations to participate in any instruction, evaluation, or other bvthe NRC chief examiner. I understand that I am not these licensing involving those applicants scheduled to be administered V'tm" administration. I further understand that glt* examinations from this date until completion of examination in cancellation of the examinations and/or an violation of the conditions of this agreement may result action against me or the facility license I will immediately report to facility management or enforcement that examination security may have been the NRC chief examiner any indications or suggestions compromise . Post-Examination unauthorized persons any information concerning To the best of my knowledge, I did not divulge to any ,u zs lo . From the the week(s) of ('z\- % the NRC licensing examinations administered during of examination administration, I did not date I entered into this security agreement until the completion those applicants who were administered those participate in any training related activities involving licensing examination Signature (1) Date natu (2)

PrintedName Job Title /

Responsiblity

ie.SfrtC+L 'S-r o Ki/72 a Ott Der1s" f~t~~ &

me .

C" /0nv~4 tilln S Seeo~ ziz IAIJD~reRSM 9 of 9

ES-301 Administrative Topics Outline Form ES-301-1 (R8, SI)

Facility: Hatch Date of Examination: 10/16-24/02 Examination Level (circle one): RO / SRO Operating Test Number:

Administrative Describe method of evaluation:

Topic/Subject 1. ONE Administrative JPM, OR Description 2. TWO Administrative Questions Conduct of Use of Overtime Guidelines. K/A 2.1.3 3.0/3.4 (NEW)

Operations Conduct of Determine if SBLC tank meets requirements of Tech Specs per Operations table 3.1.7-1 and Table 3.1.7-2. K/A 2.1.25 2.8/3.1 (NEW) Equipment Prepare Equipment Clearance and Hold Tags. JPM 25019 Control K/A2.2.13, 3.6/ Radiation Determine exposure limits for equipment OOS. K/A 2. Control 2.5/2.9 (NEW) Emergency During an Emergency, Perform a Prompt Offsite Dose Procedures/Plan Assessment Calculation (JPM 25305) K/A2.4.39 3.3/ ES-301 Administrative Topics Outline Form ES-301-1 (R8, S)

1/2>

Facility: Hatch Date of Examination: 10/16-24/02 Examination Level (circle one): RO / SRO Operating Test Number:

Administrative Describe method of evaluation:

Topic/Subject 1. ONE Administrative JPM, OR Description 2. TWO Administrative Questions Conduct of Use of Overtime Guidelines. K/A 2.1.3 3.0/3.4 (NEW)

Operations Conduct of IRM Alternate Power Checks prior to taking the Mode Switch to Operations Run. K/A 2.1.23 3. 9/4.0 (NEW) Equipment Review 34SV-C1I-002-2S, Scram Discharge Volume Isolation Control Valve Timing and Closure Test K/A 2.1.33 3.4/4.0 (NEW) Radiation Determine exposure limits for equipment OOS. K/A 2. Control 2.5/2.9 (NEW) Emergency During an Emergency, with information provided, Perform a Procedures/Plan PA (JPM 25205) K/A 2.4.44 2.4/ ES-301 Control Room Systems Form ES-301-2 (R8, S1)

and Facility Walk-Through Test Outline Facility: HATCH Date of Examination: 10/16-24/0202 Exam Level (circle one): RO I SROi / SRBROW) Operating Test No.:

B.1 Control Room Systems System / JPM Title Type Safety Code* Function a. Recirculation System / Shift Recirc Control from Individual D,S 7u to Master Control. (4.06)

b. Containment / Initiate Evergency Torus Venting using the D,S 5 Emergency Vent Path. (13.53)

c. HPCI / Perform a manual Startup of HPCI and maintain MS 2 reactor water level in ban d. Recirculation System / Start a Recirc MG Set from the M,A,S 4 Control Room with Failure of Pump Seal. (4.02)

N,L,A,S lU e. Reactor Protection / Transfer the Mode Switch to S/U with

<-V one APRM reading hig f. RHRSW / Crosstie the RHR Service Water with a failure of MS,A 8u the second RHRSW pump to start. (34.08)

g. 4160 VAC / Transfer An Emergency 4160 VAC Bus From D,S 6 the Emergency to Normal Power Supply. (27.11)

B.2 Facility Walk-Through a. RCIC / From the Remote Shutdown Panel, Start RCIC for D,R 2u Injection into the Reactor. (39.16)

b. SBLC / From Outside the Control Room, Inject Boron M,A,R I Using the SBLC System with Failure of "A" Pump to star (11.12) U c. Fire Protection I During a Loss of Air, Isolate the Fire Protection Sprinklers. (36.13)

Type Codes: (D)irect from bank, (M)odified from bank, (N)ew, (A)lternate path, (C)ontrol room, (S)imulator, (L)ow-Power, (R)CA

FR-MnlI ODeratino Test Quality Checklist Form ES-301-3 (R8, Sl)

ES-301 I Operating Test Quality Checklist Facility: HATCH Date of Examination: OCT 2002 Ooerating Test Number:

1. GENERAL CRITERIA The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution). There is no day-to-day repetition between this and other operating tests to be administered during this examinatio The operating test shall not duplicate items from the applicants' audit test(s)(see Section Di.a). Overlap with the written examination and between operating test categories is within acceptable limit It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license leve . WALK-THROUGH (CATEGORY A & B) CRITERIA Each JPM includes the following, as applicable:

initial conditions initiating cues references and tools, including associated procedures

reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time critical by the facility licensee specific performance criteria that include:

- detailed expected actions with exact criteria and nomenclature

- system response and other examiner cues

- statements describing important observations to be made by the applicant .*.

- criteria for successful completion of the task

- identification of critical steps and their associated performance standards

- restrictions on the sequence of steps, if applicable The prescripted questions in Category A are predominantly open reference and meet the criteria in Attachment I of ES-30 Repetition from operating tests used during the previous licensing examination is within acceptable limits (30% for the walk-through) and do not compromise test integrit At least 20 percent of the JPMs on each test are new or significantly modifie . SIMULATOR (CATEGORY C) CRITERIA The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-301-4 and a copy is attache Printed Name / Signature Date-z t e , cA& 7-z-0 2a a. Author b. Facility Reviewer(*)

N14 c. NRC Chief Examiner (#)

d. NRC Supervisor AW nJCHIdt4 E, gnpu-,ss/'rflco /6 ho /V NOTE: * The facility signature is not applicable for NRC-developed test # Independent NRC reviewer initial items in Column "c;" chief examiner concurrence require ES-301 Simulator Scenario Quality Checklist Form ES-301-4 (R8, Sl)

! 'L3 Facility: HATCH Date of Exam: OCT 2002 Scenario Numbers: . / Operating Test No.: I QUALITATIVE ATTRIBUTES Initials a b* c#

.14 The initial conditions are realistic, in that some equipment and/or instrumentation may be out of service, but it does not cue the operators into expected event . The scenarios consist mostly of related event W4 3, Each event description consists of the point in the scenario when it is to be initiated the malfunction(s) that are entered to initiate the event the symptoms/cues that will be visible to the crew the expected operator actions (by shift position)

the event termination point (if applicable) No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic even . The events are valid with regard to physics and thermodynamic . Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objective . Iftime compression techniques are used, the scenario summary clearly so indicates. Operators given.sufficient time to carry out expected activities without have undue time constraints. Cues are The simulator modeling is not altere . The scenarios have been validated. Any open simulator performance deficiencies have been ,-

evaluated to ensure that functional fidelity is maintained while running the planned scenario . Every operator will be evaluated using at least one new or significantly modified scenario. All other scenarios have been altered in accordance with Section D.4 of ES-30 . All individual operator competencies can be evaluated, as verified using Form ES-301-6 (submit the form along with the simulator scenarios).

1 Each applicant will be significantly involved in the minimum number of transients and events specified on Form ES-301-5 (submit the form with the simulator scenarios).

1 The level of difficulty is appropriate to support licensing decisions for each crew positio TARGET QUANTITATIVE ATTRIBUTES (PER SCENARIO; SEE SECTION D.4.D) Actual Attributes - Total malfunctions (5-8) /,5-/ 42 7)A o_ IA_ Malfunctions after EOP entry (1-2) / / /* _ Abnormal events (2-4) 5 1,,/'1 - 1 Major transients (1-2) / / / 7,.Y-- 1 EOPs entered/requiring substantive actions (1-2) 1/ 2-1 2- _ " EOP contingencies requiring substantive actions (0-2) 2 /I / / ____ ' Critical tasks (2-3) 2 4 / / 2-

ES-301 Transient and Event Checklist Form ES-301-5 (R8, Si)

OPERATING TEST NO.: 1 - 4 Applicant Evolution Minimum Scenario Number Type Type Number R B ROI BOP R

RoZ8oP

RQ BOP

R0 3OP 1 1 2 2 Reactivity 4 Normal 1 1 4 1 RO Instrument/ 4 2,3 5,6 2? 3.5 3,5 4,6 3,5 4,5 Component 1 7 6 6 7 7 6 6 Major 7

Reactivity 1 1 2

As RO Normal 0 1 2 ,6 23 3,5 3,5 4,6 3,5 4,5 Instrument/

Component Major7 7 6 6 7 7 6 6 SRO-[

0 4 1 2 2 Reactivity 1 1 4 1 1 As SRO Normal 2 233' 34 Instrument, 2,,365 Component Major 1 76 7 6 0 4 1 2 2 Reactivity Normal 1 1 4 1 1 Instrument/ 2 2,,365 23,4 3,3 SRO-U Component

Major 1 7 6 7 Instructions: (1) Enter the operating test number and Form ES-D-1 event numbers for each evolution tvo (2) Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.4.d) but must be significant per Section C.2.a of Appendix (3) Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's competence count toward the minimum requirement.

Author: Scenariol.2.3 and 4 - T. Kolb NRC Reviewer:

- I

/(Z.,/[, U, ES-30 Con )etencies Ch, cklist Form ES-301 -6 J,:L? J-FT pplicannt #3 Arp icarO-2 R SRO-I/SRO-U RO/CRO-ISRO-U SCENARIO SCENARIO Competencies So'etzc7 s't elv 1 2 L)3 41 el _ a cS 4 1 41 &2 J 4 Understand and Interpret g- .( f'

Annunciators and Alarms Diagnose Events (,,I- , ,

and Conditions 1,3,;3 r,tf Understand Plant .f and System Response Comply With and , 7- , ,7 Use Procedures (1) '

4~ V,1

'

F%2,

, 'a-'VA SS 2ois NJ4 Operate Control Boards (2) , Ij 1.7'

I, Y etA C A Communicate and " qr C Interact With the Crew . sJ* wN i- N vIA 'I.?

Demonstrate Supervisory Ability (3) Il 'ft SI't Comply With and PI? N" Njk ?44 oil A Use Tech. Specs. (3)

Notes:

an R (1) Includes Technical Specification compliance for (2) Optional for an SRO- (3) Only applicable to SROs.

instructions:

event numbers that will allow the Circle the applicant's license type and enter one or more for every applicant.

e*aniners to evaluate every applicable competency Author:

NRC Reviewer:

NUREG-1021, Revision 8, Supplement 1 26 of 26 I

ES-401 Written Examination Form ES-401-7 (R8, SI)

Quality Checklist Facility: HATCH Date of Exam: OCT 2002 Exam Level: RO Initial Item Description a b* c Questions and answers technically accurate and applicable to facility a. NRC K/As referenced for all questions b. Facility learning objectives referenced as available RO/SRO overlap is no more than 75 percent, and SRO questions are appropriate per Section D.2.d of ES-40 ,. Question selection and duplication from the last two NRC licensing exams appears consistent with a systematic sampling process Question duplication from the license screening/audit exam was controlled as M/A indicated below (check the item that applies) and appears appropriate:

the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or

.. the examinations were developed independently; or-the licensee certifies that there is no duplication; or other (explain) Bank use meets limits (no more than 75 percent Bank Modified New from the bank at least 10 percent new, and the rest modified); enter the actual question 40 9 51 I,ý distribution at right Between 50 and 60 percent of the questions on Memory C/A the exam (including 10 new questions) are written at the comprehension/analysis level; 50 50 enter the actual question distribution at right I References/handouts provided do not give away answers Question content conforms with specific K/A statements in the previously approved examination outline and is appropriate for the Tier to which they are assigned; deviations are justified 1 Question psychometric quality and format meet ES, Appendix B, guidelines to 1 The exam contains 100, one-point, multiple choice items; the total is correct and W agrees with value on cover sheet Printed Name / Signa re Date a. Author b. Facility Reviewer (*)

-'7-d NMIA/

416 &4 1 t 7-2-02 G. NaC Chief Examiner(#) 1ZiCOlA46V "_76*,'!/*** ý d. NRC Regional Supervisr*'lH / f v " J/'4* . * 47/lay _*

Note: * The facility reviewer's initials/signature are not applicable for NRC-developed examination # Independent NRC reviewer initial items in Column "c;" chief examiner concurrence require LICtic5c 'aatj-r19r,et n~jDDYIoMAL1 CotJNcgPNS AFI-reA Ii¶IIDL? #1teiz'At P*LLO'tiIMG SVS45QU90T &H~v4J, 5FIKAt 4f/RA~veeo /0/? 9/o&

ES-401 Written Examination Form ES-401-7 (R8, Si)

Quality Checklist Facility: HATCH Date of Exam: OCT 2002 Exam Level: SRO Initial Item Description a b c' Questions and answers technically accurate and applicable to facility 1CM a. NRC K/As referenced for all questions b. Facility learning objectives referenced as available RO/SRO overlap is no more than 75 percent, and SRO questions are appropriate per Section D.2.d of ES-401 Question selection and duplication from the last two NRC licensing exams appears consistent with a systematic sampling process Question duplication from the license screening/audit exam was controlled as IA indicated below (check the item that applies) and appears appropriate:

-theaudit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or Sthe examinations were developed independently; or the licensee certifies that there is no duplication; or other (explain) Bank use meets limits (no more than 75 percent from the bank at least 10 percent new, and the Bank

Modified

New

9 enter the actual question rest modified); right distribution at Between 50 and 60 percent of the questions on Memory C/A the exam (including 10 new questions) are written at the comprehension/analysis level; 46 54 enter the actual question distribution at right References/handouts provided do not give away answers Question content conforms with specific K/A statements in the previously approved examination outline and is appropriate for the Tier to which they are assigned; deviations are justified 1 Question psychometric quality and format meet ES, Appendix B, guidelines 1 P41 1 The exam contains 100, one-point, multiple choice items; the total is correct and __ It agrees with value on cover sheet Printed Name / Sign ure Date Author - e" 7 C#o/4/6/4z__Zz Facility Reviewer (* u1 A I NRC Chief Examiner(#) .IA*tO 1 t'-v-1,' -.a-/1 NRC Regional Supervisors' ! d/V 6* r - ,,A-Note: * The facility reviewer's initials/signature are not applicable for NRC-developed examination # Independent NRC reviewer initial items in Column "c;" chief examiner concurrence require *- U c tJ ffe6 /DflaNt/J-ro/ý -0ApL4P(To Nlv Co dC6d4 AFT6t9bv 0 fe~

Po LL~DdWer4-JG' LeoSCute,/ CpNt1v( flEKAv gaIfdo Vep ) o~ /64

ES-401 Written Examination Form ES-401-9 (R8, Si)

Review Worksheet . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q# LOK LOD (F/H) (1-5) Stem Cues T/FI Cred. Partial Job- Minutia #/ Back- 0Q SRO U/E/S Explanation Focus Dis Link 1 unts ward K/A Only Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.] Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive leve . Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable). Check the appropriate box if a psychometric flaw is identified:

The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

The answer choices are a collection of unrelated true/false statement More than one distractor is not credibl One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem). Check the appropriate box if a job content error is identified:

The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirement . Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable). Based on the reviewer's judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditodial enhancement, or (S)atisfactory? At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met). . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

a# LOK LOD I I (F/H) (1-5) Stem Cues T/FI Cred. Partial Job- Minutia I Back- Q= SRO U/E/S Explanation Focus Dis Link units ward K/A Only 1 F 2-3 E 201002A3.03, MEM 3.2/3.2, Bank WOOTF The answer is the only distractor that states "...Reset the drift alarm..."

The other distractors should read the same, where appropriate. Add

"drift"to the other distractor TCK - Changed to WOOTF and added "drift"to other distractors 5/2 Page 1 of 61 . 3. PsychometricFlaws 4.JobContent Flaws 5. Other .

Q# LOK LOD r I (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dis Link units ward KA 1Ony June 14, 2002 (10:32AM) RSB, need to remove the word best from the stem. Correcte Facility requested procedure added to ste TCK - Added "per 34GO -OPS 001-2S to the stem. Facility accepted resolution. 9/24 10/4/02 - Facility requested "Group 1" replace "central in-sequence" in the answer S TCK - Revised as requested. 10/7/02 2 H 3 S 202001A1.07, C/A 2.7/2.8, Bank Appears ok TCK - made "one" all capitals. 5/29 June 14, 2002 (10:39AM) RSB, ok 3 H 2-3 X X E 202002K3.05, C/A 3.2/3.3, Bank WOOTF Distractor C would not be chosen because 22 % is the lowest an Recirc pump can operate. Change the distractor t have 22 vice 2 TCK - Changed to WOOTF and changed distractor C to 22%. 5/29 June 14,2002 (11:20AM), RSB OK 8/2/02 - Facility requested change to correct answer since the system has been upgraded since material was given to u TCK - Verified with updated information that proposed change is correct and revised correct answer. 8/ S 9/19/02 - Facility accepted resolution. TCK Page 2 of 61 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other Q#LOK (F.H)

LOD (1-5) Stem Cues T/F Cred. Partial Job- Minutia Focus I I IDs Link I 1 BIack- 1Q= SROI units ward K/A Only U/E/S Explanation 4 F 3 E 203000A1.01, MEM 4.2/4.3, Bank WOOTF Is this something they are required to know from memory? Would not think so, but will let the licensee decid TCK - Changed to WOOTF. All operators should know when it is appropriate to re-inject. 5/29 S June 14, 2002 (11:20AM), RSB, OK 5 H 3 E 206000K6.08, C/A 3.4/3.4, New WOOTF Otherwise it appears o TCK - Changed to WOOTF. 5/29 S June 14, 2002 (11:21AM), RSB, OK 6 F 2-3 U 211000A3.04, MEM 4.3/4.4, New WOOTF Seems there is more than one answer. I think B C and D could be correct. Discuss with Ti There is a note in the provided references that say that Discharge pressure, tank level, and neutron level are used to confirm that SBLC is injecting into the Reactor Core. May need to change the question to warrant this inf TCK - Changed to WOOTF. Modified answers B and C to ensure D is the only correct answer. 5/2 S June 14, 2002 (11:21AM), RSB, OK Page 3 of 61

4. Job Content Flaws 5. Other . . 3. Psychometric Flaws Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO UWEIS Explanation Focus Dis Link units ward K/A Only 7 H 3 E 211000A4.01, C/A 3.9/3.9, New WOOTF Need to add to the stem the procedure noun name associated with 34SO C41-003-O Why would distractor's C and D be chosen. Is there something in the procedure that would allow for this? Why are they plausible? Discuss with Tim TCK - Changed to WOOTF and added procedure name. 5/29 June 14, 2002 (11:24AM), RSB, OK as i /23/02 - Facility requested stem to indicate that the instrument failed downscal S TCK - Changed as requested and facility accepted resolution. 9/24 8 M 3 E 212000K4.06, MEM 3.0/3.0, Bank WOOTF, Not sure of the answer. Discuss with Tim or license TCK - Changed to WOOTF. 5/29 June 14,2002 (12:20PM), RSB, OK as is 10/4/02 - Facility identified that Rod Control System is different than described in the questio S TCK - Developed new question with material supplied by the facility. 10/7 9 F 3 E 214000K4.01, MEM 3.013.1, Bank WOOTF Otherwise appears o TCK - Changed to WOOTF. 5/29 S June 14, 2002 (12:21PM), RSB, OK as changed Page 4 of 61 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO U/E/S Explanation Focus Dis I Link [ Iunits ward K/A Only 10 F 3 S 215005A2.03, MEM 3.6/3.8, Bank Do not understand the reference material. Need to discuss with Tim to understand this topi Otherwise appears o TCK - made "one" all capitals. 5/29 June 14, 2002 (12:21PM), RSB, OK as is 8/2/02 - Facility requested new question due to OPRM changes which make the current question wron TCK - Wrote new question with input from facility. Made minor changes to their suggested question. Changed question from Meai to C/A. 8/7 9/12/02 - Facility requested B APRM total inputs be changed from 17 to 18 since it is right on the line for operabilit TCK - Denied change since APRM is still OPERABLE with 17 inputs which makes the answer more plausible. 9/18 9/19/02 - Facility accepted resolution. TCK 11 F 2-3 E 216000K2.01, MEM 2.8/2.8, Bank WOOTF Do we need to spell out ATTS? May help Otherwise appears o TCK - Changed to WOOTF and spelled out ATTS. 5/29 June 14,2002 (12:22PM), RSB, ok as i /4/02 - Facility stated knowing bhich bus supplies ATTS panels is beyond intent of K/ TCK - K/A tests knowledge of power supplies to ATTS. Question is S technically correct and stays as written. 10/7/02 Page 5 of 61 .

Q# LOK LOD Flaws 4. Job Content Flaws 5. Other (F/H) (1-5) Psychometric Stem3. Cues T/FI Cred.. Partial Job- Minutia #/ Back- 0 SRO U/E/S Explanation i Focus I___I_ Dis ILink I__ lunitslI ward jK/AjI nloy _____________________________

12 H 3 X E 217000K1.01, C/A 3.5/3.5, New WOOTF Distractor's C and D both have reasons for the valve positioning, however, distractors A and B do not. Either remove the reasons or add reasons to the others. Discuss TCK - Changed to WOOTF. Removed reasons for valve travel in distractors C and D. 5129 S June 14, 2002 (12:22PM), RSB, OK AS CHANGED Page 6 of 61

1 . 3. PsychometricFlaws 4.JobContent Flaws 5. Other .

01 LOK LOD I I (F/H) (1-5) Stem Cues T/F Cred. Partial Job- MinutiaI #/ Back- 0= SRO U/E/S Explanation I Focus I I I Dis Link units ward K/A Only 13 H 3 E 219000A2.08, C/A 2.3/3.5, New Parenthesis around the period after Trip .... Pump B tdp."

Replace badly with excessivel Procedure usage? Not sure this will fly, do not normally require the applicants memorize non-automatic action steps of ARPs. Discuss with the licensee to see if it is applicable. This would be a direct look up if we allowed the use of the AR Discuss with Tim Each Distractor has the same first sentence, can we move it up to the stem?

If it does apply, then need to under line some of the words to key in on loop and pump. It was difficult to rea Disagree with level of knowledge. Not sure this is a C/A type question. If you do not know the answer, not sure you could use the stem to determine the answer. More of a Memory level questio TCK - Changed to WOOTF. Replaced badly with excessively. Did not change distractors and believe it is C/A since have to determine if the Loop or the Pump is inoperable. 5/29 June 14, 2002 (12:50PM), RSB, OK AS CHANGE /2102 - Facility suggested changes in stem for Operator Titles and to remove reference the HPCI surveillanc TCK - Changes made as requested. 8/5 9/19/02 - Facility accepted resolution. TCK 9/23/02 - Facility requested "B RHR Loop" be changed to "Division 2 RHR".

TCK - Changed all occurances as requested and facility accepted resolution. 9/24 10/4/02 - Facility noted that you cannot just call an RHR Pump inoperable but you must call the division inoperable if a pump is isolate TCK - Revised all answers and updated reference section. There was no S correct answer prior to the change. 10/7/02 Page 7 of 61 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #m Back- Q= SRO U/E/S Explanation Focus Dis Link Iunits ward K/A jOnly 14 H 3 E 223001A2.12, C/A 3.7/3.8, Bank WOOTF Are we going to provide the curve for them to use? Ifso we need to provide the vortex limit curve also if there is one availabl TCK - Changed to WOOTF. Students will be provided both graphs. 5/29 June 14. 2002 (1:08PM), RSB, OK AS CHANGED, Added to the Reference material that the applicant needs to get Graph 9, 1 1A and 11 B 8/2/02 - Facility requested to change TAF to -165".

TCK - Changed stem to read "Before level reached -185" which is technically more correct. 8/ /19/02 - Facility accepted resolution. TCK S

15 H 3 E 223002K1.07, C/A 3.4/3.6, New In this question, is the RCIC isolation signal the Suppression Chamber high temp 170?

add degrees to WOOTF Otherwise appears o TCK - Changed to WOOTF. 5/29 June 18, 2002 (6:24AM), OK as is 8/2102 - Facility requested changing 'Turbine' to 'Trip and' in the ste TCK - Change made as requested. 8/ /19/02 - Facility accepted resolution. TCK 10/4/02 - Facility requested "Inboard" and "Outboard" be placed in front of valve numbe S TCK - Revised as requested. 10/7/02 Paae 8 of 61 . 3. PsychometncFlaws 4.JobContent Flaws I 5. Other .

Q# LOK (F/H) LOD (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO U/E/S Explanation Focus Dis ILink I Iunits ward K/A IOnly 16 H 3 S 226001 K2.02, C/A 2.9/2.9, New Rx change to reactor in stem. Done are 470 and 480 open. Should state this if it is s What about changing distractor A to be powered from its respective DG which looks to be 2C EDG. That would be more reasonabl Are they going to need the schematic to determine this, or can they do it from memory?

Otherwise appears o TCK - Changed distractor A to indicate 2C EDG. Students will not need schematic. 5/29 June 18, 2002 (6:26AM). RSB, OK as changed 812/02 - Facility requested minor change to stem regarding 28 Recirc Pp TCK - Changed as requested. 8/5 9/19/02 - Facility accepted resolution. TCK 17 H 3 S 234000K6.02, C/A 2.8/3.5, New Do we in the stem need to state what are the actions according to TS' That would link it to that procedure. May not get the same answer or they may think there is no answer. Did we bounce this off of the ARP requirements?

Otherwise appears ok TCK - Changed to WOOTF. The applicants must determine that an electrical AC source is INOPERABLE. 5/29 June 18, 2002 (6:28AM), RSB ok as change /4/02 - Facility requested reference for Tech Spec TCK - Reference would be a direct look up and the operators are expected to know immediate actions. Facility agreed to leave as is. 10/7 Paie 9 of 61 (F/H) (1-5)

1Stem3. Cues Psychometric Flaws 4. Job Content Flaws 5. Other .

T/F Cred. Partial Job- Minutial #1 Back- 0= SRO U/E/S Explanation Focus II_ Dis Link units ward K/A Only 18 F 3 E 239001K4.04, MEM 3.4/3.5, New WOOTF Stem needs to be reworded. Should not lift the whole statement out of the procedure. There is also some teaching in the stem, which is not necessar WOOTF describes the purpose of the Main Steam line restrictors?

Add different accidents to the first part of each distracto To limit the loss of coolant from the RPV following a steam line rupture outside containment to the extent that the RPV water level would not reach TAF prior to the MSIVs closin Pick other accidents and add their bases to the other distractors. Make two similar and then the answer and another on TCK - Changed to WOOTF. Changed all the answers to account for change in stem. Incorporated suggestions above. 5/30 June 18, 2002 (6:30AM), RSB, OK as changed 8/2/02 - Facility requested to change answer ' to read as taught in lesson pla TCK - Change not made as requested. The FSAR describes the purpose of the Main Steam Line Flow Restrictors by themselves. The lesson plan describes the purpose of the Flow Restrictors in conjunction with the MSIV's. These are different. 8/5 9/19/02 - Facility accepted resolution unless they find more documentation. TCK 9/23/02 - Facility requested correct answer be revised to indicate what was in the lesson pla TCK - Revised distractor A to ensure it is not the correct answer. Revised correct answer to lesson plan info since operators are not required to S memorize the FSAR. Facility accepted resolution. 9/24 Page 10 of 61 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #I Back- Q= SRO UIEIS Explanation Focus Dis Link units ward K/A Only 19 F 3 E 239002A1.01, MEM 3.3/3.4, New Underline inadvertent. Done WOOTF when rewritten, under line and Capitalize EXPECT, that way there is not a misunderstandin Otherwise appears o TCK - Changed to WOOTF and underlined appropriate words. 5/30 June 18, 2002 (6:32AM), RSB, ok as change TCK - Changed to C/A since have to determine physical conditions and S how the plant will react.. Also changed pressure band. 6/21 20 H 2-3 x E 241002K6.05, MEM3.4/3.4, Bank have three distractors that have the MSIVs last. Could rearrange A to have them secon TCK - Changed to WOOTF. Changed distractor D for consistency. 5/30 June 18, 2002 (6:33AM), RSB, ok as change /2/02 - Facility requested stem to state correct alarm tile titl TCK - Changed as requested. 8/5 S 9/19/02 - Facility accepted resolution. TCK Pane 11 of 61

r T . 3. Psychometric Flaws 4. Job Content Flaws 5. Other 7.

Q# LOK LOD (F/H) (1-5) Stem Cues I T/F Cred. Partial Job Minutia Back- Q= Explanation Focus Dis Link units ward K/A 21 F 2-3 X E 245000K1.09, MEM 2.7/2.7, New Change stem to read something like:

On a turbine trip from a loss of D.C. power, WOOTF is the reason an operator must be sent locally to trip the Generator Exciter Field Breaker after the PCBs open?

The lesson plan provided states that this occurs with the loss of 125/250 VDC Switchgear "A". Do we need to say that inthe stem? Also the lesson plan does not talk about the exciter field breaker. Discuss w/Tim TCK - Re-worded stem for WOOTF and added that 125/250 VDC Switchgear "A"caused the turbine trip. 5/30 June 18, 2002 (6:35AM), RSB, ok as changed 10/4/02 - Facility requested replacement/modification of question due to 3 correct andswer TCK - Developed new question based on input supplied from the facilit S 10/7 22 H 3 X E 259002K3.02, C/A 3.7/3.7, Bank Need to add that A is in automatic contro WOOTF Help, do not understand the material and the question. Discuss TCK - It doesn't matter if the controller is in manual or automati Changed to WOOTF. 5/30 S June 18, 2002 (6:51AM), RSB, ok as changed.

23 F 3 E 261000K4.01, MEM 3.7/3.8, Modified WOOTF Otherwise appears o TCK - Changed to WOOTF. 5/30 S June 18, 2002 (7:36AM), RSB, ok as changed 9/23/02 - Facility requested "Unit 1" be added to ste TCK - Revised as requested and facility accepted resolution. 9/24 Q#LOK (F/H) LCD (1-5)

3. Psychometric Flaws Stem Cues T/F 4. Job Content Flaws Cred. Partial Job- MinutiaI #/ IBack-i the 5.Other Q= SRO .

U/E/S .

Explanation Focus Dis Link units ward K/A Only 24 H 3 X E 262001A4.02, C/A 3.4/3.4, Modified WOOTF This question could be modified to use the two adjustments as in each distractor and then change the second part of C and D to be like A and If you know the answer is VARS on the second part from the bank question it is a 1 out of 2 chance you could get it correc Discuss with Ti TCK - Changed to WOOTF and adjusted distractors to be consisten Also updated the reasons distractors are wrong. 5/30 June 18, 2002 (7:38AM), RSB, ok as changed TCK - Changed Cog level to C/A since you have to know if a red level is exceeded and you also need to know what actions occur. 6/21 8/2/02 - Facility requested answers changed from 'VAR flow" to "Reactive load".

TCK - Changed as requested since same concept. 8/ /02 - Facility accepted resolution. TCK 9/23/02 - Facility requested "main" be placed in front of generator in ste S TCK - Changed as requested and facility accepted resolution. 9/24 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q# LOK (F/H)

LOD (1-5) Stem Cuesl T/FI Cred. Partial Job- 1 Minutia1 #1 Focus Dis Link 1Back-units ward K/A LQ=

SRO U/E/S Only Explanation 25 M 2-3 E 263000K3.01, MEM 3.4/3.8, New Do we need to add the windows numbers for the annunciators in the stem?

WOOTF Appears o TCK - Changed to WOOTF. Don't think we need alarm window numbers in the stem. 5/30 June 18, 2002 (7:39AM), RSB, ok as i /2/02 - Facility requested "or" changed to "OR" in ste TCK - Changed two 125/250V alarms to read exactly as the alarm tiles read. 8/ /4/02 - Facility wanted to add "only" in front of 125 VDC 2D. Also believes that question is beyond requirements of K/ TCK - Meets K/A requirements. Stem says that 125 VDC 2D is lost. Did S not change question and facility agreed to this resolution. 10/7 26 M 2-3 X X U 268000A1.01, MEM 2.7/3.1, Bank Stem should read HIGH Trip Setpoint, WOOTF Why is distractor A not also correct. Granted it is not the total actions but it does happen. Discus TCK - Changed to WOOTF. Added all to the stem so that a partial answer is not correct. Changed stem to HIGH trip setpoint. 5/30 June 18, 2002 (7:39AM), RSB Capitalized ALL and still underlined it. Done. Should be ok as change /2/02 - Facility requested stem to indicated "2B" tank and to change the discharge flow rate to 65 gpm which is normal flow rat TCK - Changed stem as requested. 8/ S 9/19/02 - Facility accepted resolution. TCK . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

LOD I I Q# LOK (F/H) (1-5) Stem Cues T/F Cred. IPartial Job- Minutia #/ Back- Q- SRO UIE/S Explanation Focus Dis Link I units ward K/A Only 27 H 2-3 E 27200K2.05, C/A 2.6/2.9, Bank WOOTF Is there another A train instrument we can substitute that is not correct?

That could be better having a known A train DC power instrumen Disagree with LOK, more of a memory level question. Discuss TCK - Changed to WOOTF and changed to Memory level of knowledg Left the distractors as they were. 5/30 S June 18, 2002 (7:41AM). RSB, ok as is 28 F 2-3 X X E 286000A1.06, MEM 2.9/3.0, New WOOTF Changed # to psig Could we use a distractor that state there is only one SRV?

Distractor D does not make sense to me. Pressure is increasing at a rate of 25 psig/hour however, the distractor states the system would dump if the pressure REACHES 263, HOW DOES IT DO THAT? Need another distracto TCK - Changed to WOOTF and changed # to psig. Revised distractor D to make sense. 5/30 June 18, 2002 (7:43AM), RSB, ok as changed 9118102 - Facility requested KA changed from A1.06 to A1.01 due to tank pressure being plant specific. There are no tank pressure limits significant to operations and their ability to operate cardox syste TCK - Changed KA and replaced question as requested. Revised question to make answers more plausible. Changed to C/A. 9/19 S 9/19/02 - Facility accepted resolution. TCK . 3. Psychometric Flaws 4. Job Content Flaws 5.Other .

04* LOK LOD (F/H) (1-5) Stem CuesIT/F Cred. Partial Job- Minutia #1 Back- 0= SRO U/E/S Explanation Focus ~ Dis nk units ward K/A Only 29 H 3 S 288000A2.05, C/A 2.6/2.7, New WOOTF There are a lot of distractors that concern themselves with TS type answers. Are the applicants supposed to know, from memory, this information. Are we going to provide the applicable TS. Additionally, are the applicants supposed to know the actions of the cold weather procedure from memory? Is there a learning objective that requires this?

Facility may not agree with asking this questio Not sure I agree with the level of knowledge designation. Looks more like a memory! Discuss with Ti TCK - Changed to WOOTF. Revised distract A to say what could happen. Remains at C/A since the applicant must know that the oil and coolant systems have immersion heaters to protect the D/G. 5/30 June 18, 2002 (7:46AM), RSB, ok as change /2102 - Facility requested to change stem to indicate temp. drops to the low teens. Also, remove freezing fire piping from the correct answe TCK - Changed as requested. 8/ /19/02 - Facility accepted resolution. TCK 10/4/02 - Facility requested additional info added to correct answer to meet the stem requirement TCK - Changed as requested. 10/7/02 . 3. Psychometric Flaws 4. Job Content Flaws 6. Other .

Q# LOK LOD (F/H) (1-5) Stem CuesI T/F Cred. Partial Job- Minutia #N Back- Q SRO U/E/S Explanation P i Focus I Dis Link I units ward K/A Only 30 H 2-3 X E 290001A3.01, C/A 3.9/4.0, Bank Do we have to designate which Unit's 609 detectors are in alarm? Does it matter? Could not figure out from the lesson plan. Combined question 23 also deals with these detector Stem could be clearer concerning 609 C and D. May be easier to read if we make that one sentence into two. A and B have a HI-HI signa Channels C and D have failed as is. When I first read it I incorrectly thought that D was the only channel that failed as i Is this credible, both channels failing as it. Could we have one in test and not functioning and then have the other corresponding channel fail as is?

This may make more credible and make more sense to the reade Low level C/A, close to a memory level questio TCK - Revised stem to make two sentences and placed a unit designator for the instruments. 5/30 June 18, 2002 (7:49AM), RSB, appears to be ok as changed 8/2102 - Facility requested EPN change in ste TCK - changed as requested. 8/ /19/02 - Facility accepted resolution. TCK 10/4/02 - Facility requested changing question for red monitors to all read Hi-Hi. Also, to add the 'A" that Reactor Building ventilation remains operatin S TCK - Change not made since meets K/A and Enabling Objectives. 10/7 31 F 3 E 290002G2.1.28, MEM 3.2/3.3, Bank WOOTF Otherwise o TCK - Changed to WOOTF. 5/30 S June 18, 2002 (7:53AM), RSB ok as change . . Psychometric Flaws 4. Job Content Flaws 5. Other .

Q# LOK LOD I (F/H) (_5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- 0 SRO U/E/S Explanation Focus Dis Link unitsward K/A Ony 32 H 3 E 290003K5.02, C/A 2.8/2.8, Bank WOOTF Do we expect them to memorize this information? I don't think so even though it is a bank questio Ifyou provide the TS it will be a direct Look u TCK - Changed to WOOTF. Added pressurization mode to the stem. 5/30 June 18, 2002 (7:53AM), RSB, ok as change /2/02 - Facility requested references for Tech Specs with SR' TCK - Tech Spec and SR requirements will be provided. This is not a direct look-up since the operator has to convert the 1/5 inch water guage to .2" water gauge. 8/ /19/02 - Facility accepted resolution. TCK S

33 F 3 S 295001AK2.07, MEM 3.4/3.4, Bank Appears o TCK - Capitalized ONE and separated sentence. 5/30 June 18, 2002 (7:55AM), RSB, ok 34 S 295003AK2.01, C/A 3.2/3.3, New June 18, 2002 (8:20AM), RSB, Question appear to be ok as is 10/4/02 - Facility requested "de-energized" in stem be underline TCK- Bolded and underlined "de-energized". 10/7 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

CtLOK LCD (F/H) (1-5) Stem Cues ' T/F Cre Partial Job- #i Back- Q=

Minutia utwadKAOnly SRO UIE/S Explanation Focus Dis Link 35 F 3 E 295004AK3.03, MEM 3.1/3.5, Bank WOOTF The learning objective states: "GIVEN a loss of 125/250 VDC buses, 34AB-R22-211S, AND System Operating Procedures , Describe the operability of the following systems. Not sure the licensee will consider this question fair with out the references provide TCK - Changed to WOOTF. Should be allowed since matches K/A. 5/30 June 18, 2002 (8:20AM), RSB, Again, not sure the licensee will allow this question. Will let them decide, even though the KA matches it does not make it any more vali /2/02 - Facility requested stem to indicate RCIC Turbine trip alarm instead of LPCI Mode of RHR not available. System has been change TCK - Removed LPCI Mode of RHR and replaced with 125/250V Battery volts low alarm since RCIC trip is only associated with SWGR 2A. 8/ S 9/19/02 - Facility accepted resolution. TCK 36 F 3 S 295005AA1.05, MEM 3.6/3.6, New WOOTF Appears ok TCK - Changed to WOOTF and deleted end of last sentence in ste /30 June 18, 2002 (8:24AM), RSB, OK as change . Psychometric Flaws . Job Content Flaws 5. Other .

1 Back-Job- IMinutiaf units Inly U/E/S SRO Explanation (F/H) (O 5 Stem C Focus Dist. Partial ILink Cre ward K/

37 H 3 x E 295006AK3.01, C/A 3.8/3.9, New WOOTF Distractor D does not make sense. Iflevel is going to increase why would it do so when something is collapsing? This needs to be change TCK - Changed to WOOTF. Revised distractor D as suggested. 5/30 June 18, 2002 (8:25AM), RSB. Ok as change /2/02 - Facility requested minor changes to 2 distractor TCK - Changed as requested. 8/ /19/02 - Facility accepted resolution. TCK 9/23102 - Facility requested "initial" be placed in front of reactor water level in the ste S TCK - Changed as requested and facility accepted resolution. 9/24 38 S 295007AA1.04, C/A 3.9/4.1, New, June 18, 2002 (8:34AM), RSB, Changed distractor A to use automatically, this is present in only one more distractor, added AUTOMATICALLY to A. OK as changed 39 F 3 X X E 295008AK3.01, MEM 3.4/3.5, New WOOTF is the reason the Main Turbine receives a trip signal if the RPV experiences a high water level?

Rewrite Distractor C to read Initiates an anticipatory reactor scram due to the simultaneous trip of the reactor feedwater pum TCK - Changed to WOOTF format. Revised distractor C. 5/30 S June 18, 2002 (8:36AM), RSB, appears ok . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q# LOK LOD h-2 (F/H) (1-5) IStem Cues T/F Cred. Partial Job- Minutia #/ Back- = SRO U/EIS Explanation Focus Dis I Link I Iunits ward K/A Only 40 F 3 E 295009AK1.05, MEM 3.3/3.4, Bank WOOTF is the main reason the RPV level is lowered during an ATWS?

Discuss with TIM The material attached speaks more to reduction in power than natural circulatio TCK - Changed to WOOTF and changed the correct answer per the lesson plan documentation. 5/30, June 18, 2002 (8:37AM), RSB, appears o /2/02 - Facility requested "decreasing head pressure" to be changed to

"Reducing the natural circulation driving head".

TCK - Changed as requested per referenced documents. 8/ S 9/19/02 - Facility accepted resolution. TCK 41 H 3 X E 295009G2.4.1, C/A 4.3/4.6, Modified WOOTF In distractor A is there a time when you would maintain level in such a wide band? If so ok, if not then may need a better distracto Would we expect the RO's to know this from memory?

TCK - Changed to WOOTF. Revised level band as suggested. RO's are expected to know when to start injecting during an ATWS. 5/30 June 18, 2002 (8:55AM), RSB, change appears o /2/02 - Facility requested stem to be changed to 11% RTP or distribute a copy of the BIIT Curv TCK - Distribute copy of BlIT curve. 8/5 S 9119/02 - Facility accepted resolution. TCK . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q# LOK LOD (F/H) (1-5) Stem Cues T/F ICred. Partial Job- Minutia 1#1 ack- Q= SRO U/E/S Explanation Focus Dis Link units ward K/A Only 42 H 3 S 295012AA1.02, C/A 3.8/3.8. New WOOTF The designators you use are cooling units, does that matter that you call it a fan? Terminology may be differen Appears ok TCK - Changed to WOOTF. Changed fans to Units in first part of ste Added degrees. 5/30 June 18, 2002 (9:08AM), RSB, Appears ok as change /4/02 - Facility requested replacement of editing of question due to exceeding K/A requirement TCK - K/A is the ability to operate and monitor drywell cooling system on high drywell temperature. Question meets K/A/ Only one answer identifies the correct equipment to start on an auto start signal. Leave question as-is. 10/7 43 F 3 E 295013AK1.03, MEM 3.0/3.3, Bank WOOTF Distractor A does not make sense, in the respect that, from the chronology listed in the stem, it is not reasonable to think that this action had already taken place.. This may be an additional correct answe Discuss TCK - Changed to WOOTF. Distractor A is a plausible action. Added degrees. 5/30 S June 18, 2002 (9:09AM), RSB, ok as changed

1 .PsychometdicFlaws 4. Job Content Flaws 5.Other .

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia Back- Q SRO U/E/S Explanation Focus Dis Link junits ward K/A Ony 44 F 3 S 295013AK3.01, MEM 3.6/3.8, Ne WOOTF Appears ok TCK - Changed to WOOTF. Added degrees. 5/30 June 18, 2002 (9:11AM), RSB, ok 8/2/02 - Facility wants to change name of surveillance in ste TCK - Changed name of surveillance as requested. 8/ /18/02 - Facility requested question be revised to address the reason why heat addition to the containment is halted at 105F. Previous question referred to basis for 24 hr time limit to be in this conditio TCK - Changed as requested due to more operationally oriented and facility accepted resolution. 9/19 45 S 295014AK2.03, C/A 3.3/3.4, New, June 18, 2002 (9:11AM), RSB, Ok, but is this an RO knowledge level question? Will allow the licensee to determin /2/02 - Facility wanted "Abnormal Operational Occurances" changed to

"Plant Transients".

TCK - Added "Plant Transients" in parenthasis. 8/5 9/19/02 - Facility accepted resolution. TCK 46 S 295015AA2.01, MEM 4.1/4.3, Bank No reference material, do not understand, need to discuss with Tim TCK - Changed to WOOTF. Provided references. Leaving this valve open would allow feedwater to continue to feed into the vessel. 6/3 June 18, 2002 (12:55PM), RSB, OK

5. Other .

Q#LOK LOD 3. Psychometric Flaws 4. Job Content Flaws (F/H) (1-5) I Stem Cues T/F Cred. Partial Job- IMinutia #IIBack- Q= SRO U/E/S Explanation Focus I j Dis Link units ward K/A Ony 47 F 3 E 295016AK3.01, MEM 4.1/4.2, New The stem of the question lead the reader to believe that the reactor did not scram. Need to add words that allow the reader to understand that the additional requirements are due to the reactor failing to scra WOOTF The licensee may not require the RO's to have this memorize TCK - Changed to WOOTF. Revised stem to make it clearer that the Ro should insert a manual scram from the control room if possible prior to abandoning the control room. 5/30 June 18, 2002 (12:59PM), RSB, ok as change /2/02 - Facility suggested minor spelling change TCK - Changed as requested. 8/5 9/19/02 - Facility accepted resolution. TCK 10/4/02 - Facility believes question exceeds requirements for R TCK - Matches K/A for the reason you insert a scram when the control S room is abandoned. 4.1 for RO. Leave as-is. 10/7 48 F 3 E 295018AK2.02, MEM 3.4/3.6, Modifie WOOTF Appears o TCK - Changed to WOOTF. 5/30 S June 18, 2002 (1:19PM), RSB, ok as changed . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ j Back- Q= SRO U/E/S Explanation Focus Dis Link units ward K/A Only 49 C 3 E 295021AK2.05, C/A 2.7/2.8, New WOOTF The question appears to be ok. However, not sure where you obtained the info about distractor A. Discuss with Ti The licensee may not like this question because you have used their procedure to develop a good question. It has many aspects of the procedure that are true but not for the initial conditions. They may think this is an SRO only question. We will see what they sa TCK - Changed to WOOT June 18, 2002 (1:20PM), RSB, ok as changed 8/2/02 - Facility suggested minor wording correction in ste TCK - Changed as requested. 8/5 S 9/19/02 - Facility accepted resolution. TCK . 1 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q# LOK LOD [ I (F/H) (1-5) IStem CuesI T/F I Cred. Partial Job- Minutia #/ Back- Q= SRO UJE/S Explanation Focus Dis Link units ward K/A Only 50 H 3 X X U 295022G2.1.30, C/A 3.9/3.4, Bank K/A: Ability to locate and operate components / including local control The stem of the question places the operator observing a running CRD pump. He then needs to observe the current running conditions and should determine what automatic action should have occurre Not sure the KA is fully met. While the question provides indications the applicant would not locate and operate components locally. The essence of the question is to determine if the status of the pump is correct and if it should or should not have starte If this question is valid for this KA then distractors A and B should be changed to Should have started but .....

The explanation for Distractor D is incorrect, it says that this trip is bypassed, but Distractor B states that there is no such trip. Need to adjust one or the othe WOOTF TCK - Changed to WOOTF. Revised distractors A and B. Need to discuss if meets K/A. 5/30 June 18, 2002 (1:23PM), RSB, ok as changed 8/2/02 - Facility requested PEO be change to S TCK - Changed as requested. 8/5 S 9/19/02 - Facility accepted resolution. TCK 51 F 3 E 295023AK1.03, MEM 3.7/4.0, New WOOTF Otherwise appears o TCK - Changed to WOOTF. 5/30 S June 18, 2002 (1:24PM), RSB, ok as changed . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q#LOK (F/L) LODII (15) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dis Link I__units ward K/A Onlyl 52 F 2-3 X E 295024EA1.04, MEM 3.4/3.8, New WOOTF While the question is correct, the licensee may complain on being trick Would suggest to underline and capitalize the word MINIMUM and some how have the reference to the procedure. For example:

In accordance with 34SO-El 1-010-2S, "Residual Heat Removal System,"

which one of the following is the MINIMUM drywell spray flow rate required to ensure an effective drywell pressure reduction?

Additionally, I am not sure where the numbers for pressure and the temperature for the drywell came from. The temperature seems a bit high based on the pressure of the drywell. I figure it should be approx. 244 deg f. Why don't we pick a pressure like 10 psig and use this that way the corresponding saturation pressure is 250 deg. TCK - Changed to WOOTF. Revised stem to add applicable procedure and underlined minimum and effective. Also, the numbers for the Drywell parameters are based on the minimum requirements to initiate drywell sprays. Added degrees. 5/30 S June 18, 2002 (1:52PM), RSB, ok as changed 53 F 3 X E 295025EA1.07, MEM 4.1/4.1, Bank WOOTF appears to be ok, however, distractor D bothers me a little. Would it be better if for distractor D we used some other pressure instead of drywell pressure. In the stem of the question we don't even address drywell pressure. Why don't we do the same for D as we did for the corresponding A and B combination? That way we cover all the parameter TCK - Changed to WOOTF. Revised distractor D to be consistent with distractors A and B. 5/30 June 18, 2002 (1:52PM), RSB, placed 1190 on the same line as psig to S read easier. Ok as change . Other . . 3. Psychometric Flaws 4. Job Content Flaws Q# LOK LOD i I (F/H) (1-5) Stem Cred. IPartial Job- MinutiaI #1 Back-CCuesIT/F 0 SRO UIE/S Explanation Focus Dis Link units ward K/A Ony 54 H 3 S 295026EK2.04, C/A 2.5(2.8, New Appears to be ok TCK - Capitalized ONE. Added degrees. 5/30 June 18, 2002 (1:55PM), RSB, ok as changed 8/2/02 - Facility requested correct name for surveillance tes TCK - Changed as requested. 8/5 9/19/02 - Facility accepted resolution. TCK 10/4/02 - Facility requested question be replaced since too difficult and doesn't meet K/N TCK - Question meets K/A and Enabling Objective and is technically correct. Left as-is. 10/7 55 F 2-3 S 295028EK1.02, MEM 2.9/3.1, Bank Appears to be ok TCK - Capitalized ON June 18, 2002 (1:55PM), RSB, ok as change F 3 X E 295029EK1.01, MEM 3.4/3.7, Bank WOOTF Need to reword the stem to remove BEST, we don't usually use that terminology. Can we tie this to the procedure. It will not give the basis but it will provide the ste TCK - Changed to WOOTF. Removed the word BEST from the ste Reworded the stem to include the PC-1 procedure. 5/30 S June 18, 2002 (1:56PM), RSB, ok as changed . 3. Psychometric Flaws LOD I I 4. Job Content Flaws 5. Other .

Q# LOK (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutial #m Back- 0= SRO UIE/S Explanation Focus I Dis Link units ward K/A Ony 57 F 3 X X E-U 295030EK3.03, MEM 3.6/3.7, New WOOTF The stem states that HPCI is required to be tripped on low Torus Level, but RCIC not address. Then in 2 distractors, A and C you say that it now has a low level trip. This may be a specific determine Is there a case for B ever to be true? If not, does not seem credibl Discuss with Ti TCK - Changed to WOOTF. Revised stem to make it more clear. 5130 S June 18, 2002 (1:56PM), RSB, ok as changed 58 F 3 X X E 295032EK3.03, MEM 3.5/3.8, New WOOTF Add to the stem, "The SC SECONDARY CONTAINMENT CONTROL EOP"....

Key words in each distractor needs to be underlined. For example: Underline immediate and indirect Underline substantial and may lead Underline immediate and direct Underline substantial and safest condition I think that this will help misreading the distractor TCK - Changed to WOOTF. Made suggested underline comments. 5/30 S June 18, 2002 (1:58PM), RSB, ok as change . . Psychometric Flaws 4. Job Content Flaws 5. Other .

O# LOK LOD I (F/H) (1-5) Stem Cues T/F Cred. JPartial Job- Minutia #I IBack- 0I SRO U/E/S Explanation Focus Dis Link units ward K/A Ony 59 H 3 E 295036EA1.02, C/A 3.5/3.6, Bank WOOTF Need to add to the stem what procedures Immediate Operator Actions you expect them to d In accordance with the EOP SC, which one of the following is the immediate respons Is this really an immediate response? Will they need the EOP? Not sure this is an item required to be memorized. Discus Ifyou provide the procedure then it would be a look u TCK - Changed to WOOTF. Revised stem with the procedure that is controlling the actions. EOP is required to answer question. 5/30 E? June 18.2002 (2:OOPM). RSB. ok as chanaed. Since the EOP is required to answer this, will this be a direct look up??

TCK - This is not a direct look-up since the student must determine from a S different table that max safe water level is exceeded. 6/20 60 F 2-3 E 295037EK2.05, MEM 4.0/4.1, New added differential pressure (dp) vise just dp in the ste WOOT Otherwise appears o TCK - Changed to WOOTF. Added differential pressure to stem. 5/30 S June 18, 2002 (2:02PM), RSB, ok as changed . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

QV LOK (F/H) LOD (1-5) Stem Cues T/F Cre Partial Job- Minutia #1 Back- Q= SRO U/E/S Explanation I

Focus Dis Link units ward K/A Ony 61 F 3 E 295037EK3.02, MEM 3.6/3.9, Bank Add to the stem the Valve number for the minimum flow valve. SO-21, MOV 19 ?

Otherwise appears o Could change the answer and have it be D and ask that question about the minimum flow. Not necessary but just a suggestio TCK - Changed to WOOTF. Added valve number to stem. 5/30 S June 18, 2002 (2:03PM). RSB, ok as changed.

62 F 3 S 295038EA2.03, MEM 3.5/4.3, Bank Is this RO knowledge?? Not sure. Let the licensee decid Otherwise o TCK - Capitalized ONE. 5/30 June 18, 2002 (2:05PM), RSB, ok as changed, will let licensee decide if RO knowledge.

63 H 3 X E 295038EK2.03, C/A 2.9/3.5, Modified, WOOTF Otherwise it appears o TCK - Changed to WOOTF. Revised stem to determine impact on high radiation signal. 5130 S June 18, 2002 (2:05PM), RSB, ok as changed .

Q#LOK LOD Flaws 4. Job Content Flaws 5. Other (F/H) (1-5) Psychometric Stem 3. Cues T/F BCred. jPartial Job- I MinutiaI #X Back- Q= SRO U/E/S Explanation Focus Dis Link units ward K/A Ony 64 H 3 S 400000A4.01, C/A 3.1/3.0, Bank Appears to o Disagree with level of knowledge. Ifyou don't have this memorized you do not know the answer. No way to figure it out from the stem of the questio TCK - Changed to WOOTF. Believe question is C/A since the applicant must know the effects on the equipment with a pump trip. 5/30 June 18, 2002 (2:07PM), RSB, ok as is, C/A is ok.

65 F 3 X E 500000EA1.01, MEM 3.4/3.3, Bank WOOTF happens when the temperature decreases below the setpoint?

In those distractors that use BUT, can we substitute HOWEVER?

Otherwise appears o TCK - Changed to WOOTF. Changed BUT to however. Added degree /3 June 18, 2002 (2:08PM), RSB, ok as change /2/02 - Facility believes that answer B is correct since procedure 34SO T49-001-2S says a temp of 220 F on Blower Inlet Temp required the Operator to place the Operate Switch in OFF. This would prevent the blower from re-startin TCK - Added note the stem stating "Assume no operator action" which would still make C correct. 8/5 9/18/02 - Facility requested question be replaced with proposed question since KA talks about instrumentation and not the H2 recombiner TCK - Changed as requested since better aligns with KA and facility S accepted resolution. 9/19 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q# LOK LOD I (F/H) (1-5) Stem Cues T/F Cred. Partial Job- MinutiaI #/ IBack- I= SRO UEI/S Explanation IFocus I I Dis I Link I units ward K/A Only 66 F 2 E 600000AA2.06, MEM 2.5/2.8, New WOOTF The procedure does not state pressurization mode. Only isolation operation. Need to make it like the procedure, unless the specific referenced procedure states what the stem did. Did not look at the other procedur Otherwise appears o TCK - Changed to WOOTF. The procedure for operating the control room ventilation system has the step labeled isolation/pressurization mod June 18, 2002 (2:17PM), RSB, ok as changed 8/2102 - Facility requests minor editorial chang TCK - Changed as requested. 8/5 S 9/19/02 - Facility accepted resolution. TCK 67 S G2.1.29, MEM3.4/3.3, Modified June 18, 2002 (2:19PM), RSB, Changed the word needs to is required to ok as is . Psychometric Flaws 4. Job Content Flaws 5. Other .

Q# LOK LOD (F/H) (1-5) Stem 1 Cues T/F Cred. Partial Job- I Minutia #I Back- Q SRO U/E/S Explanation Focus Dis Link untsl ward K/A Ony 68 F 3 U G2.1.32, MEM 3.4/3.8, New KA states: Ability to explain and apply system limits and precaution The question really requires memory of the new setpoints. The question does not require application or explanation TCK - Changed to WOOTF. Revised the question to also know what actions must be taken when a safety limit is violated. 5/30 June 18, 2002 (2:22PM), RSB, ok as changed, however, not sure the licensee expects this as RO knowledge level. Need to ask 8/2/02 - Facility requested minor spelling chang TCK - Changed as requested. 8/5 9/19102- Facility accepted resolution. TCK 10/4/02 - Facility requested different question for RO since it is beyond the requirements for the RO to kno S TCK - Developed new question for SRO and RO. 10/7 69 H 3 S G2.2.1, C/A3.7/3.6, New Disagree with LOK, more of a memory, if you do not know, can not figure ou Otherwise appears o Not so sure the licensee expects the RO's to have the number memorize TCK - Changed to Memory. 5/30 June 18, 2002 (2:24PM), RSB, ok as redesignate /4/02 - Facility requested thermal power changed from 21% to 23% and delete reference to power level required by T TCK- Revised question to address APRM adjustment only. 10/7 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

0# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- 0= SRO U/E/S Explanation Focus Dis Link units ward K/A Ony 70 F 2-3 S G2.3.1, MEM 2.6/3.0, Modifie WOOTF Otherwise appears o TCK - Changed to WOOTF. 5/30 June 18, 2002 (2:26PM), RSB, ok as is 71 F 3 U G2.3.2, MEM 2.5/2.9, Bank KA states: Knowledge of the facility ALARA progra Question concerns itself with posting areas associated with given initial conditions. Not sure this matche May need to select KA 2.3.10 this matches bette TCK - Changed to WOOTF. I think the question meets the K/A. 5/30 S June 18, 2002 (2:27PM), RSB, ok will accept 72 H S G2.4.12, C/A 3.4/3.9, New WOOTF Otherwise appears o TCK - Changed to WOOTF. Added degrees. 5130 June 18, 2002 (2:50PM), RSB, ok 73 S G2.4.16, C/A 3.0/4.0, New June 18, 2002 (2:51PM), RSB, ok 10/4/02 - Facility requested references be given to R TCK - Added statement to stem that provides references of EOP Flowcharts to the RO. 10/7 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- C= SRO U/EIS Explanation Focus j Dist. j I Link I lunits ward K/A Ony 74 F 2-3 S G2.4.43, MEM 2.8/3.5, New WOOTF Otherwise appears o TCK - Changed to WOOTF. 5/30 June 18, 2002 (2:52PM), RSB, ok 812/02 - Facility requested clarification in the stem to indicate that the communications are between the Control Room and Fire Brigad TCK - Changed as requested. 8/5 9/19102 - Facility accepted resolution. TCK 75 S G2.4.47, C/A 3.4/3.7, New June 18, 2002 (2:52PM), RSB, Are we going to have to provide the procedure for them to use? Are they expected to know this from memory?

TCK - RO and SRO should know what conditions require a Blowdow /30 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

(FIH) (1-5) Stem Cues TIF Cred. Partial Job- MinutiaI #/ IBack- 0= SRO U/E/S Explanation Focus Dis Link units ward K/A Only H 3-4 X E 204000K5.08, C/A 2.6/2.6, New WOOTF add degrees before F in the stem Not sure this is a number the applicants are required to have committed to memory. Ifyou provide the TS as I think the utility would want this makes it trivia Are they required to have this number in memory?

TCK - Changed to WOOTF. The applicants should know the isolation setpoints for the RWCU system. Added degrees. 5/30 June 18, 2002 (2:59PM), RSB, ok as changed 8/2102 - Facility requested minor spelling changes and a copy of the applicable Tech Specs and Tabl TCK - Made suggested editorial changes and revised answers to make C correct since previous answer was incorrect. 8/ /19/02 - Facility accepted resolution. TCK 10/4/02 - Facility requested answer 'C" be changed from 24 hours2.777778e-4 days 0.00667 hours 3.968254e-5 weeks 9.132e-6 months to 12 hours1.388889e-4 days 0.00333 hours 1.984127e-5 weeks 4.566e-6 months since both B and C would be correct. Also requested Bases as referenc S TCK - Revised as requested but did not supply bases. 10/7/02 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q4 LOK LOD T I (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO U/E/S Explanation Focus Dis Link units ward K/A Only 2 H 3-4 X E 205000G2.1.22, C/A 2.8/3.3, NEW KA ok Can we make the date of the test the same date of the written examination?

Are TS's going to be given with this question? Not sure they are required to know from memor Add degrees prior to all cases where F i WOOT I do not understand how you get the answer, please explai TCK - Changed to WOOTF. Added degrees. Date will be changed to proper date when we know when the exam is scheduled. Tech Specs will be given with the question. 5/31 June 19, 2002 (6:09AM), RSB, Don't worry about changing the date, ok as i /4/02 - Facility thought Unit 2 should be changed to Unit TCK - Explained that references for Unit 2 should be given. Facility S accepted resolution. 10/7 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q# LOK LOD (F/H) (1-5) Stem Cues TI Cred. Partial Job- Minutia / a 0 GRO U/S/S Explanation Focus Dis Link units ward K/A Only 3 H 3-4 X E 206000K5.08, C/A 3.0/3.2, NEW WOOTF Should be able to break out the first part of each distractor because it is same for all. "HPCI Vacuum Breaker Isolation Valve MO F104 must be closed."

Are TS's going to be provided? Do you expect them to know from memory?

TCK - Changed to WOOTF and moved first part of all answers to the stem. Tech specs will be provided. 5/31 June 19, 2002 (6:11AM), RSB, This question was NOT changed as stated. Is this not a direct look up when the TS's are provided? Discuss with Ti TCK - Ensured question was changed as described above. This will not be a direct look-up since Tech Specs don't say when to declare HPCI inoperable. 6/20 8/2/02 - Facility requested EPN change to valve number TCK - Changed as requeste /12 - Facility requested simplified drawing of HPCI Exhaust sy TCK - Denied request. Operator should know exhaust path of HPCI and facility accepted resolution. 9/19 10/4/02 - Facility requested "design" be replaced with "safety" in the answers.Requested Bases as referenc S TCK - Revised as requested. Bases not supplied. 10/7/02 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

CQ# LOK LODI I I I (F/H) (1-5) Stem Cues TIF Cred. Partial Job- MinutiaI #/ 1Back- Q= SRO U/E/S Explanation Focus Dis Link units ward K/A Only 4 H 3-4 E 209001 G2.2.21, C/A 2.3/3.5, New, WOOTF Place"" around A, done Are TS's going to be provided? Not sure could answer without them. Will this make it a direct look up then?

TCK - Changed to WOOTF. Added ""around A. Tech Specs will not be provided since they don't specify which surveillances need to be performed. 5/31 June 19, 2002 (6:15AM),RSB, will see if the licensee will have a problem S with this questio H 3 E 215004K5.03, C/A 2.8/2.8, New WOOTF form should be from in distractor D. Fixe Should distractor C be above range 2, since the opposite is true, Range 2 and below. I would think that range 2 would not be counte TCK - Changed to WOOTF. Changed IRM reading in stem to Range 2 since SRMs are not required with IRMs on range 3 or above. 5/31 June 19, 2002 (6:19AM), RSB, ok as changed 8/2/02 - Facility requests copy of TRM section 3.3.2 for referenc TCK - Provided copy of TRM section 3.3.2 and Tech Spec section 3.3.1.2. 8/ S 9/19/02 - Facility accepted resolution. TCK . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO UIE/S Explanation Focus Dis Link units ward K/A Only 6 H 3 E 218000G2.2.22, CIA 3.4/4.1, New WOOTF Are TS's going to be provided. Ok if they ar Start sequence with 1600 vice 220 TCK - Changed to WOOTF. Will provide Tss. Didn't understand part about sequence. 5/31 June 19, 2002 (6:20AM), RSB, on the distractors start with 1600 vice 2200, Changed in test. Changed the answer to B and then rearranged the S description of the distractors to match the new answer F 2-3 X E 264000K5.06, MEM 3.4/3.5, New WOOTF, The lesson plan states induction motor driven pumps would that have to be added to those distractors that needed it?

Yes this is not just an SRO only questio TCK - Changed to WOOTF. Added motor driven pumps to distractor A to be consistent with other distractors. 5/31 Does it need to be replaced because it is to easy?

June 19, 2002 (6:25AM), RSB, YES, it is too easy, it is not an SRO U question will need to be replace TCK - Wrote new question. It is now a C/A question. 6/20 E/S June 24, 2002 (1:48PM), RSB, seem ok, not sure this is an SRO S question, but it is bette . . Psychometric Flaws 4. Job Content Flaws 5. Other .

0# LOK LOD (F/H) (1-5) Stem Cues I T/F I Cred. Partial Job- Minutia #/ Back- Q=0 SRO U/E/S Explanation Focu Dist.* I Link I Junits ward K/A Only 8 F 2-3 E 295002AA2.02, MEM 3.2/3.3, New WOOTF Add degrees to distractor C. Done Place the name of the procedure in Parenthesis. Don Not necessarily SRO only question. Why would the RO not be required to know this from the subsequent operator action Why is this an SRO memory level question of subsequent actions of the procedure. Does the facility expect the operators to have this in memory?

June 19, 2002 (6:41AM), RSB, This question was not addressed by TCK TCK - Wrote new question. Changed to C/A. 6/20 June 24, 2002 (1:52PM), RSB, not sure where you changed the question to a CA from a Memory level. Maybe on your bank. Not on the 0 driv /2102 - Facility requested to change stem and answers from "Reactor Power" to "Generator Output".

TCK - Denied change after discussing with the Facility. The Generator Output change is immediate but the Reactor Power follows. 8/5 S 9/19/02 - Facility accepted resolution. TCK . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q# LOK LOD (F/H) (1-5) Fstem Cues T/F Cre sPartial Job- Minutia #/ Back- 0Q= SRO U/E/S Explanation Focus IDis Link I__

I__ Iunitslward K/A (Onlyl__________________________

9 F 2-3 E 295006G2.2.22, MEM 3.4/4.1, New WOOTF, Why SRO Only?

Do RO's not need to know this?

KA does not match. Explain why it does? KA is the Knowledge of LCOs and safety limits, the question concerns itself with basis for scrams, TCK - Re-wrote question to meet K/A. This changed the question to C/A instead of Memory. 5/31 June 19, 2002 (6:42AM), RSB, I do not see any changes, looks like the same question to me. Discuss with TIM TCK - Believe the question was changed and I threw the old question away. Need to review question as it is now. 6/20 June 24, 2002 (1:53PM), RSB, ok as is. No change necessary 8/2/02 - Facility requested title change for I & C Techs and to provide copies of TS 3.3.1.1 and table 3.3.1.1- TCK - Changed as requested. Allow copy of TS 3.3.1.1 but not the tabl /5 S 9/19/02 - Facility accepted resolution. TCK 10 H 3 E 295010AA2.06, C/A 3.6/3.6, Bank WOOTF Is Graph 8 going to be provided? If it is would that not eliminate that distractor. Did not look up the references need to understand where the answer comes fro TCK - Changed to WOOTF and revised distractors slightly. Ask licensee if need to provide copies of PC-1 and Graph 8. 5/31 June 19, 2002 (6:46AM), RSB, ok as changed, will ask licensee if we need to provide this info. But again it may eliminate one of the incorrect S answers immediatel . . Psychometric Flaws 7.

Q# LOK LOD~ r tT 4. Job Content Flaws 5. Other (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- 0= SRO U/EJ Explanation I Focus Dis Link units ward K/A Ony 11 H 3 S 295017G2.3.4, C/A 2.5/3.1, New change hurt to injured. Done SRO only ?? NOT sure it i TCK - Made procedure name italics. Believe this is SRO level since it deals with Emergency Director responsibilities. 5/31 June 19, 2002 (6:49AM), RSB, discuss with GH to see if he believes it is SRO only. I still do not believe it i /2/02 - Facility requested to provide a copy of 73EP-EIP-073-O TCK - Copy of procedure not provided. SRO should know what the lifesaving dose limits are. 8/ /19/02 - Facility accepted resolution. TCK 12 H 3 S 295025EA2.04, C/A 3.9/3.9, New WOOTF EXPECTED OR EXEMPTED??

Otherwise ok TCK - Changed to WOOTF. Changed excepted to exempted. 5/31 June 19, 2002 (6:51AM), RSB, ok as change /2/02 - Facility requested U-2 PC-1 EOP to be provide TCK - PC-1 not provided since this would then be a direct lookup. 8/ /19/02 - Facility accepted resolution. TCK 10/4/02 - Facility requested adding "all of" in the stem to prevent having two correct answer TCK - Revised distractor "B"to add another system that made the answer incorrect. 10/7

Q# LOK

_ _ L.....LOD (F/H) (1-5)

II 3. Psychometric Flaws Stem Cuesj T/F Focus 1I 4. Job Content Flaws

_ _

I 5. Other

!_ _

Cred. Partial Job- MinutiaI #1 Back- Q= SRO U/IEIS Dis Unk I units ward K/A Only

_ _ Explanation 13 H 3 S 295030EA2.01, C/A 4.1/4.2, New WOOTF Appears ok TCK - Changed to WOOTF. 5131 June 19, 2002 (6:51AM), RSB, ok as changed 8/2/02 - Facility requested minor title chang TCK - Changed as requested. 8/ /19/02 - Facility accepted resolution. TCK 14 H 3 E 295031G2.4.4, C/A 4.0/4.3, New WOOTF Distractor 0 does not make sense to me. When do you have a SCRAM and NOT enter the EOPs? Is there a case that this happens?

TCK - Changed to WOOTF. You do not enter the EOP's if you don't meet an entry condition. Every scram does not meet entry condition. 5/31 June 19, 2002 (6:52AM), RSB, Is there a procedure that you go to then?

If so put that in the distracto TCK - Added Scram procedure to distractor D. 6120 June 24, 2002 (1:58PM), RSB, ok as change /12 - Facility requested change to a mispelled wor S TCK - Changed as requested and facility accepted resolution. 9/13 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dis I Link I lunits ward K/A Ony 15 H 3 E 295033G2.3.10, C/A 2.9/3.3, New in stem changed going up to increasing and changed causes to caused WOOTF in the stem, is it necessary to provide the Max Safe Operating values?

Seems like they, SROs should know that informatio TCK - Changed to WOOTF. Placed ORDER in the stem and revised all distractors for the action only. Left Max Safe values in the stem to make the distractor for blowdown more plausible. 5/31 June 19, 2002 (6:53AM), RSB, ok, but do not agree with putting in the max safe value /2/02 - Facility requests minor title changes and copy of SCC EO TCK - Changed as requested and also provided SCC reference. 8/ S 9/19/02 - Facility accepted resolution. TCK 16 H 3 E 295034EA2.02, C/A 3.7/4.2, New WOOTF Why SRO only? Seems generic to both RO and SR Distractor B is not plausible. Why would any pick a non radioactive system to cause a High Rad isolation? Needs to be change Distractor D under line the word NO June 19, 2002 (6:56AM), RSB, NOT address by TCK TCK - Changed to WOOTF and revised distractor B. Believe this is Sro due to analysis of situation. 6/20 June 24, 2002 (2:06PM),RSB, ok as changed. Will ask licensee if is SRO onl /2/02 - Facility requested minor equipment name chang TCK - Changed as requested. 8/5 S 9/19/02 - Facility accepted resolution. TCK . 3. Psychometric Flaws 4. Job Content Flaws 1 5. Other .

01 LOK LOD T (F/H) (1-5) Stem Cues T/F I Cred. Partial Job- Minutia #I Back- Q= SRO U/E/S Explanation IFocus I Dis Link units ward KIA Only 17 H 3 295035G2.1.7, CIA 3.7/4.4, New The answer requires damage to have occurred. How do you get that from the stem. Additionally, the tornado should be > 100 mph to determine that answer, how do they get this?

Discuss with TIM WOOTF Seems like you have to provide Eplan and EOPs to get the answer. You don't expect them to answer from memory do you?

TCK - changed to WOOTF. Added wind speed to stem. The reactor bldg siding is loose in the stem should indicate damage caused by the tornad Should be able to answer from memory. 5/31 June 19, 2002 (6:58AM), RSB, ok, will see what the licensee has to sa /2/02 - Facility requested minor title change and to re-order the actions in each answer so that the declaration is made first. Also requested copy of 73EP-EIP-001-O TCK - Changed as requested and provided copy of procedure. 8/ /12 - Facility requested rewording stem to indicate that Inside Rounds SO discovers air leaking into containment and pointed out that loss of containment is a 4 hr action per Tech Spec TCK - Changed as requested except added that air was noticed to be rushing "in and out" since the containment is broke. Facility accepted resolution. 9/13 10/4/02 - Facility requested deleting the TS actions due to not reasonable to memorize to this leve TCK - Reference is provided that could lead to the correct answer since only one answer identifies the event as a site emergency. SRO should know the TS requirements for loss of secondary containment.. Left question as-is and facility agreed. 10/7 18 S G2.1.22, C/A 2.8/3.3, Modified June 19, 2002 (7:07AM), RSB, ok, no TS's provided

S#LOK .

LOD T11 Flaws 3. Psychometric 4. Job Content Flaws 5. Other (F/H) (1-5) Stem Cues T/F Cred. Partial Job- I Minutia #1 Back- Q SRO U/E/S Explanation Focus Dis Link units ward KIA Only 19 F 2-3 S G2.1.4, MEM 2.3/3.4, Bank Appears to be o Provide TS's? If provided may be a direct look u TCK - Will provide Tech Spec section. It doesn't talk about SRO for fuel handling activities. 5/31 June 19, 2002 (7:06AM), RSB, OK as is 20 H 2-3 E G2.2.27, C/A 2.6/3.5, New WOOTF The question as it is seems ok. Why don't we make A the answer, that is not as obvious. Make A's first part and then correct it to have the correct actions. That way the SRO will have to think a bi Not sure why this is SRO onl Do not agree with level of difficulty, more of a memory level questio TCK - Changed to WOOTF. Changed answer so that A is correct as suggested. Believe question is C/A since the SRO must understand that continuing on with fuel moves is not correct and must recognize the correct action to take. 5/31 June 19, 2002 (7:08AM), RSB, ok as change /2/02 - Facility requested additional info for the answer which says that the orientation error was correcte TCK - Changed as requested and also changed other distractors in regards to fuel orientation. 8/ S 9/19/02 - Facility accepted resolution. TCK . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO UIE/S Explanation Focus Dist. I I Link lunits ward K/A Only 21 M 3 E G2.2.32, 2.3/3.3, NO source provided. Not sure what category it is. Also no LOK provide WOOTF Not so sure that C is not a correct answer. Need to evaluate if it is truly incorrect. Discus Why SRO only?

TCK - Changed to WOOTF. Answer C is not an option per the procedur SRO only because this is an action the SRO is responsible for. 5/31 June 19, 2002 (7:10AM), RSB, ok as change S 22 F 2-3 S G2.2.6, MEM 2.3/3.3, Bank OK as is SRO only??

TCK - Re worded the stem slightly. 5/31 E June 19. 2002 (7:13AM), RSB, Why is A not correct, it says the SS should? Discus TCK - Answer A is not correct since this process is used for an editorial S change only. This change is not editorial. 9/19

1, . Psychometric Flaws 4. Job Content Flaws 5. Other .

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/EIS Explanation Focus Dis Link units ward K/A Only 23 H 3 E G2.3.3, C/A 1.8/2.9, New WOOTF TS's provided? Should be. Will that be a direct look up then?

TCK - Changed to WOOTF. Tech Specs not provided since this condition would be required to be recognized on shift. 5/31 June 19, 2002 (7:14AM), RSB, ok as change /2/02 - Facility requested copy of TS 3.7.6 to be provide TCK - Provided copy of TS as requested. 8/ /12 - Facility requested cahnging answers to delete "at least" in all answers and to delete surveillance grace period tim TCK - Changed as requested due to inappropriate use of grace perio Changed answer A to isolate SJAE... as requested by facility and facility S accepted resolution. 9/14/02 24 F 2-3 S G2.3.4, MEM 2.5/3.1, Bank Appears ok TCK - Changed to WOOTF. 5/31 June 19, 2002 (7:15AM), RSB, ok as changed.

25 S 2.4.48, C/A 3.5/3.8, New June 19, 2002 (7:16AM), RSB, ok as is 9/12 - Facility requested question revised to 30% oscillations since this would be a reason that SBLC was already initiated. Remove indication of SBLC continuity alarm. Revise answers accordingl TCK - Revised as requested and facility accepted resolution. 9/14 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q#LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- MinutiaRI # Back- Q SRO U/E/S Explanation Focus Dis Link units ward KJA Only H 3 S 201001G2.1.28, KA 3.2/ Used on the last exam how can it be characterized as NEW?.

Appears to be o Why do they need the attached reference?

TCK - Changed to Bank question. Drawing is provided without labels to help diagnose problem. 6/3 June 19, 2002 (1:02PM), RSB, ok as changed 9/12 - Facility requested change to unit and component designato TCK - Changed as requested. Does not change intent of question and S facility accepted resolution. 9/14 2 F 3 X E 201001 K2.02, 3.6'/3.7, Bank The stem of the question has to be placed in the Which one of the Following (WOOTF) format. Should read:

Unit 1 is operating at 100% RTP, WOOTF represents the expected response of the Scram Pilot Solenoid Valves and the Backup Valves due to a loss of RPS 'A."

All the distractors except C the second part state de-energized. Need to make one the second part de-energized. I believe this would make this bette TCK - Changed to WOOTF as suggested. Revised distractor C as suggested. 6/3 S June 19, 2002 (1:16PM), RSB, Ok as changed.

3 H 3 S 204000K5.04, Bank, 2.7/2.7, Ban Question appears to be o TCK - Capitalized ONE. 6/3 June 19, 2002 (1:48PM), RSB, ok as change . .Psychometric Flaws 4. Job ContentFlaws 5.Other .

Q2# LOK LOD TrT I I (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- 0 SRO U/E/S Explanation Focus I__ Dis Link Iunits ward I KIA Only 4 H 3 S 205000K3.04, Bank 3.7/ Added the word degrees to the initial conditions. Otherwise appears to be o TCK - Changed to WOOTF. 6/3 June 19, 2002 (1:50PM), RSB, ok as change /2/02 - Facility requested clarification for answers C and D so it was clea that forced circulation through the core is diminishe TCK - Made minor editorial change to stem and revised answers C and D as requested. 8/ /19102 - Facility accepted resolution. TCK 10/4/02 - Facility requested stem to indicate that RWL was indicated level and to change "loss of forced circulation" to "inadequate circulation".

TCK - Changed as requested. 10/7 5 H 3 E 206000A2.16, New, 4.0/4.1, TCK May need to add the noun name for the procedure 34-SO-E41-001-2S, Are they required to know this information? Probably not. Even though they wil Should add to the stem WOOTF. To make it standardize WOOTF is the appropriate operator action(s) for the opeartor to take with regards to the HPCI syste Add degrees to the ste TCK - Changed to WOOTF. All operators need to know that they have to manually start equipment if it doesn't start on an auto start signal. 6/3 S June 19, 2002 (1:51PM), RSB, ok . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- MinutiaI #/ Back- Q= SRO U/E/S Explanation Focus Dis Link units ward K/A Only 6 H 3 E 209001G2.4.31, C/A 3.3/3.4, New, No source liste Bullets may work bette Unit 1 is in Mode 4. maintenance is being conducted that has the potential to drain....

WOOTF actions should be taken with regards to the "A" Spray Pump?

TCK - Changed to WOOTF. Left stem as is without bullets. 6/3 June 20, 2002 (7:00AM), RSB, OK as change /18/02 - Facility requested stem be changed to say the "A" Core Spray is the only pump running. Didn't want the operators to be confused as to whether "B" pumps were availabl TCK - Added words to stem that say "B"pumps are out of service due to an outage. Facility accepted resolution. 911 /4/02 - Facility requested adding more information to the stem that indicates a pump may not tip when the alarm actuate S TCK - Added cause from ARP in the form of a note in the stem. 10/7 . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q#LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia ; Back- Q= SRO U/E/S Explanation Focus Dis Link units ward K/A Only 7F 2 209001 K5.06, C/A 3.7/4.0, New Disagree with the level of knowledge, believe this is more a knowledge level questio Stem could be better written. Need to add an underline under the words, actual and capitalize close at the end of the sentenc Need to also add WOOT WOOTF is the ACTUAL total pump flow (in gpm) when the minimum flow valve (FO31) gets a CLOSE signal?

TCK - Changed to WOOTF. Reworded stem to make it flow bette Capitalized CLOSE. Believe it is C/A since the operator must know what the pump flows are and must know to add the 2 values together. 6/3 June 20, 2002 (7:01AM), RSB, ok as changed, ok to level of knowledg /18/02 - Facility proposed new question due to KA is plant specific to BWR 1. Hatch is BWR 4. Change KA fromK5.06 to K5.0 TCK - Replaced question with proposed question. Facility accepted S resolution. 9/18 8 H 3 E 212000A3.05, C/A 3.9/3.9, New, TCK The question is not clear as to the status of the test. Do we need to add some words as to where they are? Do we need to the stem the procedure? Would it be better if we changed the words ... signed off.., to signed accomplishe Add to C and D the word received after signa TCK - Changed to WOOTF. Added received to C and D. Revised stem to make it clear that the test was not performed. 6/3 S June 20, 2002 (7:03AM), RSB, ok as change . . Psychometric Flaws 4. Job Content Flaws 5.Other .

Q# LOK LOD I r I- it S (F/H) (1-5) Stem CuesI Cred. Partial Jb Minutia # Back- SRO U/S Explanation JFocus Dis Lnk units ward Only 9 F 2-3 E 215002G2.1.23, MEM, Bank, 3.9/4.0, The distractors can be shortened. The first sentence can be put in the ste Need to WOOTF to the ste The question's distractors actually concern themselves with the Recorde The Stem does not really discuss the recorder. Do we need to add to the stem about the recorde TCK - Changed to WOOTF. Removed first sentence and placed in the stem. 6/3 June 20, 2002 (7:05AM), RSB, ok as changed, also, removed the word S best from the stem.

10 F 2-3 E 215003A4.05, C/A 3.4/3.4, New, TCK Distractors A and B point the person to IRM F. I don't believe that we have to put that in the distractor. That way we don't point to that particular IR WOOT Low level CA real close to a Memory TCK - Changed to WOOTF. Removed specific IRM from the distractor /3 S June 20, 2002 (7:08AM), RSB, ok as changed 11 F 2-3 S 215004K2.01, MEM 2.6/2.8, New, TCK The question appears ok, however, the KA concerns itself with Knowledge of electrical power supplies to the following: SRM channels/detectors. The first three bullets concern themselves with Radiation monitors. This does not fully support the KA. It may be o TCK - Changed to WOOTF. Believe it meets the K/A since the power supply failure affects the SRM's. 6/3 June 20, 2002 (7:10AM), RSB, ok as i . . Psychometric Flaws 4. Job Content Flaws 5. Other .

T 0# LOK LOD I (F/H) (1-6) Stem Cues T/F Cred. Partial Job- Minutia #I j Back- Q= SRO U/E/S Explanation Focus Dist.' Link units ward K/A Only 12 H 3 E 239002K6.05, C/A 2.7/3.0, New, TCK Change the stem to read more clearly, something like A Vacuum breaker failed in the 'OPEN" position WOOTF describes the effect on containment and the Safety Relief Valves if a relief valve lifts?

TCK - Changed to WOOTF. Reworded stem to make it clear as to which relief valve lifts. 6/3 S June 20, 2002 (7:11AM), RSB, ok as changed.

13 H 3 X E 256000K1.05, C/A 3.1/3.1, Bank Stem needs to be re-written to meet standar Unit 2 is operating at 80% RTP. WOOTF describes the plant response if an operator opens the Unit 2 Condensate ............. ?

Distractor B does not make much sense to me. Talk to Tim about i TCK - Changed to WOOTF. Added that the valve is opened inadvertentl Removed available from distractor B. 6/3 S June 20, 2002 (7:13AM), RSB, ok as change M 2-3 X E 259001K1.05, MEM 3.2/3.2, New Stem needs to use WOOT The answer C, does not incorporate Condensate pumps, did you not put these in for a reason. It would not be a totally correct answer without these listed. Ask Ti TCK - Changed to WOOTF. Revised distractor C to include Condensate Pumps. 6/3 5 June 20, 2002 (7:18AM), RSB, ok as change .

Q#LOK LOD 3. Psychometric Flaws 4. Job Content Flaws 15.Other (F/H) (1-5) Stem Cues[T/F Cred. Partial IJob- fMinutiaI #/ IBack- I ORO U/E/S Explanation Focus Dis Link units ward Onyr n/

15 H 3 E 264000A1.01, C/A 3.0/3.0, New, Change stem to use WOOT Not sure if they expect the applicants to know the DG should have tripped 1 degree after the setpoint. If may make it more palatable if we make it 240 degrees. Discuss Low level CIA Stem could be a little clearer ....... DG is running an loaded onto the bus TCK - Changed to WOOTF. Reworded stem slightly to say that the diesel is tied to the bus. 6/3 June 20, 2002 (7:20AM), RSB, ok as changed 10/4/02 - Facility requested oil pressure trip setpoint be changed to 22 psig from 20 psig due to procedure chang S TCK - Changed as requested since setpoint changed. 10/7 16 H 3 E 264000K3.01, C/A 4.2/4.4, Bank The KA states Knowledge of the effect that a loss or malfunction of the EMERGENCY GENERATORS (DIESEL/JET) will have on the following:

Emergency Core Cooling Syste I do not believe the question matches the KA. Discus Change stem to add WOOTF. Not sure the question illicits the answe TCK - Changed to WOOTF. Reworded question to account for a failure of a D/G to start to meet the K/A. Changed the question from Bank to Modified. 6/3 June 20, 2002 (7:23AM), RSB, ok as changed, now it meets the KA 8/2/02 - Facility requested clarification for the 25 second timefram TCK - Revised stem to clarify that the 25 seconds is from the initiation signal to the EDG's. 8/7 S 9/19/02 - Facility accepted resolution. TCK . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO UIE/S Explanation Focus Dis Link units ward K/A Only 17 M 2-3 E 271000K4.08, MEM 3.1/3.3, Modified KA ok WOOTF The valves in the stem, are they unit 1 or 2?

Next time attach the original questio TCK - Changed to WOOTF. Placed the Unit in the first part of the ste /3 S June 20, 2002 (7:26AM), RSB, ok as changed.

18 F 3 X E 295002G2.1.2, MEM 3.0/4.0, Bank KA ok Distractor D does not appear plausible. Why would you isolate feed. If we keep this distractor need to add degrees pror to Otherwise appears o TCK - Changed to WOOTF. Kept distractor D as-is since there is direction in the loss of Circ Water procedure to bypass the demins if Condensate Temp exceeds 140 F. 6/3 June 20, 2002 (7:26AM), RSB, ok as change /2102 - Facility requested changing the conditions in the stem from 800 Mwe to 550 Mwe since losing a Circ Pump at 800 Mwe would scram the uni TCK - Changed as requested. 8/7 S 9/19/02 - Facility accepted resolution. TCK . 3. Psychometric Flaws 4. Job Content Flaws 5. Other .

04 LOK (F/H) LOD (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dis Ljnk units ward K/A Ony 19 H 3 E 295010AA2.02, C/A 3.8/3.9, New KA? Not sure it matches that close. Could also be??

Add WOOTF Are we going to have to provide PC-I, it seems that this information may be SRO knowledge vice RO. Discus TCK - Changed to WOOTF. Rewrote question to match the K/A. 6/3 June 20, 2002 (7:29AM), RSB, the question a reason for the should or should not, do we have to put that in the stem. SHOULD or SHOULD NOT be in operation and the reason for that? So it seems that now you do not need the procedure to answer this questio TCK - Changed the question slightly to remove SHOULD and SHOULD NOT from the stem. Do not need to provide PC-I, RO's should kno /20 S June 24, 2002 (2:09PM), RSB, ok as changed.

20 H 3 X E 295020G2.1.20, C/A 4.2/3.9, NEW CBO, is this Hatch terminology. Not sure, have to ask facilt WOOTF Are the Ros supposed to know this knowledge? ARPs without immediate operator actions are not normally required for memorization. Will need to ask the facilit The answer does not state anything about stopping the surveillance. That would most likely make the answer more correct. Would this be necessary to do?

Not sure I agree with the level of knowledge. I believe it is memor TCK - Changed to WOOTF. Revised the answer to include that Shift Supervisor stops the surveillance. CBO is Hatch terminology . 6/3 June 20, 2002 (8:38AM), ok as change /2/02 - Facility requested minor title changes in stem and answer TCK - Changed IM's to I&C. 8/ S 9/19/02 - Facility accepted resolution. TCK

Q#

LOK LOD 3. Psychometric Flaws Iri 4. Job 1 Content Flaws 5. Other (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ IBack-

_ _

IFocus jI Ds Link units ward K/A I

Q= SRO U/E/S C y'0 Explanation 21 H 3 X E 300000K6.12, C/A 2.9/2.9, New, WOOTF Not sure that B and C are that much different. Need to replace one of them. The same thought process occurs to eliminate either on Is D correct or do they have more times to operate with nitrogen? I realize that they are isolated but what is the actual cycle amount. Use that vice 1 TCK - Changed to WOOTF. Moved distractor C to Distractor D. Revised distractor C for clarity. 6/3 S June 20, 2002 (8:40AM), RSB, ok as change /4/02 - Facility states that question is difficult in that it requires evaluating condition of nitrogen backu TCK - discussed with facility and the question is technically accurate and meets the K/A. Agreed to leave as is. 10/7 22 F 2 X E G2.1.10, MEM 2.7/3.9, Bank KA ok Reword WOOTF is the maximum power level authorized for UNIT 2 operation lAW the current Facility Operating License No. NPF-5?

It may be better to say law T Both units are the same thermal power, how did you get the other thermal power level?

TCK - Changed to WOOTF. Left the numbers the same from the ban /3 S June 20, 2002 (9:53AM), RSB, ok as change . Psychometric Flaws 4. Job Content Flaws 5. Other .

Q# LOK 1 LOtD (F/H) (1-5) Stem Cues I TIF Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation IFocus Dis I Link I tunits I ward I VA On 23 H 3 E G2.1.2, C/A 3.0/4.0, New Not sure this is RO required memorization material Need to discuss with licensee to see if it is appropriate required knowledg WOOTF TCK - Changed to WOOT June 20, 2002 (9:54AM), RSB, OK as changed. Will let the licensee determine if this is RO knowledg /2102 - Facility requested correct answer be revised to delete portion that is no longer performed by R TCK - Changed as requested and reordered answers. 8/7 S 9/19/02 - Facility accepted resolution. TCK 24 F 3 E G2.2.13, MEM 3.6/3.8, Bank WOOTF Not sure this is RO knowledge requirement. Need to ask license Used as an SRO question before.,

What does TDO stand for?

TCK - Changed to WOOTF. TDO stands for Tagout Desk Operator. 6/3 June 20, 2002 (9:55AM), RSB, ok as changed, Will let the licensee S determine if RO knowledge.

25 S G2.2.3, MEM 3.1/3.3,New, June 20, 2002 (9:57AM), RSB, changed the wording of the stem slightly, appears to be o /12/02 - Facility requested "and" located after safe Shutdown Panel to be capitalized and underline _TCK - Changed as requested and facility accepted resolution. 9/14

ES-403 Written Examination Grading Form ES-403-1 (R8, SI)

Quality Checklist Facility: E.I. HATCH Date of Exam: 10/30/02 Exam Level: RO/SRO Initials Item Description a b c Clean answer sheets copied before grading V4 1#/66 Answer key changes and question deletions justified and documented 1 146 Applicants' scores checked for addition errors (reviewers spot check > 25% of examinations) _ ,_ Grading for all borderline cases (80% +/- 2%) reviewed in detail _ _ All other failing examinations checked to ensure that grades are justified _ , _ Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed Name / Signature Date TIMOTHY C. KOLB/ B/_/,

a. Grader NA b. Facility Reviewer(*)

RICHARD S. BALDWIN/

c. NR C C hief Exam iner (*) ,Z,,.,._-_,___...,,,_ // t' -O MICHAEL E. ERNSTES/

d. NRC Supervisor (*) iQf,,n/

. - "2 /f'//z 6/a z (*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are require ES-403 Written Examination Grading Form ES-403-1 (R8, S1)

Quality Checklist Facility: E.I. HATCH Date of Exam: 10/30/02 Exam Level: RO/SRO Initials Item Description a b c Clean answer sheets copied before grading -7.Z- A4N Answer key changes and question deletions justified and documented __ 1 Applicants' scores checked for addition errors (reviewers spot check > 25% of examinations) _ Grading for all borderline cases (80% +/- 2%) reviewed in detail _ _ All other failing examinations checked to ensure that grades are justified I Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed Name / Signature Date TIMOTHY C. K a. Grader ___ /_-_

NA--/

b. Facility Reviewer(*)

RICHARD S BALDWIN/

c. NRC Chief Examiner (*) " // 2 MICHAEL E. ERNSTES/

d. NRC Supervisor (*) rZ--., /,/r4 ___

(*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are require ES-501 Post-Examination Check Sheet Form ES-501-1 (R8, $1)

Hatch October 2002 Task Description Date Complete Facility written exam comments or graded exams received and 11/07/02 verified complete Facility written exam comments reviewed and incorporated and 11/14/02 NRC grading completed, if necessary Operating tests graded by NRC examiners 11/28/02 NRC Chief examiner review of written exam and operating test 12/02/02 grading completed Responsible supervisor review completed A/a/ Management (licensing official) review completed /¶ /o 3 License and denial letters mailed Facility notified of results Examination report issued (refer to NRC MC 0610) _ /_,_o 1 Reference material returned after final resolution of any appeals

IR 05000321/2002301

Text

Navigation menu

v t e Inspection Report - Hatch - 2002301 (Operator Exams)
80 \| 81 \| 82 \| 83 \| 84 \| 85 \| 86 \| 87 \| 88 \| 89 \| 90 \| 91 \| 92 \| 93 \| 94 \| 95 \| 96 \| 97 \| 98 \| 99 00 \| 01 \| 02 \| 03 \| 04 \| 05 \| 06 \| 07 \| 08 \| 09 \| 10 \| 11 \| 12 \| 13 \| 14 \| 15 \| 16 \| 17 \| 18 \| 19 \| 20 \| 21 \| 22 \| 23 \| 24 \|
2002 Quarterly Integrated 1Q (0) 2Q (0) 3Q (0) 4Q (0) Assessments Mid Cycle End of Cycle Security Operator Exams 301(0) Emergency Planning Other

IR 05000321/2002301

Text

Navigation menu

Search