ML092160391

2009 Kewaunee, Initial Exam - Administrative Forms

ML092160391
Person / Time
Site:	Kewaunee
Issue date:	04/13/2009
From:	NRC/RGN-III
To:
References
Download: ML092160391 (14)

Text

KEWAUNEE POWER STATION ADMINISTRATIVE REQUIREMENTS DOCUMENTS ES-201-1 ES-301-4 ES-301-5 ES-301-6 ES-401-4 ES-401-9 Operating Test Comments

ES-201 Examination Preparation Checklist Form ES-201-1 Facility: Kewaunee Power Station Date of Examination: April 13-23, 2009 Developed by: Written - Facility NRC // Operating - Facility NRC Target Chief Date* Task Description (Reference) Examiners Initials

-180 1. Examination administration date confirmed (C.1.a; C.2.a and b) drm

-120 2. NRC examiners and facility contact assigned (C.1.d; C.2.e) drm

-120 3. Facility contact briefed on security and other requirements (C.2.c) drm

-120 4. Corporate notification letter sent (C.2.d) drm

[-90] [5. Reference material due (C.1.e; C.3.c; Attachment 2)] n/a

{-75} 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-5, ES-D-1's, ES-401-1/2, ES-401-3, and drm ES-401-4, as applicable (C.1.e and f; C.3.d)

{-70} {7. Examination outline(s) reviewed by NRC and feedback provided to facility drm licensee (C.2.h; C.3.e)}

{-45} 8. Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-drm 301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6, and any Form ES-201-3 updates), and reference materials due (C.1.e, f, g and h; C.3.d)

-30 9. Preliminary license applications (NRC Form 398s) due (C.1.l; C.2.g; ES-drm 202)

-14 10. Final license applications due and Form ES-201-4 prepared (C.1.l; C.2.i; drm ES-202)

-14 11. Examination approved by NRC supervisor for facility licensee review drm (C.2.h; C.3.f)

-14 12. Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g) drm

-7 13. Written examinations and operating tests approved by NRC supervisor drm (C.2.i; C.3.h)

-7 14. Final applications reviewed; 1 or 2 (if >10) applications audited to confirm qualifications / eligibility; and examination approval and waiver letters sent drm (C.2.i; Attachment 4; ES-202, C.2.e; ES-204)

-7 15. Proctoring/written exam administration guidelines reviewed drm with facility licensee (C.3.k)

-7 16. Approved scenarios, job performance measures, and questions drm distributed to NRC examiners (C.3.i)

• Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.

[Applies only] {Does not apply} to examinations prepared by the NRC.

ES-301 Transient and Event Checklist Form ES-301-5 Facility: Kewaunee Date of Exam: 4/13-27/2009 Operating Test Number: 1 (group 1,2,3)

A E Scenarios P V P E 1 2 3 4 T M L N O I I T T N C CREW CREW CREW CREW A I A T POSITION POSITION POSITION POSITION L M N Y S A B S A B S A B S A B U T P R T O R T O R T O R T O E M(*)

O C P O C P O C P O C P R I U RO RX -- 2 -- 1 1 1 0 SRO-I NOR 1 -- 3 2 1 1 1 I/C 1,2,4,6 1,7 2,5,3 9 4 4 2 SRO-U MAJ 5 4 4 3 2 2 1 TS -- -- -- 0 0 2 2 RO RX 1 -- -- 1 1 1 0 SRO-I NOR -- 2 3 2 1 1 1 I/C 2,3,7 1,3,5,6,7 1,2,5,6 12 4 4 2 SRO-U MAJ 5 4 3,4, 4 2 2 1 TS -- 1,3,4 1,3 5 0 2 2 RO RX -- -- 3 1 1 1 0 SRO-I NOR 1 2 -- 2 1 1 1 I/C 1,2,3,4,6,7 3,5,6 1,6,3 12 4 4 2 SRO-U MAJ 5 4 4 3 2 2 1 TS 3,4 -- -- 2 0 2 2 RO RX 1 1 0 SRO-I NOR 1 1 1 I/C 4 4 2 SRO-U MAJ 2 2 1 TS 0 2 2 Instructions:

1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SROs must do one scenario, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position.

2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-1 basis.

3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.

ES-301, Page 26 of 27

ES-301 Competencies Checklist Form ES-301-6 Facility: Kewaunee Date of Examination: 4/13-27/2009 Operating Test No.: 1 APPLICANTS RO RO RO RO SRO-I SRO-I SRO-I SRO-I Competencies SRO-U SRO-U SRO-U SRO-U SCENARIO SCENARIO SCENARIO SCENARIO 1 2 3 4 1 2 3 4 5 -- -- -- 5 -- -- --

Interpret/ Diagnose 1-7 1-7 1-6 1-6 1-7 1-7 1-6 1-6 1-6 1-6 Events and Conditions Comply With and Use 1-7 1-7 1-6 1-6 1-7 1-7 1-6 1-6 1-6 1-6 Procedures (1)

Operate Control 1-7 1-7 1-6 1,2,4-6 1-7 1-7 1-6 1,2,4-6 1-6 1-6 Boards (2)

Communicate 1-7 1-7 1-6 1-6 1-7 1-7 1-6 1-6 1-6 1-6 and Interact Demonstrate 1-7 1-7 1-6 1-6 1-6 Supervisory Ability (3)

Comply With and 3,4 1,3,4 1,3 2,3 2,3 Use Tech Specs. (3)

Notes:

(1) Includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Check the applicant's license type and enter one or more event numbers that will allow the examiners to evaluate every applicable competency for every applicant.

ES-301, Page 27 of 27

ES-401 Record of Rejected K/As Form ES-401-4 Tier / Randomly Reason for Rejection Group Selected K/A RO 1/1 027AA1.02 Operate/monitor SCR-controlled heaters in manual - KPS does not have manual control for proportional heaters. Selected 027AA1.01 as replacement.

RO 1/2 037AA1.06 Main steam line rad monitors - Have seven other questions related to radiation monitors on RO exam and one additional question on the SRO exam. Selected 037AA1.11 as replacement.

RO 2/1 007 G 2.4.45 Prioritize and interpret significance of each alarm associated with PRT - Only one annunciator alarm exist for PRT (47043-B PRESSURIZER RELIEF TANK ABNORMAL) so cannot be discerning. Selected 007 G 2.1.20 as replacement.

RO 2/1 007 G 2.4.35 Local operator tasks during emergency and effects - No actions associated with PRT for AO during emergency. Selected 007 G 2.1.20 as replacement.

RO 2/1 012A3.03 Monitor auto operation Power Supply for RPS - Discriminating question could not be written to test power supply since no auto action associated with power supply to RPS. Selected 012A3.02 as replacement.

RO 2/1 013K1.18 Premature reset of ESF actuation - No discriminating actions on early reset of ESF actuations (Containment Spray, SI, Containment Isolation) since components do not change state. Selected 013K6.01 as replacement.

RO 2/1 013K1.06 K/A is valid for KPS but when selection of Tier 1 was completed K6 had only been selected once while K1 had been selected 7 times (5 times from 2/1). Decided to deselect a K1 and reselect from K6 to meet sampling requirements. Selected 013K6.01 as replacement.

RO 2/1 076A1.02 Monitor reactor and turbine building closed cooling water temperatures - KPS does not have closed cooling loops cooled by SW or similar cooling systems. No other allowable K/As in A1 for 076 so reselected 076 G 2.4.50 as replacement.

SRO 1/2 036AA2.01 ARM indications as related to Fuel Handling incidents - Have seven other questions related to radiation monitors on RO exam and one on SRO exam. Also K/A does not allow for SRO-level question development that is discriminating. Selected 036AA2.03 as replacement, which also is related to radiation monitor/release values but has SRO-level quality attributes.

SRO 2/2 034A4.01 & Monitor radiation levels/Monitor neutron levels from control room.

034A4.02 Have seven other questions related to radiation monitors on RO exam and one on SRO exam. Also K/A does not allow for SRO-level question development that is discriminating. Selected 034K5.03 as replacement.

RO 3 2.1.17 Make accurate, clear and concise verbal reports. Not applicable to written; evaluated in Operating Exam. Selected 2.1.7 as replacement.

Tier / Randomly Reason for Rejection Group Selected K/A RO 3 2.2.24 Interpret control room indications to verify the status and operation of a system - Not applicable to written but evaluated in Operating Exam. Selected 2.2.41 as replacement.

SRO 3 2.1.6 Manage control room crew during plant transients - SRO-level but Not applicable to written. Evaluated in Operating Exam. Selected 2.1.3 as replacement.

SRO 3 2.2.40 Apply Technical Specifications for a system - SRO-level but not appropriate for Tier 3 since no system exists. Evaluated in Operating Exam. Selected 2.2.37 as replacement.

SRO 3 2.3.15 Knowledge of radiation monitoring systems, such as fixed radiation monitors and alarms, portable survey instruments, personnel monitoring equipment, etc - Does not allow for SRO-level question development that is discriminating. Selected 2.3.13 as replacement.

RO 1/1 056AK1.04 Definition of saturation conditions, implications - Similar to K/A 010K5.01 in Tier 2/1 on RO outline. Could not develop a dissimilar discriminatory question on this topic. No other K/As in K1 group that would differentiate from the (KAs) questions selected elsewhere on thermodynamics and natural circulation. Reselected from K3 group and selected 056AK3.02 as replacement.

RO 2/1 076AA2.03 Determine or interpret RCS R/A level meter for high RCS activity -

Low discrimination value in that only one meter used (R-9) and indications are either PPCS (Computer) alarm or control board annunciator for alert or high level on R-9. Selected 076AA2.02 as replacement.

RO 2/1 039K1.07 Relationship/cause-effect relation between MRSS and RMS - Large number of radiation monitor questions on written (seven on RO and one on SRO). Also this area is on Operating Exam dynamics with a SG tube leak or SGTR. Selected 039K1.07 as replacement RO 2/1 073A4.03 Operate Check Source for Rad monitor - This K/A is selected as a JPM on the Operating exam. Selected 073A4.01 as replacement.

RO 2/2 034A1.02 Predict or monitor limits on changes in water level in refueling canal

- Not discriminatory for RO-level only. Related to KA already selected in Tier 1/2 (036AK2.02). No other 034A KA exist that can be used. Selected 034 2.1.32 (G) as replacement.

SRO 1/2 036A2.03 Magnitude of potential R/A release from fuel handling incident -

Large number of questions related to radiation monitors (six on RO and one on SRO), and large number of fuel handling related KAs (two on RO and three on SRO). Selected new E/APE W/E01EA2.2 as replacement

Tier / Randomly Reason for Rejection Group Selected K/A RO 2/2 028A1.01 According to USAR 5.8.2: Although generation of hydrogen can follow a LOCA, the postulated hydrogen release from a design basis LOCA has been determined not to be risk significant because it is not large enough to lead to early containment failure. The risk associated with hydrogen combustion is beyond design basis (e.g.,

severe) accidents. 10CFR50.44 as revised September 16, 2003, eliminated the hydrogen release associated with a design basis LOCA. Question would ask for information in the SAMG. Selected new K/A 028K5.03 SRO 1/1 057G2.4.1 Not credible. Entry into EAL for a Loss of Vital AC Inst. Bus would require a loss of 3 of the 4 Vital AC Inst. Buses. With the plant redundancy not a credible situation. Selected new K/A 057G2.4.11

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 1 H 2.5 E New. Put headers over the columns. Done.

2 H 2 E New. Put common material in stem. No change made.

3 F 2 S New.

4 F 1.5 S Bank.

5 F 1.5 S New.

6 H 2.0 S New.

7 H 2.5 S New. Changed distractor d. to prevent 2 correct answers.

8 F 2.5 S New. Changed stem to eliminate confusion.

Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

• The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

• The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

• The answer choices are a collection of unrelated true/false statements.

• The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

• One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

• The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

• The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

• The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

• The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).

ES-401 2 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 9 H 2.0 S New.

10 H 2.5 S New 11 H 3.5 S New.

12 F` 2.0 S New. Changed Feed and Bleed to Bleed and Feed.

13 H 2.0 S New.

14 H 2.5 S New.

15 H 2.5 S New.

16 H 2.0 U New. Not a higher skill question. Agreed - changed to F 17 H 2.5 S Bank New. Do we need to provide a power level in the stem to prevent 18 F 2.0 E assumptions? Agreed - power level added.

19 H 2.0 S New.

20 H 2.0 S Modified.

21 H 2.0 S Modified.

22 H 2.0 S Modified.

New. Distractor d. does not follow the stem, eliminating it easily. Not 23 H 2.0 U a higher order question. Answer has to be memorized. Agreed -

replaced distractor d., changed to F.

24 F 2.0 S New.

25 H 2.0 S New 26 F 2.5 U Modified. Not fundamental. Agreed - changed to H.

27 F 2.0 S New.

28 H 2.0 S Modified 29 F 2.5 U New. Not a fundamental question. Agreed - changed to FH 30 H 2.5 S New.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 31 F 1.0 U Modified. LOD = 1. Agreed - modified question and distractors.

32 F 2.0 S Modified.

Bank. May be a trick question - dumps on floor. Agreed - modified 33 H 2.0 S distractor.

Bank. LOD =1.0. Agreed - modified distractors by adding 34 H 1.0 U causes.

35 F 2.0 S Modified 36 F 2.0 S New.

37 H 2.0 S Bank.

38 H 2.5 S Bank.

39 H 2.5 S Bank 40 F 2.0 U Bank. Not fundamental. Agreed - changed to H.

41 F 2.0 S Bank New. Not an RO task. Not a fundamental question. Agreed -

42 F 2.5 SU changed to H. Disagreed - task is an RO task at Kewaunee.

43 F 2.0 S Bank.

44 F 2.0 S New.

45 F 2.0 S Bank.

46 F 2.0 S New.

47 F 2.0 S New.

Bank. There is no stipulation as to VARS IN or VARS OUT. A 48 H 2.5 E candidate can dispute the question by making assumptions that would be allowed. Agreed - added VARS out.

Bank. Distractors a. and b. are not plausible in that they are not related to the electrical control system of the EDG. LOD = 1.

49 F 1.0 X U Agreed - replaced distractors. After distractor replacement, LOD = 2.

50 F 2.0 S Bank.

51 F 1.0 U Bank. LOD =1 Agreed - replaced question.

52 H 2.0 S New.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only Bank. Not higher skill. Recognition of a setpoint. Agreed -

53 H 2.0 U changed to Fundamental.

54 H 2.0 S New.

New. Be ready to respond to questions about how many RHR 55 H 2.0 S pumps are running when the exam is being given. Agreed - added additional information in plant status.

Bank. Not an RO job responsibility. Disagreed - this is the ROs 56 H 2.5 SU responsibility at Kewaunee Station.

57 H 2.0 S New.

58 H 2.0 S Modified 59 F 1.0 U Bank. LOD = 1 Agreed. Replaced correct answer.

nd Modified. Review 2 bullet for clarity. Add permission to distractor d., i.e. NRC permission Distractor b. is ok as is. Changed 60 H 2.5 E distractor d. to NRC approval. Changed correct answer to distractor d.

New. Distractors a. and c. dont relate. Agreed. Modified 61 F 2.0 x U distractors a. and c.

New. Distractor b. is improbable. Failure of an impulse pressure 62 H 2.0 E instrument doesnt have any impact on a steam line flow instrument.

Agreed. Replaced distractor b.

63 F 2.0 S Bank.

64 H 2.0 S New.

65 F 2.0 S Bank.

New. The action doesnt appear to be IMMEDIATE. Verify it is an 66 H 2.0 E immediate action or modify the stem. Action is an IMMEDIATE action. No change to the question.

67 F 2.0 S New.

68 H 2.5 S New.

69 H 2.5 S New 70 H 3.0 S New.

71 H 1.0 U Bank. LOD = 1. Not higher skill. Agreed. Replaced question.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only New. Not higher skill. Disagreed. Fundamental question. No 72 H 2.0 U changes made. Agree with facility.

73 H 2.0 S Bank.

Modified. Not an RO job responsibility. Disagree. This is an RO 74 H 3.0 SU task at Kewaunee Station. Changed to satisfactory.

75 F 2.0 S New.

76 H 2.5 X S New.

77 H 3.0 X S New New. Not a higher skill. Must be memorized. Agreed. Changed to 78 H 2.0 X U Fundamental 79 H 2.5 X S New.

New. Not an SRO Only question. The question can be answered 80 H 2.0 X E with system understanding. Agreed. Reworded distractors to make the question SRO level.

Bank. Change the distractors so they reflect an SROs job, i.e., enter 81 H 2.5 X E and direct the actions of, etc. Agreed. Changes made New. Change the distractors and stem so they reflect an SROs job, 82 H 2.5 X E i.e. enter and direct the actions of, etc. Agreed. Changes made.

83 H 2.5 X S New.

New. Verify distractor d. is incorrect for all cases (Nis are not working, can the SRO legitimately enter ATWS? Not allowed to 84 H 2.5 X S enter ATWS with given conditions. Added SRO direction to distractors to make the question SRO Only.

85 F 2.0 X S New.

Modified. LOD = 1. Simple recognition of setpoint. Not an SRO Only question. Question can be answered with RO knowledge of the 86 F 1.0 X U limiting safety system setpoints. (entry conditions) Agreed. Added tech spec basis to distractors and answer to make the question SRO Only.

Modified. LOD=1. Recognition of the purpose of the system.

87 F 1.0 X U Question can be answered with RO knowledge of the system.

Agreed. Replaced question.

88 H 2.0 X S New.

89 H 2.0 X S New.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only Bank. Not an SRO level question. This is an entry condition that is 90 F 2.0 X U required to be memorized by an RO. Facility has custom tech specs. This information is SRO Only at Kewaunee Station.

91 H 2.5 X S New.

92 H 2.5 X S New.

93 F 2.0 X S New.

94 F 2.0 X S New.

95 F 2.0 X S New.

96 F 2.0 X S Bank 97 H 2.0 X S Modified New. Not an SRO Only. This is a part of GET. Agreed. Changed 98 F 2.0 X U question to a tech spec action.

New. Not a fundamental question. Requires analysis Agreed.

99 F 2.0 X U Changed to higher skill.

100 H 2.0 X S Bank.

OPERATING TEST COMMENTS Admin JPM a RO: Is Step 2 a critical task? If it is, should step 11 be a critical task? Is Step 4 a non-critical task? Critical tasks resolved during on-site validation.

Admin JPM a SRO: The cue doesnt seem to elicit any action. What is the actual cue? Cue was missed by the examiner. Cue was acceptable.

Admin JPM e1 SRO: Please replace both SRO admin JPM e so the JPM so the SRO has to make PARs. JPM replaced with new classify/provide PAR JPM.

CR JPM g: This is a dynamic JPM. See if we can fix initial cue so operator understands his task. It also only has one critical task. Cue changed to support a dynamic JPM.