ML081190704

NRC Comments to the Proposed Written Examination, ES-401-9 for the Fermi Initial Exam - January 2008

ML081190704
Person / Time
Site:	Fermi
Issue date:	03/25/2008
From:	Hironori Peterson Operations Branch III
To:	Jennifer Davis Detroit Edison
Shared Package
ML080860174	List: ML081190547 ML081190699 ML081190701 ML081190704 ML081190707 ML081200422 ML081200435 ML081200448 ML081200455
References
50-341/08-301
Download: ML081190704 (16)

Text

NRC COMMENTS TO THE PROPOSED WRITTEN EXAMINATION, ES-401-9 FOR THE FERMI INITIAL EXAM -JANUARY 2008

1. 2. 3. Psychometric Flaws 4. Job Content F l a w 5. Other 6. 7.

QX LOK LOO (F/H) Stem Cues T/F Cred. Partial J o b Minutia XI Back- Q= SRO Explanation Focus Oist. Link units ward KIA Only 1 H 2 Y S New.

2 H 4 Y U New. LOO = 1. This is fundamental information that everyone should S know. Probably not Higher skill.

RESOLUTION: Agree ilis fundamental information, but question addresses the KA and could not identify a beller way to ask question thai incorporated the elements of the KA. Make LO0=2 and question=S.

Instructions

[Refer to Section 0 of ES401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of dafcully (LOO) of each question using a 1 - 5 (easy - difficull) rating scale (questions in the 2 - 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

The Stem lacks sufficient focus l o elicil the correct answer (e.g., unclear intent. more information is needed, or too much needless information).

The stem or distracton wntain cues (i.e., clues, specif~cdeterminers phrasing, length. etc).

The answer choices are a collection of unrelated truenalse statements.

The distradors are not credible: single implausibledistractom should be repaired, more than one is unacceptable.

One or more distractom is (are) partially correct (e.9.. lfthe applicant can make unstated assumptionsthat are not contradicted by stem).

4. Check the appropriate box if a job content error is identfied:

The question is not linked to the job requirements (i.e., the question has a valid KIA but, as written, is not operational in content).

The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e.. ilis not required l o be known from memoly),

The question contains data wilh an unrealistic level of accuracy or inconsistent unils (e.g., panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformancewith the approved KIA and those that are designated SRO-on/y(KIA and license level mismatches are unacceptable).

6. Based on the reviewer's judgment. is the question as wrillen (U)nsatisfactofy(requiring repair or replacement). in need of (E)dnorial enhancement, or (S)atisfactory?

7. At a minimum, explain any V ratings (e.g., how the Appendix B psychometric allributes are not being met).

I A "+" in the 'Q#" column indicates that question was reviewed as part of the representative sample of 30 questions.

All questions reviewed for KA conformance and reference verification Page 1 of 15

1. 'sychometnc Flaws 6. 7.

.OK

-/H J/E/S Explanation Dist.

U C

power supply to tne inverter? If no, and DN 2 IS the only power s~pply then A and B are not plausible RESOLUTION There IS no backup power supply to the HPCl inverter Change stem ana dnlractor wording 10 require diagnosis of the loss of m r from the inverter and associated ODerator actions S

S S

New.

Bank 12003 NRCI.

Bank. Same question on DAEC exam.

I RESOLUTION: This question is from the Fermi 2 bank EQ-OP-315-0123-000-A017-001.

E RESOLUTION Final suomlnal will have correct answer (D I iaentlfied S 1Bank. II S Bank (2001 NRC) 10 CFR reference should be 41(b)(7) or (5)

RESOLUTION Changea reference 10 '4t(b)7.

E New Question answer assumes no IeaRage analor aces not indicate how long the is0 ation valves nave been closed Say how long is0 ation valves nave teen s h d so appliwnt dwsn't assume accumulator nas bed down RESOLUTION Revised the stem 10 include a ten minute lime to account for accumu alor syslem bleec down Page 2 of 15

4. Job Content Flaws 1 5. Other- 6. 7.

1RC J/E/S Explanation

.ink unit! )nh X Y E New. 1) Do individual valves indicate GREEN or RED or does the group indicate only when all vaives are in the required position? 2) What does "Valves wired in series'on display mean?

RESOLUTION: Incorporated statement that clarified 'isolation is complete" in the stem. 1) All valves in a group have to close to get the green light.

Y S New.

Y New. Steam Tables pmvided. 1) Feed Flow will increase due to level error to compensate for Feed/Steam Flow mismatch. not because tnennal power nc I

RESOLUTION 1) Changed 'D' to an incorrect. plausible answer to Ireflect FW 'lowering to' vice 'at." Plausible because II Y U New 1) RFP sdction flow and pressure bullets in stem provide c ~ e on s djrect on 01 Min Flow Valve failure 2) No correct answer min flow valve is not procedurally REQUIRED to be reposdioned dnless there IS not enougn flow througn tne SULCV to tne RPV, which IS Jnllkely at the referencea power ,eve1 RESOLUTION Rewrote question using same KA. to be a loss of air to the SULCV (fails OPEN) mth the requirement to select a mdigating action N U Ba&& New 1) As m e n stem could be interpreted to read a smgle Low Water Level sgnal wnich would have no effect 2) Q#KA postulates a realignment of SBGT not a loss or maiiunction of the system 3) If SBGT IS not capabe of drawng TONSpressLre negative enough to open vacuum Dreaken then distractor D is not p ausible RESOLUTION Licensee agreed wnh commenls Could not wrde creddable queslion 10 the selectea KA knowleage K3 06 Resekcted to K3 04 and mote new ouestion Y S I Bank (2006 NRC).

Page 3 of 15

3. Psychometric Flaws 6. 7 o b Minutia lac J/US Explanation Jist. unlt!

E Bank. No wrrect answer: damage may occur only if busses are not in phase. Just because the bus is being supplied by the DG does not by itself indicate that the two busses would not be in phase, ie. possibili, buses would be in phase.

RESOLUTION: Revised last sentence of stem to LOCAL MANUAL operation of breaken. and used the term MAY resuil in... vice Will cause equipment damage to negate the concern for a randomly limed.

synchronized by chance wndtion that could occur. Also reordered the answer choices shortest fin1 to lowest last.

X U Bank (2003NRC) LOO=l No creddaDk distracton cue l o answer E provlded by system name, LOW pressure inledion system Used on prev.ous NRC exam, therefore. E vice U RESOLUTION Changed reactor pressure In Stem from 900 to 400 psig which does not change answer, but makes questlon more creddable LOB2 X E Modified. Consider a new distractor D (see wmment on Q22). Note: If distractor D changed. then both Q21 and 22 would be good questions, othemise, potential double jeopardy.

RESOLUTION: Changed distractor D (old question) to a symptom for a loss of Div 1 ESF Battery (new choice A), re-ordered answer choices shoriest l o lonaest.

X M New. 1) Q provides cues For eliminating distractor D in previous Q 21.

S Distractor B is a wrrect answer(?)

RESOLUTION: Changed Q21 distractor which negated this comment.

Page 4 of 15

Psychometric Flaws

4. Job Content Flaws 5. Other 6. 7.

artia linutii SRO u/E/s Ewlanation Dist VA Only x W Bank. OLook at site procedures for paralleling; whether DG picks up or S gives up load is dependant on speed difference. Are C and D correct answers?

RESOLUTION: Breaker closure automatically adiates a governor mode change from ISOCHRONOUS lo SPEED DROOP. The EDG is initially ISOCHRONOUS, or speed regulated, at 60 hr with the synchroscope moving slow in the FAST direction to pmduce a minimally loaded condnion when the breaker is closed. When the breaker is closed, the governor mode change occurs and speed droop lowers governor demand (fuel flow) by an amount based on the increased load.

Wfih very lmle initial load, a further redudion in fuel flow will resun in a reverse power condiiion. Automatic operation of the governor will not result in overload contiaion (reason for requirement lo immediately apply load). C and D are not correct answers.

Y I I S INew.

Y I I S INw.

yI I E I BanN The stem stales that the rod IS de-selected and cLes potential elimination of C and D Delete 'de-selected .

RESOLUTION D e l e d 'is de-selected, and rod' from last line of stem Page 5 of 15

X X

r.7 N flL m +

N z

I

4. Job Content Flaws 5. Other 7 2

Focus x

I

/F Cred.

Dist.

X artia linutii lack-Nard I= SRC VA On4 Y

Ewlanation lew. 1) The stem does not indicate whether annunciator is due to a higl iput signal or due to an INOP wndaion. At the current power a rod

1. lockshould not occur due to an over power condition. 2) Given the ondtions stated in the stem. Band D are not plausible since a Rod llock (RB) would occur regardless of which input tripped the alarm.

RESOLUTION: Deleted alarm from stem, added and if exceeded to answer choices, and changed LOK to F. RBM RBr are auto bypassed when referenceAPRMs are below 27 per cent power (ie. RB condition would not occur). Therefore B and D are plausible.

The RBM trip setpoint is not reactor power. The RBM is enabled l o generate rod block functions by reference APRM power exceeding 27 percent. The RBM output is LOCAL power if only the LPRMs surrounding the selected control rod are normalized or nulled to 100 percent. As a control rod is withdrawn, local power rises. The setpoint at which the RBM will initiate a RB is determined by the reactor power a the time the control rod was selected and the RBM nulled. When a rcd is selected for movement. the RBM will indicate 100 percent. That is an indicationthat the null process m p l e t e d successfulty. It is agreed thal APRM RBs will not occur at 65 percent averaqe,or APRM measured reactor power. The question evaluates the RBM instrument initiating a RB based on local power increase generated by rod withdrawal.

The initial reactor power determines the RB setpoint as follows: When reactor power is 27-52 percent. the Low Trip Setpoint is active, RB occurs at 117.0 percent RBM level. When reactor power is 62-82 percent, the IntermediateTrip Setpoint is active. RB occurs at 112.2 percent RBM level. When reactor power is above 82 percent. the High

-_ Trio Setooint is active, RB occurs at 107.2 percent RBM Level.

3 N Jew Bank. QZKA, postulated event is an equipment failure and not due D operation of controls. KA is oriented towards NORMAL operation of he Fuel Handling Equipment. As mitten, Q related l o a refueling iccident (KA 295023).

tESOLUTION: ROs dont handle fuel: also. no Hi Rad interlock, load 811 related l o slack cable interlocks; not operationally valid KA.

teselected KA AI .03 to replace At .02 and replaced guestion.

Page 7 of 15

-5. ( 7.

3= Explanation (IA 33+ H U p(ew Bank 1) Wdh the keep fil subsystem solatea all four answer F- choices are true statements Operation of the keep fill system will H min m i x the impact of each of the oescriced conddlons except possibly 8

2) Q#KA KA is onentea towards operation of the controls associated wdh the CRDH System The reference leg keep fill subsystem 15not mpacted by normal CRDH control manipidation Question is an instrument impact question related to Nuclear Boiler Instrumentation(KA 216000) and not related IO impact of RPV water level resuhing from operalion of the CRDH system 3) LOK=F RESOLUTION Replaced question LOK=H 3 4 H S New 35 H I S INew.

~ ~~

II 36+ H U New. The ARP directs verification of H2 flow rates. This could be misinterpreted such that C wouM be a correct answer.

RESOLUTION: Replacad distractor C to make only one correct answer.

37 F W New. Are applicants required to memorize all loads on MPUs? LO?

S RESOLUTION: Operators are required to memorize MPU loads per learning objective. LP-OP-3154150-A013. 'Describe the normal and alternate power supplies to Process Radiation MonitoringSystem components." Revised answer choices to a conceptual level.

38 F E New. LOK=H.

H RESOLUTION: LOK-H.

39+ F S New.

40 H S Bank.

41 H E Bank. it is not clear what "Loss of valve position indications for ALMOST all RClC Valves" means. The stem should indicate which RClC vatve indications still exist, since there are a small number.

RESOLUTION: Revised last two bulieted hems in stem.

42+ H S Bank (2006 NRC).

Page8of IS

3.Psychometric Flaws 4. Job Content Flaws I 5. Other 6. 7 JEIS Explanation 43 Y S New.

44 X Y c) Bank (2003NRC). 1) The procedure tale '...Shutdown..." within the E stem gives cue to corred answer C. 2)Also, stem does not say why control rom is un-inhabtable. so B could be a possible corred answer.

RESOLUTION: Deleted 'un-inhabitable" in stem. edited 'shutdown and cooldown" to 'continue to remove decay heat." Reordered answer

- choices shortest to longest.

15+ Y E 1Bank. LOK=H.

46 X Y E Bank. 1) Given Station Air low alarm and low Station Air pressure indication, B and D are not plausible (ie, to first start Control vice Station Air compressors). 2)Are subsequent steps required to be done in ordefi If so. replace 'DN1 or DN2 Control Air Compressors' wilh 'Close P50OO-F401: 3) ROs not required l o memorize subsequent procedure steps (required by LO? Asking conceptual vice specific steps?).

RESOLUTION: Deleted 'FIRST" in stem. Ediled dlstradors B and D l o "CLOSE P5000F401 to prevent..." instead of 'START Div 1 and Div 2

- Control Air Comoressom.'

47 X X Y E New. 1) The question stem asks two separate questions and is confusing (need l o rephrase the question stem and align the corresponding answers l o clarify what h being asked). 2)As willen, the three bullets and following sentence in stem are 'Ruff (not required to answer the question). 3) Last stem sentence references Abnormal procedure 20.205.01, "Loss of Shutdown Cooling' which implies RHR A and B are lost which eliminates A and B (ie. not plausible),

RESOLUTION: Rewrote stem and distradors l o incorporate comments

- and make them more conceptual and to the point.

18+ Y U New Why IS 26 5 feel wlevabte [le. C and D plausible)7 RESOLUTION Changed C and D from 26 5 to 22 0 feet. minimdm level above spent fuel sealed n rams. not referencedto the RPV flange Page 9 of 15

E -

1. 3. Psvchmetric Flaws 4. Job Content Flaws 5. Other 6.  ?

OK 3i TIF JIEIS Explanation 49 Y New. 1) LOD=5 (too difficult). NRC doesn't examine beyond Design S Basis. 2) Q#KA. answer D is a low pressure system (vacuum breaken).

U does not directly address the high DW pressure.

RESOLUTION: Not asking question beyond design basis (ie, SAGS),

asking about exceeding a design limit. Reference is UFSAR and EPGs, not SAG. Question not Focused on the low pressure system (vacuum breakers), they are the affected system. Replaced "would be MOST LIKELY to cause the Primary Containment to exceed a Design Limit?'

with Would threaten Primary Containment Integrity?' Added '...located in the Drywell' to distractor A.

POST EXAM Second correct answer.

New.

50 S 51+ S lBank 52 U New. Q#W,KA is focused on RWL. choices focus on pressure permissive. Rewrite choices as indicated.

RESOLUTION: Accept comment. Rewrote stem and choices as indicated.

53 S New. DWSlL CURVE provided.

S Bank.

54+

]New.

-55 S 56 New 1) A is also a correct answer. Statement is true. question not asking for a basis. 2) B is '...inside the Secondary Containment." Not plausible unless change "inside."

RESOLUTION: 1) Rewrote distractorA to make it incorrect, ie. Control Room radiation concern. Deleted '...outside Secondary Containment' from stem. which makes B a plausible distractor. Note: Safety related equipment is located inside the Secondary Containment. The Secondary Containment EOP contains a steo for restartina RB HVAC to Dreserve

~

57+ S access 10 Safety Related Equipment which pro-vides the basis for a polenlial misconception INew.

III Page 10of 15

X

+ +

m W

4. Job Content Flaw I 5. Other 6. 7 J/E/S Explanation S New.

S IBank (2003 NRC).

S IBank (2003 NRC).

U New. The applicants are cued to the correct answer because ROs are only required to know 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> TS actions. The only plausible distractor is the correct answer (ie. no plausible distracton).

RESOLUTION: Changed times to be within 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> plus a plausible 1.25 overrun.

E New. As written. this k a Subsequent Action of 20.710.01, operaton not required to know subsequent actions from memory (required by LO?

Asking conceptual vice specific steps?).RESOLUTION: Made choices more conceptual. Reworded stem by deleting 'FIRST.' Bolded AREA to distinguishfrom Fuel Pool Exhaust Duct Radiation Monitors.

s Bank.

U New. D is a second correct answer (go from EOP 1 to In).

RESOLUTION: Revised stem to include no actuations and no control rod motion. Revised distractor B to make it incorrect. Revised correct

- answer and other two distracton to make D correct answer.

s Bank.

U New. 1) A and C not plausible. Not plausible that Fermi 2 notifications to Canada (foreign country) and the NRC (federal government agency) would be affected by the SEOC (state and local government) being functional. 2) Are ROs "communlcaton' (ie, job responsibility)? This is SRO level of detail (Emergency Director).

Y

- s RESOLUTION: ROs are communicaton. Revised question to be a selection of communication techniques.

New.

Page 12of 15

Page 15 of 15