ML12116A179

NRC Comments on Draft Licensee Developed Exam (Written)(Folder 2)

ML12116A179
Person / Time
Site:	Three Mile Island
Issue date:	02/29/2012
From:	Caruso J Operations Branch I
To:	Vanwyen T Exelon Nuclear
Jackson D
Shared Package
ML113350031	List: IR 05000289/2012301 ML113460727 ML12095A273 ML12110A080 ML12116A177 ML12116A179 ML12116A182 ML12116A189 ML12116A194 ML12137A337 ML12137A339 ML12137A348
References
TAC U01847, EA-401-9
Download: ML12116A179 (10)

Text

ES-401 Written Examination Review Worksheet Form ES-401*9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

0# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #I Back 0= SRO B/M/N UlEiS Explanation Focus Dist. Link units ward KJA Only 1 H 3 B S 2 F 2 N E Added words to stem, " ...provides an EFW initiation input .. to make an obvious KIA match 3 F 2 B S LOD borderline 2. Knowledge that the isolation valve breakers are open for the core flood tanks is very fundamental system knowledge borderline NLO 4 F 2 X N E Should revise Q to also add the affected power supplies so that it better matches KIA for knowledge of bus power supplies. The answer addresses expected pump combinations for operation but makes no mention of power supplies. Q revised to add power supplies.

Licensee added "pump" to B&D for accuracy.

5 H 2 N E Licensee made following changes based on validation feedback comments:

Bulletized the subsequently line for consistency

- Rearranged the wording in choices A and 0 for 2-part consistency with Band C.

- Due to rearranging, length of choices changed, therefore the correct answer went from A to B.

- Swapped A and B explanations.

6 F 2 B S 7 F 2 B S 8 H 2 B S Note: TMI Written Exam Draft Received 2/23/12. Review completed and comments on written provided to the licensee on 2/29/12. Reviewed written exam resolutions on site validation week 3/22 and 3/23. Subsequently on 4/13 licensee recommended some further revisions based on feedback from exam validators. Written exam approved 4/19.

ES-401 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK (FfH)

LOD (1-5) Stem Cues Focus Tt;-, ~~ ~artial Dist.

Job- Minutia #I Back-Link units ward Q= SRO BtMlN UtEtS KIA Only Explanation 9 H 4-5 X B S Looks like minutia for RO to remember from memory is there a valid LO for this? Will get back to me. Licensee stated Required RO know/edge from memory and they have a validLO 10 H 2 B S 11 F 3 N S 12 H 3 B S 13 F 2 B E Changed from "F" not H" just recall of set point 14 F 2 N S 15 F 3 N S 16 F 2 N S 17 H 3 N E Licensee made following changes based on validation feedback comments:

- Changed 2nd bullet from "Instrument air has lowered to 81 psig and is steady" to Instrument Air has lowered to 81 psig throughout the system, and is steady.

I~ ~ ~ ~ l~ ~  :~

F 2 B H 3 N I :: I F I 3 I I I I N I

21 F 1 X N U Q asks which will result in the earliest trip? Distractors not plausible - choice "8" the answer is the only choice that results in an auto trip. Licensee developed a new replacement Q testing same system but different generic KIA 22 H 3 N S 23 F 2 N E Licensee made following changes based on validation feedback comments:

- Added procedure number to stem.

- Added more to part 1 of each answer to remove ambiguity.

- Added info to explanation.

24 H 2 N S 25 H 3 8 S

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back Q= SRO B/M/N utE/S Explanation Focus Dist. Link units ward KIA Only 26 H 3 N S 27 F 2 N S 28 H How do we know from the Q that LPI flow is not greater than 2 8 E 1250 gpm in each line? Injection will occur at 180 psig in the ReS. Delete the word "(LOCA)" from stem unnecessary obviously a LOCA In addition, licensee made following changes based on validation feedback comments:

Edited 2 part stem to indicate Part (1) and Part (2).

29 F 2 M E Licensee made following changes based on validation feedback comments: Added "(per 1102-11, Plant Cooldown)" to the stem for clarification.

30 F 3 N S

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N UlE/S I:JqJIi:lllcH'vl' Focus Dist. Link units ward KIA Only 31 H N S 32 H N S 33 H X N E A&C don't appear to be plausible to purge the waste tank to stop a leaking relief valve? Licensee revised distactors to improve plausiblity 34 F 2 B S 35 F 2 Need follow-up on KiA match for fuel handling Licensee N E explained basis for KIA match In addition, licensee reworded the stem and choices based on confusion of validators. They did not really understand the wording, and there were possibly 3 or 4 correct answers based on interpretation. The question itself has not ch~ng~<:I,just rearranged.

36 F 2 N S 37 F 2 N S 38 H 3 N S 39 H 3 X B E o not plausible with Rx Trip IMAs complete in the stem.

Revised "C&D" and removed 4 psig ES actuation from stem not necessary and added steam tables as a required reference.

In addition, licensee made following changes based on validation feedback comments:

- Changed wording of choices to remove Phase 1 and Phase 2. The candidates must now know what is in Phase 1 and Phase 2.

- Rearranged all choices for consistency.

- Reordered explanations.

40 H 1 X N U LOO=1 that decay heat will not be less than 1% in the 1SI minute GFE which makes A&B implausible. Also second part of the answer more operational but how important is that for RO to know? Replaced Q and KIA 120 newQ.

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOO (F/H) (1-5) 8tem Cues T/F Credo Partial Job- Minutia #1 Back Q= 8RO B/M/N UlEiS Explanation Focus Oist. Link units ward KIA Only 41 H 3 X N U A&B not plausible to decrease RC8 pressure 100 psig and no change in break flow results Licensee rewrote Q and answer choices 42 F 2 M 8 43 H 1 X N U LOO=1. GFE indications of pump shaft shear. implausible distractors . Rewrote Q using same KIA with different stem conditions and answer choices.

44 H B 8 Please verify that this concept of not securing RCPs on a loss of SCM if elapsed time exceeds 1 minute has already been tested somewhere else on the exam.

Licensee verified not tested elsewhere on the exam 45 F 2 M 8 46 F 3 N E In addition. licensee made following changes based on validation feedback comments:

- Reorganized the choices for consistency.

- Reordered the explanations accordingly.

47 H 1 X N E "0" distractor not plausible top of Pzr htrs is about 64" the Pzr level is currently 190" and decreasing slowly approx 130" above top of htrs? Licensee lowered Pzr level in stem to make "0" more plausible also lowered power in stem to 5% to make lower level range for Pzr also more plausible.

48 F 2 B 8

49 F 2 X N E

1. KIA "adjustmenf to maintain frequency and voltage-recommend increase frequency of EDG "An to 61.1 and add to Q second part to explain how would adjustments be made, if necessary Licensee revised conditions in the stem and Q to require speedlfrequency adjustment.

Licensee added "lAW OP-TM-864-901/902" to the stem for clarity and to avoid challenges based on other procedures.

50 H 2 B S 51 F 2 X B E "An is not plausible to isolate cooling to the RCPs on a Rx trip after discussion the licensee will revise to 500 psig RCS pressure ESAS and reorder answer choices in ascending order. Revised "A" choice and reordered answer choices shortest to longest.

52 F 1 X N U Q is Too simplistic with no plant specific knowledge the Q can be answered. LOD=1, implausible distracters replace Q. Replaced Q with a bank Q testing a different KIA 53 F 2 N S I

54 F 2 N S 55 F 2 N S 56 H 3 N S 57 H 1-2 X N Y GFE as written, C&D not plausible, recommend adding second part to questions to ask corrective action to make more operationally oriented. Revised stem and answer choices to ask required operator actions.

58 F 2 N S 59 3 B S 60 2 N S 61 2 B E Tighten and revise stem change from 'should" to what is required by procedure. Licensee revised Q stem to lAW MAP required action.

62 1 N E A&S may have effedively the same meaning need to verify meaning of word "suspended" and "interrupted" to ensure different meanings at site. Revised answer choices 63 2 N S 64 1-2 X N U "A" & "S" not plausible to have 25" in the SIU range to support natural eire. Licensee will consider revising level to "50% operating range" which is the required level to maintain once natural eire is established. Recommended change made.

65 N E Licensee made following changes based on validation feedback comments:

- Added Reactor Power is 25% and steady to Plant Conditions for clarity.

- Changed part 2 of Band 0 to make wrong.

Candidates could have argued securing the pumps, but cannot argue the revision when coupled with the next bullet.

- Added "First" to part 2 of the question.

66 3 N S 67 2 M E Based on validation comments licensee changed all answers by 5 MW. The original correct answer, 925, is technically, on the high side of the line drawn, therefore one could challenge that 925 is above and NOT the maximum. 920 is close enough to the line but on the low side.

68 1 x N U "C&OD not plausible that cannot hang more than one danger tag on valve NLO knowledge need to increase LOD of Q Overlapped with JPM licensee randomly selected a new KIA and replaced with a bank Q.

LOK LOK Q# FIH (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back: Q= SRO B/MIN UlE/S Explanation Focus Dist. Link units ward KIA Only

69 H 3 B S 70 H 3 N S 71 F 2 N E Based on validation comments licensee added "if exceeded" to the stem to match the requirement in the alarm response, otherwise the listed answer would not be the correct answer.

72 H 3 N S 73 H 2 N U Replace 0 it overlaps concepts tested in 064 for natural circ level required in S/Gs also you have another 0 testing loss of SCM Licensee replaced Q with a bank Q testing the sameK/A.

74 H 3 N S 75 H 3 B S 76 F 2 N E Changed to "F" from "H" 77 H 3 N S 78 H 3 X B U 1) Not SRO - RO system knowledge to know recognize failure of instrument air will fail closed the EDG fan damper and inop the EDG is above the line knowledge of TS entry

2) "H" rather than UF" analyze plant conditions

3) add required TS action to make SRO level Added TS call to revised Q to make SRO level 79 H 3 B S 80 H 2 X N E The distracters are not plausible with prep to restore condensate and MFW just starting "C&D are implausible and SCM approaching saturation temp "B" is not plausible. Revised the stem started a condensate booster pump to improve plausibility for "C&D" also removed "loss of vacuum" on both MFPs in first bullet. Added subcooling margin bullet.

81 F 2 B S I

82 H 3 N E Revised "C" to balance answer choices. I I

83 X N U B&D are not plausible with a LOOP no eirc water pumps and cond available so use of Bypass valves not plausible. "C" also implausible to isolate both S/Gs then you take away means to c/d primary forces you to use feed and bleed also with high pressure in S/G need to avoid lifting S/G safety valves. Changed RM*G*26 reading, changed SG pressures and levels, added BWST level, removed LOOP, changed question to required actions also revised answer choices, changed explanation and justifications. In addition, licensee requested addition of 1.5 REM thyroid to the stem to avoid confusion 84 H 3 M S 85 H 3 B S 86 H 2 X N E A&B appear to be implausible to crystallize boron at 49F.

suggest changing temp to 45F a little closer to 40F limit.

Recommended change made. In addition, licensee requested boron conc change from 2490 to 2475 to make further from TS limit.

87 H 3 M S 88 F 2 X B E Revised stem to tighten by adding "actions required by bn procedures 1303*4.1 and TS"

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LaD (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KIA Only 89 F 2 N E Typo on KIA system being tested Containment Spray not RPS. Fixed typo 90 H 3 N S 91 H 2 B S 92 F 2 N S 93 F 2 B E Licensee listed wrong system being tested on KlA typo corrected

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.

Q# LOK LOO (F/H) (1-5) Stem Cues T/F Credo Partial Job- Minutia #1 Back- Q= SRO B/M/N UtE/S Explanation Focus Oist. Link units ward KIA Only 94 F 1 X X N U 1.The distracters can be ruled out with RO level knowledge.

2 .. "C&O" not plausible stem reads which of the following is the responsibility of the Fuel Handling SRO "ONLY" initially develop fuel move sheets is the exclusive responsibility of the Res not plausible.

3. "B2" is also not plausible that the CRO needs to also approve disengaging the grapple from assembly in the SFP- never get refueling done.

Replaced Q using same KIA.

95 H 3 X B E "C&O" can be ruled out using RO level of knowledge of TS. "B" EOG OOS at 1000 and at 1200 determined another 36 hours4.166667e-4 days <br />0.01 hours <br />5.952381e-5 weeks <br />1.3698e-5 months <br /> just to get part. It is not plausible to not test and determine that the other redundant EOG is operable for over 36 hours4.166667e-4 days <br />0.01 hours <br />5.952381e-5 weeks <br />1.3698e-5 months <br />. Consider revising the time to test redundant EOG, Revised time to obtain replacement part to 24 hours2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br /> to make distracters more plausible.

96 F 3 N E Licensee turned first bullet into two bullets for

~Q consistency.

97 H 3 M S 98 H 3 B E Typo in justification "is" also changed from modified to bank 99 F 3 N U No of the current answers appear to be correct per the reference both the RP manager and the site VP/Plant manager are required to approve. Complete rewrite of Q.

100 H M E Modify stem to delete MA2 call from the stem that way someone needs to classify initially then the applicants will need to consider whether they can down grade with current conditions and escalate later due to loss of alarms. Rewrote Q and answers to increase discrimination level for an SRO applicant.

---