ML14080A042

From kanterella
Revision as of 09:58, 11 April 2019 by StriderTol (talk | contribs) (Created page by program invented by StriderTol)
Jump to navigation Jump to search
Initial Exam 2013-302 Final Administrative Documents
ML14080A042
Person / Time
Site: Sequoyah  Tennessee Valley Authority icon.png
Issue date: 03/21/2014
From:
NRC/RGN-II
To:
Tennessee Valley Authority
Shared Package
ML14080A058 List:
References
50-327/13-302, 50-328/13-302
Download: ML14080A042 (63)


Text

ES-401 Written Examination Review Worksheet Form ES-401-9 Instructions [Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.] 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level. 2. Enter the level of difficulty (LOD) of each question using a 1 5 (easy difficult) rating scale (questions in the 2 4 range are acceptable). 3. Check the appropriate box if a psychometric flaw is identified: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information). The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc). The answer choices are a collection of unrelated true/false statements. The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable. One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem). 4. Check the appropriate box if a job content error is identified: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content). The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory). The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons). The question requires reverse logic or application compared to the job requirements. 5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable). 6. Enter question source: (B)ank, (M)odified, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f. 7. Based on the reviewe judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory? 8. At a minimum, explain any ratings (e.g., how the Appendix B psychometric attributes are not being met).

ES-401 2 Form ES-401-9 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 1 F 2 X N U S 007 EK2.02 Stem Focus: Reword question to remove it functions correctly They should already assume that it functions correctly unless told otherwise. - Removed assuming it functions correctly. Stem Focus: The explanation states that the bypass breakers (I assume BYA) only have UV coils. The r answer states that RTB and BYA breakers are opened by shunt trip and UV coils. This would mean that there are no correct answers. Modify the question but keep the general idea the same. - Re-worded stem question to clearly indicate that the UV and Shunt trip did open both breakers. Understand how this could have implied that they did. Changed UV to SSPS to be more detailed. Ok 12/24 KDS 2 H 1 B U S 009 EA2.11 LOD: This should probably be a two part question to get the difficulty higher. -Replace distracter with PZR steam space break Q502 -created 2 part in Q602 if not going with Q502 Ok 12/24 KDS 3 H 2 X B E S 015 AK1.01 Cred Dist: B Forced circulation not plausible. Ask two parts: Nat Circ does/does not exist. Atmos reliefs are/are not open. When is a condition where the Atmos reliefs would be open? -When the steam dumps cannot handle the pace of a load rejection. When steam dumps are in the wrong mode for a given plant condition, Ok 12/24 KDS 4 F 2 X B E S 025 AK3.02 Part: Could not find in the AOP or AOP lesson where it gives the reason as being a loss of inventory. It makes sense but so does overpressurizing the PRT. If you can present in a document where loss of inventory is right and overpress is wrong, the question is ok ATL changed answer and C second part to say rupturing the PRT rupture Ok 12/24 KDS Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 5 F 2 X N E/S 026 AA1.01 Stem Focus: Discuss how to ensure that the applicants know that the question is asking about the pump lower bearing and not the motor lower bearing. - No change. Per operations, terminology is correct leave as is. 6 H 2 N S 027 AK1.02 7 H 2 X B E S 038 G2.4.31 Cred Dist: B not plausible because it do anything to address the problem like the other 3 answers. -changed out distracter B using another action option from the table in E-3, step 32. Ok 12/24 KDS 8 H 3 B S 055 EA2.03 9 F 2 B E S 056 AG2.1.20 Stem Focus: Add to question 1 to prevent a subset issue. Change loads to load(s) in question 2. -made requested changes Ok 12/24 KDS 10 H 3 N S 057 AA1.04 11 F 3 B S 058 AK3.01 12 H 3 X M E S 062 AA2.06 Part: 10 minutes is a subset of 15 minutes. Need to stay away from using Is there a design time to failure that you can use. i.e. The ERCW pumps are designed to operate for minutes before bearing failure occurs. A hard and fast number. -removed and added AOP-M.01 to be more explicit. ATL added stated to question stem Ok 12/24 KDS 13 F 2 B S S 065 AK3.04 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 14 H 3 X X M E S 077 AG2.2.42 Cred Dist: If not in another alt alignment, why would I enter the TS? If you can give an example, this may be ok. -Manual 2R is an alternate alignment and does not require TS entry. Ok 12/24 KDS 15 H 2 X M U S E04 EK2.2 Cred Dist: Not plausible to stop the pump prior to closing the inject valve. A&B. -some pumps cannot be stopped after the discharge valve is closed unless a mini recirc is in play. Standard practice is stop a pump, then isolate it if necessary. CPPs can be damaged in a very short time if running with discharge path isolated. Ok 12/24 KDS 16 H 3 X B E S W.E05 EK1.3 Cred Dist: Change C to Feed at 50 to 100 gpm to one SG until level is established, then at the maximum available feed flow. -made requested change Ok 12/24 KDS 17 H 3 X B E S E11 EA1.3 Do your ROs have to memorize the table in ECA-1.1? -Expected to know this, taught in training. Stem Focus: Remove the plant indications remain as above, Replace with Using parameters stated above, when. You expect any of the parameters stated to remain the same. -Made requested change Ok 12/24 KDS 18 H 3 M S W/E12 EK2.1 19 F 2 X M S 001 AA1.04 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 20 F 2 X N U S 036 AK3.02 KA. 036 is fuel handling accident. see anything in the question pertaining to an accident. -Site feels it is implied that the purpose of the fuel handling interlocks is to prevent a fuel handling accident. Modified question to include fuel handling accident. Ok 12/24 KDS 21 H 3 N S 037 AK1.02 Run this on the simulator to ensure its cut & dry. As power increases, coolant temperature will ri level pressure increas just want to make sure. ATL added urbine currently on HOLD to question stem Ok 12/24 KDS 22 H 3 X N E S 037 AK1.02 Cred Dist: On and the turb after trip the reactor. Stem Focus: Remove 2nd bullet and move last bullet up to the 2nd bullet. -made requested changes Ok 12/24 KDS 23 F 2 X N U S 068 AA2.05 Cred Dist: Unless you have any examples when you use level indicators to determine AFW flow, the 2nd part of B&D are not plausible. - replaced flow rates with SG level indication. Improved plausibility. ATL adNRon stem Ok 12/24 KDS 24 H 1 X B U S 076 AK2.01 Cred Dist: Not plausible to think that a leak inside containment or a temperature rise in containment will cause condenser vacuum exh to increase. LOD: D is too easy to pick out of the available answers. -re-wrote question as 2X2 to address plausibility concerns Ok 12/24 KDS Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 25 F 2 X B E S E02 EG2.2.44 Cred Dist: C not plausible to think it would clear the annnciator. - changed out distracter C to improve plausibility. Why is performed. Walk through why this would be plausible. - Replaced procedure reference in distracter D to improve plausibility as well the EA is in the EOP set and is more applicable than the SI. Ok 12/24 KDS 26 H 3 B S W/E03 EK2.2 27 F 2 X M E S W/E08 EK3.3 How did I get to FR-P.1 from a SBLOCA? -Changed to a general LOCA Cred Dist: Need to explain the second part of C&D. I do not understand the relevance of the explanation. -will discuss Ok 12/24 KDS 28 H 2 N S 003 K6.14 29 F 2 N S 004K2.07 30 H 2 B S 004K3.06 31 F 3 X N E/S S 005 K5.03 Stem Focus: For the second question, recommend giving an RCS pressure of 365 psig and ask if the valve will go open when manipulating the switch. It elimates any subset issue and the numbers mentioned in the answers lead the applicants. -made changes as requested (test on the interlock) ATL added to second question statement Ok 2/24 KDS 32 H 3 M S 006 A4.01 When is LTOPS armed? What is the lift setpt. 650 psig seems very high. -LTOP is armed prior to going below 685 psig. The question seems ok as long as the initial conditions are operationally valid.

Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 33 H 3 X M U/E S 007 K5.02 Cred Dist: At 89%, its not plausible that you need to add primary water to the PRT. At 129 degrees, its not plausible that you need to add primary water to heat up or cool down the PRT. -modified question by raising pressure and lowering level in stem. Now is the correct answer and the plausibility of the distracters is improved. Will update DA if acceptable. ATL changed level to % Ok 12/24 KDS 34 H 2 X X B U/E S 008 K3.03 Stem Focus: The oil cooler low flow really makes it hard not to pick bearings overheating. Can you give a valve closure without the alarms to give the same answers. Cred Dist: With low oil flow alarms in, operating indefinitely is not plausible. -the alarms in are for low cooling flow to the oil coolers not low oil flow. -modified question stem to just give as loss of CCS. Ok 12/24 KDS 35 H 2 B S 010 K1.08 36 H 3 N S 012 A2.05 37 H 3 X B E S 013 K2.01 Goofy font in the first bullet. -fixed Cred Dist: Why is it plausible to think that only one trains master relays would actuate but both trains of ECCS equipment would start -operators feel is plausible as it is difficult to keep track of which is auctioneered power and what is not. Could be the slaves or the masters. Discuss. ATL created Q537 and changed answer to use train Ok 12/24 KDS 38 H 2 N S 022 A3.01 Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 39 F 2 X B U S 022 K3.01 Stem Focus: I will need something from engineering that states that you would expect safety valve leakage if containment temp increases from 110 to 130 degrees. Other than that, I do see any answers as plausible. Even the correct answer. -discuss, reference material covers concerns listed above. At SQN this is a valid situation. At what temp would you require to shutdown or de-energize equipment? This may be a good direction for this question. Ok 12/24 KDS 40 H 3 B E/S S 025 A3.02 This question explanations are confusing. If I get the alarm once (at if level turns around and the alarm clears, A is correct. The alarm will have to be acknowledged before it would is that correct. If so, we need to add a bullet. Lets walk through this question to make sure of whats going on. -discuss will explain as it is assumed that the operator acknowledged alarm. Ok 12/24 KDS 41 F 1 M U S 026 G2.2.36 LOD: Assuming that the 1A-A CS pump is powered from the 1A-A Bus (and associated 1A-A DG) why would you not think that its operability is affected? The 2nd part really has nothing to do with the KA. -changed the stem to be more definitive by asking operable/not operable Ok 12/24 KDS 42 F 2 B S 039 A4.04 43 H 3 M U/S S 059 A2.11 Explain how a leak on a steam pressure sensing line causes indicated steam pressure to increase. It seems as though it would decrease, causing DP to decrease with pump speed increasing because of it. This would make level increase woul it? -updated the DA to better explain the effects. Ok 12/24 KDS Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 44 H 3 B E S 059 K4.16 The question concept appears to be ok. The time below 220 psig has to be very specific. I would recommend a timeline so there is no doubt about the duration below 220 psig. It would be too easy to appeal as it is written. -the requested time line would be in seconds and would be the first time the examinees saw a question like this. Recommend leaving as is. ATL added er the alarm is rece to question stem Ok 12/24 KDS 45 H 3 M E S 061 K1.07 Do you need the last bullet? It appears that if the alarm is in (you can assume its valid), the clock starts. -yes, to show that the motors and the turbine AFW pumps are less in alarm. What are the travel times for the valves. From the plausibility statement it appears that if the alarm is in for 5.5 seconds, the valves will start to open. As long as the travel times stretch the time out over 60 seconds, the question appears to be ok. -stroke times are <42 seconds Ok 12/24 KDS 46 F 3 N S 061 K6.01 47 H 3 B E S 062 A1.01 Stem Focus: Change answer A to remove the word e 3 hours3.472222e-5 days <br />8.333333e-4 hours <br />4.960317e-6 weeks <br />1.1415e-6 months <br /> would seem to be more plausible than 4 hours4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br />. It has to do with something electrical instead of notifications. Ok 12/24 KDS 48 F 2 B S 063 A1.01 49 F 2 X B E/S S 063 A2.01 Cred Dist: Why i plausible. I could not find this alarm proc in the reference package. -this board does not have a local reset, but some boards do have a local reset and the 480 boards actually have a ground test PB. -Updated DA to include this. Ok 12/24 KDS Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 50 H 3 X M E S 064 G2.4.4 Stem Focus: Change last bullet to is 840 rpm or sped up to 840 rpm. -made requested change Partial: Need to explain why is not correct. I have lost a shutdown board (based on B being correct). That is an entry condition for AOP-P.01 it? -P.01 entry is based on SDB de-energizing and then being picked up by its associated DG. If it remains de-energized it is a P.05/P.06 entry. Ok 12/24 KDS 51 H 2 B E S 073 K4.01 Stem Focus: Change stem to state -made change Ok 12/24 KDS 52 H 2 X B E S 076 A3.02 Part: C appears to be correct also. If 151 is already closed (as is) and you stated that it closes fully, you will not lose an appeal. You could make it avels from open to fully -made requested change Ok 12/24 KDS 53 F 2 N S 076 K2.04 54 F 2 X N E/S S 078 K1.04 Are compressors A&B different than C&D? Are there any other compressors you could use? I would rule out A&B because they appear to be the same type of compressor. - Compressors A&B are different than compressors C&D, this means that distracters A & B are different. Ok 12/24 KDS Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 55 F 2 X N U/E S 103 K4.04 Stem Focus: Underline e -made requested change Cred Dist: To expect the applicant to not know that the inner and outer door are ot plausible. -the question is written asking about the interlocks by giving the operator some alarms and asking them to interpret them. The site feels that this makes the question plausible. Q555 is written which increases the difficulty level. Beyond this, the narrow scope provided by the KA restricts further development. 2nd part of question is ok. Ok 12/24 KDS 56 F 2 X B E S 001 K4.23 Stem Focus: Change question urgent failure is originated iand switch has to be We can discuss. Just want to make sure the wording is correct. Ok 12/24 KDS 57 H 2 X B E S 011 K6.04 Stem Focus: Change C to owers until letdown Change to until the reactor Ok 12/24 KDS 58 H 2 X N U/E S 015 A1.01 Cred Dist: Calculated power > Actual power being non conservative not plausible and vise versa. 2nd part of B&C not plausible. -This is a GFE K/A written to a question that is operationally valid. The plausibility for parts B & C is relating to the context of making the NI adjustment based on the first part. In other words, we are adjusting NIS power range channels with respect to RX trip setpoints. Incumbents have chosen A & C so far. ATL modified second question to determine how gain potentiometer would be adjusted Ok 12/24 KDS Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 59 H 2 X B E S 028 K5.04 Cred Dist: It appears that if you have a LOCA, you put H2 Igniters in service regardless of H2 concentration. If this is true, is not plausible. -Discuss, updated DA Ok 12/24 KDS 60 F 3 B E/S S 041 K2.02 Does Pzr Lvl 1-LI-68-320 fail low if bus 1-III loses power. If it does, this question appears to be ok. -it does fail low on loss of 1-III. Ok 12/24 KDS 61 H 2 X X B U/S S 045 K3.01 Stem Focus: Last Bullet. If all systems respond as designed, why is pressurizer level going up? Remove the last bullet. -Made requested change At what power would the reactor NOT trip. Discuss asking a similar question at a power in which the reactor would not trip with the turbine. Cred Dist: The premise of the question is good but Pzr level is too easy to pick out among the choices given. If Tave is supposed to be going to 553 and A states that its 553 and still increasing, is that abnormal. You may need to go to a 2x2 question to get one thdiscriminating. -modified question with different parameter values to improve plausibility. Ok 12/24 KDS Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 62 H 2 X B E S 055 A3.03 Check font on answer A for . Cred Dist: Do you have ANY valve where reaching a setpt would prevent a valve from being opened manually? If not, is not plausible. - Created Q562 to remove d Yes, there are other valves that have interlocks that prevent opening with interlocks. Ok 12/24 KDS 63 H 2 N S 056 A2.04 Can you validate this on the simulator? Not done yet, operators have looked at it a second time and feel it is operational valid and are OK with it. 64 F 2 X B U S 072 A4.01 Cred Dist: C&D just because it has an operate light, make it plausible. Either pick another indication for C&D or come up with a better plausibility statement. -changed operating light is extinguished verses illuminates and updated the DA plausibility. Ok 12/24 KDS 65 H 2 X B E S G2.4.1 Stem Focus: For the second part of the question, provide a pressure of 4.2 psia and ask if a reactor trip is required. -made requested change What does it mean for an interlock to be -re-wrote to remove from stem. ATL created Q665 to determine C-9 light status and if manual reactor trip required Ok 12/24 KDS Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 66 H 2 X B E S G2.1.32 Cred Dist: Not plausible that an applicant would think that the delay of a restart would be started from the time of discovery -changed time to improve plausibility Stem Focus: If you stopped a pump due to a water box leak, would you start that pump only 10 minutes later. Recommend finding another reason. It t have to be fancy, just operationally valid. -changed initial conditions to make operationally valid. ATL reworded question to state accordance with GOI- and replaced with allow Ok 12/24 KDS 67 H 3 N S G2.1.45 68 F 1 B U S G2.2.14 LOD: Compared to the rest of the answers stated are just not plausible. -wrote Q568 to address concerns ATL reworded question to form a in the type question and added Ord to :Work Document Ok 12/24 KDS 69 F 2 X M U/E S G2.2.22 Cred Dist: 2500 psig is not plausible just because its above the lift setpoint. A&B not plausible. What is lift setpoint + 10%? That may work. -changed pressure to 2485 to improve plausibility. Ok 12/24 KDS 70 F 3 B S G2.2.38 The plausibility statement for states that the TS limit is 2205 psia. The TS actually says 2220 psia. Make sure the numbers are correct. Ok 12/24 KDS Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 71 H 2 X B U/E S G2.3.13 Cred Dist: Not plausible to think that you could not continue the release No action required is not valid either, C not valid. Ask as a 2 part. Release will terminate automatically/require manual termination. After batch samples are obtained and the release is reinitiated, periodic sampling during the release is/is not required. Something to that effect. -created 2 X 2 as requested ATL changed question stem to have rad monitor I and reworded second question to reflect ODCM wording regarding batch sampling Ok 12/24 KDS 72 F 1/2 B U S G2.3 Cred Dist: 1st part of A&B appear to be plausible. The plausibility statement is confusing to read so if you can explain why this would be valid after a CRI, it may be ok. With A&C, explain why you would want the emerg press fans operating you can prove plausibility with the procedure, this may be ok. This question will need much more plausibility information than what is in the existing statements. Otherwise you may need to start over. -Discuss, updated DA. The 125 RM normally monitors the MCR intake and actually initiates the CRI. This makes it plausible. It gets isolated on a CRI though or it would continue monitoring. Stopping the Emergency Pressurization fan is plausible as the CRI procedure actually has conditions where the fans are shut down depending on wind direction during an event. ATL created Q672 to test if rad monitors 90-125/126 were isolated on CRI and if rad monitors 90-205/206 provide auto start signal to MCR Emerg Press fans Ok 12/24 KDS Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 73 F 2 B S G2.3 Add entry to a pump roo -made change This appears to be ok as long as it only takes ONE authorization to get the exposure. ATL reworded question stem to test who authorizes emerg exposure limits in excess of 10CFR20 limits Ok 12/24 KDS 74 H 3 B S G2.4 75 H 2 B S G2.4 76 H 3 X B U/E S 008 AG2.1.7 Stem Focus: Add trends to parameters (increasing or decreasing). Need to put some kind of time line on the conditions. Would I HAVE TO WAIT until I reached 1250 psig. If I were ate 1280 and decreasing and thought that 1250 psig was immanent, would I be wrong to secure them? - Normally the operators do not trip RCPs early, the procedure direction is if RCS pressure is less than 1250 psig and an SI pump is running then trip RCPs I referenced the reference package from 2013-301 in E-1 and it appears that I get to the decision to go to ES-1.2 (Step 15) before I get to the step for RHR spray (Step 17). So to me it looks as if I would already have transitioned to ES-1.2 before I go to the point in the procedure that the question suggests. There may be no correct answers. The premise of the question appears to be ok but the conditions need to be specific enough so the correct parts are definitely correct and the incorrect parts are definitely not correct. - Reworded stem to have values for PZR pressure and CNMT pressure at the transition to E-1, and supporting parameters that are observed after PZR safety valve goes closed. - Altered step of E-1at which the crew is observing data to prior to transitions. Ok 12/24 KDS Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 77 H 3 X X N U S 011 EA2.05 Put space after the bullets. - Word version of review question was not formatted correctly, LXR version OK. Do you need the first bullet? - Yes to add credibility for decay heat energy SRO/Cred Dist: Neither part is SRO knowledge. 2nd part of C&D not plausible to look at 2nd heat transfer during a large break. Can you just ask if Design Basis is met with one CCP out for the 2nd part? - Created #677 with 2nd part of question changed to suggested wording. Ok 12/24 KDS 78 F 2 X X N U/E S 025 AA2.01 Is the 20 psig from the head of the water in the system? - Yes Dist: 2nd part of B&C not plausible for the same reason stated in the plausibility statement. - Disagree, if candidate does not recognize RCS pressure then thermal stress is plausible. Would prevent be better or would it be too close to correct? - Prevent stratification is part of basis, so this would be a correct answer. - Enhanced second part of question to include Tech Spec bases for refueling with < 23 ft of water above fuel. Ok 12/24 KDS Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 79 F 2 X N E/U S 056 AG2.4.40 Stem Focus: Its hard to determine from the question if the answers start after the 24 hours2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br /> in the question or do the times start at the same time. Put some times in the question to specify what your asking. - Added time when CSST A lost power, and reworded question to ask maximum time to shutdown unit 2 Subset. If the unit must be in Hot Shutdown within 12 hours1.388889e-4 days <br />0.00333 hours <br />1.984127e-5 weeks <br />4.566e-6 months <br />, then it also must be shut down in 13 and 14 hours1.62037e-4 days <br />0.00389 hours <br />2.314815e-5 weeks <br />5.327e-6 months <br />. This makes B&C not plausible. This should be fixed when incorporating times per the first comment and asking the latest time that Hot Shutdown can be entered. - Enhanced question by asking the latest time Unit 2 would be required to be shutdown. Ok 12/24 KDS 80 F 2 X B E S 065AA2.06 Stem Focus: Need to mention AOP-M.02 in question 2. What is the SG level when you get an auto trip? - SG low level trip 10%, normally a target value of 15% and lowering is used to direct a manual trip to prevent an auto trip. Ok 12/24 KDS 81 H 3 X B E S W/E04 G2.4.18 Stem Focus: Need trend on CETs. - Added stable as trend for CETs Walk through classification but appears to be ok. Ok 12/24 KDS Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 82 F 3 X B E S 069 AG2.1.23 Stem Focus: Edit last bullet to state that acceptance criteria was not met. - Made suggested change to last bullet Is the airlock test part of the overall containment leakage test? Are all of the tests performed as part of one procedure? - Fac Rep to explain the CNMT leak rate test Question appears to be ok but walk through it to clarify it for me. - Enhanced 1st part of question to ask if Tech Spec LCO is/is not being met. Ok 12/24 KDS 83 H 3 X N E S 076 AG2.4.46 Stem Focus: Change 1st question to just ask if 1-RA-90-1A is consistent with the given plant conditions. - Agree and made change to 1st question. Need Ops and or Chem to sign off on 28 microcuries/gram DEI giving the stated alarms. - The value given in the stem is 100 times the Tech Spec limit. Normal alarm values are established to warn operators that a Tech Spec limit has or is about to be exceeded. Will have Fac Rep discuss Ok 12/24 KDS 84 H 3 X N E S WE03 EA2.1 Stem Focus: Move with TSC conc to the question stem instead of having it in all 4 answers. - Agree and made change to question and all distractors - Also enhanced question by asking if allowed cooldown rate has/has NOT been exceeded vs allowed rate of cooldown. Ok 12/24 KDS 85 H 3 X B E/S S W/E07 EA2.2 In this question, is RHR in ormal Shutdown Cooling If I am in 0-SO-74-1, am I out of the EOPs? Need to walk this question through the EOPs. - Procedure reference is incorrect should be EA-74-1 not 0- SO-74-1. Made change to question stem. Ok 12/24 KDS Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 86 H 2 X X N E/S S 005 A2.01 Stem Focus: Would you tag out an RHR pump while cooling down? - Agree and enhanced by changing reason for 1B-B RHR pump to be OOS. Ok 12/24 KDS 87 F 2 X E/S S 008 G2.4.30 Stem Focus: Change 1st part to ask: if the Shift Manager needs to notify the Duty Plant Manager.yes or no. - Agree with and made change What is the reference and why do they need it? - Reference is NPG-SPP-3.5 with all 1 hr requirements redacted. - Reason for reference is greater than 1 hr requirement for notification The plausibility statement for C states that a 4hr report due to a TS required shutdown. The questions statement states that it was an automatic trip. Still 4 hours4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br /> but the statement is not correct. 10CFR50.72(b)(2)(IV)(B). Need to verify this with your SPP-3.5. If 3.7.3 requires a shutdown, do I need the trip in the bullets? - Reactor trip added for plausibility due to guidance for 8 hr notification due 50.72(D)(3)(a)(1). - Changed reporting time to 1 hr (EPIP) or 4 hr (Tech Spec shutdown) - Enhanced by removing Reactor trip and making candidate determine operational requirements by given condition on each unit and then determine if notification is required. Ok 12/24 KDS Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 88 H 2 N U/E S 026 G2.2.25 1st part ok Stem Focus: Remove which ONE of the following identifies from the question. Cred Dist: 2nd part using the word may lend itself to the 2nd part of B&D. This is an action not an option. The makes them not plausible. Recommend getting a new 2nd part. This was one of the ten sample questions sent and still has the same issue with the may terminology. - Removed ONE of the following identifies from the question. - The word may was taken directly from the Tech Spec basis for CNMT Spray. This action may have to be performed if the CNMT spray pumps cavitate after sump recirc is established but it is not a definite. - Enhanced 1st part to ask if RHR spray is/is NOT required for current plant condition. - Enhanced 2nd part to ask what procedure guidance is required to comply with Tech Spec basis, this changes 2nd part of distractors to actions contained within 0-SO-74-1. Ok 12/24 KDS 89 H 2 X N U S 062 A2.07 SRO Only: Electrical system knowledge answers what does and does not have power. Procedure entry conditions answers which procedure your in. Nat Circ cooldown just plausible. Its more of an er the procedure that you would use. - Attempted to write first question to meet 10CFR55.43.b.5 - Wrote a different version question (#589) testing if Offsite power is OPERABLE for each unit with 500 KV power unavailable (from Tech Spec basis) and to select appropriate procedure to mitigate the event. Ok 12/24 KDS 90 F 3 X B E S 063 G2.4.31 Stem Focus; Remove the which ONE of the following part and write on the above conditions, (1) in accordance with Tech Spec 3.8.2.3, .C. Distribution Oper Battery Board II is and (2) in accordance with 0-SO-250-1, 25 Vold dc Vital Battery B . - Agree and made suggested enhancements to question Ok 12/24 KDS Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 91 F 2 X B E S 002 G2.2.37 Stem Focus: Change the question state that a pressurizer PORV inadvertently opened. Ask the 1st question. Then ask that the PORV was manually Ask the 2nd question. May need to word-smith it a little. - Agree and made suggested enhancements. Ok 12/24 KDS 92 F 2 X B U/E S 028 G2.1.32 SRO Only: One piece of RO knowledge (H2 level that you are not allowed to vent or run recombiners) can be used to answer both questions. May be edited such that the second part asks about staying in FR-I.3 or transitioning out to perform a set action. You have to change the 2nd part that much. - Made change to wording of question and enhanced the distractors to include the wording used in FR-I.3 to return to step and procedure in affect. Ok 12/24 KDS 93 F 2 X B E S 079 A2.01 Stem Focus: Ask separate questions or reword the 2nd question to match the question statement. i.e. (1) Which ONE of the following identifies the direction given to the AUO and (2) In accordance with Tech Specs , the Turbine Driven EFDWP is/is NOT required to be declared INOPERABLE. Need to wordsmith it a little. - Agree and made suggested enhancements. Ok 12/24 KDS 94 F 2 X B U/S S G2.1.42 SRO Only: The objective referenced is an RO objective as well as an SRO objective. Think about adding a procedure selection portion to this question. - Fuel movement and requirements are SRO only tasks at SQN. Site will correct lesson plan objectives to indicate that this is an SRO only objective. - Question sat as written, no changes needed. Ok 12/24 KDS Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 95 F 2 X N E S G2.2.15 Stem Focus: The reference stated gives an example where the SM can authorize relaxiation of status control within a clearance boundary when necessary. The question is no specific enough to eliminate this as a correct answer. Modify the question step to ensure there is only one answer. - Will add more specific words to 1st part of stem to clarify - Discuss with Fac Rep - Enhanced question by changing answer from Shift Manager to Plant Manager to eliminate possible overlap of responsibilities. Ok 12/24 KDS 96 H 3 X M E/S S G2.2.20 Walk through the times in the procedure to show what the alert range is and how the opening and closing time requirements are. Cred Dist: On the surface it seems as though the closing times given are so much shorter than the opening times that it wo be plausible for them to be in the alert range. - Will walk through procedure with examiner to ensure only one correct answer. Demonstrate how Unit 1 and Unit 2 data can be easily confused. - No change needed. Use question as is. Ok 12/24 KDS 97 H 3 X B U/E S G2.3.4 Cred Dist: 2nd part of A&B not plausible to think they only apply during a General Emergency or always apply (during an UE). - Disagree, Per EPIP-15, the REP allows emergency exposure limits under specific circumstances to mitigate the consequences of any emergency condition, thus the 2nd part of A is correct. (plausible). - The 2nd part of B is plausible since when a General Emergency is declared, actions are likely to be needed to protect the health and safety of the public. - After review question satisfactory as is. Ok 12/24 KDS Q# 1. LOK (F/H) 2. LOD (1-5) 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. B/M/N 7. U/E/S 8. Explanation Stem Focus Cues T/F Cred. Dist. Partial Job- Link Minutia #/ units Back- ward Q= K/A SRO Only 98 F 3 X B E S G2.3.7 Cred Dist: Change rad level to 48 Rad/Hr. This will change the correct answer to A. - Do not agree with 48 Rad/hr is more credible than 58 Rad/hr which is currently in question. - Need to discuss with examiner. - Enhanced question to lower rad level to 20 R/hr. Ok 12/24 KDS 99 H 2 X B E S G2.4.35 Stem Focus: on the second question make it rol is(are) - Agree and made minor enhancement Ok 12/24 KDS 100 H 3 M S G2.4.38 Need to walk through and discuss how the errors could reasonably be made for the distractors. Ok 12/24 KDS