ML21230A346

CN 2021-06 Draft Written Comments kdc-rev1 Final

ML21230A346
Person / Time
Site:	Cooper
Issue date:	06/25/2021
From:	Heather Gepford Operations Branch IV
To:	Nebraska Public Power District (NPPD)
References
Download: ML21230A346 (10)

Text

ES-401 CN-2021-06 Retake Written Examination Review Worksheet Form ES-401-9 Ans

1. LOK 2. LOD 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6 7 CFR 8 Letter stem cred job #/ back- SRO- A/B/C/ 55.41 Q# (F/H) (1-5) cueing T/F partial minutia K/A B/M/N U/E/S Explanation focus dist link units ward only D 55.43 Notes: Final exam submittal questions are all listed as Rev 3.

1 F 3 N S A 10 2 F 3 N S A 7 3 H 2 M S A 7 The NUREG allows bolding for emphasis, such as certain words, such as NOT, or which ONE of 4 H 3 X N S C 4 the , but not in this case for a value of reactor power. This could be considered cueing to this piece of information. The bold has to come off of the value to prevent cueing to this information. with rev3 exam file, the bolding is removed and question is now Sat.

5 H 2 N S C 10 6 H 3 B S D 3 2018 NRC 7 F 3 N S B 4 8 H 3 N S B 10 9 H 3 N S A 2 mod from 2017 NRC-no reference to support the part 2 info (steam 10 F 3 M S D 4 dump operation aspect of the question). Licensee added reference to support this part and question is now Sat with Rev 3.

11 H 3 N S B 9 Reference needed 12 F 2 B S B 7 13 F 3 N S B 1 a Rev 3

ES-401 CN-2021-06 Retake Written Examination Review Worksheet Form ES-401-9 14 F 3 B S C 7 2018 NRC Modified from 2020 NRC (stem is different, answer is different, 15 H 4 M S C 10 application is different)

Reference needed No bases or reason for the assured or not assured in A so it can be thrown out. Could use "Not assured because of level and 16 F 2 B S B 10 injection rates" in distracter A.

Licensee fixed this distracter and added balance (balanced 2 X 2 now) with another "Not assured" per BC comments. Rev 3 of question is now Sat.

17 H 3 N S A 10 18 F 3 N S D 9 19 F 2 B S D 10 2015 NRC This is a modified question from bank 2017 NRC.

Need to enhance the discussion on credibility for V/R switch in OFF and voltage adjust and incorporate validation data since I 20 H 3 M S B 5 know operators were picking this choice. Licensee completed this updated and question is now Sat with the rev3 submittal.

mod from 2017 NRC-no reference to support the part 2 info (steam dump operation aspect of the question). Licensee added 21 H 3 M S D 5 reference to support this part and question is now Sat with Rev 3. a Rev 3

ES-401 CN-2021-06 Retake Written Examination Review Worksheet Form ES-401-9 NRC 2020-4 Reference provided (Values are different for this exam 22 H 3 B S C 4 so plotting is different) 23 F 3 N S A 10 24 H 3 N S A 1 25 H 3 N S B 7 26 H 3 N S D 10 27 F 2 N S B 10 28 H 2 N S D 7 29 H 3 N S C 7 30 H 3 N S D 7 31 H 3 N S B 7 32 H 3 N S A 7 This is a modified question from 33 F 2 M S C 6 2018 NRC.

34 H 3 N S B 7 NRC 2017 35 H 3 B S C 2 36 H 3 N S D 2 37 F 2 N S A 2 38 F 3 N S C 2 39 F 2 M S B 2 Modified from 2017 NRC.

40 F 3 B S C 7 NRC 2017 41 H 4 B S B 7 42 F 3 N S C 3 43 H 3 N S B 5 44 F 2 N S C 10 45 H 4 N S D 5 46 F 2 N S A 7 47 H 3 N S A 5 48 H 3 N S D 5 49 H 3 N S C 7 50 F 3 N S D 7 51 F 3 N S A 4 52 H 3 B S C 4 53 F 2 N S A 8 a Rev 3

ES-401 CN-2021-06 Retake Written Examination Review Worksheet Form ES-401-9 54 F 3 N S A 6 55 H 4 B S C 6 Modified from NRC 2020 Answer D needs a space between 45% and speed on upper section 56 H 3 M S D 5 of question. Licensee made requested changes and question is now Sat with Rev3.

57 H 3 N S A 4 58 H 3 N S A 9 59 H 3 N S D 4 60 H 3 B S B 5 NRC 2018 Need to put actual noun name of valve in stem if it is not "Outboard isolation valve, such as MSL Drain Valve MS-MO-077". Licensee 61 H 3 N S C 9 made requested changes and it is now Sat with rev 3.

missing the word "for" in the stem for part 1. Licensee made requested changes and it is now 62 F 3 N S D 4 Sat with rev3. a Rev 3

ES-401 CN-2021-06 Retake Written Examination Review Worksheet Form ES-401-9 Cueing from length of answer to others and also answer format to other choices with no balance. If you use 250vdc in answer A you need at least one other choice that is 250vdc. You could put the type of service as the answers, such as 250vdc, 480vdc, 250vac, 480vac. I don't believe there is a 63 F 2 X N S C 4 480vdc but you get the style of answers. Knowing MCC details for the seal oil backup pump probably isn't a 2.9 KA value either. With rev3 of question it is now Sat.

64 F 2 N S D 13 modified from 2019 NRC With 50mr/hr, this is getting into Tier 1 accident space. NRC bank question was a fuel handling accident. We need to use an I and C mistake or inadvertent Group 6 isolation in the stem so that we stay out of Tier 1 space for this KA. Just asking a normal CR 65 H 3 M S D 7 pressure value of two choices and then the malfunction causes it to go up or down would suffice.

Licensee made requested changes (modified the original bank question) and with rev3 it is now sat.

66 H 2 B S B 10 NRC 2018 67 F 2 N S A 10 68 F 3 N S D 3 69 F 2 B S D 10 NRC 2018 70 F 3 B S B 10 NRC 2018 71 H 2 N S C 10 a Rev 3

ES-401 CN-2021-06 Retake Written Examination Review Worksheet Form ES-401-9 72 H 2 M S B 12 Modified from 2020 NRC.

73 F 2 B S A 12 NRC 2018 74 F 2 N S C 10 NRC 2018 Bank question not submitted.

Need to get a new KA since RO's don't do this task as originally communicated. Go with 2.4.5 and use this question:

The EP numeric series used for piping emergencies is A: 5.1 75 F 2 N S B 10 B. 5.2 C. 5.3 D. 5.4 Answer B. Licensee wrote new question as suggested and with rev3 question is now New and Sat. a Rev 3

ES-401 CN-2021-06 Retake Written Examination Review Worksheet Form ES-401-9 Results Table  %

RO LOK -H 41 54.67 Avg RO LOD 2.75 Flaws 10 CFR Distribution RO LOK-F 34 AVG SRO LOD #### Stem focus 0 41(b)1 2 43(b)1 0 SRO LOK - H 0 Overall LOD 2.75 Cues 2 41(b)2 6 43(b)2 0 SRO LOK - F 0 T/F 0 41(b)3 3 43(b)3 0

%  % Cred Dist 0 41(b)4 10 43(b)4 0 RO Bank 16 21.33 SRO Bank 0 0 Partial 0 41(b)5 8 43(b)5 0 RO Mod 10 13.33 SRO Mod 0 0 job link 0 41(b)6 3 43(b)6 0 RO New 49 65.33 SRO New 0 0 units 0 41(b)7 17 43(b)7 0

% minutia 0 41(b)8 1 Total Bank 16 16 backward 0 41(b)9 4 Total Mod 10 10 KA 0 41(b)10 18 Total New 49 49 SRO-only 0 41(b)11 0

%  % LOD = 1 0 41(b)12 2 RO Sat 75 100 SRO Sat 0 0 41(b)13 1 a Rev 3

ES-401 CN-2021-06 Retake Written Examination Review Worksheet Form ES-401-9 RO Unsat 0 0 SRO Unsat 0 0 Answer Dist ( in %) 41(b)14 0 RO Edit 0 0 SRO Edit 0 0 RO-A 18 SRO-A 0

%  % RO-B 19 SRO-B 0 Total Sat 75 75 Total Unsat 0 0 RO-C 19 SRO-C 0 Total Edit 0 0 RO-D 19 SRO-D 0 a Rev 3

Question Overlap with the Previous Two NRC Exams QA form ES-401-6 item 4 requires 4 or less questions on RO exam from previous two NRC exams, SRO portion two or less questions from previous two NRC exams*

• if this is exceeded, the region shall call NRR to explain why/reasons.

RO overlap from previous two NRC exams (2020-04 AND 2020-09 EXAMS)

Q22 2020-04 (Q40 however values are diff so plotting is diff)

SRO overlap from the previous two NRC exams N/A Note: the previous two exams considered for overlap are the 2020-04 and 2020-09 NRC Exams

Questions Requiring References to Answer 6-10 questions rule of thumb on SRO portion of exam are allowed to be open reference, while the RO exam is generally none RO Questions that require hand-outs Q11 EOP Graph 10 Q15 EOP vortex graphs 4A, 4B, 6A, 6B Q22 2.4PC, Attach 1 SRO Questions that require hand-outs N/A