ML20042C046

From kanterella
Jump to navigation Jump to search
PV 2019-10 Draft Written Comments Delayed Release Until March 2022
ML20042C046
Person / Time
Site: Palo Verde  Arizona Public Service icon.png
Issue date: 10/12/2019
From: Greg Werner
Operations Branch IV
To:
Arizona Public Service Co
References
Download: ML20042C046 (8)


Text

ES-401 PV-2019-10 Written Examination Review Worksheet Form ES-401-9

1. LOK 2. LOD 6

7 Ans Letter CFR 8

Q#

(F/H)

(1-5) stem focus cueing T/F cred dist partial job link minutia

  1. /

units back-ward K/A SRO-only B/M/N U/E/S A/B/C/

D 55.41 55.43 Explanation 1

F 2

N S

B 3

2 H

3 N

S A

5 3

H 3

N S

D 5

4 F

2 N

S C

8 5

H 3

N S

B 7

6 H

3 N

S C

10 7

H 3

N S

B 7

2018 NRC Q51 8

F 3

N S

D 3

9 H

3 N

S A

4 10 H

3 N

S D

3 11 H

3 N

S A

14 12 H

3 N

S A

14 13 H

2 N

S B

10 14 H

3 N

S C

5 15 H

3 N

S D

3 16 H

3 N

S B

10 17 H

3 N

S D

7 18 F

3 N

S B

3 19 H

2 N

S D

7 20 H

2 N

S A

7 21 H

3 N

S B

3 22 H

4 N

S A

8 23 F

3 N

S D

4 24 H

4 N

S D

7 25 F

3 N

S D

8 26 H

3 M

S C

7 27 H

3 N

S C

7 28 H

3 B

S B

4 2018 NRC Q54 29 H

3 N

S B

5 30 H

3 N

S D

11 31 H

3 N

S C

7 32 H

3 N

S D

7

3. Psychometric Flaws
4. Job Content Flaws
5. Other a Rev 3

ES-401 PV-2019-10 Written Examination Review Worksheet Form ES-401-9 33 H

3 N

S C

7 34 F

3 M

S D

9 35 H

3 N

S C

7 36 F

2 N

S B

5 37 F

3 N

S D

4 38 H

3 N

S D

4 39 F

3 N

S A

8 40 F

3 N

S D

7 41 H

3 M

S C

8 42 H

3 B

S A

11 43 F

2 N

S C

4 44 H

3 B

S D

4 2016 NRC Q54 45 H

3 N

S B

9 46 H

2 N

S B

5 47 H

2 N

S A

1 48 H

4 N

S A

2 49 H

3 N

S C

11 50 F

3 N

S B

10 51 F

2 N

S D

11 52 H

4 N

S B

10 53 F

3 N

S B

7 54 F

2 N

S B

10 55 H

3 N

S B

3 56 F

2 B

S A

5 2016 NRC Q56 57 H

3 N

S B

7 58 F

3 N

S B

7 59 F

2 B

S B

6 60 F

2 N

S D

9 61 F

2 N

S D

11 62 F

2 N

S B

12 63 H

3 N

S A

10 64 F

3 N

S A

7 65 F

3 N

S C

4 66 H

3 N

S B

10 67 F

2 N

S B

10 68 F

3 N

S C

10 a Rev 3

ES-401 PV-2019-10 Written Examination Review Worksheet Form ES-401-9 69 F

3 N

S A

10 70 F

3 N

S D

10 71 F

2 N

S A

12 72 F

2 N

S C

12 73 F

2 M

S A

10 74 F

2 N

S C

10 75 F

2 N

S A

10 76 H

3 N

S A

5 77 H

3 N

S D

5 78 H

3 X

N U

B 5

C, D not credible based on stem 2).

79 H

3 N

S A

4 REFERENCE NEEDED 80 H

3 N

S A

5 81 H

3 N

S B

2 82 H

3 N

S C

2 83 H

3 N

S A

2 84 H

3 N

S A

2 85 H

3 B

S C

5 2018 NRC Q90 86 H

3 N

S C

6 REFERENCE NEEDED 87 H

3 N

S D

2 88 H

3 B

E A

2 2016 NRC Q86 -put in worksheet that it is 2016 Q86 89 H

3 B

S B

5 90 H

4 N

S A

5 91 H

4 X

N E

B 6

D not credible. Discuss 92 H

3 N

S D

2 93 F

3 N

S A

7 94 F

3 N

S A

2 95 F

3 N

S C

6 96 F

1 N

U B

3 LOD = 1. Use LO to write question.

97 F

3 N

S B

4 98 F

2 N

S B

4 99 F

3 N

S C

5 100 F

2 N

E C

1 Not H, but F LOK a Rev 3

ES-401 PV-2019-10 Written Examination Review Worksheet Form ES-401-9 Results Table RO LOK -H 42 56 Avg RO LOD 2.76 Flaws 10 CFR Distribution RO LOK-F 33 AVG SRO LOD 2.92 Stem focus 0

41(b)1 1

43(b)1 1 SRO LOK - H 17 Overall LOD 2.8 Cues 0

41(b)2 1

43(b)2 8 SRO LOK - F 8

T/F 0

41(b)3 7

43(b)3 1 Cred Dist 2

41(b)4 8

43(b)4 3 RO Bank 5

6.667 SRO Bank 3

12 Partial 0

41(b)5 7

43(b)5 8 RO Mod 4

5.333 SRO Mod 0

0 job link 0

41(b)6 1

43(b)6 3 RO New 66 88 SRO New 22 88 units 0

41(b)7 17 43(b)7 1 minutia 0

41(b)8 5

Total Bank 8

8 backward 0

41(b)9 3

Total Mod 4

4 KA 0

41(b)10 15 Total New 88 88 SRO-only 0

41(b)11 5

LOD = 1 1

41(b)12 3

RO Sat 75 100 SRO Sat 20 80 41(b)13 0

RO Unsat 0

0 SRO Unsat 2

8 Answer Dist ( in %)

41(b)14 2

RO Edit 0

0 SRO Edit 3

12 RO-A 17 SRO-A 9

RO-B 23 SRO-B 7

Total Sat 95 95 Total Unsat 2

2 RO-C 15 SRO-C 6

Total Edit 3

3 RO-D 20 SRO-D 3 a Rev 3

Question Overlap with the Previous Two NRC Exams QA form ES-401-6 item 4 requires 4 or less questions on RO exam from previous two NRC exams, SRO portion two or less questions from previous two NRC exams*

  • if this is exceeded, the region shall call NRR to explain why/reasons.

RO overlap from previous two NRC exams (2018 AND 2016 EXAMS)

Q7 Q51 ON 2018 NRC EXAM Q28 Q54 ON 2018 NRC EXAM Q44 Q54 ON 2016 NRC EXAM Q56 Q56 ON 2016 NRC EXAM SRO overlap from the previous two NRC exams Q85 Q90 ON 2018 NRC Q88 Q86 ON 2016 NRC Note: the previous two exams considered for overlap are the 2018-04 and 2016-10 NRC Exams

Questions Requiring References to Answer 6-10 questions rule of thumb on SRO portion of exam are allowed to be open reference, while the RO exam is generally none RO Questions that require hand-outs NONE SRO Questions that require hand-outs Q79 EAL hot chart Q86 EAL cold chart

Stats and Graph sat 95 edit 3

unsat 2

Stem focus 0

Cues 0

T/F 0

Cred Dist 2

Partial 0

job link 0

units 0

minutia 0

backward 0

KA 0

SRO-only 0

LOD = 1 1

2 0

0 0

2 unsat Stem focus Cues T/F Cred Dist PV 2019-10 Initial Writt

0 0

0 0

t Partial job link units minutia ten Exam Statistics