ML060870200

CPSES-09-2005 - NRC Draft Exam Comments

ML060870200
Person / Time
Site:	Comanche Peak
Issue date:	09/13/2005
From:	Gody A Operations Branch IV
To:	Blevins M TXU Electric
References
50-445/05-302, 50-446/05-302, CPSES-09-2005, ES-401-9 50-445/05-302, 50-446/05-302
Download: ML060870200 (5)

Text

ES-401 CPSES-09-2005 Written Examination Form ES-401-9 Review Worksheet

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. O ther 6. 7.

Q# LOK LOD

( F/H ) (1-5) Stem Cu es T /F Cred. Partial Job- Minut ia #/ Back- Q= S R O U/E /S Explan ation Focus Dis t. Link units ward K/A O nly 1B H 2 E B - 7, CR, N, LOD is 2 vice 3.

2B H 3 S B - 5, CR, N, EOP.

3M H 3 S D - 10, CR, N, EOP.

4M H 3 S C - 3, CR, N, EOP.

5B H 2 S D - 7, C R, N .

6B F 3 S A - 8, CR, N.

7M H 2 U U B - 4 3.2, C R, N . T he qu estion is an LC O applic ation of C CW in M ode 4.

W hile this m atch es th e KA , it is a 10C FR 55.4 3.2 top ic and is theref ore an SR O level question. It is an application question because it involves m ore than on e T S variable (C CW O perability and M ode res trictions ). W ill documen t in the question data sheet that this information is required for an RO.

8N H 3 S B - 7, CR, N.

9N F 3 U U B - 1 0, C R, N , EO P. T he K A f or this q ues tion involves the operation al imp lication of S G T R an d natu ral circ ulation. T he qu estion is foc us ed on SG T R and the ef fec ts on PZ R level dur ing d epres su rization . Als o, this ques tion is a 10 CF R5 5.41 .10 vic e 41.8 . W ill revise the qu estion to enhance the fact that the plant is in natural circulation.

Instructions

[Ref er to Sec tion D of E S-4 01 an d A ppen dix B f or additional inf ormation regard ing eac h of th e following c onc epts .]

1. En ter th e level of kn owled ge (L O K) of eac h q ues tion as either ( F)un dam ental or ( H )igh er c ogn itive level.

2. Enter the level of difficulty (LO D) of each ques tion using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

@ Th e stem lacks su fficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless inform ation).

@ Th e stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

@ The answer choices are a collection of unrelated true/false statements.

@ O ne or m ore distr actors is (are) n ot cred ible.

@ On e or more distractors is (are) partially correct (e.g., if the applicant can m ake unstated assu mptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

@ Th e question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

@ Th e question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from mem ory).

@ Th e question contains data with an unrealistic level of accu racy or incons istent units (e.g., panel meter in percent with question in gallons).

@ The question requires reverse logic or application compared to the job requirements.

5. Ch eck q ues tions th at are sam pled for c onform anc e with the ap proved K /A an d thos e that are des igna ted S R O -only (K/A and license level mismatches are unacceptable).

6. Based on the review ers jud gm ent, is the qu estion as written (U )nacceptable ( req uiring rep air or rep lac em ent), in need of ( E)ditorial enh anc em ent, or (S)atis fac tory?

7. At a m inimu m, explain an y U ratings (e.g., how the A ppen dix B p syc hom etric attribu tes are n ot being m et).

ES-401 Form E S-401 -9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. O ther 6. 7.

Q# LOK LOD

( F/H ) (1-5) Stem Cu es T /F Cred. Partial Job- Minut ia #/ Back- Q= SRO U/E /S Explan ation Focus Dis t. Link units ward K/A O nly 10N F 2 S D - 7, CR, N, EOP.

11B F 3 E E A - 10, CR, N, EOP . The indicated answer is technically incorrect. The correct answer should read Prevent SG dryout or Maintain SG com pon ents in a w et cond ition an d n ot P revent S G tub e dryou t. It c ould be argu ed there is no c orrect an sw er as w ritten. Will delete the word "tube".

12M F 3 U U A - 10, CR, N, EOP . Both distractors A and B could be argued to be correct and this argument is supported by the EOP bases document provided. Will replace distractor "B".

13N H 3 E S D - 7, C R, N 14N H 3 S A - 7, CR, N.

15M F 2/E E A - 7, CR, N. LOD is 2 vice 3 and should be 10CFR55.41.7 vice 41.5.

16M H 3 S C - 10, C R, N .

17B F 2 U U C - 10, C R, N , EO P. D istrac tor d. is n ot cred ible. Will rewrite distractor d.

18M H 3 E E C - 10, O R, N , EO P. C hang e bullet 8 in s tem to read , T he c rew h as d eter min ed E CC S c an not b e ter min ated du e to in ad eq uate R C S su bc ooling and are in the pr oces s of establis hing min imu m E CC S f low.

Agree, will revise.

19M H 3 S D - 5, OR, N.

20M H 3 S B - 7, CR, N.

21B F 2 S B - 1 1, C R , N .

22M F 2 S D - 1 1, C R , N .

23B H 3 S A - 10, CR, N, EOP.

24M H 3 S A - 10, CR, N, EOP.

25M H 3 S C - 10, CR, N, EOP.

26N H/E 3 E D - 10, CR, N, EOP. LOK should be H vice F.

27B H 3 S C - 10, CR, N, EOP.

28B H 3 S D - 5, CR, N. Should be 10CFR55.41.5 vice 41.7.

29M H 3 S D - 5, CR, N.

30B F 3 U U C - 7, C R, N . Dis tractors are true/fals e statem ents . Agree - will rewrite Question.

31N F 3 S C - 7, CR, N. LOD is 3 vice 4.

32N H 3 S C - 7, CR, N, EOP . LOD is 3 vice 4.

33N F 3 S D - 5, O R, N .

34M F 2 U U B - 5, CR, N. The way the third bullet in the stem is written, it cues the cor rec t ans wer. T his stat em ent s hou ld read , C C W Pu mp 1 -01 is s till operating. and another bullet that states, Ccw H eat Exchanger 1-01 outlet temperature is 125 degrees. Agree, will revise.

35M F 2 U U U C - 10, CR, N. The answer comes from a note from the operating proc edure ( not a cau tion or limitation). T ypically, cand idates are n ot mem ory tested on notes. In addition, the p roced ure s tates this ...step may be required.... LOD is 2 vice 3.

36N H 3 S B - 7, CR, N.

37N H 3 S B - 5 , CR , N 38M H 3 S C - 7, CR, N.

39B F 2 S C - 7, CR, N.

40N F 2 S C - 5, CR, N.

41M H 3 S B - 7 , CR , N 42M F 2 S C - 7, CR, N.

42N H 3 S A - 7, CR, N.

44N H 3 S D - 5, C R, N 45M F 3 S B - 7 , CR, N.

46N H 3 S D - 7, CR, N.

47N F 3 S A - 1 0, C R , N .

48N H 3 S C - 7, CR, N.

49N H 3 S D - 7, CR, N.

50M F 2 S B - 1 0, C R , N .

51M H 3 S A - 7, C R, N . The KA is focus ed on the automatic load sequencer for a blackout (Mode I or III). The question is written on the operation of the und ervoltage sequ enc er in M ode II (non -blac kout). D oes the q ues tion need to be written with the sequencer in Mode I or Mode III? No, the t er m in o lo g y is co r re ct an d no c ha n ge s a re n ec es sa ry .

52M F 2 S C - 1 1, C R , N .

53M F 2 U U A - 7, CR, N. This is an A2 KA which requires the question to test the imp act of th e malfu nc tion and th e mitigation s trategy. T his q ues tion does not test th e imp act p art of the K A. Agree, will revise.

54M H 3 S B - 7, CR, N.

55M H 3 S A - 5, CR, N.

56M H 2 S A - 1 0, C R , N .

57N H 3 S D - 1 0, C R , N .

58N H 3 S C - 5, CR, N.

59M H 3 S D - 5, CR, N.

60M H 3 S D - 7, CR, N.

61N F 2 S D - 7, CR, N.

62N H 3 S C - 7, CR, N.

63N H 3 S B - 5, CR, N.

64N H 3 S C - 5, CR, N.

65N F 4 S B - 7, CR, N.

66B H 2 S A - 7, CR, N.

ES-401 Form E S-401 -9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. O ther 6. 7.

Q# LOK LOD

( F/H ) (1-5) Stem Cu es T /F Cred. Partial Job- Minut ia #/ Back- Q= SRO U/E /S Explan ation Focus Dis t. Link units ward K/A O nly 67B F 2 S D - 1 0, C R , N .

68B F 2 S A - 1 0, C R , N .

69N H 3 S A - 1 0, C R , N .

70N F 3 S C - 1 0, C R , N .

71N H 2 S C -1 2, C R , N .

72N F 3 S A - 1 0, C R , N .

73N F 2 S D - 1 0, C R , N .

74N H 3 S D - 1 0, C R , N .

75N F 2 S A -1 0, C R , N .

RO 0 1 1 1 2 1 0 0 6 1 15 B 43 H 2.65 12 U RO TOTALS 26 M 57% 6 E 28 N 57 S Answer Distribution: A = 18 Open Reference = 3 32 F B = 16 Previous NRC Qs = 0 43% C = 21 D = 20 10C FR 55.4 1 D istribu tion 41.1 = 0 41.2 = 0 41.3 = 1 41.4 = 0 41.5 = 14 41.6 = 0 41.7 = 29 41.8 = 1 41.9 = 0 41.10 = 25 41.11 = 3 41.12 = 1 GENERAL COMM ENTS:

1. The exam questions are generally well written and focused on the KAs.

2. All metrics are within those permitted by NUR EG 1021, Rev 9.

NOT E: Ban k qu estions are indic ated by B ; Mod ified are ind icated b y M; N ew q ues tions are in dic ated by N .