ML18057B535: Difference between revisions

Administrative Topics Outline

Form ES-301-1

JPM SUMMARY STATEMENTS

CONDUCT OF OPERATIONS (Al-a): Calculates leak rate using system data provided since

IPCS is out of service. Detects that unidentified leakage exceeds the TS limit.

CONDUCT OF OPERATIONS (Al-b): Completes OAP-l 00.6, Attachment IA, Reactivity

Control Parameters, consistent with the attachment included with this JPM. Tolerance will

generally only be given for rounding; however, each case must be evaluated on an individual

basis.

EQUIPMENT CONTROL (A2): B MDEFP is tagged out lAW SAP-201. The suction and

discharge valves are tagged closed, pump casing drains and vents are tagged open, the motor

is tagged out, and the correct sequence is identified for tagging.

RADIATION CONTROL (A3): Compare two options to conduct work in a high radiation area

with airborne activity due to a LOCA outside of containment.

EMERGENCY PLAN (A4): Not selected for RO exam

NUREG-1021, Revision 9

F I [%J,t\\[..

Administrative Topics Outline

Form ES-301 -1

Facility:

VC SUMMER

Date of Examination:

9/12/2011

Examination Level (circle one):

RD I ISROI

Operating Test Number:

Administrative Topic

Type

Describe activity to be performed

(see Note)

Code*

ROISRO Common

.

JPA-081A Manual leak rate

Conduct of Operations

D

G2.1 .7 (4.4/4.7) Ability to evaluate plant performance and make

(Al -a)

operational judgements based on operating

characteristics, reactor behavior, and instrument

interpretation.

JPA-009 Shift manning.

.

G2.1 .5 (2.9*/3.9) Ability to use procedures related to shift staffing

Conduct of Operations

D

such as minimum crew complement, overtime

(Al -b)

limitations, etc.

JPA-025A REVIEW TAGOUT FOR

B MDEFP

.

G2.2.13 (4.1/4.3) Knowledge of tagging and clearance procedures

Equipment Control (A2)

M

RO/SRO Common

.

Modify JPA-083 Apply facility ALARA principles to an emergency

Radiation Control (A3)

M

situation in an area with a high dose rate and

airborne radiation

JPA-083A(R 1)

G2.3.12 (3.2/3.7) Knowledge of radiological safety principles

pertaining to licensed operator duties, such as

containment entry requirement, fuel handling

responsibilities, access to locked high-radiation

areas,_aligning_filters,_etc.

JPA-020 Given a set of conditions determines the EAL.

G2.4.41 (2.9/4.6): Knowledge of the emergency action level

Emergency Plan (A4)

D

thresholds and classifications.

NOTE:

All items (5 total) are required for SROs.

Type Codes & Criteria:

(C)ontrol room

(D)irect from bank ( 3 for ROs;

4 for SROs & RO retakes)

(N)ew or (M)odified from bank ( 1)

(P)revious 2 exams ( 1; randomly selected)

(S) imulator

FINAL

NUREG-1021, Revision 9

Administrative Topics Outline

Form ES-301-1

JPM SUMMARY STATEMENTS

CONDUCT OF OPERATIONS (Al-a): Calculates leak rate using system data provided since

IPCS is out of service. Detects that unidentified leakage exceeds the TS limit.

CONDUCT OF OPERATIONS (Al-b): Determines actions necessary to maintain shift staffing.

Update JPM for new fatigue rule and EmpCenter

EQUIPMENT CONTROL (A2): Reviews a manual danger tag for errors. B MDEFP is tagged

out lAW SAP-201. The suction and discharge valves are tagged closed, pump casing drains

and vents are tagged open, the motor is tagged out, and the correct sequence is identified for

tagging.

RADIATION CONTROL (A3): Compare two options to conduct work in a high radiation area

with airborne activity due to a LOCA outside of containment.

EMERGENCY PLAN (A4): Event properly classified as a SITE AREA EMERGENCY due to a

Loss or Potential Loss of 2 (two) fission product barriers (RCS by D.2 or D.3 and Containment

by D.3 or D.4). This is a time critical JPM and the ENF form must be completed within 15

minutes after the emergency condition is determined.

FINAL

NUREG-1021, Revision 9

Control Room/In-Plant Systems Outline

Form ES-301 -2

-

9/72/2011

Facility:

VC Summer

Date of Examination:

Exam Level (circle one):

(Ro)! SRO(l) I SRO(U)

Operating Test No.:

Control Room Systems (8 for RO; 7 for SRO-l 2 or 3 for SRO-U)

ystem / JPM Title

Type Code*

Safety Function

a

APE 069 (JPSF-045B) Modify JPSF-045A

A,M,S,EN

5

Ensure Containment Isolation (ED P-i .0)

b.

System 015 (JPS-161)

N,L,S

7

Block Source Range Hi Flux Trip (GOP-3)

c.

APE 003 (JPSF-012A)

A,D,S

1

Dropped Rod Recovery (AOP-403.6)

EPE011 (JPS-002A)

D,S

2

Transfer to Hot Leg Recirculation (EOP-2.3)

e.

EPE 038 (JPSF-007)

A,D,S

3

Depressurize RCS to < Ruptured Steam Generator Pressure

(EOP-4.0)

f

System 008 (JPS-042)

D,S

8

Identify and Isolate an RCS Leak to the CCW System (ARP)

g

E05 (JPS-149A) Modify JPS149

M,S

4S

Respond to steam generator overpressure (E0P-15.3)

h

System 062 (JPSF-160)

A,N,S

6

Respond to electrical grid issues fAOP-301.1)

hi-Plant Systems (3 for RO; 3 for SRO-l; 3 or 2 for SAC-U)

.

APE 068 (JPPF-049 for RO)

A,D,E

4

Evacuation of control room (AOP-600.1)

APE 067 fJPP-205)

D,E,R

6

Cross train connection of swing battery charger (FEP-2.0)

APE 025 (]PP-408)

N,L,E,R

8

Align Spent Fuel Cooling Loop B to return Refueling Cavity water

to the RWST (AOP-1 15.4)

FINAL

NUREG-1021, Revision 9

Control Room/In-Plant Systems OutHne

Form ES-301-2

@

All control room (and in-plant) systems must be different and serve different safety functions; in-

plant systems and functions may overlap those tested in the control room.

Type Codes

Criteria for:

RO / SRO-l / SRO-U

(A)lternate path

4-6 / 4-6 / 2-3

5/NA/NA

(C)ontrol room

(D)irect from bank

i

8 I

4

6/NA/NA

(E)mergency or abnormal in-plant

1 /

1

3/NA/NA

(EN)gineered safety feature

NA I NA /

1 (control room system)NA/NA/NA

(L)ow-Power

1 /

1

2/NA/NA

(N)ew or (M)odified from bank including 1 (A)

2 /

2 I

1

5/NA/NA

(P)revious 2 exams

/

3/

2 (randomly selected) 0/NA/NA

(R)CA

1/1/1

2/NA/NA

(S)im ulator

VC SUMMER 2011 NRC JPM SUMMARY

a.

Take actions to ensure containment isolation in accordance with EOP-1 .0, REACTOR

TRIP/SAFETY INJECTION ACTUATION, Attachment 3. The applicant will identify that

containment integrity is not intact. This leads to the alternate path for this JPM. The

applicant attempts to initiate a phase A or close valves from the MCB. One penetration

is isolated from the MCB. Another penetration will not close from the MCB and the

applicant sends a local operator to close a backup valve. This JPM will be modified from

one in the bank to change the valves involved and increase the number of valves.

b.

Block Source Range Hi Flux Trip in accordance with GOP-3, REACTOR STARTUP

FROM HOT STANDBY TO STARTUP (MODE 3 TO MODE 2). The applicant will raise

power using rods from the source range up to io 3/4 power. On the power increase the

source range will be blocked before an automatic reactor trip occurs. This JPM is new.

c.

Take actions to recover a dropped control rod in accordance with AOP-403.5,

DROPPED CONTROL ROD. The applicant will assume the shift with a dropped rod. On

recovery the rod will become stuck. When the candidate detects the stuck rod that rod

and a second rod will drop requiring a manual reactor trip. Both the stuck rod and the

second rod dropping makes this JPM alternate path.

d.

Take actions to transfer from cold leg recirculation to hot leg recirculation in accordance

with EOP-2.3, TRANSFER TO HOT LEG RECIRCULATION. The applicant will assume

the shift with cold leg recirculation in service for 8 hours9.259259e-5 days 0.00222 hours 1.322751e-5 weeks 3.044e-6 months . The applicant will transfer

from cold to hot leg recirculation without causing the charging pumps to be deadheaded

or run out. This JPM is not considered alternate path even though the right hand column

is used in the EOP because the right hand side will always be used to properly align the

C pump to the correct train.

e.

Take actions to depressurize the RCS to less than the pressure of the ruptured steam

generator in accordance with EOP-4.0, STEAM GENERATOR TUBE RUPTURE. The

applicant will open the pressurizer spray valve to depressurize. On reaching a

termination setpoint the applicant will attempt to close the spray valve, but it will stick

NUREG-1021, Revision 9

F I FJ1\\L_

Control Room/In-Plant Systems Outline

Form ES-301-2

open. This leads to the alternate path for this JPM.

In order to stop the

depressurization, the applicant will have to secure the A RCP.

f.

Identify and isolate an RCS Leak to the CCW System in accordance with a radiation

monitor alarm. The applicant will verify that the COW surge tank vent valve closes.

Then the source of the leak will be determined to be the letdown heat exchanger. The

applicant will align excess letdown and secure normal letdown to secure the leak.

g.

Take actions to respond to an overpressure condition in a steam generator in

accordance with EOP-1 5.3, RESPONSE TO LOSS OF NORMAL STEAM RELEASE

CAPABILITIES. An inadvertent main steam line isolation occurred. In addition, the

PORV for one of the steam generators fails to open. The applicant is directed to reduce

steam generator pressure. The applicant will detect which steam generator is affected.

The applicant will lower pressure using the condenser steam dumps by opening the

main steam isolation bypass valves. Modified from a JPM in the bank to place applicant

in EOP-15.3 instead of EOP-15.1.

h.

Take actions to respond to electrical grid issues in accordance with AOP-301 .1,

RESPONSE TO ELECTRICAL GRID ISSUES. The applicant will monitor check to see

that a runback is not required. Then monitor turbine bearing vibrations and reactive

load. Finally will investigate the condition of 1 DA and 1 DB. This sets up the alternate

path for this JPM.

1 DB voltage will be too low and the applicant will start the emergency

diesel and have it tie on by opening the normal incoming breaker to 1 DB. This JPM is

new.

Take actions necessary after evacuation of the control room in accordance with AOP

600.1, CONTROL ROOM EVACUATION. Due to bomb threat the control room is

evacuated without any equipment tripped from the MCB. RO candidates will perform the

actions of the BOP. The alternate path for the RO is that the A RCP is tripped and so

either B or C RCP will have to be left running. The C RCP is also tripped so the

applicant must leave the B RCP running.

j.

Take actions to cross-train the battery charger in accordance with FEP-2.0, TRAIN A

PLANT SHUTDOWN TO HOT STANDBY DUE TO FIRE, Enclosure K. The swing

battery charger will be aligned to cross-train AC power from A Train to DC power of B

Train to support equipment operation.

k.

Take actions to align Spent Fuel Cooling Loop B to return Refueling Cavity water to the

RWST in accordance with AOP-1 15.4, LOSS OF RHR WHILE REFUELING, Attachment

I, REFUELING CAVITY LEVEL CONTROL WITH SPENT FUEL GATE IN. Applicant will

establish a return of water to the RWST so that spent fuel can be cooled and level can

be controlled in the refueling cavity as RHR is returned to service. This is a new JPM.

NUREG-1021, Revision 9

Control Room/In-Plant Systems Outline

Form ES-301-2

Facility:

VC Summer

Date of Examination:

911212011

Exam Level (circle one):

RD / SRO(l)(Oj)

Operating Test No.:

Control Room Systems (8 for RO; 7 for SRO-l 2 or 3 for SRO-U)

ytem I JPM Title

Type Code*

Safety Function

APE 069 (JPSF-045B) Modify

A,MS,EN

5

Ensure containment isolation (ED P-i .0)

b.

Systemol5(JPS-161)

N,L,S

7

Block Source Range Hi Flux Trip (GOP-3)

C.

d.

e.

f.

g.

h.

In-Plant Systems (3 for RO; 3 for SRO-l; 3 or 2 for SRO-U)

APE 068 (JPPF-044 for SRO)

AD,E

4

Evacuation of control room (AOP-600. 1)

APE 067 (]PP-205)

D,E,R

6

Cross train connection of swing battery charger (FEP-2.0)

k

APE 025 (JPP-408)

N,L,E,R

8

Align Spent Fuel Cooling Loop B to return Refueling Cavity water

to the RWST (AOP-1 15.4)

NUREG-1021, Revision 9

Control Room/In-Plant Systems Outline

Form ES-301-2

@

All control room (and in-plant) systems must be different and serve different safety functions; in-

plant systems and functions may overlap those tested in the control room.

Type Codes

Criteria for:

RO I SRO-I I SRO-U

(A)lternate path

4-6 / 4-6 I 2-3

NNNN2

(C)ontrol room

(D)irect from bank

9 /

8/

4

NNNN2

(E)mergency or abnormal in-plant

1 I

1 1

1

NNNN3

(EN)gineered safety feature

NA / NA I

1 (control room system) NNNN1

(L)ow-Power

1 I

1

NNNN2

(N)ew or (M)odified from bank including 1(A)

2 /

1

NNNN3

(P)revious 2 exams

3 I

3 /

2 (randomly selected)

NA/NAb

(R)CA

1I1/1

NNNN2

(S)imulator

a.

Take actions to ensure containment isolation in accordance with EOP-1 .0, REACTOR

TRIP/SAFETY INJECTION ACTUATION, Attachment 3. The applicant will identify that

containment integrity is not intact. This leads to the alternate path for this JPM. The

applicant attempts to initiate a phase A or close valves from the MCB. One penetration

is isolated from the MCB. Another penetration will not close from the MCB and the

applicant sends a local operator to close a backup valve. This JPM will be modified from

one in the bank to change the valves involved and increase the number of valves.

b.

Block Source Range Hi Flux Trip in accordance with GOP-3, REACTOR STARTUP

FROM HOT STANDBY TO STARTUP (MODE 3 TO MODE 2). The applicant will raise

power using rods from the source range up to 1 0 % power. On the power increase the

source range will be blocked before an automatic reactor trip occurs. This JPM is new.

c.

Not selected for SRO.

d.

Not selected for SRO.

e.

Not selected for SRO.

f.

Not selected for SRO.

g.

Not selected for SRO.

h.

Not selected for SRO.

i.

Take actions necessary after evacuation of the control room in accordance with AOP

600.1, CONTROL ROOM EVACUATION. Due to bomb threat the control room is

evacuated without any equipment tripped from the MCB. SRO candidates will perform

the actions of the CRS. The alternate path for the SRO is determining that emergency

boration is required due to two stuck rods.

j.

Take actions to cross-train the battery charger in accordance with FEP-2.0, TRAIN A

PLANT SHUTDOWN TO HOT STANDBY DUE TO FIRE, Enclosure K. The swing

VC SUMMER 2011 NRC JPM SUMMARY

NUREG-1 021, Revision 9

Control Room/In-Plant Systems Outline

Form ES-301-2

battery charger will be aligned to cross-train AC power from A Train to DC power of B

Train to support equipment operation.

NUREG-1 021, Revision 9

k.

Take actions to align Spent Fuel Cooling Loop B to return Refueling Cavity water to the

RWST in accordance with AOP-1 15.4, LOSS OF RHR WHILE REFUELING, Attachment

I, REFUELING CAVITYLEVEL CONTROL WITH SPENTFUEL GATE IN. Applicant will

establish a return of water to the RWST so that spent fuel can be cooled and level can

be controlled in the refueling cavity as RHR is returned to service. This is a new JPM.

- 1

ES-401

Record of Rejected K/As

Form ES-401 -4

Tier /

Randomly

Reason for Rejection

Group

Selected K/A

ROs

1/2

000032AA2.03

Source range high voltage is never removed at VCS

(Gammametrics fission chamber NIS)

KA replaced with 000032AA2.06 for RO test

2/1

063 A2.01

Not able to write discriminating question at RO level since only

response to DC grounds in procedures is to have electrical

maintenance trouble shoot.

KA replaced with 063 A3.01 for RO test.

2/2

01 1 K4.03

Pressurizer level is not density compensated at VC Summer.

KA replaced with 01 1 K4.05 for RO test.

3

G2.4.39

No responsibilities of RO in emergency plan implementation.

KA replaced with G2.4.25 for RO test.

2/i

078K1.01

VC Summer has no specific system that is equivalent to sensor air.

KA replaced with 078K 1.03 for RO test.

SROs

1/2

000059 AA2.03

Not able to write an operationally relevant question that is

discriminating for an SRO.

KA replaced with 000059 AA 1.01 for SRO test.

2/2

028 G2.2.40

Hydrogen Recombiner was removed from Technical Specifications.

KA replaced with 02$ G 2.1.27 for SRO test.

2/2

086A2.01

Not able to write an operationally relevant question that is

discriminating for an SRO.

KA replaced with 002A2.04 for SRO test.

2/2

072A2.03

Not able to write an operationally relevant question that is

discriminating for an SRO.

KA replaced with 034K4.02 for SRO test.

e

ES4OI

Written Examination Quality Checklist

Form ES-401-6

Facility:

f

Date of Exam: ItV2 1/)

Exam Level: RO

Initial

Item Description

a

b*

c

1.

Questions and answers are technically accurate and applicable to the facility.

?

2.

a.

NRC K/As are referenced for all questions.

p1

b.

Facility learning objectives are referenced as available.

3.

SRO questions are appropriate in accordance with Section D.2.d of ES-401

c

4.

The sampling process was random and systematic (If more than 4 RO or 2 SRD questions

were repeated from the last 2 NRC licensing exams, consult the NRR CL program office).

5.

Question duplication from the license screening/audit exam was controlled

as indicated below (check the item that applies) and appears appropriate:

the audit exam was systematically and randomly developed; or

the audit exam was completed before the license exam was started; or

the examinations were developed independently; or

? the licensee certifies that there is no duplication; or

other (explain)

6.

Bank use meets limits (no more than 75 percent

Bank

Modified

New

from the bank, at least 10 percent new, and the rest

I

new or modified); enter the actual RO I SRO-only

q

qr

,, C/q] LII

/

question distribution(s) at right.

L4,z4I

Oii

(0416

7.

Between 50 and 60 percent of the questions on the RO

Memory

CIA

exam are written at the comprehension/ analysis level;

the SRO exam may exceed 60 percent if the randomly

3/

s

f

19

selected K/As support the higher cognitive levels; enter

s,

ai1

the actual RO I SRO question distribution(s) at right.

1

i/o ,52..,, Yi,

8.

References/handouts provided do not give away answers

or aid in the elimination of distractors.

9.

Question content conforms with specific KIA statements in the previously approved

examination outline and is appropriate for the tier to which they are assigned;

Y

h44

deviations are justified.

10.

Question psychometric quality and format meet the guidelines in ES Appendix B.

? 4

1 1.

The exam contains the required number of one-point, multiple choice items;

4+/-J c

f

the total is correct and agrees with the value on the cover sheet.

Printed.kJamI Sig ature

Date

a. Author

MIieiv 1

JQ/i/ii

b. Facility Reviewer()

OeIk

c. NRC Chief Examiner (#)

U4øIr.4 5

.

L4-----

toIt1)L4

d. NRC Regional Supervisor

iA43CI+IL A-.

c j__

Note:

The facility reviewers initials/signature are not applicable for NRC-developed examinations.

Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

ES-401, Page 29 of 33

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

VC SUMMER 2011-301 EXAM REVIEW

Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1.

Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2.

Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3.

Check the appropriate box if a psychometric flaw is identified:

$

The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

$

The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

$

The answer choices are a collection of unrelated true/false statements.

$

The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

$

One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4.

Check the appropriate box if a job content error is identified:

$

The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

$

The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

$

The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

$

The question requires reverse logic or application compared to the job requirements.

5.

Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).

6.

Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

7.

At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

Generic Issues.

1.

In the stem of the question, need to determine if a period is or is not going to be used in the bulleted area of the stem. Sometimes it is used and sometimes it is not. It does not

matter which one just do it one way or the other.

2.

For the first few questions that use annunciator windows in the stem or distractors, these are not written the same. Some have the panel some have the panel and tile number,

we need to get that uniform.

3.

Reference material assembled is insufficient for examination review, system diagrams are not provided, key ARPs and AOPs not provided. Appears that the littlest amount of

material was provided for the review to take place.

4.

Add to those questions where necessary, applicable procedures being used to accomplish the appropriate tasks. This ensures validity of each question.

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

1

F

2

X

E

Question

still needs

work.

Could be a

U.

004K4.07, Task Master ' question 4483

1.

Distractor B is NOT plausible. In that, when does a single

failure cause the system to actuate unless there is some other

information provided in the stem to identify they have to think of

this. Need to change this distractor.

2.

Characterized as Higher, this is a very low higher cognitive

question.

3.

KA appears to match

Tuesday, October 04, 2011

1.

Change provides values associated with the parameter

identified in the distractor.

2.

Actual

3.

Using the values, in B and C make them more implausible.

HOW does the instrument failing HIGH, cause emergency

makeup to occur? Actual have no relevance to the control

system, so putting actual level does not help.

Recommendation:

1.

Develop a 2 by 2 question using

2.

The design feature of what happens on the failure and then

what operator actions are necessary to combat that failure.

- Design feature of what happens, then operator actions to combat

the failure.

This question needs more work, it is still an E. Or potentially a U.

Thursday, October 13, 2011

1.

Added actual in each of the NEW 2/2 question.

2.

Satisfactory

S

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

2

H

2

S

012K6.03, New,

1.

This question is kind of backwards logic, in that, it is you have to

think of it failed? Not sure if this is a good way to ask this.

2.

Were there any issues with reading this question? Based on

evaluator review. Ask licensee.

3.

Do we need names of each of these or are they required to

know that form memory. The licensee states that they are

required to know this material.

4.

Kind of simple.

5.

KA appears to match

Thursday, October 13, 2011

1.

No changes, operators are required to know the P numbers.

2.

Still Sat.

3

H

3

S

011K4.03, Higher, New,

1.

In distractor A, need to somehow identify the word NO, so the

applicants do not miss it. Bold, underline, dont care, pick one

use it the same throughout the test.

2.

Would it be better to add to 1) that will eventually cause a

reactor trip? This may ensure that they have to evaluate the

entire cycle like the analysis identifies. . Ask licensee.

3.

KA appears to match

Tuesday, October 04, 2011

1.

Still think in question number 1 that we bold an underline the

NO before operator, like no.

2.

Otherwise ok.

Thursday, October 13, 2011

1.

Made consistent with other questions.

2.

Rearranged SERVE after ONLY, GL suggested.

3.

Bolded in B and D, serve only

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

4

H

2

X

E

016A2.01, Modified, Higher, Modified question was not supplied with

package.

1.

Not sure that the initial information in the stem has a real

meaning to answer the question. Other than it provides a

starting point. This can be removed from the stem.

2.

The KA requires in the second part to use procedures, while this

is sort of the way about it, but it does not state what procedure

just the actions to accomplish the required. Is there a way to

add procedures in the second part rather than stating it in the

stem? Ask licensee.

3.

Add the word the prior to the word failure in the stem of the

question. Just to clarify a little.

Tuesday, October 04, 2011

1.

The question as changed still does not meet the KA, in that,

there is no procedure listed in the answer. This is awkward! .

2.

Change the stem to read:

WOOTF identifies the Resistance Temperature Detector (RTD)

failure that would cause these indications and the appropriate

operator actions in accordance with AOP 304.3, Continuous

Control Ro Motion?

1.

Remove the procedure from distracters A and B.

2.

Add parenthesis around the A as in A for all

distracters since parenthesis are used in the initial

conditions. Make this a global change for all

questions.

This needs to be fixed before it is Satisfactory.

Thursday, October 13, 2011

1.

Changed the second part to as if they had to enter the AOP or

not to and for rods in MANUAL.

Changes SAT.

S

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

5

H

2-3

E

00005G2.1.31, New, Higher,

1.

How is it known that the alarm provided is the one that comes in

FIRST? Was this run on the simulator to prove that it actually is

the first? Ask licensee.

2.

Distractor C, P-12 is written differently here on this question

than it was written on Question # 2. Is there a reason why?

Should they read the same and change # 2 or does this provide

information to help decide that on Question # 2 that the

distractor it appears is NOT correct for either. Discuss with

licensee.

3.

KA while it is not a complete match, it appears to cover the

question fairly well. OK

4.

Not sure if distractor is plausible. Need to ask another

examiner.

Tuesday, October 04, 2011

1.

Why was the questions stem changed?

2.

As the question appears the change is ok. Now a Sat question

Thursday, October 13, 2011

1.

Changed the stem to be clearer. See question. WOOTF will be

received simultaneously with a feedwater isolation signal

actuation?

S

6

H/F

2-3

E

000007EK2.03, New, Higher,

1.

The reference material identifies the annunciator to have an

intermittent fast flash. This is significant difference from the

way the question is worded. Recommend that the essence of

these words be put in for the answer other distractors that use

the same wording, ie. Distractor B.

2.

Do not agree this is higher level. The first part of the question is

memory, does a failure of the IR cause a rx trip. Also second

part of question, how does the alarm flash. Also could be

memory. Discuss with licensee.

3.

KA appears to match.

Tuesday, October 04, 2011

1.

Question was changed as requested, now satisfactory.

S

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

Thursday, October 13, 2011

1.

No further changes. Still satisfactory.

7

F

2-3

X

U

000032AA.2.03, Modified, Knowledge (Fundamental)?

1.

Remove from stem the word choices it is redundant and not

necessary. The first sentence can read, in almost every case,

Which One of the following (WWOTF)..describes, indicates.

2.

Modified question not supplied.

3.

When were these new NIs installed? Was everyone in class

when they were changed out? Or are the ONLY individuals who

were around then were the SRO-Us? I would imagine that this

is the case. IF this is true, then the plausibility of the OLD

versus the NEW does not bode well for the plausibility.

4.

The procedure provided actually states to verify AT and not

ABOVE as the question indicates. Could there be an issue with

distractor B, in that, this may be close to the P-6 interlock

(Source Range Permissive). Is this what we are looking at in

this question? Discuss with licensee.

5.

KA appears to NOT match. The KA asks the expected values

of source range indication when high voltage is automatically

removed. This is for a LOSS of Source Range NI. Discuss with

licensee.

Tuesday, October 04, 2011

1.

The question was entirely replaced with a new question.

2.

The KA was changed at the request of the licensee. The NEW

KA is 000032AA2.06

3.

Question matches KA,

4.

Put a comma between EOP-12.0 and Monitoring Critical Safety

Functions.

5.

Otherwise, question appears to be Satisfactory.

Thursday, October 13, 2011

No further changes still ok,. Made minor changes to stem.

S

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

8

H

3

E

000029EK2.06, New, Higher,

1.

The question is kind of confusing, in that, the stem is asking

about minimum number of malfunctions that would cause a

failure of an automatic reactor trip during the situation

presented. Can this be worded a little differently? Is this like in

the answer that there are three malfunctions? This does not

make any sense to me. .

2.

How did the evaluators do?

3.

What reference are you going to give? Not sure if it is only

going to be the print of the RTBs and bypass breakers and

emergency borate flow.

4.

Is it necessary to have the emergency borate flow there?

5.

KA appears to

Tuesday, October 04, 2011

1.

This change removed the requirement for the use of a

reference.

2.

Question as changed is satisfactory.

Thursday, October 13, 2011

1.

Scott P identified an issue with this question. Will discuss this

on Friday.

Friday, October 14, 2011

S

9

H

2-3

S

010A4.01, Bank, Higher,

1.

KA appears to match\\

2.

Question was used on Watts Bar last exam.

3.

Not a hard question.

Tuesday, October 04, 2011

1.

Made a change to the IC, added statement for group 2 Backup

heaters. No reason was provided for the added statement.

Added

2.

Appears to be Satisfactory

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

10

U

063K4.04, New, Fundamental,

1.

THE KA does not match. This is almost the way it can be but it

is talking about DC power and Trips, this would be better to

identify what electrical trips are not available for the DG or only

the TRIPS associated with electrical. BUT they do not mean the

mechanical trips how to stop the DG. Loss of Electrical power

causes the loss of most trips which ones do not get bypassed.

The DG overspeed and the DG reverse power trip. This needs

to be corrected. Discuss with licensee.

Tuesday, October 04, 2011

2.

Question was completely replaced.

3.

The question asks what is the response of the EDG during the

loss of All A train DC power. Ask it this way! The question

asks the response, which would indicate something should

happen. However from the answer, nothing happens. It is

really asking what is the status of the EDG, running or tripped?

This is the way it should be asked, that status, not response.

4.

To make it more valid, need to add what test is being done so

that the operator understands what the situation is with the

EDG. Can this be added to the initial conditions. ASK

LICENSEE.

5.

Each distractor has a loss of DC power, it is already asked in

the stem, it is not necessary in each distractor. Remove the

statement due to a loss of DC power.

6.

Same idea with second question, either there is or is not

protected.

Therefore re write the question to read

After the ICs

E

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

S

WOOTF describes a) the status of the EDG following the loss of DC

power and b). the protection 1DA has from the 51 overcurrent trip.

A.) a.) EDG will trip

b.) 1DA is protected by the 51 trips.

B.) a.) EG will trip

b.) 1DA is not protected by the 51 trips

C.) a.) EDG will remain running

b.) 1DA is protected by the 51 trips

D.) a.) EDG will remain running

b.) 1DA is not protected by the 51 trips

with this change it should be easier to read and will be Satisfactory.

Licensee please make this change to this question and ensure we still

have a valid question.

Basically the question is ok, just look at the above and note the changes

that will help shorten and make it easier to read for the applicants.

Thursday, October 13, 2011

1.

needed to add words to the stem to identify closer what was

being asked.

2.

Additionally, added output to the EDG breaker and the noun

name to the breaker to be clearer.

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

11

F

2--3

U if #2 is

correct

and OK

otherwise.

022K1.01, New, Fundamental,

1.

KA appears to match

2.

Distractors B and D second part do not seem plausible. After

reading the analysis it seems like they may be ok, but, I am

going to ask G. Laska, tomorrow to see how he feels about this

part of the distractor. It does not sit well with me, it seems to be

easy to eliminate them.

Tuesday, October 04, 2011

1.

Second part of distracters C and D have been changed.

2.

Are there vacuum relief valves on the return lines of the

RBCUs? This is a question I am not sure of. Need to ask the

licensee if this is a true statement or is it something made up.

3.

This needs some more work to understand what is or is not

happening. IS there something like what is described in

distracters C and D available on any other system? Ask

licensee. If there is NO other system that has this kind of

vacuum relief valves then these distractors are unsat.

Friday, October 14, 2011

1.

Question was replaced.

2.

See new question as SAT

3.

E/U

s

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

12

H

2-3

E

064K1.05, Higher, VCS Closed Bank

1.

Remove reason for DG will not start from the Main Control

Room (MCR), faulty wiring. All they need to know is it will not

start from the MCR. Done

2.

In the bulleted part, the A in the third bullet is not in quotes as it

is in the stem of the question. Write it one way or the other, I do

not care which method is used, just be consistent. Same for

distractor D with the A or just A.

3.

The A distractor uses a period and the rest do not have periods,

be consistent within and all questions. Either way is ok with me.

4.

KA appears to match

Wednesday, October 05, 2011

1.

After reviewing this question again, the question asks if the EDG

will be prevented from coming up to speed. It does not say

start, it states come up to speed. This is key in understanding

2.

The air start system ONLY provides air to turn the crankshaft to

allow the combustion cycle to start, thats what causes this to

come up to speed. The air system would not get the EDG to

operating speed.

3.

If an operator ONLY depresses the air start system valve, does

this then start the EDG or does the operator have to place a

start signal to the circuit for the EDG to actually start? Was the

action that INITIALLY started the EDG that locked IN? SO did

the DG have a start signal that would allow the DG to run after

the engine is turned over???? ASK LICENSEE. I am not sure

that this is clear and if it is, then the distractors may not be

plausible. DISCUSS.

4.

ADD to the stem WOOTF . IAW AOP 304.3. Is this the

procedure

Friday, October 14, 2011

SATISFACTORY

S

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

13

H

2-3

E

W/E10EK3.4, BANK, VCS closed , higher

1.

Is this abbreviation something the applicants would know,

ESFLSs? Should we have it spelled out to begin with? Ask

Licensee.

2.

Why in the stem do we NOT use the actual procedure the crew

would be in?

3.

KA does it match? Well kind of. The KA speaks to adhered to

and the limitations in the facilitys license and amendments are

not violated. This is not covered in this question. Discuss with

4.

licensee. Need to have another examiner review for KA match.

Wednesday, October 05, 2011

1.

The question as changed appears to be ok.

2.

No further changes warranted.

Friday, October 14, 2011

Minor changes from validation comments, see exam for changes.

ADDED MINIMUM in the stem

S

14

H

2

S

000057AA.2.12, MOD, VCS Closed, Higher.

1.

APN-5901 thru 5904, what is the noun name of that bus? Is

there any?

2.

Are operators expected to know this information from memory?

3.

Is 5902 channel II?

4.

Low level higher question, really is memory, how if not

memorized anyone would know this.

Wednesday, October 05, 2011

1.

Question Matches KA

2.

Why not add the high PZRP level alarm annunciator alarm that

should come in also? Ask if this does come in and add it if it

does. Discuss with licensee. Minor enhancement, but it would

make the question more technically correct.

3.

Other than that, it is appears to be ok.

Friday, October 14, 2011

1.

Added appropriate alarms that came in, as asked.

2.

SATISFACTORY.

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

15

H

2

X

U

064A3.03, New, Higher,

1.

Is there a noun name for XTF-31? If so, add it to the stem.

2.

Distractors C and D, second part are NOT plausible. The

operator applicants all have observed DG starts and know that

there is not a cycling of the frequency as described. Something

better has to be used. The way this is it is not plausible. This is

describing sequencing. Lets just say that. Frequency

fluctuates as the load sequencer sequences.

3.

The analysis does not describe the function of XTF-31 or where

to find information about it. No reference identified.

4.

The stem is difficult to read. Which choice below identifies the

following with regard to.. With regard to the A DG response,

which one of the following (WOOTF). May read better.

Use recommendation above. Should be a S then.

Wednesday, October 05, 2011

1.

None of the suggestions were used.

2.

Answer D is another correct answer. This makes the question

unsat.

3.

D has to be changed to make this question sat. Discuss with

licensee.

Friday, October 14, 2011

1.

SAT SEE EXAM CHANGES.

U

S

16

F

2

X

E/S

063A2.01, New, Lower,

1.

The questions KA was replaced with 063A3.01. This should be

in the header of the question. Replace 2.01 with 3.01 in the

header. Otherwise, it does not make sense for the question.

2.

It states Local indication, is there no location where battery

voltage can be observed? This is not clear and should ensure

this is not another provable answer. Discuss with licensee.

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

U

3.

KA appears to match.

Wednesday, October 05, 2011

1.

Licensee identifies there is a LOCAL battery meter, provides a

reference, reference was not submitted to identify that there are

local battery meters. Are there 126 v and 108 v system local

meters.

2.

Licensee states that the procedure means in the reference

monitor Batter Bus Voltage throughout this procedure implies

the MCB. If this is the case WHY would anyone select LOCAL

for reading the battery bus voltage? Why is it plausible? With

this new information, distractors B and C are NOT plausible.

Discuss with licensee. This makes this question UNSAT.

Friday, October 14, 2011

CHANGES SAT

S

17

H

2-3

E

062A2.01, Bank, Higher,

1.

Add to the stem the procedure they would actually be in.

2.

Why is it necessary to add on low flow in both A and B. This is

not necessary and can be deleted.

3.

Why is it necessary for the 1 minute time after the event?

Discuss with licensee.

4.

KA appears to match.

Wednesday, October 05, 2011

1.

ADD to the question the procedure, SOP-XX the crew would be

in, in addition, to the GOP. Is there another one to parallel the

MTG?

2.

Question modified as requested, appears to be SAT.

Friday, October 14, 2011

1.

SAT NO CHANGES MADE.

S

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

18

H

2-3

S

045 G2.4.3, Bank, Higher.

1.

Add noun name for 1A1X. This may or may not be necessary

2.

KA appears to almost match. This is a borderline analysis.

3.

The questions KA discusses use of annunciator alarms,

indications or procedure response. The question uses a ARP

that came in based on loss of a power supply. The correct

answer analysis uses the AOP. The answer to the question

does not use a procedure but identifies how the system works.

The question barely matches the KA. Discuss with licensee.

4.

The manual adjustment of the field provides the reason for the

first part of the question. This really has nothing to do with the

procedure. What is the response procedure we are answering

in this question? Discuss with licensee

Wednesday, October 05, 2011

1.

Why was the question changed from the loss of 1A1X to the

Regulator Core Alarm? This was not suggested in the above?

Discuss with licensee! SO IT WAS CLOSER TO KA

2.

The new question provides information as to why the

annunciator came in. AND provides the ARP correct actions to

address this event. The skill set is different for answering this

question than for the first question.

3.

The first part of each distractor should have the words load

will vary, with either load will increase, or load will

decrease. This will then make the question more operationally

valid. What will have happen to the reactive or real load.

Basically, as it sits the operator does not have to know what the

action taken will do.

4.

Additionally, the second part of the question has to be re-written

to the following: AND based on a over temperature condition

how the Main Generator Voltage Regulator will respond.

Currently, the question does not really identify that the condition

is higher than the information provided in the IC.

Recommendations:

If the above are followed the question will be considered SAT.

Friday, October 14, 2011

S

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

MADE CHANGES TO THE QUESTION. See changes on exam

SATISFACTORY.

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

19

H

3

E

026K2.01, New, Higher,

1.

I do not understand why the 480 v bus is a plausible distractor.

I understand what is written, however, I do not understand why

that is plausible.

2.

The analysis does not explain the function of the XCP-639 point

6-4 BUS 1DX LCKOUT 86 B. The ARP was not provided. It

should have been.

3.

Does the Reactor building Spray pump get any control power

from the 480V bus? Does the 480 V bus 1DA1 bus get

powered from the 7.2KV Bus 1DA.

4.

No information provided about the lockout

5.

KA appears to match.

Wednesday, October 05, 2011

1.

The question stem was changed from the submittal. The

information asked for is in a different order than those of the

answers. The question stem asks for the location of the breaker

and the ultimate power supply. The distractors answer the

power supply and then where power comes from. The question

does NOT elicit the answers. Again, stem asks for the

LOCATION of breaker and answers identify From power supply,

ie from offsite power, from the A EDG. Doesnt Location mean

the BUS it is on, 1DA, on or the building it bus sits in. This now

makes this question UNSAT.

2.

I still do not believe that the 480 V bus is plausible. Discuss

directly with licensee to understand why anyone would select A

or B and that a Safety Related Motor would be ONLY 480 volts.

While this was characterized as an E, it initially should have

been characterized as a U. Regardless, of the characterization

the question has two distractors that have been determined as

implausible and therefore is UNSAT. The licensee did not

provide a good reason why the less than competent operator

would select a pump that is safety related and is powered from

the 480V power supply.

3.

IS 1 EA powered in this instance with 1 DA? What is the

voltage of 1EA1 bus? Discuss if either of these buses are

U

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

S

plausible under the plant conditions listed in the IC.

Monday, October 17, 2011

1.

2 1DA is ok as a distractor because the rhr and spray pumps

are in the same room, however, they are powered from different

buses.

Question is sat.

20

H

2-3

E

001K2.01,Modified, Higher,

1.

KA appears to match

2.

So 1DA2 and 1DB2 are safeguards buses? I dont understand

why these are plausible! It seems like we are comparing apples

and oranges, in that, one is 7200v and the other is 480v.

Discuss with licensee

3.

Need to understand why those in 2 are plausible.

Wednesday, October 05, 2011

1.

Why was the power supplies identified at the next lower voltage

power? Why not use buses 1B3 and 1C2 as the alternate

answers for distractors B and D? Discuss with licensee.

2.

Why is the above not as good or better answer than 1A3X and

1C3X?

3.

Question has two implausible distractors B and D, this is the

same type of argument identified in question 19 using different

power supplies one being a lower voltage than the other.

Monday, October 17, 2011

1.

Used the suggestion above, as 480 switch gear.

2.

U

S

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

21

F

3

X

E/S

000055EA2.06. New, Knowledge,

1.

No reference diagram for power line up. Discussed in the

analysis of the answer but that is hard if not impossible to

understand without a diagram.

2.

Does the conditions of the stem put the plant in a Station

Blackout? Not sure it does. Ask licensee.

3.

The KA talks about clearing an item to allow re-energization.

The question concerns itself with preventing closing. Its a little

difference but it is not the KA requirements. Discuss with

licensee.

4.

Have licensee explain this question with references.

Wednesday, October 05, 2011

1.

Question is OK as it is. No further changes necessary.

Monday, October 17, 2011

1.

Sat

S

22

F

2-3

X

U

0000056AK3.02, New, Knowledge,

1.

KA appears to match

2.

Distractors A and B do not make sense, in that, placing the

Service Water pumps in PTL, Pull to Lock, does not make

sense to remove the cooling medium for the EDGs.

3.

The second part of B and D are not plausible to me. To

immediately provide a heat sink for CCW. This does not seem

plausible. The system being without power, CCW that is, has

no ability to cool anything, no heat transfer is being

accomplished, so when power comes back the heat load on

CCW should be low, so an IMMEDIATE requirement will not

appeal to any of the applicants. This needs to be changed.

4.

Fix both sets of concerns.

Wednesday, October 05, 2011

1.

First issue was corrected, however, now we have numerous

reasons for doing this. Why only 2 in the 2 by 2 format.

2.

Second part of B is still not plausible. Needs to be fixed.

U

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

S

3.

Second part of second part of D needs to be replaced. Not

plausible.

4.

Use second part of C in B and then use the second part of A in

D. Then it will be sat until fixed remains unsat.

Monday, October 17, 2011

1.

Followed the above suggestion.

2.

Changed the order of distractors to have them look like the

more of a radiation question.

2.

Ideas for questions associated with this KA, red tag procedure,

locked valve procedure, expectations associated with second

person verification.

3.

WHY should an RO know this from recognizing this value? One

could possibly identify that this is an SRO only knowledge.

It would be better to rewrite this question and hit the KA better associated

with valve line up.

Friday, October 14, 2011

1.

New question,

2.

Changed what was proposed.

3.

U

S

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

48

F

2-3

S

003 2.4.25, Modified, Knowledge

1.

KA appears to match.

2.

KA importance rating for 2.4.25 is only 3.3.

Wednesday, October 05, 2011

1.

Unsure as to WHY this question changed from the initial

submittal.

2.

UPON Further review, this question is considered UNSAT.

When in ANY procedures does the RO/SRO/BOP operate

DISCONNECT SWITCHES as Immediate operator actions.

3.

Changes made in green (2nd part of distractors) look o.k. and

are plausible given AOP-600.1 knowledge of the RO in-plant

JPM i (where leaving one RCP running was a critical step).

The issue with the Q is that tripping the Reactor is such a strong

correct choice as an immediate operator action that it may be

hard to develop a second choice that is technically incorrect

(when viewed against Rx trip) and plausible.

4.

K/A covers all aspects of fire protection procedures, does not

necessarily need to cover immediate actions of FEP-4.0.

5.

Q is U due to two non-plausible distractors.

Friday, October 14, 2011

1.

Chose to use disconnects for IPV-445a and b and C. BOP does

not trip the reactor. Rx trip is a duty of the RO. \\

2.

Changes are sat

3.

Question is sat

U

S

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

49

F

2-3

X

E

003 2.4.34, Modified, Knowledge

1.

KA does NOT fully match. Need to discuss tasks AND

resultant operational effects.

Thursday, October 06, 2011

1.

K/A is now met with the changes as made.

2.

Q now looks SAT.

Friday, October 14, 2011

SATISFACTORY.

S

50

F

3

S

086 K3.01, Modified, Knowledge

1.

KA appears to match.

2.

Supplied documentation does not fully support basis for correct

answer or distracters. Distracters appear valid based on limited

documentation.

Thursday, October 06, 2011

1.

Questions 48, 49, and 50 all deal with FEP-4.0 and may present

a potential double jeopardy for an applicant. For example, if

an applicant has a misconception that train A is used during

FEP-4.0 rather than train B the applicant may get both 49 and

50 wrong. Recommend licensee and chief examiner discuss to

determine if this is acceptable.

2.

Need to bound the time frame of actions performed within the

scope of the Qspecifically, the attachments of FEP-4.0 specify

that actions to black out the A ESF train and start turbine-

driven EFW pump need to be completed within 30 minutes.

This needs to be reflected in the Q stem. Potential fix to last

E

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

S

bullet: It has been 45 minutes (note to licensee: pick a

technically correct time here, 35 min? 40 min? 1 hour1.157407e-5 days 2.777778e-4 hours 1.653439e-6 weeks 3.805e-7 months ?)

since the crew began implementing FEP-4.0 CONTROL ROOM

EVACUATION DUE TO FIRE.

3.

If double jeopardy issues resolved to satisfaction, Q should be

o.k. with changes as recommended.

Friday, October 14, 2011

1.

BOUNDED THE TIME TO BE 45 min, all actions should be

done by 30 minutes.

2.

Changed as requested. See exam for changes

3.

Question is SAT.

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

51

H

3

S

003 2.4.31, New, Higher

1.

KA appears to match.

2.

Last bullet on given information does not appear to have any

value.

Thursday, October 06, 2011

1.

K/A is met.

2.

Distractor D is not plausible as written. The combination of

leaving the RCPs running, in combination with a loss of all seal

cooling, does not make any sense. However, changing

distractor D in a 2x2 format means that other aspects of the Q

also have to change.

3.

Potential recommendation:

Initial plant conditions:

-100% power

Current plant conditions:

-XCP-612 pt 4, PHASE B ISOL, alarms

-RB Spray pumps A and B are NOT running

-RB pressure is 0.4 psig and stable

-all phase B automatic actions have occurred

Based on the current conditions, which ONE (1) of the following

states how RCPs should be operated, in accordance with ARP-

001-XCP-612 for PHASE B ISOL; AND what is the status of

RCP seal cooling?

A. Trip all RCPs immediately.

Seal cooling still exists.

B. Trip all RCPs immediately.

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

E

All seal cooling has been lost.

C. RCP operation may continue as long as parameters remain

within limits as displayed on IPCS ZZRCPBRG.

Seal cooling still exists.

D. RCP operation may continue as long as parameters remain

within limits as displayed on IPCS ZZRCPBRG.

All seal cooling has been lost.

4.

Note: the reason it would not be recommended to simply insert

the above first part of C. and D. into the Q as written now, is the

LOCA in progress. Specifically, RCP trip criteria is so well-

known that if the LOCA progresses to the point that a valid

phase B occurs, it is much less plausible to keep the RCPs

running. I.e., if the LOCA started out as a small enough

SBLOCA that we didnt have to trip RCPs on the first pass

through EOP-1.0/EOP-2.0, now the LOCA has gotten so big

theres 12 psig into the RBso the operators will be thinking

shut down the RCPs even without the phase B actuation.

Friday, October 14, 2011

1.

Made the question into 2 by 2, good

2.

S

52

H

2-3

S

002 G2.2.44, New, Higher

KA appears to match.

Thursday, October 06, 2011

1.

Second part of distractors A. and C. are weak, because no

RWST level to be worried about is provided in the Q stem.

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

E

2.

Recommendation: keep the distractors as shown, modify the Q

statement to read something like

Given the following plant conditions:

-The crew is responding to a Faulted Steam Generator (S/G)

-The S/G has blown dry

-The crew has transitioned to EOP-1.2, SI TERMINATION

-RCS pressure is increasing

-RWST level is 40% and slowly decreasing (licensee verify a

good RWST level at this point)

-A charging pump is running

-The crew has just secured the B charging pump

Based on the given conditions, which ONE (1) of the following is

the next required action, in accordance with EOP-1.2; AND why

a reduction in SI flow should be done expeditiously?

Friday, October 14, 2011

1.

Changed this to have just RWST is decreasing.

2.

S

53

H

2-3

S

002 K5.14, New, Higher

KA appears to match.

Thursday, October 06, 2011

1.

Potential issue is that the electronic references for EOP-4.0 rev

20 do not seem to have any steps that put in aux spray at steps

22 and 23 of EOP-4.0 (where the operators depressurize the

RCS to refill pressurizer). However, there is a step at EOP-4.0

22.c.2) that closes PVT-8125? When would this valve ever be

opened before this point in EOP-4.0? Is this a potential

procedural error? Discuss with licensee.

2.

This Q has overlap with a simulator JPMapplicants will be

very familiar with steps 22 and 23 of EOP-4.0.

3.

How is it plausible to put in aux spray if EOP-4.0 does not list

that as an option at steps 22/23?

E

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

S

4.

Potential fix: put the operators in EOP-4.2 (i.e. step 27) in the

fifth bullet of the Q stem. Maybe say something like the

operators are at the step to depressurize the RCS to reduce

break flow in EOP-4.2, SGTR WITH LOSS Does the Q still

work thencheck with licensee? Since there is a chance to use

aux spray in this procedure (EOP-4.2 vs. EOP-4.0), the

plausibility issues are enhanced.

Friday, October 14, 2011

1.

Changed the starting point to EOP 4.2 at step 27.

SATIFSACTORY

54

H

2

S

003 EA2.04, New, Higher

KA appears to match.

Thursday, October 06, 2011

1.

Need to discuss with licensee the potential for first part of A. and

C. to be correctpotential for C. to also be true. The provided

distractor analysis for A. or C. does not discuss why primary to

secondary leak flow has decreased is incorrect.

2.

If first part of A. and C. can be shown to be incorrect, Q should

be SAT.

Friday, October 14, 2011

1.

2.

55

F

2

S

002 EK1.3, Bank, Knowledge

KA appears to match.

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

E

Thursday, October 06, 2011

1.

Q is low discriminatory value, operators who saw the EOP-2.5

simulator scenario (and resulting simulator freeze issue) will

be very familiar with this Q and the correct answer.

2.

Distractor C. is not plausible. Is there any procedure in the

Westinghouse EOP network where SI flow rates are used as

parameters? Recommend modifying C. to be RCS subcooling

3.

Q should be o.k. with modification.

Friday, October 14, 2011

1.

Fixed distractor C

2.

3.

S

56

F

2

S

009 EK1.02, New, Knowledge

KA appears to match

Friday, October 07, 2011

1.

If the S/Gs are dry, answer choices to stop removing heat may

be correct. Need to add S/G levels to stem of Q to ensure RCS-

to-S/Gs coupled in order for reflux boiling to occur? Maybe add

a bullet to state: All S/G narrow range levels are approximately

50% and stable.

2.

Steam binding is a phenomena normally associated with

pumps, not U-tube S/Gs, making the second part changes to A.

and B. suspect. Recommend stop removing heat due to

interruption of natural circulation. Ensure not too much

overlap/potential double jeopardy with Q 53.

3.

The time frame is also important in this Q, because if the hot

legs are completely voided would reflux boiling be able to

occur? Recommend modification to second Q statement as

follows: After RCS level decreases to the point that steam

voiding has just begun to occur in the RCS hot leg.

Friday, October 14, 2011

E

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

1.

Added all the recommendations.

2.

57

H

2

E

KA appears to match

Friday, October 07, 2011

1.

Potential overlap with Q 52, ensure were not putting the

applicant in too much double jeopardy. Should be o.k.

2.

The fact that every distractor except C. deals with Both RHR

pumps gives it weak plausibility. Recommend either changing

C. to Both RHR pumps were stopped to conserve RWST

inventory, or potentially changing B. to read something like

ONE (1) RHR pump was stopped to align to charging pump

suction, if you want to keep C. as writtenthis will improve the

parallelism of the Q.

3.

Recommend adding in accordance with EOP-2.0 LOSS OF

REACTOR OR SECONDARY COOLANT to the end of the

WOOTF statement to clearly identify the source of the correct

answer.

Friday, October 14, 2011

Satisfactory,

S

58

H

2

E

004 A2.01, Higher, New

1.

KA appears to match.

2.

Question uses much of the same information required to answer

question 57.

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

S

Friday, October 07, 2011

1.

Q looks SAT.

59

H

2

X

E

003 A1.2, Higher, New

1.

KA appears to match.

2.

For the choices give, 5% power level could never be wrong. It

is more severe than IR SUR positive, therefore without knowing

anything else, if the SUR answer led to a red path, then the

power range answer must too.

Friday, October 07, 2011

1.

Q still has a potential subset issue/multiple correct answers,

because if Intermediate Range SUR is positive, wouldnt Source

Range SUR be positive as well?

2.

Recommend modifying the Q statement as follows: WOOTF

and the lowest Intermediate Range SUR indication that will

result in an ORANGE path on the Subcriticality critical safety

function, in accordance with EOP-12.0, MONITORING OF

CRITICAL SAFETY FUNCTIONS?

A. End of Life

0.1 DPM and stable

B. End of Life

0.2 DPM and stable

C. Beginning of Life

0.1 DPM and stable

D. Beginning of Life

0.2 DPM and stable

Friday, October 14, 2011

1.

Used recommendation.

2.

S

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

60

F

3

E

E13 EK3.4, Knowledge, Bank

KA appears to match

Friday, October 07, 2011

1.

This Q has overlap issues with SRO Q 94.

2.

Need to understand the impact of the loss of instrument air

header pressurehas it been long enough to bleed down MSIV

accumulators and close all MSIVs? Issue is that if the

condenser is available, then EOP-15.1 step 8 alternate action

would first have the operator locally operate steam dump valves

before attempting to locally operate SG PORVs.

3.

Distractor C is not plausible. Common knowledge that TDEFW

pump has steam line sources from B & C S/Gs, not the A S/G. If

the overlap issues can be resolved and it made clear that it has

been a long-term loss of instrument air, changing distractor C. to

say Locally operate steam dump valves in all condenser

sections to reduce affected SG pressure, may be a plausible

candidate for replacing C.

4.

Should delete based upon a yellow condition on the Heat

Sink CSF status tree as teaching in the stem; you can only get

to EOP-15.1 on a yellow path.

Friday, October 14, 2011

1.

Changed no overlap issue.

2.

MSIVs no accumulators

3.

Removed teaching from the stem.

4.

In C removed in each condenser section. To each condenser

like the procedure.

S

61

F

2

S

W/E15 EA1.3 get this from here.

Friday, October 07, 2011

1.

Distractor B. is a subset of correct answer A. A faulted SG

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

inside containment would be one of the unexpected sources of

water. Therefore B. is a non-plausible distractor.

2.

Potential recommendation for B.: Evaluate ECCS system

status to determine strategy to transition to cold and hot leg

injection. to play off distractor D.

Friday, October 14, 2011

1.

Changed B to look like D.

SATISFACTORY

62

H

2-3

E

022 G2.4.11, Higher, Modified

1.

KA appears to match.

2.

Using the word Immediately implies immediate action. Instead

suggest using which step will the AOP require first?

Friday, October 07, 2011

1.

Q was modified as requested in first 401-9.

2.

Q is of low discriminatory value, but acceptable.

3.

Q now appears SAT.

Friday, October 14, 2011

S

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

63

F

2

X

E

00024AK1.01 need to get this one from file.

003 AK1.01, Knowledge, New

1.

KA slightly matches.

2.

The question is NOT very discriminating. The candidates really

do not need to understand the operational impact of the loss of

RHR, the just need to know the max pressure and temperature

that it can be put in service. A better question might put them

outside one of the limits and have them determine that they

cannot put it in service until they restore the parameter.

Friday, October 07, 2011

1.

Q was modified as requested in first 401-9.

2.

Could be acceptable Q if source is provided for correct

answeri.e. design limits based on what document?

Westinghouse Design Basis Document for RHR system? VC

Summer FSAR? Etc. Once source is specified, recommend

listing it as an in accordance with at the end of WOOTF

statement.

3.

Q may be o.k. with modifications as requested

Friday, October 14, 2011

1.

Changed question based on the comment from NRC.

S

64

F

2-3

S

076 K3.05,Knowledge, New

1.

KA appears to match.

2.

Answer is logical. Does not appear to be adequate procedural

documentation to ensure only one correct answer. How long is

RCS temperature expected to remain stable?

Friday, October 07, 2011

E

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

S

1.

Distractor B is non-plausible. How would the condenser still be

available? Recommend slight modification to read: Dump

steam using S/G PORVs.

Friday, October 14, 2011

1.

Version two uses SG PORVs.

2.

Changed B to use MDAFW to feel one SG and use that S/G to

depressurization.

65

F

3

X

E

065 AA1.03, Knowledge, New

1.

KA sort of matches.

2.

KA is asking how to operate equipment when air is restored. In

other words, what do you need to do prior to restoring air to

ensure you dont damage the plant or cause another transient

when you restore air. Valve switches may be placed in hard

open or closed (or gagged open or closed) to prevent

repositioning upon air restoration. This question appears to be

written from a standpoint of operating without air vice operating

while restoring air.

Friday, October 07, 2011

1.

Q was modified as requested in initial 401-9.

2.

Q now looks SAT.

Friday, October 14, 2011

Validation identified that it was a gaging handwheel so had to change the

stem to a valve that needed to be ungagged.

S

66

F

2

X

E

079 A4.01, Higher, New

1.

KA appears to match.

2.

Answer C is NOT plausible. Why would service air isolate

before the backup compressor started?

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

S

Friday, October 07, 2011

1.

Q modified as requested in initial 401-9.

2.

Q now looks SAT.

Friday, October 14, 2011

1.

Not higher level of knowledge otherwise ok.

2.

S

67

F

2-3

S

059 G2.4.11, Higher, Bank

1.

KA appears to match.

2.

Consider asking which AOP would they enter and what is the

first action that would be taken.

3.

Is it certain that manually controlling all three FRVs cannot

cause SG levels to rise?

Friday, October 07, 2011

1.

Distractor A. is still potentially correct. For the given plant

conditions, operators would meet entry conditions for AOP-

210.1 and A. is the first immediate operator action of AOP-

210.1. Also, use of the word all in distractor A. is a giveaway

word.

2.

If agreement can be reached that A. is clearly technically

incorrect, recommend changing A. to read take feed reg. valves

to manual for the affected S/Gs.

3.

If A. is not clearly incorrect, recommend development of new

distractor to replace A. Would it be plausible to start additional

condensate pumps or feedwater booster pumps?

Friday, October 14, 2011

1.

Changed A to start feed water booster pump.

2.

Changed the stem . see final exam for changes.

3.

Sat

E

S

68

H

3

S

077 AK3.02, Higher, New

1.

KA appears to match.

Friday, October 07, 2011

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

1.

Unsure about higher cognitive, Q can be answered via simple

recall of AOP-301.1 CAUTION/first step. Should be

Fundamental LOK.

2.

Recommend adding Based on the given conditions, to the

WOOTF statement.

3.

Otherwise Q looks SAT.

Friday, October 14, 2011

1.

69

F

2

E

059 AK1.01, Knowledge, New

1.

KA appears to match.

2.

If this is knowledge that the operators are expected to

memorize, it is OK. However it is not very discriminating.

Specific to plant.

Friday, October 07, 2011

1.

What microcuries/gm setpoint would correspond to a full

Condensate Storage Tank? i.e. check to ensure A. and B. are

incorrect.

2.

As mentioned in first 401-9, not very discriminating; however, if

above concern is resolved Q should be SAT.

Friday, October 14, 2011

1.

SAT as is, need to know spec.

S

70

F

2

S

058 G2.2.36 Higher, New

1.

KA appears to match.

2.

Memorization. No higher level ability required.

3.

Not very discriminating. Any person knowledgeable of PWR

operations could answer.

Friday, October 07, 2011

1.

Q should be SAT.

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

Friday, October 14, 2011

sat

71

F

2

X

S

003 3.01, Higher, New

1.

KA appears to match.

2.

Stopping dilution within 1 hour1.157407e-5 days 2.777778e-4 hours 1.653439e-6 weeks 3.805e-7 months is part of the material below the

line. ROs do not need to know this information. This makes

these distracters very weak. Recommend using be in cold

shutdown within 12 hours1.388889e-4 days 0.00333 hours 1.984127e-5 weeks 4.566e-6 months as a better distracter.

Friday, October 07, 2011

1.

Potential subset issueif second part of distracters B. and D.

were correct, second part of distracters A. and C. are also

correct.

2.

Also need to add with no operator action to the Q statement?

Because FCV-122 is in MANUAL

3.

Potential fix for this issue would be to change WOOTF

statement to read: Which ONE(1) of the following describes an

expected parameter trend if the running RHR pump trips with no

other operator actions, and the required action as stated in

Technical Specifications?

Friday, October 14, 2011

1.

Fixed the subset issues.

2.

Added with no operator actions to the stem.

SATISFACTORY

E

S

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

72

F

2

U

017 AK2.10, Knowledge, New

1.

KA matches somewhat.

2.

Memorization. No higher level ability required.

3.

Not very discriminating. Memorization of the trip setpoint and a

basic understanding of reactor physics that any nuclear

professional should have.

Friday, October 07, 2011

1.

This Q has multiple subset issues. As written D. is a potentially

correct answer along with C. Second part of A. and B. are not

plausible because they would allow operators to restart a RCP

at 100% power (current MODE is MODE 1), and because if the

second part of A. and B. are true, then the second part of C. and

D. are also true.

2.

311 degrees is also not plausible because its too highseal

return would be superheated at this temp? (return flow at VCT

pressure?)

3.

Q as written is UNSAT due to the above issues.

4.

Potential fix/recommendation: (delete the Given and the

bullets)

In accordance with SOP-101, REACTOR COOLANT SYSTEM, which

ONE (1) of the following correctly identifies:

1) The lowest seal water outlet temperature at which a RCP must be

stopped.

2) The highest MODE in which a RCP can be restarted after the cause of

the high temperature is corrected?

A. 1) 195 F

2) MODE 3

B. 1) 195 F

2) MODE 4

C. 1) 235 F

2) MODE 3

S

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

D. 1) 235 F

2) MODE 4

Friday, October 14, 2011

Followed all recommendations.

73

H

2

X

S

003 AK1.21 Higher, New

1.

KA appears to match.

2.

Not very discriminating. Bases for the plausibility of AFD being

within the band is that the candidate must know that the

surveillance requires 2/4 to be outside the band to be

considered outside the band. Given that it is easy to see that

two NIs are outside the band, the average person with no

knowledge would declare it out. A more discriminating question

would have three inside and one outside.

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

E

Friday, October 07, 2011

1.

Q was not changed given the recommendation of the first 401-9.

As written, first part of Q is essentially a direct look-up on the

100% power line (points given on the provided reference).

Therefore, with two values outside the acceptable region,

plausibility of first part of A. and C. is weak.

2.

Recommend changes to delta flux indications as follows:

Before the Drop After the drop

N41 -4.4% -3.6%

N42 -4.4% -5.7%

N43 -4.4% -9.1%

N44 -4.4% -6.8%

3.

Recommend changing the second half of the Q statement to

The BOP is required to maintain Tavg within a maximum of

_____ of Tref, in accordance with AOP-403.5, STUCK OR

MISALIGNED CONTROL ROD.

4.

If the above changes are made, C. is the new correct answer.

5.

Q should be ok with modifications.

Friday, October 14, 2011

1.

Sat as changed, it is a little different but ok

74

F

2

S

2.2.35, Knowledge, New

KA appears to match

Friday, October 07, 2011

1.

K_eff values up to 0.99 are not plausible. How could you ever

refuel at that value? Recommend making one first part choice

E

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

S

less than or equal to 0.90 and the other less than or equal to

0.95 Temperature choices in the 2x2 are ok.

2.

Another potential enhancement to WOOTF statement: WOOTF

that can exist when the first Rx Vessel head bolt is

detensioned in accordance with Technical Specifications?

Friday, October 14, 2011

1.

Changed from 0.99 to 0.90, changed less than or equal to .

2.

75

F

3

S

003 2.2.37, Knowledge, Bank

1.

KA appears to match.

2.

Memorization. Plant specific.

Friday, October 07, 2011

1.

Q appears to be SAT.

Friday, October 14, 2011

1.

S

SRO ONLY Questions

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

76

H

3

E

017 AK2.10, Knowledge, New

4.

KA matches somewhat.

5.

Memorization. No higher level ability required.

6.

Not very discriminating. Memorization of the trip setpoint and a

basic understanding of reactor physics that any nuclear

professional should have.

Friday, October 07, 2011

5.

This Q has multiple subset issues. As written D. is a potentially

correct answer along with C. Second part of A. and B. are not

plausible because they would allow operators to restart a RCP

at 100% power (current MODE is MODE 1), and because if the

second part of A. and B. are true, then the second part of C. and

D. are also true.

6.

311 degrees is also not plausible because its too highseal

return would be superheated at this temp? (return flow at VCT

pressure?)

7.

Q as written is UNSAT due to the above issues.

8.

Potential fix/recommendation: (delete the Given and the

bullets)

In accordance with SOP-101, REACTOR COOLANT SYSTEM, which

ONE (1) of the following correctly identifies:

1) The lowest seal water outlet temperature at which a RCP must be

stopped.

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

S

2) The highest MODE in which a RCP can be restarted after the cause of

the high temperature is corrected?

A. 1) 195 F

2) MODE 3

B. 1) 195 F

2) MODE 4

C. 1) 235 F

2) MODE 3

D. 1) 235 F

2) MODE 4

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

77

H

2

X

U

W/E16G2.4.30, New, Higher,

1.

Depending on the other questions, the reference provided

should be the entire EAL matrix. This way the applicant at least

has to find the section necessary to answer the question. IF

ONLY the page that is associated with each question is

provided then the question becomes a look up for only that item

on that page. Suggest the entire EAL Matrix be provided,

unless it helps answer other questions on the exam (RO or

SRO)

2.

An event occurred that increased (raised) the readings Not

sure it is necessary to say significant. Also, reading should be

plural, readings. And at the end of the second bullet add the

word respectively.

3.

KA does not match, reporting to agencies internal or external,

not done, only classification is done. Not notification. Repair or

replace

Wednesday, September 28, 2011

1.

1. Replacement question. New Lower,

2.

Distractors C is NOT plausible, the stem of the question does

not provide any substantive information concerning the

information that would require the identification of offsite dose

projections. While the question analysis states that the INITIAL

notification does not require the offsite dose projection, the

question in the stem does not provide any information that

would be used to do this. Additionally, the stem states offsite

radiation is normal.

3.

Distractor D is NOT plausible.

This new question still warrants an evaluation of a U.

Thursday, October 13, 2011

1.

Changed to a 2 by 2 format.

U

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

U

2.

Event prognosis and estimated release duration was used.

3.

Stem has a radiation monitor that needs to be changed

because there is a 309 that needs to be removed from the rad

monitorl RMG-7 needs to be changed. *****

4.

Fission product matrix is used.

5.

PM states remove the 1 hour1.157407e-5 days 2.777778e-4 hours 1.653439e-6 weeks 3.805e-7 months . Added note to the make sure

that the ED JUDGEMENT is NOT used.

6.

- - - - still have to ensure that RMG-7 nomenclature is corrected.

78

F

2

X

U

G2.2.25, New, Lower,

1.

Distractors with run out are not plausible A and C. This is a

system knowledge item that is covered by everyone, not just

SRO knowledge.

2.

The 13 gpm value listed in the question in C and D are also not

valid. In that, what or where does this number come up that

would cause the operators to think it is plausible? Additionally,

what did the results of the validation see for this question?

Anyone pick anything but the correct answer? Did anyone pick

D? or C? If not these most likely are not valid answers and not

plausible.

3.

Asked G. Laska concerning the evaluation of the question. He

agrees.

Thursday, September 29, 2011

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

S

1.

Question was UNCHANGED. The above evaluation still is

valid.

Question is still a U.

Thursday, October 13, 2011

1.

The new question still has subset issues. B and D can be

also correct. Subset issues. Changes to this are

necessary so it is bounded.

2.

Change maximum of 33 and a maximum of 39. This was

changed during this meeting.

3.

JL asks what part is the SRO?

4.

Had to change to maximum of vice less than. This

included a less than 13 which would also be 33 gpm.

5.

Also changed distracters to add during the design basis

LOCA.

6.

Changed pump to RCP.

Question is satisfactory.

79

H

2

X

U

000062AA2.03, New, Higher,

1.

In the stem of the question, the A EDG is listed this way and A

EDG. With or without quotes. Pick a standard for all questions

and do it the same.

2.

This information while in the basis of TSs, is not SRO ONLY

knowledge.

3.

Question needs to be re-written to be at SRO level.

4.

Verified with G. Laska to ensure it was NOT SRO ONLY, he

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

S

agrees.

Thursday, September 29, 2011

1.

Replacement question. New Lower.

2.

Attempting is misspelled in the last bullet in the stem.

3.

Suggest to put a comma after the first line in each distractor,

this will separate the answers

4.

KA appears to match

5.

Otherwise, this appears to be OK.

-How is Q lower cognitive? Should be higher cog based on

evaluation of plant conditions, operability call required, etc.?

Thursday, October 13, 2011

SATISFACTORY

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

80

H

2-3

U

00025AA2.04, New, Higher,

1.

Use of period in bulleted area, one has all rest do not have

periods

2.

Question is NOT SRO ONLY. Systems knowledge can answer

this without any knowledge of the procedure.

3.

The procedure is provided so the SRO does not have to identify

what procedure to handle this in.

4.

The PZR level is not described sufficiently, uncontrollably, is not

good enough to evaluate.

5.

The stem TELLS the applicant that there is an indication of a

LOSS of inventory. Why not use that instead of teaching that.

Dont tell the applicant what is going on.

6.

G. Laska reviewed for verification of NOT SRO ONLY, he

agrees.

7.

KA appears to match.

Thursday, September 29, 2011

1.

NEW, LOWER, current question was MODIFIED from 45 day

submittal.

2.

Question should NOT ask how operators would use, but how

the SRO would direct! This would be a better indication of what

we are asking the applicant to figure out. Discuss this with

licensee. This is an enhancement.

3.

This question while closer to the requirements of an SRO

question is low level.

4.

KA appears to match, not really close but close enough.

5.

The question appears to be more common sense and can be

answered with that. The first part is basic knowledge. The

subcooling is decreasing and this will need to be fixed by being

in the injection mode.

6.

Why would anyone select distractors C and D with LOCA

OUTSIDE CONTAINMENT? This does not seem plausible.

Discuss with the licensee. WHY would an applicant pick these?

7.

In the analysis, it is stated that EOP 2.5 will NOT be entered

from mode 4. Need to understand this and why it is plausible.

8.

Matches KA

9.

Still considered a U because of the procedure selected.

Thursday, October 13, 2011

U

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

S

1.

New question

2.

Changed wording of initial conditions.

3.

Changed PZR level that has level go from 60 to 30 in the

time frame and do they enter 112.2, loca during mode 4.

4.

Leak needs to be greater than the capacity of the CCP.

Does the 60 to 30 do this?

5.

Changed the time to 0415,

81

H

2-3

U

086A2.01, New, Higher,

1.

Question is trivial.

2.

Question can be salvaged by, removing in the stem not reset in

the second bullet. It should read the pump has been shutdown

and the (whatever the switch is called is ) either OFF. Do not

say it was reset.

3.

This question is not SRO ONLY. The only part is the timeframe

for which to return to operability.

4.

What is the difference between a roving fire watch or a

continuous fire watch? I believe they are the same.

5.

Discussed with BC M. Widmann and G. Laska both believe the

question is NOT SRO ONLY.

Thursday, September 29, 2011

1.

The licensee changed the question as discussed in # 2 above.

However, the information provided does not appear to be

correct. How is the switch labeled? Is there an AUTO position

on the switch? If there is, then the switch was taken from the

AUTO to OFF/RESET. Not the ON position. Discuss with

licensee.

2.

The distractors A and B are not credible. Why would anyone

that is trained call something OPERABLE and then have a

compensatory measure for it being OPERABLE.

3.

Discuss with licensee

Thursday, October 13, 2011

New question and will be discussed later,

U

??

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

Also, MM provided a NEW KA

Friday, October 14, 2011

New ka provided by MM.

0002A2.04

New question is SAT. See exam for new test item.

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

82

H

3

U

000007EG2.4.34, New, Higher,

1.

Need to add the noun name of procedure AOP-600.01,

2.

NOT SRO ONLY, this question requires an operator to

determine if when transferring control of a pump to the Control

Room Evacuation Panel (CREP) is Operable or Inoperable.

This knowledge is not just the SROs in this case. The RO is

taught this and should know this for control of the pump as well

as if it was not swapped to the local area for control.

3.

The second part of the question concerns itself with the

requirement of starting room coolers when starting equipment.

This is a system requirement and the RO is taught this also to

prevent failure of the equipment.

4.

KA does NOT match. The KA was supposed to be written

during a situation of Reactor-Trip Stabilization and Recovery,

performed OUTSIDE the MCR during an emergency and the

resultant operational effects. While this is OUTSIDE the control

room it is not during a reactor trip.

Thursday, September 29, 2011

1.

This question was inserted into the examination at this point.

000007EG2.4.34, New, Higher, is the new question 7 or SRO

82 this questions was the # 9 in the first submittal.

2.

AOP 600.1 at step 6 states

6 Attempt to start the Diesel Generator by depressing the ENGINE SHUT

DOWN RESET Pushbutton

Is this the step the analysis is talking about? Will this work in

this case? Ask licensee to explain how this works.

Stem of the question should ask what procedure to use and then what

action the procedure should direct. For example, the answer should now

read: AOP 600.1, Control Room Evacuation, start the B EDG. Now the

stem does not identify the procedure is being asked. It starts with the

action then a procedure. Also, it does not identify where the operator is

going to operate MVT-8104. Discuss with licensee. Enhancements-------

Additional comments

on 007EG2.4.34 as submitted in 2011 NRC SRO Test 2nd

Submittal

-need to ensure operators are in correct procedurecould A be

correct? Or, once B EDG is started as per choice D, based on the

note before steps 12-19 of AOP-600.1 would A not also be correct?

-stem should probably state reason why control room was

evacuated, otherwise FEP-4.0 could be the right procedure.

-not sure about operational validityfrom AOP-600.1 step 12.d.

Alernative Action, wouldnt operator emergency borate with AOP-

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

U

S

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

83

OLD

H

2-3

X

U

063A2.02, New, Higher,

1.

KA does NOT match. The second part of the KA was not

tested. It is required to test the (b) part of the KA when there is

a two part KA. The (b) part required the question be written to

use procedures to correct, control or mitigate. This question

does not do this. This question only identifies the generation of

Hydrogen or Sulphuric acid vapors. Has nothing to do with

procedure that will correct etc. .This makes this question unsat.

Thursday, October 13, 2011

1.

At this point, the licensee submitted the Second submittal. This second submittal the numbers and KAs for each question was changed. Not sure why. As licensee why this was done.

Starting with question 82 the KAs were swapped.

83

NEW

H

2

S

063A2.02

Thursday, September 29, 2011

1.

KA 063A2.02, was number 10 in submittal # 1, (S1) now it is

question number 8 in Submittal # 2 (S2)

2.

S1 it was higher new and now it is lower new.

3.

In stem put quotes around XVA1A and commas as appropriate.

i.e. A charge of A Battery, XBA1A, is in progress. This will

make this read better.

4.

KA appears to match

5.

The stem is a little confusing concerning the lifting of the lead

and then the requirement to continue or recommence the

charge. Has the charge ever been stopped because of the fans

being found off? Ask licensee if this is important or not.

6.

Otherwise appears to be ok.

Thursday, October 13, 2011

1.

Changed 14 days to 96 hours0.00111 days 0.0267 hours 1.587302e-4 weeks 3.6528e-5 months . 96 hours0.00111 days 0.0267 hours 1.587302e-4 weeks 3.6528e-5 months ,

nuisance annunciators, can open a link from 48

to extend the open to 96 hours0.00111 days 0.0267 hours 1.587302e-4 weeks 3.6528e-5 months . What was

wrong with 14 days. Operations does nothing in

14 days.

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

2.

Changed back to 14 days.

SAT QUESTION.

84

H

3

X

E

012A2.01, New, Higher, Summer

Thursday, September 29, 2011

Question was changed from S1

1.

Distractor D identifies just to SHUT down the reactor, however,

A and B identify to be in HOT STANBY, this keys the applicant

that D is not totally correct, in that, the MODE is NOT listed. I

believe that this makes this distractor not plausible.

2.

For distractor A and B, is this plant terminology, Initiate

Measures . Prepare for plant shutdown by XXXX to Hot

Standby by XXX.

3.

When the stem states asks for the MINIMUM action, does that

mean the shortest action? Discuss with the licensee.

4.

KA appears to match, this is a TS question, need to make sure

that we do not have too many for the A2 KAs.

5.

The distractors could be made such that the first two have the

BS trip times added to the end of the statements and then have

the opposite where the BS are tripped as in Distractor D and

then have the reactor down power done to hot standby. This

would alleviate the unsymmetrical distractor part of C. Discuss

with licensee.

Thursday, October 13, 2011

1.

NEW FORMAT and 2 x 2 question.

2.

S

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

85

H

3

X

U

Thursday, September 29, 2011

039G2.4.11, New, Higher,

1.

Question was NOT changed from S1 to S2.

2.

Question concerns itself with TS evaluation. We need to be

careful with the use of TS questions. There were a lot before

and we may exceed or emphasis on TSs.

3.

This question, needs a reference because it is greater than an

hour. If the reference is presented, then the question as is

written this would make it a direct look up. This makes the

questions unacceptable.

4.

Main and reheat steam, could have used ARPs and maybe with

a PORV that had failed open, maybe there could have been a

reportability call to make, i.e. an SRO ONLY type question.

How long, who to call.

5.

As the question is not Sat because of the call of TS greater than

1 hour1.157407e-5 days 2.777778e-4 hours 1.653439e-6 weeks 3.805e-7 months , information not required to be memorized by operators.

6.

Also in the stem could shorten action or actions by using

action(s).

IF the licensee validates that this knowledge is REQUIRED for the SRO,

then this question could be Satisfactory. Discuss with licensee.

Thursday, October 13, 2011

1.

NEW question, suggested by MM.

2.

New question will require TS 3.7.1.2, 78 hours9.027778e-4 days 0.0217 hours 1.289683e-4 weeks 2.9679e-5 months , 3 days plus

6.

3.

REFERENCE will be provided.

S

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

86

H

2

U

00027AA2.01, New, Higher,

Thursday, September 29, 2011

1.

Question was re-written from S1 to S2. Minor changes to make

consistent with other questions.

2.

Analysis of the answer A states procedure step 10 a. however

in EOP 1-2, this step is not the requirement for subcooling

margin being greater than 52.2 F. This is in the foldout page but

not in step 10a. Have licensee identify where this comes from.

3.

Do not understand What the stem is asking, PZR level greater

than the SI termination criterion is expected for this event and

whether other conditions are met to transfer to EOP 1.2. have

the licensee explain what this is asking.

4.

KA appears to match question

Additional comments on 027AA2.01 as submitted in 2011 NRC

SRO Test 2nd Submittal

-not sure about SRO-only match on procedure selection, operators

are not selecting a procedure but only staying in current

procedure. Would it be better to ask expected procedural flowpath

(i.e. E-1 to ES-1.2, then ES-1.3) or give four-choices of procedures

with some additional info in stem? E.g. choose between staying in

E-1, going to ES-1.2, going to ES-1.1, or going to ES-1.3 (WOG

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

S

designators). Otherwise Q is potential RO-level knowledge of SI

Termination criteria (e.g. subcooling value is foldout page item).

-careful about teaching in answer choicessubcooling is too low

should be subcooling not met, etc.

Thursday, October 13, 2011

1.

Replaced.

2.

Replacement ok.

87

H

3

S

000056EA2.06, New, Higher,

Thursday, September 29, 2011

1.

This question is the new number 12, but corresponds to the old

15.

2.

Question was made into a two part question/answer.

3.

Question appears to be ok.

4.

KA appears to match

Thursday, October 13, 2011

1.

Changed the graphic from 5% to 2%. Changed this because as

soon as the SI pump is started it would or could be secured.

S

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

88

H

3

E

076A2.01, New Higher

Monday, October 03, 2011

1.

In the stem of the question, the Loop is identified with

parenthesis. However, the last bullet the A train, should be the

same A train. Also there is one extra space in the last bullet

between Pump and is.

2.

SW is not defined until the first question.

3.

In the second question in the stem there is a missing period.

4.

The First question, should not be an AN, it should be an A.

Would recommend that this be re written to something like:

Due to the A Service Water pump failure this

caused the ..

5.

What is the status of the C Service Water pump at this time?

Per the figure provided for the start logic (Figure IB1.6),

shouldnt the C service water pump auto-start on low header

pressure? If the pump is running, the answer choices may be

different.

6.

As currently written, first part of distracters C. and D. are weak.

Recommend changing first part of C. and D. to The A Motor-

Driven Emergency Feedwater Pump is OPERABLE.

Thursday, October 13, 2011

1.

Rewrote question in 2X 2

2.

Appears to do all the above,

S

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

89

H

3

X

U

K/A 103G2.4.18

NEW HIGHER

Monday, October 03, 2011

1.

Q appears to match K/A. Q appears to be SRO-only.

2.

Q statement needs to specifically reference the EOP; for

example, Which ONE (1) of the choices below is correct in

accordance with EOP-2.4?

3.

Second part of distracters C. and D. is not plausible. RWST

would have to gravity drain through the RB spray header rings

against a 40 psig differential pressure.

4.

Need to lower RWST level to make securing a RB Spray pump

more plausible30% level is above the 18% setpoint to go to

cold leg recirculation.

5.

Question is U due to more than one non-plausible distractor.

Thursday, October 13, 2011

1.

Wants to keep rwst level at 30%,

2.

Changes the pressure of containment to 32 psig rather than 40

psig.

3.

SAT with changes to C and D, see question for change.

S

90

H

3

X

E

K/A 011G2.4.21

NEW HIGHER

Monday, October 03, 2011

1.

Q appears to match K/A. Q appears to be SRO-only.

2.

Operational validity/stem content: how would any SRO be

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

S

entering a YELLOW path procedure 15 minutes after a

LBLOCA? Must increase the time frame to be operationally

valid. Did increase comment.

3.

Stem needs to provide all criteria for critical safety path

evaluationfor example, needs to include intermediate range

power and startup rate values, containment pressure values,

and RHR sump level values.

Thursday, October 13, 2011

1.

91

H

3

E

G 2.2.38, Bank, Higher.

1.

Question appears to be within the SRO knowledge

requirements.

2.

KA appears to match.

3.

Question is kind of easy, not trivial but it does not require much

cognitive skills to answer.

4.

Why is the answer 92 days, is that the time frame you use for a

Quarter?.

5.

The description for the analysis for distractor A is incorrect. TS 4.0.3, allows up to 24 hours2.777778e-4 days 0.00667 hours 3.968254e-5 weeks 9.132e-6 months , so why is that not the reason for A

rather than the applicants miss-reading quarterly as Shiftly?

That does not make sense.

K/A G2.2.38

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

S

NEW HIGHER

Monday, October 03, 2011

1.

Q appears to match K/A. Q appears to be SRO-only.

2.

Fourth bullet needs to explicitly match the language in the TS 4.0.3 for completing a risk assessment. For example, A Risk

Evaluation has been performed for the surveillance, and has

concluded that the risk associated with the delay of the

surveillance is minimal.

3.

For the distracters, need to specify time limit from the time of

discovery; for example:

A.

Within the next 24 hours2.777778e-4 days 0.00667 hours 3.968254e-5 weeks 9.132e-6 months from time of discovery

B.

Within the next 23 days from time of discovery

C.

Within the next 92 days from time of discovery

D.

Within the next 115 days from time of discovery

Friday, October 14, 2011

1.

Question was replaced. See exam for question.

2.

Presented question with word shiftly, GL states not terminology

3.

Question is SAT.

92

F

3

X

U

072A2.03, New, Knowledge.

1.

When a KA has a two part K or A if the question cannot be

written to the part (a) and (b) then the goal is to write the

question using the SRO portion of the K or A, meaning the (b)

part of the KA. This question does not meet the (a) part, it does

not predict the impact. There is no justification why the (a) was

not written in this question.

2.

Procedures to correct. Part (b), this is a 30 day action, the

questions indicates INITIAL action required if the power supply

fails. There is no INITIAL action in any of the distractors.

3.

The RM used in distractors C and D, RM-A4, would, if in

service, alarm for ANY leak.

4.

As written, this question is unsat

5.

Is the SRO required to know 14 day and 30 day TSs from

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

S

memory? Ask licensee, this seems unreasonable

K/A 072A2.03

LOWER

Monday, October 03, 2011

1.

Q is essentially unchanged from initial submittal.

2.

Distractor A is potentially another correct answer.

3.

Q is still U

4.

Making the applicants recognize instruments that may or may

not be in TS. Is this something you expect? Items are 7 days,

72 hours8.333333e-4 days 0.02 hours 1.190476e-4 weeks 2.7396e-5 months ?? Ask licensee.

Friday, October 14, 2011

1.

New KA provided by MM. 034K3.02

2.

See new question, modified slightly from what was provided.

Generic Comment: in two-part questions, it is better to indent the (1) and the (2) parts of the question statement (offset from the Which ONE of the following) for readability.

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

93

F

2

U

K/A 028G2.1.27

Monday, October 03, 2011

1. Q appears to match K/A. Q appears to be SRO-only.

2. Last bullet for temperatures needs degrees Fahrenheit (F) after

the degree symbol.

3. Recommend modification to question statement as follows:

Based on the initial conditions, which ONE (1) of the following is

correct in accordance with EOP-14.0? did

(1) How many hydrogen recombiners will be started?

(2) What is the next procedure transition?

4. When would operators ever start both Hydrogen Recombiners

at the same time? First part of distracters C. and D. are not

plausible.

5. Recommend potential fix for first part C. and D. to say No

recombiner will be started.

6. Correct spelling error for Guideline in all choices.

7. Q is U due to two non-plausible distracters.

Thursday, October 13, 2011

1.

Changed as suggested.

2.

Satisfactory

S

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

94

H

3

U

K/A WE13EA2.2

Monday, October 03, 2011

1.

Q appears to match K/A. Q appears to be SRO-only level.

2.

Distractor B. is not plausible because all MSIVs are closed, why

would you dump steam from the B&C steam generators when

you had an option to use A? (distractor A.) Also it is not clear

whether dump steam infers using steam dumps or steamline

PORVs.

3.

Distractor D. is not plausible because there is not physical

steam supply from the A S/G to the turbine driven EFW pump.

4.

Q is U due to two non-plausible distracters.

5.

Need to move the last bullet (Operators have entered EOP-

15.1, STEAM GENERATOR OVERPRESSURE) to bullet

number three.

6.

Potential fix/recommendation:

Based on the given conditions, which ONE (1) of the following

is the procedure and the action the CRS will direct?

A.

Remain in EOP-15.1, STEAM GENERATOR

OVERPRESSURE, and dump steam from A Steam

Generator steamline PORV.

B.

Remain in EOP-15.1, STEAM GENERATOR

OVERPRESSURE, and initiate blowdown from the A

Steam Generator.

C.

Transition to EOP-15.2, STEAM GENERATOR HIGH

LEVEL, and dump steam from A Steam Generator

steamline PORV.

D.

Transition to EOP-15.2, STEAM GENERATOR HIGH

LEVEL, and initiate blowdown from the A Steam

Generator. (new correct answer)

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

S

Thursday, October 13, 2011

1.

Followed recommendations. \\

2.

2/2 format.

Satisfactory

95

H

3

E

K/A WE08G2.4.21

NEW HIGHER

Monday, October 03, 2011

1.

Q appears to match K/A. Q appears to be SRO-only

2.

Valid with respect to physics and thermodynamics? RCS and

RB pressures are matchedis there a LBLOCA in progress as

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

S

well as the steam line break?

3.

Delete 30 minutes ago from first Q statement. Again, do not

believe conditions would be established as stated in 30 min

timeframe.

4.

Distractor D. is not plausible, Recommend changing to Remain

in EOP-3.1, UNCONTROLLED DEPRESSURIZATION OF ALL

STEAM GENERATORS.

5.

Change question statement to read: WOOTF identifies the

procedure the CRS will direct the crew to implement to

effectively mitigate this condition?

Friday, October 14, 2011

1.

New question, did not follow the above recommendation.

2.

Changed from what was presented slightly, see question for

new sat question.

96

F

2

S

K/A G2.3.14

Monday, October 03, 2011

1.

Q appears to match K/A. Q appears to be SRO-only.

2.

Q is SAT.

Friday, October 14, 2011

1.

The licensee wants to change this question based ONLY on the

results of the everyone FAILED. Initially this question was

validated by 2 SROs and was not an issue. The question was

revalidated again because there were 5 individuals who

Question would not be justifiable. The OLD version will be used.

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

97

F

2

E

K/A G2.3.12

Monday, October 03, 2011

1.

Q appears to match K/A. Q appears to be SRO-only.

2.

Q is SAT as submitted .

Tuesday, October 04, 2011

When is the RB Charcoal Clean up unit energized? Licensee needs to

identify. This is from OAP 108.1 b. Determine if operation of four

RBCU's (fast speed) per SOP-114 should be performed in

order to increase stay times for teams entering

containment.

Why is D not also correct?

Distractor C appears to be not plausible. Need to clarify or identify a

special case for entering the RB and then Key off of that. Discuss.

Thursday, October 13, 2011

1.

ADDED in stem a DAC reference to make C more plausible,

2.

Changed D to slow speed.

3.

Satisfactory.

S

98

H

2

S

K/A G2.1.4

Monday, October 03, 2011

1.

Q appears to match K/A. Q appears to be SRO-only.

2.

Remove to regain SRO proficiency from distractor D.

Thursday, October 13, 2011

SATISFACTORYs

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A

Only

99

F

2-3

U

G 2.1.3, New, Lower

1.

KA appears to match

2.

Distracters C and D are not plausible. The situation for a

reactor start up NO distractions would occur and therefore

implausible. This makes the SRO functions trivial, there is no

instance where an operator would select these.

3.

Recommendation

Knowledge between long and short term turnovers. Use the 2 by 2 format

to identify 2 items from each or something that is unique to the short and

not to the long.

Thursday, October 13, 2011

1.

NEW QUESTION

2.

OK

SATISFACTOY

s

100

U

2.4.37, VCS CLOSED, Lower,

1.

KA does NOT match, SRO ONLY, trivial knowledge

2.

The answers for the second part are not really answered by the

answers in the distracters. For example, what happens if the

TSC is not manned but the ED takes command from the IED?

Should the question ask when is the IED relieved from his

duties?

There is some information needed to the stem of the question.

Recommendation:

VC Summer 2011-301 Examination

ES-401, Rev. 9

Written Examination Review Worksheet

Form ES-401-9

Q#

1.

LOK

(F/H)

2.

(1-5)

3. Psychometric Flaws

4. Job Content Flaws

5. Other

6.

U/E/S

7.

Explanation

Stem

Focus

Cues

T/F

Cred.

Dist.

Partial Job-

Link

Minutia

/

units

Back-

ward

Q=

K/A