ML18057B535

VC Summer 05000395/2011301 Exam Administrative Items 2C

ML18057B535
Person / Time
Site:	Summer
Issue date:	02/26/2018
From:	NRC/RGN-II
To:	South Carolina Electric & Gas Co
References
Download: ML18057B535 (118)

See also: IR 05000395/2011301

Text

ES-30l Administrative Topics Outline Form ES-301-1

Facility: VC SUMMER Date of Examination: 9/12/2077

Examination Level (circle one): / SRO Operating Test Number:

Administrative Topic Type Describe activity to be performed

(see Note) Code*

RO/SRO Common

Conduct of Operations D JPA-081A Manual leak rate

(Al-a)

G2.1 .7 (4.4/4.7)Ability to evaluate plant performance and make

operational judgements based on operating

characteristics, reactor behavior, and instrument

interpretation.

Modify JPA-006 Reactivity management sheet

JPAOO6B

Conduct of Operations

.

M

(Al -b) G2.1 .43 (4.1/4.3) Ability to use procedures to determine the effects

on reactivity of plant changes, such as reactor

coolant system temperature, secondary plant,

fuel depletion, etc.

D JPA-025 Create tagout

Equipment Control (A2) G2.2.13 (4.1/4.3) Knowledge of tagging and clearance procedures

RO/SRO Common

M Modify JPA-083 Apply facility ALARA principles to an emergency

D

.-ialatIon -. +

\..onLro y-) situation in an area with a high dose rate and

airborne radiation

JPA-083A(R 1)

G2.3.12 (3.2/3.7) Knowledge of radiological safety principles

pertaining to licensed operator duties, such as containment entry

requirement, fuel handling responsibilities, access to locked high-

radiation areas, aligning filters, etc.

Not chosen for RO

Emergency Pan (A4)

NOTE: All items (5 total) are required for SROs.

• Type Codes & Criteria: (C)ontrol room

(D)irect from bank ( 3 for ROs; for SROs & RO retakes)

(N)ew or (M)odified from bank ( 1)

(P)revious 2 exams ( 1; randomly selected)

(S)imulator

NUREG-1021, Revision 9

F I IJ1\L_

ES-301 Administrative Topics Outline Form ES-301-1

JPM SUMMARY STATEMENTS

CONDUCT OF OPERATIONS (Al-a): Calculates leak rate using system data provided since

IPCS is out of service. Detects that unidentified leakage exceeds the TS limit.

CONDUCT OF OPERATIONS (Al-b): Completes OAP-l 00.6, Attachment IA, Reactivity

Control Parameters, consistent with the attachment included with this JPM. Tolerance will

generally only be given for rounding; however, each case must be evaluated on an individual

basis.

EQUIPMENT CONTROL (A2): B MDEFP is tagged out lAW SAP-201. The suction and

discharge valves are tagged closed, pump casing drains and vents are tagged open, the motor

is tagged out, and the correct sequence is identified for tagging.

RADIATION CONTROL (A3): Compare two options to conduct work in a high radiation area

with airborne activity due to a LOCA outside of containment.

EMERGENCY PLAN (A4): Not selected for RO exam

NUREG-1021, Revision 9 F I [%J,t\[..

ES-301 Administrative Topics Outline Form ES-301 -1

Facility: VC SUMMER Date of Examination: 9/12/2011

Examination Level (circle one): RD I ISROI Operating Test Number:

Administrative Topic Type Describe activity to be performed

(see Note) Code*

ROISRO Common

. JPA-081A Manual leak rate

Conduct of Operations D G2.1 .7 (4.4/4.7) Ability to evaluate plant performance and make

(Al -a) operational judgements based on operating

characteristics, reactor behavior, and instrument

interpretation.

JPA-009 Shift manning.

. G2.1 .5 (2.9*/3.9) Ability to use procedures related to shift staffing

Conduct of Operations D such as minimum crew complement, overtime

(Al -b) limitations, etc.

JPA-025A REVIEW TAGOUT FOR B MDEFP

. G2.2.13 (4.1/4.3) Knowledge of tagging and clearance procedures

Equipment Control (A2) M

RO/SRO Common

. . Modify JPA-083 Apply facility ALARA principles to an emergency

Radiation Control (A3) M situation in an area with a high dose rate and

airborne radiation

JPA-083A(R 1)

G2.3.12 (3.2/3.7) Knowledge of radiological safety principles

pertaining to licensed operator duties, such as

containment entry requirement, fuel handling

responsibilities, access to locked high-radiation

areas,_aligning_filters,_etc.

JPA-020 Given a set of conditions determines the EAL.

G2.4.41 (2.9/4.6): Knowledge of the emergency action level

Emergency Plan (A4) D thresholds and classifications.

NOTE: All items (5 total) are required for SROs.

• Type Codes & Criteria: (C)ontrol room

(D)irect from bank ( 3 for ROs; 4 for SROs & RO retakes)

(N)ew or (M)odified from bank ( 1)

(P)revious 2 exams ( 1; randomly selected)

(S) im ulator

FINAL

NUREG-1021, Revision 9

ES-301 Administrative Topics Outline Form ES-301-1

JPM SUMMARY STATEMENTS

CONDUCT OF OPERATIONS (Al-a): Calculates leak rate using system data provided since

IPCS is out of service. Detects that unidentified leakage exceeds the TS limit.

CONDUCT OF OPERATIONS (Al-b): Determines actions necessary to maintain shift staffing.

Update JPM for new fatigue rule and EmpCenter

EQUIPMENT CONTROL (A2): Reviews a manual danger tag for errors. B MDEFP is tagged

out lAW SAP-201. The suction and discharge valves are tagged closed, pump casing drains

and vents are tagged open, the motor is tagged out, and the correct sequence is identified for

tagging.

RADIATION CONTROL (A3): Compare two options to conduct work in a high radiation area

with airborne activity due to a LOCA outside of containment.

EMERGENCY PLAN (A4): Event properly classified as a SITE AREA EMERGENCY due to a

Loss or Potential Loss of 2 (two) fission product barriers (RCS by D.2 or D.3 and Containment

by D.3 or D.4). This is a time critical JPM and the ENF form must be completed within 15

minutes after the emergency condition is determined.

NUREG-1021, Revision 9

FINAL

ES-301 Control Room/In-Plant Systems Outline Form ES-301 -2

Facility: VC Summer Date of Examination: 9/72/2011

-

Exam Level (circle one): (Ro)! SRO(l) I SRO(U) Operating Test No.:

Control Room Systems (8 for RO; 7 for SRO-l 2 or 3 for SRO-U)

ystem / JPM Title Type Code* Safety Function

APE 069 (JPSF-045B) Modify JPSF-045A A,M,S,EN

a 5

Ensure Containment Isolation (ED P-i .0)

b. System 015 (JPS-161) N,L,S 7

Block Source Range Hi Flux Trip (GOP-3)

c. APE 003 (JPSF-012A) A,D,S 1

Dropped Rod Recovery (AOP-403.6)

EPE011 (JPS-002A) D,S 2

Transfer to Hot Leg Recirculation (EOP-2.3)

e. EPE 038 (JPSF-007) A,D,S 3

Depressurize RCS to < Ruptured Steam Generator Pressure

(EOP-4.0)

f System 008 (JPS-042) D,S 8

Identify and Isolate an RCS Leak to the CCW System (ARP)

g E05 (JPS-149A) Modify JPS149 M,S 4S

Respond to steam generator overpressure (E0P-15.3)

h System 062 (JPSF-160) A,N,S 6

Respond to electrical grid issues fAOP-301.1)

hi-Plant Systems (3 for RO; 3 for SRO-l; 3 or 2 for SAC-U)

APE 068 (JPPF-049 for RO) A,D,E

.

4

Evacuation of control room (AOP-600.1)

APE 067 fJPP-205) D,E,R 6

Cross train connection of swing battery charger (FEP-2.0)

APE 025 (]PP-408) N,L,E,R 8

Align Spent Fuel Cooling Loop B to return Refueling Cavity water

to the RWST (AOP-1 15.4)

FINAL

NUREG-1021, Revision 9

ES-301 Control Room/In-Plant Systems OutHne Form ES-301-2

@ All control room (and in-plant) systems must be different and serve different safety functions; in-

plant systems and functions may overlap those tested in the control room.

Type Codes Criteria for: RO / SRO-l / SRO-U

(A)lternate path 4-6 / 4-6 / 2-3 5/NA/NA

(C)ontrol room

(D)irect from bank i 8I 4 6/NA/NA

(E)mergency or abnormal in-plant 1 / 1 / 1 3/NA/NA

(EN)gineered safety feature NA I NA / 1 (control room system)NA/NA/NA

(L)ow- Power 1 / 1 / 1 2/NA/NA

(N)ew or (M)odified from bank including 1 (A) 2/ 2I 1 5/NA/NA

(P)revious 2 exams / 3/ 2 (randomly selected) 0/NA/NA

(R)CA 1/1/1 2/NA/NA

(S)im ulator

VC SUMMER 2011 NRC JPM SUMMARY

a. Take actions to ensure containment isolation in accordance with EOP-1 .0, REACTOR

TRIP/SAFETY INJECTION ACTUATION, Attachment 3. The applicant will identify that

containment integrity is not intact. This leads to the alternate path for this JPM. The

applicant attempts to initiate a phase A or close valves from the MCB. One penetration

is isolated from the MCB. Another penetration will not close from the MCB and the

applicant sends a local operator to close a backup valve. This JPM will be modified from

one in the bank to change the valves involved and increase the number of valves.

b. Block Source Range Hi Flux Trip in accordance with GOP-3, REACTOR STARTUP

FROM HOT STANDBY TO STARTUP (MODE 3 TO MODE 2). The applicant will raise

power using rods from the source range up to io 3/4 power. On the power increase the

source range will be blocked before an automatic reactor trip occurs. This JPM is new.

c. Take actions to recover a dropped control rod in accordance with AOP-403.5,

DROPPED CONTROL ROD. The applicant will assume the shift with a dropped rod. On

recovery the rod will become stuck. When the candidate detects the stuck rod that rod

and a second rod will drop requiring a manual reactor trip. Both the stuck rod and the

second rod dropping makes this JPM alternate path.

d. Take actions to transfer from cold leg recirculation to hot leg recirculation in accordance

with EOP-2.3, TRANSFER TO HOT LEG RECIRCULATION. The applicant will assume

the shift with cold leg recirculation in service for 8 hours9.259259e-5 days <br />0.00222 hours <br />1.322751e-5 weeks <br />3.044e-6 months <br />. The applicant will transfer

from cold to hot leg recirculation without causing the charging pumps to be deadheaded

or run out. This JPM is not considered alternate path even though the right hand column

is used in the EOP because the right hand side will always be used to properly align the

C pump to the correct train.

e. Take actions to depressurize the RCS to less than the pressure of the ruptured steam

generator in accordance with EOP-4.0, STEAM GENERATOR TUBE RUPTURE. The

applicant will open the pressurizer spray valve to depressurize. On reaching a

termination setpoint the applicant will attempt to close the spray valve, but it will stick

NUREG-1021, Revision 9

F I FJ1\L_

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2

open. This leads to the alternate path for this JPM. In order to stop the

depressurization, the applicant will have to secure the A RCP.

f. Identify and isolate an RCS Leak to the CCW System in accordance with a radiation

monitor alarm. The applicant will verify that the COW surge tank vent valve closes.

Then the source of the leak will be determined to be the letdown heat exchanger. The

applicant will align excess letdown and secure normal letdown to secure the leak.

g. Take actions to respond to an overpressure condition in a steam generator in

accordance with EOP-1 5.3, RESPONSE TO LOSS OF NORMAL STEAM RELEASE

CAPABILITIES. An inadvertent main steam line isolation occurred. In addition, the

PORV for one of the steam generators fails to open. The applicant is directed to reduce

steam generator pressure. The applicant will detect which steam generator is affected.

The applicant will lower pressure using the condenser steam dumps by opening the

main steam isolation bypass valves. Modified from a JPM in the bank to place applicant

in EOP-15.3 instead of EOP-15.1.

h. Take actions to respond to electrical grid issues in accordance with AOP-301 .1,

RESPONSE TO ELECTRICAL GRID ISSUES. The applicant will monitor check to see

that a runback is not required. Then monitor turbine bearing vibrations and reactive

load. Finally will investigate the condition of 1 DA and 1 DB. This sets up the alternate

path for this JPM. 1 DB voltage will be too low and the applicant will start the emergency

diesel and have it tie on by opening the normal incoming breaker to 1 DB. This JPM is

new.

Take actions necessary after evacuation of the control room in accordance with AOP

600.1, CONTROL ROOM EVACUATION. Due to bomb threat the control room is

evacuated without any equipment tripped from the MCB. RO candidates will perform the

actions of the BOP. The alternate path for the RO is that the A RCP is tripped and so

either B or C RCP will have to be left running. The C RCP is also tripped so the

applicant must leave the B RCP running.

j. Take actions to cross-train the battery charger in accordance with FEP-2.0, TRAIN A

PLANT SHUTDOWN TO HOT STANDBY DUE TO FIRE, Enclosure K. The swing

battery charger will be aligned to cross-train AC power from A Train to DC power of B

Train to support equipment operation.

k. Take actions to align Spent Fuel Cooling Loop B to return Refueling Cavity water to the

RWST in accordance with AOP-1 15.4, LOSS OF RHR WHILE REFUELING, Attachment

I, REFUELING CAVITY LEVEL CONTROL WITH SPENT FUEL GATE IN. Applicant will

establish a return of water to the RWST so that spent fuel can be cooled and level can

be controlled in the refueling cavity as RHR is returned to service. This is a new JPM.

NUREG-1021, Revision 9

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2

Facility: VC Summer Date of Examination: 911212011

Exam Level (circle one): RD / SRO(l)(Oj) Operating Test No.:

Control Room Systems (8 for RO; 7 for SRO-l 2 or 3 for SRO-U)

ytem I JPM Title Type Code* Safety Function

APE 069 (JPSF-045B) Modify A,MS,EN 5

Ensure containment isolation (ED P-i .0)

b. Systemol5(JPS-161) N,L,S 7

Block Source Range Hi Flux Trip (GOP-3)

C.

d.

e.

f.

g.

h.

In-Plant Systems (3 for RO; 3 for SRO-l; 3 or 2 for SRO-U)

APE 068 (JPPF-044 for SRO) AD,E 4

Evacuation of control room (AOP-600. 1)

APE 067 (]PP-205) D,E,R 6

Cross train connection of swing battery charger (FEP-2.0)

k APE 025 (JPP-408) N,L,E,R 8

Align Spent Fuel Cooling Loop B to return Refueling Cavity water

to the RWST (AOP-1 15.4)

NUREG-1021, Revision 9

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2

@ All control room (and in-plant) systems must be different and serve different safety functions; in-

plant systems and functions may overlap those tested in the control room.

Type Codes Criteria for: RO I SRO-I I SRO-U

(A)lternate path 4-6 / 4-6 I 2-3 NNNN2

(C)ontrol room

(D)irect from bank 9 / 8/ 4 NNNN2

(E)mergency or abnormal in-plant 1 I 1 1 1 NNNN3

(EN)gineered safety feature NA / NA I 1 (control room system) NNNN1

(L)ow-Power 1 I 1 I 1 NNNN2

(N)ew or (M)odified from bank including 1(A) 2/ 2/ 1 NNNN3

(P)revious 2 exams 3 I 3 / 2 (randomly selected) NA/NAb

(R)CA 1I1/1 NNNN2

(S)imulator

VC SUMMER 2011 NRC JPM SUMMARY

a. Take actions to ensure containment isolation in accordance with EOP-1 .0, REACTOR

TRIP/SAFETY INJECTION ACTUATION, Attachment 3. The applicant will identify that

containment integrity is not intact. This leads to the alternate path for this JPM. The

applicant attempts to initiate a phase A or close valves from the MCB. One penetration

is isolated from the MCB. Another penetration will not close from the MCB and the

applicant sends a local operator to close a backup valve. This JPM will be modified from

one in the bank to change the valves involved and increase the number of valves.

b. Block Source Range Hi Flux Trip in accordance with GOP-3, REACTOR STARTUP

FROM HOT STANDBY TO STARTUP (MODE 3 TO MODE 2). The applicant will raise

power using rods from the source range up to 1 0 % power. On the power increase the

source range will be blocked before an automatic reactor trip occurs. This JPM is new.

c. Not selected for SRO.

d. Not selected for SRO.

e. Not selected for SRO.

f. Not selected for SRO.

g. Not selected for SRO.

h. Not selected for SRO.

i. Take actions necessary after evacuation of the control room in accordance with AOP

600.1, CONTROL ROOM EVACUATION. Due to bomb threat the control room is

evacuated without any equipment tripped from the MCB. SRO candidates will perform

the actions of the CRS. The alternate path for the SRO is determining that emergency

boration is required due to two stuck rods.

j. Take actions to cross-train the battery charger in accordance with FEP-2.0, TRAIN A

PLANT SHUTDOWN TO HOT STANDBY DUE TO FIRE, Enclosure K. The swing

NUREG-1 021, Revision 9

ES-301 Control Room/In-Plant Systems Outline Form ES-301-2

battery charger will be aligned to cross-train AC power from A Train to DC power of B

Train to support equipment operation.

k. Take actions to align Spent Fuel Cooling Loop B to return Refueling Cavity water to the

RWST in accordance with AOP-1 15.4, LOSS OF RHR WHILE REFUELING, Attachment

I, REFUELING CAVITYLEVEL CONTROL WITH SPENTFUEL GATE IN. Applicant will

establish a return of water to the RWST so that spent fuel can be cooled and level can

be controlled in the refueling cavity as RHR is returned to service. This is a new JPM.

• • 1

NUREG-1 021, Revision 9

ES-401 Record of Rejected K/As Form ES-401 -4

Tier / Randomly Reason for Rejection

Group Selected K/A

ROs

1/2 000032AA2.03 Source range high voltage is never removed at VCS

(Gammametrics fission chamber NIS)

KA replaced with 000032AA2.06 for RO test

2/1 063 A2.01 Not able to write discriminating question at RO level since only

response to DC grounds in procedures is to have electrical

maintenance trouble shoot.

KA replaced with 063 A3.01 for RO test.

2/2 01 1 K4.03 Pressurizer level is not density compensated at VC Summer.

KA replaced with 01 1 K4.05 for RO test.

3 G2.4.39 No responsibilities of RO in emergency plan implementation.

KA replaced with G2.4.25 for RO test.

2/i 078K1.01 VC Summer has no specific system that is equivalent to sensor air.

KA replaced with 078K 1.03 for RO test.

SROs

1/2 000059 AA2.03 Not able to write an operationally relevant question that is

discriminating for an SRO.

KA replaced with 000059 AA 1.01 for SRO test.

2/2 028 G2.2.40 Hydrogen Recombiner was removed from Technical Specifications.

KA replaced with 02$ G 2.1.27 for SRO test.

2/2 086A2.01 Not able to write an operationally relevant question that is

discriminating for an SRO.

KA replaced with 002A2.04 for SRO test.

2/2 072A2.03 Not able to write an operationally relevant question that is

discriminating for an SRO.

KA replaced with 034K4.02 for SRO test.

e

ES4OI Written Examination Quality Checklist Form ES-401-6

Facility:

f

Date of Exam:

I tV2 1/) Exam Level: RO SRO

Initial

Item Description a b* c

1. Questions and answers are technically accurate and applicable to the facility.  ?

2. a. NRC K/As are referenced for all questions. p1

b. Facility learning objectives are referenced as available.

3. SRO questions are appropriate in accordance with Section D.2.d of ES-401

c

4. The sampling process was random and systematic (If more than 4 RO or 2 SRD questions

were repeated from the last 2 NRC licensing exams, consult the NRR CL program office).

5. Question duplication from the license screening/audit exam was controlled

as indicated below (check the item that applies) and appears appropriate:

the audit exam was systematically and randomly developed; or

the audit exam was completed before the license exam was started; or

the examinations were developed independently; or

the licensee certifies that there is no duplication; or

? other (explain)

6. Bank use meets limits (no more than 75 percent Bank Modified New

from the bank, at least 10 percent new, and the rest

q I LII

new or modified); enter the actual RO I SRO-only qr ,,

C/q] /

question distribution(s) at right. L4,z4I Oii (041 6

7. Between 50 and 60 percent of the questions on the RO Memory CIA

exam are written at the comprehension/ analysis level;

the SRO exam may exceed 60 percent if the randomly

selected K/As support the higher cognitive levels; enter

3/ s s,

f ai1

19

the actual RO I SRO question distribution(s) at right. 1 i/o ,52..,, Yi,

8. References/handouts provided do not give away answers

or aid in the elimination of distractors.

9. Question content conforms with specific KIA statements in the previously approved

examination outline and is appropriate for the tier to which they are assigned; Y h44

deviations are justified.

10. Question psychometric quality and format meet the guidelines in ES Appendix B.  ? 4

1 1. The exam contains the required number of one-point, multiple choice items;

the total is correct and agrees with the value on the cover sheet.

4+/-J

c

f

Printed.kJamI Sig ature Date

a. Author MIieiv 1 JQ/i/ii

b. Facility Reviewer() OeIk

c. NRC Chief Examiner (#) U4øIr.4 5 . L4----- toIt1)L4

d. NRC Regional Supervisor iA43CI+IL A-. c j__

Note: *

The facility reviewers initials/signature are not applicable for NRC-developed examinations.

1. Independent NRC reviewer initial items in Column c; chief examiner concurrence required.

ES-401, Page 29 of 33

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

VC SUMMER 2011-301 EXAM REVIEW

Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3. Check the appropriate box if a psychometric flaw is identified:

$ The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

$ The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).

$ The answer choices are a collection of unrelated true/false statements.

$ The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

$ One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

$ The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).

$ The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

$ The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

$ The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).

6. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

7. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

Generic Issues.

1. In the stem of the question, need to determine if a period is or is not going to be used in the bulleted area of the stem. Sometimes it is used and sometimes it is not. It does not

matter which one just do it one way or the other.

2. For the first few questions that use annunciator windows in the stem or distractors, these are not written the same. Some have the panel some have the panel and tile number,

we need to get that uniform.

3. Reference material assembled is insufficient for examination review, system diagrams are not provided, key ARPs and AOPs not provided. Appears that the littlest amount of

material was provided for the review to take place.

4. Add to those questions where necessary, applicable procedures being used to accomplish the appropriate tasks. This ensures validity of each question.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

E 004K4.07, Task Master ' question 4483

1. Distractor B is NOT plausible. In that, when does a single

failure cause the system to actuate unless there is some other

information provided in the stem to identify they have to think of

this. Need to change this distractor.

2. Characterized as Higher, this is a very low higher cognitive

question.

3. KA appears to match

Tuesday, October 04, 2011

1. Change provides values associated with the parameter

identified in the distractor.

2. Actual

Question

3. Using the values, in B and C make them more implausible.

still needs

HOW does the instrument failing HIGH, cause emergency

work.

makeup to occur? Actual have no relevance to the control

Could be a

system, so putting actual level does not help.

U.

1 F 2 X Recommendation:

1. Develop a 2 by 2 question using

2. The design feature of what happens on the failure and then

what operator actions are necessary to combat that failure.

• • Design feature of what happens, then operator actions to combat

the failure.

This question needs more work, it is still an E. Or potentially a U.

S Thursday, October 13, 2011

1. Added actual in each of the NEW 2/2 question.

2. SAT.

Satisfactory

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

012K6.03, New,

1. This question is kind of backwards logic, in that, it is you have to

think of it failed? Not sure if this is a good way to ask this.

2. Were there any issues with reading this question? Based on

evaluator review. Ask licensee.

3. Do we need names of each of these or are they required to

2 H 2 S know that form memory. The licensee states that they are

required to know this material.

4. Kind of simple.

5. KA appears to match

Thursday, October 13, 2011

1. No changes, operators are required to know the P numbers.

2. Still Sat.

011K4.03, Higher, New,

1. In distractor A, need to somehow identify the word NO, so the

applicants do not miss it. Bold, underline, dont care, pick one

use it the same throughout the test.

2. Would it be better to add to 1) that will eventually cause a

reactor trip? This may ensure that they have to evaluate the

entire cycle like the analysis identifies. . Ask licensee.

3. KA appears to match

3 H 3 S Tuesday, October 04, 2011

1. Still think in question number 1 that we bold an underline the

NO before operator, like no.

2. Otherwise ok.

Thursday, October 13, 2011

1. Made consistent with other questions.

2. Rearranged SERVE after ONLY, GL suggested.

3. Bolded in B and D, serve only

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

016A2.01, Modified, Higher, Modified question was not supplied with

package.

1. Not sure that the initial information in the stem has a real

meaning to answer the question. Other than it provides a

starting point. This can be removed from the stem.

E 2. The KA requires in the second part to use procedures, while this

is sort of the way about it, but it does not state what procedure

just the actions to accomplish the required. Is there a way to

add procedures in the second part rather than stating it in the

stem? Ask licensee.

3. Add the word the prior to the word failure in the stem of the

question. Just to clarify a little.

Tuesday, October 04, 2011

1. The question as changed still does not meet the KA, in that,

there is no procedure listed in the answer. This is awkward! .

2. Change the stem to read:

4 H 2 X

WOOTF identifies the Resistance Temperature Detector (RTD)

failure that would cause these indications and the appropriate

operator actions in accordance with AOP 304.3, Continuous

Control Ro Motion?

S 1. Remove the procedure from distracters A and B.

2. Add parenthesis around the A as in A for all

distracters since parenthesis are used in the initial

conditions. Make this a global change for all

questions.

This needs to be fixed before it is Satisfactory.

Thursday, October 13, 2011

1. Changed the second part to as if they had to enter the AOP or

not to and for rods in MANUAL.

Changes SAT.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

00005G2.1.31, New, Higher,

1. How is it known that the alarm provided is the one that comes in

FIRST? Was this run on the simulator to prove that it actually is

the first? Ask licensee.

2. Distractor C, P-12 is written differently here on this question

than it was written on Question # 2. Is there a reason why?

E Should they read the same and change # 2 or does this provide

information to help decide that on Question # 2 that the

distractor it appears is NOT correct for either. Discuss with

licensee.

3. KA while it is not a complete match, it appears to cover the

5 H 2-3 question fairly well. OK

4. Not sure if distractor is plausible. Need to ask another

examiner.

Tuesday, October 04, 2011

1. Why was the questions stem changed?

2. As the question appears the change is ok. Now a Sat question

S

Thursday, October 13, 2011

1. Changed the stem to be clearer. See question. WOOTF will be

received simultaneously with a feedwater isolation signal

actuation?

000007EK2.03, New, Higher,

1. The reference material identifies the annunciator to have an

E intermittent fast flash. This is significant difference from the

way the question is worded. Recommend that the essence of

these words be put in for the answer other distractors that use

the same wording, ie. Distractor B.

6 H/F 2-3 2. Do not agree this is higher level. The first part of the question is

memory, does a failure of the IR cause a rx trip. Also second

part of question, how does the alarm flash. Also could be

memory. Discuss with licensee.

S 3. KA appears to match.

Tuesday, October 04, 2011

1. Question was changed as requested, now satisfactory.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

Thursday, October 13, 2011

1. No further changes. Still satisfactory.

000032AA.2.03, Modified, Knowledge (Fundamental)?

1. Remove from stem the word choices it is redundant and not

necessary. The first sentence can read, in almost every case,

Which One of the following (WWOTF)..describes, indicates.

2. Modified question not supplied.

3. When were these new NIs installed? Was everyone in class

when they were changed out? Or are the ONLY individuals who

were around then were the SRO-Us? I would imagine that this

is the case. IF this is true, then the plausibility of the OLD

U

versus the NEW does not bode well for the plausibility.

4. The procedure provided actually states to verify AT and not

ABOVE as the question indicates. Could there be an issue with

distractor B, in that, this may be close to the P-6 interlock

(Source Range Permissive). Is this what we are looking at in

this question? Discuss with licensee.

7 F 2-3 X 5. KA appears to NOT match. The KA asks the expected values

of source range indication when high voltage is automatically

removed. This is for a LOSS of Source Range NI. Discuss with

licensee.

Tuesday, October 04, 2011

1. The question was entirely replaced with a new question.

2. The KA was changed at the request of the licensee. The NEW

KA is 000032AA2.06

3. Question matches KA,

4. Put a comma between EOP-12.0 and Monitoring Critical Safety

S Functions.

5. Otherwise, question appears to be Satisfactory.

Thursday, October 13, 2011

No further changes still ok,. Made minor changes to stem.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

000029EK2.06, New, Higher,

1. The question is kind of confusing, in that, the stem is asking

about minimum number of malfunctions that would cause a

failure of an automatic reactor trip during the situation

presented. Can this be worded a little differently? Is this like in

the answer that there are three malfunctions? This does not

E make any sense to me. .

2. How did the evaluators do?

3. What reference are you going to give? Not sure if it is only

going to be the print of the RTBs and bypass breakers and

emergency borate flow.

4. Is it necessary to have the emergency borate flow there?

8 H 3 5. KA appears to

Tuesday, October 04, 2011

1. This change removed the requirement for the use of a

reference.

2. Question as changed is satisfactory.

Thursday, October 13, 2011

S

1. Scott P identified an issue with this question. Will discuss this

on Friday.

Friday, October 14, 2011

SAT

010A4.01, Bank, Higher,

1. KA appears to match\

2. Question was used on Watts Bar last exam.

3. Not a hard question.

9 H 2-3 S Tuesday, October 04, 2011

1. Made a change to the IC, added statement for group 2 Backup

heaters. No reason was provided for the added statement.

Added

2. Appears to be Satisfactory

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

063K4.04, New, Fundamental,

1. THE KA does not match. This is almost the way it can be but it

is talking about DC power and Trips, this would be better to

identify what electrical trips are not available for the DG or only

the TRIPS associated with electrical. BUT they do not mean the

U

mechanical trips how to stop the DG. Loss of Electrical power

causes the loss of most trips which ones do not get bypassed.

The DG overspeed and the DG reverse power trip. This needs

to be corrected. Discuss with licensee.

Tuesday, October 04, 2011

2. Question was completely replaced.

3. The question asks what is the response of the EDG during the

loss of All A train DC power. Ask it this way! The question

asks the response, which would indicate something should

10 happen. However from the answer, nothing happens. It is

E

really asking what is the status of the EDG, running or tripped?

This is the way it should be asked, that status, not response.

4. To make it more valid, need to add what test is being done so

that the operator understands what the situation is with the

EDG. Can this be added to the initial conditions. ASK

LICENSEE.

5. Each distractor has a loss of DC power, it is already asked in

the stem, it is not necessary in each distractor. Remove the

statement due to a loss of DC power.

6. Same idea with second question, either there is or is not

protected.

Therefore re write the question to read

After the ICs

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

WOOTF describes a) the status of the EDG following the loss of DC

power and b). the protection 1DA has from the 51 overcurrent trip.

A.) a.) EDG will trip

b.) 1DA is protected by the 51 trips.

B.) a.) EG will trip

b.) 1DA is not protected by the 51 trips

C.) a.) EDG will remain running

b.) 1DA is protected by the 51 trips

D.) a.) EDG will remain running

b.) 1DA is not protected by the 51 trips

with this change it should be easier to read and will be Satisfactory.

S

Licensee please make this change to this question and ensure we still

have a valid question.

Basically the question is ok, just look at the above and note the changes

that will help shorten and make it easier to read for the applicants.

Thursday, October 13, 2011

1. needed to add words to the stem to identify closer what was

being asked.

2. Additionally, added output to the EDG breaker and the noun

name to the breaker to be clearer.

SAT

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

022K1.01, New, Fundamental,

1. KA appears to match

U if #2 is

2. Distractors B and D second part do not seem plausible. After

correct

reading the analysis it seems like they may be ok, but, I am

and OK

going to ask G. Laska, tomorrow to see how he feels about this

otherwise.

part of the distractor. It does not sit well with me, it seems to be

easy to eliminate them.

Tuesday, October 04, 2011

1. Second part of distracters C and D have been changed.

2. Are there vacuum relief valves on the return lines of the

RBCUs? This is a question I am not sure of. Need to ask the

11 F 2--3 licensee if this is a true statement or is it something made up.

E/U 3. This needs some more work to understand what is or is not

happening. IS there something like what is described in

distracters C and D available on any other system? Ask

licensee. If there is NO other system that has this kind of

vacuum relief valves then these distractors are unsat.

Friday, October 14, 2011

s 1. Question was replaced.

2. See new question as SAT

3. SAT

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

064K1.05, Higher, VCS Closed Bank

1. Remove reason for DG will not start from the Main Control

Room (MCR), faulty wiring. All they need to know is it will not

start from the MCR. Done

2. In the bulleted part, the A in the third bullet is not in quotes as it

is in the stem of the question. Write it one way or the other, I do

not care which method is used, just be consistent. Same for

distractor D with the A or just A.

E

3. The A distractor uses a period and the rest do not have periods,

be consistent within and all questions. Either way is ok with me.

4. KA appears to match

Wednesday, October 05, 2011

1. After reviewing this question again, the question asks if the EDG

will be prevented from coming up to speed. It does not say

start, it states come up to speed. This is key in understanding

2. The air start system ONLY provides air to turn the crankshaft to

12 H 2-3

allow the combustion cycle to start, thats what causes this to

come up to speed. The air system would not get the EDG to

operating speed.

3. If an operator ONLY depresses the air start system valve, does

this then start the EDG or does the operator have to place a

start signal to the circuit for the EDG to actually start? Was the

action that INITIALLY started the EDG that locked IN? SO did

S the DG have a start signal that would allow the DG to run after

the engine is turned over???? ASK LICENSEE. I am not sure

that this is clear and if it is, then the distractors may not be

plausible. DISCUSS.

4. ADD to the stem WOOTF . IAW AOP 304.3. Is this the

procedure

Friday, October 14, 2011

SATISFACTORY

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

W/E10EK3.4, BANK, VCS closed , higher

1. Is this abbreviation something the applicants would know,

E ESFLSs? Should we have it spelled out to begin with? Ask

Licensee.

2. Why in the stem do we NOT use the actual procedure the crew

would be in?

3. KA does it match? Well kind of. The KA speaks to adhered to

and the limitations in the facilitys license and amendments are

S not violated. This is not covered in this question. Discuss with

13 H 2-3 4. licensee. Need to have another examiner review for KA match.

Wednesday, October 05, 2011

1. The question as changed appears to be ok.

2. No further changes warranted.

Friday, October 14, 2011

S

Minor changes from validation comments, see exam for changes.

ADDED MINIMUM in the stem

SAT.

000057AA.2.12, MOD, VCS Closed, Higher.

1. APN-5901 thru 5904, what is the noun name of that bus? Is

there any?

2. Are operators expected to know this information from memory?

3. Is 5902 channel II?

4. Low level higher question, really is memory, how if not

memorized anyone would know this.

Wednesday, October 05, 2011

14 H 2 S 1. Question Matches KA

2. Why not add the high PZRP level alarm annunciator alarm that

should come in also? Ask if this does come in and add it if it

does. Discuss with licensee. Minor enhancement, but it would

make the question more technically correct.

3. Other than that, it is appears to be ok.

Friday, October 14, 2011

1. Added appropriate alarms that came in, as asked.

2. SATISFACTORY.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

064A3.03, New, Higher,

1. Is there a noun name for XTF-31? If so, add it to the stem.

2. Distractors C and D, second part are NOT plausible. The

operator applicants all have observed DG starts and know that

there is not a cycling of the frequency as described. Something

better has to be used. The way this is it is not plausible. This is

U describing sequencing. Lets just say that. Frequency

fluctuates as the load sequencer sequences.

3. The analysis does not describe the function of XTF-31 or where

to find information about it. No reference identified.

4. The stem is difficult to read. Which choice below identifies the

following with regard to.. With regard to the A DG response,

which one of the following (WOOTF). May read better.

15 H 2 X

Use recommendation above. Should be a S then.

U Wednesday, October 05, 2011

1. None of the suggestions were used.

2. Answer D is another correct answer. This makes the question

unsat.

3. D has to be changed to make this question sat. Discuss with

licensee.

S

Friday, October 14, 2011

1. SAT SEE EXAM CHANGES.

063A2.01, New, Lower,

1. The questions KA was replaced with 063A3.01. This should be

E/S in the header of the question. Replace 2.01 with 3.01 in the

16 F 2 X header. Otherwise, it does not make sense for the question.

2. It states Local indication, is there no location where battery

voltage can be observed? This is not clear and should ensure

this is not another provable answer. Discuss with licensee.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

3. KA appears to match.

Wednesday, October 05, 2011

1. Licensee identifies there is a LOCAL battery meter, provides a

U reference, reference was not submitted to identify that there are

local battery meters. Are there 126 v and 108 v system local

meters.

2. Licensee states that the procedure means in the reference

monitor Batter Bus Voltage throughout this procedure implies

the MCB. If this is the case WHY would anyone select LOCAL

for reading the battery bus voltage? Why is it plausible? With

this new information, distractors B and C are NOT plausible.

Discuss with licensee. This makes this question UNSAT.

S

Friday, October 14, 2011

CHANGES SAT

062A2.01, Bank, Higher,

1. Add to the stem the procedure they would actually be in.

E 2. Why is it necessary to add on low flow in both A and B. This is

not necessary and can be deleted.

3. Why is it necessary for the 1 minute time after the event?

Discuss with licensee.

4. KA appears to match.

S Wednesday, October 05, 2011

17 H 2-3

1. ADD to the question the procedure, SOP-XX the crew would be

in, in addition, to the GOP. Is there another one to parallel the

MTG?

2. Question modified as requested, appears to be SAT.

S Friday, October 14, 2011

1. SAT NO CHANGES MADE.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

045 G2.4.3, Bank, Higher.

1. Add noun name for 1A1X. This may or may not be necessary

2. KA appears to almost match. This is a borderline analysis.

3. The questions KA discusses use of annunciator alarms,

indications or procedure response. The question uses a ARP

that came in based on loss of a power supply. The correct

answer analysis uses the AOP. The answer to the question

does not use a procedure but identifies how the system works.

S The question barely matches the KA. Discuss with licensee.

4. The manual adjustment of the field provides the reason for the

first part of the question. This really has nothing to do with the

procedure. What is the response procedure we are answering

in this question? Discuss with licensee

Wednesday, October 05, 2011

1. Why was the question changed from the loss of 1A1X to the

Regulator Core Alarm? This was not suggested in the above?

Discuss with licensee! SO IT WAS CLOSER TO KA

2. The new question provides information as to why the

18 H 2-3 annunciator came in. AND provides the ARP correct actions to

address this event. The skill set is different for answering this

question than for the first question.

3. The first part of each distractor should have the words load

will vary, with either load will increase, or load will

decrease. This will then make the question more operationally

valid. What will have happen to the reactive or real load.

Basically, as it sits the operator does not have to know what the

action taken will do.

S 4. Additionally, the second part of the question has to be re-written

to the following: AND based on a over temperature condition

how the Main Generator Voltage Regulator will respond.

Currently, the question does not really identify that the condition

is higher than the information provided in the IC.

Recommendations:

If the above are followed the question will be considered SAT.

Friday, October 14, 2011

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

MADE CHANGES TO THE QUESTION. See changes on exam

SATISFACTORY.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

026K2.01, New, Higher,

1. I do not understand why the 480 v bus is a plausible distractor.

I understand what is written, however, I do not understand why

that is plausible.

2. The analysis does not explain the function of the XCP-639 point

6-4 BUS 1DX LCKOUT 86 B. The ARP was not provided. It

should have been.

3. Does the Reactor building Spray pump get any control power

from the 480V bus? Does the 480 V bus 1DA1 bus get

E powered from the 7.2KV Bus 1DA.

4. No information provided about the lockout

5. KA appears to match.

Wednesday, October 05, 2011

1. The question stem was changed from the submittal. The

information asked for is in a different order than those of the

answers. The question stem asks for the location of the breaker

and the ultimate power supply. The distractors answer the

19 H 3 power supply and then where power comes from. The question

does NOT elicit the answers. Again, stem asks for the

LOCATION of breaker and answers identify From power supply,

ie from offsite power, from the A EDG. Doesnt Location mean

the BUS it is on, 1DA, on or the building it bus sits in. This now

makes this question UNSAT.

2. I still do not believe that the 480 V bus is plausible. Discuss

directly with licensee to understand why anyone would select A

or B and that a Safety Related Motor would be ONLY 480 volts.

While this was characterized as an E, it initially should have

been characterized as a U. Regardless, of the characterization

U the question has two distractors that have been determined as

implausible and therefore is UNSAT. The licensee did not

provide a good reason why the less than competent operator

would select a pump that is safety related and is powered from

the 480V power supply.

3. IS 1 EA powered in this instance with 1 DA? What is the

voltage of 1EA1 bus? Discuss if either of these buses are

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

plausible under the plant conditions listed in the IC.

Monday, October 17, 2011

1. #2 1DA is ok as a distractor because the rhr and spray pumps

are in the same room, however, they are powered from different

buses.

Question is sat.

S

001K2.01,Modified, Higher,

1. KA appears to match

2. So 1DA2 and 1DB2 are safeguards buses? I dont understand

E

why these are plausible! It seems like we are comparing apples

and oranges, in that, one is 7200v and the other is 480v.

Discuss with licensee

3. Need to understand why those in 2 are plausible.

Wednesday, October 05, 2011

1. Why was the power supplies identified at the next lower voltage

20 H 2-3 U power? Why not use buses 1B3 and 1C2 as the alternate

answers for distractors B and D? Discuss with licensee.

2. Why is the above not as good or better answer than 1A3X and

1C3X?

3. Question has two implausible distractors B and D, this is the

same type of argument identified in question 19 using different

power supplies one being a lower voltage than the other.

S

Monday, October 17, 2011

1. Used the suggestion above, as 480 switch gear.

2. SAT

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

000055EA2.06. New, Knowledge,

1. No reference diagram for power line up. Discussed in the

E/S analysis of the answer but that is hard if not impossible to

understand without a diagram.

2. Does the conditions of the stem put the plant in a Station

Blackout? Not sure it does. Ask licensee.

3. The KA talks about clearing an item to allow re-energization.

The question concerns itself with preventing closing. Its a little

21 F 3 X difference but it is not the KA requirements. Discuss with

licensee.

4. Have licensee explain this question with references.

S

Wednesday, October 05, 2011

1. Question is OK as it is. No further changes necessary.

Monday, October 17, 2011

1. Sat

0000056AK3.02, New, Knowledge,

1. KA appears to match

2. Distractors A and B do not make sense, in that, placing the

Service Water pumps in PTL, Pull to Lock, does not make

U sense to remove the cooling medium for the EDGs.

3. The second part of B and D are not plausible to me. To

immediately provide a heat sink for CCW. This does not seem

plausible. The system being without power, CCW that is, has

no ability to cool anything, no heat transfer is being

22 F 2-3 X accomplished, so when power comes back the heat load on

CCW should be low, so an IMMEDIATE requirement will not

appeal to any of the applicants. This needs to be changed.

4. Fix both sets of concerns.

U Wednesday, October 05, 2011

1. First issue was corrected, however, now we have numerous

reasons for doing this. Why only 2 in the 2 by 2 format.

2. Second part of B is still not plausible. Needs to be fixed.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

3. Second part of second part of D needs to be replaced. Not

plausible.

4. Use second part of C in B and then use the second part of A in

D. Then it will be sat until fixed remains unsat.

Monday, October 17, 2011

S

1. Followed the above suggestion.

2. Changed the order of distractors to have them look like the

other questions.

3. Also changed the loss

SAT

071A1.06, Modified, Knowledge,

1. In the stem, separate the wind direction from the speed. Make

wind speed a separate bullet.

2. IS there a reason why the procedure that is governing the

release is not being identified? I think it should be in the stem.

3. What is actually going to be provided to the applicants for the

reference? Is it just the SOP-119, Table A? IF so the reference

23 F 2 S should be ok to be provided.

4. Original question not provided.

5. KA appears to match.

Wednesday, October 05, 2011

1. Question changed as requested, question SAT.

Monday, October 17, 2011

1. SAT

039A1.05, New, Knowledge,

1. KA speaks to Main and Reheat Steam and ability to predict and

or monitor changes in Tave (without exceeding design limits)

associated with operating the MRSS controls. What is the

24 F 2 X U design limit in this question? Could use the 547 and 543 to

make it a 2 by 2, but as it sits it does not match.

2. Distractor C does not appear to be plausible due to system

alignment.

3. Also distractor D does not seem plausible because this is

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

something that is done for Every Reactor trip.

4. The main issue with the question is that it does not prevent

exceeding the limit. How is this tested with current question?

This needs to be changed to match the KA Ask Licensee.

Wednesday, October 05, 2011

1. KA match addressed. Appears to match now.

2. Change stem to add WOOTF based on the conditions

S provided(this is a minor change to the modified question).

3. Question as changed is satisfactory.

Monday, October 17, 2011

1. Used above # 2.

2. Added 1 and 2 in stem added to the distractors.

3. Reworded the stem.

4. SAT

061K6.02, Bank, Knowledge

1. Simple1 line diagram not provided. Cannot validate where

valves are wrt the other valves. Dont have time to look up

E every system.

2. KA appears to match

3. Is there a flow rate even associated with FCV 3546? Why

would anyone think this valve has a runout feature also? Ask

Licenee.

4. The stem is too wordy. WOOTF completes the following

25 F 2-3 statement? Which one of the following .. Thats all that is

necessary.

Wednesday, October 05, 2011

S 1. Question changed as requested.

2. Only one minor change, should the word RUNOUT be

identified in quotes as identified above? Not necessary but

want to ensure that the applicants do not miss this word.

3. Otherwise appears to be satisfactory

Monday, October 17, 2011

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

Changed minor, see exam.

Sat.

078K1.01, Bank, Knowledge

1. This KA was changed to have 1.03 vice 1.01, need to change

the header to reflect this when exam is built.

2. KA appears to match

26 F 2-3 S

Wednesday, October 05, 2011

1. Changed as requested, still satisfactory.

U 000026AK3.02, New, Knowledge,

1. KA appears to match.

2. Distractors C and D, first part are not plausible. This makes this

questions unsat. We need to come up with something that

makes this question more plausible. Maximize the flow to the

RHR heat exchangers is not plausible. This is a basic system

knowledge to know that CCW flow would not increase during

the injection phase of an accident. This does not make sense

why anyone would pick this. How did the validation fare? Did

27 F 2 X anyone choose this? Need to replace this with something more

plausible.

Wednesday, October 05, 2011

1. Change to question appears to be a better choice, question is

now considered satisfactory.

S

Monday, October 17, 2011

1. Made minor changes.

2. SAT

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

073K3.01, New, Knowledge.

1. KA appears to match.

2. Distractors B and D, need to separate the other Valve and write

it like, A & B. The way it is written is like the procedure and you

E could choose either valve. This does not work for that and

needs to be separated.

3. How about swapping the second line in A and C and start with

the word ONLY. This will be consistent with B and C where

28 F 2-3 BOTH starts them off. Discuss with Licensee.

4. What is the difference between XPB and PVB, are they

considered the same? Explain.

Wednesday, October 05, 2011

1. ALL comments addressed

S 2. Question is considered satisfactory

Monday, October 17, 2011

1. SAT NO changes.

2.3.11, Bank, Higher.

1. Need to add to the stem the procedure the release is being

E done under.

2. It seems that there are a LOT of As for answers, we need to

look at the end of the exam and determine if we have too many

one or the other.

3. Add another time prior to the answer and make the answer B,

something like 0300 on 10/3.

29 H 2-3

Wednesday, October 05, 2011

1. Do not understand the comment in the second submittal. I Still

want to add some time prior to 10/06 at 2330 that will be wrong

E and will make answer B be the correct answer. There are WAY

to many As or add two times and make the answer C. Either

way, I would like to have an answer other than A.

2. Still E, until discussed with licensee.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

Monday, October 17, 2011

1. Changed to 0300 on 10/6.

2. Bolded and highlighted without in the stem.

S 3. Added additional quotes around tank letters and capitalized

Tank and Decay. See exam for the comments.

4. SAT.

103K4.04, New, Knowledge

E 1. KA appears to match.

2. Change door to airlock

Wednesday, October 05, 2011

1. Understand requirements for airlock and airlock door or doors,

30 F 2 however, do not understand both AIRLOCKS vent valves. Have

licensee explain this concept.

S 2. Otherwise appears to be Satisfactory.

Monday, October 17, 2011

1. Sat no changes.

022A4.02, Bank,Higher

S

1. KA appears to match.

2. Is the 2000 gpm minimum flow rate knowledge that the

operators are expected to memorize?

Wednesday, October 05, 2011

1. Comment, the word MINIMUM does not follow the convention

31 F 2 used to identify other like aspects of what it is being identified.

For example, it seems that it should be small letters with bolding

S and underlining minimum

2. Otherwise appears to be satisfactory.

Monday, October 17, 2011

1. Made minor changes. See exam.

2. SAT

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

008A1.001,New,Knowledge

1. KA appears to match.

E 2. The stem of the first part of the question answers the second

part. You open the header when flow reaches the band.

Therefore, B and D distracters are not plausible.

32 F 2 x Wednesday, October 05, 2011

1. Understand issue with typo in the stem.

2. Question appears to be satisfactory.

S Monday, October 17, 2011

1. Sat as changed

2. Minor changes see exam.

028AK2.03,Bank, Higher

1. KA does not match. Not pressurizer level malfunction.

2. A flow control valve that supplies a fluid to the system would

never throttle closed in response to a low level signal.

Distracters A and D are not plausible.

RSB

U

Agree this question is unsat, it does not match the ka, it does cover

controllers and positioners however, it does not cover anything with the

Pressurizer Level malfunction. While this covers level control it does not

match the intent of the KA.

33 H 2 x X

Wednesday, October 05, 2011

1. Disagree with KA match, the question concerns itself with

U

charging flow now Pressurizer LEVEL malfunctions. Discuss

with M Meeks to get his view on this analysis. Until this is done,

this question remains unsatisfactory.

Monday, October 17, 2011

1. New question has teaching in it. This is a failure of the

U? Controlling PZR level control

2. This may need to be run on the simulator to see how long

3. THIS QUESTION IS NOT CONSIDERED SAT TILL THIS IS

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

RUN ON THE TABLE TOP SIMULATOR.

S 004A2.09, New, Knowledge

1. KA appears to match.

Wednesday, October 05, 2011

1. No changes, still satisfactory

34 F 3

S

007G2.4.18, New, Knowledge

1. KA appears to match. .

2. Distracters C. and D. are trivial during an EOP. If you have a

E valid safety injection, the operator is not going to be concerned

about breaking or potentially breaking the rupture disks.

RSB

35 F 2 X This question distractors C and D are not plausible. Above states exactly

why would anyone think that there was a reason to vent to the PRT during

a LOCA and SI. This does not make sense at all. Additionally, this would

make this question evaluation UNSAT since both C and D would be

considered not plausible.

S

Wednesday, October 05, 2011

1. Initially should have been analyzed as Unsatisfactory because it

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

had two distractors that were not plausible.

2. Changed C only, appears to be ok.

3. Question appears to be satisfactory.

Minor issue, change answer so that A is NOT the correct answer. Re

arrange to make C the correct answer to better distribute the answers

across A B and C and D.

Monday, October 17, 2011

1. CHANGED AS REQUESTED. `

006A3.01, Bank, Higher

1. KA appears to match.

Wednesday October 5, 2011

1. Can third bullet be deleted? Based on Appendix E brief,

applicant should understand that automatic actions occurred

unless explicitly given otherwise.

2. Verify with licensee shutoff head of RHR pumpsdistractor

36 H 2 S analysis states that 350 psig is in RHR pressure band for decay

heat removal.

3. Recommend adding Based on the given plant conditions to the

question statement to be clear to applicant about time frame of

questionbecause if time keeps moving, answer choice C will

also be correct. Q statement could say Based on the plant

conditions as given, which ONE (1) of the following.

Friday, October 14, 2011

1. Licensee implemented the suggestions above.

2. Question is still SAT.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

036AA2.03, Bank, Higher

1. KA appears to match. .

2. Distracters C. and D. do not appear to be very plausible

considering the short time frame involved. Answer C might be

improved by being in a lowered inventory status. Answers D.

and C. are similar in that youre trying to imply fuel damage due

E to inadequate cooling. Perhaps the 4th option could have

something to do with dry storage.

Wednesday, October 05, 2011

1. Distractor B is not plausible. Applicant can easily differentiate

between dropping a spent fuel assembly that has been

37 H 2 X irradiated for hundreds of days vs. dropping a brand new fuel

assembly that hasnt been in the reactor core.

2. Can distractor D be a correct answer? Ref. lesson plan GS-05

fig. GS5.3 flowpath from 6669 to 6674 to 6681 to SFP

purification pump to 6691 to RWST. What is the maximum

radiation field given whatever will be the height of spent fuel

pool water above the 6669 valve siphon?

S 3. We dont need any information above the WOOTF statement

can be deleted.

Friday, October 14, 2011

1. Verified that D is NOT the answer.

2. Changed B, validation

012K5.01, New Higher

38 H 2 S 1. KA appears to match.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

Wednesday, October 05, 2011

E

1. Need to bound the time frame that the question is askingfor

example, 5 seconds? 10 seconds? after the spray valve is open

and before the reactor trips.

2. Also need to mention before any operator action?

Friday, October 14, 2011

S 1. Made the question easier to read and identified the 1 and 2 in

stem and each distractor.

2. Added Assume no operator action.

07A4.10, Modified, Higher

1. KA appears to match.

2. GFE type question.

S 3. PRT Temperature is not required.

4. If the Pressurizer Code Safety is leaking, which ONE (1) of the

following is the expected temperature as read on TI-465 (Use

Noun Name)?

39 H 3

Wednesday, October 05, 2011

1. Check the correct answerusing steam tables and interpolation

E should correct answer be 267 degrees F, not 260?

2. Delete first and second bullets as unnecessary?

3. Need to add approximate to the temperatures because some

people will use Mollier diagram and some will interpolate, etc..

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

For example, change Q statement to read as follows: If a

Pressurizer Code Safety valve is leaking, which ONE (1) of the

following is the expected approximate temperature as read.

4. Distractor D is not plausiblerecommend to come up with

another wrong way to calculate an answer in the 200s range of

temperatures. Having a single distractor 327 degrees F too big

from three other answers is hard to believe.

S

Friday, October 14, 2011

1. Changed this as suggested.

2. SAT

SAT

005 K6.03, Modified, Higher

1. Sort of matches KA.

2. Distracter D is weak. Why would anyone assume that the

temperature recorder measured HX outlet only.

Wednesday, October 05, 2011

40 H 2 X S

1. K/A match is weak, willing to accept.

2. Q is OK as written.

Friday, October 14, 2011

1. No changes. Ok as is.

041 K1.02, Modified, Higher

1. KA appears to match.

41 H 2-3 S

Wednesday, October 05, 2011

1. Need to add that steam dumps are controlling in automatic

pressure mode to second bullet? Implied by correct answer but

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

not completely stated. added

2. Inserting control rods is not plausible. In the power range

control rods ultimately control Tavg not reactor power. Every

other choice involves a manipulation of the secondary system.

Potential recommendation: Raising the setpoint on the STM

E DUMP CNTRL potentiometer (clock).

3. Is it necessary to add potentially to the question statement?

i.e. Which ONE (1) of the following actions would potentially

cause a swell in S/G level? I.e. what are effects of FRV

operation, etc.

4. Need to provide current Tavg value in Q stem to make distractor

A. more plausible (i.e. would actual Tavg be greater than 5

degrees higher than no load, which would lead someone to

erroneously believe the steam dumps would open in Tavg

mode?)

S Friday, October 14, 2011

1. Changed as selected, see exam for changes.

2. SAT

SAT

035 K6.01, Modified, Highe

r

S 1. KA appears to match.

2. Correct answer uses similar thought process to 41.

Wednesday, October 05, 2011

42 H 2-3

1. GFE question that examines same conceptsshrink vs. swell

as 41. Low discriminatory value/no tie to plant-specific

E knowledge.

2. Change distractor C. to Steam Generator B narrow range

level will decrease for parallelism with distractor B?

3. How is this question operationally valid? If the reactor should

trip on an inadvertent MSIV closure, and it does not, operators

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

are in an ATWS/FR-S.1 situation and steam generator

parameters are irrelevant.

4. Potential double jeopardy with previous Q (#40)applicant

could potentially get two Q wrong if applicant has a

misconception of shrink and swell phenomena.

S Friday, October 14, 2011

1. Completely new question to avoid double jeopardy with steam

dumps. In 41.

SATISFACTORY

003 K5.04, New, Higher

1. KA appears to match.

2. Not very discriminative. Just a GFE question.

S

Thursday, October 06, 2011

43 H 2 1. How is it plausible to have higher steam flows with no change in

steam generator pressure, or to have higher steam generator

pressures with no change in steam flows? Need to discuss with

s licensee, may be o.k. if validators missed?

Friday, October 14, 2011

1. sat

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

002 2.3.13, Modified, Knowledge

1. KA appears to match.

2. B and D are not plausible. Operators do not carry rad monitors.

3. Specifically identify the procedure in which these requirements

exist.

RSB

S The plausibility of B and D needs to be fixed. Operators do not normally

use rad monitors themselves. Do they use them at Summer? I doubt it,

see what we can do to identify a more plausible distractor.

Wednesday, October 05, 2011

1. DISAGREE with licensee concerning that the second part of

distractors B and D are plausible.

44 F 2 X 2. NORMALLY the individual does NOT have the radiation

monitoring device. The procedure does not allow an individual

go to by them self.

Change B and D to read: Must be accompanied by another operator who

radiation monitor qualified with a radiation monitor.

3. How is 500 rads/hr plausible? How many system restoration

valve lineups (i.e. normal ops) take place in a room posted with

500 rad/hr fields?

Friday, October 14, 2011

1. CHANGED as requested.

2. The change has generic terminology concerning rad qualified.

Need to change that

3. Removed 500 rads

SATISFACTORY

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

001 2.1.31, Bank, Knowledge

KA does not match. KA discusses the ability to locate CR

switches and indications and determine if they correctly reflect

the desired plan lineup.

Wednesday, October 05, 2011

U 1. Question was replaced,

2. KA appears to match

3. With two protection channels failed high, you would not be in a

3.0.3 shutdown, the reactor would automatically trip. Question

as written is not operationally valid. In either case (whether the

Rx trips or not), what procedure would specifically direct

operation of PORV PCV-444B (i.e. to ensure a single correct

answer)?

4. Recommend adding both to first bullet: have both failed

45 F 2 X high.

5. There are multiple switches on the CREP panelone is the

isolation switch and one is the switch to position the

valve/component. If Q is salvageable, the Q statement needs to

reflect this. Recommend: Which ONE (1) of the following

describes the location of the switch (or switches) that will be

used to control Pressurizer PORV PCV-444B and the correct

position of that switch (or switches), in accordance with AOP-??

S  ?

6. As written distractor A. is potentially correct, because those

should be the at-power positions of the switches at the CREP.

7. Question is still U due to operational validity issues.

Friday, October 14, 2011

1. NEW Question

2. See exam for changes.

3. SAT

003 2.1.2, Modified, Knowledge

46 F 2 S KA appears to match.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

Thursday, October 06, 2011

1. Recommend changing word ones to operators in the Q

statement, would say The NROATC and the CRS are the only

S operators present in the Control Room.

2. Otherwise Q looks SAT.

Friday, October 14, 2011

1. SAT

003 2.1.29, Bank, Knowledge

1. Need to discuss if KA matches. If it matches question is SAT.

S or U Wednesday, October 05, 2011

1. This question does NOT match the KA. Just because you ask

the question associated with Component/Condition Verification ,

SAP 153, it does not match the KA. The question asked is

more of a radiation question.

2. Ideas for questions associated with this KA, red tag procedure,

U locked valve procedure, expectations associated with second

47 F 2 X person verification.

3. WHY should an RO know this from recognizing this value? One

could possibly identify that this is an SRO only knowledge.

It would be better to rewrite this question and hit the KA better associated

with valve line up.

S Friday, October 14, 2011

1. New question,

2. Changed what was proposed.

3. SAT

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

003 2.4.25, Modified, Knowledge

1. KA appears to match.

2. KA importance rating for 2.4.25 is only 3.3.

S

Wednesday, October 05, 2011

1. Unsure as to WHY this question changed from the initial

submittal.

2. UPON Further review, this question is considered UNSAT.

When in ANY procedures does the RO/SRO/BOP operate

U DISCONNECT SWITCHES as Immediate operator actions.

3. Changes made in green (2nd part of distractors) look o.k. and

are plausible given AOP-600.1 knowledge of the RO in-plant

JPM i (where leaving one RCP running was a critical step).

The issue with the Q is that tripping the Reactor is such a strong

correct choice as an immediate operator action that it may be

hard to develop a second choice that is technically incorrect

48 F 2-3 (when viewed against Rx trip) and plausible.

4. K/A covers all aspects of fire protection procedures, does not

necessarily need to cover immediate actions of FEP-4.0.

5. Q is U due to two non-plausible distractors.

Friday, October 14, 2011

1. Chose to use disconnects for IPV-445a and b and C. BOP does

not trip the reactor. Rx trip is a duty of the RO. \

2. Changes are sat

S 3. Question is sat

SAT

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

003 2.4.34, Modified, Knowledge

E

1. KA does NOT fully match. Need to discuss tasks AND

resultant operational effects.

Thursday, October 06, 2011

1. K/A is now met with the changes as made.

49 F 2-3 X 2. Q now looks SAT.

S

Friday, October 14, 2011

SATISFACTORY.

086 K3.01, Modified, Knowledge

1. KA appears to match.

2. Supplied documentation does not fully support basis for correct

answer or distracters. Distracters appear valid based on limited

S

documentation.

Thursday, October 06, 2011

50 F 3 1. Questions 48, 49, and 50 all deal with FEP-4.0 and may present

a potential double jeopardy for an applicant. For example, if

an applicant has a misconception that train A is used during

FEP-4.0 rather than train B the applicant may get both 49 and

50 wrong. Recommend licensee and chief examiner discuss to

E determine if this is acceptable.

2. Need to bound the time frame of actions performed within the

scope of the Qspecifically, the attachments of FEP-4.0 specify

that actions to black out the A ESF train and start turbine-

driven EFW pump need to be completed within 30 minutes.

This needs to be reflected in the Q stem. Potential fix to last

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

bullet: It has been 45 minutes (note to licensee: pick a

technically correct time here, 35 min? 40 min? 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />?)

since the crew began implementing FEP-4.0 CONTROL ROOM

EVACUATION DUE TO FIRE.

3. If double jeopardy issues resolved to satisfaction, Q should be

o.k. with changes as recommended.

S

Friday, October 14, 2011

1. BOUNDED THE TIME TO BE 45 min, all actions should be

done by 30 minutes.

2. Changed as requested. See exam for changes

3. Question is SAT.

SAT

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

003 2.4.31, New, Higher

1. KA appears to match.

2. Last bullet on given information does not appear to have any

value.

Thursday, October 06, 2011

1. K/A is met.

2. Distractor D is not plausible as written. The combination of

leaving the RCPs running, in combination with a loss of all seal

cooling, does not make any sense. However, changing

distractor D in a 2x2 format means that other aspects of the Q

also have to change.

3. Potential recommendation:

51 H 3 S Initial plant conditions:

-100% power

Current plant conditions:

-XCP-612 pt 4, PHASE B ISOL, alarms

-RB Spray pumps A and B are NOT running

-RB pressure is 0.4 psig and stable

-all phase B automatic actions have occurred

Based on the current conditions, which ONE (1) of the following

states how RCPs should be operated, in accordance with ARP-

001-XCP-612 for PHASE B ISOL; AND what is the status of

RCP seal cooling?

A. Trip all RCPs immediately.

Seal cooling still exists.

B. Trip all RCPs immediately.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

All seal cooling has been lost.

C. RCP operation may continue as long as parameters remain

within limits as displayed on IPCS ZZRCPBRG.

Seal cooling still exists.

D. RCP operation may continue as long as parameters remain

within limits as displayed on IPCS ZZRCPBRG.

All seal cooling has been lost.

E 4. Note: the reason it would not be recommended to simply insert

the above first part of C. and D. into the Q as written now, is the

LOCA in progress. Specifically, RCP trip criteria is so well-

known that if the LOCA progresses to the point that a valid

phase B occurs, it is much less plausible to keep the RCPs

running. I.e., if the LOCA started out as a small enough

SBLOCA that we didnt have to trip RCPs on the first pass

through EOP-1.0/EOP-2.0, now the LOCA has gotten so big

theres 12 psig into the RBso the operators will be thinking

shut down the RCPs even without the phase B actuation.

Friday, October 14, 2011

1. Made the question into 2 by 2, good

2. SAT

SAT

S

002 G2.2.44, New, Higher

KA appears to match.

52 H 2-3 S Thursday, October 06, 2011

1. Second part of distractors A. and C. are weak, because no

RWST level to be worried about is provided in the Q stem.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

2. Recommendation: keep the distractors as shown, modify the Q

statement to read something like

Given the following plant conditions:

E -The crew is responding to a Faulted Steam Generator (S/G)

-The S/G has blown dry

-The crew has transitioned to EOP-1.2, SI TERMINATION

-RCS pressure is increasing

-RWST level is 40% and slowly decreasing (licensee verify a

good RWST level at this point)

-A charging pump is running

-The crew has just secured the B charging pump

Based on the given conditions, which ONE (1) of the following is

the next required action, in accordance with EOP-1.2; AND why

S a reduction in SI flow should be done expeditiously?

Friday, October 14, 2011

1. Changed this to have just RWST is decreasing.

2. SAT

002 K5.14, New, Higher

KA appears to match.

S Thursday, October 06, 2011

1. Potential issue is that the electronic references for EOP-4.0 rev

20 do not seem to have any steps that put in aux spray at steps

22 and 23 of EOP-4.0 (where the operators depressurize the

53 H 2-3 RCS to refill pressurizer). However, there is a step at EOP-4.0

22.c.2) that closes PVT-8125? When would this valve ever be

opened before this point in EOP-4.0? Is this a potential

procedural error? Discuss with licensee.

E 2. This Q has overlap with a simulator JPMapplicants will be

very familiar with steps 22 and 23 of EOP-4.0.

3. How is it plausible to put in aux spray if EOP-4.0 does not list

that as an option at steps 22/23?

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

4. Potential fix: put the operators in EOP-4.2 (i.e. step 27) in the

fifth bullet of the Q stem. Maybe say something like the

operators are at the step to depressurize the RCS to reduce

break flow in EOP-4.2, SGTR WITH LOSS Does the Q still

work thencheck with licensee? Since there is a chance to use

aux spray in this procedure (EOP-4.2 vs. EOP-4.0), the

S plausibility issues are enhanced.

Friday, October 14, 2011

1. Changed the starting point to EOP 4.2 at step 27.

SATIFSACTORY

003 EA2.04, New, Higher

KA appears to match.

Thursday, October 06, 2011

1. Need to discuss with licensee the potential for first part of A. and

C. to be correctpotential for C. to also be true. The provided

54 H 2 S distractor analysis for A. or C. does not discuss why primary to

secondary leak flow has decreased is incorrect.

2. If first part of A. and C. can be shown to be incorrect, Q should

be SAT.

Friday, October 14, 2011

1. SAT.

2.

002 EK1.3, Bank, Knowledge

KA appears to match.

55 F 2 S

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

Thursday, October 06, 2011

E 1. Q is low discriminatory value, operators who saw the EOP-2.5

simulator scenario (and resulting simulator freeze issue) will

be very familiar with this Q and the correct answer.

2. Distractor C. is not plausible. Is there any procedure in the

Westinghouse EOP network where SI flow rates are used as

parameters? Recommend modifying C. to be RCS subcooling

3. Q should be o.k. with modification.

Friday, October 14, 2011

S

1. Fixed distractor C

2. SAT

3.

009 EK1.02, New, Knowledge

KA appears to match

S

Friday, October 07, 2011

1. If the S/Gs are dry, answer choices to stop removing heat may

be correct. Need to add S/G levels to stem of Q to ensure RCS-

to-S/Gs coupled in order for reflux boiling to occur? Maybe add

a bullet to state: All S/G narrow range levels are approximately

56 F 2 50% and stable.

2. Steam binding is a phenomena normally associated with

pumps, not U-tube S/Gs, making the second part changes to A.

and B. suspect. Recommend stop removing heat due to

E interruption of natural circulation. Ensure not too much

overlap/potential double jeopardy with Q 53.

3. The time frame is also important in this Q, because if the hot

legs are completely voided would reflux boiling be able to

occur? Recommend modification to second Q statement as

follows: After RCS level decreases to the point that steam

voiding has just begun to occur in the RCS hot leg.

Friday, October 14, 2011

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

1. Added all the recommendations.

2.

SAT

KA appears to match

Friday, October 07, 2011

E

1. Potential overlap with Q 52, ensure were not putting the

applicant in too much double jeopardy. Should be o.k.

2. The fact that every distractor except C. deals with Both RHR

pumps gives it weak plausibility. Recommend either changing

C. to Both RHR pumps were stopped to conserve RWST

57 H 2 inventory, or potentially changing B. to read something like

ONE (1) RHR pump was stopped to align to charging pump

suction, if you want to keep C. as writtenthis will improve the

parallelism of the Q.

3. Recommend adding in accordance with EOP-2.0 LOSS OF

REACTOR OR SECONDARY COOLANT to the end of the

S

WOOTF statement to clearly identify the source of the correct

answer.

Friday, October 14, 2011

Satisfactory,

004 A2.01, Higher, New

58 H 2 E 1. KA appears to match.

2. Question uses much of the same information required to answer

question 57.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

Friday, October 07, 2011

S

1. Q looks SAT.

SAT

003 A1.2, Higher, New

1. KA appears to match.

2. For the choices give, 5% power level could never be wrong. It

is more severe than IR SUR positive, therefore without knowing

anything else, if the SUR answer led to a red path, then the

power range answer must too.

E

Friday, October 07, 2011

1. Q still has a potential subset issue/multiple correct answers,

because if Intermediate Range SUR is positive, wouldnt Source

Range SUR be positive as well?

2. Recommend modifying the Q statement as follows: WOOTF

59 H 2 X and the lowest Intermediate Range SUR indication that will

result in an ORANGE path on the Subcriticality critical safety

function, in accordance with EOP-12.0, MONITORING OF

CRITICAL SAFETY FUNCTIONS?

A. End of Life

0.1 DPM and stable

B. End of Life

S 0.2 DPM and stable

C. Beginning of Life

0.1 DPM and stable

D. Beginning of Life

0.2 DPM and stable

Friday, October 14, 2011

1. Used recommendation.

2.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

E13 EK3.4, Knowledge, Bank

KA appears to match

Friday, October 07, 2011

E 1. This Q has overlap issues with SRO Q 94.

2. Need to understand the impact of the loss of instrument air

header pressurehas it been long enough to bleed down MSIV

accumulators and close all MSIVs? Issue is that if the

condenser is available, then EOP-15.1 step 8 alternate action

would first have the operator locally operate steam dump valves

before attempting to locally operate SG PORVs.

3. Distractor C is not plausible. Common knowledge that TDEFW

pump has steam line sources from B & C S/Gs, not the A S/G. If

the overlap issues can be resolved and it made clear that it has

60 F 3 been a long-term loss of instrument air, changing distractor C. to

say Locally operate steam dump valves in all condenser

sections to reduce affected SG pressure, may be a plausible

candidate for replacing C.

4. Should delete based upon a yellow condition on the Heat

Sink CSF status tree as teaching in the stem; you can only get

to EOP-15.1 on a yellow path.

S Friday, October 14, 2011

1. Changed no overlap issue.

2. MSIVs no accumulators

3. Removed teaching from the stem.

4. In C removed in each condenser section. To each condenser

like the procedure.

SAT

W/E15 EA1.3 get this from here.

61 F 2 S

Friday, October 07, 2011

1. Distractor B. is a subset of correct answer A. A faulted SG

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

inside containment would be one of the unexpected sources of

water. Therefore B. is a non-plausible distractor.

2. Potential recommendation for B.: Evaluate ECCS system

status to determine strategy to transition to cold and hot leg

injection. to play off distractor D.

Friday, October 14, 2011

1. Changed B to look like D.

SATISFACTORY

022 G2.4.11, Higher, Modified

1. KA appears to match.

2. Using the word Immediately implies immediate action. Instead

E suggest using which step will the AOP require first?

Friday, October 07, 2011

62 H 2-3

1. Q was modified as requested in first 401-9.

2. Q is of low discriminatory value, but acceptable.

3. Q now appears SAT.

S Friday, October 14, 2011

SAT

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

00024AK1.01 need to get this one from file.

003 AK1.01, Knowledge, New

E 1. KA slightly matches.

2. The question is NOT very discriminating. The candidates really

do not need to understand the operational impact of the loss of

RHR, the just need to know the max pressure and temperature

that it can be put in service. A better question might put them

outside one of the limits and have them determine that they

cannot put it in service until they restore the parameter.

63 F 2 X

Friday, October 07, 2011

1. Q was modified as requested in first 401-9.

2. Could be acceptable Q if source is provided for correct

answeri.e. design limits based on what document?

Westinghouse Design Basis Document for RHR system? VC

S Summer FSAR? Etc. Once source is specified, recommend

listing it as an in accordance with at the end of WOOTF

statement.

3. Q may be o.k. with modifications as requested

Friday, October 14, 2011

1. Changed question based on the comment from NRC.

076 K3.05,Knowledge, New

S 1. KA appears to match.

2. Answer is logical. Does not appear to be adequate procedural

documentation to ensure only one correct answer. How long is

64 F 2-3

RCS temperature expected to remain stable?

E

Friday, October 07, 2011

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

1. Distractor B is non-plausible. How would the condenser still be

available? Recommend slight modification to read: Dump

steam using S/G PORVs.

S Friday, October 14, 2011

1. Version two uses SG PORVs.

2. Changed B to use MDAFW to feel one SG and use that S/G to

depressurization.

065 AA1.03, Knowledge, New

1. KA sort of matches.

E 2. KA is asking how to operate equipment when air is restored. In

other words, what do you need to do prior to restoring air to

ensure you dont damage the plant or cause another transient

when you restore air. Valve switches may be placed in hard

open or closed (or gagged open or closed) to prevent

repositioning upon air restoration. This question appears to be

written from a standpoint of operating without air vice operating

S while restoring air.

65 F 3 X

Friday, October 07, 2011

1. Q was modified as requested in initial 401-9.

2. Q now looks SAT.

S

Friday, October 14, 2011

Validation identified that it was a gaging handwheel so had to change the

stem to a valve that needed to be ungagged.

079 A4.01, Higher, New

1. KA appears to match.

66 F 2 X E 2. Answer C is NOT plausible. Why would service air isolate

before the backup compressor started?

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

Friday, October 07, 2011

S 1. Q modified as requested in initial 401-9.

2. Q now looks SAT.

Friday, October 14, 2011

S 1. Not higher level of knowledge otherwise ok.

2. SAT

059 G2.4.11, Higher, Bank

1. KA appears to match.

S 2. Consider asking which AOP would they enter and what is the

first action that would be taken.

3. Is it certain that manually controlling all three FRVs cannot

cause SG levels to rise?

Friday, October 07, 2011

1. Distractor A. is still potentially correct. For the given plant

conditions, operators would meet entry conditions for AOP-

210.1 and A. is the first immediate operator action of AOP-

E 210.1. Also, use of the word all in distractor A. is a giveaway

67 F 2-3

word.

2. If agreement can be reached that A. is clearly technically

incorrect, recommend changing A. to read take feed reg. valves

to manual for the affected S/Gs.

3. If A. is not clearly incorrect, recommend development of new

distractor to replace A. Would it be plausible to start additional

condensate pumps or feedwater booster pumps?

Friday, October 14, 2011

S 1. Changed A to start feed water booster pump.

2. Changed the stem . see final exam for changes.

3. Sat

SAT

077 AK3.02, Higher, New

1. KA appears to match.

68 H 3 S

Friday, October 07, 2011

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

1. Unsure about higher cognitive, Q can be answered via simple

recall of AOP-301.1 CAUTION/first step. Should be

Fundamental LOK.

2. Recommend adding Based on the given conditions, to the

WOOTF statement.

3. Otherwise Q looks SAT.

Friday, October 14, 2011

1. SAT

SAT

059 AK1.01, Knowledge, New

1. KA appears to match.

2. If this is knowledge that the operators are expected to

E

memorize, it is OK. However it is not very discriminating.

Specific to plant.

Friday, October 07, 2011

69 F 2 1. What microcuries/gm setpoint would correspond to a full

Condensate Storage Tank? i.e. check to ensure A. and B. are

incorrect.

2. As mentioned in first 401-9, not very discriminating; however, if

S above concern is resolved Q should be SAT.

Friday, October 14, 2011

1. SAT as is, need to know spec.

SAT

058 G2.2.36 Higher, New

1. KA appears to match.

2. Memorization. No higher level ability required.

3. Not very discriminating. Any person knowledgeable of PWR

70 F 2 S operations could answer.

Friday, October 07, 2011

1. Q should be SAT.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

Friday, October 14, 2011

sat

003 3.01, Higher, New

1. KA appears to match.

2. Stopping dilution within 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> is part of the material below the

S line. ROs do not need to know this information. This makes

these distracters very weak. Recommend using be in cold

shutdown within 12 hours1.388889e-4 days <br />0.00333 hours <br />1.984127e-5 weeks <br />4.566e-6 months <br /> as a better distracter.

Friday, October 07, 2011

E 1. Potential subset issueif second part of distracters B. and D.

were correct, second part of distracters A. and C. are also

correct.

71 F 2 X

2. Also need to add with no operator action to the Q statement?

Because FCV-122 is in MANUAL

3. Potential fix for this issue would be to change WOOTF

statement to read: Which ONE(1) of the following describes an

expected parameter trend if the running RHR pump trips with no

other operator actions, and the required action as stated in

Technical Specifications?

S

Friday, October 14, 2011

1. Fixed the subset issues.

2. Added with no operator actions to the stem.

SATISFACTORY

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

017 AK2.10, Knowledge, New

1. KA matches somewhat.

2. Memorization. No higher level ability required.

3. Not very discriminating. Memorization of the trip setpoint and a

basic understanding of reactor physics that any nuclear

U professional should have.

Friday, October 07, 2011

1. This Q has multiple subset issues. As written D. is a potentially

correct answer along with C. Second part of A. and B. are not

plausible because they would allow operators to restart a RCP

at 100% power (current MODE is MODE 1), and because if the

second part of A. and B. are true, then the second part of C. and

D. are also true.

2. 311 degrees is also not plausible because its too highseal

return would be superheated at this temp? (return flow at VCT

pressure?)

72 F 2 3. Q as written is UNSAT due to the above issues.

4. Potential fix/recommendation: (delete the Given and the

bullets)

In accordance with SOP-101, REACTOR COOLANT SYSTEM, which

ONE (1) of the following correctly identifies:

1) The lowest seal water outlet temperature at which a RCP must be

S

stopped.

2) The highest MODE in which a RCP can be restarted after the cause of

the high temperature is corrected?

A. 1) 195 F

2) MODE 3

B. 1) 195 F

2) MODE 4

C. 1) 235 F

2) MODE 3

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

D. 1) 235 F

2) MODE 4

Friday, October 14, 2011

Followed all recommendations.

SAT

003 AK1.21 Higher, New

1. KA appears to match.

2. Not very discriminating. Bases for the plausibility of AFD being

within the band is that the candidate must know that the

73 H 2 X S surveillance requires 2/4 to be outside the band to be

considered outside the band. Given that it is easy to see that

two NIs are outside the band, the average person with no

knowledge would declare it out. A more discriminating question

would have three inside and one outside.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

Friday, October 07, 2011

1. Q was not changed given the recommendation of the first 401-9.

As written, first part of Q is essentially a direct look-up on the

E 100% power line (points given on the provided reference).

Therefore, with two values outside the acceptable region,

plausibility of first part of A. and C. is weak.

2. Recommend changes to delta flux indications as follows:

Before the Drop After the drop

N41 -4.4% -3.6%

N42 -4.4% -5.7%

N43 -4.4% -9.1%

N44 -4.4% -6.8%

3. Recommend changing the second half of the Q statement to

The BOP is required to maintain Tavg within a maximum of

_____ of Tref, in accordance with AOP-403.5, STUCK OR

MISALIGNED CONTROL ROD.

4. If the above changes are made, C. is the new correct answer.

5. Q should be ok with modifications.

Friday, October 14, 2011

1. Sat as changed, it is a little different but ok

2.2.35, Knowledge, New

S KA appears to match

74 F 2 Friday, October 07, 2011

E 1. K_eff values up to 0.99 are not plausible. How could you ever

refuel at that value? Recommend making one first part choice

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

less than or equal to 0.90 and the other less than or equal to

0.95 Temperature choices in the 2x2 are ok.

2. Another potential enhancement to WOOTF statement: WOOTF

that can exist when the first Rx Vessel head bolt is

detensioned in accordance with Technical Specifications?

S

Friday, October 14, 2011

1. Changed from 0.99 to 0.90, changed less than or equal to .

2.

003 2.2.37, Knowledge, Bank

S 1. KA appears to match.

2. Memorization. Plant specific.

75 F 3 S Friday, October 07, 2011

1. Q appears to be SAT.

Friday, October 14, 2011

1.

SRO ONLY Questions

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

017 AK2.10, Knowledge, New

4. KA matches somewhat.

5. Memorization. No higher level ability required.

6. Not very discriminating. Memorization of the trip setpoint and a

basic understanding of reactor physics that any nuclear

professional should have.

Friday, October 07, 2011

5. This Q has multiple subset issues. As written D. is a potentially

correct answer along with C. Second part of A. and B. are not

plausible because they would allow operators to restart a RCP

76 H 3 E at 100% power (current MODE is MODE 1), and because if the

second part of A. and B. are true, then the second part of C. and

D. are also true.

6. 311 degrees is also not plausible because its too highseal

return would be superheated at this temp? (return flow at VCT

pressure?)

7. Q as written is UNSAT due to the above issues.

8. Potential fix/recommendation: (delete the Given and the

bullets)

In accordance with SOP-101, REACTOR COOLANT SYSTEM, which

ONE (1) of the following correctly identifies:

1) The lowest seal water outlet temperature at which a RCP must be

stopped.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

2) The highest MODE in which a RCP can be restarted after the cause of

the high temperature is corrected?

A. 1) 195 F

2) MODE 3

B. 1) 195 F

2) MODE 4

C. 1) 235 F

2) MODE 3

D. 1) 235 F

S 2) MODE 4

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

W/E16G2.4.30, New, Higher,

1. Depending on the other questions, the reference provided

should be the entire EAL matrix. This way the applicant at least

has to find the section necessary to answer the question. IF

ONLY the page that is associated with each question is

provided then the question becomes a look up for only that item

on that page. Suggest the entire EAL Matrix be provided,

unless it helps answer other questions on the exam (RO or

U SRO)

2. An event occurred that increased (raised) the readings Not

sure it is necessary to say significant. Also, reading should be

plural, readings. And at the end of the second bullet add the

word respectively.

3. KA does not match, reporting to agencies internal or external,

not done, only classification is done. Not notification. Repair or

replace

77 H 2 X Wednesday, September 28, 2011

1. 1. Replacement question. New Lower,

2. Distractors C is NOT plausible, the stem of the question does

not provide any substantive information concerning the

information that would require the identification of offsite dose

projections. While the question analysis states that the INITIAL

notification does not require the offsite dose projection, the

question in the stem does not provide any information that

U would be used to do this. Additionally, the stem states offsite

radiation is normal.

3. Distractor D is NOT plausible.

This new question still warrants an evaluation of a U.

Thursday, October 13, 2011

1. Changed to a 2 by 2 format.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

2. Event prognosis and estimated release duration was used.

3. Stem has a radiation monitor that needs to be changed

because there is a 309 that needs to be removed from the rad

monitorl RMG-7 needs to be changed. *****

4. Fission product matrix is used.

5. PM states remove the 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />. Added note to the make sure

that the ED JUDGEMENT is NOT used.

6.

U

• • • • • • still have to ensure that RMG-7 nomenclature is corrected.

G2.2.25, New, Lower,

1. Distractors with run out are not plausible A and C. This is a

system knowledge item that is covered by everyone, not just

SRO knowledge.

2. The 13 gpm value listed in the question in C and D are also not

valid. In that, what or where does this number come up that

would cause the operators to think it is plausible? Additionally,

78 F 2 X U what did the results of the validation see for this question?

Anyone pick anything but the correct answer? Did anyone pick

D? or C? If not these most likely are not valid answers and not

plausible.

3. Asked G. Laska concerning the evaluation of the question. He

agrees.

Thursday, September 29, 2011

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

1. Question was UNCHANGED. The above evaluation still is

valid.

Question is still a U.

Thursday, October 13, 2011

1. The new question still has subset issues. B and D can be

also correct. Subset issues. Changes to this are

S necessary so it is bounded.

2. Change maximum of 33 and a maximum of 39. This was

changed during this meeting.

3. JL asks what part is the SRO?

4. Had to change to maximum of vice less than. This

included a less than 13 which would also be 33 gpm.

5. Also changed distracters to add during the design basis

LOCA.

6. Changed pump to RCP.

Question is satisfactory.

000062AA2.03, New, Higher,

1. In the stem of the question, the A EDG is listed this way and A

EDG. With or without quotes. Pick a standard for all questions

and do it the same.

79 H 2 X U 2. This information while in the basis of TSs, is not SRO ONLY

knowledge.

3. Question needs to be re-written to be at SRO level.

4. Verified with G. Laska to ensure it was NOT SRO ONLY, he

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

agrees.

Thursday, September 29, 2011

1. Replacement question. New Lower.

2. Attempting is misspelled in the last bullet in the stem.

3. Suggest to put a comma after the first line in each distractor,

this will separate the answers

4. KA appears to match

S 5. Otherwise, this appears to be OK.

---

-How is Q lower cognitive? Should be higher cog based on

evaluation of plant conditions, operability call required, etc.?

Thursday, October 13, 2011

SATISFACTORY

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

00025AA2.04, New, Higher,

1. Use of period in bulleted area, one has all rest do not have

periods

2. Question is NOT SRO ONLY. Systems knowledge can answer

this without any knowledge of the procedure.

3. The procedure is provided so the SRO does not have to identify

what procedure to handle this in.

4. The PZR level is not described sufficiently, uncontrollably, is not

good enough to evaluate.

U 5. The stem TELLS the applicant that there is an indication of a

LOSS of inventory. Why not use that instead of teaching that.

Dont tell the applicant what is going on.

6. G. Laska reviewed for verification of NOT SRO ONLY, he

agrees.

7. KA appears to match.

Thursday, September 29, 2011

1. NEW, LOWER, current question was MODIFIED from 45 day

80 H 2-3 submittal.

2. Question should NOT ask how operators would use, but how

the SRO would direct! This would be a better indication of what

we are asking the applicant to figure out. Discuss this with

U licensee. This is an enhancement.

3. This question while closer to the requirements of an SRO

question is low level.

4. KA appears to match, not really close but close enough.

5. The question appears to be more common sense and can be

answered with that. The first part is basic knowledge. The

subcooling is decreasing and this will need to be fixed by being

in the injection mode.

6. Why would anyone select distractors C and D with LOCA

OUTSIDE CONTAINMENT? This does not seem plausible.

Discuss with the licensee. WHY would an applicant pick these?

7. In the analysis, it is stated that EOP 2.5 will NOT be entered

from mode 4. Need to understand this and why it is plausible.

8. Matches KA

9. Still considered a U because of the procedure selected.

Thursday, October 13, 2011

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

1. New question

2. Changed wording of initial conditions.

3. Changed PZR level that has level go from 60 to 30 in the

time frame and do they enter 112.2, loca during mode 4.

4. Leak needs to be greater than the capacity of the CCP.

Does the 60 to 30 do this?

5. Changed the time to 0415,

S

086A2.01, New, Higher,

1. Question is trivial.

2. Question can be salvaged by, removing in the stem not reset in

the second bullet. It should read the pump has been shutdown

U and the (whatever the switch is called is ) either OFF. Do not

say it was reset.

3. This question is not SRO ONLY. The only part is the timeframe

for which to return to operability.

4. What is the difference between a roving fire watch or a

continuous fire watch? I believe they are the same.

5. Discussed with BC M. Widmann and G. Laska both believe the

question is NOT SRO ONLY.

Thursday, September 29, 2011

U 1. The licensee changed the question as discussed in # 2 above.

81 H 2-3

However, the information provided does not appear to be

correct. How is the switch labeled? Is there an AUTO position

on the switch? If there is, then the switch was taken from the

AUTO to OFF/RESET. Not the ON position. Discuss with

licensee.

2. The distractors A and B are not credible. Why would anyone

that is trained call something OPERABLE and then have a

compensatory measure for it being OPERABLE.

3. Discuss with licensee

??

Thursday, October 13, 2011

New question and will be discussed later,

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

Also, MM provided a NEW KA

Friday, October 14, 2011

New ka provided by MM.

0002A2.04

New question is SAT. See exam for new test item.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

000007EG2.4.34, New, Higher,

1. Need to add the noun name of procedure AOP-600.01,

2. NOT SRO ONLY, this question requires an operator to

determine if when transferring control of a pump to the Control

Room Evacuation Panel (CREP) is Operable or Inoperable.

This knowledge is not just the SROs in this case. The RO is

taught this and should know this for control of the pump as well

as if it was not swapped to the local area for control.

3. The second part of the question concerns itself with the

requirement of starting room coolers when starting equipment.

This is a system requirement and the RO is taught this also to

prevent failure of the equipment.

4. KA does NOT match. The KA was supposed to be written

during a situation of Reactor-Trip Stabilization and Recovery,

performed OUTSIDE the MCR during an emergency and the

resultant operational effects. While this is OUTSIDE the control

room it is not during a reactor trip.

Thursday, September 29, 2011

1. This question was inserted into the examination at this point.

000007EG2.4.34, New, Higher, is the new question 7 or SRO

82 this questions was the # 9 in the first submittal.

82 H 3 U 2. AOP 600.1 at step 6 states

6 Attempt to start the Diesel Generator by depressing the ENGINE SHUT

DOWN RESET Pushbutton

Is this the step the analysis is talking about? Will this work in

this case? Ask licensee to explain how this works.

Stem of the question should ask what procedure to use and then what

action the procedure should direct. For example, the answer should now

read: AOP 600.1, Control Room Evacuation, start the B EDG. Now the

stem does not identify the procedure is being asked. It starts with the

action then a procedure. Also, it does not identify where the operator is

going to operate MVT-8104. Discuss with licensee. Enhancements-------

---

Additional comments

on 007EG2.4.34 as submitted in 2011 NRC SRO Test 2nd

Submittal

-need to ensure operators are in correct procedurecould A be

correct? Or, once B EDG is started as per choice D, based on the

note before steps 12-19 of AOP-600.1 would A not also be correct?

-stem should probably state reason why control room was

evacuated, otherwise FEP-4.0 could be the right procedure.

-not sure about operational validityfrom AOP-600.1 step 12.d.

Alernative Action, wouldnt operator emergency borate with AOP-

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

U

S

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

063A2.02, New, Higher,

1. KA does NOT match. The second part of the KA was not

tested. It is required to test the (b) part of the KA when there is

a two part KA. The (b) part required the question be written to

use procedures to correct, control or mitigate. This question

83 does not do this. This question only identifies the generation of

H 2-3 X U Hydrogen or Sulphuric acid vapors. Has nothing to do with

OLD

procedure that will correct etc. .This makes this question unsat.

Thursday, October 13, 2011

1. SAT

At this point, the licensee submitted the Second submittal. This second submittal the numbers and KAs for each question was changed. Not sure why. As licensee why this was done.

Starting with question 82 the KAs were swapped.

063A2.02

Thursday, September 29, 2011

1. KA 063A2.02, was number 10 in submittal # 1, (S1) now it is

question number 8 in Submittal # 2 (S2)

2. S1 it was higher new and now it is lower new.

3. In stem put quotes around XVA1A and commas as appropriate.

i.e. A charge of A Battery, XBA1A, is in progress. This will

make this read better.

83 4. KA appears to match

H 2 S 5. The stem is a little confusing concerning the lifting of the lead

NEW

and then the requirement to continue or recommence the

charge. Has the charge ever been stopped because of the fans

being found off? Ask licensee if this is important or not.

6. Otherwise appears to be ok.

Thursday, October 13, 2011

1. Changed 14 days to 96 hours0.00111 days <br />0.0267 hours <br />1.587302e-4 weeks <br />3.6528e-5 months <br />. 96 hours0.00111 days <br />0.0267 hours <br />1.587302e-4 weeks <br />3.6528e-5 months <br />,

nuisance annunciators, can open a link from 48

to extend the open to 96 hours0.00111 days <br />0.0267 hours <br />1.587302e-4 weeks <br />3.6528e-5 months <br />. What was

wrong with 14 days. Operations does nothing in

14 days.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

2. Changed back to 14 days.

SAT QUESTION.

012A2.01, New, Higher, Summer

Thursday, September 29, 2011

Question was changed from S1

E 1. Distractor D identifies just to SHUT down the reactor, however,

A and B identify to be in HOT STANBY, this keys the applicant

that D is not totally correct, in that, the MODE is NOT listed. I

believe that this makes this distractor not plausible.

2. For distractor A and B, is this plant terminology, Initiate

Measures . Prepare for plant shutdown by XXXX to Hot

Standby by XXX.

3. When the stem states asks for the MINIMUM action, does that

mean the shortest action? Discuss with the licensee.

84 H 3 X

4. KA appears to match, this is a TS question, need to make sure

that we do not have too many for the A2 KAs.

5. The distractors could be made such that the first two have the

BS trip times added to the end of the statements and then have

the opposite where the BS are tripped as in Distractor D and

then have the reactor down power done to hot standby. This

S would alleviate the unsymmetrical distractor part of C. Discuss

with licensee.

Thursday, October 13, 2011

1. NEW FORMAT and 2 x 2 question.

2. SAT

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

Thursday, September 29, 2011

039G2.4.11, New, Higher,

1. Question was NOT changed from S1 to S2.

2. Question concerns itself with TS evaluation. We need to be

careful with the use of TS questions. There were a lot before

U and we may exceed or emphasis on TSs.

3. This question, needs a reference because it is greater than an

hour. If the reference is presented, then the question as is

written this would make it a direct look up. This makes the

questions unacceptable.

4. Main and reheat steam, could have used ARPs and maybe with

a PORV that had failed open, maybe there could have been a

reportability call to make, i.e. an SRO ONLY type question.

How long, who to call.

85 H 3 X 5. As the question is not Sat because of the call of TS greater than

1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />, information not required to be memorized by operators.

6. Also in the stem could shorten action or actions by using

action(s).

IF the licensee validates that this knowledge is REQUIRED for the SRO,

then this question could be Satisfactory. Discuss with licensee.

S

Thursday, October 13, 2011

1. NEW question, suggested by MM.

2. New question will require TS 3.7.1.2, 78 hours9.027778e-4 days <br />0.0217 hours <br />1.289683e-4 weeks <br />2.9679e-5 months <br />, 3 days plus

6.

3. REFERENCE will be provided.

SAT

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

00027AA2.01, New, Higher,

Thursday, September 29, 2011

1. Question was re-written from S1 to S2. Minor changes to make

consistent with other questions.

2. Analysis of the answer A states procedure step 10 a. however

in EOP 1-2, this step is not the requirement for subcooling

margin being greater than 52.2 F. This is in the foldout page but

not in step 10a. Have licensee identify where this comes from.

3. Do not understand What the stem is asking, PZR level greater

than the SI termination criterion is expected for this event and

whether other conditions are met to transfer to EOP 1.2. have

86 H 2 U the licensee explain what this is asking.

4. KA appears to match question

---

Additional comments on 027AA2.01 as submitted in 2011 NRC

SRO Test 2nd Submittal

-not sure about SRO-only match on procedure selection, operators

are not selecting a procedure but only staying in current

procedure. Would it be better to ask expected procedural flowpath

(i.e. E-1 to ES-1.2, then ES-1.3) or give four-choices of procedures

with some additional info in stem? E.g. choose between staying in

E-1, going to ES-1.2, going to ES-1.1, or going to ES-1.3 (WOG

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

designators). Otherwise Q is potential RO-level knowledge of SI

Termination criteria (e.g. subcooling value is foldout page item).

-careful about teaching in answer choicessubcooling is too low

should be subcooling not met, etc.

Thursday, October 13, 2011

1. Replaced.

2. Replacement ok.

S

SAT

000056EA2.06, New, Higher,

Thursday, September 29, 2011

S 1. This question is the new number 12, but corresponds to the old

1. 15.

2. Question was made into a two part question/answer.

87 H 3 3. Question appears to be ok.

4. KA appears to match

Thursday, October 13, 2011

1. Changed the graphic from 5% to 2%. Changed this because as

S soon as the SI pump is started it would or could be secured.

SAT.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

076A2.01, New Higher

Monday, October 03, 2011

1. In the stem of the question, the Loop is identified with

E parenthesis. However, the last bullet the A train, should be the

same A train. Also there is one extra space in the last bullet

between Pump and is.

2. SW is not defined until the first question.

3. In the second question in the stem there is a missing period.

4. The First question, should not be an AN, it should be an A.

Would recommend that this be re written to something like:

Due to the A Service Water pump failure this

caused the ..

88 H 3 5. What is the status of the C Service Water pump at this time?

Per the figure provided for the start logic (Figure IB1.6),

shouldnt the C service water pump auto-start on low header

pressure? If the pump is running, the answer choices may be

different.

6. As currently written, first part of distracters C. and D. are weak.

S Recommend changing first part of C. and D. to The A Motor-

Driven Emergency Feedwater Pump is OPERABLE.

Thursday, October 13, 2011

1. Rewrote question in 2X 2

2. Appears to do all the above,

SAT.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

K/A 103G2.4.18

NEW HIGHER

Monday, October 03, 2011

1. Q appears to match K/A. Q appears to be SRO-only.

2. Q statement needs to specifically reference the EOP; for

U example, Which ONE (1) of the choices below is correct in

accordance with EOP-2.4?

3. Second part of distracters C. and D. is not plausible. RWST

would have to gravity drain through the RB spray header rings

against a 40 psig differential pressure.

89 H 3 X 4. Need to lower RWST level to make securing a RB Spray pump

more plausible30% level is above the 18% setpoint to go to

cold leg recirculation.

5. Question is U due to more than one non-plausible distractor.

Thursday, October 13, 2011

1. Wants to keep rwst level at 30%,

S 2. Changes the pressure of containment to 32 psig rather than 40

psig.

3. SAT with changes to C and D, see question for change.

K/A 011G2.4.21

NEW HIGHER

90 H 3 X E Monday, October 03, 2011

1. Q appears to match K/A. Q appears to be SRO-only.

2. Operational validity/stem content: how would any SRO be

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

entering a YELLOW path procedure 15 minutes after a

LBLOCA? Must increase the time frame to be operationally

valid. Did increase comment.

3. Stem needs to provide all criteria for critical safety path

evaluationfor example, needs to include intermediate range

power and startup rate values, containment pressure values,

S and RHR sump level values.

Thursday, October 13, 2011

1. SAT

SAT

G 2.2.38, Bank, Higher.

1. Question appears to be within the SRO knowledge

requirements.

2. KA appears to match.

3. Question is kind of easy, not trivial but it does not require much

cognitive skills to answer.

4. Why is the answer 92 days, is that the time frame you use for a

91 H 3 E Quarter?.

5. The description for the analysis for distractor A is incorrect. TS 4.0.3, allows up to 24 hours2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br />, so why is that not the reason for A

rather than the applicants miss-reading quarterly as Shiftly?

That does not make sense.

K/A G2.2.38

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

NEW HIGHER

Monday, October 03, 2011

1. Q appears to match K/A. Q appears to be SRO-only.

2. Fourth bullet needs to explicitly match the language in the TS 4.0.3 for completing a risk assessment. For example, A Risk

Evaluation has been performed for the surveillance, and has

concluded that the risk associated with the delay of the

surveillance is minimal.

3. For the distracters, need to specify time limit from the time of

S discovery; for example:

A. Within the next 24 hours2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br /> from time of discovery

B. Within the next 23 days from time of discovery

C. Within the next 92 days from time of discovery

D. Within the next 115 days from time of discovery

Friday, October 14, 2011

1. Question was replaced. See exam for question.

2. Presented question with word shiftly, GL states not terminology

3. Question is SAT.

072A2.03, New, Knowledge.

1. When a KA has a two part K or A if the question cannot be

written to the part (a) and (b) then the goal is to write the

question using the SRO portion of the K or A, meaning the (b)

part of the KA. This question does not meet the (a) part, it does

not predict the impact. There is no justification why the (a) was

92 F 3 X U not written in this question.

2. Procedures to correct. Part (b), this is a 30 day action, the

questions indicates INITIAL action required if the power supply

fails. There is no INITIAL action in any of the distractors.

3. The RM used in distractors C and D, RM-A4, would, if in

service, alarm for ANY leak.

4. As written, this question is unsat

5. Is the SRO required to know 14 day and 30 day TSs from

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

memory? Ask licensee, this seems unreasonable

K/A 072A2.03

LOWER

Monday, October 03, 2011

1. Q is essentially unchanged from initial submittal.

2. Distractor A is potentially another correct answer.

S 3. Q is still U

4. Making the applicants recognize instruments that may or may

not be in TS. Is this something you expect? Items are 7 days,

72 hours8.333333e-4 days <br />0.02 hours <br />1.190476e-4 weeks <br />2.7396e-5 months <br />?? Ask licensee.

Friday, October 14, 2011

1. New KA provided by MM. 034K3.02

2. See new question, modified slightly from what was provided.

Generic Comment: in two-part questions, it is better to indent the (1) and the (2) parts of the question statement (offset from the Which ONE of the following) for readability.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

K/A 028G2.1.27

Monday, October 03, 2011

1. Q appears to match K/A. Q appears to be SRO-only.

2. Last bullet for temperatures needs degrees Fahrenheit (F) after

the degree symbol.

3. Recommend modification to question statement as follows:

Based on the initial conditions, which ONE (1) of the following is

U

correct in accordance with EOP-14.0? did

(1) How many hydrogen recombiners will be started?

(2) What is the next procedure transition?

4. When would operators ever start both Hydrogen Recombiners

at the same time? First part of distracters C. and D. are not

93 F 2 plausible.

5. Recommend potential fix for first part C. and D. to say No

recombiner will be started.

6. Correct spelling error for Guideline in all choices.

7. Q is U due to two non-plausible distracters.

Thursday, October 13, 2011

S 1. Changed as suggested.

2. SAT

Satisfactory

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

K/A WE13EA2.2

Monday, October 03, 2011

1. Q appears to match K/A. Q appears to be SRO-only level.

2. Distractor B. is not plausible because all MSIVs are closed, why

would you dump steam from the B&C steam generators when

you had an option to use A? (distractor A.) Also it is not clear

whether dump steam infers using steam dumps or steamline

PORVs.

3. Distractor D. is not plausible because there is not physical

steam supply from the A S/G to the turbine driven EFW pump.

4. Q is U due to two non-plausible distracters.

5. Need to move the last bullet (Operators have entered EOP-

15.1, STEAM GENERATOR OVERPRESSURE) to bullet

number three.

94 H 3 U

6. Potential fix/recommendation:

Based on the given conditions, which ONE (1) of the following

is the procedure and the action the CRS will direct?

A. Remain in EOP-15.1, STEAM GENERATOR

OVERPRESSURE, and dump steam from A Steam

Generator steamline PORV.

B. Remain in EOP-15.1, STEAM GENERATOR

OVERPRESSURE, and initiate blowdown from the A

Steam Generator.

C. Transition to EOP-15.2, STEAM GENERATOR HIGH

LEVEL, and dump steam from A Steam Generator

steamline PORV.

D. Transition to EOP-15.2, STEAM GENERATOR HIGH

LEVEL, and initiate blowdown from the A Steam

Generator. (new correct answer)

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

Thursday, October 13, 2011

1. Followed recommendations. \

2. 2/2 format.

Satisfactory

S

K/A WE08G2.4.21

NEW HIGHER

Monday, October 03, 2011

95 H 3 E

1. Q appears to match K/A. Q appears to be SRO-only

2. Valid with respect to physics and thermodynamics? RCS and

RB pressures are matchedis there a LBLOCA in progress as

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

well as the steam line break?

3. Delete 30 minutes ago from first Q statement. Again, do not

believe conditions would be established as stated in 30 min

timeframe.

4. Distractor D. is not plausible, Recommend changing to Remain

in EOP-3.1, UNCONTROLLED DEPRESSURIZATION OF ALL

STEAM GENERATORS.

5. Change question statement to read: WOOTF identifies the

procedure the CRS will direct the crew to implement to

S effectively mitigate this condition?

Friday, October 14, 2011

1. New question, did not follow the above recommendation.

2. Changed from what was presented slightly, see question for

new sat question.

SAT

K/A G2.3.14

Monday, October 03, 2011

1. Q appears to match K/A. Q appears to be SRO-only.

96 F 2 S 2. Q is SAT.

Friday, October 14, 2011

1. The licensee wants to change this question based ONLY on the

results of the everyone FAILED. Initially this question was

validated by 2 SROs and was not an issue. The question was

revalidated again because there were 5 individuals who

Question would not be justifiable. The OLD version will be used.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

K/A G2.3.12

Monday, October 03, 2011

E 1. Q appears to match K/A. Q appears to be SRO-only.

2. Q is SAT as submitted .

Tuesday, October 04, 2011

When is the RB Charcoal Clean up unit energized? Licensee needs to

identify. This is from OAP 108.1 b. Determine if operation of four

RBCU's (fast speed) per SOP-114 should be performed in

order to increase stay times for teams entering

97 F 2

containment.

Why is D not also correct?

Distractor C appears to be not plausible. Need to clarify or identify a

special case for entering the RB and then Key off of that. Discuss.

Thursday, October 13, 2011

S

1. ADDED in stem a DAC reference to make C more plausible,

2. Changed D to slow speed.

3. SAT

Satisfactory.

K/A G2.1.4

Monday, October 03, 2011

98 H 2 S

1. Q appears to match K/A. Q appears to be SRO-only.

2. Remove to regain SRO proficiency from distractor D.

Thursday, October 13, 2011

SATISFACTORYs

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

G 2.1.3, New, Lower

1. KA appears to match

2. Distracters C and D are not plausible. The situation for a

reactor start up NO distractions would occur and therefore

U implausible. This makes the SRO functions trivial, there is no

instance where an operator would select these.

3.

Recommendation

99 F 2-3 Knowledge between long and short term turnovers. Use the 2 by 2 format

to identify 2 items from each or something that is unique to the short and

not to the long.

s Thursday, October 13, 2011

1. NEW QUESTION

2. OK

SATISFACTOY

2.4.37, VCS CLOSED, Lower,

1. KA does NOT match, SRO ONLY, trivial knowledge

2. The answers for the second part are not really answered by the

answers in the distracters. For example, what happens if the

TSC is not manned but the ED takes command from the IED?

100 U Should the question ask when is the IED relieved from his

duties?

There is some information needed to the stem of the question.

Recommendation:

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

Q# LOK LOD

(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation

Focus Dist. Link units ward K/A Only

1. The ED declares that the cross connection of 1DA and 1DB is

necessary for the protection of health and safety of the public.

This would then help in the decision for the SS to comply with

the cross connection of the power supplies. There is a lot of

information not identified that should be here.

2. The reference provided is associated with the EOP users Guide.

The KA is the lines or authority during implementation of the

S EPlan. These are different.

Thursday, October 13, 2011

1. SUGGESTED REPLACEMENT, DID NOT LIKE. VERY

SIMPLE. Changed second part for the new question. Not

ready yet.

VC Summer 2011-301 Examination

ES-401, Rev. 9 Written Examination Review Worksheet Form ES-401-9

ES-401, Rev. 9 2 Form ES-401-9