ML23017A121

From kanterella
Jump to navigation Jump to search

Review Worksheets
ML23017A121
Person / Time
Site: Limerick  Constellation icon.png
Issue date: 12/05/2022
From:
Constellation Energy Company
To: Thomas Setzer
NRC/RGN-I/DORS/OB
References
EPID L-2023-OLL-0012
Download: ML23017A121 (1)
v • d • e


Text

Form 2.3-3 Operating Test Review Worksheet (JPMs)

Facility: Limerick Exam Date: December 5, 2022 1

JPM # or title 2

Type (S/P/A) 3 ALT (Y/N) 4 LOD (1-5) 5 JPM Errors 6

U/E/S 7

Explanation LOD REF IC TSK CUE CS TL RO Admin 1 -

Determination of Decay Heat (2.1.25, Ability to interpret reference materials, such as graphs, curves and tables. IMP 3.9)

(LOJPM6735)

A N

2 E

  • Answer key (copy of student cue sheet with answers filled in) added
  • Evaluator materials list to be provided now includes ALL TRIP procedures flowcharts
  • T-103 added on ref sheet at back of JPM
  • Added Evaluator note there are 2 methods and 2 acceptable answers
  • Steps 3 and 5 address use of both chart and graph

A N

2 E

  • Corrected date to 12/5/22
  • Entered N/A for step 4.5.9.2 on ST attachment to avoid confusion
  • Time 25 minutes
  • Added Header NAME added to student CUE Sheet RO Admin 3 - Gaseous Effluent Dose Rate Determination (2.3.11, Ability to Control Radiation Releases, IMP 3.8) (LOJPM6706)

A N

3 E

  • Rows removed from answer Sheet, just 2 columns
  • Chart of RM values -> moved release rate to end
  • Answer key, now includes Both JPM step AND procedure step
  • Broke out critical steps into individual steps for each item
  • Added Header NAME added to student

CUE Sheet RO Admin 4 -

Determination of Emergency Preparedness Equipment (2.4.3, Ability to Identify Post Accident Instrumentation, IMP 3.7)

(LOJPM6736)

A N

2 E

  • Removed monitoring Plan Changed to:

o The Shift Manager directs you to determine which equipment should be used to assess conditions specific to the R2 category of EAL classifications including:

o Instrumentation currently available to assess conditions specific to the R2 category of EAL classifications

  • Changed initiating cue wording Recognition Category, to:

o Determine all available instrumentation, which can be used to assess conditions specific to the R2 category of EAL classifications

  • Added Header NAME added to student CUE Sheet

Form 2.3-3 Operating Test Review Worksheet (JPMs)

Facility: Limerick Exam Date: December 5, 2022 1

JPM # or title 2

Type (S/P/A) 3 ALT (Y/N) 4 LOD (1-5) 5 JPM Errors 6

U/E/S 7

Explanation LOD REF IC TSK CUE CS TL SRO Admin 1 -

Determination of Decay Heat (2.1.25 Ability to Interpret reference materials such as graphs, charts etc.

IMP 4.2 (LOJPM6769)

A N

3 E

  • Answer key (copy of student cue sheet with answers filled in) added
  • Evaluator materials list to be provided now includes ALL TRIP procedures flowcharts
  • T-103 added on ref sheet at back of JPM
  • Added Evaluator note there are 2 method and 2 acceptable answers
  • Steps 3 and 5 address use of both chart and graph
  • Added Header NAME added to student CUE Sheet SRO Admin 2 - Perform a Shift Turnover (2.1.3, Knowledge of shift or short term relief turnover practices, IMP 3.9) (LOJPM6754)

A N

2 E

  • Initial conditions date corrected to 12- 05-22
  • Added LCO Log with RCIC and A ESW INOP.
  • Removed check mark from LCO log review
  • Added Evaluator NOTE: Have copy of UNIT 2 TECH SPECS available for use in room in room
  • Amplify evaluators note for CREFAS, Not a TS requirement, Station Risk
  • Added Evaluator Note that candidate may also identify A CREFAS testing should not occur during B ESW Flush; this is a station risk concern, not TS, and is not expected to be identified. This is not critical.

Form 2.3-3 Operating Test Review Worksheet (JPMs)

SRO Admin 3 - Evaluate Valve Stroke Data (2.2.45, Ability to Determine Tech Specs with action statements of greater than 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br />, IMP 4.7) (LOJPM6766)

A N

2 E

  • Added Noun name for F020 recirc sample valve to cues
  • Deleted Step 8
  • Initiating CUE -added PRO complete through 4.3
  • Step 3 added note that CUE may not be needed SRO Admin 4 - Review and Approve Inventory Release from Equipment Drain Sample Tank to Cooling Tower Blowdown Line (2.3.11, Ability to Approve Liquid or Gaseous Release Permits, IMP 3.8)

(LOJPM6726)

A N

3 E

  • Updated initial conditions to reflect a change from reviewing a release in progress to approving a release.
  • Made step 5 critical to assess whether or not to approve release.

Updated task standard and initiating cue accordingly.

  • Remarked master copies of procedures to reflect approval of release instead of release already in progress.
  • Editorial rearrangement of initial conditions for better grouping SRO Admin 5 -

Determine Equipment for Post Accident and Classify Event (2.4.41, Classify Event, 2.4.3, Identify Post Accident Instrumentation, 4.6, 3.9) (LOJPM6737)

A N

3 E

  • Step 3 added pg 6 to standard
  • Step 4 added pg 10 to standard
  • Student cues-changed from develop a contingency plan to determine which equipment should be used
  • For 2 part JPM, List initial conditions 1 and 2 with standard 1 and 2 o Added page between initial and second cues with appropriate verbiage for evaluator to only provide part 1 cue at this time.

o Added verbiage that part 2 of JPM is time critical.

o JPM Summary Page, broke out time 20/15 for parts 1 & 2 respectively.

Form 2.3-3 Operating Test Review Worksheet (JPMs)

Control Room Systems

a. Align SLC Pump for Automatic Operation (211000

- Standby Liquid Control, A1.09 IMP 3.8)(LOJPM3767)

S N

2 E

  • Mark up procedure S48.1A through step 4.6.6 o Added note for evaluator to provide candidate with a copy of S48.1.A, Standby Liquid Control System Set-Up For Normal Operation marked up through step 4.6.6
  • Fix step 4, step 4 now states:

o Examinee signs step and proceeds to 4.7

  • Edit task standard:

o The 1C SLC Pump aligned for automatic injection with SS-48-104C-1 switch to "ENABLE", 1C SLC Pump control switch in normal.

  • Typo in NOTE: above step 5 fixed (RRCS)
b. Removing RFP from Service to Standby (259001-Feedwater System, A4.02, IMP 4.0) (LOJPM3008)

S Y

2 E

  • JPM updated to allow RFP min-flow valve operation in manual o Malfunction table and triggers added o Task standard updated:

1C Reactor Feed Pump removed from service per S06.2.C U1 Upon recognition of failed closed Min Flow Valve:

  • Min flow valve in manual and open OR
  • Reactor Feed Pump tripped o Steps added to address change o Added reference to procedure S06.0.A U/1 MANUAL ADJUSTMENT OF REACTOR FEED PUMP MINIMUM RECIRCULATION FLOW
  • Added reference to procedure S06.1.H U/1 RESPONDING TO ALARMS AND SELECTED EVENTS AT THE FEEDWATER LEVEL CONTROL SYSTEM

Form 2.3-3 Operating Test Review Worksheet (JPMs)

OPERATOR STATION

  • Added evaluator note and cue for the following:

Simulator DFWLC HMI panel displays alarm as 1XX-FW317.ICHD Minfl C Clsd Hi Dmnd S06.1.H U/1 lists alarm as 1XX-FW317.ICDH Minfl C Clsd Hi Dmnd If Candidate identifies difference provide CUE: Procedure discrepancy has been identified and captured, continue with the task

  • Added evaluator note for the following above new step to open min flow valve:

Candidate may reference S06.0.A U/1 MANUAL ADJUSTMENT OF REACTOR FEED PUMP MINIMUM RECIRCULATION FLOW

Form 2.3-3 Operating Test Review Worksheet (JPMs)

Facility: Limerick Exam Date: December 5, 2022 1

JPM # or title 2

Type (S/P/

A) 3 ALT (Y/N) 4 LOD (1-5) 5 JPM Errors 6

U/E/S 7

Explanation LOD REF IC TSK CUE CS TL

c.

EHC Pump Operability Test (241000 Rx/Turb Press. Reg System A2.20, IMP 3.4)(LOJPM3163)

S Y

2 E

  • Add Printout of S31.6C o Added S31.6.c Rev 09 to validation checklist and references o Added note for evaluator:

Provide candidate with a copy of RT-6-031-320-1, Unit 1 EHC Pump Operability/ Performance Check IF required during performance of JPM provide copy of:

  • S31.6.C Swapping Operating EHC Pumps
  • Alternate steps to stop B pump should be critical 15/14 o Steps now critical
  • Update task standard:

1A EHC pump secured IAW the ST. Following report of leak on 1B EHC pump:

  • 1A EHC pump restarted
  • 1B EHC pump secured
d. RCIC Recovery from Steam Line Isolation (217000 RCIC System, A4.14 IMP 3.9)(LOJPM3016)

S N

2 E

  • Provide marked up copy of procedure S49.1B through step 4.1.1 Added note for evaluator:
  • Provide candidate with a copy of S49.1.B, Recovery From RCIC Steam Line Isolation and Resultant Turbine Trip marked up through step 4.1.1
  • Modified step 13 to include ARC window number, now reads:

Form 2.3-3 Operating Test Review Worksheet (JPMs) o IF RCIC TURB INLET DRAIN POT HI LEVEL, annunciator 116 RCIC D-2 alarms

e. Reset Rx Enclosure Hi Rad Isolation (290001 -

Secondary Containment, A4.11, Imp 3.5)

(LOJPM3075)

S N

2 E

  • Task standard updated:

o Updated task standard to Unit 1 Reactor Enclosure Radiation isolation reset per GP-8 U/1 Attachment 3 Step 1, with the SGTS fans stopped

  • Added the word CUE to steps 6a through 6h for Unit 2 operator actions
f.

GP-11 Scram Reset - (212000

- Rx Protection System, A4.14, Imp. 3.8)

(LOJPM3001)

S Y

3 E

  • Task standard updated:

o Insert a full reactor scram signal upon recognition that multiple HCUs will not reset after 2nd attempt in accordance with GP-11 Scram Reset, step 3.10.1

  • Added Evaluator note to step 3:

o Evaluator Note: If needed, provide key for Scram Discharge Volume High Level Bypass Switch

g. Alternate Cooling of RECW Heat Exchangers (400000 Component Cooling Water, A2.01, Imp.-

4.1)(LOJPM3052)

S N

3 E

  • Task standard updated:

o Unit 1 and Unit 2 'A' RECW Heat Exchangers supplied by the ESW System. In accordance with S11.8.A Alternate Cooling of RECW Heat Exchanges, section 4.2

  • Added initial condition: No seismic event has occurred
  • JPM starting point changed to start at step 4.2.2 o JPM steps prior to starting point (steps 1,2,3) deleted o Initiation que modified to provide starting point at step 4.2.2:

Form 2.3-3 Operating Test Review Worksheet (JPMs)

The Shift Manager directs you to supply ESW to the U/1

'A' RECW Heat Exchanger, per S11.8.A, Alternate Cooling of RECW Heat Exchangers starting with step 4.2.2 o Evaluator note added:

EVALUATORS NOTE: Provide a copy of S11.8.A Alternate Cooling of RECW Heat Exchanges marked up through step 4.2.1

  • Added evaluator note for CUE if Hi Diff flow ANN is received:

o CUE (if needed): Another operator will respond to ARC-MCR-011 C-1 ESW Loop B Hi Diff Flow.

h. Manually Initiate a MCR Chlorine Isolation (290003, Control Room Ventilation, A3.01, Imp-3.7)(LOJPM3023)

S N

3 S

Form 2.3-3 Operating Test Review Worksheet (JPMs)

Facility: Limerick Exam Date: December 5, 2022 1

JPM # or title 2

Type (S/P/A) 3 ALT (Y/N) 4 LOD (1-5) 5 JPM Errors 6

U/E/S 7

Explanation LOD REF IC TSK CUE CS TL In-Plant Systems

i. Maximizing CRD Cooling Water Header Flow During ATWS Conditions T-219 (201001, Control Rod Drive Hyd, A4.05, IMP 3.3)(LOJPM2264)

P N

3 S

j. Manual Start of a Diesel Generator (264000 -

Emergency Generators, A2.09, Imp 4.7)

(LOJPM2276)

P Y

3 S

k.

Initiate Reactor Scram and MSIV Closure from the AER per SE-1 (212000, RPS, A2.20, Imp. - 4.3)

(LOJPM2221)

P N

3 S

Form 2.3-3 Instructions for Completing the JPM Table

1. Enter the JPM number and/or title.
2. Enter the type of JPM(S)imulator, (P)lant, or (A)dministrative.
3. Enter (Y)es or (N)o for an Alternate Path JPM.
4. Rate the level of difficulty (LOD) of each JPM using a scale of 1-5 (easy-difficult). A JPM containing less than two critical steps, a JPM that tests solely for recall or memorization, or a JPM that involves directly looking up a single correct answer is likely LOD = 1 (too easy). Conversely, a JPM with over 30 steps or a JPM that takes more than 45 minutes to complete is likely LOD = 5 (too difficult).
5. Check the appropriate block for each JPM error type, using the following criteria:

LOD = 1 or 5 is unsatisfactory (U).

REF: The JPM lacks required references, tools, or procedures (U).

IC: The JPM initial conditions are missing or the JPM lacks an adequate initial cue (U).

CUE: The JPM lacks adequate evaluator cues to allow the applicant to complete the task, or the evaluator cues are subjective or leading (U).

TSK: The JPM lacks a task standard or lacks completion criteria for a task standard (U).

CS: The JPM contains errors in designating critical steps, or the JPM lacks an adequate performance standard for a critical step (U).

TL: The JPM validation times are unreasonable, or a time-critical JPM lacks a completion time (U).

6. Mark the JPM as unsatisfactory (U), satisfactory (S), or needs enhancements (E). A JPM is (U) if it has one or more (U) errors as determined in step 5. Examples of enhancements include formatting, spelling, or other minor changes.
7. Briefly describe any JPM determined to be unsatisfactory (U) or needing enhancement (E). Save initial review comments and detail subsequent comment resolution so that each exam-bound JPM is marked by a satisfactory (S) resolution on this form.

Form 2.3-3 Operating Test Review Worksheet (Scenarios)

Facility: Limerick Scenario: 1 SEG-6225E Exam Date: December 5, 2022 1

Scenario Event ID/Name:

2 Scenario event errors 3

U/E/S 4

Explanation Realism/

Credibility Performance Standards Verifiable Actions Critical Task TS 1

N-BOP N-SRO S

2 R-ATC S

3 TS S

TS 4

I-BOP I-SRO E

Added MC to 3.3-1 for event 4 HWC failure 5

C-BOP C-SRO S

6 C-ATC C-SRO TS S

TS 7

M-ALL S

CT-1, CT-2 8

MC-ATC S

9 I-ATC I-SRO S

10 C-ATC C-SRO S

CT-3 11 C-BOP MC-BOP I-SRO S

SAT

Form 2.3-3 Operating Test Review Worksheet (Scenarios)

Facility: Limerick Scenario: 2 SEG-3159E Exam Date: December 5, 2022 1

Scenario Event ID/Name:

2 Scenario event errors 3

U/E/S 4

Explanation Realism/

Credibility Performance Standards Verifiable Actions Critical Task TS 1

N-BOP N-SRO S

2 MC-BOP C-BOP C-SRO S

3 MC-BOP C-ALL TS E

Evaluated TS 3.5.1 and Tech spec LCO not met as the pumps autostarted on LOCA and will never receive another auto start signal until and unless the Inadvertent LOCA signal is reset.

4 TS-SRO E

Removed TS 3.4.1.3.b reference 5

I-ATC MC-ATC I-SRO TS E

Added Functional Unit 3 reference to TS 3.3.1-1 6

C-BOP C-SRO E

Added GP-4 action to assessment 7

M-ALL E

SS Boundary condition in T-103.4 has HPCI system isolation within 15 minutes. This is not necessary Removed HPCI system isolation required with 15 minutes boundary condition from T-103.4 Critical task and updated with the correct time bounding of within 10 minutes of exceeding MSO 8

C-ATC C-SRO S

9 C-BOP C-SRO S

10 C-BOP C-SRO S

SAT

Form 2.3-3 Operating Test Review Worksheet (Scenarios)

Facility: Limerick Scenario: 3 SEG-2164E Exam Date: December 5, 2022 1

Scenario Event ID/Name:

2 Scenario event errors 3

U/E/S 4

Explanation Realism/

Credibility Performance Standards Verifiable Actions Critical Task TS 1

N-BOP N-SRO S

2 C-BOP C-SRO TS S

TS 3

C-ALL S

4 I-ATC I-SRO S

5 R-ATC C-BOP C-SRO TS S

TS 6

C-ALL E

Created manual trigger to insert guard bed failure and offgas charcoal bed failure if crew fails to scram after exceeding 300 scfm 7

C-ATC MC-ATC C-SRO E

Adjusted critical task T-101.1 safety sign.

Boundary condition 8

M-ALL S

CT-2 9

C-BOP C-SRO S

10 C-BOP MC-BOP C-SRO S

SAT

Form 2.3-3 Instructions for Completing the Scenario Table

1. For each scenario, enter the scenario event names and descriptions.
2. Review the individual events contained in each scenario, and identify and mark event errors:

The scenario guide event description is not realistic/credibleunsatisfactory (U).

The scenario guide event description lacks adequate crew/operator performance standardsneeds enhancement (E).

The scenario guide event description lacks verifiable actions for a credited normal event, reactivity event instrument/component malfunction, or technical specification (TS) event (or a combination of these) (U).

The scenario guide event description incorrectly designates an event as a critical task (i.e., a noncritical task labeled as critical or a critical task labeled as noncritical). This includes critical tasks that do not meet the critical task criteria (i.e., the critical task does not have a measurable performance standard) (U).

The scenario guide event description incorrectly designates entry into TS actions when not required or does not designate entry into TS actions when required (U).

3. Based on the outcome in step 2, mark the scenario event as unsatisfactory (U), satisfactory (S), or needs enhancements (E). An event is (U) if it has one or more (U) errors as determined in step 2. Examples of enhancements include formatting, spelling, or other minor changes.
4. Briefly describe any scenario event determined to be unsatisfactory (U) or needing enhancement (E). Save initial review comments and detail subsequent comment resolution so that each exam-bound scenario event is marked by a satisfactory (S) resolution on this form.

Form 2.3-5 Written Examination Review Worksheet

Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level 1

F 3

N S

2 F

3 N

S 3

H 3

B E

Distractors A and C may be implausible since RMCS doesnt enforce insert blocks. Consider tying to RPS instead.

Rev history discusses changing reading to 35/125, stem states 28/135 Changed IRM reading to 35/125.

Changed insert blocks to 1A RPS deenergizing Modified interrogative from RMCS response to plant response 4

H 3

N E

Second half of distractor D is subjective.

Spell out MNO Modified distractor D MNO spelled out 5

H 3

N E

In stem, change LPCI to RHR Pump in LPCI mode Place common part of answers into stem Removed common portions of all answers, and rephrased interrogative to support the new wording.

Updated plausibility explanation for distractor A 6

H 3

N S

7 H

3 N

S 8

F 3

B E

Rephrased interrogative, minor edits 9

H 3

N S

10 F

3 N

S 11 H

E N

E Distractor C change reduced suppression capacity to lower water level

Correct answer changed from A to D, and changed answer formatting to 2-column in support of this Modified verbiage in distractors associated vacuum relief alarms to more clearly convey intent.

12 H

3 B

S 13 F

3 N

S 14 F

3 N

S 15 H

3 B

E Stem: change 5 seconds to 10 Distractor C change MSL to inbd/outbd MSIVs Changed 5 to 10 seconds Changed C distractor 16 H

3 N

E Added procedures to stem

Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level 17 F

3 N

E Update KA justification with normal power supplies.

Stem remove reason for the response Answers remove because statements Distractor A add trip immediately Evaluate cognitive level Removed because clauses from answers, making correct answer C instead of B.

Adjusted interrogative to incorporate removed because clause impact statement.

Added immediately to trip distractor Updated K/A justification Left as low cog due to simple recall of power supplies 18 F

3 N

E Added next to interrogative 19 H

3 N

S 20 F

3 N

E Remove 4 hours4.62963e-5 days <br />0.00111 hours <br />6.613757e-6 weeks <br />1.522e-6 months <br /> later from stem.

Change interrogative (1) from design feature to mechanism Removed time component from stem Changed design to mechanism 21 H

3 N

S 22 H

3 B

E Changed Distractor D to does not actuate 23 H

3 N

S 24 H

3 N

E Added verbiage to differentiate HPSP/IPSP with HTSP/ITSP.

25 F

3 N

E Rearranged interrogative for better readability 26 H

3 N

S 27 H

3 B

E Corrected stem typo greed vs green 28 H

3 B

S

29 H

3 N

S 30 H

3 N

E Remove ARC references to NORTH stack (cueing). Combine bullets into valid hi-hi rad at exhaust stack Removed north stack references, added valid high radiation condition on the in service exhaust stack 31 F

3 B

S 32 H

3 B

E Provided indication of one failed seal

Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level 33 F

3 N

E Updated distractor D, all fans running 34 H

3 B

E Distractor C answer explanation - clean up 1st sentence to make clear type of ATWS Determined that stem requires an additional bullet stating SCRAM blue lights are not lit.

This is necessary to eliminate distractor C due to hydraulic ATWS.

Added bullet to stem, all blue lights extinguished Adjusted explanation for distractor C accordingly 35 H

3 N

S 36 F

3 N

E Added only, distractor B 37 H

3 B

S 38 H

3 N

E List procedures alphabetically Include S49.1.A or other in list, change distractor B2 and C2 to include it Corrected procedure order Added T-238 and provided an exhaust pressure (below trip setpoint) for plausibility.

39 H

3 N

S 40 F

3 B

S 41 F

3 B

E Add a bullet about fuel damage to make T-104 plausible Added fuel damage 42 F

3 B

S 43 H

3 N

E Modified stem to say a Middle of Cycle startup inprog 44 H

3 N

E Grammar edit - Unit 2 has experienced a leak.

Interrogative - included question about operating procedure

45 H

3 N

E Non-Regenerative spelled wrong Add noun names for 2F001 and 2F004 valves Corrected spelling Added noun names 46 F

3 N

E Bolded and Underlined normal in stem 47 F

3 N

E Changed distractors C and D from will approach to transitions through 48 H

3 N

E Assess distractors B and D. Too similar.

  • Changed distractor B
  • Enhanced wording in all distractors to add clarity.
  • Correct answer moved to D from C

Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level 49 F

3 N

S 50 F

3 N

S 51 F

3 N

E Explanations for distractor C and D are transposed, corrected 52 H

3 N

E Incorporated station OE in K/A justification 53 H

3 N

E Made Immediate bold and underline 54 F

3 N

S 55 F

3 N

E Corrected explanation for distractor A 56 F

3 B

E Spelled out CRDH 57 F

3 N

E Added noun name for HV-006-120 58 H

3 B

S 59 H

3 N

E Interrogative (2) who is required to be notified (bold underline) 60 H

3 N

S 61 F

3 B

E Corrected stem - reason to design criteria 62 F

3 N

E Changed answers from vapor quality to steam quality 63 H

3 N

S 64 H

3 N

E Added normal stack exhausts in answer explanation

Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level 65 F

3 N

S 66 H

3 N

S 67 H

3 N

E Made the soonest bold underline 68 F

3 N

E

  • Stem a recent revision to an operations administrative procedure
  • Consider changing the item being communicated to make more op focused Selected more operationally focused condition, new correct answer 69 H

3 N

E

  • Remove safe and unsafe from curve
  • For rate of depressurization, consider changing this to whether exceeding 100 F/Hr is allowed or not
  • Removed safe and unsafe
  • Changed part 2 of answers as requested 70 H

3 N

S 71 H

3 B

S 72 H

3 N

E

  • Distractor B reactor pressure rises to 25 psig
  • Change to Steam Leak instead of LOCA (plausibility, remove confusion)
  • Changed distractor as described 73 F

3 N

S 74 H

3 N

S 75 F

3 N

E Corrected capitalization on Suction Flows in stem 76 H

3 N

E

  • Interrogative (1) tech spec system which requires LCO entry
  • Assess answers, and whether bypassing RWM is possible/plausible/expected, making B and C both correct. Possibly change interrogative.
  • Changed interrogative to address both comments 77 F

3 N

E Look for another distractor that might include a tech spec in the title for A. Too easy as is

  • Adjusted answer order such that A is the correct answer.

78 H

3 N

E

  • Answer A, make it clear that no other pumps are available. Suggestions: 1B CRD Pump is the only injection source available or RPV pressure is 100 psig, and only 1B CRD Pump is injecting
  • Add KA justification
  • Adjusted answer to make clear no other injection source.
  • Correct answer was moved to D
  • Added KA justification 79 H

3 N

E

  • First bullet remove s from indicates (grammar)
  • Write SRO only justification
  • Document why expected instead of required
  • Typos in B answer explanation
  • Corrected typo
  • Added SRO only justification
  • Documented expected vs required
  • Corrected typos 80 H

3 N

E Include procedure and action, maybe 2 column if needed, to raise LOD Updated to procedure directed and reason why.

Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level 81 H

3 N

E Included in answer explanation what T-102 entry is as compared to ARC etc.

82 H

3 N

S 83 H

3 N

S 84 H

3 N

S 85 H

3 N

S 86 F

3 N

E Removed EP manager, adjusted answers accordingly.

87 H

3 N

S 88 H

3 N

S 89 H

3 N

E

  • Corrected spelling error - inadvertently
  • Changed to OPCON 2 90 H

3 N

E Removed Consider HPCI RCIC 91 H

3 N

E

  • Interrogative (1) determine the minimum design pH
  • Consider changing column (1) to acidic or basic
  • Reworded interrogative
  • Left column 1 as is, because the design minimum pH is neutral, not acidic or basic 92 F

3 N

E Missing answer explanations

  • Rearranged answers to C
  • Added explanations 93 H

3 N

E Rephrased question to test CRS ability to direct actions 94 H

3 N

S 95 F

3 N

E Deleted (2) and make D exit not allowed OR give conditions related to 1, 3, and 4 and then ask which condition allows exiting TRIPs 96 F

3 N

S

Q#

1.

LOK (F/H)

2.

LOD (1-5)

3. Psychometric Flaws
4. Job Content Flaws
5. K/A Use Flaws
6. Source (B/M/N)
7. Status (U/E/S)
8. Explanation Stem Focus Cues T/F Cred.

Dist.

Partial Job Link Minutia

  1. /Units Logic Q-K/A License Level 97 H

3 N

S 98 H

3 N

E Changed voice of question away from CRS enters 99 F

3 N

E

  • Changed voice of question away from CRS enters
  • Answers A and C, changed permission to direction 100 H

3 B

S ALL Answer distribution skewed:

RO: A-22, B-19, C-17, D-17 SRO: A-6, B-11, C-7, D-1 Adjusted distribution RO 19/18/19/19 SRO 6/7/6/6 Total 25/25/25/25 ALL For SRO questions, ensure CFR 55.43 is adequately tied. Specifically Q # 76, 80, 81, 83, 88, 92, 93, 99.

Add correct 55.43 reference to KA Verified appropriate 55.43 reference in each listed question ALL For SRO questions, modified the voice from CRS directs to What would you direct.

Form 2.3-5 Instructions for Written Examination Review Worksheet Refer to ES-4.2 for the definitions of terms used in this worksheet for the written examination.

Review each question (Q) as submitted and as subsequently revised and document the following in the associated worksheet columns:

1. Enter the level of knowledge (LOK) as either (F)undamental or (H)igher cognitive level.
2. Enter the level of difficulty (LOD) from 1 (easy) to 5 (difficult); mark direct lookup questions (applicant can directly determine the answer from the provided reference) as LOD 1. A question is (U)nsatisfactory if it is LOD 1 or LOD 5.
3. Check the appropriate box if a psychometric flaw is identified:

Stem Focus: The stem lacks enough focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information). This is an (U)nsatisfactory question.

Cues: The stem or one or more answer choices contains cues (e.g., clues, specific determiners, phrasing, length). This is an (U)nsatisfactory question.

T/F: All of the answer choices are a collection of unrelated true/false statements. This is an (U)nsatisfactory question.

Cred. Dist.: The distractors are not credible; single implausible distractors require (E)nhancement, and more than one noncredible distractor in the same question results in an (U)satisfactory question.

Partial: One or more distractors are partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by the stem). This is an (U)nsatisfactory question.

4. Check the appropriate box if a job content flaw is identified:

Job Link: The question is not linked to the job requirements (i.e., the question has a valid knowledge or ability (K/A) but, as written, is not operational in content). This is an (U)nsatisfactory question.

Minutia: The question requires the recall of knowledge that is too specific for the closed-reference test mode (i.e., it is not required to be known from memory). This is an (U)nsatisfactory question.

  1. /Units: The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons). This is an (U)nsatisfactory question.

Logic: The question requires backward or reverse logic or application compared to the job requirements. This is an (U)nsatisfactory question.

5. Check the first box if a K/A mismatch flaw exists. Check the second box if the question is flawed because it is written at the wrong license level. Either condition results in an (U)nsatisfactory question.
6. Enter the questions source: (B)ank, (M)odified, or (N)ew. Verify that (M)odified questions meet the criteria of ES-4.2.
7. Based on the review performed in steps 2-5, mark the question as (U)nsatisfactory, in need of (E)nhancement, or (S)atisfactory.
8. Fully explain the reason for any (U) in column 7 (e.g., how the psychometric attributes are not being met).
9. Save the initial review comments and detail subsequent comment resolution so that each exam-bound question is marked by an (S) on this form.

marked by an (S) on this form.

Retrieved from "https://kanterella.com/w/index.php?title=ML23017A121&oldid=5453695"