ML082950349

NRC Comments on Draft Licensee-Developed Exam (Written & Operating Tests) (Folder 2)

ML082950349
Person / Time
Site:	Ginna
Issue date:	09/17/2008
From:	NRC Region 1
To:
Hansell S
Shared Package
ML080030004	List: IR 05000244/2008301 ML081360258 ML082950349 ML082950384 ML082950389 ML082950422 ML082950425 ML082950432 ML083110590 ML083110619 ML083110659 ML083110665 ML083510111 ML083660253
References
TAC U01687
Download: ML082950349 (9)

Text

ES-401 Written Examination Review Worksheet Form ES-401-9

1. Enter the level of knowlerlrp !I OK! nf e& quer?inr!8 s either (F)u~dem~n!n!cr <U)ighc: cogni:ivs !=;el.

2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 - 4 range are acceptable).

3.

Check the appropriate box if a psychometricflaw is identified:

The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).

0 The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc).

The answer choices are a collection of unrelated true/false statements.

0 The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

4. Check the appropriate box if a job content error is identified:

0 The question is not linked to the job requirements (i.e., the question has a valid WA but, as written, is not operational in content).

0 The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).

The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

The question requires reverse logic or application compared to the job requirements.

5. Check questions that are sampled for conformance with the approved WA and those that are designated SRO-only (WA and license level mismatches are unacceptable).

6. Enter question source: (B)ank, (M)odified,or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.

7. Based on the reviewers judgment, is the question as written (U)nsatisfactory(requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

8. At a minimum, explain any U ratings (e.g., how the Appendix B psychometricattributes are not being met).

ES-401 2 Form ES-401-9

2008 Ginna NRC Exam: JPM/Si mulator Scenario Comments and Resolutions The following are comments made during validation and the corrections incorporated.

I. JPMs A. Simulator/Plant JPMs

1. JPM A: Added to initial cue the plant has been operating for 16 months at rated power and reshot I/C with an EOL core to support the 100 gallon water addition.

Step 9 no longer a critical step.

2. JPM B: Added notes for the Evaluator and Booth Operator to keep the simulator in Freeze until the candidate has the watch to prevent the depletion of the RWST.

Inserted evaluator cue for steps 15 and 16 to inform candidate of SW and CCW flows and alignments.

3. JPM C: At NRCs request added (1) critical step for the candidate to determine that accumulator nitrogen pressure is low and identify corrective actions. Added examiners note for information only, the setpoint of the accumulator low pressure alarm.

4. JPM D: Condensed initiating cue.

5. JPM E: At NRCs request altered initiation of JPM and requested recommendation from candidate on procedure use due to plant conditions. Added information to Examiners Notes, candidate may perform actions from memory but must verify actions with the procedure.

6. JPM F: Changed steps 11 and 1 3 to non-critical steps and changed step 19 to be a critical step. Rearranged cues in step 2. Clarified performance step 3. Removed cue from step 19.

7. JPM G: None.

8. JPM H: None.

9. JPM I: None.

10. JPM J: None.

11. JPM K: None.

B. Admin JPMs

1. RA-1: Added note for examiner concerning rod control. Added amplifying cue if needed at the end of the JPM, included bank and step if Bank B is used.

2. RA-2: Added note to examiner concerning correct usage of data sheet. Changed acceptance criteria based on feedback during validation. Changed to a simulator admin JPM based on readabilitjr of meters required to perform JPM.

3. RA-3: Changed all references from tagout to holds. Added Cues and Notes for examiner to clarify responses arid required tasks. Added other possible vent path.

Added No Tag as an option on vents and drains.

4. RA-4: Added procedure numbers to standard blocks where applicable. Added additional clarification in Initiating Cue.

5. SA-1: None.

6. SA-2: None.

7. SA-3: Changed all references from tagout to holds. Added Cues and Notes for examiner to clarify responses arid required tasks.

8. SA-4: Changed Delay to Decay, changed to A GDT and added procedure S-4.2.5, Release of Gas Decay Tank.

9. SA-5: None.

11. Simulator Scenarios A. Scenario 1

1. Event 1 - Removed BOP credit for Instrument malfunction reclassified Event Type to I-SRO.

2. Event 5 - Ensured RCP Vibration ramped to allow for candidate evaluation of tripping the Reactor and RCP.

B. Scenario 2

1. Rearranged first four events to allow better evaluation of RCS leak rate.

2. Changed letdown setup from 60 gals to 40 gals to ensure makeup capacity to VCT was not exceeded with the given RCS leak rate.

3. Put ramp on PRZR Pressure controller failure to ensure candidates would respond prior to needing a reactor trip.

4. Removed ATC credit for component malfunction for RCS leak. Changed event type to C-SRO and TS-SRO.

5. Added malfunction of RWST level post EOP entry to evaluate candidate awareness of actual ES- 1.3 entry conditions vs. instrument failure.

6. Event 5 - Ensured ramp of malfunction provided enough opportunity for candidate intervention prior to reactor trip on S/G level.

C. Scenario 3

1. Event 3 - Reclassified from C-SRO and TS-SRO to TS-SRO.

2. Event 5 - Ensured ramp rate allowed for candidate response prior to reactor trip on S/G level. Added steps for SRO determination not to trip second channel and removed defeat steps.

D. Scenario4

1. Event 6 - Added Auto Failure of TDAFW Pump to start and then later after one S/G > 7% NR, fails TDAFW Pump Speed to zero. Added Event Type C-BOP.

E. Scenario 5

1. No comments, spare scenario.