ML073130563

NRC Comments on Draft Licensee-Developed Beaver Valley 1 Operator Licensing Exam (Written & Operating Tests) (Folder 2)

ML073130563
Person / Time
Site:	Beaver Valley
Issue date:	10/14/2007
From:	Todd Fish NRC Region 1
To:	FirstEnergy Nuclear Operating Co
Fish T
Shared Package
ML072040334	List: ML072050449 ML073100303 ML073130563
References
Download: ML073130563 (9)

Text

ES-401 -

Written Examination Review Worksheet BV1 Nov. 2007 Form ES-401-9

1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7.

3# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO U/E/S Explanation Focus Dist. Link units ward WA Only Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.

Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating scale (questions in the 2 -

4 range are acceptable).

I. Check the appropriate box if a psychometric flaw is identified:

0 The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed or too much needless information).

0 The stem or distractors contain cues (Le., clues, specific determiners, phrasing, length, etc.).

0 The answer choices are a collection of unrelated true/false statements.

0 The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.

0 One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).

Check the appropriate box if a job content error is identified:

0 The question is not linked to the job requirements (Le., the question has a valid WA but, as written, is not operational in content).

0 The question requires the recall of knowledge that is too specific for the closed reference test mode (Le., it is not required to be known from memory).

0 The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).

0 The question requires reverse logic or application compared to the job requirements, Check Questions that are sampled for conformance with the approved WA and those that are designated SRO-only (WA and license level mismatches are unacceptable).

Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement),

in need of (E)ditorial enhancement, or (S)atisfactory?

At a minimum, explain any Uratings (e.g., how the Appendix B psychometric attributes are not being met).

ES-401 2 Form ES-401-9

Memo To: Todd Fish From: Rich B r o o k s p w - .

Date: 10/26/2007 Re: Walkthrough Comments The below listed modifications were made to the Operating exam as a result of our walkthrough validations.

JPM WALK THRU COMMENTS RO A I .I Changed the last word on the Initiating Cue (both sheets) from JPM to OST RO A I .2 No changes RO A2 No changes RO/SRO Added more detail to Initial Conditions as to the location of 1CH-324, Added - 1CH-324, A3 located directly below MOV-1CH-308c also added MOV-ICH-308C located in A Penetrations, On Rad Survey sheet for APenetrations, revised Dose rates associated with MOV-ICH-308A (because in transit path to work location)

SRO Changed the InitiatingCue (both sheets) from remainder of JPM to remainder of OST.

A I .I Better defined the Initiating Cue expectations regardingTS Actions, by adding - TS Actions required for this shift Added TS 3.2.4 to list of Handouts to be provided to Candidate.

SRO Added additional information to the NOTE below JPM Step 2, to give evaluator information A I .2 that candidate may state that the RO could be forced in for the shift with additional Management approvals.

JPM S I No changes JPM S2 Modified the alternate path malfunction to include a demand signal failure. Revised step 10 of the JPM to address this modified malfunction.

JPM S3 No changes JPM S4 Deleted steps 2 through 6 of JPM and added this informationto the JPM initial conditions.

1

JPM S5 No changes JPM S6 Deleted next procedure step in CUE for step 11.

JPM S7 Added a CUE to step 8 of the JPM JPM S8 Modified Standard for steps 1 and 2 of the JPM to address Train B power supply status.

JPM P I Made steps 3 and 4 NOT critical. Added new step 8 to JPM.

JPM P2 Added additional plant nomenclatures to JPM steps.

JPM P3 Clarified CUE in step 5; Added rotating voltmeter selector switch to step 9; Added voltage range to CUE in step 10 and designated step 10 critical; revised step 11 CUE; deleted step 12.

SCENARIO WALK THRU COMMENTS Scenario 1 Reduced Initial power level to 90%; Moved PRZ master pressure controller failure to event 5 instead of event 3; slowed the rate on PRZ master pressure controller failure to 120 seconds; modified field report for racking the C river water pump onto the AE bus.

Scenario 2 Moved LHSl common mode failure to Event 1; Modified turnover to now read maintain current power level; added plant management CUE to commence immediate plant shutdown due to TS 3.0.3; added additional PO activities in FR-H.l Scenario 3 Moved SG B feed flow failure to event 5 instead of event 3; added procedural reference for governor valve limiter recovery; designated PORV isolation as critical; designated throttling AFW as NON critical; 0 Page2