ML071570402: Difference between revisions

From kanterella
Jump to navigation Jump to search
(Created page by program invented by StriderTol)
(Created page by program invented by StriderTol)
Line 15: Line 15:


=Text=
=Text=
{{#Wiki_filter:A.pril 18, 2006 NOTE TO: Steve Garchow Chief Examiner, Operations Branch FROM: Anthony T. Gody, Chief Operations Branch Division of Reactor Safety  
{{#Wiki_filter:A.pril 18, 2006 NOTE TO: Steve Garchow Chief Examiner, Operations Branch FROM:       Anthony T. Gody, Chief Operations Branch Division of Reactor Safety


==SUBJECT:==
==SUBJECT:==
EXAM I NAT IO N ASS I GN M EN1 You have been assigned as Chief of the Columbia Generating Station examination.
EXAMINATION ASS IGNMEN1 You have been assigned as Chief of the Columbia Generating Station examination. The operating test has been scheduled to be completed by December 1, 2006. Thank you for contacting the Columbia Generating Station facility to finalize the details of the examination You are reminded that the RPSllP system must be maintained to ensure that the exarninm and numbers of candidates are accurate. In addition, you are reminded that only qualified examiners are permitted to conduct any part of the examination.
The operating test has been scheduled to be completed by December 1, 2006. Thank you for contacting the Columbia Generating Station facility to finalize the details of the examination.
Division of Reactor Safety
You are reminded that the RPSllP system must be maintained to ensure that the exarninm and numbers of candidates are accurate.
 
In addition, you are reminded that only qualified examiners are permitted to conduct any part of the examination.
Replaces NUREG1021 Revision 9, ES Forms 201-1 and 501-?
Division of Reactor Safety Replaces NUREG1021 Revision 9, ES Forms 201-1 and 501-? Pq Due I Description Date Date Complete Initials I I
Pq Due Date I Description IDate Complete I Initials   Notes produced by Chief Examiner produoed by OLA
                                                                                                                                    ~
print Report-21
                                                                                                        ~ produced by Chief Examiner
* Indicates the due dates are more conservative than the ES-201-1 requires.
* Indicates the due dates are more conservative than the ES-201-1 requires.
Notes produced by Chief Examiner produoed by OLA ~ print Report-21
 
~ produced by Chief Examiner ES-201 Examination Outllne Quality Checklist Form ES-201-2 127 10 7 Facility:
ES-201                                 Examination Outllne Quality Checklist                               Form ES-201-2 Facility:                                                                               Date of Examination: II 127    10 7 Initial Task Description a   I   b' 1.
Date of Examination:
1111 I a. Verify that the outline(s) fit@)the appropriate model, In accordance wjth ES-1.
I I Initial Task Description a I b' 1. I a. Verify that the outline(s) fit@) the appropriate model, In accordance wjth ES-1. 1111 R I b. Assess whether the outline was systematically and randomly prepared in accordance wifh Section D.l of E$-401 and whether all WA categories are appropriately sampled. c. Assess Wether the outline overemphasizes any system, evolutions, or generic topics. d. Assess whether the justifications for deselxted or rejected WA statements are appropriate.
R       b. Assess whether the outline was systematically and randomly prepared in accordance wifh I        Section D.l of E$-401 and whether all WA categories are appropriately sampled.
E of normal evolutions, instrument ad component failures, technical specifications, plicants' audit t&(s) CA tasks meet the criteria a. Author 6. Facility Reviewer (*) c. MRC Chief Examiner (#) d. NRC Supervisor Date I -Y -07 law Note: # Independent PIRC reviewer initial items in Column "c'; chief examiner concurrence required.
: c. Assess Wether the outline overemphasizes any system, evolutions, or generic topics.
ES-201, Page 25 of 27 ES-401 Written Examination Qualitv Checklist Form ES401-6 Facility:
E
blo/H b; Date of mm:' I/z!/,& Exam Level: ROlSRO Initial I I 4. If more than four RO and two SRO questions are repeated from the last two MRC licensing
: d. Assess whether the justifications for deselxted or rejected WA statements are appropriate.
: 5. Question duptication from the license screeninglaudit exam was controlled as ' dicated below (check the item that applies) and appears appropriate: - Ah audit exam was systematically and randomly developed tk audit exam was completed before the license exam was started examinations were developed independently licensee certifies that there is no duplication other (explain)
of normal evolutions, instrument a d component failures, technical specifications, plicants' audit t&(s)
I I I New @J $ 6. Bank use meets limits (no more than 75 percent Bank Modifid from the bank, at least 10 percent new, and the rest new or modified);
CA tasks meet the criteria Date
enter the actual RO I SRO-only question distribution(s) at right Between 50 and 60 percent of the questions on the RO exam are written at the comprehension/
: a. Author                                                                                                           I -Y -07
analysis level; the SRO exam may exceed 60 percent if the randomly selected WAS suppott the higher cognitive Levels; enter the actual RO I SRO question distnbution(9) at right. /<tY I LUQI 7. Memorj 8. 9. Referencesthandouts provided do not give away answers or aid in the elimination of distractom. Question content conforms with specific WA statements in the previously approved examination outlhe and is approprlate for the tier to which they are assigned; deviations are justified.
: 6. Facility Reviewer (*)
: 10. Question psychomtric quality and formt meet the guidelines in ES Appedix 6. Id4-h IY 11. Tlae exam contains the required number of onepoint, multiple choice items; the total is correct and agrees with the value on the cover sheet. a. Author b. Facility Reviewr (") c. NRC Chief Examiner (#) d. NRC Regional Supervisor I Note: The facilily reviewer's initialdsignature are not applicable for NRC-developed examinations.  
: c. MRC Chief Examiner (#)
# Independent NRC revlewer initial items in Column "c"; chief examiner comurrence required.
: d. NRC Supervisor law Note:                 # Independent PIRC reviewer initial items in Column "c'; chief examiner concurrence required.
ES-401, Page 29 of 33 ES-301 Operating Test Quality Checklist Form ES-301-3 Facility:
ES-201, Page 25 of 27
CklJ*b ;cy Date of Examination:  
 
''/Z7/ak Operatir 1. General Criteria a. The operating tesf confoms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distriblrtion).
ES-401                                   Written Examination Qualitv Checklist                                 Form ES401-6 Facility:         b l o / H b;                                       Date of m m : ' I/z!/,&               Exam Level: ROlSRO Initial I         I
: b. There is m day-to-day repetition between this and other operating tests to be administered during this examination.
: 4.         If more than four RO and two SRO questions are repeated from the last two MRC licensing
C. The operating test shall not duplicate  
: 5.         Question duptication from the license screeninglaudit exam was controlled as ' dicated below (check the item that applies) and appears appropriate:
$ems from the applicants' audit test(?.). (see Section D.1 .a,) d. Overlap with the written examination and between different parts of the operating test is within acceptable limits. rest Number - c# e. It appears that the operating test will differentiate behen competent and less-thancompetent applicants at the designated license level. 2. Walk-Through Criteria a. Each JPM includes the following, as applicable:
Ah
initial conditions initfating cues references and tools, including aaciated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-crifical by the facilf licensee operationally important specific performance criteria that include: - - - - - -
            - audit exam was systematically and randomly developed t k audit exam was completed before the license exam was started examinations were developed independently licensee certifies that there is no duplication other (explain)
* detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important observations to be made by the applicant criteria for successful completion of the task identification of critical steps and their associated performam standards restrictions on the sequence of steps, if applicable
I         I           I
: b. Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301-1 and 2) have not calrsed the test to deviate from any of the acceptance criteria (e.g.< item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms ad Form ES-201-2.
: 6.         Bank use meets limits (nomore than 75 percent                   Bank       Modifid   New from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only question distribution(s) at right                               /<tY            I    LUQI @J                  $
: 7.          Between 50 and 60 percent of the questions on the RO               Memorj exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly selected WAS suppott the higher cognitive Levels; enter the actual RO I SRO question distnbution(9) at right.
: 8.         Referencesthandouts provided do not give away answers or aid in the elimination of distractom.
: 9.        Question content conforms with specific WA statements in the previously approved examination outlhe and is approprlate for the tier to which they are assigned; deviations are justified.
: 10.       Question psychomtric quality and formt meet the guidelines in ES Appedix 6.                   Id4-h IY
: 11.       Tlae exam contains the required number of onepoint, multiple choice items; the total is correct and agrees with the value on the cover sheet.
: a. Author
: b. Facility R e v i e w r (")
: c. NRC Chief Examiner (#)
: d. NRC Regional Supervisor                                                                                         I Note:         The facilily reviewer's initialdsignature are not applicable for NRC-developed examinations.
            # Independent NRC revlewer initial items in Column "c"; chief examiner comurrence required.
ES-401, Page 29 of 33
 
ES-301                                     Operating Test Quality Checklist                                       Form ES-301-3 Facility:         CklJ*b           ;cy                           Date of Examination: ' ' / Z 7 / a k  Operatir rest Number
                                                                                                                              -
: 1. General Criteria c#
: a.       The operating tesf confoms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distriblrtion).
: b.       There is m day-to-day repetition between this and other operating tests to be administered during this examination.
C.       The operating test shall not duplicate $ems from the applicants' audit test(?.). (see Section D.1.a,)
: d.       Overlap with the written examination and between different parts of the operating test is within acceptable limits.
: e.       It appears that the operating test will differentiate b e h e n competent and less-thancompetent applicants at the designated license level.
: 2. Walk-Through Criteria
: a.       Each JPM includes the following, as applicable:
initial conditions initfating cues references and tools, including a a c i a t e d procedures
* reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-crifical by the f a c i l f licensee operationally important specific performance criteria that include:
                - detailed expected actions with exact criteria and nomenclature
                - system response and other examiner cues
                - statements describing important observationsto be made by the applicant
                - criteria for successful completion of the task
                - identification of critical steps and their associated performam standards
                - restrictions on the sequence of steps, if applicable
: b.         Ensure that any changes from the previouslyapproved systemsand administrativewalk-through outlines (Forms ES-301-1 and 2) have not calrsed the test to deviate from any of the acceptance criteria (e.g.<item distribution, bank use,repetition from the last 2 NRC examinations) specified on those forms a d Form ES-201-2.
: 3. Simulator Criteria The associated sirnulator operatirrg tests (scenario sets) have been reviewed in accordance with Form ES-301-4 and a copy is attached.
: 3. Simulator Criteria The associated sirnulator operatirrg tests (scenario sets) have been reviewed in accordance with Form ES-301-4 and a copy is attached.
Printed Name I Signature
Printed Name I Signature
: a. Author b. Facility Reviewer?)
: a. Author
: c. NRC Chief Examiner (#) d. NRC Supervisor NOTE: I I The facility signature is not applicable for NRCdeveloped tests. Iddependent NRC reviewer initial items in Column "c"; chief examiner concurrence required.
: b. Facility Reviewer?)
f ES-301, Page 24 of 27 ES-301 Simulator Scenario Quality Checklist Form ES-301-4 11 Facility:  
: c. NRC Chief Examiner (#)
&Iuw &#'- Date of Exam:h&enario Numbers: I Zt 30pemU~ Test No.: QUALITATIVE ATRIBWE5 Initials I I 1. 2. 3. The initial conditions are realistic.
I
in that wme equipment andlor instrumentation may be out of service, but it does not cue the operators into expected events. The scenarios consist mostly of related events. Each went description consists of - * *
: d. NRC Supervisor I
* No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event. The events are valid with regard to physics and thermodynamics. Sequencing and timing of events is reasonable, and allm the examination team to obtain complete evaluation results commensurate with the scenario objectives.  
NOTE:           The facility signature is not applicable for NRCdeveloped tests.
@ 11sri the point in the scenario when it is to be initiated the malfunction(s) that are entered to initiate the event the symptomshes that Will be visible to the crew the expected operator actions (by shill position) the event termination point (if applicable)
f    Iddependent NRC reviewer initial items in Column "c";chief examiner concurrence required.
: 4. 5. 6. w 7. If time compression techniques are used, the scenario summary clearly sa indicates.
ES-301, Page 24 of 27
 
ES-301                                 Simulator Scenario Quality Checklist                                 Form ES-301-4 11 Facility:     & I u w &#'-               Date of Exam:h&enario         Numbers:   I Zt 3 0 p e m U Test
                                                                                                          ~   No.:
QUALITATIVE ATRIBWE5                                                         Initials I       I
: 1.       The initial conditions are realistic. in that wme equipment andlor instrumentation may be out of service, but it does not cue the operators into expected events.
: 2.        The scenarios consist mostly of related events.
3.
          -
Each went description consists of the point in the scenario when it is to be initiated
          *
* the malfunction(s)that are entered to initiate the event the symptomshes that Will be visible to the crew the expected operator actions (by shill position)
                                                                                                              @
* the event termination point (if applicable)
: 4.        No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event.                                     11sri
: 5.        The events are valid with regard to physics and thermodynamics.                                     w
: 6.        Sequencing and timing of events is reasonable, and a l l m the examination team to obtain complete evaluation results commensurate with the scenario objectives.
: 7.       If time compression techniques are used, the scenario summary clearly sa indicates.
Operators have sufficient time to carry olrt expected activities without undue time constraink.
Operators have sufficient time to carry olrt expected activities without undue time constraink.
Cues are given. 8. The simulator modeling is not altered. 9. Tho mnarios have been validated.
Cues are given.
Pursuant to 10 CFR 55,46(d), any orpen simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.
: 8.       The simulator modeling is not altered.
I 22. Each applicant Will be significantly involved in the minimum number of transients and events ES-301, Page 25 of 27 ES-301 Transient and Event Checklist Form ES-301-5 SRO-U TS I RO I= I 1 I SRO-U TS FA* SRO-U Scenarios 2 I 3 I 4 M I N 1 M U M - - 1* - 1* - 4* 2 2 1* - - 1* - 4* 2 2 I* I" - - 4' 2 - 2 2 - 1. Circle the applicant level and enter the operation test number and Form ES-D-I event numbers for each event type; TS are not applicable for RO applicants.
: 9.       Tho mnarios have been validated. Pursuant to 10 CFR 55,46(d), any orpen simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.
ROs must serve in both the "at the controls (ATC)" and "balance of plant (BOP)" positions; Instant SROs must do one scenario, including at least two instrument or component OK) malfunctions and one major transient, in the ATC position. Reactivity manipulations may be conducted under norma1 or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. *Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1 for I basis. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's competence count toward the minimum requirement.
I
: 2. 3. Page 1 ES-301 Transient and Event Checklist Form ES-301-5 P - - bcility: ColFbia Generating Station Date of Ex ER 2006 Operating Test Number: - iRO-I xo-I SRO-U SRO-I SRU-U zo mo-I SRO-U nstructions:
: 22.       Each applicant Will be significantly involved in the minimum number of transients and events ES-301, Page 25 of 27
M I N I M U M - - 1' - 1* 4* - 2 2 I. Circle the applicant level and enter the opcration test number and Form ES-D-I event numbers for each event type; TS are not applicable for RO applicants.
 
ROs must serve in both the "at the controls (ATC)" and "baIance of plant (BOP)" positions; Instant SROs must do one scenario, including at least two instrument or component
ES-301                                 Transient and Event Checklist                           Form ES-301-5 Scenarios 2           I         3           I             4                       M I
([IC) malfunctions and one major transient, in the ATC position.
N 1
I Reactivity manipulations may be conducted under normal or uonirolkd abnormal conditions (rcfcr to Section D.5.d) but must be significant per Section C.2.a of Appendix D. *Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1 for 1 basis. 3. Whenevcr practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicant's competence count toward the mininium rquirement.
M U
Page 2 ES-301 Competencies Checklist Form ES-301-6 Roq IISRO- :ENARIO SCENARIO Notes: (I {Z) Optional for an SRO-U. (3) Only applicable to SROs. Includes Technical Specification compliance for an RO. Instructions:
M
Circle the applicants'license type and enter one or more event numbers that will allow the examiners to evaluate every Author: NRC Reviewer:  
                                                                                                                                        -
/ p - aev q & I 1 1 1 t ES-301, Page 27 of 27 ES-301 Competencies Checklist Form ES-301-6 Competencies Notes: (1) (2) Optional for an SRO-U. (3) Only applicable to SROs. Includes Technical Specification compliance for an RO. In structions Circle fhe applicants'license type and enter one or more event numbers that will allow the examiners to evaluate every Author: cy for every applicanl.  
                                                                                                                                        - 1*
/ NRC Reviewer:
                                                                                                                                        - 1*
ES-301, Page 27 of 27 ES-403 Written Examination Grading Form ES403-1 Quality Checklist u&3d 6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Date of Exam: '1/27/& Exam LevelmRO Initials ~ @ Item Descriation
                                                                                                                                        - 4*
: 1. 2. Clean answer sheets copied before grading Answer key changes and question deletions justified and documented urn J? II I I I ? @ 3. 4. Applicants' scores checked for addition errors {reviewers spot check > 25% of examinations)
2
Grading for all borderline cases (80 k29'0 overall and 70 or 80, as applicable, k4Y0 on the SRO-only) reviewed in detail 5. All other failing examinations checked to ensure that grades II are iustified
                                                                                                                                        -
: a. Grader b. Facility Reviewerr)  
                                                                                                                                        -
&hd /45/D6 d. NRC Supervisor
2 1*
(*) I VGJQ c. NRC Chief Examiner
1*
(") r) The facility reviewer's signature is nof applicable for examinations graded by the NRC; two independent NRC reviews are required.
                                                                                                                                        - 4*
ES-403, Page 5 of 5 ES-403 Written Examination Grading Form ES-403-4 Quality Checklist Facility:
2 SRO-U          TS                                                                                                                      -  2 I*
G/ OvrlbLa- Date of Exam: "/L7/& Exam Level: ROI~ I I Initials 4. Grading for all borderline cases (80 k2Y0 overall and 70 or 80, as applicable, k4% on the SRO-only) reviewed in detail 5. AH other failing examinations checked to ensure that grades are justified
I RO          I=        I         1      I I
: 6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed NamelSignature - , Date a. Grader b. Facility Reviewerr)
                                                                                                                                        - 4 2
: c. NRC Chief Examiner (*) d. NRC Supervisor I") (*) The facility reviewer's signature is nof applicable for examinations graded by the NRC; two independent NRC reviews are required.
SRO-U          TS F    A SRO-U        *                                                                                                                        -
ES-403, Page 5 of 5 IO LL U LL C .- E 3 LL U LL 8 D s c . N 4 a Ill Ill IIIII IIIII Lu Ll 1 s h Q IIIII c T 2 I- w% 0. I I I I I I I I I I I I I 2 w I I I I I I I I I I I I Id c iI a-w I I IIIIIII IIIIIII II U r F}}
                                                                                                                                          -
2 2
: 1. Circle the applicant level and enter the operation test number and Form ES-D-I event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at the controls (ATC) and balance of plant (BOP)positions; Instant SROs must do one scenario, including at least two instrument or component O K ) malfunctions and one major transient, in the ATC position.
: 2. Reactivity manipulations m a y be conducted under norma1 or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.aofAppendix D. *Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1 for I basis.
: 3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirement.
Page 1
 
ES-301                                 Transient and Event Checklist                         Form ES-301-5 P                             -                       -
bcility: ColFbia Generating Station                     Date of Ex                     ER 2006 Operating Test Number:               -
M I
N I
M U
M
                                                                                                                                          -
                                                                                                                                          - 1
                                                                                                                                          - 1*
iRO-I                                                                                                                                       4*
xo-I SRO-U SRO-I SRU-U zo mo-I
                                                                                                                                          -  2 SRO-U                                                                                                                                         2 nstructions:
I.       Circle the applicant level and enter the opcration test number and Form ES-D-I event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at the controls (ATC) and baIance of plant (BOP) positions; Instant SROs must do one scenario, including at least two instrument or component ([IC)malfunctions and one major transient, in the ATC position.
I       Reactivity manipulations may be conducted under normal or uonirolkd abnormal conditions (rcfcr to Section D.5.d) but must be significant per Section C.2.a of Appendix D. *Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1 for 1 basis.
: 3.       Whenevcr practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the mininium rquirement.
Page 2
 
ES-301                                   Competencies Checklist                       Form ES-301-6
                                                                                                      &I Roq11 IISRO-
:ENARIO         SCENARIO     1 t
Notes:
(I     Includes Technical Specification compliance for an RO.
{Z)     Optional for an SRO-U.
(3)     Only applicable to SROs.
Instructions:
Circle the applicantslicense type and enter one or more event numbers that will allow the examiners to evaluate every Author:
NRC Reviewer:                           p
                                          /
                                            - aev             q ES-301, Page 27 of 27
 
ES-301                                   Competencies Checklist                         Form ES-301-6 Competencies Notes:
(1)     Includes Technical Specification compliance for an RO.
(2)     Optional for an SRO-U.
(3)     Only applicable to SROs.
Instructions Circle fhe applicants'license type and enter one or more event numbers that will allow the examiners to evaluate every                           cy for every applicanl.
Author:
                                          /
NRC Reviewer:
ES-301, Page 27 of 27
 
ES-403                             Written Examination Grading                       Form ES403-1 Quality Checklist Date of Exam: '1/27/&         Exam L e v e l m R O Initials Item Descriation
: 1. Clean answer sheets copied before grading
: 2. Answer key changes and question deletions justified II and documented I
u  r n J?
I         I
: 3. Applicants' scores checked for addition errors
{reviewers spot check > 25% of examinations)                                           ?
Grading for all borderline cases (80 k29'0 overall and 70 or 80, 4.
as applicable, k4Y0 on the SRO-only) reviewed in detail                                 @
5.
6.
All other failing examinations checked to ensure that grades are iustified Performance on missed questions checked for training
                                                                                                  ~
deficiencies and wording problems; evaluate validity                  u &      3  d  @
of questions missed by half or more of the applicants
: a. Grader
: b. Facility Reviewerr)                                                                 &hd
: c. NRC Chief Examiner (")                                                              /45/D6
: d. NRC Supervisor (*)                                                                 I VGJQ r)     The facility reviewer's signature is nof applicable for examinations graded by the NRC; two independent NRC reviews are required.
ES-403, Page 5 of 5
 
ES-403                               Written Examination Grading                       Form ES-403-4 Quality Checklist Facility:   G/O v r l b L a -                 Date of Exam: "/L7/&           Exam Level: R    O  I ~
I I       Initials
: 4.       Grading for all borderline cases (80 k2Y0 overall and 70 or 80, as applicable, k4% on the SRO-only) reviewed in detail
: 5.       AH other failing examinations checked to ensure that grades are justified
: 6.       Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed NamelSignature     -   ,                 Date
: a. Grader
: b. Facility Reviewerr)
: c. NRC Chief Examiner (*)
: d. NRC Supervisor I")
(*)     The facility reviewer's signature is nof applicable for examinations graded by the NRC; two independent NRC reviews are required.
ES-403, Page 5 of 5
 
IO LL   LL U    U LL   LL
.-
C E
3     D 8
4 a
s.
c N
 
Ill IIIII Ill IIIII
 
Lu IIIII 1Ll sh Q
c T 2
 
IIIIIIIIIIIII w
I- .%
w 0
2 Id I IIIIIIIIIII iI a -
c
 
I IIIIIII I IIIIIII II w
 
U r
 
F}}

Revision as of 06:35, 23 November 2019

Generation Station - 11-2006 - Public Forms; Examination Assignment
ML071570402
Person / Time
Site: Columbia Energy Northwest icon.png
Issue date: 04/18/2006
From: Gody A
Operations Branch IV
To: Garchow S
Operations Branch IV
References
Download: ML071570402 (21)


Text

A.pril 18, 2006 NOTE TO: Steve Garchow Chief Examiner, Operations Branch FROM: Anthony T. Gody, Chief Operations Branch Division of Reactor Safety

SUBJECT:

EXAMINATION ASS IGNMEN1 You have been assigned as Chief of the Columbia Generating Station examination. The operating test has been scheduled to be completed by December 1, 2006. Thank you for contacting the Columbia Generating Station facility to finalize the details of the examination You are reminded that the RPSllP system must be maintained to ensure that the exarninm and numbers of candidates are accurate. In addition, you are reminded that only qualified examiners are permitted to conduct any part of the examination.

Division of Reactor Safety

Replaces NUREG1021 Revision 9, ES Forms 201-1 and 501-?

Pq Due Date I Description IDate Complete I Initials Notes produced by Chief Examiner produoed by OLA

~

print Report-21

~ produced by Chief Examiner

  • Indicates the due dates are more conservative than the ES-201-1 requires.

ES-201 Examination Outllne Quality Checklist Form ES-201-2 Facility: Date of Examination: II 127 10 7 Initial Task Description a I b' 1.

1111 I a. Verify that the outline(s) fit@)the appropriate model, In accordance wjth ES-1.

R b. Assess whether the outline was systematically and randomly prepared in accordance wifh I Section D.l of E$-401 and whether all WA categories are appropriately sampled.

c. Assess Wether the outline overemphasizes any system, evolutions, or generic topics.

E

d. Assess whether the justifications for deselxted or rejected WA statements are appropriate.

of normal evolutions, instrument a d component failures, technical specifications, plicants' audit t&(s)

CA tasks meet the criteria Date

a. Author I -Y -07
6. Facility Reviewer (*)
c. MRC Chief Examiner (#)
d. NRC Supervisor law Note: # Independent PIRC reviewer initial items in Column "c'; chief examiner concurrence required.

ES-201, Page 25 of 27

ES-401 Written Examination Qualitv Checklist Form ES401-6 Facility: b l o / H b; Date of m m : ' I/z!/,& Exam Level: ROlSRO Initial I I

4. If more than four RO and two SRO questions are repeated from the last two MRC licensing
5. Question duptication from the license screeninglaudit exam was controlled as ' dicated below (check the item that applies) and appears appropriate:

Ah

- audit exam was systematically and randomly developed t k audit exam was completed before the license exam was started examinations were developed independently licensee certifies that there is no duplication other (explain)

I I I

6. Bank use meets limits (nomore than 75 percent Bank Modifid New from the bank, at least 10 percent new, and the rest new or modified); enter the actual RO I SRO-only question distribution(s) at right /<tY I LUQI @J $
7. Between 50 and 60 percent of the questions on the RO Memorj exam are written at the comprehension/ analysis level; the SRO exam may exceed 60 percent if the randomly selected WAS suppott the higher cognitive Levels; enter the actual RO I SRO question distnbution(9) at right.
8. Referencesthandouts provided do not give away answers or aid in the elimination of distractom.
9. Question content conforms with specific WA statements in the previously approved examination outlhe and is approprlate for the tier to which they are assigned; deviations are justified.
10. Question psychomtric quality and formt meet the guidelines in ES Appedix 6. Id4-h IY
11. Tlae exam contains the required number of onepoint, multiple choice items; the total is correct and agrees with the value on the cover sheet.
a. Author
b. Facility R e v i e w r (")
c. NRC Chief Examiner (#)
d. NRC Regional Supervisor I Note: The facilily reviewer's initialdsignature are not applicable for NRC-developed examinations.
  1. Independent NRC revlewer initial items in Column "c"; chief examiner comurrence required.

ES-401, Page 29 of 33

ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: CklJ*b ;cy Date of Examination: ' ' / Z 7 / a k Operatir rest Number

-

1. General Criteria c#
a. The operating tesf confoms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distriblrtion).
b. There is m day-to-day repetition between this and other operating tests to be administered during this examination.

C. The operating test shall not duplicate $ems from the applicants' audit test(?.). (see Section D.1.a,)

d. Overlap with the written examination and between different parts of the operating test is within acceptable limits.
e. It appears that the operating test will differentiate b e h e n competent and less-thancompetent applicants at the designated license level.
2. Walk-Through Criteria
a. Each JPM includes the following, as applicable:

initial conditions initfating cues references and tools, including a a c i a t e d procedures

  • reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-crifical by the f a c i l f licensee operationally important specific performance criteria that include:

- detailed expected actions with exact criteria and nomenclature

- system response and other examiner cues

- statements describing important observationsto be made by the applicant

- criteria for successful completion of the task

- identification of critical steps and their associated performam standards

- restrictions on the sequence of steps, if applicable

b. Ensure that any changes from the previouslyapproved systemsand administrativewalk-through outlines (Forms ES-301-1 and 2) have not calrsed the test to deviate from any of the acceptance criteria (e.g.<item distribution, bank use,repetition from the last 2 NRC examinations) specified on those forms a d Form ES-201-2.
3. Simulator Criteria The associated sirnulator operatirrg tests (scenario sets) have been reviewed in accordance with Form ES-301-4 and a copy is attached.

Printed Name I Signature

a. Author
b. Facility Reviewer?)
c. NRC Chief Examiner (#)

I

d. NRC Supervisor I

NOTE: The facility signature is not applicable for NRCdeveloped tests.

f Iddependent NRC reviewer initial items in Column "c";chief examiner concurrence required.

ES-301, Page 24 of 27

ES-301 Simulator Scenario Quality Checklist Form ES-301-4 11 Facility: & I u w &#'- Date of Exam:h&enario Numbers: I Zt 3 0 p e m U Test

~ No.:

QUALITATIVE ATRIBWE5 Initials I I

1. The initial conditions are realistic. in that wme equipment andlor instrumentation may be out of service, but it does not cue the operators into expected events.
2. The scenarios consist mostly of related events.

3.

-

Each went description consists of the point in the scenario when it is to be initiated

  • the malfunction(s)that are entered to initiate the event the symptomshes that Will be visible to the crew the expected operator actions (by shill position)

@

  • the event termination point (if applicable)
4. No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event. 11sri
5. The events are valid with regard to physics and thermodynamics. w
6. Sequencing and timing of events is reasonable, and a l l m the examination team to obtain complete evaluation results commensurate with the scenario objectives.
7. If time compression techniques are used, the scenario summary clearly sa indicates.

Operators have sufficient time to carry olrt expected activities without undue time constraink.

Cues are given.

8. The simulator modeling is not altered.
9. Tho mnarios have been validated. Pursuant to 10 CFR 55,46(d), any orpen simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.

I

22. Each applicant Will be significantly involved in the minimum number of transients and events ES-301, Page 25 of 27

ES-301 Transient and Event Checklist Form ES-301-5 Scenarios 2 I 3 I 4 M I

N 1

M U

M

-

- 1*

- 1*

- 4*

2

-

-

2 1*

1*

- 4*

2 SRO-U TS - 2 I*

I RO I= I 1 I I

- 4 2

SRO-U TS F A SRO-U * -

-

2 2

1. Circle the applicant level and enter the operation test number and Form ES-D-I event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at the controls (ATC) and balance of plant (BOP)positions; Instant SROs must do one scenario, including at least two instrument or component O K ) malfunctions and one major transient, in the ATC position.
2. Reactivity manipulations m a y be conducted under norma1 or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.aofAppendix D. *Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1 for I basis.
3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirement.

Page 1

ES-301 Transient and Event Checklist Form ES-301-5 P - -

bcility: ColFbia Generating Station Date of Ex ER 2006 Operating Test Number: -

M I

N I

M U

M

-

- 1

- 1*

iRO-I 4*

xo-I SRO-U SRO-I SRU-U zo mo-I

- 2 SRO-U 2 nstructions:

I. Circle the applicant level and enter the opcration test number and Form ES-D-I event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at the controls (ATC) and baIance of plant (BOP) positions; Instant SROs must do one scenario, including at least two instrument or component ([IC)malfunctions and one major transient, in the ATC position.

I Reactivity manipulations may be conducted under normal or uonirolkd abnormal conditions (rcfcr to Section D.5.d) but must be significant per Section C.2.a of Appendix D. *Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1 for 1 basis.

3. Whenevcr practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the mininium rquirement.

Page 2

ES-301 Competencies Checklist Form ES-301-6

&I Roq11 IISRO-

ENARIO SCENARIO 1 t

Notes:

(I Includes Technical Specification compliance for an RO.

{Z) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions:

Circle the applicantslicense type and enter one or more event numbers that will allow the examiners to evaluate every Author:

NRC Reviewer: p

/

- aev q ES-301, Page 27 of 27

ES-301 Competencies Checklist Form ES-301-6 Competencies Notes:

(1) Includes Technical Specification compliance for an RO.

(2) Optional for an SRO-U.

(3) Only applicable to SROs.

Instructions Circle fhe applicants'license type and enter one or more event numbers that will allow the examiners to evaluate every cy for every applicanl.

Author:

/

NRC Reviewer:

ES-301, Page 27 of 27

ES-403 Written Examination Grading Form ES403-1 Quality Checklist Date of Exam: '1/27/& Exam L e v e l m R O Initials Item Descriation

1. Clean answer sheets copied before grading
2. Answer key changes and question deletions justified II and documented I

u r n J?

I I

3. Applicants' scores checked for addition errors

{reviewers spot check > 25% of examinations)  ?

Grading for all borderline cases (80 k29'0 overall and 70 or 80, 4.

as applicable, k4Y0 on the SRO-only) reviewed in detail @

I 5.

6.

All other failing examinations checked to ensure that grades are iustified Performance on missed questions checked for training

~

deficiencies and wording problems; evaluate validity u & 3 d @

of questions missed by half or more of the applicants

a. Grader
b. Facility Reviewerr) &hd
c. NRC Chief Examiner (") /45/D6
d. NRC Supervisor (*) I VGJQ r) The facility reviewer's signature is nof applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-403, Page 5 of 5

ES-403 Written Examination Grading Form ES-403-4 Quality Checklist Facility: G/O v r l b L a - Date of Exam: "/L7/& Exam Level: R O I ~

I I Initials

4. Grading for all borderline cases (80 k2Y0 overall and 70 or 80, as applicable, k4% on the SRO-only) reviewed in detail
5. AH other failing examinations checked to ensure that grades are justified
6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed NamelSignature - , Date
a. Grader
b. Facility Reviewerr)
c. NRC Chief Examiner (*)
d. NRC Supervisor I")

(*) The facility reviewer's signature is nof applicable for examinations graded by the NRC; two independent NRC reviews are required.

ES-403, Page 5 of 5

IO LL LL U U LL LL

.-

C E

3 D 8

4 a

s.

c N

Ill IIIII Ill IIIII

Lu IIIII 1Ll sh Q

c T 2

IIIIIIIIIIIII w

I- .%

w 0

2 Id I IIIIIIIIIII iI a -

c

I IIIIIII I IIIIIII II w

U r

F