ML093640778: Difference between revisions
StriderTol (talk | contribs) (Created page by program invented by StriderTol) |
StriderTol (talk | contribs) (Created page by program invented by StriderTol) |
||
| Line 26: | Line 26: | ||
Examiner's Initials -180 1. Examination administration date confirmed (C.1.a; C.2.a and b) rfa -120 2. NRC examiners and facility contact assigned (C.l.d; C.2.e) rfa -120 3. Facility contact briefed on security and other requirements (C.2.c) rfa -120 4. Corporate notification letter sent (C.2.d) rfa [-90] (S. Reference material due (C.1.e; C.3.c; Attachment 2)] rfa {-7S} 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-S, ES-D-l's, ES-401-1I2, ES-401-3, and ES-401-4, as rfa applicable (C. I.e and f; C.3.d) {-70} {7. Examination outline(s) reviewed by NRC and feedback provided to facility rfa licensee (C.2.h; C.3.e)} {-4S} 8. Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, rfa ES-301-S, ES-301-6, and ES-401-6), and reference materials due (C.1.e, f, g and h; C.3.d) -30 9. Preliminary license applications (NRC Form 398's) due (C. I.!; C.2.g; ES-202) rfa -14 10. Final license applications due and Form ES-20 1-4 prepared (C. I.!; C.2.i; ES-202) rfa -14 11. Examination approved by NRC supervisor for facility licensee review rfa (C.2.h; C.3.f) -14 12. Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g) rfa -7 13. Written examinations tu18 8f}@Fsting t88t8 approved by NRC supervisor rfa (C.2.i; C.3.h) -7 14. Final applications reviewed; 1 or 2 (if> 1 0) applications audited to confirm qualifications | Examiner's Initials -180 1. Examination administration date confirmed (C.1.a; C.2.a and b) rfa -120 2. NRC examiners and facility contact assigned (C.l.d; C.2.e) rfa -120 3. Facility contact briefed on security and other requirements (C.2.c) rfa -120 4. Corporate notification letter sent (C.2.d) rfa [-90] (S. Reference material due (C.1.e; C.3.c; Attachment 2)] rfa {-7S} 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-S, ES-D-l's, ES-401-1I2, ES-401-3, and ES-401-4, as rfa applicable (C. I.e and f; C.3.d) {-70} {7. Examination outline(s) reviewed by NRC and feedback provided to facility rfa licensee (C.2.h; C.3.e)} {-4S} 8. Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, rfa ES-301-S, ES-301-6, and ES-401-6), and reference materials due (C.1.e, f, g and h; C.3.d) -30 9. Preliminary license applications (NRC Form 398's) due (C. I.!; C.2.g; ES-202) rfa -14 10. Final license applications due and Form ES-20 1-4 prepared (C. I.!; C.2.i; ES-202) rfa -14 11. Examination approved by NRC supervisor for facility licensee review rfa (C.2.h; C.3.f) -14 12. Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g) rfa -7 13. Written examinations tu18 8f}@Fsting t88t8 approved by NRC supervisor rfa (C.2.i; C.3.h) -7 14. Final applications reviewed; 1 or 2 (if> 1 0) applications audited to confirm qualifications | ||
/ eligibility; and examination approval and waiver letters sent rfa (C.2.i; Attachment 4; ES-202, C.2.e; ES-204) -7 IS. Proctoring/written exam administration guidelines reviewed with facility licensee rfa (C.3.k) -7 16. Approved scenarios, job performance measures, and questions distributed to NA NRC examiners (C.3.i) | / eligibility; and examination approval and waiver letters sent rfa (C.2.i; Attachment 4; ES-202, C.2.e; ES-204) -7 IS. Proctoring/written exam administration guidelines reviewed with facility licensee rfa (C.3.k) -7 16. Approved scenarios, job performance measures, and questions distributed to NA NRC examiners (C.3.i) | ||
* Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee. | * Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee. | ||
[AJ>Plies only] {Does not apply} to examinations 2repared by the NRC. ES-201, Rev. 9E Examination Preparation Checklist Fonn ES-201-1 OPNA Facility: | [AJ>Plies only] {Does not apply} to examinations 2repared by the NRC. ES-201, Rev. 9E Examination Preparation Checklist Fonn ES-201-1 OPNA Facility: | ||
McGuire Date of Examination: | McGuire Date of Examination: | ||
| Line 33: | Line 33: | ||
Examiner's Initials -180 1. Examination administration date confirmed (C.1.a; C.2.a and b) rfa -120 2. NRC examiners and facility contact assigned (C.l.d; C.2.e) rfa -120 3. Facility contact briefed on security and other requirements (C.2.c) rfa -120 4. Corporate notification letter sent (C.2.d) rfa [-90] 1 S. Reference material due (C.1.e; C.3.c; Attachment 2)] rfa {-7S} 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-S, ES-D-l's, ES-40l-1I2, ES-40l-3, and ES-401-4, as rfa applicable (C. I.e and f; C.3.d) {-70} {7. Examination outline(s) reviewed by NRC and feedback provided to facility rfa licensee (C.2.h; C.3.e)} {-4S} 8. Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, rfa ES-30l-S, ES-301-6, and ES-401-6), and reference materials due (C.1.e, f, g and h; C.3.d) -30 9. Preliminary license applications (NRC Form 398's) due (C. I.!; C.2.g; ES-202) rfa -14 10. Final license applications due and Form ES-20 1-4 prepared (C. I.!; C.2.i; ES-202) rfa -14 11. Examination approved by NRC supervisor for facility licensee review rfa (C.2.h; C.3.f) -14 12. Examinations reviewed with facility licensee (C.l.j; C.2.f and h; C.3.g) rfa -7 13. Written examinations 8ft8 8fJ@fstmg t88t8 approved by NRC supervisor rfa (C.2.i; C.3.h) -7 14. Final applications reviewed; 1 or 2 (if> 1 0) applications audited to confirm qualifications | Examiner's Initials -180 1. Examination administration date confirmed (C.1.a; C.2.a and b) rfa -120 2. NRC examiners and facility contact assigned (C.l.d; C.2.e) rfa -120 3. Facility contact briefed on security and other requirements (C.2.c) rfa -120 4. Corporate notification letter sent (C.2.d) rfa [-90] 1 S. Reference material due (C.1.e; C.3.c; Attachment 2)] rfa {-7S} 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-S, ES-D-l's, ES-40l-1I2, ES-40l-3, and ES-401-4, as rfa applicable (C. I.e and f; C.3.d) {-70} {7. Examination outline(s) reviewed by NRC and feedback provided to facility rfa licensee (C.2.h; C.3.e)} {-4S} 8. Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, rfa ES-30l-S, ES-301-6, and ES-401-6), and reference materials due (C.1.e, f, g and h; C.3.d) -30 9. Preliminary license applications (NRC Form 398's) due (C. I.!; C.2.g; ES-202) rfa -14 10. Final license applications due and Form ES-20 1-4 prepared (C. I.!; C.2.i; ES-202) rfa -14 11. Examination approved by NRC supervisor for facility licensee review rfa (C.2.h; C.3.f) -14 12. Examinations reviewed with facility licensee (C.l.j; C.2.f and h; C.3.g) rfa -7 13. Written examinations 8ft8 8fJ@fstmg t88t8 approved by NRC supervisor rfa (C.2.i; C.3.h) -7 14. Final applications reviewed; 1 or 2 (if> 1 0) applications audited to confirm qualifications | ||
/ eligibility; and examination approval and waiver letters sent rfa (C.2.i; Attachment 4; ES-202, C.2.e; ES-204) -7 IS. Proctoring/written exam administration guidelines reviewed with facility licensee rfa (C.3.k) -7 16. Approved scenarios, job performance measures, and questions distributed to NA NRC examiners (C.3.i) | / eligibility; and examination approval and waiver letters sent rfa (C.2.i; Attachment 4; ES-202, C.2.e; ES-204) -7 IS. Proctoring/written exam administration guidelines reviewed with facility licensee rfa (C.3.k) -7 16. Approved scenarios, job performance measures, and questions distributed to NA NRC examiners (C.3.i) | ||
* Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee. | * Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee. | ||
[Applies only] {Does not apply} to examinations prepared by the NRC. | [Applies only] {Does not apply} to examinations prepared by the NRC. | ||
* JC/NIJL ES-201 Examination Outline Quality Checklist Facility: | * JC/NIJL ES-201 Examination Outline Quality Checklist Facility: | ||
McGuire Nuclear Station Date of Examination: | McGuire Nuclear Station Date of Examination: | ||
11119/2009 Item 1. W R I T T E N 2. S I M U L A T 0 R 3. W 1 T 4. G E N E R A L Task Description | 11119/2009 Item 1. W R I T T E N 2. S I M U L A T 0 R 3. W 1 T 4. G E N E R A L Task Description | ||
: a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401. b. Assess whether the outline was systematically and randomly prepared in accordance with Section D.1 of ES-401 and whether all KiA categories are appropriately sampled. c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics. d Assess whether the justifications for deselected or rejected KiA statements are appropriate. | : a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401. b. Assess whether the outline was systematically and randomly prepared in accordance with Section D.1 of ES-401 and whether all KiA categories are appropriately sampled. c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics. d Assess whether the justifications for deselected or rejected KiA statements are appropriate. | ||
: a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, and major transients. | : a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, and major transients. | ||
: b. Assess whether there are enough scenario sets (and spares) to test the projected number and mix of applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity, and ensure that each applicant can be tested using at least one new or significantly modified scenario, that no scenarios are duplicated from the applicants' audit test(s), and that scenarios will not be repeated on subsequent days. c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative and quantitative criteria specified on Form ES-301-4 and described in Appendix D. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2: | : b. Assess whether there are enough scenario sets (and spares) to test the projected number and mix of applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity, and ensure that each applicant can be tested using at least one new or significantly modified scenario, that no scenarios are duplicated from the applicants' audit test(s), and that scenarios will not be repeated on subsequent days. c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative and quantitative criteria specified on Form ES-301-4 and described in Appendix D. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2: | ||
(1 ) the outline(s) contain(s) the required number of control room and in-plant tasks distributed among the safety functions as specified on the form (2) task repetition from the last two NRC examinations is within the limits specified on the form (3) no tasks are duplicated from the applicants' audit testis) (4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form. b. Verify that the administrative outline meets the criteria specified on Form ES-301-1: | (1 ) the outline(s) contain(s) the required number of control room and in-plant tasks distributed among the safety functions as specified on the form (2) task repetition from the last two NRC examinations is within the limits specified on the form (3) no tasks are duplicated from the applicants' audit testis) (4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form. b. Verify that the administrative outline meets the criteria specified on Form ES-301-1: | ||
(1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations | (1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations | ||
: c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections. | : c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections. | ||
: b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate. | : b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate. | ||
: c. Ensure that KiA importance ratings (except for plant-specific priorities) are at least 2.5. d. Check for duplication and overlap among exam sections. | : c. Ensure that KiA importance ratings (except for plant-specific priorities) are at least 2.5. d. Check for duplication and overlap among exam sections. | ||
: e. Check the entire exam for balance of coverage. | : e. Check the entire exam for balance of coverage. | ||
: f. Assess whether the exam fits the appropriate job level (RO or SRO). a. Author Fred 8KJI'kJr | : f. Assess whether the exam fits the appropriate job level (RO or SRO). a. Author Fred 8KJI'kJr | ||
: b. Facility Reviewer (*) | : b. Facility Reviewer (*) | ||
-.L Mcdelkf c. NRCChiefExaminer(#) Form ES-201-2 a JfII< 't/{<< Initials b* c# 9JII iJ!1 " .V1 0"\ \. <P-N{t\ I'-wi/" NitJ tJ/r Date 1/-13-09 d NRC Supervisor A1AI//v 1L i.lJJlfWAJI.,A( /{l\ IhJ-dJ ///$'or It/truj * / | -.L Mcdelkf c. NRCChiefExaminer(#) Form ES-201-2 a JfII< 't/{<< Initials b* c# 9JII iJ!1 " .V1 0"\ \. <P-N{t\ I'-wi/" NitJ tJ/r Date 1/-13-09 d NRC Supervisor A1AI//v 1L i.lJJlfWAJI.,A( /{l\ IhJ-dJ ///$'or It/truj * / | ||
| Line 56: | Line 56: | ||
NitJ (1 ) the outline(s) contain(s) the required number of control room and in-plant tasks | NitJ (1 ) the outline(s) contain(s) the required number of control room and in-plant tasks | ||
* W distributed among the safety functions as specified on the form 1 (2) task repetition from the last two NRC examinations is within the limits specified on the form IJR' T (3) no tasks are duplicated from the applicants' audit testis) tJ/r (4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form. b. Verify that the administrative outline meets the criteria specified on Form ES-301-1: | * W distributed among the safety functions as specified on the form 1 (2) task repetition from the last two NRC examinations is within the limits specified on the form IJR' T (3) no tasks are duplicated from the applicants' audit testis) tJ/r (4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form. b. Verify that the administrative outline meets the criteria specified on Form ES-301-1: | ||
1ft (1 ) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations | 1ft (1 ) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations | ||
: c. Determine if there are enough different outlines to test the projected number and mix 1ft of applicants and ensure that no items are duplicated on subsequent days. 4. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered 161.. in the appropriate exam sections. | : c. Determine if there are enough different outlines to test the projected number and mix 1ft of applicants and ensure that no items are duplicated on subsequent days. 4. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered 161.. in the appropriate exam sections. | ||
5Ur\ G 1f4( E b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate. )J.JI\ N Ensure that KiA importance ratings (except for plant-specific priorities) are at least 2.5. E c. .Sl.M R d. Check for duplication and overlap among exam sections. | 5Ur\ G 1f4( E b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate. )J.JI\ N Ensure that KiA importance ratings (except for plant-specific priorities) are at least 2.5. E c. .Sl.M R d. Check for duplication and overlap among exam sections. | ||
1tlJI, A t!K. | 1tlJI, A t!K. | ||
L e. Check the entire exam for balance of coverage. | L e. Check the entire exam for balance of coverage. | ||
<liA f. Assess whether the exam fits the appropriate job level (RO or SRO). '\ Fred 8KJI'kJr Date a. Author 1/-13-09 b. Facility Reviewer (*) | <liA f. Assess whether the exam fits the appropriate job level (RO or SRO). '\ Fred 8KJI'kJr Date a. Author 1/-13-09 b. Facility Reviewer (*) | ||
: c. NRC Chief Examiner (#) ///$'Or | : c. NRC Chief Examiner (#) ///$'Or | ||
* d NRC Supervisor A1AI//v lL i.lJJlfJ//AJI.,A( /{l\ I t/L1/D.j. | * d NRC Supervisor A1AI//v lL i.lJJlfJ//AJI.,A( /{l\ I t/L1/D.j. | ||
| Line 73: | Line 73: | ||
I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licenSing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). | I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licenSing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). | ||
Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. | Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. | ||
I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised. | I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised. | ||
: 2. Post-Examination , did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of ii7lr:b1!f. | : 2. Post-Examination , did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of ii7lr:b1!f. | ||
From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC. PRINTED NAME JOB TITLE I RESPONSIBILITY " A SIGNATURE (1) lLc IOh | From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC. PRINTED NAME JOB TITLE I RESPONSIBILITY " A SIGNATURE (1) lLc IOh | ||
| Line 96: | Line 96: | ||
I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licenSing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). | I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licenSing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). | ||
Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. | Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. | ||
I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised. | I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised. | ||
: 2. Post-Examination To the best of my not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or previ e performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC. JOB TITLE I RESPONSIBILITY " A SIGNATURE (1) lLc IOh | : 2. Post-Examination To the best of my not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or previ e performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC. JOB TITLE I RESPONSIBILITY " A SIGNATURE (1) lLc IOh | ||
! | ! | ||
| Line 127: | Line 127: | ||
New KIA (WEll 2.1.27) selected by Lead Examiner. | New KIA (WEll 2.1.27) selected by Lead Examiner. | ||
f!'IN4L ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: | f!'IN4L ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: | ||
McGuire Nuclear Station Date of Exam: 11/19/2009 Exam Level: RO SRO 4. I 5. 6. 7. Item Description Questions and answers are technically accurate and applicable to the facility. | McGuire Nuclear Station Date of Exam: 11/19/2009 Exam Level: RO SRO 4. I 5. 6. 7. Item Description Questions and answers are technically accurate and applicable to the facility. | ||
: a. NRC KlAs are referenced for all questions. | : a. NRC KlAs are referenced for all questions. | ||
: b. Facility learning objectives are referenced as available. | : b. Facility learning objectives are referenced as available. | ||
SRO questions are appropriate in accordance with Section D.2.d of ES-401 ----. ---------------.------,,---. ------- | SRO questions are appropriate in accordance with Section D.2.d of ES-401 ----. ---------------.------,,---. ------- | ||
| Line 144: | Line 144: | ||
* The facility reviewer'S initials/signature are not applicable for NRC-developed examinations. | * The facility reviewer'S initials/signature are not applicable for NRC-developed examinations. | ||
# Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required. _ _ _ _ J _ ____ _ Date f!'IN4L ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: | # Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required. _ _ _ _ J _ ____ _ Date f!'IN4L ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: | ||
McGuire Nuclear Station Date of Exam: 11/19/2009 Exam Level: RO SRO 1. 2. 3. 4. I 5. 6. 7. 8. 9. Item Description Questions and answers are technically accurate and applicable to the facility. | McGuire Nuclear Station Date of Exam: 11/19/2009 Exam Level: RO SRO 1. 2. 3. 4. I 5. 6. 7. 8. 9. Item Description Questions and answers are technically accurate and applicable to the facility. | ||
: a. NRC KlAs are referenced for all questions. | : a. NRC KlAs are referenced for all questions. | ||
: b. Facility learning objectives are referenced as available. | : b. Facility learning objectives are referenced as available. | ||
SRO questions are appropriate in accordance with Section D.2.d of ES-401 ----. ---------------.------,,---. ------- | SRO questions are appropriate in accordance with Section D.2.d of ES-401 ----. ---------------.------,,---. ------- | ||
| Line 161: | Line 161: | ||
* The facility reviewer'S initials/signature are not applicable for NRC-developed examinations. | * The facility reviewer'S initials/signature are not applicable for NRC-developed examinations. | ||
# Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required. _ _ _ _ J _ | # Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required. _ _ _ _ J _ | ||
____ _ Date ES-401 Q#I 1. I 2. lOK lODr---,---.--.---.-(CIA) (1-5) Partial link Written Examination Review Worksheet McGuire 2009-302 4. Job Content Flaws Minutia I #1 Back-units I ward 5. Other Q= I SRO KIA Only 6. U/E/S 7. Explanation Instructions | ____ _ Date ES-401 Q#I 1. I 2. lOK lODr---,---.--.---.-(CIA) (1-5) Partial link Written Examination Review Worksheet McGuire 2009-302 4. Job Content Flaws Minutia I #1 Back-units I ward 5. Other Q= I SRO KIA Only 6. U/E/S 7. Explanation Instructions | ||
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.] | [Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.] | ||
: 1. 2. 3. 4. 5. 6. 7. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level. Enter the level of difficulty (LOD) of each question using a 1 -5 (easy -difficult) rating scale (questions in the 2 -4 range are acceptable). | : 1. 2. 3. 4. 5. 6. 7. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level. Enter the level of difficulty (LOD) of each question using a 1 -5 (easy -difficult) rating scale (questions in the 2 -4 range are acceptable). | ||
Check the appropriate box if a psychometric flaw is identified: | Check the appropriate box if a psychometric flaw is identified: | ||
| Line 177: | Line 177: | ||
Based on the reviewer's judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory? | Based on the reviewer's judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory? | ||
At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met). RO/SRO Combined Question Generic: CAF = Check at Facility DV = Discriminatory Value NP = Non plausible On the fill in the blank Os: State "Which one of the following completes the statement below" One of many examples is 0 8. Many questions marked green require this statement. | At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met). RO/SRO Combined Question Generic: CAF = Check at Facility DV = Discriminatory Value NP = Non plausible On the fill in the blank Os: State "Which one of the following completes the statement below" One of many examples is 0 8. Many questions marked green require this statement. | ||
M 2 x 2 M 2 x y N y N 1 003A1.02 E Stem: Underline and/or cap the word "minimum" RFA 10/27/09 003A301 E iSwap B with C so values are increasing Form ES-401-9 ES-401 Q#I 1. 2. 3. Psychometric Flaws LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Focus Dist. Link Written Examination Review Worksheet McGuire 2009-302 4. Job Content Flaws Minutia #1 Back-units ward 5. Other ;---Q= SRO KJA Only 6. U/E/S 7. Explanation nstructions Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.] | M 2 x 2 M 2 x y N y N 1 003A1.02 E Stem: Underline and/or cap the word "minimum" RFA 10/27/09 003A301 E iSwap B with C so values are increasing Form ES-401-9 ES-401 Q#I 1. 2. 3. Psychometric Flaws LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Focus Dist. Link Written Examination Review Worksheet McGuire 2009-302 4. Job Content Flaws Minutia #1 Back-units ward 5. Other ;---Q= SRO KJA Only 6. U/E/S 7. Explanation nstructions Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.] | ||
: 1. 2. 3. 4. 5. 16. 7. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level. Enter the level of difficulty (LOD) of each question using a 1 -5 (easy -difficult) rating scale (questions in the 2 -4 range are acceptable). | : 1. 2. 3. 4. 5. 16. 7. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level. Enter the level of difficulty (LOD) of each question using a 1 -5 (easy -difficult) rating scale (questions in the 2 -4 range are acceptable). | ||
Check the appropriate box if a psychometric flaw is identified: | Check the appropriate box if a psychometric flaw is identified: | ||
| Line 194: | Line 194: | ||
M 2 x y 2 M 2 x y N N E Stem: Underline and/or cap the word "minimum" RFA 10/27/09 Ii'. 'I' 003A301 E Swap B with C so values are increasing Form ES-401-9 n 1. I 2. Q#/ILOK (CIA) (1-5) Partial 3 M 2 4 c 3 x 5 C 3 x 6 M 1 x 7 C 3 x Link 4. Job Content Flaws Minutia I #1 I Back-units ward 5. Other Q= I SRO KIA Only 6. utE/S y N I N N u 7. Explanation D: Why would flow go up given this failure and these conditions? | M 2 x y 2 M 2 x y N N E Stem: Underline and/or cap the word "minimum" RFA 10/27/09 Ii'. 'I' 003A301 E Swap B with C so values are increasing Form ES-401-9 n 1. I 2. Q#/ILOK (CIA) (1-5) Partial 3 M 2 4 c 3 x 5 C 3 x 6 M 1 x 7 C 3 x Link 4. Job Content Flaws Minutia I #1 I Back-units ward 5. Other Q= I SRO KIA Only 6. utE/S y N I N N u 7. Explanation D: Why would flow go up given this failure and these conditions? | ||
RFA 10108/09 Accepted 10/27/09 ':;, i:, f"', ;:, :"t',", ;, ... :', 004K5.49 No comment at this time RFA 10/27/09 ..... .., .-.j. | RFA 10108/09 Accepted 10/27/09 ':;, i:, f"', ;:, :"t',", ;, ... :', 004K5.49 No comment at this time RFA 10/27/09 ..... .., .-.j. | ||
'. 't' " UUbG2.4.50 The second part of distracters A and 8 do not state any manual or automatic actions. That action is not much different then the correct answer a stated in C. Potentially A and C are both correct answers. Modify the second parts of A and 8. This Q is U because of two potentially correct answers. RFA 10/27/09 .. '\ ,'::\.!;. | '. 't' " UUbG2.4.50 The second part of distracters A and 8 do not state any manual or automatic actions. That action is not much different then the correct answer a stated in C. Potentially A and C are both correct answers. Modify the second parts of A and 8. This Q is U because of two potentially correct answers. RFA 10/27/09 .. '\ ,'::\.!;. | ||
::-: 006K2.01 N N E I Please justify why 2EMXA and 2ELXA are plausible. | ::-: 006K2.01 N N E I Please justify why 2EMXA and 2ELXA are plausible. | ||
Neither the distracter analysis nor the reference material supports their plausibility. | Neither the distracter analysis nor the reference material supports their plausibility. | ||
N N N N E This E is U until justified due to two NP distracters. | N N N N E This E is U until justified due to two NP distracters. | ||
RFA 10/27/09 Added feeder to stem of question. | RFA 10/27/09 Added feeder to stem of question. | ||
1 006K2.04 This Q has low DV. Increase DV by adding a second valve to each choice: A. XZ incorrect | 1 006K2.04 This Q has low DV. Increase DV by adding a second valve to each choice: A. XZ incorrect | ||
: 8. XY correct C. zy incorrect D .. WZ incorrect This Q is U because of low DV RFA 10/27/09 ,-;. ** ' .. ::. 1-1 ' .-:, .:. I 007AT01 The containment floor and equipment sum plausibility is I19t justified. | : 8. XY correct C. zy incorrect D .. WZ incorrect This Q is U because of low DV RFA 10/27/09 ,-;. ** ' .. ::. 1-1 ' .-:, .:. I 007AT01 The containment floor and equipment sum plausibility is I19t justified. | ||
The distracter analvsis says floor is used :) -1. 2. 3. Flaws 0#1 LOK (CI A) I (1':.'5) | The distracter analvsis says floor is used :) -1. 2. 3. Flaws 0#1 LOK (CI A) I (1':.'5) | ||
| Line 212: | Line 212: | ||
RFA 10/27/09 I I; c': , : '/ I 10 012K6.03 C 3 X N N E The 3'd bullet is not required because they were never I declared i noperable. | RFA 10/27/09 I I; c': , : '/ I 10 012K6.03 C 3 X N N E The 3'd bullet is not required because they were never I declared i noperable. | ||
RFA 10/27/09 I " .': I 11 013A4.03 C 3 X N N E I don't think need the word ONL Y in A because an I auto SI will OT reoccur until the timer has t i med out as i n B. You can also rewrite A as follows: After the SI reset I push buttons are depressed and the RTBs have been cycled , an auto SI reinitiation can immediatel* | RFA 10/27/09 I " .': I 11 013A4.03 C 3 X N N E I don't think need the word ONL Y in A because an I auto SI will OT reoccur until the timer has t i med out as i n B. You can also rewrite A as follows: After the SI reset I push buttons are depressed and the RTBs have been cycled , an auto SI reinitiation can immediatel* | ||
occur. I (Note, th i s is wrong because the timer has no timed out yet) I Distracter A is NP as written. RFA 10/27/09 I ',', r 1 ,, 1 , , -, I 12 013K1.01 M 2 Y N S No comment at this time I E RFA 10/27/09 , " Changed que s tion to use Containment Spray logic instead of SI logic b a sed on validation feedback results , This changed the correct a n s wer to'S'. This also changed the question from an'S' to an 'E'. 1. 2. 3. Psy c hometric Flaws 4. Job Conlent Flaws 0#/ LOK LOD (C I A) (1-5) Stem Cues T I F Credo Partial Job-Minutia #1 Back-F o cus Dis!. link units ward B c 3 x 9 c 3 x 1 0 c 3 x 11 c 3 x () | occur. I (Note, th i s is wrong because the timer has no timed out yet) I Distracter A is NP as written. RFA 10/27/09 I ',', r 1 ,, 1 , , -, I 12 013K1.01 M 2 Y N S No comment at this time I E RFA 10/27/09 , " Changed que s tion to use Containment Spray logic instead of SI logic b a sed on validation feedback results , This changed the correct a n s wer to'S'. This also changed the question from an'S' to an 'E'. 1. 2. 3. Psy c hometric Flaws 4. Job Conlent Flaws 0#/ LOK LOD (C I A) (1-5) Stem Cues T I F Credo Partial Job-Minutia #1 Back-F o cus Dis!. link units ward B c 3 x 9 c 3 x 1 0 c 3 x 11 c 3 x () | ||
: 6. A'" SRO U I EIS KIA Only N N E N N E N N E N N E 7. E x planation ogesn say w en. | : 6. A'" SRO U I EIS KIA Only N N E N N E N N E N N E 7. E x planation ogesn say w en. | ||
c an9,n9 IV. a n d C2 to the radwaste facility o r something or justify p l ausibi li ty. Thi s a i s E until A2 and C2 are either justified or replaced. RFA 10 f 27{09 " ' >' 00BA2.03 Change motor b eari n g tempe r atures t o 190. C 1 and D 1 more pl a u s i bility. RFA 10127/09 . '" , , 010K6.0 4 This will give I t's common knowledge th at the Pzr r elief valves discharge t o th e PRT. If th e PRT ruptures\ | c an9,n9 IV. a n d C2 to the radwaste facility o r something or justify p l ausibi li ty. Thi s a i s E until A2 and C2 are either justified or replaced. RFA 10 f 27{09 " ' >' 00BA2.03 Change motor b eari n g tempe r atures t o 190. C 1 and D 1 more pl a u s i bility. RFA 10127/09 . '" , , 010K6.0 4 This will give I t's common knowledge th at the Pzr r elief valves discharge t o th e PRT. If th e PRT ruptures\ | ||
| Line 241: | Line 241: | ||
the CF isolation reset or when pressure increase above 1955 psig. D. when pressure increased above 1955 psig ONLY RFA 10/27/09 ',;: : :,,:. ;.:,; .. : '; 'f. 059K3.03 Too much teaching in all distracters/choices. | the CF isolation reset or when pressure increase above 1955 psig. D. when pressure increased above 1955 psig ONLY RFA 10/27/09 ',;: : :,,:. ;.:,; .. : '; 'f. 059K3.03 Too much teaching in all distracters/choices. | ||
Furthermore, the second parts may give away the correct answer. Reduce to the following: | Furthermore, the second parts may give away the correct answer. Reduce to the following: | ||
IA. The feedwater regulating valves on A and 0 SGs only will open. B. The feedwater regulating valves will remain in the same position for all SGs C. All feedwater regulating valves will open to feed all SG (WR or NR) levels to 65%. D. The feedwater regulating valves on Band C SGs will open to increase the (WR or NR) levels to 65%. RFA 10/27/09 '(.'. ' . n (") 1. 2. 3. Psychometric Flaws 4. Job Content Flaws | IA. The feedwater regulating valves on A and 0 SGs only will open. B. The feedwater regulating valves will remain in the same position for all SGs C. All feedwater regulating valves will open to feed all SG (WR or NR) levels to 65%. D. The feedwater regulating valves on Band C SGs will open to increase the (WR or NR) levels to 65%. RFA 10/27/09 '(.'. ' . n (") 1. 2. 3. Psychometric Flaws 4. Job Content Flaws | ||
: 5. 7. 0#1 l OO 100" (1-5) S t em T I F Parti a l Job-M i n utia " Back-U tE/S Explanation Focus Unk units w,rn KIA , ." | : 5. 7. 0#1 l OO 100" (1-5) S t em T I F Parti a l Job-M i n utia " Back-U tE/S Explanation Focus Unk units w,rn KIA , ." | ||
* 17 e 3 X N N . isolated a t 1 00% t o 85%. T his wil g i ve 8 a nd . , . ," ' ' * ' ro' ., 18 e 3 X Y N E i P-11 to 1960 This way th ey ha ve't o I ;"andha pressure P-11 I S. his w ill in c r ease I m a k e the answer les s obvious RFA i i com ment: 1 01! NP for se t of even t s given. F or this l evel o f exa m failure to r eca ll that P-11 resets is not . Th ere ore 0 is not p lau sible. I sugges t the l A,' Follow ing the CF isolation reset or when the SG Hi-Hi l evel c le a re d. When the SG Hi-Hi l eve l cleared ON L Y I e. | * 17 e 3 X N N . isolated a t 1 00% t o 85%. T his wil g i ve 8 a nd . , . ," ' ' * ' ro' ., 18 e 3 X Y N E i P-11 to 1960 This way th ey ha ve't o I ;"andha pressure P-11 I S. his w ill in c r ease I m a k e the answer les s obvious RFA i i com ment: 1 01! NP for se t of even t s given. F or this l evel o f exa m failure to r eca ll that P-11 resets is not . Th ere ore 0 is not p lau sible. I sugges t the l A,' Follow ing the CF isolation reset or when the SG Hi-Hi l evel c le a re d. When the SG Hi-Hi l eve l cleared ON L Y I e. | ||
the CF isolation r ese t o r when pressure Increase above 1955 psig. 1 0. when pressure Increased above 1955 psig ONLY I RFA 10 12 7/09 | the CF isolation r ese t o r when pressure Increase above 1955 psig. 1 0. when pressure Increased above 1955 psig ONLY I RFA 10 12 7/09 | ||
* 1 9 e 3 X Y N E ':: i j parts may give away the co rre ct 1 0 th e following: I A. The feedwaler regulating valves on A and 0 SGs only will open. l B. The feedwaler regu l at iG1 valves will re main in the same position for a ll S s I C. All feedwater valves will op e n to feed a ll SG (WR or NR) le ve s t o 6 %. 1 0. The fee dwa ter refhulatin2 valves on Band C SGs will I RF:pen 1 0 increase e (W or NR) level s t o 65%. 10 127/09 | * 1 9 e 3 X Y N E ':: i j parts may give away the co rre ct 1 0 th e following: I A. The feedwaler regulating valves on A and 0 SGs only will open. l B. The feedwaler regu l at iG1 valves will re main in the same position for a ll S s I C. All feedwater valves will op e n to feed a ll SG (WR or NR) le ve s t o 6 %. 1 0. The fee dwa ter refhulatin2 valves on Band C SGs will I RF:pen 1 0 increase e (W or NR) level s t o 65%. 10 127/09 | ||
* I , | * I , | ||
( ) l 0 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Cred o Partial Job-Minutia #1 8ack-Q= SRO UtE/S Explanation Focus Dist. Link units ward KIA Only : : TT:;:) 20 I 061Kl.0l M 2 Y N No comment at this time RFA 10/27109 '1/'" ,;" ., . . . 21 062K4.10 C 3 X Y N E Need for D. As written, D could be potentially correct since i it takes 30 s or so to return to normal. Suggestion for D: Loads will auto swap back to the inverter as soon as inverter over curren is detected to be less than 120% RFA 10/27109 :.' . .').';:; ':{-':.: :" ,.--: ri:'.:"C}::.:-: '; 22 063K2.01 M 1 X N N U This Q has low DV. Suggested fix: A. DIG Fuel Oil Booster Pump and FWPT A Emergency Oil Pump(s) B. FWPT A Emergency Oi l Pump(s) and Reactor Trip Switchgear Control C. Turbine Emergency Bearing Oil Pump and Turbine Backup Vapor Extractor(s) | ( ) l 0 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Cred o Partial Job-Minutia #1 8ack-Q= SRO UtE/S Explanation Focus Dist. Link units ward KIA Only : : TT:;:) 20 I 061Kl.0l M 2 Y N No comment at this time RFA 10/27109 '1/'" ,;" ., . . . 21 062K4.10 C 3 X Y N E Need for D. As written, D could be potentially correct since i it takes 30 s or so to return to normal. Suggestion for D: Loads will auto swap back to the inverter as soon as inverter over curren is detected to be less than 120% RFA 10/27109 :.' . .').';:; ':{-':.: :" ,.--: ri:'.:"C}::.:-: '; 22 063K2.01 M 1 X N N U This Q has low DV. Suggested fix: A. DIG Fuel Oil Booster Pump and FWPT A Emergency Oil Pump(s) B. FWPT A Emergency Oi l Pump(s) and Reactor Trip Switchgear Control C. Turbine Emergency Bearing Oil Pump and Turbine Backup Vapor Extractor(s) | ||
D. Turbine Emergency Bearing Oil Pump and DIG Fuel Oil Booster Pump This Q is U because of low DV RFA 10/27109 I i: ,;: :): .. 23 064A3.0 1 M 2 X N N E Move the WOOTF statement to the top. CAF: Look at A1 and C1 and make sure that they are not subsets of B1 and D1 because 235 psig is between both choices. You might consider using an actual value where the l imits have to be applied instead. RFA 10/27109 the Rressure range for d i stracters | D. Turbine Emergency Bearing Oil Pump and DIG Fuel Oil Booster Pump This Q is U because of low DV RFA 10/27109 I i: ,;: :): .. 23 064A3.0 1 M 2 X N N E Move the WOOTF statement to the top. CAF: Look at A1 and C1 and make sure that they are not subsets of B1 and D1 because 235 psig is between both choices. You might consider using an actual value where the l imits have to be applied instead. RFA 10/27109 the Rressure range for d i stracters | ||
| Line 266: | Line 266: | ||
C and 0 a re "ve rify" A and B a re performance steps. If th e stem for a requ ire m ent, then th e applicant w ill rul e l out c and 0 be cause they a r e NOT performan ce steps. I RFA 10/2 7/09 | C and 0 a re "ve rify" A and B a re performance steps. If th e stem for a requ ire m ent, then th e applicant w ill rul e l out c and 0 be cause they a r e NOT performan ce steps. I RFA 10/2 7/09 | ||
'A' and '8' and changed . to " Start the associated samp l e pump perform a setpolnt c he ck and chan ed the associated sample pump AND perform a so ur ce check" , '''' ',' , ")' 26 M 2 X N N E | 'A' and '8' and changed . to " Start the associated samp l e pump perform a setpolnt c he ck and chan ed the associated sample pump AND perform a so ur ce check" , '''' ',' , ")' 26 M 2 X N N E | ||
; 1 knqwle,dge, I do not I fmm ! ;, I since I suction IS commo n D. I RFA 10/27/09 " , , , 27 C 3 Y N I"' co mm e nt at th i s time RFA 10/27/09 , , , 26 M 2 X N N E If C was co rr ect, 0 would be a l so. , or 0 or add an ONLY to C. I RFA 10127/09 I .. '. . 29 C 2 X N N E I ,:,n, ;n ,:;t ,peed-is not plausible especiaUy with | ; 1 knqwle,dge, I do not I fmm ! ;, I since I suction IS commo n D. I RFA 10/27/09 " , , , 27 C 3 Y N I"' co mm e nt at th i s time RFA 10/27/09 , , , 26 M 2 X N N E If C was co rr ect, 0 would be a l so. , or 0 or add an ONLY to C. I RFA 10127/09 I .. '. . 29 C 2 X N N E I ,:,n, ;n ,:;t ,peed-is not plausible especiaUy with | ||
( , ( ) I ......,; 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. Q#I LOK I LOD r--(CIA) (1-5) Stem Cues T/F Cred o Partial Job-Minutia #1 Back-Q= SRO U/E/S Explanation Focus Dist. Link units ward KIA Only IKI"'A 10/27/09 | ( , ( ) I ......,; 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. Q#I LOK I LOD r--(CIA) (1-5) Stem Cues T/F Cred o Partial Job-Minutia #1 Back-Q= SRO U/E/S Explanation Focus Dist. Link units ward KIA Only IKI"'A 10/27/09 | ||
:.: ," , . '., . :';i:: , " ;::., "':" '''-".:,-:. | :.: ," , . '., . :';i:: , " ;::., "':" '''-".:,-:. | ||
,-.' ',: ,..: . I' .' ',-r'. ,/', I (::;:1 i 1",': 30 014A1.02 M 2 X N N E A is a subset of B. If C was correct so would D. Psychometrics need to be addressed. | ,-.' ',: ,..: . I' .' ',-r'. ,/', I (::;:1 i 1",': 30 014A1.02 M 2 X N N E A is a subset of B. If C was correct so would D. Psychometrics need to be addressed. | ||
| Line 276: | Line 276: | ||
?'t::>'.: | ?'t::>'.: | ||
i;: :.; .. ,-' ..... .. .::: :: !? : "i ,:., :.,: , ',':;' -","', ::';",::;; | i;: :.; .. ,-' ..... .. .::: :: !? : "i ,:., :.,: , ',':;' -","', ::';",::;; | ||
":.': :. ;. :';":;:. '; 32 029A2.03 C 3 X Y N E Identify the procedure that must be used to support the second part of the KA . ..... and how can it be stabilized as stated in procedure RF A 10/28/09 I: i:':,. " -: '::": , r\ ,. ,. , . ;" '.lid'*-/*;**nc*'" : . : : <.: <J 034A303 ._--33 M 2 Y N Revisited No comment at this time RFA 10/28109 *1 ,,\, ( : : ':: :. :'-' ;. 045K4.13 -,-34 M 2 Y N No comment at this time RF A 10/28109 'i.:. .;; -: r.1'-;*, 'll -_. o . ... 3 0#/ LUK L UU Partial Flaws 30 M 2 x 31 c 3 x 32 c 3 x 33 M 2 34 M 2 Unk 4. Job Content Flaws Minutia #1 Back-units ward n t<JA """ N N y N y N y N y N 6. UIE/S E KCA I**, -,., 1014A1.02 | ":.': :. ;. :';":;:. '; 32 029A2.03 C 3 X Y N E Identify the procedure that must be used to support the second part of the KA . ..... and how can it be stabilized as stated in procedure RF A 10/28/09 I: i:':,. " -: '::": , r\ ,. ,. , . ;" '.lid'*-/*;**nc*'" : . : : <.: <J 034A303 ._--33 M 2 Y N Revisited No comment at this time RFA 10/28109 *1 ,,\, ( : : ':: :. :'-' ;. 045K4.13 -,-34 M 2 Y N No comment at this time RF A 10/28109 'i.:. .;; -: r.1'-;*, 'll -_. o . ... 3 0#/ LUK L UU Partial Flaws 30 M 2 x 31 c 3 x 32 c 3 x 33 M 2 34 M 2 Unk 4. Job Content Flaws Minutia #1 Back-units ward n t<JA """ N N y N y N y N y N 6. UIE/S E KCA I**, -,., 1014A1.02 | ||
: 7. | : 7. | ||
-, I I;' 'is a subse t of B. [ii C was co rrect so would O. j P,;,cho,nellrics need to be addressed. | -, I I;' 'is a subse t of B. [ii C was co rrect so would O. j P,;,cho,nellrics need to be addressed. | ||
j RFA 10/27109 ,. t. 7K601 D E d: , ": 0::' "A" i s plausible g iv en t h e I f " A" o r prove plausibility. I RFA 10 108/09 E l eAF: Must demon s trate plausibility | j RFA 10/27109 ,. t. 7K601 D E d: , ": 0::' "A" i s plausible g iv en t h e I f " A" o r prove plausibility. I RFA 10 108/09 E l eAF: Must demon s trate plausibility | ||
[RFA 10{27/09 I .\. It; ',), * " oj',. 'I * 'I , i the procedure that must be u sed to suppo rt the part of the KA ..... and how can it be stabilized as stated in t'p"""d",. | [RFA 10{27/09 I .\. It; ',), * " oj',. 'I * 'I , i the procedure that must be u sed to suppo rt the part of the KA ..... and how can it be stabilized as stated in t'p"""d",. | ||
1 I RFA 10/28/09 ., I al this time 10/28/09 \ I Uoo" O." at this time 10/28/09 n 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. Q#I LOK LOD r--(CIA) (1-5) Stem Cues TIF Credo Partial Job-Minutia #1 Back-Q= SRO U/E/S Explanation Focus D i st. Link units ward KIA Only 35 I I U OOK 1.U O M 2 Y N No comment at th i s time RFA 10/28/09 t': | 1 I RFA 10/28/09 ., I al this time 10/28/09 \ I Uoo" O." at this time 10/28/09 n 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. Q#I LOK LOD r--(CIA) (1-5) Stem Cues TIF Credo Partial Job-Minutia #1 Back-Q= SRO U/E/S Explanation Focus D i st. Link units ward KIA Only 35 I I U OOK 1.U O M 2 Y N No comment at th i s time RFA 10/28/09 t': | ||
| Line 292: | Line 292: | ||
a is U because o f potentially two co rre c t answers. 10/28/09 I .. " ,," 39 M 2 X X Y N u OK f or actions that s hould h ave occ urr ed | a is U because o f potentially two co rre c t answers. 10/28/09 I .. " ,," 39 M 2 X X Y N u OK f or actions that s hould h ave occ urr ed | ||
!p turbines a r e t ripped" is nol plausible i . in the stem that mi.9ht drive the i I Add so mething in t he stem like a I fa;l, r Oi al m ight elude the appli cant t o '0. Q. U because of two NP d i st r ac ters. 10/28/09 , 40 (1.01 C 3 Y N . 1 w!lh I I hlsQ I deal, w ! Ihe. | !p turbines a r e t ripped" is nol plausible i . in the stem that mi.9ht drive the i I Add so mething in t he stem like a I fa;l, r Oi al m ight elude the appli cant t o '0. Q. U because of two NP d i st r ac ters. 10/28/09 , 40 (1.01 C 3 Y N . 1 w!lh I I hlsQ I deal, w ! Ihe. | ||
m0tUei .m ,-I';; SRO ONLY a'pecl of Ih;,. , ..... 41 I' D 4. Job Content Flaws 0#/1 LOK | m0tUei .m ,-I';; SRO ONLY a'pecl of Ih;,. , ..... 41 I' D 4. Job Content Flaws 0#/1 LOK | ||
: 1. I 2. I 3. Psychometric Flaws Stem I Cuesl T/F Icred.1 Partial (CIA) (1-5) M I 2 42 M 2 43 C 3 44 C 2 Focus Dis!. x I I X X X X Link Minutia 1 #1 I Back-units ward 5. Other Q= ISRO KIA Only YIN Y N Y N Y N 6. 7. utE/S Explanation | : 1. I 2. I 3. Psychometric Flaws Stem I Cuesl T/F Icred.1 Partial (CIA) (1-5) M I 2 42 M 2 43 C 3 44 C 2 Focus Dis!. x I I X X X X Link Minutia 1 #1 I Back-units ward 5. Other Q= ISRO KIA Only YIN Y N Y N Y N 6. 7. utE/S Explanation | ||
-r lAIl dloices Involve teaching. | -r lAIl dloices Involve teaching. | ||
| Line 306: | Line 306: | ||
AI what temp does resin . Something higher than 1 38 would also be I RFA'IOI28109 , I , , * \ . , , final I 'h.,'em ofthe i j to 8 1 . l to i effects" ,in Ii Ithe w", rthe due I i and not \' '5;'0 . This c ha nged th e i ""ni an' an 'E', approved RFA 11 112109 Change " ha s* to " ha ve". : As written, B is also a corre c t answe r. i I I If C was correc!. so wou ld D. Q is U of mult ip l e correct answers. 10/28/0 9 , , | AI what temp does resin . Something higher than 1 38 would also be I RFA'IOI28109 , I , , * \ . , , final I 'h.,'em ofthe i j to 8 1 . l to i effects" ,in Ii Ithe w", rthe due I i and not \' '5;'0 . This c ha nged th e i ""ni an' an 'E', approved RFA 11 112109 Change " ha s* to " ha ve". : As written, B is also a corre c t answe r. i I I If C was correc!. so wou ld D. Q is U of mult ip l e correct answers. 10/28/0 9 , , | ||
final va lidati o n on 1 11 11109 , c hang e d fi r st ) bullets .to set i nit ia l co ndition s as a Steam Break opposed to a Pre ssu rizer Safety Va r ve stuck open I t; improve the p l au s ibitlty of the Initial condi t ion s. app r oved RFA t 1/12/09 | final va lidati o n on 1 11 11109 , c hang e d fi r st ) bullets .to set i nit ia l co ndition s as a Steam Break opposed to a Pre ssu rizer Safety Va r ve stuck open I t; improve the p l au s ibitlty of the Initial condi t ion s. app r oved RFA t 1/12/09 | ||
, 1. 2. 3. Psychomet r ic Flaws 4. Job Content Flaws 5. Other 6. 7. Q#I LOK LOD ,--(CIA) (1-5) Stem Cues T/F Credo Partial Job-M i nutia #1 Back-Q= SRO U/EtS E x planation Focus Dis!. Li nk units ward KIA On l y 1 I::I-'I:: lI/!-I{';/ A.2" 45 M 2 Y N No comment at this time RFA 10/28/09 | , 1. 2. 3. Psychomet r ic Flaws 4. Job Content Flaws 5. Other 6. 7. Q#I LOK LOD ,--(CIA) (1-5) Stem Cues T/F Credo Partial Job-M i nutia #1 Back-Q= SRO U/EtS E x planation Focus Dis!. Li nk units ward KIA On l y 1 I::I-'I:: lI/!-I{';/ A.2" 45 M 2 Y N No comment at this time RFA 10/28/09 | ||
(':,,}' ,:; :/;/': ":":') 46 EPE038EA 1.10 M 2 X X Y N E This Q is con f using. NSO-5 1 3 states that the best method is EMF-33 and the seconda'6 method is the N-16 monitor. The Q stem asks what the est indication is to determine that a SG tube leak has occurred. | (':,,}' ,:; :/;/': ":":') 46 EPE038EA 1.10 M 2 X X Y N E This Q is con f using. NSO-5 1 3 states that the best method is EMF-33 and the seconda'6 method is the N-16 monitor. The Q stem asks what the est indication is to determine that a SG tube leak has occurred. | ||
The stem seems to contrad i ct the ref materia l s l ightly by the way it is worded. Facility please re-evaluate. RFA 1 0/28/09 ,,' .. | The stem seems to contrad i ct the ref materia l s l ightly by the way it is worded. Facility please re-evaluate. RFA 1 0/28/09 ,,' .. | ||
| Line 312: | Line 312: | ||
RF A 10/28/09 {.-', :,: .. '-:: , . | RF A 10/28/09 {.-', :,: .. '-:: , . | ||
; .. :';. '.,,>; I'J :" ;'.:i A n' ';.: .. '; , "'.: p .; . I'*" ;:;: , ", . i 1 ,'<> ',"'>.> < .... 50 APE056AA2.37 C 3 Y N No comment at this time RFA 10/28/09 ,,'. 'i' ,', '; .) 51 APE057AA1.06 M 2 X X Y N E To be consistent, state in B , C, and 0 the procedure you --. -0#/ 45 1. LOK (C/A) M 2. | ; .. :';. '.,,>; I'J :" ;'.:i A n' ';.: .. '; , "'.: p .; . I'*" ;:;: , ", . i 1 ,'<> ',"'>.> < .... 50 APE056AA2.37 C 3 Y N No comment at this time RFA 10/28/09 ,,'. 'i' ,', '; .) 51 APE057AA1.06 M 2 X X Y N E To be consistent, state in B , C, and 0 the procedure you --. -0#/ 45 1. LOK (C/A) M 2. | ||
LOD (1-5) Stem !cu es TIf I<:r , ed. Partial Job* i #1 Back-Focus I UISt. Link units ward 2 () 7. | LOD (1-5) Stem !cu es TIf I<:r , ed. Partial Job* i #1 Back-Focus I UISt. Link units ward 2 () 7. | ||
: 6. 0-i SRO UlElS E:.:planation 10128 109 :" I this lime II----I----I---I---l----+--I---l---I----I---I-----I---I-----I--I= "" " , 1.10 46 M 2 x x y N 47 c 3 x y N 48 c 3 y N 49 M 2 x y N 50 c 3 y N 51 M 2 x x y N E I lIhe, 1 3 , Ithe.1 N-16 I iii , leak be" I,dl" ,eem, Hef , I "Igh ll y by 1e wi;';'", RF"i" r e-evaluate. " . comment a t this time 10/28/09 I I * ,\1 U I A is NP because there is nothing in t he s t em to indicate I t h a-' NC sys t em subcooling has been lost or challenged. | : 6. 0-i SRO UlElS E:.:planation 10128 109 :" I this lime II----I----I---I---l----+--I---l---I----I---I-----I---I-----I--I= "" " , 1.10 46 M 2 x x y N 47 c 3 x y N 48 c 3 y N 49 M 2 x y N 50 c 3 y N 51 M 2 x x y N E I lIhe, 1 3 , Ithe.1 N-16 I iii , leak be" I,dl" ,eem, Hef , I "Igh ll y by 1e wi;';'", RF"i" r e-evaluate. " . comment a t this time 10/28/09 I I * ,\1 U I A is NP because there is nothing in t he s t em to indicate I t h a-' NC sys t em subcooling has been lost or challenged. | ||
ill' 1 the to support the use o r I use s i n th is case .. . A and B do not appear t o be plausible. Q is U untit it is proved otherwise. | ill' 1 the to support the use o r I use s i n th is case .. . A and B do not appear t o be plausible. Q is U untit it is proved otherwise. | ||
| Line 335: | Line 335: | ||
* I RFA 10/28/09 , * " ,,, , , * . | * I RFA 10/28/09 , * " ,,, , , * . | ||
* i, l . fin a' " o n1'''''"' , ' I be ', 10' ,'h e a l acI"ai ' , In , | * i, l . fin a' " o n1'''''"' , ' I be ', 10' ,'h e a l acI"ai ' , In , | ||
I the , I I I ,:"ould' ffor-; de c rease l i n SOM | I the , I I I ,:"ould' ffor-; de c rease l i n SOM | ||
: a, I r!,d not -'j always de crease for a . Also , in the of th e question I the b u llet i r od motion to sa.y I . was *od I '!.O!. 0 ,od . | : a, I r!,d not -'j always de crease for a . Also , in the of th e question I the b u llet i r od motion to sa.y I . was *od I '!.O!. 0 ,od . | ||
'bo,on: | 'bo,on: | ||
| Line 345: | Line 345: | ||
The ref does not expla i n well. 60 C 3 x Y N 61 M 2 Y N Stem: Is this a high Temperature or a low temperature condition? | The ref does not expla i n well. 60 C 3 x Y N 61 M 2 Y N Stem: Is this a high Temperature or a low temperature condition? | ||
Remove the doub l e period from " C" and "D" RF A 10109/09 Revisited After revisiting this Q , I think 80°F would be more plausible then 65 of. 80 is the excessive water temperature in the RWST where 65 is the min RCS cold leg temp. Consider changing and we will discuss during the on site rev i ew. RFA 10/29/09 5 ": .. -: ': / ": ' i:: '::)' " IAPE061AA2 | Remove the doub l e period from " C" and "D" RF A 10109/09 Revisited After revisiting this Q , I think 80°F would be more plausible then 65 of. 80 is the excessive water temperature in the RWST where 65 is the min RCS cold leg temp. Consider changing and we will discuss during the on site rev i ew. RFA 10/29/09 5 ": .. -: ': / ": ' i:: '::)' " IAPE061AA2 | ||
.04 E Ilf you wanted to write this W /0 it being a NOT Q , consider the following: u WOOTF alarm(s) can be used to confirm that the 1EMF-1 6 alarm is valid? A. 1EMF-17 annunciator or SFP level Low computer alarm B. Incore Inst Room Sump Hi Level or 1 EMF-51A alarm C. 1 EMF-17 annunciator ONLY D. 1EMF-51A alarm ONLY RFA 10/29/09 .. <,., . " ,;' .;; '. -: : 1 ,.,,* ;." k. '.-. '(: I A P E067AK3.02 Accord i ng to the reference (OMP 2-2 , Page 13,) A and B are both correct. If that is not so then: Change the 2 nd part of A to "The fire brigade will respond." Change the 2 nd part of B to ''The fire brigade will NOT respond." l As written , the Question is leadinQ the applicant to the -0 L6K 3. i Flaws 4. Job Content Flaws | .04 E Ilf you wanted to write this W /0 it being a NOT Q , consider the following: u WOOTF alarm(s) can be used to confirm that the 1EMF-1 6 alarm is valid? A. 1EMF-17 annunciator or SFP level Low computer alarm B. Incore Inst Room Sump Hi Level or 1 EMF-51A alarm C. 1 EMF-17 annunciator ONLY D. 1EMF-51A alarm ONLY RFA 10/29/09 .. <,., . " ,;' .;; '. -: : 1 ,.,,* ;." k. '.-. '(: I A P E067AK3.02 Accord i ng to the reference (OMP 2-2 , Page 13,) A and B are both correct. If that is not so then: Change the 2 nd part of A to "The fire brigade will respond." Change the 2 nd part of B to ''The fire brigade will NOT respond." l As written , the Question is leadinQ the applicant to the -0 L6K 3. i Flaws 4. Job Content Flaws | ||
: 6. 1. Q#! ie,,, | : 6. 1. Q#! ie,,, | ||
TIF Partial Job-Minutia #I Back'* Q. | TIF Partial Job-Minutia #I Back'* Q. | ||
| Line 357: | Line 357: | ||
RFA 10/29/09 (: :',', ,'; . :, .' .. ;; ; " 65 WE13G2.2.37 C 3 Y N S No comment at this time E RF A 10/29109 : ,',\ /"': " '.! ""'::,,. ",' ",' .... I I> , ., '; 'I* I .': ;': . . . 66 G2.1.28 M 2 Y N No comment at this time RFA 10/29/09 : .... : .,.: . , 67 G2.1.30 M 2 N N U This Q does not have to do with local contro S. I suggest writing a Q where e CR haC! to be evacuated an the operator has to report to a local station to operated equipment. | RFA 10/29/09 (: :',', ,'; . :, .' .. ;; ; " 65 WE13G2.2.37 C 3 Y N S No comment at this time E RF A 10/29109 : ,',\ /"': " '.! ""'::,,. ",' ",' .... I I> , ., '; 'I* I .': ;': . . . 66 G2.1.28 M 2 Y N No comment at this time RFA 10/29/09 : .... : .,.: . , 67 G2.1.30 M 2 N N U This Q does not have to do with local contro S. I suggest writing a Q where e CR haC! to be evacuated an the operator has to report to a local station to operated equipment. | ||
This Q is U because the KA is not met -_ .... --() () 1. 2. 3. Psychome t ric Flaws 4. Job Content Flaws 6. 7. 0#1 lOD 1'6,:1 (1-5) Stem I C,,, 71F Partial Job-, #1 Back.-1 U/EIS Explana t ion Focus Li n k units _,d KJA I the Q is U because o f two correct answers. , " . 1\, . n e w qu es t io n. O ri gina l qu estion w as i to be SRO l evel k no w le d ge fo ll owing f i n al i o n 11/11 10 9. approved RF A 11 1121 0 9 62 .1.2. M 2 y N $ comme nt at t his time E RFA 1 0129/09 r, 1,1 * '. , 63 M 2 Y N commen t a l th i s ti m e r.: , 1 0/29/09 "'l ,I, 64 C? 2 Y N E i a comp r e h e n sive a s i nce a fa ir a m o unt o f I is required. I RFA 10129109 ., , , 65 C 3 Y N $ | This Q is U because the KA is not met -_ .... --() () 1. 2. 3. Psychome t ric Flaws 4. Job Content Flaws 6. 7. 0#1 lOD 1'6,:1 (1-5) Stem I C,,, 71F Partial Job-, #1 Back.-1 U/EIS Explana t ion Focus Li n k units _,d KJA I the Q is U because o f two correct answers. , " . 1\, . n e w qu es t io n. O ri gina l qu estion w as i to be SRO l evel k no w le d ge fo ll owing f i n al i o n 11/11 10 9. approved RF A 11 1121 0 9 62 .1.2. M 2 y N $ comme nt at t his time E RFA 1 0129/09 r, 1,1 * '. , 63 M 2 Y N commen t a l th i s ti m e r.: , 1 0/29/09 "'l ,I, 64 C? 2 Y N E i a comp r e h e n sive a s i nce a fa ir a m o unt o f I is required. I RFA 10129109 ., , , 65 C 3 Y N $ | ||
al this ti me E 10/29/09 , 66 M 2 Y N commen t at t his lime 1 0129'09 e., {, r _. c "' , 67 M 2 II N U cO' t o do wi th l oca l co nt ro s. I SU9aBst a Q I w h e r e t o be evacuated an the opera or has to a I s t a t ion t o ope r ated equip m en t. a is U beca u se the KA i s not mel o (J 0 1\ 1 I 11 1. I 2. Q#/I LOK' LaD (CIA) (1-5) Partial 68 e 3 69 M 2 x 70 e 2 JobLink 4. Job Content Flaws Minutia I #1 I 8ack-units ward 5. Other I 6. .------Q= I SRO I U/E/S KIA Only 7. E x planation | al this ti me E 10/29/09 , 66 M 2 Y N commen t at t his lime 1 0129'09 e., {, r _. c "' , 67 M 2 II N U cO' t o do wi th l oca l co nt ro s. I SU9aBst a Q I w h e r e t o be evacuated an the opera or has to a I s t a t ion t o ope r ated equip m en t. a is U beca u se the KA i s not mel o (J 0 1\ 1 I 11 1. I 2. Q#/I LOK' LaD (CIA) (1-5) Partial 68 e 3 69 M 2 x 70 e 2 JobLink 4. Job Content Flaws Minutia I #1 I 8ack-units ward 5. Other I 6. .------Q= I SRO I U/E/S KIA Only 7. E x planation | ||
[R F A 1U/£8/U8 {,)', ::"-" : | [R F A 1U/£8/U8 {,)', ::"-" : | ||
{: ,;; ". ,(" (;', I**** : 1, :.:(, . ',(.,; '\,;-""'::1;:': | {: ,;; ". ,(" (;', I**** : 1, :.:(, . ',(.,; '\,;-""'::1;:': | ||
'1 ': .:"; ;1': G2.1.31 y N SIN .... O comment at this time E RF A 10/29/09 :, " '" y N y N : ".1 s;.-: | '1 ': .:"; ;1': G2.1.31 y N SIN .... O comment at this time E RF A 10/29/09 :, " '" y N y N : ".1 s;.-: | ||
| Line 369: | Line 369: | ||
RFA 10/29/09 Rewrote per Chief Examiner's suggestion . ... > J ,.':. .''-: I ", ':', G2.2.35 I th i nk e and 0 will immediately be eliminated but it meets NUREG requirements. | RFA 10/29/09 Rewrote per Chief Examiner's suggestion . ... > J ,.':. .''-: I ", ':', G2.2.35 I th i nk e and 0 will immediately be eliminated but it meets NUREG requirements. | ||
The Q IS OK as is. RF A 1 0/29/09 r ... * () 0 1. 2. J. P sycho m etric F laws 4. Job Content Fl aws 6. 7. 0#/ LOK L OO (CtA) (1.5) Stem C ues TIF Credo Partial Job-Minutia " Back-Q. SRO UIE/S Explanation Focus Dist. link units ward t<JA Only I i) " "",' , n ,. . , , , 1-*' I 68 G2.1.31 C 3 Y N S N o co mm e nt a t thi s ti me E RFA 10/29/09 , " " , , , , " , e, , .. 'I-, , , . 69 G2.2.21 M 2 X Y N E Rem ove double period from " A" a nd *C* D istrac l e r analysis: "D" w h at does "t he exposure wi ll be grea ter i f yo u wear the re sp irato r" have to do w i th thi s Q? " 8" and " 0": r e m ove "to provide .. : as t his is te aching. Plus it i s additional inf ormation thai i s not needed. RFA 1 0/09/09 Revi si ted There is way too much teaching in all of the choices. Reduce as follows: A. 1ND*15B is Interlocked with 1ND-58A (TRAIN A NO TO NV & NI). B. 1ND-158 would ca use o ne NO train to b e come inoperable. | The Q IS OK as is. RF A 1 0/29/09 r ... * () 0 1. 2. J. P sycho m etric F laws 4. Job Content Fl aws 6. 7. 0#/ LOK L OO (CtA) (1.5) Stem C ues TIF Credo Partial Job-Minutia " Back-Q. SRO UIE/S Explanation Focus Dist. link units ward t<JA Only I i) " "",' , n ,. . , , , 1-*' I 68 G2.1.31 C 3 Y N S N o co mm e nt a t thi s ti me E RFA 10/29/09 , " " , , , , " , e, , .. 'I-, , , . 69 G2.2.21 M 2 X Y N E Rem ove double period from " A" a nd *C* D istrac l e r analysis: "D" w h at does "t he exposure wi ll be grea ter i f yo u wear the re sp irato r" have to do w i th thi s Q? " 8" and " 0": r e m ove "to provide .. : as t his is te aching. Plus it i s additional inf ormation thai i s not needed. RFA 1 0/09/09 Revi si ted There is way too much teaching in all of the choices. Reduce as follows: A. 1ND*15B is Interlocked with 1ND-58A (TRAIN A NO TO NV & NI). B. 1ND-158 would ca use o ne NO train to b e come inoperable. | ||
C. iND*i5S Is Interlocked with iNI*136S. O. Both trains of NO will become ino perable. Put all ofth e reasons in the distracter ana l ysis. RFA 10/29/09 Rewrote per Chief E xaminer's suggestion. , " 70 <32.2.35 C 2 Y N S I think C and 0 will i mm ediate l y be e limin ated bu t it m ee t s E NURE G r eq uir emen t s. The a IS OK as i s. RFA 10/29/09 | C. iND*i5S Is Interlocked with iNI*136S. O. Both trains of NO will become ino perable. Put all ofth e reasons in the distracter ana l ysis. RFA 10/29/09 Rewrote per Chief E xaminer's suggestion. , " 70 <32.2.35 C 2 Y N S I think C and 0 will i mm ediate l y be e limin ated bu t it m ee t s E NURE G r eq uir emen t s. The a IS OK as i s. RFA 10/29/09 | ||
: 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. Q#I LOK LOD -(CIA) (1-5) Stem Cues T/F Credo Part i al Job-Minutia #1 Back-Q= SRO U/E/S E x planation Focus Dis!. Link units ward KIA On l y : ,>:;, ,' '.,,', ',: (:;':. "." .. " .,;T:d:,"'* ''''J'''; L* > :: ; ,1'.. 71 G2.3.1 2 C 2 X Y N E o is not plaus i ble for this fa i led fue l event. It is common knowledge to redirect letdown. Replace D. RF A 10/29/09 : '. ;',:;.: ': !',,'" . . :' . " : '; ' .. \:.' , li' , \: ".' :,,' !; " . 'f'-,': : ;': t' .: .. " I.-\'. "i' :: f: ,! ,j,' .. .<,;',; ;.:. <: .. : ':. ..r . . .. ,.f',,' 72 G2.3.14 C 2 X Y N E Dist r acter A is weak. This is too important of an evolution to be evaluated and approved by an NLO. Replace A. Distracter C: State a reason instead of "under these conditions" RF A 10/29/09 I; .. '. ), --'-:"; ':::',,:.:.:: .. | : 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. Q#I LOK LOD -(CIA) (1-5) Stem Cues T/F Credo Part i al Job-Minutia #1 Back-Q= SRO U/E/S E x planation Focus Dis!. Link units ward KIA On l y : ,>:;, ,' '.,,', ',: (:;':. "." .. " .,;T:d:,"'* ''''J'''; L* > :: ; ,1'.. 71 G2.3.1 2 C 2 X Y N E o is not plaus i ble for this fa i led fue l event. It is common knowledge to redirect letdown. Replace D. RF A 10/29/09 : '. ;',:;.: ': !',,'" . . :' . " : '; ' .. \:.' , li' , \: ".' :,,' !; " . 'f'-,': : ;': t' .: .. " I.-\'. "i' :: f: ,! ,j,' .. .<,;',; ;.:. <: .. : ':. ..r . . .. ,.f',,' 72 G2.3.14 C 2 X Y N E Dist r acter A is weak. This is too important of an evolution to be evaluated and approved by an NLO. Replace A. Distracter C: State a reason instead of "under these conditions" RF A 10/29/09 I; .. '. ), --'-:"; ':::',,:.:.:: .. | ||
73 G2.3.7 C 2 X Y N E o is not plausible as written. 0: Change to: " should" to " must" and " could" to ''w i ll'' RF A 10/29/09 ,,':;,*:i"";: ::', .. " ','" ',' . f,: ,: ('. i 1 (P,,/ I 74 G2.4.16 C 2 Y N S No comment at this time E RF A 1 0/29/09 Approved RFA 11/10/09 <.,".;,', . ./'{ . .. : .. :.: .... , . : , ,;.; ',: . " , .. ',: ' *. I( '\" . .. . ... , r. 1. 2. 3. Psychometric Flaws 4. Job Co ntent Flaws 5. Other 6. 7. QNI LOK LOD r--(CIA) (1-5) Stem Cu es TIF Credo Partia l Job-Minutia #1 Back-Qo SRO U/E/S Explanation Focus Di s!. link units ward t<JA Only ", , " , , " 71 C 2 X Y N E ,,2.3.12 o is not plaus i ble for this failed fuel event. knowledge to redirect letdown. It is common Replace D. RFA 10 1 29/09 " '. , , . , 72 G2.3.14 C 2 X Y N E Distracter A is weak. This i s t oo important o f an evolut i on t o be eva l uated and approved by an NL O. Replace A. Distracter C: State a r eason instead o f 'under these condi tions* RFA 10/29/09 , , 73 G2.3.7 C 2 X Y N E o is not plausible as written. 0: C hange to: "s hou ld" to " mus t" and *co uld" to "will" RFA 10/29/09 ". , , 74 G2.4.16 C 2 Y N $ N o comment al thi s time E RFA 10/29/0 9 Approved RFA 11/1 0/09 , , " ," " " | 73 G2.3.7 C 2 X Y N E o is not plausible as written. 0: Change to: " should" to " must" and " could" to ''w i ll'' RF A 10/29/09 ,,':;,*:i"";: ::', .. " ','" ',' . f,: ,: ('. i 1 (P,,/ I 74 G2.4.16 C 2 Y N S No comment at this time E RF A 1 0/29/09 Approved RFA 11/10/09 <.,".;,', . ./'{ . .. : .. :.: .... , . : , ,;.; ',: . " , .. ',: ' *. I( '\" . .. . ... , r. 1. 2. 3. Psychometric Flaws 4. Job Co ntent Flaws 5. Other 6. 7. QNI LOK LOD r--(CIA) (1-5) Stem Cu es TIF Credo Partia l Job-Minutia #1 Back-Qo SRO U/E/S Explanation Focus Di s!. link units ward t<JA Only ", , " , , " 71 C 2 X Y N E ,,2.3.12 o is not plaus i ble for this failed fuel event. knowledge to redirect letdown. It is common Replace D. RFA 10 1 29/09 " '. , , . , 72 G2.3.14 C 2 X Y N E Distracter A is weak. This i s t oo important o f an evolut i on t o be eva l uated and approved by an NL O. Replace A. Distracter C: State a r eason instead o f 'under these condi tions* RFA 10/29/09 , , 73 G2.3.7 C 2 X Y N E o is not plausible as written. 0: C hange to: "s hou ld" to " mus t" and *co uld" to "will" RFA 10/29/09 ". , , 74 G2.4.16 C 2 Y N $ N o comment al thi s time E RFA 10/29/0 9 Approved RFA 11/1 0/09 , , " ," " " | ||
| Line 381: | Line 381: | ||
* I ndependent of whether or not it met the KA , mis-classified WRT RO/SRO , or required grammar or minor enhancement. | * I ndependent of whether or not it met the KA , mis-classified WRT RO/SRO , or required grammar or minor enhancement. | ||
Quell1lon Status Question is Sat with NO Comments E(42) Editorial Changes Needed E' Questionable E ditoria l U(14) Question is A ll Hosed Up 81(0) Questionab l e riO) Question and stem sat -editorial elsewhere 11"(0) Partially met KA ES*403, Rev. 9 Written Examination Grading Quality Checklist Facility: | Quell1lon Status Question is Sat with NO Comments E(42) Editorial Changes Needed E' Questionable E ditoria l U(14) Question is A ll Hosed Up 81(0) Questionab l e riO) Question and stem sat -editorial elsewhere 11"(0) Partially met KA ES*403, Rev. 9 Written Examination Grading Quality Checklist Facility: | ||
McGuire Date of Exam: Nov 19, 2009 Item Description | McGuire Date of Exam: Nov 19, 2009 Item Description | ||
: 1. Clean answer sheets copied before grading 2. Answer key changes and question deletions justified and documented | : 1. Clean answer sheets copied before grading 2. Answer key changes and question deletions justified and documented | ||
: 3. Applicants' scores checked for addition errors (reviewers spot check> 25% of examinations) | : 3. Applicants' scores checked for addition errors (reviewers spot check> 25% of examinations) | ||
: 4. Grading for all borderline cases (80 +/-2% overall and 70 or 80, as applicable, +/-4% on the SRO-only) reviewed in detail 5. All other failing examinations checked to ensure that grades are justified | : 4. Grading for all borderline cases (80 +/-2% overall and 70 or 80, as applicable, +/-4% on the SRO-only) reviewed in detail 5. All other failing examinations checked to ensure that grades are justified | ||
: 6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed Name/Signature | : 6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed Name/Signature | ||
./ a. Grader Ronald F. Aiello / A b. Facility/NRC Reviewer(*) | ./ a. Grader Ronald F. Aiello / A b. Facility/NRC Reviewer(*) | ||
Bruno Caballero/ c. NRC Chief Examiner (*) Ronald F. Aiello/ a rfa NA rfa rfa rfa rfa d. NRC Supervisor | Bruno Caballero/ c. NRC Chief Examiner (*) Ronald F. Aiello/ a rfa NA rfa rfa rfa rfa d. NRC Supervisor | ||
(*) Malcolm T. Widmann/ I | (*) Malcolm T. Widmann/ I | ||
\---} --. Form ES*403*1 Exam Level: RO Initials b c blc rfa NA NA blc rfa blc rfa blc rfa blc rfa Date 11/?1J/or ) /J/?tI;h9 , ) | \---} --. Form ES*403*1 Exam Level: RO Initials b c blc rfa NA NA blc rfa blc rfa blc rfa blc rfa Date 11/?1J/or ) /J/?tI;h9 , ) | ||
(*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required. | (*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required. | ||
ES*403, Rev. 9 Written Examination Grading Quality Checklist Facility: | ES*403, Rev. 9 Written Examination Grading Quality Checklist Facility: | ||
McGuire Date of Exam: Nov 19, 2009 Item Description | McGuire Date of Exam: Nov 19, 2009 Item Description | ||
: 1. Clean answer sheets copied before grading 2. Answer key changes and question deletions justified and documented | : 1. Clean answer sheets copied before grading 2. Answer key changes and question deletions justified and documented | ||
: 3. Applicants' scores checked for addition errors (reviewers spot check> 25% of examinations) | : 3. Applicants' scores checked for addition errors (reviewers spot check> 25% of examinations) | ||
: 4. Grading for all borderline cases (80 +/-2% overall and 70 or 80, as applicable, +/-4% on the SRO-only) reviewed in detail 5. All other failing examinations checked to ensure that grades are justified | : 4. Grading for all borderline cases (80 +/-2% overall and 70 or 80, as applicable, +/-4% on the SRO-only) reviewed in detail 5. All other failing examinations checked to ensure that grades are justified | ||
: 6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed Name/Signature | : 6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed Name/Signature | ||
./ | ./ | ||
: a. Grader Ronald F. Aiello / A b. Facility/NRC Reviewer(*) Bruno Caballero/ | : a. Grader Ronald F. Aiello / A b. Facility/NRC Reviewer(*) Bruno Caballero/ | ||
: c. NRC Chief Examiner (*) Ronald F. Aiello/ a rfa NA rfa rfa rfa rfa d. NRC Supervisor | : c. NRC Chief Examiner (*) Ronald F. Aiello/ a rfa NA rfa rfa rfa rfa d. NRC Supervisor | ||
(*) | (*) | ||
Malcolm T. Widmann/ I | Malcolm T. Widmann/ I | ||
\---7 --Form ES*403*1 Exam Level: RO Initials b c blc rfa NA NA blc rfa blc rfa blc rfa blc rfa Date 11/?1J/or ) /J/?tI;h9 , ) | \---7 --Form ES*403*1 Exam Level: RO Initials b c blc rfa NA NA blc rfa blc rfa blc rfa blc rfa Date 11/?1J/or ) /J/?tI;h9 , ) | ||
(*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required. | (*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required. | ||
-. * * * -KEYID © r-------,---------y--------------------------j SCORING & CJ RESCORE C MULTIPLE "4NSWE,'R SCORING | -. * * * -KEYID © r-------,---------y--------------------------j SCORING & CJ RESCORE C MULTIPLE "4NSWE,'R SCORING | ||
| Line 409: | Line 409: | ||
.. __ | .. __ | ||
--- | --- | ||
\f/1RK(J/dJ | \f/1RK(J/dJ | ||
();"}; --fr -.., -;:, -:j -'S -0 ..... -;:., -::'] _:::l ------- | ();"}; --fr -.., -;:, -:j -'S -0 ..... -;:., -::'] _:::l ------- | ||
-----T F l.©@ 3@©e -I@.@ 5.©(l!,)@ | -----T F l.©@ 3@©e -I@.@ 5.©(l!,)@ | ||
| Line 423: | Line 423: | ||
-2S | -2S | ||
-50.©© --fr -.., -'"' -0 _s; ... -" \:: -II _v'; ---NUMBER CORRECT PERCENT CORRECT ROSTRR NUMBER SCORE RESCORE T F 51 (];).@ | -50.©© --fr -.., -'"' -0 _s; ... -" \:: -II _v'; ---NUMBER CORRECT PERCENT CORRECT ROSTRR NUMBER SCORE RESCORE T F 51 (];).@ | ||
S-l_@©@@ 55.©@ 56.@©@ 57. 5S. S9.@© 60.© 61.©@ 62. 63.@ M.@ 65.© 66©. 67©e 69.© 70.@ 72.@ n.©@ 74@. COMBINED POINTS EARAED (;RADE SCORE RESCORE 1 F 76@@ 77@© 78@© 79©@ so© 81© 1i2© 83@© 8-1© S5@©@ 86© f!7© 88© 8'1@ 91J© 91@ 92@ 93@@ 94© 95© 96@ 97©© 91i©© 99© ]{)() (ID©© V::) MARKING INSTRUCTIONS Pearson NCS Test Sheet 100 Form No. 106173 Reorder Form No. J(}6J73 1-8()()-367-6627 Fax 1-S07-4SJ-,f513 va Iii ebridge.llcspearso/!.com | S-l_@©@@ 55.©@ 56.@©@ 57. 5S. S9.@© 60.© 61.©@ 62. 63.@ M.@ 65.© 66©. 67©e 69.© 70.@ 72.@ n.©@ 74@. COMBINED POINTS EARAED (;RADE SCORE RESCORE 1 F 76@@ 77@© 78@© 79©@ so© 81© 1i2© 83@© 8-1© S5@©@ 86© f!7© 88© 8'1@ 91J© 91@ 92@ 93@@ 94© 95© 96@ 97©© 91i©© 99© ]{)() (ID©© V::) MARKING INSTRUCTIONS Pearson NCS Test Sheet 100 Form No. 106173 Reorder Form No. J(}6J73 1-8()()-367-6627 Fax 1-S07-4SJ-,f513 va Iii ebridge.llcspearso/!.com | ||
("ANSWER ') L@:YINFO. | ("ANSWER ') L@:YINFO. | ||
I (PERFORMANCE) | I (PERFORMANCE) | ||
| Line 452: | Line 452: | ||
S-I_@©@@ 5S.@ 56.@@@ S7. 5S. S9.@@ 60.© 61.©@ 62.@ 63.@ M. 65@.@ 66@@@. 67©e 69.© 70.@ 72@.@ n.©@ 74@. COMBINED POINTS EARAED COMBINED I 1 F 76@ 77@@@ 78@@ 79© So@© 81@© 1!2© 83@©@ 8..f@ | S-I_@©@@ 5S.@ 56.@@@ S7. 5S. S9.@@ 60.© 61.©@ 62.@ 63.@ M. 65@.@ 66@@@. 67©e 69.© 70.@ 72@.@ n.©@ 74@. COMBINED POINTS EARAED COMBINED I 1 F 76@ 77@@@ 78@@ 79© So@© 81@© 1!2© 83@©@ 8..f@ | ||
S5@@ 86© f!7@@ 88@@ 8'1© 91J@© 91 @@ 92@© 93@ | S5@@ 86© f!7@@ 88@@ 8'1© 91J@© 91 @@ 92@© 93@ | ||
94@ 95© 96@@ 97@© 91!©@ 99© ]{)() (ID@ MARKING INSTRUCTIONS Pearson NCS Test Sheet 100 Form No. 106173 Reorder Form No. J(}6J73 1-8()()-367-6627 Fax 1-S07-4SJ-,f513 va Iii ebridge.llcspearso/!.com | 94@ 95© 96@@ 97@© 91!©@ 99© ]{)() (ID@ MARKING INSTRUCTIONS Pearson NCS Test Sheet 100 Form No. 106173 Reorder Form No. J(}6J73 1-8()()-367-6627 Fax 1-S07-4SJ-,f513 va Iii ebridge.llcspearso/!.com | ||
("ANSWER ') L@:YINFO. | ("ANSWER ') L@:YINFO. | ||
I 1 , !TEJl t ' COlt w icD CD CD GJI I CDwG) I GJG) I I G)G) I I I. CDCDiJl II (PERFORMANCE) | I 1 , !TEJl t ' COlt w icD CD CD GJI I CDwG) I GJG) I I G)G) I I I. CDCDiJl II (PERFORMANCE) | ||
Revision as of 14:08, 11 July 2019
| ML093640778 | |
| Person / Time | |
|---|---|
| Site: | McGuire, Mcguire  |
| Issue date: | 12/08/2009 |
| From: | Division of Nuclear Materials Safety II |
| To: | Duke Energy Carolinas |
| References | |
| 50-369/09-302, 50-370/09-302 | |
| Download: ML093640778 (29) | |
Text
FACILITY NAME: McGuire Section 7 REPORT NUMBER: 05000369,370/2009302 FINAL ADMINISTRATIVE DOCUMENTS CONTENTS: (X) Exam Preparation Checklist (ES-201-1) (X) Final Exam Outline Quality Checklist (ES-201-2) (X) Exam Security Agreements (ES-201-3) (NA) Final Administrative Topics Outline (ES-301-1) (NA) Final Control Room & Walk-Through Test Outline(ES-301-2) (NA) Final Operating Test Quality Check Sheet (ES-301-3) (NA) Final Simulator Scenario Quality Check Sheet (ES-301-4) (NA) Final Transient and Event Check Sheet (ES-301-5) (NA) Final Competencies Check Sheet (ES-301-6) (X) Final Written Exam Sample Plan (ES-401-1/2)'f (X) Final Record of Rejected KAs (ES-401-4) (X) Final Written Exam Quality Check Sheet (ES-401-6) (X) Final Written Exam Review Work Sheet (ES-401-9) (X) Written Exam Grading Quality Check Sheet (ES-403-1) (with RO computer answer keys) Location of Electronic Files: Primary Folder: All applicable documents are attached Submitted By: ___
___ . __
FACILITY NAME: McGuire Section 7 REPORT NUMBER: 05000369,370/2009302 FINAL ADMINISTRATIVE DOCUMENTS CONTENTS: (X) Exam Preparation Checklist (ES-201-1) (X) Final Exam Outline Quality Checklist (ES-201-2) (X) Exam Security Agreements (ES-201-3) (NA) Final Administrative Topics Outline (ES-301-1) (NA) Final Control Room & Walk-Through Test Outline(ES-301-2) (NA) Final Operating Test Quality Check Sheet (ES-301-3) (NA) Final Simulator Scenario Quality Check Sheet (ES-301-4) (NA) Final Transient and Event Check Sheet (ES-301-5) (NA) Final Competencies Check Sheet (ES-301-6) (X) Final Written Exam Sample Plan (ES-401-1/2)'f (X) Final Record of Rejected KAs (ES-401-4) (X) Final Written Exam Quality Check Sheet (ES-401-6) (X) Final Written Exam Review Work Sheet (ES-401-9) (X) Written Exam Grading Quality Check Sheet (ES-403-1) (with RO computer answer keys) Location of Electronic Files: Primary Folder: All applicable documents are attached Submitted By: ___
___ . __
ES-201, Rev. 9E Examination Preparation Checklist Fonn ES-201-1 OPNA Facility:
McGuire Date of Examination:
WR 11119109 Facility NRC Examinations Developed by: Written Written Exam Outline only Target Chief Date
- Task Description (Reference)
Examiner's Initials -180 1. Examination administration date confirmed (C.1.a; C.2.a and b) rfa -120 2. NRC examiners and facility contact assigned (C.l.d; C.2.e) rfa -120 3. Facility contact briefed on security and other requirements (C.2.c) rfa -120 4. Corporate notification letter sent (C.2.d) rfa [-90] (S. Reference material due (C.1.e; C.3.c; Attachment 2)] rfa {-7S} 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-S, ES-D-l's, ES-401-1I2, ES-401-3, and ES-401-4, as rfa applicable (C. I.e and f; C.3.d) {-70} {7. Examination outline(s) reviewed by NRC and feedback provided to facility rfa licensee (C.2.h; C.3.e)} {-4S} 8. Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, rfa ES-301-S, ES-301-6, and ES-401-6), and reference materials due (C.1.e, f, g and h; C.3.d) -30 9. Preliminary license applications (NRC Form 398's) due (C. I.!; C.2.g; ES-202) rfa -14 10. Final license applications due and Form ES-20 1-4 prepared (C. I.!; C.2.i; ES-202) rfa -14 11. Examination approved by NRC supervisor for facility licensee review rfa (C.2.h; C.3.f) -14 12. Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g) rfa -7 13. Written examinations tu18 8f}@Fsting t88t8 approved by NRC supervisor rfa (C.2.i; C.3.h) -7 14. Final applications reviewed; 1 or 2 (if> 1 0) applications audited to confirm qualifications
/ eligibility; and examination approval and waiver letters sent rfa (C.2.i; Attachment 4; ES-202, C.2.e; ES-204) -7 IS. Proctoring/written exam administration guidelines reviewed with facility licensee rfa (C.3.k) -7 16. Approved scenarios, job performance measures, and questions distributed to NA NRC examiners (C.3.i)
- Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.
[AJ>Plies only] {Does not apply} to examinations 2repared by the NRC. ES-201, Rev. 9E Examination Preparation Checklist Fonn ES-201-1 OPNA Facility:
McGuire Date of Examination:
WR 11119109 Facility NRC Examinations Developed by: Written Written Exam Outline only Target Chief Date
- Task Description (Reference)
Examiner's Initials -180 1. Examination administration date confirmed (C.1.a; C.2.a and b) rfa -120 2. NRC examiners and facility contact assigned (C.l.d; C.2.e) rfa -120 3. Facility contact briefed on security and other requirements (C.2.c) rfa -120 4. Corporate notification letter sent (C.2.d) rfa [-90] 1 S. Reference material due (C.1.e; C.3.c; Attachment 2)] rfa {-7S} 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-S, ES-D-l's, ES-40l-1I2, ES-40l-3, and ES-401-4, as rfa applicable (C. I.e and f; C.3.d) {-70} {7. Examination outline(s) reviewed by NRC and feedback provided to facility rfa licensee (C.2.h; C.3.e)} {-4S} 8. Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, rfa ES-30l-S, ES-301-6, and ES-401-6), and reference materials due (C.1.e, f, g and h; C.3.d) -30 9. Preliminary license applications (NRC Form 398's) due (C. I.!; C.2.g; ES-202) rfa -14 10. Final license applications due and Form ES-20 1-4 prepared (C. I.!; C.2.i; ES-202) rfa -14 11. Examination approved by NRC supervisor for facility licensee review rfa (C.2.h; C.3.f) -14 12. Examinations reviewed with facility licensee (C.l.j; C.2.f and h; C.3.g) rfa -7 13. Written examinations 8ft8 8fJ@fstmg t88t8 approved by NRC supervisor rfa (C.2.i; C.3.h) -7 14. Final applications reviewed; 1 or 2 (if> 1 0) applications audited to confirm qualifications
/ eligibility; and examination approval and waiver letters sent rfa (C.2.i; Attachment 4; ES-202, C.2.e; ES-204) -7 IS. Proctoring/written exam administration guidelines reviewed with facility licensee rfa (C.3.k) -7 16. Approved scenarios, job performance measures, and questions distributed to NA NRC examiners (C.3.i)
- Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by-case basis in coordination with the facility licensee.
[Applies only] {Does not apply} to examinations prepared by the NRC.
- JC/NIJL ES-201 Examination Outline Quality Checklist Facility:
McGuire Nuclear Station Date of Examination:
11119/2009 Item 1. W R I T T E N 2. S I M U L A T 0 R 3. W 1 T 4. G E N E R A L Task Description
- a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401. b. Assess whether the outline was systematically and randomly prepared in accordance with Section D.1 of ES-401 and whether all KiA categories are appropriately sampled. c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics. d Assess whether the justifications for deselected or rejected KiA statements are appropriate.
- a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, and major transients.
- b. Assess whether there are enough scenario sets (and spares) to test the projected number and mix of applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity, and ensure that each applicant can be tested using at least one new or significantly modified scenario, that no scenarios are duplicated from the applicants' audit test(s), and that scenarios will not be repeated on subsequent days. c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative and quantitative criteria specified on Form ES-301-4 and described in Appendix D. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:
(1 ) the outline(s) contain(s) the required number of control room and in-plant tasks distributed among the safety functions as specified on the form (2) task repetition from the last two NRC examinations is within the limits specified on the form (3) no tasks are duplicated from the applicants' audit testis) (4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form. b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:
(1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations
- c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections.
- b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.
- c. Ensure that KiA importance ratings (except for plant-specific priorities) are at least 2.5. d. Check for duplication and overlap among exam sections.
- e. Check the entire exam for balance of coverage.
- b. Facility Reviewer (*)
-.L Mcdelkf c. NRCChiefExaminer(#) Form ES-201-2 a JfII< 't/{<< Initials b* c# 9JII iJ!1 " .V1 0"\ \. <P-N{t\ I'-wi/" NitJ tJ/r Date 1/-13-09 d NRC Supervisor A1AI//v 1L i.lJJlfWAJI.,A( /{l\ IhJ-dJ ///$'or It/truj * /
- Not applicable for NRC-prepared examination outlines JC/NIJL ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility:
McGuire Nuclear Station Date of Examination:
11119/2009 Initials Item Task Description a b* c# 1. a. Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401. W 9JII R b. Assess whether the outline was systematically and randomly prepared in accordance with " I Section D.1 of ES-401 and whether all KiA categories are appropriately sampled. iJ!1 T T c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics. .V1 E N d Assess whether the justifications for deselected or rejected KiA statements are appropriate. 0"\ \. 2. a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number JfII< of normal evolutions, instrument and component failures, technical specifications, S and major transients.
<P-I M b. Assess whether there are enough scenario sets (and spares) to test the projected number U and mix of applicants in accordance with the expected crew composition and rotation schedule 't/{<< L without compromising exam integrity, and ensure that each applicant can be tested using N{t\ A at least one new or significantly modified scenario, that no scenarios are duplicated I'-T from the applicants' audit test(s), and that scenarios will not be repeated on subsequent days. 0 To the extent possible, assess whether the outline(s) conform(s) with the qualitative tf,f< R c. wi/" and quantitative criteria specified on Form ES-301-4 and described in Appendix D. 3. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:
NitJ (1 ) the outline(s) contain(s) the required number of control room and in-plant tasks
- W distributed among the safety functions as specified on the form 1 (2) task repetition from the last two NRC examinations is within the limits specified on the form IJR' T (3) no tasks are duplicated from the applicants' audit testis) tJ/r (4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form. b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:
1ft (1 ) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations
- c. Determine if there are enough different outlines to test the projected number and mix 1ft of applicants and ensure that no items are duplicated on subsequent days. 4. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered 161.. in the appropriate exam sections.
5Ur\ G 1f4( E b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate. )J.JI\ N Ensure that KiA importance ratings (except for plant-specific priorities) are at least 2.5. E c. .Sl.M R d. Check for duplication and overlap among exam sections.
1tlJI, A t!K.
L e. Check the entire exam for balance of coverage.
<liA f. Assess whether the exam fits the appropriate job level (RO or SRO). '\ Fred 8KJI'kJr Date a. Author 1/-13-09 b. Facility Reviewer (*)
- c. NRC Chief Examiner (#) ///$'Or
- d NRC Supervisor A1AI//v lL i.lJJlfJ//AJI.,A( /{l\ I t/L1/D.j.
/ (/ ,"-, flU( Note: # Independent NRC reviewer initial items in Column "c n; chief examiner concurrence required. . Not applicable for NRC-prepared examination outlines ES-201 Examination Security Agreement Form ES*201-3 1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of \ \/'1 ('/r:8 as of the date of my signature.
I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner.
I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback).
Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may resuH in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
2, Post-Examination To the best of my not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of \ . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC. PRINTED NAME JOB TITLE I RESPONSIBILITY SIGNATURE (1 DATE SIGNATURE (2) DATE NOTE ES-201, Page 27 of 28 ES-201 Examination Security Agre e ment 1. Pre-Exam ina tion I ackno'oAo1edge that 1 have acq u ired spec i alized knoYJIedge abou t the NRC l ice n si n g examinations scheduled for the weekes) of ) 01.,!cfl as of the date of my signature. I agree that I wi ll not knowingly divulge a n y information about these examinations to any persons who have not been autho ri zed by the NRC chief examiner.
I understand that I am not to i nstruct, eva l uate , or provide perfonnance fee dback t o those app li cants scheduled to be admi n istered these licensing examinations from this date until completion of examination admi n is t ration , except as specifica ll y no t ed below and authorized by the NR C (e.g., acting as a simu l ator booth operator or communicator i s acceptab l e if the i ndividual does not select the tra i nIng con te nt or provide direct or i ndirect feedback). Furthermore, I am aware of the physica l securtty measures and re quirements (as do cumented i n the facility licensee's procedure s) and understand that vio l ation of the condit i ons o f this agreement may resu" in cance ll ation of the examinations and/or an enforcement actio n agains t me or t he facility l icensee. I wil l i mmediately r eport to facility management or the NRC chief examiner a ny i nd icatio ns o r suggestio n s thai examination securtty may have been comprom i se d. 2. P ost-Examin a tion To the best of my not d ivu lge to any unauthorized persons any information concerni ng the NRC l icensing examinations admin i stered during the week(s) of \ . From the date that I e n tered into this security agreement until the completion of examination administration , I did not instruct, evaluate , or pro v ide performance feedback to those a p p l icants who were administered these li censin g examinations, except as specifica lly noted be l ow and au th orized by the NRC. PRINTED NAME JOB TITLE I R E SPONS I B ILITY DATE S I GNATURE (2) DATE NOTE ES-201 , Page 27 o f 28 ES-201 Examination Security Agreement Form ES-201-3 1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of fjA ('/or as of the date of my signature.
I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner.
I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licenSing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback).
Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee.
I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
- 2. Post-Examination , did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of ii7lr:b1!f.
From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC. PRINTED NAME JOB TITLE I RESPONSIBILITY " A SIGNATURE (1) lLc IOh
!
f/[sf!irre 5. ____________________________
_ DATE SIGNATURE (2) DATE NOTE fIE ----6. ____________________________
_ 7. ____________________________
_ 8. ____________________________
_ 9. ____________________________
_ 10. _____________________________
_ ----------
11. _____________________________
_ ---------------12. _____________________________
_ -----------------
13. _____________________________
_ ----------
14. _____________________________
_ -----------
15. ____________________________
_ ------NOTES: .. ES-201, Page 27 of 28 ES-201 Examination Security Agreement Form ES-201-3 1. Pre-Examination I acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of fjA ('/or as of the date of my signature.
I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner.
I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licenSing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback).
Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensee's procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee.
I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
- 2. Post-Examination To the best of my not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of . From the date that I entered into this security agreement until the completion of examination administration, I did not instruct, evaluate, or previ e performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC. JOB TITLE I RESPONSIBILITY " A SIGNATURE (1) lLc IOh
!
f/[sf!irre 5. _______________________________________________________________
___ PRINTED NAME DATE SIGNATURE (2) DATE NOTE fIE ---6. ______________________________________________________________
___ 7. _____________________________________
_ 8. ___________________________________________________
_ 9. __________________________________________________
__ 10. ______________________________________________________________
___ ----------------
11. _________________________________________________________
___ ----------------
12. _____________________________________
_ -----------
13. ___________________________________________________________
___ ---------------
14. ________________________________________
_ ----------------
15. ___ --------_________________________
_ NOTES: -----------------
ES-201, Page 27 of 28 FINAL ES-401. Rev. 9 Record of Rejected KJAs Form ES-401-4 Tier / Randomly Reason for Rejection Group Selected KA 1/1 APE022 AK1.04 (Q42) 9/15/09: It is not possible to write a discriminating question for this KIA. This KIA is being replaced by APE 027 AK3.04 which was randomly selected by Lead Examiner.
1/1 APE027 AK3.02 Q(44) 9/15/09: Replacement KIA requested because it was impossible to construct a discriminating question with the origional KIA. APE 027 AK3.04 was randomly selected and provided by the lead examiner.
1/1 APE062 AA1.03 Q(53) 9/15/09: It is not possible to write a question that matches this KA. Replacing with APE 062 AA1.05 which was randomly selected by Lead Examiner.
1/1 WE05 EK2.1 Q(55) Unable to write question tor RO level. Chief Examiner randomly selected new K/A WE05 EK2.2 1/1 WEll 2.4.8 Q(56) Unable to write RO level question.
New KIA (WEll 2.1.27) selected by Lead Examiner.
FINAL ES-401. Rev. 9 Record of Rejected KJAs Form ES-401-4 Tier / Randomly Reason for Rejection Group Selected KA 1/1 APE022 AK1.04 (Q42) 9/15/09: It is not possible to write a discriminating question for this KIA. This KIA is being replaced by APE 027 AK3.04 which was randomly selected by Lead Examiner.
1/1 APE027 AK3.02 Q(44) 9/15/09: Replacement KIA requested because it was impossible to construct a discriminating question with the origional KIA. APE 027 AK3.04 was randomly selected and provided by the lead examiner.
1/1 APE062 AA1.03 Q(53) 9/15/09: It is not possible to write a question that matches this KA. Replacing with APE 062 AA1.05 which was randomly selected by Lead Examiner.
1/1 WE05 EK2.1 Q(55) Unable to write question tor RO level. Chief Examiner randomly selected new K/A WE05 EK2.2 1/1 WEll 2.4.8 Q(56) Unable to write RO level question.
New KIA (WEll 2.1.27) selected by Lead Examiner.
f!'IN4L ES-401 Written Examination Quality Checklist Form ES-401-6 Facility:
McGuire Nuclear Station Date of Exam: 11/19/2009 Exam Level: RO SRO 4. I 5. 6. 7. Item Description Questions and answers are technically accurate and applicable to the facility.
- a. NRC KlAs are referenced for all questions.
- b. Facility learning objectives are referenced as available.
SRO questions are appropriate in accordance with Section D.2.d of ES-401 ----. ---------------.------,,---. -------
. --------------. ----.------
The sampling process was random and systematic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR OL program office). Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:
_ the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or iZ'the examinations were developed independently; or _ the licensee certifies that there is no duplication; or _ other (explain) --r -----Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified);
enter the actual RO / SRO-only question distribution(s) at right. ___
I 36 / -I 3 / -1_ L Memory CIA Between 50 and 60 percent of the questions on the RO exam are written at the comprehension/
analysis level; the SRO exam may exceed 60 percent if the randomly selected KlAs support the higher cognitive levels; enter the actual RO / SRO question distribution(s) at right. 1-31 / 44 / References/handouts provided do not give away answers or aid in the elimination of distractors.
Initial a b*! c* j , I , I,
,------1 ------1 1tf/4 ,Jlffi "-I--,j--1 ---, . I ',1 11fA< 19J'\! \) : ----t---I-I i ' , I 1'\ i I d/);/ , Ij..I\. I :71.:7\ I : I j I i Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; i /, lfI deviations are
- '
- J-F' I 10. -
psychometric
_1 iii ! i 11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet. i a. Author i b. Facility Reviewer (*) ! c. NRC Chief Examiner (#) I d. NRC Regional Supervisor Note:
- The facility reviewer'S initials/signature are not applicable for NRC-developed examinations.
- Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required. _ _ _ _ J _ ____ _ Date f!'IN4L ES-401 Written Examination Quality Checklist Form ES-401-6 Facility:
McGuire Nuclear Station Date of Exam: 11/19/2009 Exam Level: RO SRO 1. 2. 3. 4. I 5. 6. 7. 8. 9. Item Description Questions and answers are technically accurate and applicable to the facility.
- a. NRC KlAs are referenced for all questions.
- b. Facility learning objectives are referenced as available.
SRO questions are appropriate in accordance with Section D.2.d of ES-401 ----. ---------------.------,,---. -------
. --------------. ----.------
The sampling process was random and systematic (If more than 4 RO or 2 SRO questions were repeated from the last 2 NRC licensing exams, consult the NRR OL program office). Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:
_ the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or iZ'the examinations were developed independently; or _ the licensee certifies that there is no duplication; or _ other (explain) --r -----Bank use meets limits (no more than 75 percent from the bank, at least 10 percent new, and the rest new or modified);
enter the actual RO / SRO-only question distribution(s) at right. ___
I 36 / -I 3 / -1_ L Memory CIA Between 50 and 60 percent of the questions on the RO exam are written at the comprehension/
analysis level; the SRO exam may exceed 60 percent if the randomly selected KlAs support the higher cognitive levels; enter the actual RO / SRO question distribution(s) at right. 1-31 / 44 / References/handouts provided do not give away answers or aid in the elimination of distractors.
Initial a b*! c* j , I , I,
,------1 ------1 1tf/4 ,Jlffi "-I--,j--1 ---, . I ',1 11fA< 19J'\! \) : ----t---I-I i ' , I 1'\ i I d/);/ , Ij..I\. I :71.:7\ I : I j I i Question content conforms with specific KIA statements in the previously approved examination outline and is appropriate for the tier to which they are assigned; i /, lfI deviations are
- '
- J-F' I -
psychometric
_1 iii ! 10. i 11. The exam contains the required number of one-point, multiple choice items; the total is correct and agrees with the value on the cover sheet. i a. Author i b. Facility Reviewer (*) ! c. NRC Chief Examiner (#) I d. NRC Regional Supervisor Note:
- The facility reviewer'S initials/signature are not applicable for NRC-developed examinations.
- Independent NRC reviewer initial items in Column "c"; chief examiner concurrence required. _ _ _ _ J _
____ _ Date ES-401 Q#I 1. I 2. lOK lODr---,---.--.---.-(CIA) (1-5) Partial link Written Examination Review Worksheet McGuire 2009-302 4. Job Content Flaws Minutia I #1 Back-units I ward 5. Other Q= I SRO KIA Only 6. U/E/S 7. Explanation Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1. 2. 3. 4. 5. 6. 7. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level. Enter the level of difficulty (LOD) of each question using a 1 -5 (easy -difficult) rating scale (questions in the 2 -4 range are acceptable).
Check the appropriate box if a psychometric flaw is identified:
- The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
- The stem or dlstracters contain cues (i.e., clues. specific determiners, phrasing, length, etc).
- The answer choices are a collection of unrelated true/false statements.
One or more distracters is not credible.
One or more distracters is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem). Check the appropriate box if a job content error is identified:
- The question Is not linked to the job requirements (i.e., the question has a valid KIA but, as written, is not operational in content).
- The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e .* it is not required to be known from memory).
- The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable).
Based on the reviewer's judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met). RO/SRO Combined Question Generic: CAF = Check at Facility DV = Discriminatory Value NP = Non plausible On the fill in the blank Os: State "Which one of the following completes the statement below" One of many examples is 0 8. Many questions marked green require this statement.
M 2 x 2 M 2 x y N y N 1 003A1.02 E Stem: Underline and/or cap the word "minimum" RFA 10/27/09 003A301 E iSwap B with C so values are increasing Form ES-401-9 ES-401 Q#I 1. 2. 3. Psychometric Flaws LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partial Focus Dist. Link Written Examination Review Worksheet McGuire 2009-302 4. Job Content Flaws Minutia #1 Back-units ward 5. Other ;---Q= SRO KJA Only 6. U/E/S 7. Explanation nstructions Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1. 2. 3. 4. 5. 16. 7. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level. Enter the level of difficulty (LOD) of each question using a 1 -5 (easy -difficult) rating scale (questions in the 2 -4 range are acceptable).
Check the appropriate box if a psychometric flaw is identified:
- The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
- The stem or dlstracters contain cues (i.e., clues, specific determiners, phrasing, length, etc).
- The answer choices are a collection of unrelated true/false statements.
One or more distracters is not credible.
One or more distracters is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem). Check the appropriate box if a job content error is identified:
- The question Is not linked to the job requirements (i.e., the question has a valid KIA but, as written, is not operational in content).
- The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
- The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
Check questions that are sampled for conformance with the approved KIA and those that are designated SRO-only (KIA and license level mismatches are unacceptable).
Based on the reviewer's judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
At a minimum, explain any "U" ratings (e.g., how the Appendix B psychometric attributes are not being met). RO/SRO Combined Question Generic: CAF = Check at Facility DV = Discriminatory Value NP = Non plausible On the fill in the blank Os: State "Which one of the following completes the statement below" One of many examples is 0 8. Many questions marked green require this statement.
M 2 x y 2 M 2 x y N N E Stem: Underline and/or cap the word "minimum" RFA 10/27/09 Ii'. 'I' 003A301 E Swap B with C so values are increasing Form ES-401-9 n 1. I 2. Q#/ILOK (CIA) (1-5) Partial 3 M 2 4 c 3 x 5 C 3 x 6 M 1 x 7 C 3 x Link 4. Job Content Flaws Minutia I #1 I Back-units ward 5. Other Q= I SRO KIA Only 6. utE/S y N I N N u 7. Explanation D: Why would flow go up given this failure and these conditions?
RFA 10108/09 Accepted 10/27/09 ':;, i:, f"', ;:, :"t',", ;, ... :', 004K5.49 No comment at this time RFA 10/27/09 ..... .., .-.j.
'. 't' " UUbG2.4.50 The second part of distracters A and 8 do not state any manual or automatic actions. That action is not much different then the correct answer a stated in C. Potentially A and C are both correct answers. Modify the second parts of A and 8. This Q is U because of two potentially correct answers. RFA 10/27/09 .. '\ ,'::\.!;.
- -: 006K2.01 N N E I Please justify why 2EMXA and 2ELXA are plausible.
Neither the distracter analysis nor the reference material supports their plausibility.
N N N N E This E is U until justified due to two NP distracters.
RFA 10/27/09 Added feeder to stem of question.
1 006K2.04 This Q has low DV. Increase DV by adding a second valve to each choice: A. XZ incorrect
- 8. XY correct C. zy incorrect D .. WZ incorrect This Q is U because of low DV RFA 10/27/09 ,-;. ** ' .. ::. 1-1 ' .-:, .:. I 007AT01 The containment floor and equipment sum plausibility is I19t justified.
The distracter analvsis says floor is used :) -1. 2. 3. Flaws 0#1 LOK (CI A) I (1':.'5)
I.;ues IIr Partial 3 M 2 4 c 3 x 5 c 3 x 6 M , x 7 c 3 x Link 4. Job Content Flaws #1 Back-units ward 5. Other a' KIA i vuly y N N N N N N N N N 6. UIEIS u E E 7. Explanation
," ow 90 up 9"e o! , RFA 10/08/09 IA",ep led 10127 10 9 '" '" " comment at this lime 10/27/0 9 ;. ,1 IInese The , part , A and B do notsla l e any That action is not much :;;:,
r in C. Potentially
,"" f A ;nd e.' W"'" Modify the second I!;;S U because of two potentially correct answers. I RFA 10/27/09 , "'" '(' ; justify . .,r a N\ and 2ELXA are plausible. i I I i nor the reference material s their i, E is U until justified due to two NP dist r aclers. I 0/2 7/09 I A,dd"d feeder t o stem of question.
s a'has low DV , Inc r ease DV by adding a second I e 10 each choice, Xl incorrec t 8. XY co rr ect z:f incorrect , WZ incorrect a is U because of low DV RFA 10/27 109 I sump I 1 Is n n 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. Q#I LOK LOD r---(CIA) (1-5) Stem Cues T/F Credo Partial Job-M i nutia #1 Back-Q= SRO U/EIS Explanation Focus Dist. Link units ward KIA Only some:.t!mesbut doesn't say when. Consider A2 and C2 to the radwaste facility or something or justi plausibil i ty . This Q is E until A2 and C2 are either justified or replaced.
RFA 10/27/09 .' ; I :,;, .. Sc.-;\' '.;'/ -' f:; ,,>_ ',' , :: . :..;. '. : . '" 'j; .' 'i , I 8 008A2.03 C 3 X N N E Change motor bearing temperatures to 190. This will give C1 and D1 more plausibility.
RFA 10/27/09 I'; I;,' ': I 9 010K6.04 C 3 X N N E It's common that the Pzr relief valves discharge l to the PRT. If the PR ruptures, it will result in a lower pressure.
This also is common know l edge. Therefore, ! distracter C i s NP. Change C to increase, increase.
RFA 10/27/09 I I; c': , : '/ I 10 012K6.03 C 3 X N N E The 3'd bullet is not required because they were never I declared i noperable.
RFA 10/27/09 I " .': I 11 013A4.03 C 3 X N N E I don't think need the word ONL Y in A because an I auto SI will OT reoccur until the timer has t i med out as i n B. You can also rewrite A as follows: After the SI reset I push buttons are depressed and the RTBs have been cycled , an auto SI reinitiation can immediatel*
occur. I (Note, th i s is wrong because the timer has no timed out yet) I Distracter A is NP as written. RFA 10/27/09 I ',', r 1 ,, 1 , , -, I 12 013K1.01 M 2 Y N S No comment at this time I E RFA 10/27/09 , " Changed que s tion to use Containment Spray logic instead of SI logic b a sed on validation feedback results , This changed the correct a n s wer to'S'. This also changed the question from an'S' to an 'E'. 1. 2. 3. Psy c hometric Flaws 4. Job Conlent Flaws 0#/ LOK LOD (C I A) (1-5) Stem Cues T I F Credo Partial Job-Minutia #1 Back-F o cus Dis!. link units ward B c 3 x 9 c 3 x 1 0 c 3 x 11 c 3 x ()
c an9,n9 IV. a n d C2 to the radwaste facility o r something or justify p l ausibi li ty. Thi s a i s E until A2 and C2 are either justified or replaced. RFA 10 f 27{09 " ' >' 00BA2.03 Change motor b eari n g tempe r atures t o 190. C 1 and D 1 more pl a u s i bility. RFA 10127/09 . '" , , 010K6.0 4 This will give I t's common knowledge th at the Pzr r elief valves discharge t o th e PRT. If th e PRT ruptures\
it will r esult i n a l ower p r essure. This a l so is common Knowledge.
Therefore, dislracte r C is N P. C han ge C to increase , in crease. RFA 10/27/09 " 012K6.03 The 3 1'0 bullel is not required because they were never declared inoperable.
RFA 1 0 f 27 f 09 , '" -' 013M03 I don't th i nk you need the word ONLY in A because an au to 5 1 wi ll N OT reoccur unti l th e tim e r has ti m ed ou t as in B. You can a l so rewrite A as fo ll ows: Afte r the 51 reset pus h buttons are depressed and the RTBs have been cycled, an au t o 51 reinitiation c an immediatelK occur. (Note , this is w r o n g b ecause the timer has no tim ed out yet) Dis tr ac t e r A Is NP as written. RFA 10 f 27 f 09 M 2 Y N S No comment at this lime E RFA 10/27/09 Cha ng e d question t o u se Containment Spray logic instead of Sllogic based on validation feedback resu lts. This changed the co rrect answer to '8', Th is also changed th e question from an '5' to a n 'E'.
t , ( ) U I 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 0#1 LOK LOD ;---(CIA) (1-5) Stem Cues T/F Credo Partial Job-Minutia #1 8ack-Q= SRO UtE/S Explanation Focus Dist. Link units ward KIA Only Changed Approved RFA 11/12/09 13 022A203 C 3 X N N U Under these cond i tions, I am not sure that Swap&in g to high speed on their is plausible.
changing " A" and " cn part ( ) to swap to slow spee on their emergency power. U because Potentially 2 NP distracters.
Part 2 of the KA i s not met (facility identified).
Use procedures to correct , control or If fr0u cannot meet the entire KA, you have to mee at least he second part. CE: Reissue a new KA if necessary.
RF A 10108/09 Revisited A2 needs to read " will remain in slow speed .... " Part 2 of the KA still not met. CAF RFA 10/27/09 Changed distracters per Chief Examiner's comments.
1;\. '; .. , :J 14 025K5.02 C 3 X N N U Whether the ice sublimates or melts, the result is a higher containment temperature which yields pressures.
Factor in instead of pressure.
is not affected.
82 and 02 are P. This Q is U due to 2 NP distracters.
RF A 10/27/09 :' '-:,' ,4 ' ,:, '.<:' ',".: 026A208 ._---15 C 3 X Y N E CAF: Do expect the to know what 1 NI-185A is? f you state the va ve nomenclature, would that g i ve away the answer? RF A 1 0108/09 Revisited The valve nomenclature was added RFA 10/27/09 "-, ,,,,' '.\" :'.-"::-' t""-: "-1 026G2.2.12
--16 C 3 X Y N E I am not sure C2 is with the valves open. Please re-evaluate this. If t e disch valvs are open, a basic understanding of fig 7.1 of the reference renders this choice NP. RFA 10/27/09 . " :.; ; :: " () 1. 2. 3. Flaws 0#1 LOK I (CI A) I \1-:)1 Stem Curu: TIF Partial Focus I U I SI. 13 c 3 x 14 c 3 x 15 c 3 x 1 6 c 3 x Link 4. Job Content Flaws #I Back-units ward ()
N N N N y N y N 6. U/£IS u u E 7. Explanation I "'. ," w ** de; 'hese ' i , , no' su.e 'ha' '0 i ' , swap \""'0'; ,peeifon U NP distracters.
Part 2 of t he KA is not met (faci lity identified
), Use ) to correct , con tr o l or mitigate ... I(you cannot t h e entire KA, you have to meel at least Ih e second a new KA if necessary. 1"'<1-..... 10 f08/09 i i !Ai needs to read " will remain in slow speed .... "
20f the KA still not met. CAF I RFA10/27109 distracters per Chief Examiner's comments.
I, ,.' . , ,ice, .me"s , Ille .esu" is a highe. i whict' pressures. '0 1 . KA is nol affec'ed. I Thi;o Is U due to 2 NP distraclers.
'RFA 10127109 ., I r£!A a Do you expect the applicants to know what 1 NI* is? If you state the valve nomenclature , would that away the answer? I rtt"A 10 1 08/09 i . I The-v alve nomenclature was added RFA 10/27/09 E I' am wi'h open. Please I I are open, a baSIC . i l of fig 7.1 ofthe 'endelS 'his I ,NP. RFA 10/27/09 (L 1. 2. 4. Job Content Flaws 0#1 LOK LOD (CIA) (1-5) Partial Job-Back-Link ward 17 I C I 3 I X I I 18 I C I 3 I X I 19 I C I 3 I X I 5. Other I 6. 7. 0= I SRO I utEIS I Explanation KIA Only N I Y I Y I I I (;T;.; :',) ; ., ;", "::' '.':;;:<;\
.039K3.04 N Since aux steam is normally i solated at 100% power change the stem power level to 85%. This will give Band N I E N I E C more plausibility. RFA 10/27/09 \ .... ,/ ;;r:'; j' ;",.':: :,j-.,,! '> ... ". /.l ,:
i 059K302 !Choice "cn:
P-11 to 1960 PSi9r Th i s way they have to know wha pressure P-11 IS. his will increase plausibility and make the answer less obvious RFA 10/08/09 Revisited I Additional comment: o is NP for set of events given. For this level of exam and failure to recall that P-11 resets is not likely. There ore 0 is not plausible. I suggest the following:
IA. Following the CF isolation reset or when the SG Hi-Hi level cleared. B When the SG Hi-Hi level cleared ONLY C.
the CF isolation reset or when pressure increase above 1955 psig. D. when pressure increased above 1955 psig ONLY RFA 10/27/09 ',;: : :,,:. ;.:,; .. : '; 'f. 059K3.03 Too much teaching in all distracters/choices.
Furthermore, the second parts may give away the correct answer. Reduce to the following:
IA. The feedwater regulating valves on A and 0 SGs only will open. B. The feedwater regulating valves will remain in the same position for all SGs C. All feedwater regulating valves will open to feed all SG (WR or NR) levels to 65%. D. The feedwater regulating valves on Band C SGs will open to increase the (WR or NR) levels to 65%. RFA 10/27/09 '(.'. ' . n (") 1. 2. 3. Psychometric Flaws 4. Job Content Flaws
- 5. 7. 0#1 l OO 100" (1-5) S t em T I F Parti a l Job-M i n utia " Back-U tE/S Explanation Focus Unk units w,rn KIA , ."
- 17 e 3 X N N . isolated a t 1 00% t o 85%. T his wil g i ve 8 a nd . , . ," ' ' * ' ro' ., 18 e 3 X Y N E i P-11 to 1960 This way th ey ha ve't o I ;"andha pressure P-11 I S. his w ill in c r ease I m a k e the answer les s obvious RFA i i com ment: 1 01! NP for se t of even t s given. F or this l evel o f exa m failure to r eca ll that P-11 resets is not . Th ere ore 0 is not p lau sible. I sugges t the l A,' Follow ing the CF isolation reset or when the SG Hi-Hi l evel c le a re d. When the SG Hi-Hi l eve l cleared ON L Y I e.
the CF isolation r ese t o r when pressure Increase above 1955 psig. 1 0. when pressure Increased above 1955 psig ONLY I RFA 10 12 7/09
- 1 9 e 3 X Y N E ':: i j parts may give away the co rre ct 1 0 th e following: I A. The feedwaler regulating valves on A and 0 SGs only will open. l B. The feedwaler regu l at iG1 valves will re main in the same position for a ll S s I C. All feedwater valves will op e n to feed a ll SG (WR or NR) le ve s t o 6 %. 1 0. The fee dwa ter refhulatin2 valves on Band C SGs will I RF:pen 1 0 increase e (W or NR) level s t o 65%. 10 127/09
- I ,
( ) l 0 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Cred o Partial Job-Minutia #1 8ack-Q= SRO UtE/S Explanation Focus Dist. Link units ward KIA Only : : TT:;:) 20 I 061Kl.0l M 2 Y N No comment at this time RFA 10/27109 '1/'" ,;" ., . . . 21 062K4.10 C 3 X Y N E Need for D. As written, D could be potentially correct since i it takes 30 s or so to return to normal. Suggestion for D: Loads will auto swap back to the inverter as soon as inverter over curren is detected to be less than 120% RFA 10/27109 :.' . .').';:; ':{-':.: :" ,.--: ri:'.:"C}::.:-: '; 22 063K2.01 M 1 X N N U This Q has low DV. Suggested fix: A. DIG Fuel Oil Booster Pump and FWPT A Emergency Oil Pump(s) B. FWPT A Emergency Oi l Pump(s) and Reactor Trip Switchgear Control C. Turbine Emergency Bearing Oil Pump and Turbine Backup Vapor Extractor(s)
D. Turbine Emergency Bearing Oil Pump and DIG Fuel Oil Booster Pump This Q is U because of low DV RFA 10/27109 I i: ,;: :): .. 23 064A3.0 1 M 2 X N N E Move the WOOTF statement to the top. CAF: Look at A1 and C1 and make sure that they are not subsets of B1 and D1 because 235 psig is between both choices. You might consider using an actual value where the l imits have to be applied instead. RFA 10/27109 the Rressure range for d i stracters
'B' and " D' to 2 10 -25 PSIG. . .' .. '11' <; 24 064K608 C 2 X Y N U Since ref is provided, and there i s no mention of problems w i th DG starting a i r , the second part of A and Bare NP. Why not chan,ge to 7 days and put a particulate bullet in I the stem that IS w i thin the limits. Unless I am missing something, this Q is U because of 2 NP distracters.
RFA 10/27109 --I J r:-1.
J. Psychometric Flaws 4 , Job Content F l aws 5. Other 6. 7. 0#/ LOK -
I c"" TIF Partial Job-Minutia " Back-UIEIS Explanati o n L i nk units ward t<iA " 20 M 2 Y N N o a t th i s time RFA 10/27(09 , , 21 C 3 X Y N E Need (f o r.D. As written, 0 cou ld be po t en ti ally t lakes 30 s or so to r eturn to no r mal. I cD. auto swap back to the inverter as soon as , :urrent is detected to be l ess than 120% RFA 10 127/09 '. -22 M 1 X N N U Q ha s l ow DV. S u ggested fi x: I A. D I G Fue l Oil Booste r Pump and FWPT A Emergency Oil Pump(s) B. FWP T A Emergency Oil Pump(s) and Reactor Trip Switc h gea r Contro l I e. Turbin e Em e rgen c y Bearing Oil Pump and Ba c kup Vapor Extractar(s) 1 0. Turbin e Emergency Bearing Oi l Pump and D I G Fuel Oil Boos t er Pump I!his Q i s U because of low DV RFA 1 0 f 27/09 . , 23 M 2 X N N E Move the WOO TF stateme nt to the lop. A1 and C 1 and make sure that they a r e not ? and 01 because 235 psig is between bo th .
might consider using an actual value where i to be applied instead. RFA 10f27 f 09 f or dislracters
'B' and " 0' to 24 C 2 X Y N U I,
7' A,.'nr Unless I th i s a i s U because o f 2 NP distracters.
RFA 1 0 f 27/09 n ... ___ .. _._ _ _ n 1. I 2. 4. Job Content Flaws 7. Q#I I LOK LOD (CIA) (1-5) Partial Job-Back-Q= Explanation Link ward KIA , , ' .. i.': . '.:,:;> ,';",: ' /.
.\ ';':1'.5 F: i:,'.' ,', ;;"/> 25 I MI I I X I I I I 073A403 2 Y N U In accordance with the reference, it appears that a source check is required not a setpoint check. Please re-verify correct answer .. The stem ask for a The word " Ensure" "c" and " 0') are NOT "requ i rements".
These o distracters will be immediately eliminated. U because "c" and '0" are NP RF A 10108/09 Revisited The stem asks for a requirement.
e and 0 are "verify" steps. A and B are performance steps. If the stem asked for a requirement, then the applicant will rule out e and 0 because they are NOT performance steps. RFA 10/27/09 Added ONLY to distracters
'A' and 'B' and changed distracters
'e' to "Start the associated sample pump AND have RP perform a setpoint check and
'0' to to "Start the associated sample pump AND ave RP perform a source check" 26 I M I 2 I X I N I N I E With train se8aration being common knowledge, I do not believe that is plausible since the suction is common from SNSWP. Replace D. RFA 10/27/09 27 I C I 3 I I Y I N 28 I M I 2 I X I N I N E If C was correct, 0 would be also. Modify C or 0 or add an ONL Y to C. RFA 10/27/09 . " ."'<: ,,: ,"" '" '. " 29 I I 2 I I I I 002K3.03 C X N N E I "No impact" (distracter B) is not plausible especially w i th fans in high speed. Replace B n () 1. 3. Psychometric F l aws 4. Job Conlent F!aws 5. Other 6. 1. 0#1 LOK I I Cues T/F Partial r-Job-Minutia ., 8ack-Q. SRO U/EtS Explanation Link units ward KIA On l y , , .,. , " 25 M 2 X Y N U lhe reference , it arpears that a source I c h eck . not a selpoin! chec . Please f e-verify I The,-s tern ask a reg,u ir ement. Th e word "Ensure" . and "0 ) are NOT " r equi r eme nt s*. These I two I i wi ll be i mmediately eliminated.
I _because *C* and 'D" are NP 1 0/08/09 stem asks for a requirement.
C and 0 a re "ve rify" A and B a re performance steps. If th e stem for a requ ire m ent, then th e applicant w ill rul e l out c and 0 be cause they a r e NOT performan ce steps. I RFA 10/2 7/09
'A' and '8' and changed . to " Start the associated samp l e pump perform a setpolnt c he ck and chan ed the associated sample pump AND perform a so ur ce check" , ' ',' , ")' 26 M 2 X N N E
- 1 knqwle,dge, I do not I fmm ! ;, I since I suction IS commo n D. I RFA 10/27/09 " , , , 27 C 3 Y N I"' co mm e nt at th i s time RFA 10/27/09 , , , 26 M 2 X N N E If C was co rr ect, 0 would be a l so. , or 0 or add an ONLY to C. I RFA 10127/09 I .. '. . 29 C 2 X N N E I ,
- ,n, ;n ,:;t ,peed-is not plausible especiaUy with
( , ( ) I ......,; 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. Q#I LOK I LOD r--(CIA) (1-5) Stem Cues T/F Cred o Partial Job-Minutia #1 Back-Q= SRO U/E/S Explanation Focus Dist. Link units ward KIA Only IKI"'A 10/27/09
- .: ," , . '., . :';i:: , " ;::., "':" -".:,-:.
,-.' ',: ,..: . I' .' ',-r'. ,/', I (::;:1 i 1",': 30 014A1.02 M 2 X N N E A is a subset of B. If C was correct so would D. Psychometrics need to be addressed.
RFA 10/27/09
- '
- :. ., '.< "; ::.: ','!':' , : ", c: 31 017K601 C 3 X Y N E I do not see where " An is plausible given the circumstances.
Replace " A" or prove plausibility.
RFA 10/08/09 CAF: Must demonstrate plausibility RFA 10/27/09
?'t::>'.:
i;: :.; .. ,-' ..... .. .::: :: !? : "i ,:., :.,: , ',':;' -","', ::';",::;;
":.': :. ;. :';":;:. '; 32 029A2.03 C 3 X Y N E Identify the procedure that must be used to support the second part of the KA . ..... and how can it be stabilized as stated in procedure RF A 10/28/09 I: i:':,. " -: '::": , r\ ,. ,. , . ;" '.lid'*-/*;**nc*'" : . : : <.: <J 034A303 ._--33 M 2 Y N Revisited No comment at this time RFA 10/28109 *1 ,,\, ( : : ':: :. :'-' ;. 045K4.13 -,-34 M 2 Y N No comment at this time RF A 10/28109 'i.:. .;; -: r.1'-;*, 'll -_. o . ... 3 0#/ LUK L UU Partial Flaws 30 M 2 x 31 c 3 x 32 c 3 x 33 M 2 34 M 2 Unk 4. Job Content Flaws Minutia #1 Back-units ward n t<JA """ N N y N y N y N y N 6. UIE/S E KCA I**, -,., 1014A1.02
- 7.
-, I I;' 'is a subse t of B. [ii C was co rrect so would O. j P,;,cho,nellrics need to be addressed.
j RFA 10/27109 ,. t. 7K601 D E d: , ": 0::' "A" i s plausible g iv en t h e I f " A" o r prove plausibility. I RFA 10 108/09 E l eAF: Must demon s trate plausibility
[RFA 10{27/09 I .\. It; ',), * " oj',. 'I * 'I , i the procedure that must be u sed to suppo rt the part of the KA ..... and how can it be stabilized as stated in t'p"""d",.
1 I RFA 10/28/09 ., I al this time 10/28/09 \ I Uoo" O." at this time 10/28/09 n 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. Q#I LOK LOD r--(CIA) (1-5) Stem Cues TIF Credo Partial Job-Minutia #1 Back-Q= SRO U/E/S Explanation Focus D i st. Link units ward KIA Only 35 I I U OOK 1.U O M 2 Y N No comment at th i s time RFA 10/28/09 t':
068G2.4.50 36 M 2 X Y N E Stem: Delete the word "is." The reference provided does not support answer and cho i ces. Facility demonstrate and provide proper reference during review. RF A 10/28/09 l/,!", ,: '.' ,'. 37 071A4.14 C 3 Y N ' The KA says to operate andlor monitor in the CR. Rad alarms are a form of monitoring.
KA i s met. No additional comments at this time RFA 10128/09 .:':':. { 'i ,
f ',j: :: 38 075K2.03 M 2 X X Y N U If 1 TB supplies power to 1 ETB, then C is also a potentially correct answer. The stem is not specific enough. This Q is U because of potentially two correct answers. RF A 10/28/09 If---+--+---+-+---r--+--+---+--I---+-+---+---r---I-
--I'-Fr i\;};. ". '. "r. ,: <: ",'::' 39 EP E 007G2.4.2 M 2 X X Y N U The KA match is OK for actions that should have occurred I on EOP entry. "Main feed pump turbines are tripped" is not plausible without something i n the stem that might drive the applicant to thinking so. Add something in the stem like a . failed annunciator that might elude the applicant to ' thinking so. This Q is U because of two NP distracters.
RF A 10/28/09 i 40 APE008AK1.01 i C 3 Y N Double jeopardy with Q 9: Th i s Q is not double jeopardy with Q 9 because 9 dealt with a ruptured PRT. This Q deals with the usage of the mollier diagram. I am researching the SRO ONLY aspect of this. RFA 10/28/09 " ,', ):'
- .,
- ' :" '. . ", ,:, : .' 41 1 APE015/017AK2.08 r () LbK 3. . Flaws 4. Job Content Flaws 6 . 7. 011 1 I e,,,
TIF Pa rtial Job-Minutia #I Back-Q" I UlEIS Explanation Li nk units ward KIA 35 M 2 Y N E mmenl allh" lime 10 128/09 r.'*, ; 36 M 2 X Y N E the word "is,"
provided does not suppo rt ans wer and ; demonstrate a n d provide proper r e f ere n ce du ring IRFA 10/28/09 I., ., I, ' 37 C 3 Y N KA says to opera t e and/or monit o r in the CR. Rad a re a form of monitori n g. KA is mel. additional co mm en ts a t this lime 10/28/09 , , , 38 M 2 X X Y N U power to 1 ETB, then C is a l so a pote n tially The ste m Is not specific enough.
a is U because o f potentially two co rre c t answers. 10/28/09 I .. " ,," 39 M 2 X X Y N u OK f or actions that s hould h ave occ urr ed
!p turbines a r e t ripped" is nol plausible i . in the stem that mi.9ht drive the i I Add so mething in t he stem like a I fa;l, r Oi al m ight elude the appli cant t o '0. Q. U because of two NP d i st r ac ters. 10/28/09 , 40 (1.01 C 3 Y N . 1 w!lh I I hlsQ I deal, w ! Ihe.
m0tUei .m ,-I';; SRO ONLY a'pecl of Ih;,. , ..... 41 I' D 4. Job Content Flaws 0#/1 LOK
- 1. I 2. I 3. Psychometric Flaws Stem I Cuesl T/F Icred.1 Partial (CIA) (1-5) M I 2 42 M 2 43 C 3 44 C 2 Focus Dis!. x I I X X X X Link Minutia 1 #1 I Back-units ward 5. Other Q= ISRO KIA Only YIN Y N Y N Y N 6. 7. utE/S Explanation
-r lAIl dloices Involve teaching.
AddltJonally, the stem does not solicit much of the info Included.
6 S E Since the Q is comprehensive , redesign it to a two part Q. RFA 10/28/09 Changed all distracters for consistency and balance and removed wording that was teaching in the answers. Approved RFA 11/10109 I APE022AK102 Revisited I No comment at this time RFA 10/28/09 ,. ]APE026AA2
.04 I think 120°F is NOT plausible because it is too low. Consider usinQ a higher temperature. At what temp does the resin bum? Something higher than 138 would also be acceptable.
RF A 10/28/09 " " .. 'I, :;: ',: I ,;.; :;", ', ii' ; .. ." Following final validation on 11/11/09 , the stem of the question was revised to add " due to reactivity effects" after the first blank to clarify that the question was asking for the change in NC system temperature due to the release of boron from the demineralizer and not the potential change due to the increase in letdown/charging temperature.
This changed the question from an'S' to an 'E'. Changed approved RFA 11112/09 U Stem: 1 st bullet: Change "has" to "have". I APE027AK3.04 E Psychometrics:
As written, B is also a correct answer. Additionally, If C was correct, so would D. This Q is U because of multiple correct answers. RF A 10/28/09 , , . : , ':
c' \' ',,,, I ;,;" ;.;, Following final validation on 11/11/09, changed first two bullets to set initial conditions as a Steam Break as opposed to a Pressurizer Safety Valve stuck open to improve the plausibility of the initial conditions.
Change approved RFA 11/12/09 () (CIA) I (1-5) Stem Cues T/F Partial Job-i #! Back-Q= SRO U I E/S Explanation F ocus I uisl. Link un i ts ward KIA On ly 42 M 2 43 C 3 X 44 C 2 X X -V -W T notoolicil Ihe info;' . "'f, Ihe slem does Y N Y N & s E Y N U E th e Q is compre hen sive, r edesign it to a two part Q. tv*,.,. 10/28/0 9 i ' a ll d i stracters for co n sis ten cy a n d balance and wording that was teaching i n the answers. RFA 11/1 0109 c omment at this l im e 10/28/09 , I' ,\ " I is NOT because it i s 100 low.
a hig e r temperature.
AI what temp does resin . Something higher than 1 38 would also be I RFA'IOI28109 , I , , * \ . , , final I 'h.,'em ofthe i j to 8 1 . l to i effects" ,in Ii Ithe w", rthe due I i and not \' '5;'0 . This c ha nged th e i ""ni an' an 'E', approved RFA 11 112109 Change " ha s* to " ha ve". : As written, B is also a corre c t answe r. i I I If C was correc!. so wou ld D. Q is U of mult ip l e correct answers. 10/28/0 9 , ,
final va lidati o n on 1 11 11109 , c hang e d fi r st ) bullets .to set i nit ia l co ndition s as a Steam Break opposed to a Pre ssu rizer Safety Va r ve stuck open I t; improve the p l au s ibitlty of the Initial condi t ion s. app r oved RFA t 1/12/09
, 1. 2. 3. Psychomet r ic Flaws 4. Job Content Flaws 5. Other 6. 7. Q#I LOK LOD ,--(CIA) (1-5) Stem Cues T/F Credo Partial Job-M i nutia #1 Back-Q= SRO U/EtS E x planation Focus Dis!. Li nk units ward KIA On l y 1 I::I-'I:: lI/!-I{';/ A.2" 45 M 2 Y N No comment at this time RFA 10/28/09
(':,,}' ,:; :/;/': ":":') 46 EPE038EA 1.10 M 2 X X Y N E This Q is con f using. NSO-5 1 3 states that the best method is EMF-33 and the seconda'6 method is the N-16 monitor. The Q stem asks what the est indication is to determine that a SG tube leak has occurred.
The stem seems to contrad i ct the ref materia l s l ightly by the way it is worded. Facility please re-evaluate. RFA 1 0/28/09 ,,' ..
nr:\ ... ,':!' --APE040AK1.01 47 C 3 X Y N E Oistracter 0 is NP. Replace 0 with a statement that would cause a CO without stating so. For example a valve or series in the primary or secondary that woul cause a CD would be acceptable. RFA 10/28/09 1*\:.) , "., "; ',:,' ( ,., 48 Ape054AA2.08 C 3 Y N No comment at this time RFA 10/28/09 I "" " ',"'; ,:" " -: :', ". ' . ;f j.:.': 49 EPE055EK3.02 M 2 X Y N U A is NP because there is noth i n% i n the stem to indicate that NC system subcooling has een lost or challenged. There is noth i np in the reference to support the use or potent i al use 0 CLAs i n this case .. Oistracters A and B do not appear to be plausible. This Q is U until it i s proved otherwise.
RF A 10/28/09 {.-', :,: .. '-:: , .
- ..
- ';. '.,,>; I'J :" ;'.:i A n' ';.: .. '; , "'.: p .; . I'*" ;:;: , ", . i 1 ,'<> ',"'>.> < .... 50 APE056AA2.37 C 3 Y N No comment at this time RFA 10/28/09 ,,'. 'i' ,', '; .) 51 APE057AA1.06 M 2 X X Y N E To be consistent, state in B , C, and 0 the procedure you --. -0#/ 45 1. LOK (C/A) M 2.
LOD (1-5) Stem !cu es TIf I<:r , ed. Partial Job* i #1 Back-Focus I UISt. Link units ward 2 () 7.
- 6. 0-i SRO UlElS E:.:planation 10128 109 :" I this lime II----I----I---I---l----+--I---l---I----I---I-----I---I-----I--I= "" " , 1.10 46 M 2 x x y N 47 c 3 x y N 48 c 3 y N 49 M 2 x y N 50 c 3 y N 51 M 2 x x y N E I lIhe, 1 3 , Ithe.1 N-16 I iii , leak be" I,dl" ,eem, Hef , I "Igh ll y by 1e wi;';'", RF"i" r e-evaluate. " . comment a t this time 10/28/09 I I * ,\1 U I A is NP because there is nothing in t he s t em to indicate I t h a-' NC sys t em subcooling has been lost or challenged.
ill' 1 the to support the use o r I use s i n th is case .. . A and B do not appear t o be plausible. Q is U untit it is proved otherwise.
I t'\rM 10128/09 I , 37 at this time 10{28/09 I" ' E 'be consistent, state in B, C, and D the procedure you
'" 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Credo Partia l Job-Minutia #1 Back-Q= SRO U/E/S Explanation Focus Dis!. Link units ward KIA Only will go to affer compTeting lfle lAs. RF A 10/28/09 I h .*. !' ..... 52 I APE058AK3.02 M 2 Y N No comment at this time RFA 10/28/09 :.,.'. : .: . . . 53 APE062M 1.05 C 3 X X Y I N E Reverse the WOOTF statement and put i t up front. The d i scussion (distracter analysis) does not l i ne up with the Q. Please re-evaluate. However , the reference does support the correct answer. RFA 10/28/09 I: J, " . j -: . ': , * ,'. 1' .. : I*: 54 WE04EK2.2 C 2 X Y N U ; If the graph wasn't marked then I wo u ld agree with the . distracter analysis for distracters Band D. However, since I the graph is incrementallr marked t it is not possible to misread it on the horizon al axis. herefore, 380 GPM is not plausible.
I do not have a suggested fix for this problem unless you can provide a curve t hat doesn't have the 2-9 incrementa l markings. This Q is U because 2 distracters are not plausible.
RF A 10/28/09 I .. :. ;y;.:'," *.. ' r: f : ... 55 WE05EK2.1 C 1 X Y N U It is common knowledge that an SI signal isolates FW and that FW cannot be regained until SI has been reset. This Q is U because it has no DV. RFA 10/28/09 :,;;"; .. /" ,: .;:. ., r ,' ! '\ ";:" ,.:,:: .. ,,"{ .' ;.' I L** .. " 56 WE11G2.4.8 C I 3 X X X Y Y U Band 0 are not plausible because you asked them in the stem WOOTF describes the requirements or implementing
... Therefore Band 0 are automatically ruled out. Change stem: WOOTF describes whether or not AP-22 can be implemented in con j unction with ECA-1.1. (something to that affect) -n 1. 2. 0#1 LOK I (C I A) I P-:>> 52 M 2 53 e 3 54 c 2 55 c 56 c 3 3. Flaws Stem I e, ," Partial Foclls Dist. x x x x x x Link x 4. Job Content F l aws " Back-u nits ward Q= SRO KJA Only y N y N y N y N y y 6. UlEtS E u u u 7. Explanation
,.he lAs. ,., the WOOlF statement and put it up fr ont. The* (distracler analysis) does nolline up with th e Q. re-evaluate.
However , the r eference does co rre ct answer. Kr-A 10/28109 , , , " .,
o,"ph wasn;. (0' IIhen 1 a"'ee v.i.h **
is 1 !,.itis , . on :he ,I axis. ;::'31,'0"GP';;:
is *n o. 1 a suggested fix for this problem unless you a curve tha t doesn't have the 2-9 incremental 0 is U because 2 distracters are not plausible.
KI'"A 10/28/09 knowledge that an 5 1 signal iso l ates FW and FWcannot be rega in ed until S I h as been reset. Q is U because it has no DV. : KrA 10/28109 , ., , , you asked them in th e , Band D are automatically ruled out. stem: whether or not AP*22 I can be ) that with ECA-1.1.
... 1. I 2. Q#/I LOK (CIA) (1-5) Partial 57 C 3 x 58 C 3 x x Link 4. Job Content Flaws Minutia I #1 I 8ack-units ward o 5. Other Q= I SRO KIA Only y N y N 6. utE/S 7. Explanation I I agree that tms Q may bEfSRO ONLY Replace the Q or request a new KA. RF A 10/28/09 -:"\ ,::" '\ -,:: .* -:':-: 1-, " ,;: " t\ . '; APE003AK1.07 E Please re-evaluate the assumption in the guestion.
If they know Xenon did not change , then power did not change and reactivity did not change. This may key them to tfle answer. Can the assumption be removed without affecting the I question?
RFA 10/28/09 , "', ' 'f
} ,: '<. , , : : .' -',:. ,: ,., ; ! ! " ":.' , ,:; " t : , '.':" " r,' , -* '; : ,'. :. .' ! Following final validation on 11/11/09, changed distracters A1 and D1 to 'increases' instead of 'decreases'. This was done since decreasing could be considered correct i f the Operator were to perform a SDM determination as opposed to considering the actual change in SDM. If a determination was performed the SDM calculation would yield a decrease In SDM due to the large penalty imposed for a dropped rod (much larger than the actual rod worth for a dropped rod). So , even though ACTUAL SDM does not change , the calculated SDM will always decrease for a dropped rod. Also, in the stem of the question changed the bullet regarding rod motion to say that temperature was restored through manual rod motion instead of automatic rod motion. Also, added a bullet to say that boron concentration has not changed so that the Operator will have all necessary parameters to determine the effect of the dropped rod on SDM. Changed approved RFA 11/12/09 I APE005AK2.02 o is not plausible because the stem stated that there no indication that the rod is mechanically bound in the 4 bullet. To state in 0 that it cannot be moved is a contradiction to the stem. The distracter analysis for 0 is not acceptable. Mod i fy or replace distracter D. RF A 10/29/09 '-:-'il L. ': , ,' -:-.:. n 0 2 3. Psychometric Flaws 4. Job Con t en t F l aws 5. Othe r 6. 7. 0#1 LaO (CI A) (1-5) Stem I c'"' TIF Pania! Job-, #1 8ack-U/EIS Exp lanati o n Focus Lin k units w ar d KIA 1 00';
.0 "", u e v,,, , I the Q o r request a new KA. RFA 10 128109 '., d *. .. " ' * , , ,,' ' 57 e 3 X Y N E J r I in th e gu est ion. If th ey I ) di!;l,nol,'
t e n power d id n ot
, and f did not I Th is may key them to t e j ean I h e I be r emoved w ith out affecting th e
- I RFA 10/28/09 , * " ,,, , , * .
- i, l . fin a' " o n1"' , ' I be ', 10' ,'h e a l acI"ai ' , In ,
I the , I I I ,:"ould' ffor-; de c rease l i n SOM
- a, I r!,d not -'j always de crease for a . Also , in the of th e question I the b u llet i r od motion to sa.y I . was *od I '!.O!. 0 ,od .
'bo,on:
- !;, 0 has 1 0
,;;;"on SOM. RFA 111 1 2/09 58 e 3 X X Y N liT n ol I Ih e." ',s la: e' , Ibe i he stem. i I f o rDis o r r ep l ace d i s tra cte r D. 1 0/29/09 * '"
o n 1. I 2. Q#I I LOK LOD 1'1--.,.--,---,---,-
(C I A) (1-5) P a rtial Focus Link 4. Job Content Flaws M i nutia I #1 I Back-units ward 5. Other 6. , I 7. 1 Q= SRO U/E/S I E x planation KIA . Only ;" i'-< ; ': ," ,>t; 59 CAF: The KA is for l ow temperature limits for Boron Concentration.
This Q references an over-tempe r ature annunciator. Is this for a high temperature or a low temperature condition?
The ref does not expla i n well. 60 C 3 x Y N 61 M 2 Y N Stem: Is this a high Temperature or a low temperature condition?
Remove the doub l e period from " C" and "D" RF A 10109/09 Revisited After revisiting this Q , I think 80°F would be more plausible then 65 of. 80 is the excessive water temperature in the RWST where 65 is the min RCS cold leg temp. Consider changing and we will discuss during the on site rev i ew. RFA 10/29/09 5 ": .. -: ': / ": ' i:: '::)' " IAPE061AA2
.04 E Ilf you wanted to write this W /0 it being a NOT Q , consider the following: u WOOTF alarm(s) can be used to confirm that the 1EMF-1 6 alarm is valid? A. 1EMF-17 annunciator or SFP level Low computer alarm B. Incore Inst Room Sump Hi Level or 1 EMF-51A alarm C. 1 EMF-17 annunciator ONLY D. 1EMF-51A alarm ONLY RFA 10/29/09 .. <,., . " ,;' .;; '. -: : 1 ,.,,* ;." k. '.-. '(: I A P E067AK3.02 Accord i ng to the reference (OMP 2-2 , Page 13,) A and B are both correct. If that is not so then: Change the 2 nd part of A to "The fire brigade will respond." Change the 2 nd part of B to The fire brigade will NOT respond." l As written , the Question is leadinQ the applicant to the -0 L6K 3. i Flaws 4. Job Content Flaws
- 6. 1. Q#! ie,,,
TIF Partial Job-Minutia #I Back'* Q.
UlEtS E x planation Link units KJA , *r' 59 M 2 X Y N E The KA i.s fo' Boron i
'T ' 0' t ow , con i . ; not expl.in well. I Is this a h ig h T emperalure o r a low temperature , the double pe ri od fr om "C' and " D" IRFA 10/09/09 iii think 80°F would be more i Is the excessive the RWST where 65 Is the I cald I e!=! temp. Consider changing and we*wiJi* i the' r eview. I RFA 10 1 29 10 9 , , , 60 C 3 X Y N E . write this WID it being a NOT Q, consider i th. ,
can be used to confirm that the 1EMF-I is valid. I A. 1EMF-1 7 annunciator o r SFP level Low computer alarm l B. Incore Inst Room Sump Hi Leve l or 1EMF-51A alarm 1 2:: 1EMF-17 a nn uncialo r ONlY 1 0. 1EMF-S1A alarm ON L Y I RFA 10129109 , " , , , 61 M 2 Y N U reference (OMP 2-2, Page 13 ,) A and B l a,e both . I mat I S no l so then: part of A to " The fire b ri gade wi ll respond." 2nd part of B 10 " The fire brigade will NOT Ih. "i' ,i, "h. i , lin Ih.
0 0 1. 2. 3. Psychometric F l aws 4. Job Content Flaws 5. Other 6. 7 . Q#I LOK LOD .----(CIA) (1-5) Stem Cues T/F Credo Partial Job-Minutia #1 Back-Q= SRO UlE/S Explanation Focus Dist. Link units ward KIA Only correct answer. I Currently, the Q is U because of two correct answers. RFA 10/29/09 fl ,!', ;' i :" ,"', ;1:): , 1'J" ,: " -,-',\ , i\; -; <<.::," ..
';:', ;',' . Changed to new question.
Original question was determined to be SRO level knowledge following final validation on 11/11/09.
Changed approved RFA 1"1112109 62 APE068G2.1.28 M 2 Y N S No comment at this time I E RF A 10/29/09 1< .,' ;;. ;': .. :,:'j .,: .-' I*'" 63 WE03EK3.2 M 2 Y N No comment at this time RFA 10/29/09 ".!" 64 WE09EA1.1 C? 2 Y N E I think this is a comprehensive Q since a fair amount of evaluation is required.
RFA 10/29/09 (: :',', ,'; . :, .' .. ;; ; " 65 WE13G2.2.37 C 3 Y N S No comment at this time E RF A 10/29109 : ,',\ /"': " '.! ""'::,,. ",' ",' .... I I> , ., '; 'I* I .': ;': . . . 66 G2.1.28 M 2 Y N No comment at this time RFA 10/29/09 : .... : .,.: . , 67 G2.1.30 M 2 N N U This Q does not have to do with local contro S. I suggest writing a Q where e CR haC! to be evacuated an the operator has to report to a local station to operated equipment.
This Q is U because the KA is not met -_ .... --() () 1. 2. 3. Psychome t ric Flaws 4. Job Content Flaws 6. 7. 0#1 lOD 1'6,:1 (1-5) Stem I C,,, 71F Partial Job-, #1 Back.-1 U/EIS Explana t ion Focus Li n k units _,d KJA I the Q is U because o f two correct answers. , " . 1\, . n e w qu es t io n. O ri gina l qu estion w as i to be SRO l evel k no w le d ge fo ll owing f i n al i o n 11/11 10 9. approved RF A 11 1121 0 9 62 .1.2. M 2 y N $ comme nt at t his time E RFA 1 0129/09 r, 1,1 * '. , 63 M 2 Y N commen t a l th i s ti m e r.: , 1 0/29/09 "'l ,I, 64 C? 2 Y N E i a comp r e h e n sive a s i nce a fa ir a m o unt o f I is required. I RFA 10129109 ., , , 65 C 3 Y N $
al this ti me E 10/29/09 , 66 M 2 Y N commen t at t his lime 1 0129'09 e., {, r _. c "' , 67 M 2 II N U cO' t o do wi th l oca l co nt ro s. I SU9aBst a Q I w h e r e t o be evacuated an the opera or has to a I s t a t ion t o ope r ated equip m en t. a is U beca u se the KA i s not mel o (J 0 1\ 1 I 11 1. I 2. Q#/I LOK' LaD (CIA) (1-5) Partial 68 e 3 69 M 2 x 70 e 2 JobLink 4. Job Content Flaws Minutia I #1 I 8ack-units ward 5. Other I 6. .------Q= I SRO I U/E/S KIA Only 7. E x planation
[R F A 1U/£8/U8 {,)', ::"-" :
{: ,;; ". ,(" (;', I**** : 1, :.:(, . ',(.,; '\,;-""'::1;:':
'1 ': .:"; ;1': G2.1.31 y N SIN .... O comment at this time E RF A 10/29/09 :, " '" y N y N : ".1 s;.-:
,,;t-:,."' " '-'.,.; '.,'
- j
',,' G2.2.21 E I Remove double period from "A" and " e" S E Oistracter analysis:
"0" what does "the exposure will be greater if you wear the respirator" have to do with this Q? " 8" and " 0": remove "to provide ... " as this is teaching.
Plus it is additional information that is not needed. RFA 10109/09 Revisited There is way too much teaching in all of the choices. Reduce as follows: A. 1 NO-15B is interlocked with 1 NO-58A (TRAIN A NO TO NV & NI). B. 1 NO-15B would cause one NO train to become inoperable.
C. 1 NO-15B is interlocked with 1 NI-136B. O. Both trains of NO will become inoperable. Put all of the reasons in the distracter analysis.
RFA 10/29/09 Rewrote per Chief Examiner's suggestion . ... > J ,.':. .-: I ", ':', G2.2.35 I th i nk e and 0 will immediately be eliminated but it meets NUREG requirements.
The Q IS OK as is. RF A 1 0/29/09 r ... * () 0 1. 2. J. P sycho m etric F laws 4. Job Content Fl aws 6. 7. 0#/ LOK L OO (CtA) (1.5) Stem C ues TIF Credo Partial Job-Minutia " Back-Q. SRO UIE/S Explanation Focus Dist. link units ward t<JA Only I i) " "",' , n ,. . , , , 1-*' I 68 G2.1.31 C 3 Y N S N o co mm e nt a t thi s ti me E RFA 10/29/09 , " " , , , , " , e, , .. 'I-, , , . 69 G2.2.21 M 2 X Y N E Rem ove double period from " A" a nd *C* D istrac l e r analysis: "D" w h at does "t he exposure wi ll be grea ter i f yo u wear the re sp irato r" have to do w i th thi s Q? " 8" and " 0": r e m ove "to provide .. : as t his is te aching. Plus it i s additional inf ormation thai i s not needed. RFA 1 0/09/09 Revi si ted There is way too much teaching in all of the choices. Reduce as follows: A. 1ND*15B is Interlocked with 1ND-58A (TRAIN A NO TO NV & NI). B. 1ND-158 would ca use o ne NO train to b e come inoperable.
C. iND*i5S Is Interlocked with iNI*136S. O. Both trains of NO will become ino perable. Put all ofth e reasons in the distracter ana l ysis. RFA 10/29/09 Rewrote per Chief E xaminer's suggestion. , " 70 <32.2.35 C 2 Y N S I think C and 0 will i mm ediate l y be e limin ated bu t it m ee t s E NURE G r eq uir emen t s. The a IS OK as i s. RFA 10/29/09
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. Q#I LOK LOD -(CIA) (1-5) Stem Cues T/F Credo Part i al Job-Minutia #1 Back-Q= SRO U/E/S E x planation Focus Dis!. Link units ward KIA On l y : ,>:;, ,' '.,,', ',: (:;':. "." .. " .,;T:d:,"'* 'J; L* > :: ; ,1'.. 71 G2.3.1 2 C 2 X Y N E o is not plaus i ble for this fa i led fue l event. It is common knowledge to redirect letdown. Replace D. RF A 10/29/09 : '. ;',:;.: ': !',,'" . . :' . " : '; ' .. \:.' , li' , \: ".' :,,' !; " . 'f'-,': : ;': t' .: .. " I.-\'. "i' :: f: ,! ,j,' .. .<,;',; ;.:. <: .. : ':. ..r . . .. ,.f',,' 72 G2.3.14 C 2 X Y N E Dist r acter A is weak. This is too important of an evolution to be evaluated and approved by an NLO. Replace A. Distracter C: State a reason instead of "under these conditions" RF A 10/29/09 I; .. '. ), --'-:"; ':::',,:.:.:: ..
73 G2.3.7 C 2 X Y N E o is not plausible as written. 0: Change to: " should" to " must" and " could" to w i ll RF A 10/29/09 ,,':;,*:i"";: ::', .. " ','" ',' . f,: ,: ('. i 1 (P,,/ I 74 G2.4.16 C 2 Y N S No comment at this time E RF A 1 0/29/09 Approved RFA 11/10/09 <.,".;,', . ./'{ . .. : .. :.: .... , . : , ,;.; ',: . " , .. ',: ' *. I( '\" . .. . ... , r. 1. 2. 3. Psychometric Flaws 4. Job Co ntent Flaws 5. Other 6. 7. QNI LOK LOD r--(CIA) (1-5) Stem Cu es TIF Credo Partia l Job-Minutia #1 Back-Qo SRO U/E/S Explanation Focus Di s!. link units ward t<JA Only ", , " , , " 71 C 2 X Y N E ,,2.3.12 o is not plaus i ble for this failed fuel event. knowledge to redirect letdown. It is common Replace D. RFA 10 1 29/09 " '. , , . , 72 G2.3.14 C 2 X Y N E Distracter A is weak. This i s t oo important o f an evolut i on t o be eva l uated and approved by an NL O. Replace A. Distracter C: State a r eason instead o f 'under these condi tions* RFA 10/29/09 , , 73 G2.3.7 C 2 X Y N E o is not plausible as written. 0: C hange to: "s hou ld" to " mus t" and *co uld" to "will" RFA 10/29/09 ". , , 74 G2.4.16 C 2 Y N $ N o comment al thi s time E RFA 10/29/0 9 Approved RFA 11/1 0/09 , , " ," " "
I , ( ) (J 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other I 6. 7. Q#I LOK LOD I (CIA) (1-5) Stem Cues T/F Cred o Partial Job-Minutia #1 Back-Q= SRO U/E/S Explanation Focus Dis!. Link units ward KIA Only 75 I G 2.4.4b C 2 X Y N Is it fair to ask this question w i thout a reference?
If you allow a reference, will it become a direct look up (Ol.U). Please re-evaluate RFA 10/29/09 " ; ,,'-': ,. .: '. f ,.', f , ,:. ; .: .' '.: : -;.: :. "',: { ",; ,.: 1'*, . ': >," : . ,: ," ";' *. ; ... ., J..:>;-:< " ..
.". SRO ONLY N/A 76 77 78 79 " 80 81 82 83 I 84 85 86 87 88 89 90 --r. 0 1 2. 3. Psychometric F laws 4. Job Content Flaws 5. O t her 6. 7. 0#1 LOK L OO ,--(CIA) (1-5) S te m C"" '" Partial Job-i " Back-Qo UIE/S Explanation Focus Link un i ts w ard t<JA 75 .*.* 0 C 2 X Y N fa ir t o ask t his q u est i on wit h o ut a r e f ere n ce? I f you II a r eference, Will it b eco me a direct l ook up (DLU). r e-eval u ate 10/29/09 , -. " ". . . ", . " " * " " . ',.". -" A . SRO ONLY N/A 7 6 77 78 7 9 8 0 8 1 8 2 83 84 85 86 87 8 8 89 90
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. Q#I LOK LOD (CIA) (1-5) Stem Cues T/F Cre(1. Partial Job-M i nutia #1 Back-Q= SRO UlE/S Explanation Focus Dis!. Link units ward KIA Only 91 92 193 i 94 95 96 97 98 99 100 ... -.-.. ------..... -.--.--.... -.. -.---............. "---------<l 0 1. 2. 3. Psychometric Flaws 4. J ob Content Flaws 5. Other 6. 7. Q#I LOK LOO r--(C I A) (1-5) Stem C ues T I F Cred o Partial Job-M inutia " Back-SRO UtE/S Explanat i on Focus Dis!. link un i ts ward KIA Only 91 92 93 94 95 96 97 98 99 1 00
- Independent of whether or not it met the KA, mis-classified WRT RO/SRO, or required grammar or minor enhancement.
Question Statu. Question is Sat with NO Comments E(42) I Editorial Changes Needed E* I Questionable Editorial U (14) I Question i s All Hosed Up 81(0) I Questionable
$1(0) I Question and stem sat -editorial elsewhere N*(O) I Partially met KA
- I ndependent of whether or not it met the KA , mis-classified WRT RO/SRO , or required grammar or minor enhancement.
Quell1lon Status Question is Sat with NO Comments E(42) Editorial Changes Needed E' Questionable E ditoria l U(14) Question is A ll Hosed Up 81(0) Questionab l e riO) Question and stem sat -editorial elsewhere 11"(0) Partially met KA ES*403, Rev. 9 Written Examination Grading Quality Checklist Facility:
McGuire Date of Exam: Nov 19, 2009 Item Description
- 1. Clean answer sheets copied before grading 2. Answer key changes and question deletions justified and documented
- 3. Applicants' scores checked for addition errors (reviewers spot check> 25% of examinations)
- 4. Grading for all borderline cases (80 +/-2% overall and 70 or 80, as applicable, +/-4% on the SRO-only) reviewed in detail 5. All other failing examinations checked to ensure that grades are justified
- 6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed Name/Signature
./ a. Grader Ronald F. Aiello / A b. Facility/NRC Reviewer(*)
Bruno Caballero/ c. NRC Chief Examiner (*) Ronald F. Aiello/ a rfa NA rfa rfa rfa rfa d. NRC Supervisor
(*) Malcolm T. Widmann/ I
\---} --. Form ES*403*1 Exam Level: RO Initials b c blc rfa NA NA blc rfa blc rfa blc rfa blc rfa Date 11/?1J/or ) /J/?tI;h9 , )
(*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.
ES*403, Rev. 9 Written Examination Grading Quality Checklist Facility:
McGuire Date of Exam: Nov 19, 2009 Item Description
- 1. Clean answer sheets copied before grading 2. Answer key changes and question deletions justified and documented
- 3. Applicants' scores checked for addition errors (reviewers spot check> 25% of examinations)
- 4. Grading for all borderline cases (80 +/-2% overall and 70 or 80, as applicable, +/-4% on the SRO-only) reviewed in detail 5. All other failing examinations checked to ensure that grades are justified
- 6. Performance on missed questions checked for training deficiencies and wording problems; evaluate validity of questions missed by half or more of the applicants Printed Name/Signature
./
- a. Grader Ronald F. Aiello / A b. Facility/NRC Reviewer(*) Bruno Caballero/
- c. NRC Chief Examiner (*) Ronald F. Aiello/ a rfa NA rfa rfa rfa rfa d. NRC Supervisor
(*)
Malcolm T. Widmann/ I
\---7 --Form ES*403*1 Exam Level: RO Initials b c blc rfa NA NA blc rfa blc rfa blc rfa blc rfa Date 11/?1J/or ) /J/?tI;h9 , )
(*) The facility reviewer's signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.
-. * * * -KEYID © r-------,---------y--------------------------j SCORING & CJ RESCORE C MULTIPLE "4NSWE,'R SCORING
>-':'.c=i
..
.. __
---
\f/1RK(J/dJ
();"}; --fr -.., -;:, -:j -'S -0 ..... -;:., -::'] _:::l -------
T F l.©@ 3@©e -I@.@ 5.©(l!,)@
6@.COCQ)@
7 .Cf;.J@
11 .© /3 (l',).GD
-14.CID©
-T F 26.©@ 2Se© 29.@© 3fJ.©@@ 31 @.(Qj@ 32.@© 33.@@ 34.@ 3.1 .(§)@@@ 36.(12)@
37.@©CQ)@
3S.@©@ 39©. --IO.©@ -16 GD.©CP) -42 (];)@.@ --I3.©@ -19.@© -44.@© --IS@@.',:Q)
-46©. --I7@.© -23@.@ -4S©. -U.,C(Q)
-49(£;J.
-2S
-50.©© --fr -.., -'"' -0 _s; ... -" \:: -II _v'; ---NUMBER CORRECT PERCENT CORRECT ROSTRR NUMBER SCORE RESCORE T F 51 (];).@
S-l_@©@@ 55.©@ 56.@©@ 57. 5S. S9.@© 60.© 61.©@ 62. 63.@ M.@ 65.© 66©. 67©e 69.© 70.@ 72.@ n.©@ 74@. COMBINED POINTS EARAED (;RADE SCORE RESCORE 1 F 76@@ 77@© 78@© 79©@ so© 81© 1i2© 83@© 8-1© S5@©@ 86© f!7© 88© 8'1@ 91J© 91@ 92@ 93@@ 94© 95© 96@ 97©© 91i©© 99© ]{)() (ID©© V::) MARKING INSTRUCTIONS Pearson NCS Test Sheet 100 Form No. 106173 Reorder Form No. J(}6J73 1-8()()-367-6627 Fax 1-S07-4SJ-,f513 va Iii ebridge.llcspearso/!.com
("ANSWER ') L@:YINFO.
I (PERFORMANCE)
I ASSESSMENT I
1 , !TEJl t ' COlt w icD CD CD GJI I CDwG) I GJG) I I G)G) I I I. CDCDiJl II r I OF POnTS TOTiI_ SCORE EARSED r I" W i [ ,ICD CD CD CD CD :,!CD wCD WW JG) G) G)IG) °1G) G) G)G) r ,t I I \ CD CD CD I Copyright
© 1995. 2001 NCS Pearson, Inc. AI! rights reserved.
Printed in U.S.A. 1------------------..., l STUDENT ID NUMBER I '---1-1--'
--I-----J , , , I --->t UVi'ii /\'(j, 1 Pt'llfi! i ICD CD CD CD CD CD CD CD CD CD Iw CD CD CD CD CD W CD W w I GJ GJ GJ G) G) G) G) GJ G) G) G)G)G)G)G)G)G)G)G)G)
I'Aark Reflex' bnns by PC3ison NCS r\i1M106173
-3 © I
ICD CD CD CD CD CD CD CD CD CD I I@..<;v...
-. * * * -KEYID @
SCORING & CJ RESCORE C MULTIPLE "4NSWE,'R SCORING
..
---
-T F l.©@ '-___ --"'______
\f/lRK (lid.! ();"}; T F -fr -., -;:, -:j -,S -0 ..... -;:., -::'] _:::l ------------3@©e -I@. 5.©(l!,)
6@.COCQ) 7.Cf;.'J@
11 @.© /3 (l',).GD
-14.CID©
-T F 26@.©@ 2Se© 29.@© 3fJ.©@ 31 @.(l!j 32.@© 33.@ 34@@.@ .'IS .(§)@@ 36.(12)@
37.@©CQ) 3S.©@ 39@©. --IO.@© -16 GD.@CP) -42 (];)@.@@ --I3.©@ -19.@@ -44.@@ --IS@@.',:Q)
-46©. --I7@@.@ -23@@.@ -4S@@. -U.,C(Q)
-49(£;J.
-2S
-50.@© --fr -., -'"' -t;:, _s; ... -" \:: -II _v'; ---NUMBER CORRECT PERCENT CORRECT ROSTRR NUMBER SCORE RESCORE 51 Cf0.@
S-I_@©@@ 5S.@ 56.@@@ S7. 5S. S9.@@ 60.© 61.©@ 62.@ 63.@ M. 65@.@ 66@@@. 67©e 69.© 70.@ 72@.@ n.©@ 74@. COMBINED POINTS EARAED COMBINED I 1 F 76@ 77@@@ 78@@ 79© So@© 81@© 1!2© 83@©@ 8..f@
S5@@ 86© f!7@@ 88@@ 8'1© 91J@© 91 @@ 92@© 93@
94@ 95© 96@@ 97@© 91!©@ 99© ]{)() (ID@ MARKING INSTRUCTIONS Pearson NCS Test Sheet 100 Form No. 106173 Reorder Form No. J(}6J73 1-8()()-367-6627 Fax 1-S07-4SJ-,f513 va Iii ebridge.llcspearso/!.com
("ANSWER ') L@:YINFO.
I 1 , !TEJl t ' COlt w icD CD CD GJI I CDwG) I GJG) I I G)G) I I I. CDCDiJl II (PERFORMANCE)
I ASSESSMENT I r cf OF f'( [\Pi I TOH/_ ) , T : . ,SCORE EAR.\Ui r l" .1"" i [ ,ICD CD CD CD CD :,!CD wCD WW JG) G) G)IG) °1G) G) G)G) r ,t I I I CD CD CD a-;l I Copyright
© 1995. 2001 NCS Pearson, Inc, All rights reserved.
Printed in U ,S,A, 1 .. _*---------------..., l STUDENT ID NUMBER I ""-1-1--'
--I*-.. _*J , , , I --rNAME 2c::xfl N'<t UVi'ii /\'(j, 1 Pt'llfi! i ICD CD CD CD CD CD CD CD CD CD Iw CD CD CD CD CD W CD W w I GJ GJ GJ G) G) G) G) GJ G) G) G)G)G)G)G)G)G)G)G)G)
lSUBJECT
'<<'C}i I PERIOD DATE ) --I'Aark Reflex' bnns by PC3ison NCS r\i1M106173
-3 @ I
ICD CD CD CD CD CD CD CD CD CD I I@..<;v .. ..