ML13032A560
| ML13032A560 | |
| Person / Time | |
|---|---|
| Site: | Brunswick  |
| Issue date: | 01/29/2013 |
| From: | NRC/RGN-II |
| To: | Duke Energy Corp |
| References | |
| 50-324/12-301, 50-325/12-301 | |
| Download: ML13032A560 (107) | |
Text
cr1 flflrQ-ciin 1 -fni1fcwm c-mc drw ES-201 - Examination Preparation Checklist Form ES-201-1 Facility: Date of Examination: h2-i Developed by: Written - Facility NRC El II Operating - Facility 7 U
N RC El Target Chief Date* Task Description (Reference) Examiners Initials
-180 1. Examination administration date confirmed (Cia; C.2.a and b)
-120 2. NRC examiners and facility contact assigned (C.1.d; C.2.e)
-120 3. Facility contact briefed on security and other requirements (C.2.c) 3/c/,2
-120 4. Corporate notification letter sent (C.2.d)
[-90] [5. Reference material due (C.1.e; C.3.c; Attachment 3)]
{-75} 6. Integrated examination outline(s) due, including Forms ES-201-2, ES-201-3, ES-301-1, ES-301-2, ES-301-5, ES-D-ls, ES-401-1/2, ES-401-, and ES-401-4, as applicable (C.1 .e and f; C.3.d) /i g/jz 0
{-70} {7. Examination outline(s) reviewed by NRC and feedback provided to facility licensee (C.2.h; C.3.e)) _;2_
1 g7o/
{-45} 8. Proposed examinations (including written, walk-through JPMs, and scenarios, as applicable), supporting documentation (including Forms ES-301-3, ES-301-4, ES-301-5, ES-301-6, and ES-401-6, and any Form ES-201-3 updates), and reference materials due (C.1.e, f, g and h; C.3.d)
-30 9. Preliminary license applications (NRC Form 3?8s due (C.1 .1; C.2.g; ES-202)
-14 10. Final license applications due and Form ES-201-4 prparec (C.1.l; C.2.i; ES-202)
/
IL 1
-14 11. Examination approved by NRC supervisor for facility licensee review (C.2.h; C.3.f)
/
-14 12. Examinations reviewed with facility licensee (C.1.j; C.2.f and h; C.3.g)
-7 13. Written examinations and operating tests approved by NRC supervisor (C.2.i;_C.3.h)___iZJ7/_
-7 14. Final applications reviewed; 1 or 2 (if >10) applications audited to confirm qualifications I eligibility; and examination approval and waiver ltters sent (C.2.i; Attachment 5; ES-202, C.2.e; ES-204) I
-7 15. Proctoring/written exam administration guidelines revewed with facility licensee (C.3.k)
-7 16. Approved scenarios, job performance measures, and questions distributed to NRC examiners (C.3.i)
Target dates are generally based on facility-prepared examinations and are keyed to the examination date identified in the corporate notification letter. They are for planning purposes and may be adjusted on a case-by case basis in coordination with the facility licensee.
[Applies only] {Does not apply) to examinations prepared by the NRC.
ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility: EttAt]SWLCiL DateofExamination:
2o12 Initials Task Description Verify that the outline(s) fit(s) the appropriate model, in accordance with ES-401.
Assess whether the outline was systematically and randomly prepared in accordance with
,A N-Section D.1 of ES-401 and whether all K/A categories are appropriately sampled.
7 Assess whether the outline over-emphasizes any systems, evolutions, or generic topics. 22 /A Assess whether the justifications for deselected or rejected K/A statements are appropriate.
Using Form ES-301-5, verify that the proposed scenario sets cover the required number of normal evolutions, instrument and component failures, technical specifications, and major transients.
Assess whether there are enough scenario sets (and spares) to test the projected number and mix of applicants in accordance with the expected crew composition and rotation schedule without compromising exam integrity, and ensure that each applicant can be tested using 7/f at least one new or significantly modified scenario, that no scenarios are duplicated from the applicants audit test(s), and that scenarios will not be repeated on subsequent days.
To the extent possible, assess whether the outline(s) conform(s) with the qualitative and quantitative criteria specified on Form ES-301-4 and described in Appendix D.
- 3. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:
(1) the outline(s) contain(s) the required number of control room and in-plant tasks w distributed among the safety functions as specified on the form
/ (2) task repetition from the last two NRC examinations is within the limits specified on the form T (3) no tasks are duplicated from the applicants audit test(s)
(4) the number of new or modified tasks meets or exceeds the minimums specified on the form
/
(5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form.
,1J4
- b. Verify that the administrative outline meets the criteria specified on Form ES-301 -1:
(1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified (3) no more than one task is repeated from the last two NRC licensing examinations
- c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.
- a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered in the appropriate exam sections.
J)7 Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate.
Ensure that K/A importance ratings (except for plant-specific priorities) are at least 2.5.
Check for duplication and overlap among exam sections.
Check the entire exam for balance of coverage.
Assess whether the exam fits the appropriate job level (RO or SRO).
- a. Author /chAL
- b. Facility Reviewer (*)
- c. NRC Chief Examiner (#) fZUNO CAAURO / (6 Z-4-il
- d. NRC Supervisor
/iv4*& ge/LL Note: /
- Independent NRC reviewer initial items in Column chief examiner concurrence required.
Not applicable for NRC-prepared examination outlines 1 C I ed< II -I 1 s witI-e eh I.e la.i.t, p r d-eL o
ES-201 Examination Outline Quality Checklist Form ES-201-2 Facility: Date of Examination:
Brunswick .
Initials Item Task Description -;: c
- 1. a. Venfy that the outline(s) fit(s) the appropriate model, in accordance with ES-401. 4 .
w R b. Assess whether the outline was systematically and randomly prepared in accordance with I Section D.1 of ES-401 and whether all KJA categories are appropriately sampled.
- Al-I
- c. Assess whether the outline over-emphasizes any systems, evolutions, or generic topics. .J . j..j
- d. Assess whether the justifications for deselected or rejected K/A statements are appropriate. -
- 2. a. Using Form ES-301-5, verify that the proposed scenario sets cover the required number I,
7 S
of normal evolutions, instrument and component failures, technical specifications, and major transients. ft M b. Assess whether there are enough scenario sets (and spares) to test the projected number u and mix of applicants in accordance with the expected crew composition and rotation schedule It
/
L without compromising exam integrity, and ensure that each applicant can be tested using A at least one new or significantly modified scenario, that no scenarios are duplicated T from the applicants audit test(s), and that scenarios will not be repeated on subsequent days.
0 c. To the extent possible, assess whether the outline(s) conform(s) with the qualitative R and quantitative criteria specified on Form ES-301-4 and described in Appendix D. ,ih /f
- 3. a. Verify that the systems walk-through outline meets the criteria specified on Form ES-301-2:
(1) the outline(s) contain(s) the required number of control room and in-plant tasks W distributed among the safety functions as specified on the form /
I (2) task repetition from the last two NRC examinations is within the limits specified on the form T (3) no tasks are duplicated from the applicants audit test(s)
(4) the number of new or modified tasks meets or exceeds the minimums specified on the form (5) the number of alternate path, low-power, emergency, and RCA tasks meet the criteria on the form.
- b. Verify that the administrative outline meets the criteria specified on Form ES-301-1:
(1) the tasks are distributed among the topics as specified on the form (2) at least one task is new or significantly modified 1 (3) no more than one task is repeated from the last two NRC licensing examinations
- c. Determine if there are enough different outlines to test the projected number and mix of applicants and ensure that no items are duplicated on subsequent days.
- 4. a. Assess whether plant-specific priorities (including PRA and IPE insights) are covered / ,p in the appropriate exam sections. 1 T1
- b. Assess whether the 10 CFR 55.41/43 and 55.45 sampling is appropriate. ff 21i_
N c. Ensure that K/A importance ratings (except for plant-specific priorities) are at least 2.5. IP iC
- d. Check for duplication and overlap among exam sections.
A e. Check the entire exam for balance of coverage. 13L.
- - Printed NameISigna,fure Date
- a. Author (-j L / i:
- b. Facility Reviewer (*) A >f.J 1k. it
- c. NRC Chief Examiner (#) 3 RIA.N 0 C*k jfcLLE-12-),/ ( I i/2?//c2
- d. NRC Supervisor ( iPJ .
Note: # Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
Not applicable for NRC-prepared examination outlines Nf -rtfr4u V Vt;vL rL1l U4St priiuid..ii .Jv ..fl-L n I I ES-201, Page 26 of 28
ES2O1 Examination Security Agreement Form SS-2O13
- 1. Pre-Exarninatiort acknowledge that I have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner I understand that am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (eg., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, I am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
- 2. Post-Examination To the best of my knowledge, did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of ..: From the date that I entered into this security agreement until the completon of examination administration, I did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.
PRINTED NAME JOB TITLE / RESPONSIBILITY SIGNATURE (1) DATE SIGNATURE (2) DATE NOTE 1 . .__________ . . , :.. . .
- 2.
- 3. A PM4 t 4.jJAcX., ..-. 7)h7o!z.
5 ..;..,.;.,
- ..,,,i ., .. . .1
. I. . .
6 ..,,,
J!- - -
7 c. . .
, ,: . _ . . , .1* .- / / .
0 S .
- 9. -
l2 _--
12-AFZ ,U))
1 3.j-Lo
- 14. \,-\\ ,,
1 NOTES. /
ES-201. Page 27 of 28
ES-201 Examination Security Agreement Form ES-201-3 I Pre-Examiriation I acknowledge that have acquired specialized knowledge about the NRC licensing examinations scheduled for the week(s) of as of the date of my signature. I agree that I will not knowingly divulge any information about these examinations to any persons who have not been authorized by the NRC chief examiner. I understand that I am not to instruct, evaluate, or provide performance feedback to those applicants scheduled to be administered these licensing examinations from this date until completion of examination administration, except as specifically noted below and authorized by the NRC (e.g., acting as a simulator booth operator or communicator is acceptable if the individual does not select the training content or provide direct or indirect feedback). Furthermore, 1 am aware of the physical security measures and requirements (as documented in the facility licensees procedures) and understand that violation of the conditions of this agreement may result in cancellation of the examinations and/or an enforcement action against me or the facility licensee. I will immediately report to facility management or the NRC chief examiner any indications or suggestions that examination security may have been compromised.
- 2. Post-Examination To the best of my knowledge. I did not divulge to any unauthorized persons any information concerning the NRC licensing examinations administered during the week(s) of From the date that I entered into this security agreement until the completion of examination administration, did not instruct, evaluate, or provide performance feedback to those applicants who were administered these licensing examinations, except as specifically noted below and authorized by the NRC.
PRINTED NAME JOB TITLE I RESPONSIBILITY SIGNATURE (1) DATE SIGNAT!JRE(2) pATE NOTE
- 1. _/_
2 i1/
7 . - 1c L2 :: . 2*i
- 3. c D.e iiai
- 4. Pe L..,-kL 5.____ 4r( fr 1 V-
- 6. I
- 8. 7ZZZ&L f?+/-&t 0
- 9. .
SI,,ci,7 4
12 1/
1O._IKf.________ SL&)
11 12.
13.
14.
15.
NOTES:
ES-201, Page 27 of 28
Bolin, Bob From: Gregitis, James Sent: Tuesday, January 08, 2013 7:10 AM To: Bolin, Bob
Subject:
RE: Brunswick Exam Security closeout I did not divulge any information to unauthorized persons any information concerning the exam.
Jim Gregitis Senior Nuclear Operations Instructor Crystal River Unit 3 352-795-0504 ext. 6004 Duke rEnergy 1
BoNn, Bob From: Lucky, Archie Sent: Monday, January 07, 2013 8:29 AM To: Bolin, Bob
Subject:
RE: Brunswick Exam Security closeout Bob, have not divulged any information to unauthorized persons for any information concerning the Brunswick NRC exam Please sign me off of the security agreement.
Thank you,
/ac, Senior Nuclear Operations Instructor Harris Plant 919-362-3386 VNet 772-3386 Duke røEnergy 1
Bolin, Bob From: Smith, Jeffrey Sent: Monday, January 07, 2013 7:29 AM To: Bolin, Bob
Subject:
RE: Brunswick Exam Security closeout Jeffrey Smith I have not divulged any information to unauthorized persons any information concerning the exam.
1
ES-301 Administrative Topics Outline Form ES-301-1 Facility: Brunswick Date of Examination: December2012 Examination Level: Ro SRO Operating Test Number: FINAL Administrative Topic Type Describe activity to be performed (see Note) Code*
Conduct of Operations R, N Evaluate Status of Operator Licenses COO-i 2.1.4 Knowledge of individual licensed operator responsibilities related to shift staffing, such as medical (RO & SRO) requirements, no-solo operation, maintenance of active license status, IOCFR55, etc.
Conduct of Operations R, N SRO ONLY NRC Event Notification COO-2 2.1.18 Ability to make accurate, clear, and concise logs, records, status boards, and reports.
(SRO Only)
Conduct of Operations R, D RO ONLY Determine Primary Containment Water Level and Evaluate PCPL-A COO-3 2.1.7 Ability to evaluate plant performance and make (RO Only) operational judgments based on operating characteristics, reactor behavior, and instrument interpretation.
Equipment Control R, P RO ONLY Develop a Clearance Boundary- RBCCW Pump 2C (RO) 2.2.13 Knowledge of tagging and clearance procedures Equipment Control R, N SRO ONLY Determine Protected Equipment Actions (SRO) 2.2.14 Knowledge of the process for controlling equipment configuration or status.
Radiation Control R, D Determine Total Dose for ALARA 2.3.7 Ability to comply with radiation work permit (RO & SRO requirements during normal or abnormal conditions Emergency Procedures/Plan SRO Only Determine Offsite Release Rate Per R, D OPEP-03.4. 7 (SRO Only) 2.4.40 Knowledge of SRO responsibilities in Emergency Plan implementation NOTE: All items (5 total) are required for SROs. RO applicants require only 4 items unless they are retaking only the administrative topics, when all 5 are required.
Type Codes & Criteria: (C)ontrol room, (S)imulator, or Class(R)oom (D)irect from bank ( 3 for ROs; <4 for SROs & RO retakes)
(N)ew or (M)odified from bank ( 1)
(P)revious 2 exams ( 1; randomly selected)
Conduct of Operations (COO-I)
Evaluate Status of Operator Licenses R, N K/A 2.1.4 Knowledge of individual licensed operator responsibilities related to shift staffing, such as medical requirements, no-solo operation, maintenance of active license status, 10CFR55, etc.
This is a new JPM that requires the examinee to determine the active/inactive status of licensed operators under different conditions.
Conduct of Operations (COO-2) (SRO Only)
NRC Event Notification R, N 2.1.18 Ability to make accurate, clear, and concise logs, records, status boards, and reports.
This is a new JPM that requires the examinee to determine the tech specs for a safety violation and determine the Reportability of the event.
Conduct of Operations (COO-3) (RO Only)
Determine Primary Containment Water Level and Evaluate PCPL-A R, D 2.1.7 Ability to evaluate plant performance and make operational judgments based on operating characteristics, reactor behavior, and instrument interpretation This is a bank JPM that requires the examinee to primary containment water level and determine if it is in the safe region of PCPL-A. Modified slightly to give the examinees pictures of the instruments instead of a list of the instrument s with their readings.
Equipment Control RO Develop a Clearance Boundary RBCCW Pump 2C
- R, P K/A 2.2.13 Knowledge of tagging and clearance procedures.
This JPM was used on 2010 NRC exam. JPM will require the RO examinee to develop an equipment clearance manually.
Equipment Control SRO Determine Protected Equipment Actions R, N 2.1.14 Knowledge of the process for controlling equipment configuration or status This is a new JPM that will require the SRO to determine technical specifications and the minimum required protected equipment for the control Building Standby Air Compressor.
Radiation Control Determine Total Dose for ALARA R, D K/A 2.3.7 Ability to comply with radiation work permit requirements during normal or abnormal conditions.
This is a bank JPM that will require the examinee to determine the lowest dose path to a work activity and determine if conditions allow waiving of Independent Verification.
Emergency ProcedureslPlan (SRO Only) Determine Offsite Release Rate Per OPEP-03.4.7 R, D K/A 2.4.40 Knowledge of SRO responsibilities in Emergency Plan implementation.
This is a bank JPM that requires the examinee to determine offsite release rates during accident conditions.
ES-301 Control Roomlln-Plant Systems Outline Form ES-301-2 Facility: Brunswick Date of Examination: Dec-12 Exam Level: RO SRO-l SRO-U Operating Test No.: Final Control Room Systems@ (8 for RO); (7 for SRO-l); (2 or 3 for SRO-U, including 1 ESF)
System / JPM Title Type Code* Safety Function
- a. Secure Main Turbine with failure of PCB to open
, A, M 4
- b. Actions for a total loss of TCC S, L, D 8
- c. ManualStartofCREV 5, D, EN 9
- d. Energize 230 KV Bus 6 S D
- e. Suppression Pool Cooling W/ SW release S, A, D 5
- f. RCIC Start WI failure to isolate 5, A, L, D 2
- g. Startup second Reactor Recirc Pump S, M, A 1
- h. (RD Only) Bypass control rod from RWM 5 D 7 In-Plant Systems (3 for RO); (3 for SRO-l); (3 or 2 for SRO-U)
SLC with Demin Water R, D, L, E 2
- j. HCU Accumulator charging scram occurs R D A 1
@ All RO and SRO-l control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.
Type Codes Criteria for RO / SRO-l / SRO-U (A)ltern ate path 4-6 / 4-6 / 2-3 (C)ontrol room (D)irectfrombank (E)mergency or abnormal in-plant 1 / 1 / 1 (EN)gineered safety feature - / - / 1 (control room system)
(L)ow-Power / Shutdown 1 / 1 / 1 (N)ew or (M)odified from bank including 1(A) 2/ 2/ 1 (P)revious 2 exams 3/ 3/ 2 (randomly selected)
(R)CA (S)imulator ES-301, Page 23 of 27
ES-301 Control Room!l n-Plant Systems OutNne Form ES-301-2 Facihty: Brunswick Date of Examination:
Exam Level: RO SRO-I jJ SRO-U U Operating Test No.: FINAL Control Room Systems (8 for RO); (7 for SRO-l); (2 or 3 for SRO-U, including 1 ESF)
System I JPM Title Type Code* Safety Function
- a. Manual APRM OAF Adjustment D S 7 b.
C Nok Oite RU W4 j//tIS/(
- d. 6J re uid TPIIJL a.
- 1tmI /e 1 6
Y U2 p . (see t iiiw 53Oi-3) a g t i2/ 3/i2. 7i- 5 I i
- h. TP/n, 5 (3 for RO) (3 for SRO-4); (3 or 2 for SRO-U)
In-Plant Systems k.
All RO and SRO-I control room (and in-plant) systems must be different and serve different safety functions; all 5 SRO-U systems must serve different safety functions; in-plant systems and functions may overlap those tested in the control room.
Type Codes Criteria for RO / SRO-I I SRO-U (A)lternale path 4-6 / 4-6 / 2-3 (C)ontrol room (D)irectfrom bank 9/ 8) 4 (E)mergency or abnormal in-plant 1 / 1) 1 (EN)gineered safety feature - / - / ;1 (control room system>
(L)ow-Power / Shutdown . 1 / 1 / 1 (N)ew or (M)odified from bank including I (A) 2/ 2/ 1 (P)revious 2 exams 3/ 3I 2 (randomly selected)
(R)CA 1/1/1 (S)irnulator ES-301, Page 23 of 27
Simulator JPMs
- a. Secure Main Turbine with failure of PCB to open (4) 245000 A2.01 Ability to predict impacts of a turbine trip on the Main Turbine Generator and Auxiliary Systems; and based on those predictions, use procedures to correct, control or mitigate consequences of those abnormal conditions.
This is a previously used (NRC Exam in April. 2010) JPM that will require the examinee to shutdown the turbine. As an alternate path one of the PCBs will fail to auto open and the examinee will have to open the PCB manually. Modified to have Lift pumps manually started.
- b. Actions for a total loss of TCC (8) 295018 AA1 .02 Ability to operate system loads as a result of a complete loss of component cooling water This is a banked JPM that will require the examinee to complete the actions lAW the AOP for a total loss of TCC.
- c. Manual Start of CREV (9) (U-SRO) 290003 A4.01 Ability to manually operate and/or monitor in the control room: Intiate I reset system This is a banked JPM that will require the examinee to manually start CREV in the high radiation mode for an inspection test. This is an Engineered Safety System.
- d. Energize 230 kV Bus (6) 262001 A4.01 Ability to manually operate and/or monitor in the control room: All breakers and disconnects (including available switchyard)
This is a banked JPM requiring the student to energize 230 kV Bus 2B in accordance with 20P-50.
- e. Place SPC in service with SW release (5) 219000 A4.01 Ability to operate and/or monitor in the control room: Pumps This is an alternate path JPM from the bank that requires the student to place the B Loop of RHR in Suppression Pool Cooling. As an alternate path the RHR Hx tubes break causing hi conductivity alarms and the RHR pumps trip establishing a release path. The student will isolate the system.
(U-SRO) 295031 EAI .05 Ability to operate and/or monitor the following as they apply to Reactor Low Water Level: Reactor Core Isolation System (plant specific)
This is a banked JPM. Unit has scrammed due to a loss of feedwater; level is below LLI with HPCI under clearance. RCIC is to be started lAW the hard card. Alternate path JPM, RCIC should isolate from the steam line break and actions must be taken to manually isolate.
- g. Startup second Reactor Recirc Pump wI trip of pump(1) (U-SRO) 202001 A4.01 Ability to manually operate and/or monitor in the control room:
Recirculation Pumps This is a modified Alternate path JPM (no longer have MG Sets) that have the examinees preparing to start the second recirc pump. When the pump is started and the discharge valve is being throttled open the only running pump will trip requiring a scram to be inserted.
- h. Bypass control rod from RWM (RO Only) (7) 201006 A2.05 Ability to use procedures to correct or control out of sequence rod movement This is a banked JPM. Modified to a different control rod. A control rod has been inserted to suppress a fuel leak. The student is to bypass the control rod in the RWM sequence.
In-Plant JPMs I. SLC with Demin Water (2) (U-SRO) 295031 EA1 .08 Ability to operate and/or monitor the following as they apply to Reactor Low Water Level: Alternate Injection Systems This is a banked JPM that is performed in the RCA. The control room has directed alternate coolant injection with demin water using the SLC pumps per EOP-01-LEP-01.
- j. HCU Accumulator charging scram occurs (1) (U-SRO) 201001 A2. 10 Ability to (a) predict the impacts of the following on the CR D Hydraulic System ; and (b) based on those predictions, use procedures to correct, control, or mitigate the consequences of those abnormal conditions or operations: tLow HCU accumulator pressure/high level This is a banked JPM that is performed in the RCA. The student will determine that the cause of a control room alarm is low pressure on an HCU and take actions to re-charge the accumulator. While re-charging the accumulator a reactor scram will occur requiring actions to isolate the drain valve on the HCU.
- k. Alignment of RCC Pump from RCC to ADHR Mode (9) 233000 K4.07 Knowledge of Fuel Pool Cooling and Cleanup design features which provide for Supplemental heat removal capability.
This is a new JPM for a new system (ADHR) that was installed in the plant in the last refueling outage. This JPM is performed in the RCA aligning a RCC pump for ADHR operation during a refueling outage (low power).
Simulator JPMs Manual APRM GAF Adjustment 215005 Al .07 Ability to predict and/or monitor changes in parameters associated with operating the APRM system controls, including APRM Gain Adjustment Factors. (30!3.4)
This s a banked Sim JPM. This JPM requires the examinee to adjust APRM I GAF from 1.02 to 1.00 or less.
ES-301 Operating Test Quality Checklist Form ES-301-3 Facility: cz. Date of Examination: Operating Test Number:
Initials
- 1. General Criteria a b*
- a. The operating test conforms with the previously approved outline; changes are consistent with b ,4 1(_.,
sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution).
- b. There is no day-to-day repetition between this and other operating tests to be administered during this examination.
- c. The operating test shall not duplicate items from the applicants audit test(s). (see Section D.1.a.)
- d. Overlap with the written examination and between different parts of the operating test is within acceptable limits.
(4 J 9A
- e. It appears that the operating test will differentiate between competent and less-than-competent applicants at the designated license level.
(Pr
- 2. Walk-Through Criteria
- a. Each .JPM includes the following, as applicable:
- initial conditions initiating cues
- references and tools, including associated procedures
- reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee
- operationally important specific performance criteria that include:
detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important observations to be made by the applicant criteria for successful completion of the task identification of critical steps and their associated performance standards restrictions on the sequence of steps, if applicable
- b. Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-301-1 and 2) have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified on those forms and Form ES-201-2.
- 3. Simulator Criteria -- --
The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES-301-4 and a copy is attached.
Printed Name I Signature Date
- a. Author /
b.
c.
FacilityReviewer(*)
NRC Chief Examiner (#)
At.iO2.ç I1. fA9c<
CAL1..q/
1 ,/ /1-23 -/
it- 1/L
- d. NRC Supervisor )*R-k- epi\J k+/- i /2-l,Z.
NOTE:
- The facility signature is not applicable for NRC-developed tests.
- Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
ES-301, Page 24 of 27
T Lii.cJ<5ftA -L2- rd ieg- etiAiL J7i14 i t l fvq- :Th,1 y 4 ivisie o-t ES3OI Operating Test Quaflty Checklist Form ES-301 -3 Facility; Brunswick Date of Examination; Operating Test Number:
Initials 1, General Criteria a b* cti
- a. The operating test conforms with the previously approved outline; changes are consistent with sampling requirements (e.g., 10 CFR 55.45, operational importance, safety function distribution). *
- b. There is no day-to-day repetition between this and other operating tests to be administered during this examination.
j V
4 jy
- c. The operating test shall not duplicate items from the applicants audit test(s), (see Section D.ta.) tQ vW 4
- d. Overlap with the written examination and between different parts of the operating test is within acceptable limits.
- e. It appears that the operating test will differentiate between competent and less-than-competent j applicants at the designated license level.
- 2. Walk-ThgCrltorla --
- a. Each JPM includes the following, as applicable; initial conditions
- initiating cues
- references and tools, including associated procedures reasonable and validated time limits (average time allowed for completion) and specific designation if deemed to be time-critical by the facility licensee operationally important specific performance criteria that include:
detailed expected actions with exact criteria and nomenclature system response and other examiner cues statements describing important observations to be made by the applicant criteria for successful completion of the task identification of critical steps and their associated performance standards restrictions on the sequence of stfipfi, if applicable
- b. Ensure that any changes from the previously approved systems and administrative walk-through outlines (Forms ES-Wi-i and 2> have not caused the test to deviate from any of the acceptance criteria (e.g., item distribution, bank use, repetition from the last 2 NRC examinations) specified j) iti on those forms and Form ES-201-2.
- 3. SImulator Criteria -.
The associated simulator operating tests (scenario sets) have been reviewed in accordance with Form ES3014 ___,,___.
t L,L L Printed Name I Signature Date
- a. Author
- b. Facility Reviewer() 4- f-s
- c. NRC Chief Examiner () - 12 13/IZ NRC Supervisor l41i FJJ)E /i !12 NOTE: The facility signature is not applicable for NRC-developed tests.
- Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
/J...( &\ ?S i -f ES-301 Page 24 of 27
ES-301 Simulator Scenario Quality Checklist Form ES-301-4 Facility: i Date of Exam:- - Scenario Numbers: /zJ /1/ Operating Test No.:
QUALITATIVE AURIBUTES ktiaIs
- 1. The initial conditions are realistic, in that some equipment and/or instrumentation may be out A) of service, but it does not cue the operators into expected events. ff
- 2. The scenarios consist mostly of related events. (b Il
- 3. Each event description consists of
- the point in the scenario when it is to be initiated
- the malfunction(s) that are entered to initiate the event
- the symptoms/cues that will be visible to the crew
- the expected operator actions (by shift position)
- the event termination point (if applicable)
- 4. No more than one non-mechanistic failure (e.g., pipe break) is incorporated into the scenario without a credible preceding incident such as a seismic event.
jb i,i r
- 5. The events are valid with regard to physics and thermodynamics. IF
- 6. Sequencing and timing of events is reasonable, and allows the examination team to obtain complete evaluation results commensurate with the scenario objectives.
- 7. If time compression techniques are used, the scenario summary clearly so indicates. A I Operators have sufficient time to carry out expected activities without undue time constraints.
Cues are given.
ff
- 8. The simulator modeling is not altered. iT W 7
- 9. The scenarios have been validated. Pursuant to 10 CFR 55.46(d), any open simulator performance deficiencies or deviations from the referenced plant have been evaluated to ensure that functional fidelity is maintained while running the planned scenarios.
- 10. Every operator will be evaluated using at least one new or significantly modified scenario.
All other scenarios have been altered in accordance with Section D.5 of ES-301.
lb L, C
- 11. All individual operator competencies can be evaluated, as verified using Form ES-301 -6 (submit the form along with the simulator scenarios).
- 9) jj ;(
- 12. Each applicant will be significantly involved in the minimum number of transients and events 4j specified on Form ES-301-5 (submit the form with the simulator scenarios). 1
- 13. The level of difficulty is appropriate to support licensing decisions for each crew position. tL tL Target Quantitative Attributes (Per Scenario; See Section D.5.d) Actual Attributes -- -- --
- 1. Total malfunctions (58) 8 7 / 6 / 7 8 ft.b
- 2. Malfunctions after EOP entry (12) 2 2 / 1 / 2 2 0
- 3. Abnormalevents(24) 3 2 / 4 / 3 PD 1 t
- 4. Major transients (12) 2 1 / 2 / 2 2
- 5. EOP5 entered/requiring substantive actions (12) 2 2 / 2 / 2 2 i Ai4
- 6. EOP contingencies requiring substantive actions (02) 0 2 / 1 / 0 2 FL.
- 7. Critical tasks (23) 2 3 / 2 / 2 2 F lit, ES-301, Page 25 of 27
ES-301 Transient and Event Checklist Form ES-301-5 Facility: Brunswick Date of Exam: December 2012 Operating Test No.: Draft A E Scenarios P V P E 3 5 2 4 r M L N CREW CREW CREW CREW I T POSmON POSITION POSmON A C S A B S A B S A B S A B T L A R T 0 R T 0 R T 0 R T 0 M(*
N o c p o C p 0 C p 0 C P ---
T p R IU RX 2b 1 1 10 ROl NOR 1 1 111 I/C 2a, 5 4,6,7a 5 4 4 2 Shawn Zander MAJ 6a, 7 7, 8 4 2 2 1 TS 0 022 RX 2 1 110 R02 NOR 1 i i I/C 3,4,6b 3,5,8a 6 4 4 2 Jeff Wheeler MAJ 6a, 7 7, 8 4 2 2 1 TS 0022 RX 2b 2 3b 3 1 1 0 SRO-I NOR 1 1 2 1 11 I/C 2a,3,4 3,4,5,6 2,3a, 15 4 4 2 Kevin 5,6b 7a,8a 6b,6c Kingston MAJ 6a,7 7, 8 6a 5 2 2 1 TS 2a,4 5 3022 RX 2b 1 1 10 R05 NOR 1 111 I/C 2a, 5 4,6,7a 5 4 4 2 Heather Nemetz MAJ 6a, 7 7, 8 4 2 2 1 TS 0 0 2 2 RX 2 1 1 10 R06 NOR 1 1 1 11 I/C 3,4,6b 3,5,8a 6 4 4 2 Andy McGee MAJ 6a, 7 7, 8 4 2 2 1 TS 0 022 RX 2b 2 2 1 10 SRO-U2 NOR 1 1 2 1 1 1 I/C 2a,3,4 3,4,5,6 I ii 4 4 2 Jake 5,6b 7a,8a I Beamer MAJ 6a,7 7, 8 4 2 2 1 TS 2a,4 5 3 0 2
ES-301 Transient and Event Checklist Form ES-301-5 Facility: Brunswick Date of Exam: December 2012 Operating Test No.: Draft A E Scenarios P V P E 3 5 2 4 T M L N CREW CREW POSITION CREW CREW I T POSfl1ON POSfl1ON POSITION A T S A B S A B S A B S A B L A R T 0 R T R u
0 T 0 R T D Mf*
N o C P 0 C P 0 C P 0 C P s--
T R IU E
RX 2b 1 1 10 R03 NOR 1 1 2 111 I/C 2a,5 46,7a 4, 6 7 4 4 2 Chris Denton MAJ 6a, 7 7, 8 7, 8a 6 2 2 1 TS 0022 RX 2 1 1 10 R04 NOR 1 1 1 11
. I/C 3,4,6b 3,5,8a 6 4 4 2 David Rutland MAJ 6a, 7 7, 8 4 2 2 1 TS 0 0 22 RX 2b 2 2 1 1 0 SRO-U1 NOR 1 1 2 1 1 1 I/C 2a,3,4 3,4,5,6 11 4 4 2 Rob 5,6b 7a,8a Mehs MAJ 6a,7 7, 8 4 2 2 1 TS 2a,4 5 3022 RX 2 1 1 10 RO 7 NOR 1 1 1 1 1 I/C 4, 5 3,5,7a 6 4 4 2 Mike Maricle MAJ 6a 7, 8a 3 2 2 1 TS 0022 RX 3b 1 1 10 R08 NOR 1 1 1 11 I/C 2,3a, 4,6 6 4 4 2 Holly 6b,6c West MAJ 6a 7, 8a 3 2 2 1 TS 0022 RX 2 1 1 10 R09 NOR 1 1 1 11 I/C 4, 5 3,5,7a 6 4 4 2 Tom Baker MAJ 6a 7, 8a 3 2 2 1 TS 0 022
Instructions:
- 1. Check the applicant level and enter the operating test number and Form ES-D-1 event numbers for each event type; TS are not applicable for RO applicants. ROs must serve in both the at-the-controls (ATC) and balance-of-plant (BOP) positions; Instant SROs must serve in both the SRO and the ATC positions, including at least two instrument or component (I/C) malfunctions and one major transient, in the ATC position. If an Instant SRO additionally serves in the BOP position, one I/C malfunction can be credited toward the two I/C malfunctions required for the ATC position.
- 2. Reactivity manipulations may be conducted under normal or controlled abnormal conditions (refer to Section D.5.d) but must be significant per Section C.2.a of Appendix D. (*) Reactivity and normal evolutions may be replaced with additional instrument or component malfunctions on a 1-for-i basis.
- 3. Whenever practical, both instrument and component malfunctions should be included; only those that require verifiable actions that provide insight to the applicants competence count toward the minimum requirements specified for the applicants license level in the right-hand columns.
ES-301 Competencies Checklist Form ES-301 -6 Facility: Brunswick Date of Examination: December 2012 Operating Test No. :Draft APPLICANTS RO-1 RO-2 RO-3 RO-4 Shawn Zander Jeff Wheeler Chris Denton David Rutland Competencies CNAO Sg.NIJO_ CAO_ AO_
Interpret/Diagnose 2a,2b 1,4, 1,3, 2,3, 2a,2b 1,4, 1,4, 1,3, 2,3, 5,6a, 6,7, 4,6a, 5,7, 5,6a, 6,7, 67,8 4,6a, 5,7, Events and 6b,7 7a,8 6b,7 8,8a 6b,7 7a,8 a 6b,7 8,8a Conditions 2a,2b 1,4, 1,3, 2,3, 2a,2b 1,4, 1,4, 1,3, 2,3, Comply With and 5,6a, 6,7, 4,6a, 5,7, 5,6a, 6,7, 67,8 4,6a, 5,7, Use Procedures (1) 6b,7 7a,8 6b,7 8 6b,7 7a,8 a 6b,7 8 2a,2b 1,4, 1,3, 2,3, 2a,2b 1,4, 1,4, 1,3, 2,3, Operate Control 5,6a, 6,7, 4,6a, 5,7, 5,6a, 6,7, 67,8 4,6a, 5,7, Boards(2) 6b,7 6bj 8a 6b,778 a 6b,78a Communicate All All All All All All All All All andlnteract Demonstrate Supervisory Ability (3)
Comply With and Use Tech. Specs. (3) =
= = = = = = = = = = = = =
Notes:
(1) Includes Technical Specification compliance for an RO.
(2) Optional for an SRO-U.
(3) Only applicable to SROs.
Instructions:
Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate even, applicable competency for even, applicant.
ES-301 Competencies Checklist Form ES-301-6 Facility: Brunswick Date of Examination: December 2012 Operating Test No.:Draft APPLICANTS RO-5 RO-6 RO-7 RO-8 Heather Nemetz Andy McGee Mike Maricle Holly West Competencies AO_ SNO_
3 524352435 2 43524 Interpret/Diagnose 2a,2b 1,4,6 1,3,4 2,3,5 1,4,5 2,3,5 2,3a, 1,4,6 5,6a, ,7,7a ,6a,6 ,7,8, 6a, 6d 7,7a, 6a,6b 7,8a Ee 6b 7 8 b,7 8a 8,8a 6c 6d and Conditions Comply With and 2a,2b 1,4,6 1,3,4 2,3,5 1,4,5, 2,3,5 2,3a, 1,4,6 5,6a, ,7,7a ,6a,6 ,7,8 6a,6d 7,7a, 6a,6b 7,8a Use Pr 0 c e d u r es 1 6b 7 8 b,7 8,8a 6c 6d Operate Control 2a,2b 1,4,6 1,3,4 2,3,5 1,4,5, 2,3,5 2,3a, 1,4,6 5,6a, ,7,7a ,6a,6 ,7,8, 6a,6d 7,7a, 6a,6b 7,8a Boards 2 / 6b,7 ,8 b,7 8a 8,8a 6c,6d Communicate All All All All All All All All and Interact Demonstrate Supervisory Ability (3)
Comply With and Use Tech. Specs. (3)
Notes:
(1) Includes Technical Specification compliance for an RO.
(2) Optional for an SRO-U.
(3) Only applicable to SROs.
Instructions:
Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate ever, applicable competency for every applicant.
ES-301 Competencies Checklist Form ES-301-6 Facility: Brunswick Date of Examination: December 2012 Operating Test No.:Draft APPLI CANTS RO-9 SRO-l SRO-U 1 SRO-U 2 Tom Baker Kevin Kingston Rob Mehs Jake Beamer Corn petencies SNI9 SNO_ ScgNO_
-- -------- -p-- --
Interpret/Diagnose 1,4,5 2,3,5 2a, 1,2,3 2,3a, 2a, 1,2,3 2a, 1,2,3 6a,6d 7,7a, 2b,3, 4,5,6 6a,6b 2b,3, 4,5,6 2b,3, 4,5,6 Events 8,8a 4,5, 7,7a, 6c,6d 4,5, 7,7a, 4,5, 7,7a, and Conditions 6a, 8,8a 6a, 8,8a 6a, 8,8a 6b,7 6b,7 6b,7 Comply VIith and 1,4,5, 2,3,5 2a, 1,2,3 2,3a, 2a, 1,2,3 2a, 1,2,3 6a,6d 7,7a, 2b,3, 4,5,6 6a,6b 2b,3, 4,5,6 2b,3, 4,5,6 Use Procedures (1) 8,8a 4,5, 7,7a, 6c,6d 4,5, 7,7a, 4,5, 7,7a, 6a, 8,8a 6a, 8,8a 6a, 8,8a 6b,7 6b,7 6b,7 Operate Control 1,4,5, 2,3,5 2,3a, 6a,6d 7,7a, 6a,6b Boards(2) 8,8a6c,6d Communicate All All All All All All All All All andlnteract Demonstrate All All All All All All Supervisory Ability (3)
Comply With and 2a, 4 5 2a, 4 5 2a, 4 5 Use Tech. Specs. (3) = = = = = = =
= = = = =
Notes:
(1) Includes Technical Specification compliance for an RO.
(2) Optional for an SRO-U.
(3) Only applicable to SROs.
Instructions:
Check the applicants license type and enter one or more event numbers that will allow the examiners to evaluate eve,y applicable competency for every applicant.
ES-401, Rev. 9 BWR Examination Outline Form ES-401-1 Facility 4SWL.I( Date of Exam: 2012, RO KIA Category Points SRO-Only Points Tier Group 1< KIK K K K AA A A G A2 G* Total 1 213 4 5 6 1j2 3 4
- Total
- 1. f i 3 3 7 Emergency&
Abnormal Plant r
__2 T T i
N!A 1 1 NIA 1 7 2 1 3 Evolutions 6 27 6 4 10 Tier Totals 1 23232223223 26 3 2 5
- 2. 1 21 11 1 II 1 1 1 12 0 2 1 3 Plant - - -
Systems 38 5 3 8 Tier Totals
- 3. Generic Knowledge and Abilities 1 2 3 4 10 1 2 3 4 7 categones 3 3 2 2 1 2 2 2
- 1. Ensure that at least two topics from every applicable KIA category are sampled within each tier of the RO and SRO-only outlines (i.e., except for one category in TierS of the SRO-only outline, the Tier Totals in each KJA category shall not be less than two).
- 2. The point total for each group and tier in the proposed outline must match that specified in the table.
The final point total for each group and tier may deviate by +/-1 from that specified in the table based on NRC revisions. The final RO exam must total 75 points and the SRO-only exam must total 25 points.
- 3. Systemslevolutions within each group are identified on the associated outline; systems or evolutions that do not apply at the facility should be deleted and justified; operationally important, site-specific systems that are not included on the outline should be added. Refer to ES-401, Attachment 2, for guidance regarding the elimination of inappropriate IVA statements.
- 4. Select topics from as many systems and evolutions as possible; sample every system or evolution in the group before selecting a second topic for any system or evolution.
- 5. Absent a plant-specific priority, only those K!As having an importance rating (lR) of 2.5 or higher shall be selected. Use the RO and SRO ratings for the RO and SRO-only portions, respectively.
- 6. Select SRO topics for Tiers I and 2 from the shaded systems and KIA categories.
7* *.r generic (G) K!As in Tiers I and 2 shall be selected from Section 2 of the K/A Catalog, but the topics must be relevant to the applicable evolution or system.
- 8. On the following pages, enter the KIA numbers, a brief description of each topic, the topics importance ratings (IRs) for the applicable license level, and the point totals (#) for each system and category. Enter the group and tier totals for each category in the table above; if fuel handling equipment is sampled in other than Category A2 or G* on the SRO-only exam, enter it on the left side of Column A2 for Tier 2, Group 2 (Note
- 1 does not apply). Use duplicate pages for RO and SRO-only exams.
- 9. For Tier 3, select topics from Section 2 of the K/A catalog, and enter the K/A numbers, descriptions, IRs, and point totals (#) on Form ES-401-3. Limit SRO selections to K/As that are linked to 10 CFR 55.43.
ES-401 2 Form ES-401-1 ES-401 BWR Examination Outline Form ES-401-1 Emergency and Abnom,aI Plant Evolutions Tier 1/Group 1 (RO / SRO)
=
E/APE # / Name / Safety Function K K K A A G K/A Topic(s) lR #
12312 295001 Partial or Complete Loss of Forced R.. Cl?) c . 2. ii Core Flow Circulation / 1 & 4 295003 Partial or Complete Loss of AC! 6 ) /cA .01 295004 Partial or Total Loss of DC Pwr / 6 0 (R) A Al o; 2, I, 2-3 295005 Main Turbine Generator Trip / 3 (P.) A 04 l f [0 Al)! ! (4 I 295006 SCRAM /1 7 1) f I 0 L- ,
295016 Control Room Abandonment / 7 t) A 1< 3o I 295018 Partial or Total Loss of CCW/8 (Pt) AA 1.0 1 295019 Partial or Total Loss of Inst. Air / 8 rS I Z.) 2. 1. I () D 2.
295021 Loss of Shutdown Cooling /4 R (R) AA . 04 295023 Refueling Acc / 8 (R) A 1< 3, 0 2_
295024 High Drywell Pressure /5 (R> E c, L4 295o25HighReactorPressure/3 R E (.) A1.S, ()A2.o3 295026 Suppression Pool High Water Temp/S s.) -)
F.oDl 295027 High Containment Temperature / 5 295028 High Drywell Temperature! 5 (ER> E Ri 295030 Low Suppression Pool Wtr Lvl / 5 R A 1.. D 29503 1 Reactor Low Water Level / 2 R. (g) E j / o 295037 SCRAM Condition Present and Reactor PowerAbove APRM Downscale or Unknown / 1 r (LN) ER i .
() 9A 2, 295038 High Off-site Release Rate / 9 R . DL9 600000 Plant Fire On Site / 8 1j) A A 2. I 0 () A A .
700000GeneratorVoltageandElectricGrid 4 (f) (Ø)2.2.4Z K/ACategoryTotals: RD 4 3 3 3i4 3 Group PointTotal: 20/7 5rO Zf
ES-401, REV 9 TIGI BWR EXAMINATION OUTLINE FORM ES-401-1 KA NAME I SAFETY FUNCTION: JR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 295003AA2.01 Partial or Complete Loss of AC / 6 3.4 3.7 LI LI LI LI LI LI LI LI LI LI Cause of partial or complete loss of A.C. power 295004Ak1.03 Partial or Total Loss of DC Pwr/ 6 3.4 3.6 LI LI LI 1 LI El LI El A.C. electrical distribution 295005AK2.04 Main Turbine Generator Trip / 3 3.3 3.3 LI Eli LI. LI LI LI LI. LI. LILI Main generator protection Shutdown margin 295006AK1.02 SCRAM / 1 3.4 3.7 LI LI LI LI LI LI LI LI LI LI 295016AK3.01 Control Room Abandonment / 7 4.1 4.2 LI LI LI LI LI LI LI LI LI LI Reactor SCRAM LI fl LI LI Backup systems 29501 8AA1 .01 Partial or Total Loss of CCW / 8 3.3 3.4 LI LI LI LI LI El 295019G2.1.32 Partial or Total Loss of Inst. Air! 8 3.8 4.0 fl LI LI LI LI LI i Ability to explain and apply all system limits and precautions.
LI El Reactor water temperature 295021A42.04 Loss of Shutdown Cooling / 4 3.6 3.6 El LI LI LI El LI LI 4-S 295023AK3.02 Refueling Acc Geet -Me / 8 3.4 3.8 LILILILLILILILILILI Interlocks associated with fuel handling equipment....
LI LI LI LI LI LI LI LI Emergency depressurization 2950246K3.04 High Drywell Pressure / 5 3.7 4.1 LI LI RCIC: Plant-Specific 295025EA1 .05 High Reactor Pressure / 3 3.7 3.7 LI LI LI LI LI LI Eli El El Page 1 of 2 2/15/2012 5:58AM
ES-401, REV9 TIGI BWR EXAMINATION OUTLINE FORM ES-401-1 KA NAME / SAFETY FUNCTION: IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 295026EK2.01 Suppression Pool High Water Temp.! 3.9 4.0 LI LI LI LI LI LI LI LI LI LI Suppression pool cooling 5
295028EK1.02 High Drywell Temperature / 5 2.9 3.1 Equipment environmental qualification 295030EA2.02 Low Suppression Pool Wtr LVI! 5 3.9 3.9 Suppression pool temperature 295031 EK1.02 Reactor Low Water Level /2 3.8 4.1 Natural circulation: Plant-Specific 295037EK1 .01 SCRAM Condition Present and Power 4.1 4.3 Reactor pressure effects on reactor power Above APRM Downscale or Unknown
/1 295038EK2.06 High Off-site Release Rate / 9 Process liquid radiation monitoring system 600000AA2.10 Plant Fire On Site! 8 2.9 3.1 DDE EDDL1DD Time limit of long-term-breathing air system for control room 70000002.4.30 Generator Voltage and Electric Grid 2.7 4.1 DZDEDDDDD. Knowledge of events related to system operations/status Distrurbancecs that must be reported to internal orginizations or outside agencies.
29500102.2.22 4.7 DEE E1ED Knowledge of limiting conditions for operations and safety Partial or Complete Loss of Forced 4.0 ED limits.
Core Flow Circulation 11 & 4 Page 2 of 2 2/15/2012 6:04AM
ES-401, REV9 SRO TIGI BWR EXAMINATION OUTLINE FORM ES-401-1 KA NAME I SAFETY FUNCTION: IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 295004G2.1 .23 Partial or Total Loss of DC Pwr / 6 4.3 4.4 LI LI LI LI LI LI LI LI LI LI Ability to perform specific system and integrated plant procedures during all modes of plant operation.
295006G2.1.25 SCRAM / 1 4.2 3.9 LILILILILILILILILILI Ability to interpret reference materials such as graphs, monographs and tables which contain performance data.
295019AA2.02 Partial or Total Loss of Inst. Air /8 3.6 LILILILILILILILILILI Status of safety-related instrument air system loads (see AK2.1 -AK2.19) 295025EA2.03 High Reactor Pressure / 3 3.9 4.1 LILILILILILILILILILI Suppression pool temperature 295037EA2.05 SCRAM Condition Present and Power Control rod position 4.2 LILILILILILILILILILI Above APRM Downscale or Unknown /
Q 6OOOOOA2.15 Plant Fire On Site / 8 2.3 3.5 LILILILILILILILILILI Requirements for establishing a fire watch 700000G2.2.42 Generator Voltage and Electric Gild 3.9 4.6 LILILILILILILILILILI Ability to recognize system parameters that are entry-level conditions for Technical Specifications Distrurbancecs Page 1 of 1 2/15/2012 608AM
ES-401 3 Form ES-401-1 ES-401 BWR Examination Outline Form ES-401-1 Emergency and Abnormal_Plant Evolutions Tier 1/Group 2 (RO / SRO)
E/APE # / Name / Safety Function K K K A A G K/A Topic(s) IR #
12312 295002 Loss of Main Condenser Vac /3 (1 2 4.
295007 High Reactor Pressure / 3 295008 High Reactor Water Level / 2 295009 Low Reactor Water Level / 2 (1) AA 2 295010 High Drywell Pressure / 5
) A 1K 3 2. I, 2.0 295011 High Containment Temp /5 295012 High DrywellTemperature/5 295013 High Suppression Pool Temp. I5 295014 Inadvertent Reactivity Addition /1 295015 Incomplete SCRAM / I 295017 High Off-site Release Rate /9 ) A 1<
295020 Inadvertent Cont. Isolation /5&7 295022 Loss of CRD Pumps / 1 R. (P. i A K) 295029 High Suppression Pool Wtr Lvl /5 A 1 04 295032 High Secondary Containment Area Temperature /5 I 0 I 295033 High Secondary Containment Area Radiation Levels / 9 4 f
- l. )
A i-(
295034 Secondary Containment Ventilation High Radiation / 9 295035 Secondary Containment High Differential Pressure) 5 295036 Secondary Containment High Sump/Area Water Level / 5 500000 High CTMT Hydrogen Conc. /5
- 2. 2f K/A Category Point Totals: R.0 S go III 11 Group Point Total:
ES-401, REV 9 TIG2 BWR EXAMINATION OUTLINE FORM ES-401-1 KA NAME I SAFETY FUNCTION: IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 295002G2.4.45 Loss of Main Condenser Vac / 3 4.1 4.3 Ability to prioritize and interpret the significance of each 31 annunciator or alarm.
295009AA2.02 Low Reactor Water Level / 2 3.6 3.7 Steam flowlfeed flow mismatch 4L 295010AK1 .03 High Drywefi Pressure / 5 3.2 3.4
.jLJj Temperature increases 29501 7AK2.08 High Off-site Release Rate / 9 2.8 3.3 SPDS/ERISICRIDS/GDS 295022AK1.02 Loss of CRD Pumps/i 3.6 3.7 E,EE.ED.EEL1D Reactivity control 295029EA1.04 High Suppression Pool Wtr Lvl / 5 3.4 3.5 RCIC: Plant-Specific 295032EK3.01 High Secondary Containment Area 3.5 3.8 Emergency/normal depressurization Temperature / 5 Page 1 of 1 2/15/2012 6:06AM
ES-401, REV 9 SRO TIG2 BWR EXAMINATION OUTLINE FORM ES-401-1 KA NAME I SAFETY FUNCTION: IR KI K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 295010G2.1 .20 4.6 Ability to execute procedure steps.
High Drywell Pressure / 5 4.6 E 295033EA2.03 High Secondary Containment Area 3.7 4.2 E Cause of high area radiation Radiation Levels /
500000EA2.01 3.1 3.5 Hydrogen monitoring system availability High CTMT Hydrogen Conc. 1 5 E
- 9)
Page 1 of 1 2/15/2012 6:09AM
ES-401 4 Form ES-401-1 ES-401 BWR Examination Outline Form ES-401-1 Plant Systems Tier 2/Group 1 (RO I SRO)
System # / Name K K K K K K A A A A G K/A Topic(s) lR #
1234561234 203000 RHRILPCI: Injection Mode E) 2. o t 205000 Shutdown Cooling A ( ID , Ig) AZ 12 206000 HPCI R to 207000 Isolation (Emprgency)
Condenser C k/4) 209001 LPCS (R) R4o ,
209002 HPCS 211000SLC (I R6jZ 212000RPS . -) A4D4 215003 IRM (R) , () i.o 215004 Source Range Monitor 4 o.._,
215005 APRM/LPRM P (\3, e 217000 RCIC 218000 ADS 1& () 2,4,20 ()
223002 PCIS/Nuclear Steam I)
Supply Shutoff /
239002SRVs R G 2-4-2 ,,
259002 Reactor Water Level Control () A3)O 261000SGTS R () fr1,03 ,(R)4)A2Q3 262001 AC Electrical ,
\ I Distribution js 0 262002 UPS (AC/DC)
) 4 p.
263000DCElectrical 264000 EDGs iJ,) 5lO5 300000 Instrument Air R. cg) 2, Z. 3 400000 Component Cooling R ft K/A Category Point Totals: f RD I2 31 2 I. i3 3] Group Point Total: 26/5
- 3
ES-401, REV9 T2GI BWR EXAMINATION OUTLINE FORM ES-401-1 KA NAME / SAFETY FUNCTION: IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 203000K2.O1 RHRILPCI: Injection Mode 3.5 3.5 El [] El El El El El El El El El Pumps 205000A11O Shutdown Cooling 30 2.9 El El El El El El ] El El El El Throttle valve position Q
205000A212 Shutdown Cooling 2.9 3.0 El El El El .El El El El El El Inadequate system flow c*4 206000K6.10 HPCI 3.8 4 jJ PCIS: BWR-2,3,4 209001K4.08 LPCS 3.8 4.0 Automatic system initiation 21 1000K5.02 SLC 2.8 3.0 Chugging (as it pertains to boron mixing) 212000A4.04 RPS 3.9 39 Bypass SCRAM instrument volume high level SCRAM signal 215003K4.04 IRM 2.9 2.9 Varying system sensitMty levels using range switches 215004A4.03 Source Range Monitor 2.9 2.7 CRT displays: Plant-Specific 215005A3.04 APRM I LPRM 3.2 3.2 El Annunciator and alarm signals 217000K3.O1 RCIC 3.7 3.7 Reactor water level Page 1 of 3 2/15/2012 6:06AM
ES-401, REV 9 T2GI BWR EXAMINATION OUTLINE FORM ES-401-1 KA NAME I SAFETY FUNCTION: IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 218000G2.4.20 ADS 3.8 4.3 El Knowledge of operational implications of EOP warnings, cautions and notes.
223002K1.07 Reactor core isolation cooHng; Plant-Specific PCIS/Nuclear Steam Supply Shutoff 3.4 3.6 El El El ElEl El El El El El 239002G2.4.2 SRVs 4.5 4.6 El El El fl El El El El El El Knowledge of system set points, interlocks and automatic actions associated with EOP entry conditions.
239002K3.01 5RV5 3.9 4.0 [] [] Reactor pressure control QD 259002A3.1O Reactor Water Level Contrd 3.1 3.0 El El El fl El El El El El El TDRFP lockup: TDRFP Qt21-261000K1.03 SGTS 2.9 3.1 El El El El El El El El El El Suppression pool Radioactive particulatefiltration 261000K4.04 SGTS 2.7 2.9 El El El [] El El El El El El El 262001K2.O1 AC Electrical Distribution 3.3 3.6 El {j El El El El El El El El El Off-site sources of power 262002A2.02 UPS (AC/DC) 2.5 2.7 El El El El El El El El El El Over voltage 263000A1.O1 DC Electrical Distribution 2.5 2.8 El El El El El El El El El El Battery charging/discharging rate El El El Opening normal and/or alternate power to emergency bus 264000A2.06 EDGs 3.4 34 El El El El El El El Qt Page 2 of 3 2/15/2012 6:07AM
ES-401, REV 9 T2GI BWR EXAMINATION OUTLINE FORM ES-401-1 KA NAME I SAFETY FUNCTION: IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 C TOPIC:
RO SRO 264000K5.05 EDGs 3.4 3.4 Paralleling AC. power sources 3t:
3OOOOOG2259 Instrument Air ,S 5 Knowledge.ofiess than one hour technicaLspecification 4 i4 action statements forsystems. /1 /,
. 1 ?
2,4 v
,. )
400000K2.02 Component Cooling Water 2.9 2.9 CCW valves
/.
400000K6.07 Component Cooling Water 2.7 2.8 Breakers, relays, and disconnects 3
Q Page 3 of 3 2/15/2012 6:07AM
ES-401, REV 9 SRO T2GI BWR EXAMINATION OUTLINE FORM ES-401-1 KA NAME I SAFETY FUNCTION: IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 20900 lG2t2r LPCS ElElElEl El El El El El El l VnowIedge.of.s-ystem-purpos andorJunction.
)
i7 1
)
/ - .
_1,
(, fL-.:
215003A2.01 IRM 2.8 3.2 El El El El El El El ] El El El Power supply degraded 218000A2.05 ADS 3.4 3.6 El [j Loss of A.C. or D.C. power to ADS valves 261000A2.03 SGTS 2.9 3.2 El El El El El El El El El El High train temperature (g(
263000G2.445 DC Electrical Distribution 4.1 4.3 ElElElElEEElEElEl Ability to prioritize and interpret the significance of each annunciator or alarm.
Page 1 of 1 2/15/2012 6:09AM
ES-401 5 Form ES-401-1 ES-401 BWR Examination Outline Form ES-401-1 Plant Systems- Thr 2/GroE2O / SRO)
System#IName K K K K K K A A A A G KIATopic(s) IR 4 123456 12 34 201001 CRD Hydraulic R g) 4 201002 RMCS 201003 Control Rod and Drive Mechanism 201004 RSCS 201005 RCIS 201006 RWM 202001 Recirculation 202002 Recirculation Flow Control 204000 RWCU 214000 RPIS 21 5001 Traversing In-core Probe g\4 I 01 215002 RBM A. 2j 216000 Nuclear Boiler Inst.
219000 RHR/LPCI: Torus/Pool Cooling
() A4- t2 223001 Primary CTMT and Aux.
226001 RHR/LPCI: CTMT Spray Mode (-) /I4.o 230000 RHR/LPCI: Torus/Pool Spray
() 43 o4-233000 Fuel Pool Cooling/Cleanup 234000 Fuel Handling Equipment 239001 Main and Reheat Steam R () 2 i< 0 239003 MSIV Leakage Control 241000 Reactor/Turbine Pressure Regulator 2 4- ,
245000 Main Turbine Gen. / Aux. R (R) A 09 256000 Reactor Condensate ( (p 14 259001 Reactor Feedwater 268000 Radwaste 27l0000ffgas (R) tH kI , ()4? 04 272000 Radiation Monitoring (g) R2 03 286000 Fire Protection 288000 Plant Ventilation CR) t UI 290001 Secondary CTMT (Q) ,t 290003 Control Room HVAC 290002 Reactor Vessel Internals KIA Category Point Totals: LI2 ..L I. L I I 1. LI LI LI Group Point Total: 12/3
ES-401, REV9 T2G2 BWR EXAMINATION OUTLINE FORM ES-401-1 KA NAME / SAFETY FUNCTION: IR Kl K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 201003G2.4.50 Control Rod and Drive Mechanism 4.2 4.0 fl E LI LI LI LI LI Ability to verify system alarm setpoints and operate controls identified in the alarm response manual.
215001A1.01 Traversing In-core Probe 2.8 2.9 LI LI LI LI LI LI LI LI LI LI Radiation levels: (Not-BWR1) 219000A4.12 RHR/LPCI: Torus/Pool Cooling Mode 4.1 4.1 LI LI LI E] E] LI LI [1 LI Suppression pool temperature Qic 226001K4.01 Testability of all operable components RHRILPCI: CTMT Spray Mode 2.6 2.8 LI LI LI LI LI LI LI 4V7 230000K3.04 RHRJLPCI: Torus/Pool Spray Mode 3.7 3.8 fl El LI LI LI LI LI LI Suppression chamber air temperature 239001 K2.01 Main and Reheat Steam 3.2 3.3 LILILIELILIELILILI Main steam isolation valve solenoids 245000A2.09 Main Turbine Gen. / Aux. 2.5 2.8 LILILIELILILILILI Turbine vibration 256000K6.09 Reactor Condensate 2.6 2.6 fl, LI. [El El LI 1 Offgas system 271000K1.11 Offgas 3.1 3.6 1 fl LI LI LI LI LI LI fl fl Station radioactive release rate QZ 272000K2.03 Radiation Monitoring 2.5 2.8 LI LI LI LI LI LI LI LI LI LI Stack gas radiation monitoring system LI LI LI LI LI LI Airborne contamination contrc 288000K5.01 Plant Ventilation 3.1 3.2 LI LI LI LI Page 1 of 2 2/15/2012 6:07AM
ES-401, REV 9 T2G2 BWR EXAMINATION OUTLINE FORM ES-401-1 KA NAME / SAFETY FUNCTION: IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 290001A3.02 Secondary CTMT 3.5 3.5 El J LI LI Normal building differential pressure: Plant-Specific E
Page 2 of 2 2/15/2012 6:07 AM
ES-401, REV 9 SRO T2G2 BWR EXAMINATION OUTLINE FORM ES-401-1 KA NAME / SAFETY FUNCTION: IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO 215002A2.O1 RBM 3.3 3.5 Withdrawal of control rod in high power region of core:
BWR-3,4,5 241000G24.9 Reactor/Turbine Pressure Regulator 3.8 4.2 E D El El Knowledge of low power / shutdown implications in accident (e.g. LOCA or loss of RHR) mitigation strategies.
271000A2.04 Offgas 3.7 4.1 Offgas system high radiation Page 1 of 1 2/15/2012 6:10AM
ES-401 Generic Knowledge and Abilities Outline (Tier 3) Form ES-401-3 Facility: R1&NSWLCR Date of Exam: IECEME 2012..
Category K/A # Topic RO SRO-Only IR IR 2.1. (R) ezi 1.
2.1.32 1R cç 2.1.32 Conduct 2.1.44 (k) 2. i.4+
of Operations 2.1.
2.1.4 2/.4-2.1.
Subtotal 2.2. 2 12. 20 2.2.35
- 2. 2.2.42 (1?) c 2, 2.4-2 Equipment Control 2.2.
2.2.) ()2,2l 2.2.3 )2.2.3g Subtotal 3 2 2.3.11 R) z..ii 2.3. 13 (I?) 31
- 3. 2.3.
Radiation Control 2.3. Crc) 2. 3 2.3.
2.3.
Subtotal 2.4.I (P) (24.I
- 4. 2.4.2s () c2,4.2 Emergency 2.4.
Procedures /
Plan 2.4. 3 ) 4g3 2.4.40 ($) , 4, 41) 2.4.
Subtotal Tier3PointTotal 10 10 7 7
ES-401, REV9 T3 BWR EXAMINATION OUTLINE FORM ES-401-1 KA NAME / SAFETY FUNCTION: IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO G2.1.32 ] Ability to explain and apply all system limits and Conduct of operations 3.8 4.0 LI El El El El [] []
precautions.
G2.1.44 Knowledge of RO duties in the control room during fuel Conduct of operations 3.9 3.8 El El El El El El El El El El handling.
G2.1.5 Conduct of operations 2.9 3.9 El El El El El El [] El El El ] Ability to locate and use procedures related to shift staffing, such as minimum crew complement, overtime limitations, etc.
G2.2.20 Equipment Control 2.6 3.8 El El El El El El El El El El ] Knowledge of the process for managing troubleshooting L 2 activities.
G2.2.35 Equipment Control 3.6 4.5 El El El El El El El El El El Ability to determine Technical Specification Mode of Operation G2.2.42 Equipment Control 3.9 4.6 El El El El El El El El El Ability to recognize system parameters that are entry-level conditions for Technical Specifications G2.3.1 1 Radiation Control 3.8 4.3 El El El El El El El El ] Ability to control radiation releases.
Qw7-G231 3 Radiation Control 3.4 3.8 El El El El El El El El El El Knowledge of radiological safety procedures pertaining to licensed operator duties G2.4.19 Emergency Procedures/Plans 3.4 4.1 El El El El El El El El El El Knowledge of EOP layout, symbols and icons.
Knowledge of fire protection procedures.
G2.4.25 Emergency Procedures/Plans 3.3 3.7 El El El El El El El El El :
Page 1 of 1 2115/2012 6:08AM
ES-401, REV 9 SRO T3 BWR EXAMINATION OUTLINE FORM ES-401-1 KA NAME / SAFETY FUNCTION: IR Ki K2 K3 K4 K5 K6 Al A2 A3 A4 G TOPIC:
RO SRO G2.l.42 Conduct of operations 2.5 3.4 E Knowledge of new and spent fuel movement procedures G2.2.19 Equipment Control 2.3 3.4 E E E j Knowledge of maintenance work order requirements.
G2238 Equipment Control 3.6 4.5 t Knowledge of conditions and limitations in the facility license.
G2.3.5 Radiation Control 2.9 2.9 E D j Ability to use radiation monitoring systems G2.3.6 Radiation Control 2.0 3.8 Ability to aprove release permits Q4q G2.4.3 Emergency Procedures/Plans 3.7 3.9 Ability to identify post-accident instrumentation.
c9 G2.4.40 Emergency Procedures/Plans 2.7 4.5 Knowledge of the SROs responsibilities in emergency plan implementation.
Q-iOO Page 1 of 1 2/15/2012 6:12AM
ES-401 Record of Rejected K/As Form ES-401-4 Tier I Randomly Reason for Rejection Group Selected K/A RO T2G1 300000G2.02.39 There are no one hour TS associated with instrument air 3/5/12 CE provided replacement K/A of G202.44 SROT2G1 209001 G201 .27 Cannot write an SRO knowledge question to this KA 3/5/12 CE provided replacement K/A of 209001 G2.01.07 RO T2G1 21 8000G2.04.20 Brunswick does not have any EOP Cautions/Notes/Warnings associated with ADS 4/18/12 CE provided replacement K/A of 218000 G2.04.50 ES-401, Page 27 of 33
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: i, . ,.. . Date of Exam: U.. 2.. Exam Level: R0SRO Initial Item Description a b* c 1 Questions and answers are technically accurate and applicable to the facility. I
- 2. a. NRC KJAs are referenced for all questions, I
- b. Facility learning objectives are referenced as available. ,
, 7L.
were repeated from the last 2 NRC licensing exams, consult the NRR OL program office). *
- 5. Question duplication from the license screening/audit exam was controlled as indicated below (check the item that applies) and appears appropriate:
the audit exam was systematically and randomly developed; or the audit exam was completed before the license exam was started; or .,
the examinations were developed independently; or the licensee certifies that there is no duplication; or other (explain)
- 6. Bank use meets limits (no more than 75 percent Bank Modified New from the bank, at least 10 percent new, and the rest 2 f9i.
new or modified); enter the actual RO I SRO-only 333%/ 40% 253% 20% 41 3% 40%
/
question distribution(s) at right.
- 7. Between 50 and 60 percent of the questions on the RO Memory CIA exam are written at the comprehension? analysis level; the SRO exam may exceed 60 percent if the randomly /,,, L..
selected K/As support the higher cognitive levels; enter 47% I 8% 53% / 92%
the actual RO I SRO question distribution(s) at right.
- 8. References/handouts provided do not give away answers .: -1?cC or aid In the elimination of distractors. . I
- 9. Question content conforms with specific K/A statements in the previously approved 4 1.fC examination outline and is appropriate for the tier to which they are assigned: ;
deviations are justified.
- 10. Question psychometric quality and format meet the guidelines in ES Appendix B. /
- i
- 11. The exam contains the required number of one-point, multiple choice items:
the total is correct and agrees with the value on the cover sheet,
/h? bL Printed Name / Signature Date
- a. Author . .. \. /C/;
- b. Facility Reviewer (*) .
i.LLJz
)
- c. NRC Chief Examiner Pi,(iO
- d. NRC Regional Supervisor /{44 A-tJ.C /
1 Note: The facility reviewers initials/signature are not applicable for NRCdeveIoped examinations,
- Independent NRC reviewer initial items in Column c; chief examiner concurrence required.
ES-401, Page 29 of 33
ES-401 Written Examination Review Worksheet Form ES-401 -9
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LCD Cred. Partial r
Job- Minutia F
- 1 Back-SRO B/M/N UIE/S Explanation (F/H) (1-5) Stem Cues TIF Q Focus Dist. Linkj unitsj ward K/A Only Gen The short-and-to-the-point explanations of how to arrive at the correct answer for each of the questions was very beneficial.
Form ES-401-6, item 4 states that IF more than four RO and two SRO questions are repeated from the last two NRC exams, (then verify how) the facility licensees sampling process was random and systematic. ES-401, Section D.2.f states that if the bank contains more than one question that fits a specific K/A statement, randomly select from among the available questions.
The folIowigO questions were repeated from recent exams:
(. #29201 0 2 Q#24WW
). Q4(20101 Q#24)
S Q#44(20102 Q# 4
)tJ 45 L* Q#52 (20101 Q#18)
- Q#54 (2008-2, Q#54)
- Q#56 (2008-2, Q#7) ii4;()
- Q#58 (2008-2, Q#57)
.._.. Q#61 (2010-2, Q#62 and 2008-2, Q#61) 1ie following SRO questions were repeated from recent ams.
- Q#81 (2010-2, Q#80) -
1p 1 it vt-.
4 1
- I4fl<
- Q#90 (2010-2, Q#92) (Vi.Of
- Q#97 (2010-2, Q#99) L Based on exceeding the number of repeat RO and SRO questions from the last two exams on Form ES-401-6, Item 4, EITHER
- 1) submit a written description of how the questions were chosen to target the sample plan, including a copy of all questions that were among the sampled population for each selected question. Provide an electronic copy of the entire exam bank that was used for this exam.
- 2) Replace the majority of these repeat questions with new questions (preferred) or significantly modified questions in th 4
(
accordance with ES-401, Section 2.f bullet)
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues TIF Cred. Partial Job- Minutia #1 Back- Q SRO BIM/N UIEIS Explanation Focus Dist. Linki unitsj ward K/A Only RO Fourteen RO test items (18.6%) were PRELIMINARILY determined to be unacceptable lAW NUREG 1021 for the following reasons:
. Cred Dist: Q#s 4, 31, 37, 50, 58, 59, 68, & 70
. K/A mismatch: Q#s 1, 9, & 17 LOD=1:Q#s30,38,&69.
SRO I ii SRO test items (28%) were PRELIMINARILY determined to Y be unacceptable lAW NUREG lO2lfor the following reasons:
. Cred Dist: O#s.84 86, & 94
. SRO-only: Q#s.?& 98
. QK/A: Q#s 82 & 89 Gen All enhancement items should be addressed. We should probably plan on a trip to Atlanta to go through all the fixes. Alternatively, we can do via phone call provided that we both have a hard copy of the fixes to all the questions. Date TBD, but as soon as possible.
Instructions
[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]
- 1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
- 2. Enter the level of difficulty (LOD) of each question using a 1 5 (easy difficult) rating scale (questions in the 2 4 range are acceptable).
- 3. Check the appropriate box if a psychometric flaw is identified:
- The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much needless information).
- The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc).
- The answer choices are a collection of unrelated true/false statements.
- The distractors are not credible; single implausible distractors should be repaired, more than one is unacceptable.
- One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
- 4. Check the appropriate box if a job content error is identified:
- The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content).
- The question requires the recall of knowledge that is too specific for the closed reference test mode (i.e., it is not required to be known from memory).
- The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with question in gallons).
The question requires reverse logic or application compared to the job requirements.
- 5. Check questions that are samqled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
- 6. Enter question source: (B)ank, (M)odifled, or (N)ew. Check that (M)odified questions meet criteria of ES-401 Section D.2.f.
- 7. Based on the reviewers judgment, is the question as written (U)nsatisfactory (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 8. At a minimum, explain any U ratings (e.g., how the Appendix B psychometric attributes are not being met).
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred Partial Job Minutia #1 Back 0 SRO B/M/N U/E/S Explanation Fusjst.jUnkJ_ tswdOy H 2 x x x N U 201001 G2.04.50 1 QK/A: The question (as proposed) tests the applicants knowledge of the Control Rod and Drive Mechanism (System I ct. 4t;- -w 4 201003); whereas the required K/A is for System 201001 (Control Rod Drive HYDRAULIC System). The System 201001 K/As in
- .,k NUREG 1123 (BWR Catalog) deal with the pumps, strainers, valves, etc, whereas the rod
, 03,K103.ganotherquestiontotestan I (LIL L - & alarm setpoint and the required control board operation in one of the urciatoprocedures for ttp1JITps, strainers, valves, etc.
- 2. Cred Dist: The 1 St part of choices C and D (even-numbered reed switch) is not plausible because the rods are all normally positioned at even numbered positions when no demand signal is present.
- 3. #/units: The stem of the question should list the APP in parenthesis beside the name of the annunciator, i.e., ROD DRIFT (A-05, 3-2) and in the 2 d
fill-in-the-blank statement.
2 F 2 M S 203000 K2.01 (NRC EXAM 201 0-2, Q#22)
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK (F/H) (1-5) Stem Cues TIE Cred. Partial Job- Minutia #1 Back- Q= SRO BIMIN UIEIS Explanation Focus Dist. Link units ward K/A Only 3 2 x x N EIU 205000 Ai.l0
/ 1 Cred Dist: Choice A (open F003) is not plausible because when t any heat exchanger outlet valve is opened, there is always
.( . MORE ht reniovall
/
- 2. Cred Dist: Choice B (throttle F047 closed) is not plausible t because the Hx inlet valve has no throttle feature, i.e., it is either full open or full shut. Suggest replacing with Eli -PDV-F068.
L CL{; V. 3. Stem Focus: The stem of the question should include RHRSW Flow rate, RHR Flow rate, and how many RHR pumps are in
- , , service because this info is necessary in order to determine C .-. .. -t which valve to throttle (maintaining certain system mm/max allowable flow rates listed in OP-17, Section 8.12), which affect
- the answer choice. Additionally, this also adds plausibility to incorrect choices.
- 4. Stem Focus: Include the name & number of the procedure section being tested tjQn.&12, Shutdown Cooling Flow Adjustments) in the WOOTF stem question.
- 5. The proposed question is listed as a lower cog question; however, it may actually be a higher cog question. Discuss.
8.
Explanation 4 H 2 x N U 205000 A2.12
- 1. Cred Dist: The 1 part of Choices B & D (cooldown rate is excessive) is not plausible because the stem does not include any information for 1) how many SRVs are open, 2) the current SRV tailpipe temperatures on recorder B21-TR-R614 on Panel H12-P614, and/or 3) whether an RHR pump is running.
- 2. Q=KIA: The proposed question tests the applicants knowledge of a TIER 1 aspect, i.e., the AOPs guidance related to an alternate method of shutdown cooling. The sample plan lists this K/A in TIER 2 (plant systems). The alternate shutdown cooling mitigation strategy is a last effort to provide cooling to the core when all other actions listed in AOP-15 have failed to work. Because the K/A is listed in TIER 2, this is typically not an emergency/abnormal knowledge. Some of the less severe aspects of AOP-1 5 can be tested; however, the alternate shutdown cooling strategy goes well beyond the normal RHR Shutdown Cooling mode of operation.
(Suggest re-writing question to test APP actions associated with\
A-3, 2-9, RHR HX DISCH CLG WTR TEMP HI or A-3-1-9, RHR HX NB INLET WTR TEMP HI. Alternatively, re-write the question to test some of the flow limitations (minimum or
-I ( maximum) listed in OP-17.
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK (F/H) (1-5) Stem Cues T/F Cred. Partial Job- I Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Linkj units ward K/A Only 5 H 3 x x N E 206000 K6.10
- 1. Stem Focus and/or Cue: Its not clear which Div I NUMAC microprocessor units have power supply cabinet (Panel
.. () ... (32A) and/or division number (Div I) may provide an unnecessary cue to t Q Iicans for this question or other questions on the 2 Suggest changing the 1 sentence in the stem to only state DVr which NUMAC microprocessor has lost its power supply, e.g.,
(NUMAC LEAK DETECTION MONITOR B21-XY-5948A.)
Alternatively, remove the electrical panel number from the stem and list the NUMAC unid name/#.
- 2. Stem Focus: The choices can be boiled down to whether or not i .,-.( F002 (or F003) will or will not auto-close. The wording in 4 Choices C and D (area temperature isolation signal is disabled) is not parallel with Choices A and B. Suggest revising choices:
A. NO HPCI Isolation MOV auto-closures will occur B. F002 and F042 immediately auto-close; F003 and F041 remain open C. F003 and F041 immediately auto-close; Ff102 and F042 remain open D. ONLY F003 will immediately auto-close. F002, F041, and F042 remain open.
6 H 2 M S 209001 K4.08 (NRC EXAM 2007, Q#6) 211000 K5.02 7 H 2 N S Note to NRC: In order to hit the K/A (i.e., chugging), Chief Examiner suggested question be written to test the applicants knowledge of how the boron initially accumulates in the bottom head region until water level is restored. Definition of chugging is to move on (as a locomotive would chug along) and this question tests the injection process, including the dispersal process only after water level has been raised.
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
LOK LOD (FIH) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 SRO B/M/N U/E/S Explanation Focus Dist. Link units Only 8 H 2 x x 212000 A4.04 Partial and/or Stem Focus: The stem is missing important information (Has a manual scram been inserted which would cause the SDV to fill? Has a DFWLC setpoint set down occurred? What is RPV level?); therefore, the question (as proposed) would be deleted during the post-exam process. For example, based on the limited information provided in the stem, the applicants could assume that some RPS valid trip signal has occurred, the reactor did not scram, and no further operator actions have been taken.
- 2. Job-Link: At the point in the EOP5 where LEP-02 is implemented, the mode switch would have already been placed in the SHUTDOWN position. An applicant can successfully argue that this question is not operationally valid since the mode switch is still in the RUN position.
Here is another alternative idea with a 2 part added:
Outage maintenance is in progress on 7 hydraulic control units (HCUs) to replace the scram valve diaphrams. The following conditions currently exist:
- Mode switch: REFUEL position, all rods inserted
- Discharge volume isolation test switch: ISOLATE position, under clearance
- Scram discharge volume high level bypass switch:
NORMAL position Due to a clearance error, one of the HCUs begins to slowly fill the discharge volume and the following alarm is received:
SOUTH SDV VOL NOT DRAINED (A-5, 1-1)
The scram discharge volume continues to slowly fill.
Which ONE of the following completes the following statement?
Placing the high level bypass switch in the BYPASS position at this time prevent a scram discharge volume high level trip from occurring. [need another part of the question]
A. will; some other 2' fill-in-the-blank B. will; some other 2 fill-in-the-blank C. will NOT some other 2 fill-in-the-blank D. will NOT, some other 2 d fill-in-the-blank
- 4. Job Content Flaws 5. Other 6. 7. 8.
Job- Minutia #1 Back Q= SRO BIMIN UIEIS Explanation Link units ward K/A Only 9 F 2 B U 215001 A1.01 Q=KIA: The question does not test the applicants ability to predict or monitor rad level changes associated with the operating the TIP controls. Instead, the proposed question tests the applicants knowledge of 001-01.03 administrative requirements associated with drywell entry requirements for the TIP positions. (Difficult K/A to hit)
Suggest modifying the question to test the applicants knowledge that the indexer is located inside the drywell (not in the TIP room) and that the indexer location is typically used for the detectors to decay prior to relocating them inside the TIP room. (done to avoid getting an unnecessary SCCP entry condition). You should verify that the following ARM responses are typical with Rx Engineers or someone knowledgeable of TIP room rad levels before, during, and after TIP scans.[security agreement] The following revision may be a starting point.
All TIPs are currently at the indexer following a full TIP core scan.
WOOTF completes both statements?
The TIP room area rad monitor (1-2 1, U-I Rx Bldg Tip Room Elev. 20 Ft) scale range indication is The current radiation level indication inside the TIP room as seen by the area rad monitor, is as compared to the radiation level with all TIPs at the in-shield position.
A. Ito 10,000 mr/hr; much higher B. I to 10,000 mr/hr; roughly the same C. 0.1 to 1000 mr/hr; much higher D. 0.1 to 1000 mr/hr; roughly the same
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues TIF Cred. Partial Job- Minutia #1 Back- Q= SRO BIM/N tilE/S Explanation Focus Dist. Link units ward K/A Only 10 F 2 x x x B E/U 215003 K4.04 GP-02, Step 5.2.27 was referenced as the basis for this question and this step refers to OMST-IRM25R. IRM Channels Range Correlation Adjustment, which is only required to be performed for an initial startup following a refuel outage, and appears to be performed by another work group. The title of this MST is important for the following comment.
Stem Focus and/or Job-Link: Do the operators perform an IRM range 6/7 overlap verification or do they perform an IRMIAPRM overlap determination? The stem should use the exact same title/number as GP-02 (instead of referring to IRM range 6/7 overlap determination..). The phrase IRM range 6/7 overlap determination appears to be limited to the lesson plan (LOl CLS-LP-009-A, Obj 15e) and may not be the same thing as OMST-IRM25R. Do operators perform the IRM amplifier frequency change verification? The stem should be worded to mirror GP-02, Step 5.2.27.
- 2. Cred Dist: (borderline) The 2 part of Choices A and D (transition from more noise immune to more sensitive operation) is not plausible because an applicant can eliminate both of these choices solely based on knowing that during a startup, the MOST sensitivity is required with very low fission rates.
/uggest re-working the question to test 1) which IRM component varies the sensitivity levels as the range switches are operated (voltage preamplifier vs pulse height discriminator) and 2) WHEN the IRM Channel Range Correlation Adjustment is required to be verified (prior to range 7 (?) vs prior to range 3).
j Does l&C perform OMST-IRM25R exactly at the time when the operator shifts from range 6 to 7? For the purposes of K/A match, the IRM Channel Range Correlation Adjustment can be
\.onsidered a design feature and/or interlock.
- 3. Ensure no overlap w/ SRO Q#78 [215003, A2.01]
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LODr (F/H) I (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- 0= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 11 H 2 x x B E/U 215004 A4.03 QK/A: Need to understand how the applicants ability to operate and/or monitor a CRT display is being tested in this question. Is there a CRT display associated with the SRM5 and IRMs? This K/A is listed in NUREG 1123 (BWR Catalog) as plant specific, which may not apply at Brunswick. IF there are process computer displays associated with the SRM system, then it is appropriate to test the applicants ability to call up or interpret these displays. On the other hand, the SRM recorder displays at P601 may be tested as a CRT display by testing the applicants ability to monitor or operate these recorders.
Otherwise, this K/A may need to be replaced.
C
- 2. Stem Focus and/or Cred Dist: The stem should state the current position of the eight RPS shortingiinks, i.e., installed or removed. This gives plausibility to Choices C and D and also makes these choices wrong.
- 3. Stem Focus: All four choices refer to an alarm. Using the generic term alarm presents two concerns: 1) alarm is subjective and could mean any alarm and2) since all four choices list the alarm, this portion of each choice is not necessary.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD r r (F/H) (1-5) Stem Cues T/F Cred. Partial Job- I Minutia #1 I Back- 0= SRO BIM/N U/E/S Explanation Focus Dist. Link! units! ward K/A Only 12 F 2 x x N E 215005 A3.04 Job-Link: Saying that the quantity of operating LPRM detectors in the flux average instantaneously at 15 may not be operationally valid. Is the 1 sentence describing a situation where the operator has previously bypassed 15 detectors and is in the process of manually bypassing the detector? If this is the situation, then it needs to be described; otherwise; the question may not be operationally valid and the applicants will have questions during the exam. An LPRM failure upscale will cause a higher APRM reading. An LPRM downscale failure will cause the APRM channel to read lower. A drifting LPRM will cause the APRM to read correspondingly higher or lower. Does the APRM auto-bypass LPRMs or is it a MANUAL action? For RBM, if a LPRM detector flux level falls below an automatic bypass set point defined by the user, it is automatically bypassed and removed from the average if it is one of the detectors used. Not sure if this applies to the APRM.
- 2. Cred Dist: Choice A is not plausible because the Rod Out Block annunciator always has a corresponding annunciator that reflects the reason for the Rod Out Block. Listing the Rod Out Block alarm as the only alarm is not plausible.
Suggest testing the applicants knowledge of whether or not the APRM Upscale Trip/mop annunciator will alarm when one more LPRM detector is manually bypassed (total of 16 detectors bypassed; only leaving 15). The additional piece of information that can be tested is whether or not the Rod Out Block annunciator will alarm.
13 H 2 x x E 217000 K3.01 (2007 NRC EXAM, 217000)
Cue and/or Stem Focus: Which DC Switchboard has been lost?
The name of the MCC or 125VDC Distribution Panel should only be provided. This makes the question specific and eliminates the unnecessary cue.
- 2. Cred Dist: Choice A is not plausible because it reflects no impact on RCIC even though the stem question asks for the applicants to identify the impact of the power loss on RCIC.
- 3. The bank designator should be M. (modified bank)
- 4. Ensure no overlap w/ SRO Q#84 (295004 G2.1 .23)
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 14 x N E 218000 G2.4.50
- 1. Cue: The stem tells the applicants that a rapidly lowering water
,..level will cause an auto-start of all low pressure ECCW pumps.
This information could be used for other test items on the exam.
Suggest providing plant parameters (DW pressure, RPV level, RPV pressure, etc.) to require the applicants to deduce whether or not LP ECCS pumps are running.
- 2. Job-Link and/or Stem Focus: The premise of the question appears to be that the crew is waiting to manually ED at the same point in time when the ADS logic would have actuated.
(The failure of control power makes the question confusing.)
This is hardly ever tile case, because the EOPs normally inhibit ADS actuation until some further point beyond which level cannot be maintained. The premise of the question is confusing because it seems to imply that ADS wasnt inhibited earlier and the crew it only attempting to manually actuate the system at the same point in time that it would have auto-actuated. Not sure this is operationally oriented.
- 3. Job-Link: Why does the Auto Depress Relays Energized annunciator immediately clear? Is this normally the case or is this a symptom of the loss of control power?
/ Suggest re-working the question to test the sequence of alarms that are received if ADS auto-actuates, ASSUMING NO OPERATOR ACTION. In other words, test the applicants A
knowledge of the sequence of these alarms due to a slowly falling reactor water level. For example:
fWhich ONE of the following identifies the sequence of
/ annunciators that will alarm before ADS auto-actuates as RPV f level slowly lowers? (Assume no operator action)
A. 4-2, 3-2, 6-9 B. 6-9, 3-2, 4-2 C. 6-9, 4-2, 3-2 4-2, 6-9, 3-2
-N Ccat dv 5/4) vL a&o 11
- cvk4 tvCfr
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues TIF Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 15 H 2 x x x M E 219000A4.12(2010-1 NRC EXAM, Q#53)
- 1. Partial: An applicant can successfully argue that Choice D is also correct since the LOCA signal was spurious. Spurious is subjective. Instead, modify the 1 sentence in the stem to say that a pipe break occurred and the following parameters currently exist:
. Drywell pressure: 3 psig
- RPV water level 50
- RPV pressure 400 psig f\ A
, 4k This way, the applicant will be tested on whether a LOCA signal exists and the subjectivity of the word spurious is avoided.
- 2. #/units: The exact name of the override sjfchs?) should be included in the fill-in-the-blank statement. Suggest splitting the fill-in-the-blank statement into two sentences, and the 2 fill-in-the-blank statement worded as:
/The Containment Spray Valve Control (THINK) switch
. required. (is or is NOT)
- 3. Stem Focus: The l fill-in-the-blank statement should include the word manually, i.e., must be MANUALLY restarted.
- 4. Ensure no overlap with Q#17 16 H 2 x x B E 223002 K1.07 (2003 NRC EXAM)
Stem Focus: The portion of each choice dealing with the RCIC turbine trip is not necessary. Also suggest changing the four choices to also include the term auto-close.
A. F007 and F008 auto-close B. ONLY F008 auto-closes; F007 remains open C. ONLY F007 auto-closes; F008 remains open D. No effect on RCIC isolation valves; both valves remain open.
- 2. #/units: The exact name of the pushbutton should be included in the stem question, i.e., WOOTF describes the effect on RCIC when the STEAM ISOLATION pushbutton is depressed?
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 17 H 2 x N U 226001 K4.01 Q=KIA: This K/A requires testing the applicants knowledge of a design feature and/or interlock that allows the operator to test the opera bi/ity of a containment spray system component. The proposed question tests the applicants knowledge of the interlocks required to spray the drywell.
Suggest re-writing the question to test the applicants knowledge of Steps 7.5.9 thru 7.5.14 in OPT-08.2.2.B, LPCI/RHR System Operability Test Loop B. The valve interlock between the inboard and outboard spray valves can be tested, as well as the design of the system such that there is normally water between these valves.
Unit 1/s operating at 100% power.
An operator is performing the valve operability checks portion of OPT-08.2.2B, LPCI/RHR System Operability Test Loop B, and is preparing to stroke the El l-FOI6B and El l-FO2IB.
WOOTF completes both statements in accordance with OPT 08.2.2B?
The FOI6B and FO2IB both be opened at the same time during the performance of this test.
When El 1-FO2IB is stroked during this portion of the test(7 water_______ enter the D,ywell through the spray header.
A. can;willNOT B. can NOT will NOT C. can; may D. can NOT; may
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues TIF Cred. Partial Job- Minutia #1 Back- Q SRO BIM/N U/E/S Explanation Focus Dist. Link units ward K/A Only 18 H 2 x x N E 230000 K3.04 Note to NRC: Since torus air temperature is not used in the EOP network, this K/A is being met by testing a parameter (torus pressure) which is directly related to torus air temperature. This is acceptable.
- 1. Partial: The 2d fill-in-the-blank statement is subjective, i.e. the word may is subjective and an applicant could argue that Choice C is also correct.
- 2. Stem Focus: The pipe break location (primary containment) and downcomer break are confusing because the locations and impact may be unclear to the applicants. That is, the two failures are intended to be unrelated.
Suggest modifying the question as follows:
WOOTF completes both statements in accordance with the 7
PCCP flowchart and 001-3 7.8, Prima,y Containment Control
/ Procedure Basis Document?
In the PC/P leg, suppression pool spray must be initiated before pressure reaches 11.5 psig.
IF suppression pool spray is NOT initiated before reaching 11.5 psig, THEN______
A. Drywell; a crack could occur at the junction of the downcomer and the vent header.
B. D,ywell; air will be drawn in through the vacuum relief system to deinert the primary containment C. Torus; a crack could occur at the junction of the downcomer and the vent header.
D. Torus; air will be drawn in through the vacuum relief
\\ system to deinert the primary containment B239001K2.01
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia Back B/M/N U/E/S Explanation Focus Dist. Link ward
- x 239002 K3.01 (2010-2 NRC EXAM, Q#24-IDENTICAL)
Cue: The phrase will lose in the l fill-in-the-blank statement is a cue when combined with the word ONLY in the 2 part of choices A and C. Suggest re-wording the fill-in-the-blank 6 f statement as follows:
SRVs B, E, and______ be operated at the RSDP for pressure control.
F can still
) Fcan NOT G can still G can NOT 21 I 2 x 239002 G2.4.2 Cred Dist: (borderline) Choices C and D are not plausible because they somewhat imply (based on the wording of Choices A and B) that torus cooling is not appropriate when an SRV is leaking with a slowly rising torus ternperature. (not true)
The 1 part of Choices A and B state place torus cooling in service, whereas Choices C and D imply to NOT place torus cooling in service. This is borderline two non-plausible distracters.
- 2. LOK: It appears that this question can be answered directly from memory knowledge space and should be labeled as a lower cog question. Discuss.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues TIF Focus J
Cred. Partial Job- Minutia #1 Back-Dist. Link jt5 ward Q I SRO B/M/N U/E/S K/A jonly Explanation 22 H 2 x x B E 245000 A2.09 Backward and/or Cue: The stem is worded such that it asks the applicants to look back in time to determine whether a turbine trip should have occurred already. Also, the sentence Turbine speed is 900 rpm and rising is placed at a point in the stem afterthe bearing vibration values are given, instead of at the front portion of the stem that describes the main turbine roll in progress.
Suggest the following variation to test the applicants knowledge that an auto turbine trip will occur and that a manual scram is NOT required when only one bearing exceeds its OP-26 limit.
(Need to ensure sufficient bypass valve capacity exists on the simulator.)
Unit 2 is operating at 20% rated thermal power and the main turbine is being rolled in accordance with 20P-26, Turbine System Operating Procedure. Turbine Speed is currently 900 rpm and slowly rising.
WOOTF predicts 1) the plant response if the bearing #10 vibration rises to 11 mils and 2) whether a manual reactor scram is required in accordance with 2OP-26?
A. An automatic turbine trip will occur; a manual reactor scram is required.
B. An automatic turbine trip will occur; a manual reactor scram is NOT required C. An automatic turbine trip will NOT occur; a manual reactor scram is required first, then the turbine is required to be manually tripped.
D. An automatic turbine trip will NOT occur; a manual turbine trip is required, the reactor is NOT required to be manually scrammed.
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F J Cred.
Dist.
Partial Job- Minutia #1 Back- Q= SRO B/MIN UIEIS Explanation Focus Link units ward K/A Only 23 H 2 x x x N E 256000 K6.09
- 1. Job-Link and/or Partial: An applicant can potentially argue that there is no correct answer because efficiency of the SJAE is not really improving when the off-gas filter is plugged since backpressure is rising at the SJAE. If the off-gas filter is plugged, then the 2 fill-in-the-blank statement may be a moot point, i.e., throttling open CO-FV-49 does provide additional
/
/
C \ cooling to the after-condenser; however, the discharge pressure of the steam jet is still continuing to rise due to the off-gas filter plugging issue. This becomes a race to see which is occurring faster the additional cooling OR the filter plugging? The CO FV-49 is effective to raise SJAE efficiency when there is a condenser vacuum leak; however, with an off gas line stoppage, the efficiency gained is questionable.
- 2. Cue: The 1st fill-in-the-blank statement tells the applicants that condenser vacuum will lower. Consequently, the applicants know that hotwell temperature will rise based on their GFES knowledge.
Suggest re-working the question to test the applicants knowledge of how a CO-FV-49 (can it fail?) failure will affect the condensate system. In this regard, the CO-FV-49 is being treated as an off gas component to meet the intent of the K/A.
24 H 2 x B E 259002 A3.10 (2010-1 NRC EXAM Q#24-IDENTICAL)
- 1. Stem Focus: The 2 bullet should be moved to the second sentence because this is an initial condition. Also, this bullet should say RFP A Manual/DFCW selector switch is in the DFCS position. All of the initial conditions should be listed 14 before the Remote Speed Signal failure event.
2
- 2. Stem Focus: To be more precise, change the l part of Choices A and B to drop to 2550 rpm. I 5t 1
- 3. Stem Focus: To be more precise, change the part of Choices C and D to not change.
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. jPartial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 25 H 2 x x B E f
-/
j 2
/
- 2. Stem Focus: Use the term auto-open or auto-close at each
, point in Choices A, B, and 0 where only open or close is used.
°°°
°
- 3. Stem Focus: In order to remove the term IF ANY in the stem
-°:::.
question: Add a lead-in phrase (before the 1° sentence in the stem) that says Drywell pressure is slowly rising and venting of the suppression chamber Change the stem question to WOOTF predicts the plant response if drywell pressure reaches 1.5 psig and reactor water level lowers to 160 inches and then stabilizes?
26 F 2 x x B E 261000 K4.04
- 1. Partial: An applicant can successfully argue that there is no correct answer because Choice 0 does not include the whole i j 1 story, i.e., Choice D doesnt say Pre-filter compartment
\ ( temperature 210°F with inlet duct temperature 180°F.
i
//i!.1 . 2. This question overlaps with SRO Q# 81 (261000 A2.03)
V .
because it also tests the applicants knowledge of how 210 °F
. affects the SBGT train.
- 3. Stem Focus. Choice A should be re worded as After the 480 V MCC supply breaker is cycled from open to close.
27 F 2 x N E 262001 K2.01 Cred Dist: (borderline) Choices B, C, & D suffer plausibility because the VFD recirc pumps would never have an auto-transfer capability to keep them running. In order to effectively test the applicants knowledge of the off-site power supply arrangement, change each of the four choices to the bus that it is powered from. (Each of the four choices identifies a load that is powered from a bus. Instead of listing the load, list the bus.)
- 2. Verify that the term Transformer Bus refers to the area between PCBs 25 (26) A& B to the SAT and Caswell Beach Transformers.
- 4. Job Content Flaws 5. Other 6. 7. 8.
Job- Minutia Back SRO B/M/N U/E/S Explanation Link units ward K/A 28 H 2 x M 262002 A2.02 (2010-2 NRC EXAM, Q# 31)
Q=KIA and/or Cue: The l part of the K/A requires testing the applicants ability to PREDICT the impacts of an overvoltage condition on the UPS system. Instead, the stem of the proposed question TELLS the applicants the impact of the overvoltage condition, i.e., the stem of the question TELLS the applicants that UPS has transferred to Reserve. [Overvoltage or undervoltage on the UPS inverter output will cause an automatic transfer of the UPS loads.]
Suggest modifying the question to eliminate the portion of the stem that refers to UA-06, 6-9 (UPS TRANSFER TO RESERV) and then test the applicants ability to predict which annunciator(s) will alarm, and to test their ability to implement the required actions of the APP.
29 F 2 B S 263000 Al .01 Stem Focus: Add the word voltage in the lstfiIlintheblank statement after the word output.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LCD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ i Back SRO B/M/N U/E/S Explanation Dist. Link units ward K/A 30 F 1 x x x N U 264000 K5.05 LOD1 and/or Q=K/A: The proposed question can be answered solely using generic fundamentals knowledge. The applicants generic fundamentals knowledge has already been tested. This portion of the NRC exam must test plant specific knowledge.
[refer to K/A Catalog items 291005, Motors and Generators, Ki .09: Interrelations of VARS, Watts, Amps, Volts, Power Factor.]
Suggest testing any of the following plant specific knowledges.
- There are two voltage regulator adjust switches at the RTGB and the local EDG control panel. Each location has an auto voltage adjust and a manual voltage adjust switch.
Since the EDG will normally utilize the auto regulator (unless it fails), the auto voltage adjust switch will normally be used.
- Therefore, when the diesel generator is placed in the MANUAL mode, the diesel generator shall be declared inoperable once the governor motor control switch or voltage adjusting rheostat switch are adiusted from the pre set condition. (When any diesel generator is in the MANUAL mode and subsequently receives an auto start signal, the auto voltage regulator and governor control will NOT return to their preset positions.)
- 2. Stem Focus: The photos in the stem are not needed to elicit the correct response.
- 3. #/units: Use the exact label name of any switch. It may be necessary to provide a diagram (SD-39, Figure 39-9?) if the switch is referred to in the question and its label name does not have a specific number/name.
31 H 2 N U 264000 A2.06 Cred Dist: The 2 part of Choices A and C (cross-tie bus El to E3) is not plausible because the stem says that a phase overcurrent exists on Bus E3.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focusj Dist. Link units ward K/A Only 32 F 2 M S 271000 Kill (2010-1 NRC EXAM, Q#33)
. Note to NRC: An acceptable way of testing the applicants t7 -
¶ knowledge of the relationship between a radioactive release rate and the Off gas system is to provide several annunciators that are in alarm and/or a situation where the RRCP flowchart has been entered. The proposed question meets the K/A.
33 F 2 B 5 272000 K2.03
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/EIS Explanation Focus Dist. Link units ward K/A Only 34 F 2 x x M E 288000 K5.01 (2010-2 NRC EXAM, Q#70)
Partial: An applicant can successfully argue that Choice A is also correct because the end result of the EOP-4 actions listed in the RRITB leg still keep the building at a negative pressure.
On the other hand, 01-37.10 states that the purpose of placing the Unit 2 HVAC system in the recirc mode is to terminate a large unfiltered volume discharge flow path for a leak on either unit. This reason is not listed in any of the choices; therefore, an applicant can argue that there is no correct answer.
Stem Focus: The stem conditions do not include any plant parameter values that require entry to EOP-4-RRCP. See enhancement below.
3.) Stem Focus: The fill-in-the-blank statements grammar doesnt flow well with the 2 nd part of the incorrect choices.
Suggest the following enhancement (higher cog):
Unit 1 and 2 are operating at 100% power with all Turbine Building Ventilation Systems operating in their normal lineup.
The following alarm is received on both units due to a main turbine steam leak on Unit 2:
TURB BLDG VENT RAD HIGH (UA- 03,3-3)
The crew has completed all required actions in accordance with the RRITB leg of OEOP-04-RRCP.
WOOTF 1) predicts the required status of the TURBINE BLDG VENT MODE SWITCH, 2-D12-TB-VENT-MODE-SEL-SW, at Panel XU-62 and
- 2) identifies how the turbine building is being maintained at a negative pressure at this time?
A. OTV; Unit I Air Filtration Unit B. OTV; Unit 2 Air Filtration Unit C. RECIRC; Unit I Air Filtration Unit D. RECIRC; Unit 2 Air Filtration Unit
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 8.
LOK LCD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO Explanation Focus Dist. Link units ward K/A Only 35 F 2 x 290001 A3.02 Stem Focus: The stem states that the storm has resulted in the Rx Bldg static pressure to lower. This information is not necessary to the question. Suggest revising as follows to streamline the question and to ensure no confusion on which way building pressure has trended:
The following alarm is received on Unit 2:
RXBLDG STATIC PRESS DIFF-LOW.
The operator observes that the VA-Pl-1297 RTGB Panel XU3 is reading flinches H20.
WOOTF identifies how the Ax Bldg ventilation system responds?
A. supply and exhaust fans auto-trip. SBGT does not auto-start.
B. supply and exhaust fans auto-trip. SBGT auto-starts.
C. Exhaust fan vortex dampers will auto-throttle open.
D. Supply fan vortex dampers will auto-throttle closed.
- 2. This question is MODIFIED (201 0-1, Q#59) 2950001 G2.2.22 Suggest making two fill-in-the-blank statements (one for Unit 1 and one for Unit 2) so no one gets confused.
37 H 2 U 295002 G2.4.45 Cred Dist: Choice A (starting MVPs) is not plausible because 1) starting a MVP is only allowed at < 5% power and 2) starting a MVP is not an action listed in AOP-37.
Cred Dist: Choice D (restarting the tripped A pump) is not plausible because the A pump had a high p screen trip (as stated in the stem).
- 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
T/F Cred. Partial Job- Minutia #/ Back- Q ISRO B/M/N U/E/S Explanation Dist. Link units ward K/A 295003 AA2.01 LOD=1: An applicant can get to the right answer just by looking at what is red and green, i.e., an applicant can get to the correct choice by observing the picture in the stem and observing that 2C Bus is not energized, which is the correct answer.
39 H 2 295004 AA1 .03 Q=KJA: (borderline) The 2 part of the question does not involve monitoring or operating the AC electrical distribution.
(CRD Pump breaker is not really AC electrical distribution).
Additionally, the question does not test at the Tier 1, Group 1 emergency/abnormal level.
- 2. Cred Dist: Choice B (4KV breaker can still be remotely operated even though the breaker wont trip on o/c following a loss of DC control power) is not plausible because all 4KV breakers require DC control power for remote operation. Also, see generic fundamentals item in BWR K/A Catalog Section 291008, Breakers, Relays, and Disconnects, K1.09, effect of removing control power on breaker operation.
Suggest modifying the question to eliminate generic F
fundamentals knowledge and to ensure the Tier 1, Group 1 emergency/abnormal aspect is hit for AC electrical distribution:
7init I is operating at rated power when the following alarms are
/ received:
- DG2JE2 ESS LOSS OF NORM POWER (UA-I8, 2-3)
- DG4/E4 LOSS OF NORM POWER (UA-I8, 2-3)
- DG-2 CTL PWR SUPPLYLOST(UA-20, 6-3)
- DG-4 LO START AIR PRESS (UA-22, 6-3)
WOOTF identifies the 125 VDC Panel that was lost and a required action in accordance with OAOP-39.0, Loss of DC Power?
A. IB; Shift control power at 480 V substation E6 B. IB; Shift control power at 480 V substation E8 C. (wrong panel); Shift control power at 480 V substation E6 D. (wrong panel); Shift control power at 480 V substation E8 40 H 2 N S 295005 AK2.04
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Explanation 295006 AKI.02
- 1. Stem Focus: The word except may cause confusion and this lead-in phrase is not needed to elicit the correct response.
Delete the phrase All rods inserted except.
- 2. This question should be listed as MODIFIED from 2010-2, Q#41 AND 201 0-1, Q#41 295009 AA2.02 (201 0-2 NRC EXAM, Q#28)
- 1. Stem Focus: The 1 part of Choice A (The master control 2-C32-SIC-R600 has failed in auto) is not necessary. All of the other three choices dont have a cause listed.
- 2. Stem Focus: To add plausibility to Choice C, change the feed pump from B to A, i.e., Place the A RFP NJJA switch in MAN UALand stoijiprmaHevej However, we Theed to discuss whether this creates two correct answers because AOP-23, Step 3.1.1 states IF automatic level control will NOT restore normal reactor vessel level, THEN MANUALLY CONTROL reactor feed pumps to restore normal level. Does this mean that the operator has two choices for controlling the A 295010 AK1.03 (2007 NRC EXAM)
Cred Dist: Provide the DW Spray Limit Curve as a reference for this question to add plausibility for Choice A (spray drywell).
Cred Dist: Raise the drywell temperature to 200 F in order to give plausibility to Choice C (emergency depressurization).
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 44 F 2 x x B E/U 295016 AK3.01 (2010-2 NRC EXAM, Q#45 - IDENTICAL)
Cred Dist: The 2 d part of Choices B and D (scram inserted so that ESF systems can be controlled from the RSDP) is not plausible because a scram is always inserted for one reason: to shutdown the reactor.
This is a tough K/A; consequently, this question is graded as an enhancement.
- 2. Stem Focus: The l part of the fill-in-the-blank statement is confusing and grammatically challenging.
Suggest the following:
WOOTF completes the following statement in accordance with AOP-32, Plant Shutdown From Outside Control Room?
The reason that AOP-32 includes steps to open all RPS EPA breakers in the cable spreading area is Lv A. to ensure that all PCIS group isolations occur and a SBGT is running during the performance of the procedure.
B. for a situation where a manual scram could not be performed prior to leaving the control room.
C. to ensure RPS components are not damaged from an electrical perturbation.
a ething else here that begins with the word
/7 295017 AK2.08 4.L 5
lJi / 4 May want to provide a screen shot of SDS Screen 500 as a reference for this item.
H 2 295018 AA1 .01 Cred Dist: To add plausibility to Choices B and D (conventional service water being used by a diesel), add a fourth sentence in the stem that states: The crew has completed all actions in OAOP-1 8.
/
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (FIH) (1-5) Stem Cues TIF Cred. Partial Job- Minutia #1 Back- Q= SRO BIMIN U/EIS Explanation Focus Dist. Link units ward K/A Only 47 ? 2 x E 295019 G21.32(2010-2Q#18and2008NRCEXAM,Q#48)
M 1. This question overlaps with SRO Q#87 (295019 02.1.32)
- 2. This question should be listed as M (modified bank) versus B.
- 3. The cognitive level for this question appears to be lower level.
- 4. Stem Focus: Each of the four choices contains ADS valves; therefore, this portion of each choice can be eliminated.
A Stem Focus: The wording of the stem question seems to imply 5.
that an alarm signal is used to initiate the backup nitrogen system.
Suggest the following:
WOOTF completes both statements in accordance with OAOP 20.0, Pneumatic (Air/Nitrogen) System Failures?
If the non-interruptible air header pressure lowers to the same value as the annunciator alarm setpoint, then the backup nitrogen system wiil automaticaily initiate.
One reason that the backup nitrogen system automaticaily initiates is so that a pneumatic supply wiil be maintained to the A. INSTR AIR PRESS-LOW; MSIV5 B. INSTR AIR PRESS-LOW; Hardened Wetweil Vent Valves C. RB INSTR AIR RECEIVER 1A PRESS LOW; MSIV5 D. RB INSTR AIR RECEIVER IA PRESS Low; Hardened Wetwell Vent Valves
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 48 F 2 x x B E 295021 AA2.04
- 1. Cred Dist: Choice D (RHR Heat Exchanger inlet temperature) is not plausible because the stem states that shutdown cooling is not in service.
- 2. Stem Focus: It is not clear whether or not the El 1 -F009 is open or closed. Suggest modifying the stem to state that Ell-F009 j cannot be re-opened. (instead of saying that the operators are having difficulty opening Ell-F009).
Stem Focus: The initial conditions should state that shutdown cooling was in service (prior to the LOOP).
- 4. Stem Focus: The stem question should closely mirror the caution just prior to Step 3.2.4 in AOP-15 in order to preclude post-exam comments. The caution doesnt refer to a mode change, instead, it refers to vessel coolant temperature.
monitoring.
WOOTF parameters is allowed to be used for vessel coolant temperature monitoring?
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
LOK LOD 1
(F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ I SRO B/M/N U/E/S Explanation Focus Dt.Unkj units 49 ? 2 295011 AK1.02 (2010-1 NRC EXAM, Q#71)
Suggest testing the following to ensure difference from previous exam:
7IIOOTF 1) identifies the setpoint for the HCU low pressure alarm (CRD ACCUM LO PRESS/HI LEVEL, A-07, 6-1) and 2) describes a condition that requires a manual reactor scram?
A. 955 psig; Reactor pressure <950 psig, Charging Header pressure <940 psig, and ONE accumulator alarm B. 955 psig; Reactor pressure > 950 psig, TWO accumulator alarms, Charging Header pressure <940 psig C. 940 psig; Reactor pressure <950 psig, Charging Header pressure <
940 p51g. and ONE accumulator alarm D. 940 psig; Reactor pressure > 950 psig, TWO accumulator alarms, Charging Header pressure <940 psig This question should be rated as a lower cog question.
50 F 2 x x N U 295023 AK3.02 Note: The refueling interlocks are described in SD-58.1.
- 1. Cred Dist: The 2 part of Choices B and D (mode switch in shutdown) is not plausible because of the first word in the fill-in-the-blank (Refueling), i.e., Refueling equipment interlocks work when the mode switch is in Refueling.
- 2. Cred Dist: The 1 st part of Choices A and B (prevents an iodine gas release) is not plausible because an equipment interlock can never stop the iodine from being released if a fuel pin leaks.
The pressure in the fuel pin will be released under the water, but the iodine will still bubble up. Interlocks prevent a release?
- 3. Partial: An applicant can argue that Choice A (prevents an iodine gas release) is also correct because this may be an indirect consequence of an inadvertent criticality.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 51 H 2 x x 295024 EK3.04 (2008 NRC EXAM)
- 1. Cue: Need to also provide the HCTL graph as a reference on the exam to ensure that the applicants arent being cued to look only at the PSP graph. Choice B relies on the HCTL graph.
- 2. Stem Focus: Re-word each of the choices to be parallel with the wording in Choice A as follows:
A. Steam exists in the suppression chamber air space, which indicates that the pressure suppression feature is being bypassed.
B. The suppression chambers heat capacity is being exceeded.
C. The combination of high suppression chamber level and pressure is threatening the design boundaty loading of the torus.
D. Suppression chamber level has lowered to the point of the downcomer elevations.
295025 EA1.05 (2010-1 NRC EXAM, Q#18 - IDENTICAL)
- 1. Stem Focus: Add the current RCIC Discharge pressure to the list of stem bullets.
53 F 2 x x E 295026 EK2.01
- 1. Cred Dist: Choice D (minimize source term for off-site release concerns) is not plausible because torus cooling will not affect the sites source term. Suggest changing this choice to the following:
To maintain cooling to HPCI and RCIC
/
- 2. Stem Focus: Re-word Choice C (to streamline) as follows:
To maintain NPSH to low pressure ECCS pumps.
- 3. Stem Focus: Include step ID/# RC/L-Kafter the word step in the stem question. V
- 4. Did this question end up being a new or
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LCD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/MIN U/E/S Explanation Focus Dist. Link units ward K/A 54 F 2 x 295028 EKI .02 (2008-2 NRC EXAM Q# 54-IDENTICAL)
Cred Dist: Choice B (Inboard MSIV solenoids) is not plausible because the EOPs do not rely on the MSIVs and they are designed to fail closed. All the other choices are components needed to operate during a LOCA.
- 2. Cred Dist: (borderline) Choice C (Torus to Drywell Vacuum Breakers) is not plausible because these valves are all metal check valves; therefore, 340F will not affect their operation.
In order to effectively test the applicants knowledge of the operational implication of a hot drywell at 340 °F, see the following suggestion:
WOOTF identifies a consequence of the drywell average air temperature remaining atF for a prolonged period of time, in accordance with 001-37.8, Prima,, Containment Control Procedure Basis Document?
( A.
B.
SRVs may not operate.
hydrogen analyzer indications are no longer reliable.
f3 drywell high range radiation monitors may not work.
Hardened wetwell vent valves may not operate.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 8.
Q# LOK LCD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Explanation Focus Dist. Link 55 H 2 x x x 295029 EA1.04 Note: The explanation provided with this question does not match the conditions provided in the stem, i.e., the explanation paragraph provided to the chief examiner for this question states that RPV level is 185 and that drywell/torus sprays are operating. /
Cred Dist: Choice D (Core Spray) is not plausible because the stem does not include any information related to NPSH or vortex limits. Also, the only other time when Core Spray is required to be secured is during an ATWS, and the stem does not include any information related to reactor power. lurthermore, Core Spray is normally aligned to the torus and is not an injection
)rce which is external to the containment. ,
Partial: There may be no correct answer. At PCCP Step SP/L 10 (terminate injection from sources external to containment), IF fthe crew aligns RCIC to the torus THEN they will not have to secure RCIC.
Stem Focus: Why does the stem question have a parenthetical statement (Assume no circuit alterations have been performed)?
The steps in SEP-10 only provide guidance for jumpering HPCI suction transfer logic when the torus is hot and its level high.
Torus temperature is not provided in the stem. In the situation presented in the stem, HPCI would be aligned to the torus (not the CST).
56 H 2 295030 EA2.02 (2008-2 NRC EXAM, Q#7 -IDENTICAL)
In order to be slightly different from the 2008 version, consider modifying the stem so that 2A and 2C RHR pumps are both running. Delete the 2B RHR Pump running. This will allow evaluation of the applicants ability to use the NPSH graphs for two pumps operating in parallel.
V
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 8.
LOK LCD (F/H) (1-5) Stem Cues TIE Cred. Partial Job- Minutia Explanation Focus Dist. Link 57 5 x 295031 EK1.02 Partial and/or LCD=5: Testing the applicants knowledge of what is defined as the primary loop and secondary loop is minutia. This is only defined in the SD-01 and not defined in any approved procedure. An applicant could become confused and argue that the primary loop is inside the shroud. Choice A may also be correct since these loops arent really defined in a procedure. Im not comfortable with this question because it may be appealable.
This seems to be a tough K/A to hit since a low reactor water level is opposed to natural circulation. Cne possibility is to write a question where SDCg was placed in service in accordance with CP-17, Section 5.7.2, Step 19, which states:
IF reactor recirculation pumps are NOT operating, THEN ESTABLISH AND MAINTAIN RPV water level between 200 and 220 inches on B21-Ll-R605A(B) OR as directed by the Unit CRS.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (FIH) (1-5) Stem Cues TIF Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N UIE/S Explanation Focus Dist. Link units ward K/A Only 58 F 2 x x B U 295032 EK3.01 (2008-2 NRC EXAM, Q#57-IDENTICAL)
- 1. Cred Dist: Choices A and B are not plausible because a high reactor building temperature will not cause an unmonitored release (Choice A) and will not cause the site boundary dose limits to be exceeded (Choice B).
- 2. Partial: Choice D (preserve personnel access) can also successfully be argued as correct based on 001-37.9 discussion for SCCP Step SCCP-27, see below:
C 71 fIf parameters in any of the areas listed in the Tables of the Seconda,y Containment Control Procedure approach their maximum safe operating value or it is anticipated that an E/Q envelope will be exceeded in more than one area, adequate core cooling, containment integrity, safety of
/ personnel, or continued operability of equipment required to perform EOP actions can no longer be assured.
70ne possibility is to write a question and provide the SCCP
/ Table(s) for temperature, delta T, radiation, or water level values and then test the applicants knowledge of the reason why ED is required, based on the values listed in the stem.
Oy i4 X-i CticYW2( £
/ ,jc jQO5
) ;?C)
)O4
() I tVc
/ U. ) 2W p J2 1 O )/ /1(
4
.I MR (4,
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem ICues T/F Cred. Partial Job- Minutia #/ Back- Q SRO B/MIN U/E/S Explanation Dist. Link units ward K/A Only 59 F 2 95037 EK1.02 Cred Dist: Choice A (raise subcooling) is not plausible because making the feedwater colder is never a reason for lowering water level since this adds positive reactivity.
Cred Dist: Choice C (reduce heat input to drywell when MSIV5 close) is not plausible because the effect of deliberately lowering level will RAISE the heat input to the drywell since core inventory is less.
Stem Focus: None of the information provided in the stem is necessary to elicit the correct response. The correct answer can be determined solely using the stem question, i.e., the correct answer to LPC (ATWS) directing level lowered to 90 inches is always to minimize oscillations by uncovering the FW sparger and preheating the feedwater.
Suggest writing a question that tests the applicants knowledge of WHERE to take RPV level based on conditions listed in the stem. This would satisfy the K/A match since an operational implication (of the effects of level on power during an ATWS) is establishing a certain water level band. The level band is dependent on critical step LPC RC/L- 16, Table 3.
038 EK2.06 (2010-1 NRC EXAM, Q#74) 1/ Cred Dist: To make Choice B (turbine building area rad high) plausible, change this choice to reactor building area rad high.
(SCC P entry condition).
H 2 M S 300000 G2.2.44 (2010-2 NRC EXAM, Q#62TOO SIMILAR; 2008-2 NRC EXAM, Q#61-fDENTICAL)
B I This question should be listed as BANK because it is not significantly modified.
tILJ4 ,Ji, f?/4) i1
?
ó-th
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F I Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus j Dist. Link units ward K/A Only 62 F 2 x B E 400000 K2.02 I Partial and/or Stem Focus: The term BOP distribution may
,..Q cause confusion and could potentially be argued as correct fI ,
/ since the BOP busses normally feed the E-Busses.
Suggest changing the distracters to list specific MCCs in the
/ ,f Reactor Building for SW-V103 and V106 to test the applicants i_ knowledge of which specific MCC is used to power these valves.
63 H 2 N S 400000 K6.07 64 F 2 N 600000 AA2.l0
) Stem Focus: In the 3 rd sentence in the stem, replace SCBAs with Scott Air Pak SCBAs.
65 ,4 2 N S 700000 G2.4.30 1- 1. This question appears to be a lower cog question. c)/L.
66 H 2 B S G2.1.5 67 F 2 B G2.1.32 (2007 NRC EXAM)
- 1. Cred Dist: Choice D (simultaneous venting of DW and torus would cause excessive radioactivity at the stack) is not plausible because the containment normally does not contain excessive radiation. Since no abnormal event is in progress, there is no reason for the stack to see excessive radioactivity.
- 2. Stem Focus: Change the 1 st part of Choices A and C to unnecessary cycling of...
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LCD (F/H) (1-5) Stem Cues TIF Cred. Partial Job- Minutia #1 Back- Q= SRO BIMIN UIE/S Explanation Focus Dist. Link units ward K/A 68 H 2 x G2.1.44 (2004 NRC EXAM)
I. Cred Dist: Choices B, C, and D (continue moving fuel) are not plausible because the stem states that SRM readings are steadily rising. The conservative action is always to stop, and this is the correct answer (Choice A).
Suggest the following:
Unit I is in a refueling outage and the initial loading of fuel bundles around each SRM is complete.
WOOTF completes both statements in accordance with OFH-II, Refueling?
Fuel movement must be suspended when an SRM reading rises by a factor of two upon insertion of any single bundIeR if an SRM rises by a factor of five relative to the SRM baseline count rate.
[Swap the underlined portions as the plausible distracters.]
G2.2.20
- 1. LOD1: The times when electricity cost the most $$ in the southeast are in the winter and summer (extremes). The correct answer (Choice D) can be obtained using this common knowledge in the southeast.
70 F 2 B G2.2.35
- 1. Cred Dist: Choices A and C (the first reactor head bolt still tensioned) are not plausible because there is no designation for which bolt is first.. The phrase first reactor head bolt still fully tensioned does not make sense. What is the first reactor head bolt?
XN ).3r
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 8.
Q# LOK LOD (F/H) (1-5) Stem Cuesl T/F Cred. Partial Job- Minutia #1 Back- Q= SRO Explanation Focus Dist. Link units ward K/A Only 71 H 2 x x G2.2.42 (2008 NRC EXAM)
Note: The plausibility analysis shows Choice C as the correct answer whereas the answer key shows Choice B as the correct
/ answer.
- 1. Cred Dist: (borderline) The plausibility of Choice C (the unidentified leakage averaged over the previous 24 hour2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br /> period) and Choice D (the total leakage averaged over the previous 24 hour2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br /> period) is borderline because the stem says that the leakage values have been constant for several days.
An applicant could logically eliminate Choices C & D because (
the plant was operating for several days with these values, then the 24 hour2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br /> averages are acceptable. The first word in Choices C & D is average, which implies averaged over the previous 24 hour2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br /> period. The stem says that these values have been constant for several days.
- 2. Stem Focus: The word correct in the stem question is not necessary.
G2.3.1 1 (2004 NRC EXAM) j 1.7 Cue: The word preferred is a cue to the applicant that the 1 / answer to the 2 d fill-in-the-blank statement is (always) TORUS.
f Suggest the following:
For these conditions, the containment is required to be vented
.-from the_____
73 2 E G2.3.13
- 1. Cred Dist: The CRS is borderline plausible. Suggest changing the 2 d
part of Choices A and C to Operations Manager and revising the 2 fill-in-the-blank statement as:
The MINIMUM approvals required to enter this area are the E&RC manager (or designee), Rad Protection Supetvisor, and
- 2. This question appears to be a low cog question.
1 Note to NRC: Although the 1 portion of the question is GET level knowledge, the 2 portion of the question is at the licensed level.
0
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/MIN U/E/S Explanation Focus Dist. Link units ward K/A Only 74 F 2 N S G2.4.19 75 F 2 x N E G2.4.25
- 1. Stem Focus: The fill-in-the-blank staterTiehtsshou1d be revised to preclude partially correct answers and/or slight cueN Suggest re-wording as follows:
WOOTF completes both statements lAW OFPP-031, Fire Brigade Staffing Roster and Equipment Requirements?
The Fire Brigade Advisor position N The Fire Brigade Advis6r_________ be diverted from
/ supporting the fire brigade during anQvent.
A. must be filled by an SRO; is allowed to B. must be filled by an SRO; can NOT
/V / C. can be filled by an RO; is allowed to D. can be filled by an RO; can NOT
8.
Explanation 209001 G2.1.7 It appears that the entire PT-7.2.4A is being distributed to the applicants as a reference. It is not clear whether the licensee intends to distribute Tech Spec 3.5.1. Ask.
It appears (not clear in the explanation) that the reason the PT 7.2.4A is unsatisfactory is because of acceptance criteria 6.1.1, which states:
CORE SPRAY PUMP A operation develops a recirculation flow rate of greater than or equal to 5000 gpm against a system head of greater than or equal to 270 psig. (SR 3.5.1.6, SR 3.5.2.5)
(The vibration values are in the Alert High range; however, none of the vibrations are in the Required Action range.)
Discuss these assumptions (listed above) w/ licensee.
Cue: All values (vibrations, flow rate, discharge pressure) should be listed on Attachment 2. Because the flow rate and discharge pressure is missing from attachment 2, this may potentially cue the applicant that these values are jfgjy Although the intent is to require the applicants to read the gauges (picture in the stem), the missing flow rate and discharge pressure onAttachment2 may cue an applicant.
Cred Dist: Choice A (no action required; LCO met) is not plausible because RHR Pump 2D is under clearance. Even if nothing is wrong with the Core Spray loop, there is STILL an LCO due to the RHR Pump 2D.
dM1 1f1 4 ,i 1
r
+
-1Q t&v Jt -
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 77 H 2 x B 215002 A2.01 I SRO-only: The 1 part of the question can be answered solely based on knowing 1)the RBM intermediate trip set point (ITSP) value (1083%) and 2) that this rod has 8 total LPRM5 and at least 4 have to be available.
The 2 part of the question can be answered solely based on knowing that the guidance for cycling the rod select power control switch is listed in the annunciator procedure (RBM UPSC/INOP), which the RO applicants routinely perform when moving control rods and this activity is a reactivity issue, which 0 a licants are required to know.
NUREG 1021, ES-401, Section D.2.a states: When selecting or writing questions for K/As that test coupled knowledge or abilities (e.g., the A.2 K/A statements in Tiers 1 and 2 and a number of generic K/A statements, such as 2.4.1, in Tier 3), try to test both aspects of the K/A statement. If that is not possible without expending an inordinate amount of resources, limit the scope of the question to that aspect of the K/A statement requiring the highest cognitive level (e.g., the (b) portion of the A.2 K/A statements) or substitute another randomly selected K/A.
Suggest writing a Tech Spec question to target the (b) portion of the A.2 K/A statement (use procedures to correct, control, or mitigate..) with the following idea.
The OPERABILITY requirement for the Low Power Range Upscale Function (114.1%) is satisfied if the Intermediate Power RangeUpscale Function (1 08.3%) orthe High Power Range Upscale Function (1 04.5%) is OPERABLE.
(imilarIy, the OPERABILITY requirement for the Intermediate Power RangeUpscale Function (1 08.3%) is satisfied if the (High Power RangeUpscale Function (104.5%) is OPERABLE.
May or may not need to provide a Tech Spec reference, depending on the question. If a two-part question is used, the nd 2
l part may be RO knowledge; however, the part must be at the SRO level in this case.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 8.
LOK LCD (F/H) (1-5) Stem Cues TIF Cred. Partial Job Explanation Focus Dist. Link 78 H 5 x 215003 A2.O1 L0D5: The proposed question should include a Tech Spec reference to the applicants because 1) knowing 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> action statements from memory is LCD = 5 and 2) the plausibility of the 2 part of Choices A and C (Be in Mode 3) is enhanced when the applicants have the reference. During a post-exam appeal, an applicant can successfully argue that this question tests memory at LCD = 5. However, providing the entire TS 3.3.1, Reactor Protection System Instrumentation will provide cues iggest keeping the 1 fill-in-the-blank question and also test the applicants ability to apply TRMS 3.3, Control Rod Block Instrumentation, requirements to this situation (IRM E previously bypassed and IRM A power supply fails). Two choices can be to restore the channel to operable w/l 24 hours2.777778e-4 days <br />0.00667 hours <br />3.968254e-5 weeks <br />9.132e-6 months <br /> VS. place one channel in trip. This way, TS 3.3.1 will not be distributed to the applicants and TRM doesnt compromise the other questions on the exam.
Stem o . e sen ence in the stem s ou e specific to say that the high voltage power supply has failed low. (the word degraded not necessary to satisfy the intent of the K/A wording and could be subjective)
Stem Focus: The it fill-in-the-blank statement.should be re worded (based on comment #2 above) as:
The IRM A power supply failure will cause a
- 4. Ensure no overlap w/ RC Question # 10 [215003 K4.04]
- 5. This question should be listed as MODIFIED (2010-2, Q#14, &
2010-1, Q#12)
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 79 H 2 x x N E 218000 A2.05 M 1. Stem Focus: The stem needs to somehow describe whether the entire panel 4B was lost or whether only one breaker from panel 4B tripped and resulted in the AUTO DEPRESS CONTROL PWR FAILURE annunciator alarming.
- 2. Cue: The specific breaker number (i.e., Circuit 11) and description of this load (ADS Relay Logic A & B and SRV p normal power supply breaker) is not necessary to elicit the correct answer, and could provide an answer to another test question.
- 3. Stem Focus: The 2 fill-in-the-blank statement should be
/ tightened to eliminate two correct answers. For example:
contains the step which provides the guidance to allow resetting the individual breaker that tripped in 125 VDC Panel 4B.
- 4. This question should be listed as MODIFIED (2010-2, Q# 25)
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LCD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward K/A Only 80 H 2 x x 241000 G2.4.9
- 1. Stem Focus: Instead of saying that UPS Panel 2A is ldst, simply state that all control rod positions are unknown Is LPC required if Panel 2A is lost because all rod positions are le2_Even if APRM power is L than 2%?
f\ / 2. Stem Focus: In order to fulfill the LPC requirements to
\. ,/ termination and prevent (i.e., Table 3 conditions), provide the Z following current parameters in the stem:
- RPV water level
- Torus temperature
- 3. Partial: Choice D can also be argued as correct because reactor power is not provided in the stem. Terminating and preventing is only required if reactor power is above 2% or cannot be determined.
Is reactor power above 2%? Include APRM power in the stem (assuming APRM5 are still available).
- 4. Stem Focus: The 2 fill-in-the-blank statement is çonfusing because the stem dbes not say that the SRO subsequently determined that ED was required (reason not important).
Chronology of events seems confusing. Suggest including a time line in the stem where the parameters are listed at one time and then the SRO determination that ED was required listed at a later time.
- 5. Stem Focus: The 2 fill-in-the-blank statement should be worded as: If none of the ADS valves can be manually opened during the emergency depressurization, THEN the crew is required to open the remaining non-ADS SRVs_______
- 6. Stem Focus: The 2 part of Choices C and D should be worded as and also perform AEDP.
- 4. Job Content Flaws 5. Other 6. 7. 8.
Job- Minutia #1 Back- Q= SRO B/M/N UIE/S Explanation Link units ward K/A Only 81 H 2 x 261000 A2.03 (2010-2 NRC EXAM, Q# 80 - IDENTICAL)
) This question overlaps w/ RO Question #26 (261000 K4.04) because it also tests the applicants knowledge of how 210 °F I affects the SBGT train.
Stem Focus: To be more precise as to exactly what the nd 2
fill in-the-blank is asking, suggest re-wording the 2 fill-in-the-blank as follows:
The procedure steps for manually opening the isolation valves to the SBGT deluge valves in order to allow water to flow inside the SBGTs is located in This question should be listed as BANK since it is the same as 2010-2, Q#80 82 H 2 x N U 263000 G2.4.45 Q=K/A: This question does not meet the K/A because it does
.11 not test the DC electrical distribution system. Instead, the proposed question tests the applicants knowledge that the HPCI FIC POWER LOSS annunciator means that HPCI is unavailable.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/E Focus Dist.
I Cred. Partial Job- Minutia #1 Back-Link units ward Q= SRO B/M/N U/E/S K/A Only Explanation 83 H 2 x N E 271000 A2.04
- 1. Stem Focus: The stem needs to specify what the SBGT system control switch positions are since the system is being operated for H PCI. That is, the applicants will ask the proctor what the position of the control switch is for the SBGT 1 B train.
- 2. Stem Focus: The 3 item in the stem (Stack Rad Levels rising) needs to include the unid# and a value (liCi, etc.) because this j1V is what the applic oj1cLseeJn-the-controLroi. [Comment previousiii5ii1fted during the assessment of the 10 sample questions.]
- 3. Stem Focus: Since the 1 st and 2 fill-in-the-blanks are noi) related, split out the fill-in-the-blank statement into two A statements.
Note to NRC: The SBGT train fans will automatically start if any of the following Secondary Containment isolation signals exist:
- Low Reactor Water Level LL#2
- High Drywell Pressure
- Reactor Building Ventilation Radiation 84 H 2 B 295004 02.1.23
- 1. Cred Dist: The 2fl part of Choices A and B (be in mode 3 w/I 12 hours1.388889e-4 days <br />0.00333 hours <br />1.984127e-5 weeks <br />4.566e-6 months <br />) is not plausible because the stem does not include any information or alarms related to H PCI. In order for the 2 part of Choices A and B to be plausible, there must be something to test the SRO applicants knowledge of HPClpe, which would make Action Statement B. 1 plausible.
Suggest revising the stem to include a previous alarm condition related to HPCI (such as one of the HPCI alarms on A-01). This will test the applicants ability to assess whether HPCI is also inoperable.
- 2. Ensure no overlap WI RO Q# 13 (217000 K3.01)
I
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LCD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q SRO B/M/N U/E/S Explanation Dist. Link units ward K/A Only 295006 G2.1.25 Cred Dist: Choice C (ED + alert) is not plausible because anytime an ED is required a site area emergency is also required.
- 2. Stem Focus: The word required should be inserted in the 2 fill-in-the-blank statement just before EAL.
Q=K/A: Ask the licensee to explain how the 295006 category is being tested in this question.
86 H 2 x 295010 G2.1.20
- 1. Cred Dist: The 1 part of choices C and 0 (stay in AOP-14 when drywell pressure/temperature is 7 psig) because concurrent execution of AOP-14 and PCCP is never done at Brunswick.
,c)
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem ICues T/F Cred. Partial Job- Minutia #1 Back B/M/N U/EIS Explanation Dist. Link units ward 87 H 5019 AA2.02 The 1st part of this question (loads on backup N2/PNS) overlaps w/ RO Q#47 (295O19G2i32)-_......
2n order to avoid providing another reference on the suggest testing the SRO applicants knowledge of whether an action statement in TS 3.6.3.1 Frimary Containment Oxygen.-
\. Concentration is/is not required to be en!.hiswillálso etedythe-bor.der.Iine-pIausibility-issueassociated with the 2 part of Choices B & D (reduce thermal power to 15% within 8 hours9.259259e-5 days <br />0.00222 hours <br />1.322751e-5 weeks <br />3.044e-6 months <br /> the action required when condition A is not met)]. Add a bullet to the stem that indicates primary containment oxygen concentration is currently LESS than 4 volume percent.
,d 2
Stem Focus: The sentence in the stem states that drywell pneumatics have been transferred; however, this is not clear with respect to whether PNS was cross-tied or RNA was used.
Step 3.2.2.2 of AOP-20 first directs opening PNS-CROSS-TIE VALVE PNS-SV-5804A. Step 3.2.2.3 then states if PNS System continues to degrade, then transfer drywell pneumatics to non-interruptible instrument air supply in accordance with 5t 1
00P-46, Section 8.17. The sentence in stem should state that the PNS leak cannot be repaired.
This question should be listed as MODIFIED (201 0-2, Q#18 &
2008-2, Q#48)
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
LOK LOD (F/H) (1-5) Stem Cues TIF Cred. Partial Job- Minutia #/ Back- Q SRO B/M/N UIEIS Explanation Focus Dist. Link units ward K/A Only 88 H 2 x B E 295025 EA2 03(2010 1 Q#88 IDENTICAL)
Stem Focus: The 2 bullet (reactor pressure band? is confusing because it is not a plant parameter. Re-word the 1 sentence (in order to clarify the list of plant conditions vs. a CRS-directed pressure band) as:
A reactor scram occurred on Unit I with the following conditions:
- Reactor power: APRMs ?%; rod positions all unknown
- Reactor pressure: one SRV open, the crew is maintaining reactor pressure between 800-1000 psig.
- Reactor water level:
- D,ywell Pressure:
- Supp pool pressure:
- Supp pool temperature:
- Supp pool level:
WOOTF choices completes both statements?
The procedure required for reactor pressure control is.
Based on these current conditions, the current reactor pressure band_________ acceptable.
A. RVCP;is B. RVCP;is not C. LPC; is D. LPC; is not
- 2. Stem Focus: It is not clear why the rod positions are unknown, and this is important because APRM indications should be provided in the stem.
inthe 10-question-sample-submittal, suggested providing the reference (HCTL) for this question, provided that the instruction for how to use the HCTL graph is omitted. This will allow testing the SRO applicants ability to use the graph without providing the sentence SELECT GRAPH LINE IMMEDIATELY BELOW SUPPRESSION POOL WATER LEVEL AS THE LIMIT.
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Focus Dist. Link units ward KJA Only 89 H 2 x x N U 295033 EA2.03 M 1. Q=K/A: The 2 portion of the question (the only portion that is SRO only) is not testing the K/A statement at the SRO level.
Another way of stating this is: Given that the 1 st portion of the question can be answered solely using RO knowledge, the K/A statement (ability to determine and/or interpret the cause of the high radiation) is not b.ing-tested-at.theSRO level. The SRO pojffiueIn must test the K/A atiheSRQ level.
/ggest revising the l part of the question to test the applicants ability to answer question SCCP-17 (IS A PRIMARY SYSTEM DISCHARGING INTO THE REACTOR BLDG?) This is a way of testing the applicants ability to interpret that the cause of the radiation directly relates to the SCCP implementation. Suggest copying a picture of the critical decision step SCCP-17 and pasting it into the stem and then est the applicants ability to answer this question as YES (Co or NO (incorrect).
- 2. Stem Focus: The fill-in-the-blank statement contains two separate thoughts; therefore, it should be split out into two nd 2
separate sentences. This will also allow modifying the part of the fill-in-the-blank statement to preclude an applicant appeal that Choice C (OP-37. 1, RB HVAC OP) is also correct because Step SCCP-12 states to restart RB HVAC (OP-37.1) or Per EOP-01 -SEP-04, if necessary. Revise as:
/n order to restart the Rx Bldg HVAC, the crew must use
- 3. This question should be listed as MODIFIED (2010-1, Q#58)
- 4. Job Content Flaws 8.
Explanation 295037 EA2.05 (2010-2 NRC EXAM, Q#92 - IDENTICAL)
- 1. Stem Focus: The 6 bullet in the stem usesi1iig. Replace with APRM downscale lights on the apron section of the RTGB.
- 2. Stem Focus: Re-word the fill-in-the-blank statement as Based on these conditions, the crew must use Section of LEP-02, Alternatq Control Rod Insertion.
Note to NRC: Choice A (de-energize scram pilot solenoids) can be eliminated because the stem states that the RPS lights are extinguished. (RO knowledge). Choice D (Use RMCS to insert rods) can be eliminated because the stem states that UPS is lost (RO knowledge). However, in order to select between Choice B (correct) and Choice C (incorrect), the applicant must have knowledge of the content of Section 4 of LEP-02, which does not include guide to iumper the high drywell pressure condition in the stem.
500000 EA2.01 600000 AA2.15 Cred Dist: Choice A (hourly watch in NRHR and continuous watch in SRHR) is not plausible because placing a more restrictive fire watch in SRHR does not make sense. The stem states that the NRHR sprinkler system is mop and the SRHR sprinkler system is operable.
Cred Dist: In order to make Choice D (hourly watches in both areas) plausible, insert the word MINIMUM right before the word required in the stem question.
- 4. Job Content Flaws 5. Other 6. 7. 8.
Job- Minutia #1 Back- Q= SRO B/M/N U/E/S Explanation Link units ward K/A Only x N E/U 700000 G2.2.42 Cred Dist: (borderline) The 2 part of Choice B and D (AOP 36.1) is not plausible because the stem does not provide any 4KV bus voltages.
- 2. SRO-only: The minimum required switchyard voltage is RD knowledge. This is a borderline SRO question. See suggestion below.
- 3. LOK: It seems that the proposed question is a lower cog question (which is acceptable); however, it is labeled as a higher cog question. The suggestion below is a higher cog question.
Suggest the following:
Units 2 is operating at rated power with full time load shedding in effect.
WOOT completes both statements in accordance with AOP-22, Grid Disturbances, and Tech Spec 3.8.1, AC Sources Operating? -.---
7 With full time load shedding, the minimum required switchyard
..voltage.is If Unit 2 switchyard voltage drops below this value, then the crew is required to enter Tech Spec 3.8., Required________
enprovided A. 225 kV; Action C B. 225 kV; Action E C. 223 kV; Action C D. 223 kV; Action E
- 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues TIF [Cred. Partial Job- Minutia #/ Back- Q= SRO B/M/N UIEIS Explanation Focus jThst.Unk 94 F 2 x x N U G2.1.42
- 1. Cred Dist: The 2 part of Choice A and C (one copy) is not plausible because the fill-in-the-blank statement says at least copy. An applicant can logically deduce, Why would they e askin how many co ies were rswer cant be one. Commort sense can be used to eliminate the 2 ptlice A and C because at least one copy is always needed to move fuel.
- 2. Stem Focus: The l fill-in-the-blank is essentially testing whether or not a spotter is required. This can be streamlined in all four choice st changing the question to test Za ion where fuel is t
U / being moved IN THE FUEL POOL ONLY. Test the applicants
( knowledge of whether or not a spotter is required and w4other c,
. -. or not a-Gopy.Gf4hefoel-m ovemeRIeet-isr.eqwredJn1ba..op Rtfl4oom.
95 H 2 x B E G2.2.1 9 Stem Focus: The fill-in-the-blank statements and choices can be streamlined and plausibility of distracters enhanced as follows:
Unit Two is operating at rated power with Core Spray Pump 2A under clearance for pump replacement.
The North RHR Room Cooler was subsequently determined to be inoperable.
WOOTF completes both statements below in accordance with WCP-NGGC-0300, Work Request Initiation, Screening, Prioritization, and Classification?
The highest required work order priority for the North RHR Room Cooler repair is Given this priority, actual work on the North RHR Room Cooler can A. 1; ONLY begin after work order planning B. 2; ONLY begin after work order planning C. 1; begin immediately in parallel with work order planning
- 0. 2; begin immediately in parallel with work order planning
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q SRO B/M/N UIE/S Explanation Focus Dist. Link units ward K/A Only 96 F 2 x B E G2.2.38 Stem Focus: The question is confusing because it mixes two different requirements, and the 2 fill-in-the-blank doesnt specify the requirement being referred to.
Suggest the following to ensure clarity and preclude any post-exam appeals:
WOOTF completes both statements? (Consider each statement separately.)
lAW Tech Spec 5.2.2, Facility Staff, the shift crew composition may be less than the minimum requirement of 10 CFR 50.54(m)(2)(i) and Specifications 5.2.2.a and 5.2.2.g for a period of time not to exceed______ for an unexpected absence of on duty shift crew members.
lAW OPS-NGGC-1000, Fleet Conduct of Operations, the minimum required number of auxiliaty operators for manning a shift at BNP is
- 4. Job Content Flaws 5. Other 6. 7. 8.
Job- Minutia #/ Back- 0= SRO B/MIN U/E/S Explanation Link units ward K/A Only 97 H 2 10-2 NRC EXAM, Q#99 lDENTlCAL;)
2010-1, Stem Focus: Choice D (RCS & containment) is not plausible because IF the applicant (incorrectly) chose both 27 RIhr (RCS) and Containment (20,000 RIhr) as being exceeded, THEN he/she would also HAVE to pick the middle number (clad-2000 RJhr). Therefore, the applicant can successfully eliminate I. Choice D without ever having to read the rad meter picture,
/ solely based on the numbers listed in Table F-i. See suggested remedy below.
- 2. Stem Focus: Modify the question to include APRM power level and mode switch position (shutdown). (conflicting)
Suggest the following changes:
WOOTF identifies whether any fission product barriers are lost or are potentially lost IA W OPEP-02. 1, BNP Initial Emergency Action Level Matrix?
A. None of the barriers are lost.
B. Lost Fuel Clad and RCS barriers ONLY C. Lost Fuel Clad and RCS barriers. Containment Barrier potentially lost.
D. Lost Fuel Clad barrier ONLY
- 1. 2. 3. Psychometric Flaws 4. Job Content Flaws 5. Other 6. 7. 8.
Q# LOK LOD (F/H) (1-5) Stem Cues T/F Cred. Partial Job- Minutia #1 Back- Q= SRO BIM/N UIE/S Explanation Focus Dist. Link units ward K/A Only 98 H 2 x x B U G2.3.6
- 1. SRO-only: SRO clarification guidance document Section ll.D identifies one example of an appropriate SRO test item is to test the SRO applicants knowledge of the PROCESS for liquid release approvals, that is, test their knowledge of the release permit approval process. The proposed question does not test 4 the applicants knowledge of the release permit approval process. Instead, the proposed question provides the applicant with a copy of a procedure that states that the required recirc time for a tank is 4 minutes for each percent level in the tank and that the samlstream is required to run for a minimum of five minutes before gathering the sample. In order to get the correct answer, the applicant only has to perform math.
- 2. Cred Dist: Choices B, C, and D are not plausible because a calculated minimum required recirculation time value is not included in the stem.
Suggest writing a question to test the applicants knowledge of reporting requirements when a liquid release permit requirements were exceeded.
CAW d w fLt c ()
. i--- ,.,. - 4 J/ )
/
2 a //
JJ).?/
J
/ /J 7// -v/ /
41
/J)
- 4. Job Content Flaws 8.
Explanation LOD=5: The proposed question should include a Tech Spec reference to the applicants because 1) knowing 1 hour1.157407e-5 days <br />2.777778e-4 hours <br />1.653439e-6 weeks <br />3.805e-7 months <br /> action statements from memory is LOD = 5. During a post-exam appeal, an applicant can successfully argue that this question tests memory at LOD = 5. However, providing the entire TS 3.3.3.1 makes this question a direct lookup. See suggestion below.
The proposed question was listed as a higher cog question; however, it appears to be lower cog.
Suggest testing the SRO applicants knowledge of the differences between the instruments associated with the TRM and Tech Specs as follows:
/vooTF is a component listed in Tech Spec 3.3.3.1, Post Accident Monitoring Instrumentation?
A. Drywell high-range radiation monitors B. SRV position indication C. Suppression chamber atmosphere temperature D. DiywelI and suppression chamber H202 monitors Stem Focus: Because the upper and lower wind directions in the stem are different, the applicant is being tested on which wind direction value is required to be used on Attachment 2, i.e.,
whether or not Zone L is required to be evacuated. Suggest streamlining the 1 st fill-in-the-blank statement to simply test whether or not Zone L is required to be evacuated.
I
- 2. Ensure that the 1 page of PEP-O..628 is distributed as a reference. (fl 2
page not necessary).
ES-403 Written Examination Grading Form ES-403-1 Quality Checklist
/
Facility: Date of Exam: Exam Level: RO SRO Initials Item Description a b c
- 1. Clean answer sheets copied before grading A -
- 2. Answer key changes and question deletions justified and documented ovvI
- 3. Applicants scores checked for addition errors r ,)
(reviewers_spot_check>_25%_of_examinations)
- 4. Grading for all borderline cases (80 +/-2% overall and 70 or 80, j ,?3<
as applicable, +/-4% on the SRO-only) reviewed in detail 1AI
- 5. All other failing examinations checked to ensure that grades are_justified
/LI/, \ /_)/4
- 6. Performance on missed questions checked for training ,//
deficiencies and wording problems; evaluate validity /4 of_questions_missed_by_half or more of the_applicants Printed Name/Signature Date
- a. Grader 1/3/Is
/
4/!,i
- b. Facility Reviewer(*) 7
- c. NRC Chief Examiner(*) ?P&
- d. NRC Supeisor (*) I /i/J
(*) The facility reviewers signature is not applicable for examinations graded by the NRC; two independent NRC reviews are required.