ML16152A280
| ML16152A280 | |
| Person / Time | |
|---|---|
| Site: | Diablo Canyon  |
| Issue date: | 04/25/2016 |
| From: | Vincent Gaddy Operations Branch IV |
| To: | |
| References | |
| Download: ML16152A280 (12) | |
Text
DC-2016-04 DRAFT OPERATING TEST COMMENTS ADMIN JPMS
- 4. Job Content
- 1. 2. 3. Attributes 6.
Errors 5.
JPM# Dyn LOD Explanation U/E/S (D/S) (1-5) IC Cues Critical Scope Over- Job- Minutia (See below for instructions)
Focus Steps (N/B) lap Link General comments: Please review the JPMs and ensure typos are corrected and that the final product exhibits sufficient attention to detail. Especially on the final product that is given to applicants, i.e. cue sheets and handouts, please take the time to ensure that punctuation and format are appropriate.
Task standards need to be tied directly to the critical steps of the JPM. Need to be sure that task standards have sufficient specificity regarding what actions must be completed and to what extent.
RO (A1) S 2 X ? U Another version of this JPM, NRCL091, is included in the submittal. Was this JPM previously used?
The applicant has to look up ARO on the handout, identify 230, and then transcribe numbers. Then they copy the 0% power rod insertion limit (given on the COLR graph in parenthesis). The only analysis is to subtract 100 from the given ECP for ECP-100, and then subtract the overlap for each group and hold in 50 step increments. There is even a sample given for the applicant to follow that shows you how to do everything - without the sample, the JPM might be LOD-2.
R
- Replace with modified Channel Check JPM which incorporates graphics. Candidate is required to determine if S/G and Pzr Level indications channel check within acceptable range of DCPP Ops Policy.
RO (A2) S 2 U The majority of the JPM, including the two parameters that are determined to be unacceptable, is looking at values given in the cue and comparing them to acceptance criteria. Otherwise, they have to know that 5 days and 12 hours1.388889e-4 days <br />0.00333 hours <br />1.984127e-5 weeks <br />4.566e-6 months <br /> is 132 hours0.00153 days <br />0.0367 hours <br />2.18254e-4 weeks <br />5.0226e-5 months <br /> and then look on the graph with the cue-given number of fuel assemblies.
DC to provide screen shots and turnover logs, more info to interpret.
- Modified to use screen shots of Control Room Vertical Board #1 for CCW Temperature and Aux Watch rounds for Spent Fuel data.
RO (A3) S 2 U The applicant does not have to, as the JPM title states, determine any clearance points. They just need to identify what is wrong with the clearance. Further, the clearance is extremely simple - one breaker and one valve for each screen. Need a slightly more challenging clearance and to have the applicants actually identify the necessary clearance points.
DC give us a bank JPM that they have looked at.
- Replaced with Clearance for Spent Fuel Pool pump. Requires candidate to evaluate drawing and procedure to come up with appropriate points, position, and tagging.
RO (A4) S 2 X E Handout needs to be the entire RWP procedure, not just the section that points out what is applicable to the JPM.
The term normal TLD is a cue to the applicant to look at TLD requirements. Simply state that the WCL has obtained a PED - having a normal TLD is required to obtain it.
DC to provide a survey map with stay time or something like that with synthesis.
- Revised to use survey map, RWP, and NRC Form 4 data. Candidate must determine if RWP appropriate for work scope specified and identify areas of deficiency. 0 Page 1 of 12 OBDI 202 - IOLE Process
DC-2016-04 DRAFT OPERATING TEST COMMENTS ADMIN JPMS
- 4. Job Content
- 1. 2. 3. Attributes 6.
Errors 5.
JPM# Dyn LOD Explanation U/E/S (D/S) (1-5) IC Cues Critical Scope Over- Job- Minutia (See below for instructions)
Focus Steps (N/B) lap Link S JPM is now SAT.
SRO (A5) S 2 U Same concerns as with A1.
DC working.
- Replace with Heatup Rate calc (modified from previous NRC exam).
SRO (A6) S 2 U Same concerns as with A2 DC to put wrong entries that applicant has to catch with synthesis required.
- Modified to use screen shots of Control Room Vertical Board #1 for CCW Temperature and Aux Watch rounds for Spent Fuel data (same changes as used for A2)
SRO (A7) S 2 U Same concerns as with A3.
DC to provide more robust tagout.
- Replaced with Clearance for Spent Fuel Pool pump. Requires candidate to review prepared clearance, and identify errors based on drawing and associated procedures.
SRO (A8) S 3 X E Delete the cue statement regarding the operability of RE-22. This can be determined by looking at the rad permit.
Is the permit expiration date (April 20 vice April 22) really a critical step if the release is scheduled for April 16?
DC to make repairs for these two comments.
- Revised to incorporate comments above.
SRO (A9) S 3 U Task is to transpose information from the cue onto the notification form. The one piece of information that must be determined (release in progress) is a very straightforward 2-step flow chart that explicitly identifies a SGTR with RCS > 200F as a release in progress.
DC to look at EAL call different from written exam question.
- Replaced with classification JPM.
Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.
- 1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is 0 Page 2 of 12 OBDI 202 - IOLE Process
basically a system reconfiguration or realignment.
- 2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.
- 3. Check the appropriate box when an attribute weakness is identified:
- The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.
- The JPM does not contain sufficient cues that are objective (not leading).
- All critical steps (elements) have not been properly identified.
- Scope of the task is either too narrow (N) or too broad (B).
- Excessive overlap with other part of operating test or written examination.
- 4. Check the appropriate box when a job content error is identified:
- Topics not linked to job content (e.g., disguised task, not required in real job).
- Task is trivial and without safety significance.
- 5. Based on the reviewer=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 6. Provide a brief description of any U or E rating in the explanation column.
- 7. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form. 0 Page 3 of 12 OBDI 202 - IOLE Process
DC-2016-04 DRAFT OPERATING TEST COMMENTS CONTROL ROOM/IN-PLANT SYSTEMS JPMS
- 4. Job Content
- 1. 2. 3. Attributes 6.
Errors 5.
JPM# Dyn LOD Explanation (D/S) (1-5) IC Cues Critical Scope Over- Job- Minutia U/E/S (See below for instructions)
Focus Steps (N/B) lap Link S1 D 2 X E JPM Step 12: Evaluator should not have to cue applicant as to when he/she should divert. Change cue to If asked: what do you recommend?).
- Revised cue; now asks examinee to recommend an action.
The procedure transition for Alt path does not really exist as written.
- Added OP1.DC10, Conduct of Operations implementation as transition point for Alternate Path.
JPM standard needs to be more clear on what is actually required for stopping the dilution. I believe that shutting the valve and securing the pump is necessary (discuss).
- Revised Task Standard to explicitly identify combination of three possible operator actions (close FCV-111A, close FCV-111B, stop makeup water pump) as an AND/OR statement.
JPM Step 13: References step 6.6.14, but actual step in reference provided is 6.6.15.
DC to add conduct of ops for alt path procedure transition.
- Revised procedural step linkage to address mismatch.
S2 D 3 X U JPM Step 5: Cues cannot direct the alternate path re-establish injection.
Remove the cue and allow the applicant to determine what pumps need to be restarted. You cant cue them to perform the steps in the alt path to. Remove this cue.
- Revised cue; If prompted, response is to ask examinee to recommend course of action.
Task standard is poorly written. It needs to state what is actually required to be successful, such as turning level trend back in the up direction by re-establishing injection, and prior to level XX being reached or at what level does LOCA signal re-initiate? Need to change task standard to clearly state what the minimum criteria is, in terms of pumps started or plant parameters, for the standard to be met. Needs to match the critical steps.
DC to adjust task standard and crit steps.
- Revised Task standard to explicitly specify pumps and valve positions required to meet critical steps. Completion of critical steps now bounded by loss of subcooling (subcooling below Lo Lo Margin of 20oF)
S3 S 2 X U Step 3: Which IC set is being used. Note says IC 219, but setup says IC 157. Would breakers normally be racked-in in these circumstances? 0 Page 4 of 12 OBDI 202 - IOLE Process
DC-2016-04 DRAFT OPERATING TEST COMMENTS CONTROL ROOM/IN-PLANT SYSTEMS JPMS
- 4. Job Content
- 1. 2. 3. Attributes 6.
Errors 5.
JPM# Dyn LOD Explanation (D/S) (1-5) IC Cues Critical Scope Over- Job- Minutia U/E/S (See below for instructions)
Focus Steps (N/B) lap Link
DC to back them up, start at step 25 and close breakers (time compression), then later when try to isolate the accums the valve does not move on the one accum (valve stays open) then they take action to vent the one accum.
- Added Examiner note clarifying breaker normal state as OPEN.
- Start point of JPM now step 25 prior to closing of breakers.
Need to designate Steps 3 & 4 as critical.
- Added critical step designations (now 4.1, 5.1, 6.2, 6.3).
You cant cue them to the alt path in the initial conditions. Step cant be critical to close 8880 if it is already closed. Also you cant give them the cue that 8808C breaker didnt work because this cues that applicant to the alt path. There is a better way to create this JPM. When they go to close the valve have the breaker trip at that point and have them dispatch someone to check what happened.
- Changed initial conditions and malfunction so that 8808C starts to stroke, but fails midposition. Examinee will identify the failure based on valve position lights (RED and GREEN both on) and normal stroke time exceeded (the other 3 valves serve as a point of comparison). Also provided cue if operator sent to investigate; reports breaker tripped on thermal overload.
Task standard is wrong. Procedure step linkages are missing in the JPM standard.
DC to edit per comments.
- Revised task standard to reflect critical steps.
- Added procedure step linkages.
S4 D 2 U Are we tripping the AFW pump on examiner cue, or after a specific step? Need to designate in the JPM how/when this pump trip is to occur.
DC to add a note for examiners on what SG level it trips.
- Added Examiner Notes to identify what conditions cause AFW Pump trip (there are two cases now - one based on level, the other based on procedure flow path to ensure Examinee pace through JPM does not impact anticipated flow path.
You need to have the correct order for vent valve opening (A, D first, then B and C second) to meet procedure and probably vent valve functions.
- Broke sequence of Vent Valve opening down to match procedure steps.
For task standard how is it bounded? Which/how many PORVs and vents must 0 Page 5 of 12 OBDI 202 - IOLE Process
DC-2016-04 DRAFT OPERATING TEST COMMENTS CONTROL ROOM/IN-PLANT SYSTEMS JPMS
- 4. Job Content
- 1. 2. 3. Attributes 6.
Errors 5.
JPM# Dyn LOD Explanation (D/S) (1-5) IC Cues Critical Scope Over- Job- Minutia U/E/S (See below for instructions)
Focus Steps (N/B) lap Link be opened and before what?
Also the task standard needs to match the critical steps. Task standard needs lots of work.
- Task Standard revised. Specific valves and sequence added along with bounding procedural steps (starting S/G depressurization) that, if performed, result in worsening plant conditions.
S DC to edit with note for transition to step 20 actions (in task standard as well). By procedure all PORV and vents in proper sequence.
S5 D 3 E Should probably have in task standard Recognize that Aux Salt Wtr To CCW Ht Exch 1-1 Pressure is Lo and enter procedure OP E-5:II, Section 6.1, "Preferred Method".
- Operator in the control room does not have indications of Aux Salt Wtr to CCW Ht Exch 1-1 Pressure other than PK input (no PI); CCW Heat Exchanger outlet temperature is primary Control Room indication used to identify ineffective thermal transport. Modified Task Standard to reflect Control Room indications and associated operator response.
S6 S 3 E JPM Step 7 & 18: Why would the cue be necessary? If the simulator has the synch scope in the correct range, then no cue should be necessary.
DC to remove cue and adjust load to ensure the synch is inside the 11-1 window.
- Rebalanced loads to be within 11-1 window. Removed cue.
At the end of the JPM it seems like the breaker to trip (based on the initial cue and procedure step direction) is the 52-HG-13, Aux Xfmr 1-2 4kV Fdr to Bus G, breaker. Task standard should also state that G bus is transferred to SU power not Aux power, right?
- Rebalanced loads to be within 11-1 window. Removed cue
- See comment below regarding final alignment of Bus G.
DC to look at procedure offfline for future revisions. Meanwhile, the task standard modified to remove 4kV bus G is aligned to Auxiliary power.
- Task Standard modified to remove designation of final 4kV bus alignment (could be Aux or Startup, depending on which breaker Examinee opened during fault).
S JPM is now SAT. 0 Page 6 of 12 OBDI 202 - IOLE Process
DC-2016-04 DRAFT OPERATING TEST COMMENTS CONTROL ROOM/IN-PLANT SYSTEMS JPMS
- 4. Job Content
- 1. 2. 3. Attributes 6.
Errors 5.
JPM# Dyn LOD Explanation (D/S) (1-5) IC Cues Critical Scope Over- Job- Minutia U/E/S (See below for instructions)
Focus Steps (N/B) lap Link S7 S 2 E JPM Step 6: Cue should read that maintenance personnel will trip bistables and remove fuses. Currently, it just reads that the fuses will be removed.
DC to edit to match procedure.
S8 S 2 X X U Running a JPM that has a radiation monitor go into alarm and the answer being that the alarm was spurious seems out of place on an NRC exam. Would like to avoid any sense that this JPM is a trick question. If I am taking an NRC op test I am faced with a radiation monitor alarm as the starting point for a JPM, I would have a hard time just calling the alarm spurious, resetting it, and handing the cue sheet back to the examiner.
Task standard needs work anyway for the bank. There are typos in it, you need the procedure name or number in it to be complete.
Why does the AR-PK list step 2.1 as the applicable step for all the different inputs when in fact for 1066 input alarm the step is 2.4 to go to? This might be a bad procedure?
Overall, too much overlap with other portions of the exam and this Safety function, so DC to attempt to use either SF 5 or SF9 and come up with corresponding JPM.
Requires candidate to quench PRT, resulting in high level and the need to drain the tank to the Reactor Coolant Drain Tank (RCDT) (coordinated w/Aux Board). JPM is tied to plant OE and problems with over-filling the RCDT due to poor communication between Control Room and Aux.
P1 S 2 U For any electrical cabinets that would need to be opened, we will need a picture of the inside of the cabinet and the breaker in question. Need to avoid actually opening plant cabinets during the op test if possible.
Applicant has to find two breakers and open them. The breakers are in the same general area. Two step JPMs are unacceptable on any level (RQ or Initial) and OP Ex violations have been written for these in the past.
Considering P3, if the applicants had studied just their control room inaccessibility procedures, then they have 2/3 of their in-plant JPMs covered.
- Replaced with bank JPM to transfer PZR Backup Heaters to vital power source 0 Page 7 of 12 OBDI 202 - IOLE Process
DC-2016-04 DRAFT OPERATING TEST COMMENTS CONTROL ROOM/IN-PLANT SYSTEMS JPMS
- 4. Job Content
- 1. 2. 3. Attributes 6.
Errors 5.
JPM# Dyn LOD Explanation (D/S) (1-5) IC Cues Critical Scope Over- Job- Minutia U/E/S (See below for instructions)
Focus Steps (N/B) lap Link (SF3)
S P2 S 2 S P3 D 3 X E The cue given for procedure step 2k directs the operator on how to handle the next step.
For a JPM to be alternate path, the alternate path must be determined by the applicant.
DC to eliminate cue for zero voltage, put in notes for examiner to cue as HSDP operator, when asked panel info examiner will provide picture(s).
Created graphic showing interior of Hot Shutdown Panel with zero voltage reading on Bus F. Will use as part of cue.
Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.
- 1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment.
- 3. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.
- 3. Check the appropriate box when an attribute weakness is identified:
$ The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.
$ The JPM does not contain sufficient cues that are objective (not leading).
$ All critical steps (elements) have not been properly identified.
$ Scope of the task is either too narrow (N) or too broad (B).
$ Excessive overlap with other part of operating test or written examination.
- 4. Check the appropriate box when a job content error is identified:
- Topics not linked to job content (e.g., disguised task, not required in real job).
- Task is trivial and without safety significance.
- 5. Based on the reviewer=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
- 6. Provide a brief description of any U or E rating in the explanation column.
- 7. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form. 0 Page 8 of 12 OBDI 202 - IOLE Process
DC-2016-04 DRAFT OPERATING TEST COMMENTS SCENARIOS Scenario 1. 2. 3. 4. 5. 6. 7. 8. 9.
- 10. Explanation (See below for instructions)
Set ES TS Crit IC Pred TL L/C Eff U/E/S 1 E Overall: The D-1 does not have the CTs listed on it as the others do. DC to add.
Event 2: Applicant should be able to determine if requirements for mode 1 are met without cueing from SM. DC to modify cue.
- Modified cue to What do you recommend if asked.
Event 3: Is this event a component failure or instrument failure? Make it an I failure since it is controller related.
- Modified to Event Type - I on ES-D-1.
CTs: Is CT-20 contained within CT-21? How long will it take to get to 100% WR S/G level if CT-18, 20 & 21 actions are not performed? DC to look into combining CT 20 and CT21 into 1 CT. We will eval during validation week. DC to provide times without actions for CTs to verify CTs can be failed within the time frame of the scenario.
- Evaluation on Desktop Simulator indicates S/G would not reach 100% WR level within the time frame of the scenario. Discussed with NRC Chief Examiner for L141 exam. DCPP electing to have critical tasks bound by procedural process steps.
S Additional enhancements made during validation week. Scenario is now SAT.
2 E General: As a combined set of malfunctions, the first three events are very low level of difficulty - simple one-time actions to open heater breaker, stop CFCU, and adjust injection flow. High risk on first two events of ROs not taking any actions at all if heater breaker or CFCU trips automatically.
- See responses below for discussion.
Event 1: If breaker trips before ATC opens it, he/she will not receive credit for component failure. DC looking into timing of 30 seconds and if operationally valid to do this.
- Discussed failure w/Sim Specialist. Time to trip on ground is a function of numerous variables (type of ground, loads on circuit, condition of trip device etc). While uncommon to have ground for 30 seconds, it is not out of the question. Modified failure to have 30 second delay prior to trip.
Event 2: BOP will not receive credit for component failure if CFCU is not secured manually.
- Event has validated well thus far. Significant time is given for diagnostics and response (approximately 3 minutes from first alarm to highest temp and another 5 minutes before CFCU will trip off).
Event 3: Need a more dynamic event in the first three malfunctions. In general, the vast 0 Page 9 of 12 OBDI 202 - IOLE Process
DC-2016-04 DRAFT OPERATING TEST COMMENTS SCENARIOS majority of malfunctions throughout the scenarios are component failures. Perhaps replace with a dynamic instrument failure.
- Added additional failure of Letdown Pressure control valve to ensure BOP has extra opportunity for board manipulation. Failure also requires good diagnostics and control to restore letdown flow (pressure indication fails high and BOP must restore control to previous value using alternate indication such as letdown flowrate).
ATC/BOP teamwork required to re-establish PZR level.
Event 5: When is the crew expected to stop feeding the faulted SG? Eval during validation week..
- Faulted S/G is isolated in EOP E-2, Appendix HH.
CT: Are there manual actions required for isolating the faulted steam generator? If so, this should be considered a critical task. DC to look at WOG, etc.
- Have added isolation of faulted S/G as CT in FR-P.1. Bounding is based on the procedure step that checks RCS Hot Leg Temperature stable; requires re-verification of isolation before continuing on in procedure if temperature is falling.
Event 7-DC to revise scenario guide to remove phase A event due to overlap with scenario 5 and attempt to create an additional CT with the malfunction.
- Replaced phase A with AFW level control valve failed open to the faulted S/G.
Failure to close the valve results in excessive cooldown beyond that introduced by the fault itself. Isolation is part of the CT to isolate the Faulted S/G. Manual isolation of the valves will not be successful; mitigations requires crew to shutdown the S associated pump.
Additional enhancements made during validation week. Scenario is now SAT and will be used as the spare.
3 E Event 3: The TS call for this event is LOD-1. The only significant action required is for rods to be placed in manual and this is accomplished in the first step of the ARP. Need to choose an event with a more challenging TS call - we cannot use this as a basis for an SRO licensing decision, especially when combined with a straightforward ASW pump OOS 72-hr TS call. DC to add ECG call for RM-22.
- Added PT-474 failing low - Does not move the plant, but is very safety significant due to its interlock function (prevents two other PORVs from opening when actual pressure is high. Multiple TS calls.
Event 5: What is the basis for TCOA 67? If TCOA 67 requires all RCPs be tripped within 5 minutes of Phase B actuation, then should this be a CT or is it just for pump protection? DC to look at this.
CT36: When is transfer to cold leg recirc considered complete for the purposes of the CT? Need to know exactly when the task is satisfied, i.e. what equipment status or procedure step should we be looking at to verify cold leg recirc is in service. DC to update cold leg recirc definition in CT table and D-2.
- Added alignment and flow indication requirements associated with either train of 0 Page 10 of 12 OBDI 202 - IOLE Process
DC-2016-04 DRAFT OPERATING TEST COMMENTS SCENARIOS cold leg recirculation in service to ES-D-1 Critical Task table.
- Critical steps are identified as bolded red in procedure body with
- at end of step.
- Step in ES-D-2 corresponding to Critical Task completion is marked as follows:
(TCOA/CT completion time __________)
CT9: Change the statement in the summary and in the D-2 to state the number of ASW pumps that must be running to meet the critical task. Need to make this generic CT specific to the scenario. DC to update equipment definitions needed in CT table and D-2 for this CT as well.
S
Additional enhancements made during validation week. Scenario is now SAT.
4 E CT43: Need to be more specific regarding what actions must be completed.
- Added bulleted Performance Indicators into ES-D-1 Critical Task Table definition section.
- Identified Performance Indicators (bolded RED) in body of ES-D-2.
- Revised CT definition to capture plant conditions that would require transition to feed and bleed.
Also need to confirm that feed and bleed would still be an option for the crew with the PORVs isolated. I assume that they could be un-isolated for the purpose of feed and bleed in this case. In any case, we would not want to have a boundary condition for the CT that has no chance of ever occurring, so I need to be sure of this.
- Yes, all 3 PORVs are available. Both PORVs are isolated by their block valves only, and can be opened at any time.
S DC to update equipment definitions needed in CT table and D-2 for this CT.
Additional enhancements made during validation week. Scenario is now SAT.
5 E CT11: Need a specific list of valves that must be shut to meet the critical task in the official CT statement.
- Added list of specific valves to Critical Task Table in ES-D-1 for Scenario 5. Listed isolation of valve pair for a single penetration as one or the other required to be closed (and/or).
- Repeated specific valve list in Critical Task statement of ES-D-2 for Scenario 5 (pg 17 of 24)
S Additional enhancements made during validation week. Scenario is now SAT, but will not be used during April 2016 exam.
Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating test scenario sets. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.
- 1. ES: ES-301 checklists 4, 5, & 6 satisfied. 0 Page 11 of 12 OBDI 202 - IOLE Process
DC-2016-04 DRAFT OPERATING TEST COMMENTS SCENARIOS
- 3. Crit: Each manipulation or evolution has explicit success criteria documented in Form ES-D-2.
- 4. IC: Out of service equipment and other initial conditions reasonably consistent between scenarios and not predictive of scenario events and actions.
- 5. Pred: Scenario sequence and other factors avoid predictability issues.
- 6. TL: Time line constructed, including event and process triggered conditions, such that scenario can run without routine examiner cuing.
- 7. L/C: Length and complexity for each scenario in the set is reasonable for the crew mix being examined, such that all applicants have reasonably similar exposure and events are needed for evaluation purposes.
- 8. Eff: Sequence of events is reasonably efficient for examination purposes, especially with respect to long delays or interactions.
- 9. Based on the reviewer=s judgment, rate the scenario set as (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory.
- 10. Provide a brief description of problem in the explanation column.
- 11. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form. 0 Page 12 of 12 OBDI 202 - IOLE Process