ML082750587

From kanterella
Jump to navigation Jump to search
09-Draft OP Test Comments
ML082750587
Person / Time
Site: Arkansas Nuclear  Entergy icon.png
Issue date: 09/05/2008
From: Brian Larson
NRC Region 4
To:
References
Download: ML082750587 (9)
v • d • e


Text

AN1 - SEP - 2008 DRAFT OPERATING TEST COMMENTS ADMIN JPMS

4. Job Content
1. 2. 3. Attributes 6.

Errors 5.

JPM# Dyn LOD Explanation U/E/S (D/S) (1-5) IC Cues Critical Scope Over- Job- Minutia (See below for instructions)

Focus Steps (N/B) lap Link RO (A1) S 2 E 1. JPM says examiner will review Briefing Checklist-System Walkthrough Attach 6 with examinee -

this is not included in the JPM. Standard statement in all JPMs.

2. Is Initiating Cue adequate for examinee to identify 3 and only 3 valves? Yes - accept as is.

RO (A2) S X U 1. Initiating cue does not direct corrective action - just requires examinee to identify that all G2 rod motor temps are not enabled. Direction given via procedure step - accept as is.

RO (A3) S X U 1. Initial Task Conditions state data gathering up to step 2.6 is complete - should read through step 2.6 to make it inclusive of this step. Fixed

2. Include stop watch time in the initiating cue to eliminate the need for the examiner to inform the applicant during conduct of the JPM. Done
3. 41.36 seconds is .69 minutes, not .68. Thus, 95/9.69 = 9.80 Changed stop watch time to eliminate need for rounding.
4. Initiating Cue directs applicant to complete the surveillance test while steps 2.8 - 2.11 cannot be performed during the Admin JPM. Fixed on examinee handout
5. Step 4 Task Standard identifies issues to discuss - if all are not identified, does the applicant fail the JPM? (step is identified as C) made separate step to clarify the Critical Step RO (A4) S X U 1. Any required dose extensions have been processed and approved. Is this statement applicable for this task assuming the limit is 2 rem/year? Sentence deleted.
2. Step 2: 95/80 is 1.19, not 1.18. Conservative direction plus there is an acceptable range - accept
3. Step 3: 95/80.725 is 1.18, not 1.17 conservative Also, 300/80.725 is 3.72, not 2.96 corrected SRO (A4) S X U 1-2. Same as RO A4 same as RO A4
3. Step 3: first calc shows 60.725 vice 80.725. Fixed Also, 95/80.725 is 1.18, not 1.17 conservative.

Also, 300/80.725 is 3.72, not 2.96 fixed

4. JPM listed on ES-301-1 says A1JPM-SRO-SVY2 but on JPM title is A1JPM-RO-SVY2. accept SRO (A1) S X U 1. Renumber as A5. done
2. JPM KA and IR should match outline (2.1.23/4.3 vs 2.1.12/4.0) fixed
3. Step 1: Error #2-how plausible is 600 vs 615.85? Maybe 618.55 instead? Accept as is
4. Step 1: Only 2 of 4 are errors - other 2 are a result of carryover. Accept as is
5. What is acceptable band for %FP? (ie what if applicant discovers only 1 or 2 errors?) accept as is
6. Initiating Cue directs applicant to complete section 11.0 but JPM does not include this action. fixed SRO (A2) S U 1. Renumber as A6. done
2. Step 3 states Refer to Attach 3 should be Attach 6 (as correctly identified in the Standard) fixed
3. Initial Conditions states 100% for 215 days - what is the significance of 215 days? Accept as is
4. JPM missing actions from procedure step 6.6 - 6.8. JPM starts at step 6.8. accept as is SRO (A3) S X U 1. Renumber as A7. Done
2. Remove from Initiating Cue since he has found some errors. Do not need to cue the applicant that errors exist in the JPM. Done Also remove from the Initiating Cue the second bullet (this is the Task Standard). Done
3. Procedure step 1.2.2 is not signed off. Continuous action step - accept as is.
4. Redo Supp 11 page 3 of 19 (step 1.11.4 A and B are N/A but there are placekeeping marks )

done

5. Procedure step 2.27 is not included in key as incorrect and not included in JPM step 2 Standard.

Added 2.27 to step 2 standard.

6. Key and JPM standard dont address that Procedure step 3.1.1 (Supp 11 page 15) should not be 0 Page 1 of 9 OBDI 202 - IOLE Process

AN1 - SEP - 2008 DRAFT OPERATING TEST COMMENTS ADMIN JPMS

4. Job Content
1. 2. 3. Attributes 6.

Errors 5.

JPM# Dyn LOD Explanation U/E/S (D/S) (1-5) IC Cues Critical Scope Over- Job- Minutia (See below for instructions)

Focus Steps (N/B) lap Link N/A. Added 3.1.1 to step 2 standard

7. JPM Initial Task Conditions should match Examinees Copy (missing 100% power) fixed SRO (A5) S X U 1. Renumber as A8. done
2. JPM Initial Task Conditions should match Examinees Copy. fixed
3. Key is missing Time and Date for ALERT declaration. Accept as is - will be filled in by applicant
4. JPM step 5 - remove the word should from the Standard. done
5. Note after JPM steps 5 and 6 - direction should be from the SM, not the CRS. done
6. 1903.011M form - First block under Activate CNS should be N/A. fixed
7. Add Time blocks in JPM steps 3 and 6 to record duration from declaration to notification. done
8. 1903.011M form, step 3.2 should be N/A on the key. done
9. 1903.011M form, steps 4 and 5 - missing from the JPM. Revised to end JPM after informing CR
10. JPM step 3 - does Ops Mgt concur this step is Critical? Removed critical designation
11. JPM steps 3 & 6 - word Entry is misspelled (Entery) fixed
12. Reword JPM note after step 3 this EAL since ALERT is a higher done
13. There are two page 5 of 5s (delete second one) done Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.
1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment.
2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.
3. Check the appropriate box when an attribute weakness is identified:
  • The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.
  • The JPM does not contain sufficient cues that are objective (not leading).
  • All critical steps (elements) have not been properly identified.
  • Scope of the task is either too narrow (N) or too broad (B).
  • Excessive overlap with other part of operating test or written examination.
4. Check the appropriate box when a job content error is identified:
  • Topics not linked to job content (e.g., disguised task, not required in real job).
  • Task is trivial and without safety significance.
5. Based on the reviewer=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
6. Provide a brief description of any U or E rating in the explanation column.
7. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form. 0 Page 2 of 9 OBDI 202 - IOLE Process

AN1 - SEP - 2008 DRAFT OPERATING TEST COMMENTS CONTROL ROOM/IN-PLANT SYSTEMS JPMS

4. Job Content
1. 2. 3. Attributes 6.

Errors 5.

JPM# Dyn LOD Explanation U/E/S (D/S) (1-5) IC Cues Critical Scope Over- Job- Minutia (See below for instructions)

Focus Steps (N/B) lap Link S1 E 1. Need descriptions for acronyms/abbreviations (SEQ. OR, SY, etc.) refer to STMs

2. In Task Standard, add Reactor is manually tripped done
3. Initial Conditions do not identify what Mode and/or % power. done S2 X X U 1. Add step between JPM step 2 and 3 to identify the procedure transition. done
2. JPM step 8 Standard - add if applicable. Why make this step an unknown? Select the P36B as the initially running HPI pump and remove the ambiguity on steps 8-11. added info in cue and removed step 8 and evaluator cue
3. Add a JPM step for examinee to check RCP Seal Bleedoff temps <180F in accordance with procedure. done
4. Remove the THEN return CV-1206 OVRD pushbutton from JPM step 16 since it is step 17. done
5. JPM step 18 (critical) should be Adjust Pressurizer Level Controller Setpoint to 100 in accordance with procedure. Then existing step 18 becomes step 19. done
6. Remove step 9 title from the Initiating Cue. done S3 X U 1. JPM step 3 is not Critical - no effect if applicant does not attempt to close valve. fixed
2. Initiating Cue - do not inform applicant to respond to annuciator alarm since it is not alarmed when JPM starts. Inform applicant to respond to plant conditions. Alarm is in at start of JPM - accept as is.
3. Annunciator procedure step 2 is missing from JPM. fixed
4. JPM step 5 - why hand applicant the procedure? Not available in simulator? This is an AOP - accept as is
5. JPM step 6 - add note that applicant may attempt to close CV-1008 again. Accept as is
6. Turbine trip is auto with reactor trip at 38% power? (JPM step 9) yes - accept as is S4 X X U 1. If Examiner is going to inform applicant of breaker positions, then dont need to include them in the Initial Conditions. (B-6255, B-5255, B-5651). Left in Initial Conditions and removed examiner cues
2. After JPM step 12 - add note that applicant may clear personnel from the A DH Vault prior to starting P-34A in accordance with WARNING statement in procedure. done
3. JPM step 14 - remove CV-3840 from first sentence since it did not open. done
4. JPM step 17 - how long does applicant have to secure pump? Before reaching a certain bearing temp? What is the success criteria for this Critical step? Prior to pump trip S5 X U 1. JPM step 4 & 5 & 11 - add to Standard without overshooting target setting in accordance with Note in procedure. done
2. JPM step 4 & 9 - where is the requirement to hold at 5 kw for 10 minutes? Removed 10 min statement from JPM steps
3. After JPM step 5, add step for applicant to record initial time at 10 kw per procedure.

done

4. After JPM step 9 - need steps to raise power to 10 kw and record initial time at 10 kw.
5. JPM step 12 - add to Standard Attachment B, page 1) fixed
6. Change Task Standard and JPM steps 12 & 13 to 57.5-58.5 kw. done S6 E/U 1. At what rate does the DG1 load rise? Viewed during onsite validation 0 Page 3 of 9 OBDI 202 - IOLE Process

AN1 - SEP - 2008 DRAFT OPERATING TEST COMMENTS CONTROL ROOM/IN-PLANT SYSTEMS JPMS

4. Job Content
1. 2. 3. Attributes 6.

Errors 5.

JPM# Dyn LOD Explanation U/E/S (D/S) (1-5) IC Cues Critical Scope Over- Job- Minutia (See below for instructions)

Focus Steps (N/B) lap Link

2. Procedure step 7.10 should be marked N/A (not have an open circle). fixed
3. What is the DG1 trip setpoint? If the applicant has too much time, then the failure should occur some time after the output breaker is closed. Modified fault during onsite validation. Wording of JPM steps is adequate. Identified success criteria for step 5.

S7 X U 1. In Initiating Cue - add RPS prior to Channel A done

2. Add note prior to JPM step 1: If asked, inform the examinee that the SM has suspended the SRO peer check. (see procedure Note.) added to initiating cue.
3. JPM step 2 - how is this step Critical? No affect if applicant does not perform. Modified JPM initial conditions to make this step critical
4. JPM step 3 - add For RPS Channel A, momentarily depress. in both the Performance and Standard columns. fixed
5. JPM is NOT ACCEPTABLE. Only two action steps, only one of which is Critical. Revise or replace JPM. Revised JPM so it is acceptable S8 X E/U JPM replaced due to overlap with audit exam
1. JPM step 1 Standard - change P-33A to P-33B (per the Initial Conditions)
2. Is JPM step 9 applicable? How long does the applicant have to isolate letdown prior to reaching the high temp isolation? If this step is performed, is it not Critical?

S9 X U 1. Renumber as P1. done

2. KA & IR on JPM do not match the outline. fixed
3. Reword the Initiating Cue for complete sentences. Accept as is
4. Procedure step 14.1 should NOT be marked off as complete. fixed
5. JPM step 1 - change Performance wording to match procedure step 14.1.5 accept as is
6. JPM step 1 - add to the Standard to the discharge flume by slowly openingaccept as is
7. Move Instructor Note after JPM step 1 to after JPM step 2. done
8. JPM step 2 Standard - procedure states valve must be unlocked - add to JPM. done
9. Procedure step 14.1.7 - what fluid is being pumped? semantics - no changes reqd
10. JPM step 3 - where is the applicant supposed to place the pyrometer? Add to Standard. Accept as is S10 X X U 1. Renumber as P2. done
2. Reword the Initiating Cue for complete sentences. fixed
3. Will cabinets be opened during the conduct of this JPM? Yes If not, why not?
4. Procedure step 12.5.2 states . pull the Programmer Control Assembly 120V BUS 2 (F-3) fuse. This does not match the Standard for JPM step 6. fixed
5. JPM Initiating Cue does not match the Examinee Copy. fixed S11 X U 1. Renumber as P3. done
2. Initial Conditions do not match. fixed
3. Add Note after JPM step 2 that applicant should determine that RI-4830 is NOT inoperable. done
4. JPM step 6 - change Standard to match procedure (while monitoring FR-4831, slowly 0 Page 4 of 9 OBDI 202 - IOLE Process

AN1 - SEP - 2008 DRAFT OPERATING TEST COMMENTS CONTROL ROOM/IN-PLANT SYSTEMS JPMS

4. Job Content
1. 2. 3. Attributes 6.

Errors 5.

JPM# Dyn LOD Explanation U/E/S (D/S) (1-5) IC Cues Critical Scope Over- Job- Minutia (See below for instructions)

Focus Steps (N/B) lap Link operated.) accept as is

5. How does this JPM end? Cue in step 6 says data recorded but this isnt done until release is terminated?? fixed Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating tests. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.
1. Determine whether the task is dynamic (D) or static (S). A dynamic task is one that involves continuous monitoring and response to varying parameters. A static task is basically a system reconfiguration or realignment.
2. Determine level of difficulty (LOD) using established 1-5 rating scale. Levels 1 and 5 represent inappropriate (low or high) discriminatory level for the license being tested.
3. Check the appropriate box when an attribute weakness is identified:

$ The initiating cue is not sufficiently clear to ensure the operator understands the task and how to begin.

$ The JPM does not contain sufficient cues that are objective (not leading).

$ All critical steps (elements) have not been properly identified.

$ Scope of the task is either too narrow (N) or too broad (B).

$ Excessive overlap with other part of operating test or written examination.

4. Check the appropriate box when a job content error is identified:
  • Topics not linked to job content (e.g., disguised task, not required in real job).
  • Task is trivial and without safety significance.
5. Based on the reviewer=s judgment, is the JPM as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?
6. Provide a brief description of any U or E rating in the explanation column.
7. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form. 0 Page 5 of 9 OBDI 202 - IOLE Process

AN1 - SEP - 2008 DRAFT OPERATING TEST COMMENTS SCENARIOS Scenario 1. 2. 3. 4. 5. 6. 7. 8. 9.

10. Explanation (See below for instructions)

Set ES TS Crit IC Pred TL L/C Eff U/E/S 1 X X U 1. Turnover states Mabelvale 500 kV line is down but scenario narrative says Mayflower 500 kV line. fixed

2. Narrative states under severe thunderstorm warning - this is the same as Scenario 2.

Since it has no impact on this scenario, remove. done 2a. Need all data (partially complete surveillance, turnover sheets, etc) given to crew at watch turnover. ok

3. Scenario narrative states CRS should ref the ACA - should this be the ATC? Not at AN1 - CRS directs annunciator corrective actions
4. Initial Conditions state ULD is failed and will not lower power - narrative and event description (D-2) do not address ULD failure. fixed
5. Add detail from 1203.045 Step 5 during down power (Event 3/4) done
6. Why is notification of load dispatcher of down power in the 1103.006 (RCP Operation) procedure and not in the 1203.045 (Rapid Plant Shutdown) procedure? AN1 format
7. What is the basis for the two minutes to trip the reactor following loss of H2 bus? Ops Department Rep to define
8. All procedure transitions should be identified in the D-2s, especially EOPs. Identify transition to 1202.001 after manual reactor trip. done
9. Add 1202.001 Step 7 to the D-2 (since Emer Boration is not expected to be in op) no longer applicable - changed scenario
10. Event 5/6 - add that both SG levels should be less than or equal to 410 inches done
11. Event 5/6 - add that IA header press should be > 75 psig done
12. Event 5/6 - add that SG press greater than or equal to 900 psig done
13. Event 5/6 - add that MFW pumps run back and then operate to maintain greater than or equal to 70 psid done
14. Event 5/6 - add RCS press > 1700 psig done
15. Event 5/6 - add PZR level control valve maintains > 55 inches done
16. Event 5/6 - add RCS T-cold remains greater than or equal to 540 F done
17. D-1 Event 7 states 200 gpm leak, narrative states 300 gpm, D-2 Event 7 states 200 revised scenario to 700 gpm leak
18. Event 7 - add WHEN associated BWST Outlet is open, THEN to the CT action. No longer applicable due to scenario changes
19. Event 7 - add IF PZR level or RCS pressure continues to drop, THEN open additional HPI Block valves No longer applicable due to scenario changes
20. Event 7 - Is RT-2 implemented if and only if PZR level < 30 inches? Yes or if press drops to below 1700 psig
21. Event 7 - does 1202.001 Steps 34.B, C, and E require entry into 1203.039, Excess RCS Leakage (to be performed in conjunction with 1202.001)? yes but no longer applicable due to scenario changes
22. Event 7 - What is entry conditions for RT-3? Once-through-cooling
23. Event 7 - will event lead to entry conditions for RT-9? RT-2 incorporates RT-9
24. Event 7 - How long (minutes) will applicants have to initiate HPI before ESAS actuates for a 200 gpm leak? 300 gpm? What leak rate was used to validate this scenario? No longer applicable due to scenario changes 0 Page 6 of 9 OBDI 202 - IOLE Process

AN1 - SEP - 2008 DRAFT OPERATING TEST COMMENTS SCENARIOS

25. Event 7 - What is ES HPI pump? HPI pump used during ESAS
26. What was the scenario run time during validation? Scenario termination may not be when HPI is initiated depending on scenario duration. No longer applicable due to scenario changes - time validated during validation week 2 X U 1. Event 2/3 - this is only one event. The only operator action to correct is attempting to open the service water valve. This is supported in that Event 2 is not listed on the ES-301-5, Transient and Event Checklist. Renumber this as Event 2 and renumber subsequent events (3-9). done
2. Event 2/3 - Is the Annunciator Corrective Action the governing procedure or is there an AOP? If so, all procedure transitions should be identified in the D-2s. ACA
3. Event 2/3 - why is it okay if the applicant attempts to secure the EDG by pushing the PB? Doesnt this demonstrate lack of system knowledge? No - cause of the auto start is unknown. Accept as is.
4. Event 2/3 - Are there any other 1-2 hr TS Action Statements associated with loss of the EDG? TS 3.8.1 Condition B
5. Event 2/3 - event termination will be at the discretion of the Chief Examiner, not when EDG is in lockout (to allow time for TS) OK
6. Event 2/3 - narrative says crew should take #1 EDG to lockout is this #2 EDG?

fixed

7. Event 2/3 -do the actions of the crew to take the EDG to lockout satisfy the Critical Task definition (significant degradation in the mitigation capability of the plant)? No
8. Event 4 - both Scenario 1 and 2 have Rapid Plant Shutdowns - can one be rapid and the other a normal plant shutdown per 1102.010? accept as is due to limited time
9. Event 4 - 700 Mwe = what percent power? 100% = 900 MWe
10. Event 5 - Any key annunciators or indicators that should be listed for this event?

Added to D-2

11. Event 5 - include steps for procedure step 1A, B, and C after procedure entry.

Accept as is.

12. Event 5 - Is procedure step 8.B applicable in this scenario? no
13. Event 5 - Why does procedure 1203.047 Step 8.D finish with while continuing with this procedure when this is the last step in the procedure? AN1 procedure guidelines
14. Event 5 - How is step 9.2 of procedure 1105.006 accomplished? Step 9.2.1 is not successful does the D-2 need expected actions for step 9.2.2? no - accept as is
15. Event 6 - add 1202.001 steps 4-8. not required due to floating step in 1201.001
16. Event 7/8 - while the crew should attempt to start the #1 EDG, what procedure guidance will they follow to do that? If they follow 1202.001, it appears the procedure transition is to 1202.008, Blackout (see step 8.D RNO). 1202.001 Step 1 is verify so they will start EDG 1 if not running
17. Event 7/8 - Provide exact wording of the Station Blackout EAL to determine adequacy of CT description. done
18. Event 7/8 - how low is the #1 EDG voltage when manually started? Out of green band
19. Event 7/8 - Add the title Evaluator Note to the U2 will report block and add If requested, U2 will report accept as is
20. Event 7/8 - Is P36B Bus Select MOD Control originally selected to bus A3 or A4? A3
21. Event 7/8 - A4 powers which ATM Dump Vlv? Any concern that associated SG press will be > 1040 psig? (Step 1, RNO Step H.3) No 0 Page 7 of 9 OBDI 202 - IOLE Process

AN1 - SEP - 2008 DRAFT OPERATING TEST COMMENTS SCENARIOS

22. Event 7/8 - p 12: third step says Actuate EFW and MSLI for both SGs Procedure 1202.007 Step 2 just says Actuate MSLI for both SGs. fixed
23. Event 7/8 - if verify means to check or take action, why does procedure 1202.007 step 11 say Place OR verify the following handswitches procedure enhancement opportunity
24. Event 9 - Blackout procedure step 1 - missing from D-2? fixed
25. Event 9 - Blackout procedure step 6 - substeps missing from D-2? (Cond/ICW pumps) no - completed in degraded power event - accept as is
26. Event 10 - this is not a separate event. This is recovery actions from station blackout. Remove from D-1 and put actions in Event 9. done Event 10 - Identify transition to Step 2.A not required - accept as is
27. Event 10 - Why energize A3? Due to equipment lineup A3 is preferred Is A4 an option? yes Also, what is 20 min of losing #1 EDG CT criteria based on? Ops department rep to review criteria basis
28. Scenario terminates when A3 energized from AAC gen AND procedure transition to 1202.007 announced. done 3(B/U) X U Event 1 - what procedure? Added to D-2 Event 2 - TS call is a direct lookup with no recovery actions (non-discriminatory event) replaced event Event 3/4 - Procedure 1203.045 steps 3 and 4 are out of order in the D-2. fixed Event 3/4 - Procedure 1203.045 step 5 is missing step to stop the Htr Drain Pmp AN1 procedure style - accept as is Event 3/4 - what procedure directs checking Htr Drain Pmp for reverse rotation? Accept as is Event 5/6 - D-2 p. 8 has action to Recognize and report a loss of offsite power? fixed Also, two entries exist for Direct operations per 1202.001 Reactor trip. fixed Event 5/6 - D-2 p. 9 (procedure step 17) procedure says maintain SG press 970-1020 but D-2 says 950-1020. procedure revised - 950 is correct Event 5/6 - procedure step 32 missing from D-2 fixed Event 7/8 - is procedure 1202.006 step 39 applicable? no Instructions for Completing Matrix This form is not contained in or required by NUREG-1021. Utilities are not required or encouraged to use it. The purpose of this form is to enhance regional consistency in reviewing operating test scenario sets. Additional information on these areas may be found in Examination Good Practices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space provided.
1. ES: ES-301 checklists 4, 5, & 6 satisfied.
2. TS: Set includes SRO TS actions for each SRO, with required actions explicitly detailed.
3. Crit: Each manipulation or evolution has explicit success criteria documented in Form ES-D-2.
4. IC: Out of service equipment and other initial conditions reasonably consistent between scenarios and not predictive of scenario events and actions.
5. Pred: Scenario sequence and other factors avoid predictability issues.
6. TL: Time line constructed, including event and process triggered conditions, such that scenario can run without routine examiner cuing.
7. L/C: Length and complexity for each scenario in the set is reasonable for the crew mix being examined, such that all applicants have reasonably similar exposure and events 0 Page 8 of 9 OBDI 202 - IOLE Process

AN1 - SEP - 2008 DRAFT OPERATING TEST COMMENTS SCENARIOS are needed for evaluation purposes.

8. Eff: Sequence of events is reasonably efficient for examination purposes, especially with respect to long delays or interactions.
9. Based on the reviewer=s judgment, rate the scenario set as (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory.
10. Provide a brief description of problem in the explanation column.
11. Save initial review comments as normal black text; indicate how comments were resolved using blue text so that each JPM used on the exam is reflected by a (S)atisfactory resolution on this form. 0 Page 9 of 9 OBDI 202 - IOLE Process
Retrieved from "https://kanterella.com/w/index.php?title=ML082750587&oldid=2152747"