ML062900360

From kanterella
Revision as of 10:15, 13 July 2019 by StriderTol (talk | contribs) (Created page by program invented by StriderTol)
Jump to navigation Jump to search
10-2006 - NRC Draft Exam Comments
ML062900360
Person / Time
Site: Cooper Entergy icon.png
Issue date: 11/10/2006
From:
NRC Region 4
To:
References
ES-401, ES-401-9
Download: ML062900360 (15)
v • d • e


Text

ES-401 COOPER NUCLEAR STATION-10-2006 Written Examination Form ES-401-9 Review Worksheet (password: lewisandclark) (TAC#: X02344 )

3. Psychometric Flaws
4. Job Content Flaws
5. Other Q# 1. LOK (F/H) 2. LOD (1-5) Stem Focus Cues T/F Cred.Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SROOnly 6. U/E/S 7. Explanation 1 H 3 Y S (M) 2 F 2 X Y E (N) CONSIDER DELETING DISTRACTOR A AND REPLACING THE DISTRACTOR WITH ANOTHER DISTRACTOR THAT INVOLVES A SYSTEM ENGINEER.

Changed 3 H 3 Y S (N) 4 F 2 U S (N) GFES QUESTION OK Licensee Explained 5 F 2 Y S (B) 6 F 3 X Y E (B) CONSIDER REWRITING THE DISTRACTORS TO READ AS FOLLOWS : A.

BOTH LOW-LOW SET VALVES CONTINUE TO CYCLE; B.

BOTH LOW-LOW SET VALUES STOP CYCLING; C. THE LOW-LOW SET VALVE (71F) , WHICH CAN BE CONTROLLED FROM THE ADS ROOM CONTINUES TO CYCLE; D. THE LOW-LOW SET

VALVE (71D) WHICH CANNOT BE CONTROLLED FROM THE ASD ROOM CONTINUES TO CYCLE.

Changes Made

7 F 2 Y S (N) 8 F 2 X Y U S (N) EITHER DISTRACTOR'S "A" OR "D" COULD BE SELECTED. THE EXPLANATION FOR DISTRACTOR "B" DISCUSSES A VALVE MV-81

WHICH IS NOT IN THE QUESTION.

Distractor B changed 9 F 3 Y S (B) Instructions

[Refer to Section D of ES-401 and Appendix B for additional information regarding each of the following concepts.]

1. Enter the level of knowledge (LOK) of each question as either (F)undamental or (H)igher cognitive level.
2. Enter the level of difficulty (LOD) of each question using a 1 - 5 (easy - difficult) rating sca le (questions in the 2 - 4 range are acceptable).
3. Check the appropriate box if a psychometric flaw is identified: The stem lacks sufficient focus to elicit the correct answer (e.g., unclear intent, more information is needed, or too much ne edless information). The stem or distractors contain cues (i.e., clues, specific determiners, phrasing, length, etc). The answer choices are a collection of unrelated true/false statements. One or more distractors is (are) not credible. One or more distractors is (are) partially correct (e.g., if the applicant can make unstated assumptions that are not contradicted by stem).
4. Check the appropriate box if a job content error is identified: The question is not linked to the job requirements (i.e., the question has a valid K/A but, as written, is not operational in content). The question requires the recall of knowledge that is too specific for the closed refe rence test mode (i.e., it is not required to be known from memory). The question contains data with an unrealistic level of accuracy or inconsistent units (e.g., panel meter in percent with ques tion in gallons). The question requires reverse logic or applic ation compared to the job requirements.
5. Check questions that are sampled for conformance with the approved K/A and those that are designated SRO-only (K/A and license level mismatches are unacceptable).
3. Psychometric Flaws
4. Job Content Flaws
5. Other Q# 1. LOK (F/H) 2. LOD (1-5) Stem Focus Cues T/F Cred.Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SROOnly 6. U/E/S 7. Explanation 6. Based on the reviewer

=s judgment, is the question as written (U)nacceptable (requiring repair or replacement), in need of (E)ditorial enhancement, or (S)atisfactory?

7. At a minimum, explain any A U@ ratings (e.g., how the Appendix B psychometric attributes are not being met).

ES-401 2 Form ES-401-9

3. Psychometric Flaws
4. Job Content Flaws
5. Other Q# 1. LOK (F/H) 2. LOD (1-5) Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SROOnly 6. U/E/S 7. Explanation 10 F 2 Y S (N) 11 F 2 X Y U S (B) DISTRACTOR "B" IS NOT CREDABLE A&C changed 12 H 3 Y S (N) 13 H 4 Y E (?) THE QUESTION HAS TWO K/As, WHICH ONE IS APPLICABLE?

B THE QUESTION DOES NOT LIST IT

'S SOURCE, i.e., BANK, NEW, ETC. 14 H 3 Y S (N) 15 H 3 X Y U S (N) DISTRACTORS "A" & "C" CAN BOTH BE CONSIDERED TO BE A CORRECT ANSWER.

A changed 16 F 2 Y S (N) 17 F 2 Y S (N) 18 F 2 Y U S (B) QUESTION IS ACCEPTABLE IF THE HANDOUT REFERENCE (EOP7A) IS DELETED OTHERWISE THE QUESTION IS A SIMPLE

LOOKUP QUESTION AND A POTENTIAL CUE FOR OTHER

QUESTIONS. Revised Notes,Cautions, Entry Conds. Deleted 19 F 2 Y E (?) SOURCE OF QUESTION IS UNKNOWN (i.e., BANK, MODIFIED)

N 20 F 3 Y S (B) 21 H 2 Y S (N) 22 F 3 Y U S (B) QUESTION IS ACCEPTABLE IF THE HANDOUT REFERENCE (EOP3A) IS DELETED OTHERWISE THE QUESTION IS A SIMPLE

LOOKUP QUESTION AND A POTENTIAL CUE FOR OTHER QUESTIONS.

Ref. Removed 23 F 3 Y S (N) 24 H 3 Y S (N) 25 F 3 Y S (N) 26 F 2 Y S (B) 27 F 2 Y U S (N) QUESTION IS ACCEPTABLE IF THE HANDOUT REFERENCE (EOP5A) IS DELETED OTHERWISE THE QUESTION IS A SIMPLE LOOKUP QUESTION.

Discussed-Multiple Alt. Paths 28 F 2 Y S (N)

3. Psychometric Flaws
4. Job Content Flaws
5. Other Q# 1. LOK (F/H) 2. LOD (1-5) Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SROOnly 6. U/E/S 7. Explanation 29 H 3 Y S (N)

ES-401 2 Form ES-401-9

3. Psychometric Flaws
4. Job Content Flaws
5. Other Q# 1. LOK (F/H) 2. LOD (1-5) Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SROOnly 6. U/E/S 7. Explanation 30 F 2 Y Y U S (?) SOURCE OF QUESTION IS UNKNOWN (i.e., BANK, MODIFIED). SRO ONLY QUESTION.

N-Ros trained to recognize LCOs 31 H 3 X N U S (N) THE QUESTION DOES NOT MATCH THE K/A. PART "B" OF THE K/A, USE OF PROCEDURES, IS NOT COVERED. QUESTION STEM PROVIDES AN ANSWER CUE. Rewritten 32 F 2 Y E N (?) SOURCE OF QUESTION IS UNKNOWN (i.e., BANK, MODIFIED) 33 F 3  ? E (?) SOURCE OF QUESTION IS UNKNOWN (i.e., BANK, MODIFIED).

WHY ARE THERE 2 K/AS??

B 211000.K2.01 34 F 2 Y E (?) SOURCE OF QUESTION IS UNKNOWN (i.e., BANK, MODIFIED)

B 35 F 2 Y E (?) SOURCE OF QUESTION IS UNKNOWN (i.e., BANK, MODIFIED)

N 36 F 3 Y S (B) 37 F 3 Y S (B) 38 H 3 Y S (N) 39 F 2 Y S (N) 40 H 3 Y S (B) 41 F 2 Y S (B) 42 F 2 Y S (B) 43 H 2 Y S (N) 44 F 2 Y S (B) 45 H 3 Y S (B) 46 H 2 Y Y U S (B) SRO ONLY QUESTION Modified Stem 47 F 3 Y S (B) 48 F 2 Y S (B)

3. Psychometric Flaws
4. Job Content Flaws
5. Other Q# 1. LOK (F/H) 2. LOD (1-5) Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SROOnly 6. U/E/S 7. Explanation

34 of 34 NUREG-1021, Draft Revision 9 ES-401 2 Form ES-401-9

3. Psychometric Flaws
4. Job Content Flaws
5. Other Q# 1. LOK (F/H) 2. LOD (1-5) Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SROOnly 6. U/E/S 7. Explanation 49 F 2 Y S (B) 50 F 2 Y S (N) 51 F 2 Y E (?) SOURCE OF QUESTION IS UNKNOWN B 52 F 3 N U S (N) THE QUESTION DOES NOT MATCH THE K/A. Discussed OK 53 H 3 N U S (N) THE QUESTION DOES NOT MATCH THE K/A. Discussed OK 54 F 2 Y S (N) 55 F 2 Y S (B) 56 F 2 Y E (?) SOURCE OF QUESTION IS UNKNOWN.

B 57 H 3 N U S (N) THE QUESTION DOES NOT MATCH THE K/A IN THAT THE PROCEDURES TO CORRECT, CONTROL, AND MITIGATE THE IMPACT ARE NOT IDENTIFIED.

SAT after discussed w/ lic.

58 F 2 Y S (B) 59 H 2 N U S (B) THE QUESTION DOES NOT MATCH THE K/A. CHANGE THE

SENTENCE IN THE STEM TO READ: "WITHOUT REFERENCE TO A PROCEDURE, WHICH OF THE FOLLOWING ACTIONS WOULD YOU, THE OPERATOR, TAKE TO PREVENT OVERPRESSURIZATION OF THE REACTOR WATER CLEANUP SYSTEM PIPING?"

Chg'd Stem 60 F 2 X X Y U S (B) DISTRACTORS "B" THROUGH "D ARE NOT CREDIBLE Chg'd Stem 61 H 3 Y Y U S (N) SRO ONLY QUESTION. OK RO activity @ CNS 62 H 3 Y S (B) 63 H 2 Y S (N) 64 H 3 Y S (N) 65 H 3 Y E (N) THE EXPLANATION FOR DISTRACTOR C STATES THAT IT IS INCORRECT. Corrected 66 H 3 Y S (M) 34 of 34 NUREG-1021, Draft Revision 9 ES-401 2 Form ES-401-9

3. Psychometric Flaws
4. Job Content Flaws
5. Other Q# 1. LOK (F/H) 2. LOD (1-5) Stem Focus Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SROOnly 6. U/E/S 7. Explanation 67 H 4 Y ?S (B) DO NOT UNDERSTAND THIS QUESTION - NEED TO HAVE EXPLAINED BY LICENSEE. DO NOT UNDERSTAND RELATIONSHIP WITH EOP-3A.

Removed Ref Mtl 68 H 3 Y S (B) 69 F 3 Y S (B) 70 F 3 Y S (B) 71 F 3 Y S (B) 72 F 2 Y S (B) 73 F 2 X Y U S (?) SOURCE OF QUESTION IS UNKNOWN. IT APPEARS THAT

DISTRACTORS "B" AND "D" COULD BE CORRECT. B Rewritten 74 H 3 Y S (M) 75 H 3 Y E (?) SOURCE OF QUESTION IS UNKNOWN.

B 76 H 3 Y Y S (N) 77 H 3 Y Y E (?) SOURCE OF QUESTION IS UNKNOWN. WHY ARE THERE TWO K/As - WHICH ONE IS APPLICABLE?

B 2.1.33 78 F 3 Y Y S (N) 79 F 2 Y Y E (?) SOURCE OF QUESTION IS UNKNOWN.

B 80 H 3 Y Y E (?) SOURCE OF QUESTION IS UNKNOWN.

B 81 H 2 Y Y S (B) 82 F 2 Y Y S (N) 83 H 3 Y Y S (N) 84 F 2 Y Y S (N) 85 F 3 Y Y S (N) 86 F 2 Y Y E (?) SOURCE OF QUESTION IS UNKNOWN.

B 34 of 34 NUREG-1021, Draft Revision 9 ES-401 2 Form ES-401-9

3. Psychometric Flaws
4. Job Content Flaws
5. Other Q# 1. LOK (F/H) 2. LOD (1-5) Ste m Foc us Cues T/F Cred. Dist. Partial Job-Link Minutia #/ units Back-ward Q= K/A SROOnly 6. U/E/S 7. Explanation 87 H 3 X N Y U S (B) THE QUESTION DOES NOT MATCH THE K/A IN THAT THE PROCEDURES TO CORRECT, CONTROL, AND MITIGATE THE IMPACT ARE NOT IDENTIFIED. IT APPEARS THAT DISTRACTORS

"C" AND" D " COULD BE CORRECT.

Chg'd Stem 88 H 3 Y Y S (B) 89 H 2 Y Y S (N) 90 H 3 Y Y S (M) 91 F 2 Y Y U S (N) QUESTION IS A SIMPLE LOOK-UP QUESTION WHEN TS 5.5.8 IS PROVIDED TO APPLICANT. Rewritten 92 H 2 X Y Y U S (B) DISTRACTORS "A" AND "B" COULD BOTH BE CORRECT. WHAT

DOES NON-TRM MEAN? Discussed OK 93 H 4 Y Y S (N) 94 H 2 X Y Y U S (?) SOURCE OF QUESTION IS UNKNOWN. IT APPEARS THAT

DISTRACTORS A AND C COULD BOTH BE CORRECT. N Rewritten 95 H 3 Y Y E (?) SOURCE OF QUESTION IS UNKNOWN. WHY ARE THERE TWO K/As ? WHICH ONE IS APPLICABLE?

B 2.2.18 96 F 3 Y Y E (?) SOURCE OF QUESTION IS UNKNOWN. WHY ARE THERE THREE K/As ? WHICH ONE IS APPLICABLE?

B 2.2.32 97 F 2 Y Y E (?) SOURCE OF QUESTION IS UNKNOWN.

B 98 F 2 Y Y E (?) SOURCE OF QUESTION IS UNKNOWN.

B 99 F 3 Y N U S (?) SOURCE OF QUESTION IS UNKNOWN. NOT A SRO ONLY QUESTION.

N OK 10CFR55.43 (2) & (5) 100 H 3 Y Y E (?) SOURCE OF QUESTION IS UNKNOWN.

B SRO TOTALS

Sat: 11 Unsat: 5 Ed: 9 H: 14 (56%)

F: 11 (44%)

Bank: 4 13 Mod: 1 New: 9 11 Unk: 11 0 RO TOTALS Sat: 45 Unsat: 17 Ed: 13 H: 27 (36%)

F: 48 (64%)

Bank: 29 37 Mod: 3 New: 31 35 Unk: 12 0

S:\DRS\OB\OB-Only\EX AMS\CNS\Exam Rev iew\APPENDIX E ADMIN.wp d- Page 1 -

AP PENDIX E - REGION IV OPER ATING TEST AD MINISTR AT IVE JOB PERF ORMAN CE MEAS URE QU ALITY R EVIEW MATRIX JPM#1.Dyn (D/S)2.LOD (1-5)3. Attributes

4. Job Conten t Errors 5.U/E/S 6.Explanatio n (See b elow for i nstruct ions)IC Focus Cues Critical Steps Scope (N/B)Over-lap Job-Link Minutia SA1 S 3 S SA2 S 2 X S ONLY O NE CRI TICAL S TEP.SA3 S 2 S SA4 S 3 X S ONLY O NE CRI TICAL S TEP SA5 S 2 X S ONLY O NE CRI TICAL S TEP RA1 S 2 S RA2 S 2 E STEP THR EE OF TH E PERFOR MANCE CHECKL IST SAYS T O DETER MINE I F THE D ELTA T VALUES ARE W ITHIN + 5 DEGREES F. TH E PUMP START CHEC KLIST STEPS 10 THROU GH 14 HAVE A TOLERANCE OF

+ 4 DEGREES F. WHICH IS COR RECT?RA3 S 2 U ATTACHM ENT 1 H PCI DAT A SHEET S HOWS HPCI-MO-1 9 INITI AL STRO KE TIME AS 18.7 SEC AND TH E RETEST STROKE TIME AS 16.4 S EC. TH ESE VALU ES ARE WITHIN THE IST ACCEPTABILITY RANGE. THER EFORE, THIS VALVE IS OPERABLE.

VALVE HPCI-MO-58 EXCEE DED TH E IST AC CEPTABLE RANGE ON BOTH STROKES WHICH MAK ES THIS VALVE INOPERA BLE. TH IS IS INC ONSISTEN T WITH THE G OAL OF THE JPM AND N EEDS TO BE RESOLVED.RA4 S 2 U THE JPM'S ATTACHME NT 3 SAYS THAT THE ATT ACHMENT MAY BE GIVEN TO THE CANDID ATE, HOWEVER, ATTACH MENT 3 HAS TH E ANSWERS DO CUMEN TED ON IT.

- Page 2 -

Instructions for Completing M atrix This form is no t contained in or required by N UREG-1021.

Utilities are not required or encouraged to use it. The pur pose of this form is to enhance regio nal consistency in reviewing operating tests.

Additional infor mation on these are as may be found in Examinat ion Good Pract ices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space p rovided.1.Determine w hether the task is dynamic (D) o r static (S).

A dynamic task is one that inv olves continuous mon itoring and respon se to varyi ng parameters. A static task is basically a sy stem reconfiguratio n or realignment.

2.Determine leve l of difficulty (LOD) using established 1-5 rat ing scale. Level s 1 and 5 represen t inappropriate (low or hi gh) discriminatory level for th e license being tested.3.Check the appropr iate box w hen an attribute weakness is ide ntified:*The initiating cue is not sufficien tly clear to e nsure the operato r understands the task and how to begin.*The JPM does not contain su fficient cues that are objective (not leading).

  • All critical steps (elements) have n ot been properly identified.
  • Scope of the task is either too nar row (N) or too broad (B).*Excessive overlap w ith other part of operating test or writt en examinati on.4.Check the appropr iate box w hen a job content error is identif ied:*Topics not linked to job content (e.g., disguised task, not required in real job).
  • Task is triv ial and witho ut safety signif icance.5.Based o n the revi ewer's ju dgmen t, is the JPM as written (U)nacc eptabl e (requi ring rep air or rep lacem ent), in need of (E)ditori al enha nceme nt, or (S) atisfa ctory?6.Provi de a b rief desc ript ion o f pro blem in th e expl anat ion c olum n. Pro vide conc lusi on on wheth er JP M SET criteria satisfied (i.e., number/

distribution of saf ety functions, A.3 and A.4 int egrated wit h parts B/C, Admin topics per sect ion meet ES).

S:\DRS\OB\OB-Only\EX AMS\CNS\Exam Rev iew\APPENDIX E JPMs.wpd- Page 1 -

AP PENDIX E - REG ION IV O PERATIN G TEST JO B PERFOR MANCE MEASUR E QUAL ITY REVI EW MATRIX JPM#1.Dyn (D/S)2.LOD (1-5)3. Attributes

4. Job Conten t Errors 5.U/E/S 6.Explanatio n (See b elow for i nstruct ions)IC Focus Cues Critical Steps Scope (N/B)Over-lap Job-Link Minutia a D 2 S PR OC ED UR E 2.2.7 4 U NA VA IL AB LE FO R R EV IE W.b D 3 S PR OC ED UR E 6.H PC I.10 3 U NA VA IL AB LE FO R R EV IE W.c D 3 E THE JPM TITLE I S ADMINISTRATIVE JPM FOR OPERATIONS , BUT TH IS IS NO T AN ADMINISTRATIVE JPM. STEP 1 0 HAS AN INCO MPLETE NUMBER FOR THE FLOW CONTR OLLER. INSTEA D OF "R CIC-F IC", IT SHOUL D BE "R CIC-F IC-91". ADD ITIONAL LY, STEP 10 HAS A "NOTE" THAT DISCUS SES A PROBLEM W ITH THE RCIC CONTROLLER, IS THIS THE ALTERNATE PATH?

d D 2 S PR OC ED UR E 2.2.7 7 U NA VA IL AB LE FO R R EV IE W.e D E THE JPM TITLE I S ADMINISTRATIVE JPM FOR OPERATIONS , BUT TH IS IS NO T AN ADMIN ISTRATIV E JPM. PROCED URE 2.2.69.3 UNAVAIL ABLE FOR REVIEW. iT IS NOT CLEAR WHERE THE ALTERNATE PAT H IS SINCE THE TITLE INCLUDE S A "FAILED 2/3 CORE COVERAG E PERMI SSIVE". S TEP 6 H AS NUM BER OF Q UESTION MARKS - WHY? STEP 8 HAS THE CANDIDATE STA RT THE RHR PUMP, BUT ONLY CHECK THAT THE RED LIGHT IS ON -

WHAT ABOUT O BSERVING MOTOR CURR ENT? S TEP 9 H AS A TERM MISSIN G AS EVIDENC ED BY QU ESTION M ARKS.f D 2 S PROCEDURE 2.2.14 UNAVA ILABLE FOR REVIE W. SIMP LE JPM.g D 3 E THE JPM TITLE I S IN PLANT JPM FOR OPERATIONS , BUT TH IS IS NO T AN IN PLANT JPM. STEP 10 IS INCONSISTENT WITH STEP 4.13 BECAUSE IT DOES MENT ION THE PRESSING OF FUNCTION KEY F-4. THE JPM HAS TH E CANDIDATE COM PLETE STEPS 4.5 THROUG H 4.21 OF THE PROCEDUR E, HOWEVER, STEPS 22 AND 23 OF T HE JPM ARE INCON SISTENT WITH PROCEDURE STEP 4.21

.h D 3 U JPM STEP S 2, 3, AND 4 HAS TH E OPERAT OR PERF ORMIN G DUTI ES THAT ARE NOT IN PROCED URE 5.4FIRE. IN GEN ERAL, T HE JPM IS INCO NSISTEN T WITH THE P ROCEDU RE. i S 3 S PROCEDURE 5.3ALT-STRATEGY COULD NOT BE OPENED BECAUSE IT HAD A SECURITY HOLD ON IT.

J D 3 E iIT IS NOT CLEAR HOW YOU GO FROM STEP 9 IN THE JPM TO STEP

11. THE PROCEDURE GOES FR OM STEP 5.1.1 1 TO ST EP 7 AND DOESN'T RETEST THE SC RAM U NTIL ST EP 7.3.9. HOW YOU GO FROM JP M STEP 10 TO PROCEDURE STEP 7.3.9 NEEDS CLARIFICA TION.k S 2 S

- Page 2 -

Instructions for Completing M atrix This form is no t contained in or required by N UREG-1021.

Utilities are not required or encouraged to use it. The pur pose of this form is to enhance regio nal consistency in reviewing operating tests.

Additional infor mation on these are as may be found in Examinat ion Good Pract ices Appendix D. Check or mark any item(s) requiring comment and explain the issue in the space p rovided.1.Determine w hether the task is dynamic (D) o r static (S).

A dynamic task is one that inv olves continuous mon itoring and respon se to varyi ng parameters. A static task is basically a sy stem reconfiguratio n or realignment.

2.Determine leve l of difficulty (LOD) using established 1-5 rat ing scale. Level s 1 and 5 represen t inappropriate (low or hi gh) discriminatory level for th e license being tested.3.Check the appropr iate box w hen an attribute weakness is ide ntified:*The initiating cue is not sufficien tly clear to e nsure the operato r understands the task and how to begin.*The JPM does not contain su fficient cues that are objective (not leading).

  • All critical steps (elements) have n ot been properly identified.
  • Scope of the task is either too nar row (N) or too broad (B).*Excessive overlap w ith other part of operating test or writt en examinati on.4.Check the appropr iate box w hen a job content error is identif ied:*Topics not linked to job content (e.g., disguised task, not required in real job).
  • Task is triv ial and witho ut safety signif icance.5.Based o n the revi ewer's ju dgmen t, is the JPM as written (U)nacc eptabl e (requi ring rep air or rep lacem ent), in need of (E)ditori al enha nceme nt, or (S) atisfa ctory?6.Provi de a b rief desc ript ion o f pro blem in th e expl anat ion c olum n. Pro vide conc lusi on on wheth er JP M SET criteria satisfied (i.e., number/

distribution of saf ety functions, A.3 and A.4 int egrated wit h parts B/C, Admin topics per sect ion meet ES).

S:\DRS\OB\OB-Only

\EXAMS\CNS\Exam Review\APPEND IX N.wpd- Page 1 -

APPENDIX N - REGIO N IV OP ERATIN G TEST SC ENAR IO REV IEW MATRIX Scen Set 1 ES 2 TS 3 Crit 4 IC 5 Pred 6 TL 7 L/C 8 Eff 9 U/E/S 10 Expla nation (See below for i nstructions) 1 X X U NEEDS TIME LINE AND IDENTIFICATION O F CRITICAL STEPS.

2 X X U NEEDS TIME LINE AND IDENTIFICATION O F CRITICAL STEPS.

3 X S NEEDS TIME LINE 4 X S NEEDS TIME LINE Instructions f or Completing Matrix This form is no t conta ined in or require d by NURE G-1021. Util ities are no t requi red or encou raged to use i t. The p urpose of this form is to enhance region al consiste ncy in re viewi ng operating test sce nario sets. A dditional information on th ese areas may be found in E xamination Good Practices App endix D. Check or mark any item(s) requiring co mment and expl ain the is sue in the space provi ded.1.ES: ES-301 c hecklists 4, 5, & 6 satisfied.

2.TS: Set inclu des SRO TS acti ons for each SRO, w ith required ac tions exp licitly detailed.

3.Crit: Each mani pulation o r evoluti on has ex plicit suc cess criteria documented in Form ES-D-2.

4.IC: Out of serv ice e quipmen t and o ther i nitia l con ditio ns rea sonab ly c onsis tent be twee n scen arios and n ot pred ictiv e of sce nario even ts and actions.

5.Pred: Scenari o sequence and other factors avoi d predictabi lity is sues.6.TL: Ti me l ine con stru cted , in clu din g ev ent a nd p roce ss tr igger ed c ondi tion s, su ch th at sc enar io c an ru n w itho ut ro utin e ex amin er cu ing.7.L/C: Len gth and complexit y for eac h scenar io in the set is reason able fo r the cr ew mix being e xamined, such tha t all applic ants have reasonably similar ex posure and ev ents are neede d for evaluati on purposes.

8.Eff: Sequence of events i s reasonably efficient for examin ation purpose s, especial ly wi th respect to l ong delays or interaction s.9.Based on the review er's judgment, is th e scenario s et as writte n (U)nacceptabl e (requiring repai r or replacemen t), in need o f (E)ditorial enhance ment, or (S)at isfac tory?10.Provi de a b rief de script ion o f probl em in t he ex plana tion c olumn

Retrieved from "https://kanterella.com/w/index.php?title=ML062900360&oldid=1835432"