NRC Generic Letter 1982-13

NRC Generic Letter 1982-013: Reactor Operator & Senior Reactor Operator Examinations

ML031080303
Person / Time
Site:	Beaver Valley, Millstone, Hatch, Monticello, Calvert Cliffs, Dresden, Davis Besse, Peach Bottom, Browns Ferry, Salem, Oconee, Mcguire, Nine Mile Point, Palisades, Palo Verde, Perry, Indian Point, Fermi, Kewaunee, Catawba, Harris, Wolf Creek, Saint Lucie, Point Beach, Oyster Creek, Watts Bar, Grand Gulf, Cooper, Sequoyah, Byron, Pilgrim, Arkansas Nuclear, Braidwood, Susquehanna, Summer, Prairie Island, Columbia, Seabrook, Brunswick, Surry, Limerick, North Anna, Turkey Point, River Bend, Vermont Yankee, Crystal River, Haddam Neck, Ginna, Diablo Canyon, Callaway, Vogtle, Waterford, Duane Arnold, Farley, Robinson, Clinton, San Onofre, Cook, Comanche Peak, Yankee Rowe, Maine Yankee, Quad Cities, Humboldt Bay, La Crosse, Big Rock Point, Rancho Seco, Zion, Midland, Bellefonte, Fort Calhoun, FitzPatrick, McGuire, LaSalle, 05000514, 05000000, 05000515, Zimmer, Fort Saint Vrain, Washington Public Power Supply System, Shoreham, Trojan, Bailly, Clinch River, Skagit, Marble Hill, Black Fox, Hartsville, Phipps Bend, Crane
Issue date:	06/17/1982
From:	Eisenhut D Office of Nuclear Reactor Regulation
To:
References
GL-82-013, NUDOCS 8204210387
Download: ML031080303 (17)

0.,.a RIGA,* 0 4'.wC UNITED STATES NUCLEAR REGULATORY

COMMISSION

WAHINGTON.

D. C. 20555 June 17, 1982 0 TO ALL POWER REACTOR LICENSEES, APPLICANTS

FOR AN OPERATING

LICENSE AND HOLDERS OF A CONSTRUCTION

PERMIT Gentlemen:

Subject: Reactor Operator and Senior Reactor Operator Examinations (Generic Letter 82-13)Enclosed are the results of a meeting held in Bethesda, Md. on January 6, 1982, to discuss changes to the examination used to license Reactor and Senior Reactor Operators.

The questions and comments raised during that meeting are discussed in the enclosed summary.This letter is for your information only and requires no response or action.Sincerely, Darrell G. Eisenhut, Director Division of Licensing Office of Nuclear Reactor Regulation Enclosure:

1. Response to Questions/-

Comments 2. List of Attendees 8204210387

820421037

820617 PDFR ADOCK O5o0OOO3 V PDR

General Topic: Examination Administration Ouestions/Suqqesticns:

What responsibilitfes/authority do proctors, especially when it is the Resident Inspector, have?Will questions be made available to allow trainers to know what areas should be covered?The exam should be open book, allowing access to the materials the operator i..uld have in the control room (i.e., Tech Specs).Will NRC guidance be updated to reflect the new exam format?What options are open for taking the written exam? AM/PM sessions?

One sitting? And what options for splitting sections are available if a split period used?Reducing the number of questions (time) increases the importance of each question.Formula/Equation sheet should be standardized.

Can the utilities get copies of questions submitted by other utilities?

NRC should recommend a list of standard texts.A firm date for implementing the new format should be set.Reoorting results should be standardized.

Some people get summary sheets, some don't know results until licenses or denials Arrive. Results should be in faster.Why not leave a copy of the exam after it has been taken?Can the utilities get a copy of the exam in advance to allow for a thorough review.Why establish a time limit? The exam should find out what you know, not how fast you can write.Why not use Qualified industry people to administer exams at other facilities?

Better guidance is needed on what will be covered in the exam ind better informa-tion on grading criteria and granting waivers should be available.

There is no way to check on the results of oral exams.Are machine prepared, machine graded exams possible?

Probable?Better clarification of the March 28, 1980 letter on qualifications is needed..1 ENCLOSURE

1 Genertl Topic: Reactor Theory, Heat Transfer, and Thermodynamncs Questions/Suggestions:

CombinelRO

and SRO sections since a distinction cannot be made on what is RO and what is SRO level of knowledge.

Response: At the January 6 meeting a poll was taken at the round table discussions.

Approximately

42% preferred separate categories and 57% preferred combining the two. Comments on the subject were: 1. Could have union problems, if operator candidates are required to answer questions at senior level.2. Combining categories is appropriate since the distinction cannot be made between SRO and RO knowledge level.3. Categories should not be corbined at this time since this change will delay implementation of new formats.4. Some individuals believed it is appropriate to keep categories separate, as proposed, since SRO and RO level can be determined.

5. Some individuals were neutral and had no strong feelings either way.Since there was not clear consensus and since there could be additional problems created, we will maintain the current format until sufficient feedback from the new exam format is available to support a move in the other direction.

This is an area where specific comments on the exams will be useful in evaluating general statements.

i ENCLOSURE

1 General Topic: Reactor Theory, Heat Transfer, and Thernodynamics Questions/Suggestions:

Combine RO and SRO sections since a distinction cannot be made on what is RO and what is SRO level of knowledge.

Response: At the January 6 meeting a poll was taken at the round table discussions.

Approximately

42% preferred separate categories and 57% preferred combining the two. Comments on the subject were: 1. Could have union problems, if operator candidates are required to answer questions at senior level.2. Combining categories is appropriate since the distinction cannot be made between SRO and RO knowledge level.3. Categories should not be combined at this time Oince this change will delay implementation of new formats.4. Some individuals believed it is appropriate to keep categories separate, as proposed, since SRO and RO level can be determined.

5. Some individuals were neutral and had no strong feelings either way.Since there was not clear consensus and since there could be additional problems created, we will maintain the current format until sufficient feedback from the new exam format is available to support a move in the other direction.

This is an area where specific comments on the exams will be useful in evaluating general statements.

I

General Topic: Future Meetings Questions/Sum estions: The meeting was useful and should be repeated regularly.

The meeting announce-rent with a proposed agenda should be available sooner. The meeting gave industry representatives a chance to understand and commient on proposed changes. Could a list of attendees be provided?

Smaller meetings between training staffs and examiners should be held.Response: We were as enthusiastic as you about the meeting. We intend to repeat the process and will provide more notice in the future. We will consider small meetings, especially as the OLB staff is regionalized, but do not plan any now due to resource limitations.

A copy of the attendance list of the meeting is attached.

Please bring additions or corrections to our attention.

General Topic: Written Examination Questions Questions/Suogestions:

Questions should not require lengthy calculations that are not done on the-ob..Questions should not be taken from the FSAR since it is worst case and may not be up to date.Technical Specification questions should not require knowing actions after one hour since the SRO can look these up.More short answer or multiple choice questions should be used.Health Physics questions should concentrate on operating information not time-distance-shielding type Questions.

Mitigating core damage should be included in exams.RO Exams should not include Tech Specs or Emergency Plan since these are not her responsibility.

If new topics are to be included in the exams, the utilities should be notified.In addition to submitting good questions, utilities should be able to identify questions they feel are bad.Response: As indicated in the January 6 meeting, emphasis in the exam will be on operational information.

To ensure that exam questions are in line with the guidelines given to you, we are reviewing the questions and deleting or modifying ones that do not comply. As discussed in the exam consistency topic, we are developing a computer-ized bank of exam questions.

When fully developed and reviewed, we will make this bank available to the public. We encourage submission of questions for the bank and comments on questions that you feel are not valid. In this effort we are eliminating the Health Physics questions that are not generally the responsi-bility of the RO or SRO, and arranging that Tech Spec questions concentrate on understanding of the bases, general knowledge of what actions are required immediately (within one hour) and why, and what systems have tech spec limits and why. In the operational exam the candidate's ability to find and use the tech specs will be examined.

Ouestion content may still include calculations to determine the candidate's understanding of the principles involved in nuclear plant operation, but calculations for the sake of calculations will be avoided.We are investigating short answer and multiple choice question formats and have used both in exams that have been given. We will not, however, shift entirely to this format until we have assured that the questions present a fair opportunit:

for the candidate to show his or her knowledge and we have notified the industry that we will be changing exam style.We are continually developing new questions from the training material provided.We will continue to use the FSAR as'a source of information, but we recognize its limitations.

As always, out of date information should be pointed out in the exam critique so that questions and answers can be updated. We hope in the near future to develop a regular information letter to inform the public of new areas of interest in the exam.

Response: Your concerns fall into several areas. First, the exam may be taken either at one sitting or broken into two parts. The utility has the option, but all candidates rust take the exam the same way. The exam will be given, as indicated, section 1, 2. and 3 or 6. 7, and 8 in the first three hours and 4, S,-or 9, 10 in the second three hours if a split sitting is elected. The examiners or proctors have the authority to allow individual breaks during the exam, but the exam must still be finished within the allowed time. The examiner or proctor will keep track of elapsed time.Second, only examiners are authorized to mwdify an exam. Proctors, even resident inspectors, are not authorized to rake changes. Proposed changes should immediately be called to the attention of the assigned chief examiner.Third, ai discussed in the exam questions topic, we are reviewing the questions, invest1gating rultiple choice and short answer questions to allow more areas to be covered in the limited amount of time, however, a time limit will remain.We are investigating machine generated/machine graded formats but have no imnediate plans for implementing such a system. Before a change like that will be adopted, the approach will be validated and your comments solicited prior to any action being taken. Once fully developed, we will consider iaking the questions contained in the exam question bank available'to assist you in your training program and In keeping the questions current.Fourth, we do not intend to go to an open book exam. We are working to ensure that the written exam tests for infornation that the candidate should know with-out aids and the operational exam tests his ability to use aids such as procedures and Tech Specs.Fifth, we are in the process-of developing updated guidance on exam content, objective and subjective grading criteria, exam administration and application content. We will not endorse a set of reference texts. This guidance, coupled with greater accessibility of exam questipns, should improve information availa.ble on what the exam will cover. Any texts-that suitably cover the Vaterial are acceptable.

Sixth, we are implementing a system to allow automatic, computer-aided tracking of applications and exam results. Our goal is to have all results reported to the Individuals and utilities within two months of completion of the examination.

As more examiners are certified this goal will be reviewed to see if we can .reduce it even further. You can assist us by refraining from calling for results or submitting FOIA requests until after the two months have passed. Exam results are not final until all portions of the exam have been completed and internal audits for consistency-and fairness are done. At that points exam summary sheets will be sent to the utility, and licenses or denials and a copy of the written exam will be sent to the individual.

Finally, almost all old format reexaminations have been completed and suffil.ient experience has been gained in preparing new format exams. Therefore, only siew format exams will be given for examinations scheduled after July 1, 19g'.

General Topic: Examination Consistency Questions/SuQgestions:

Some examiners lack the knowledge and training necessary to give oral exams.They use poor methods and intimidate the candidates.

Some examiners are too academically oriented.

There are large inconsistencies between examiners.

You almost have to know who is preparing your exam so you can prepare the candidates in the proper areas.Sore examiners will not accept an operating method that differs from a Ocookbooka method even though the alternate method may be equally acceptable.

Therefore, correct answers are marked wrong.There are no standards for required level of knowledge for oral exams. Therefore, the depth required varies between examiners.

Response: As discussed in other sections, we are working on guidelines for exam content and developing a question bank of valid questions.

Since these will include plant specific, as well as generic questions, the operating philosophy of each facility can be reflected in their exam questions.

For oral exams we are preparing guidelines for the examiners.

Appropriate portions will be made publicly available.

We have also established a training and certification program for contract examiners.

This will ensure that a minimum competence has been obtained prior to conducting exams. To ensure competence and consistency, all examiners, NRC and contractors, will be audited periodically by the OLS Section Leader.We are sensitive to the issue of competency and consistency because we are actively transferring examiner functions to the Regional Offices. Any specific feedback from an examination is welcome and will be kevt confidential.

I

Aeneral Topic: Simulator Exams OuestionsfSuqgestions:

Plant specific simulators should be mandated by NRC.What are fRC's future plans for simulator exams? More guidance is needed on what will be covered in simulator exams, especially-for non-plant-specific simulators.

Response: A Commission Paper has been prepared.recomnuending that the requirement for non-plant-specific simulator exams be removed. We have studies underway to develop valid operational exams, Including simulator exams. At this time we feel that dynamic transient operation is an important aspect of the exam but that the limitations imposed by non-plant-specific simulators and the scheduling problems encountered reduce the effectiveness of the exam and do not justify the resources required.

Therefore, we are considering returning to the old exam method of performing power transients, startups and shutdowns on those facilities that do not have a plant speci'fic simulator available.

Any change in the exam will be discussed before it is iiplemented.

Until the need for operating tests on the facility or other testing methods being studied by the staff are validated, the operating examination will continue to follow the existing guidelines in NUREG 0094. Therefore, there is a continued need for simulator training to comply with the guidance in NUREG 0094. The Coimmtssion has not acted on the staff recommendation at this time. The CoMnMssiOn paper does not include any requirements for actual plant operations at this time.As discussed under the exam administration topic, we are developing guidelines for simulator exams. We are also modifying the operational exam suffrrary sheet to facilitate the simulator exam and to ensure that areas examined at the simulator are not duplicated in the plant walk-through.

Miscellaneous Ovestion: Where are guidelines for medical applications?

Response:-

Basic requirements are in Part SS. Aioltfying guidance in Regulatory Guide 1.134 which endorses ANSI/ANS 546.Suggestion:

Fallback to RO on instant SRO failure isn't worth much since engineers or supervisors aren't in the union and cannot perform RO duties.Response: We agree that fallback has little value. When a candidate is certified to need an SRO license to perform his or her duties, we don't see how having an RD will help. Under the new format exam, this problem should disappear.

Suggostion:

KRC should put certification of training instructors on high priority since this could have a real impact on training.Response: We agree entirely.

Our highest priority, as always, is licensing new operators.

As more examiners are trained and certified, we will be pursuing the area of instructor certification more vigorously.

All Operating License applicants are required to have certified instructors prior to fuel load and we have certi-fied instructors at several operating plants. We are monitoring the INPO work on training program accreditation and are investigating means to certify vendor and consultant instructors that teach systems and operations courses. More inforrmation will be available on this subject in the near future.(uestion-What are NRC's plans for requalification exams?Response: In the Commission paper on non-plant-specific simulators we discuss the subject of requalification at length. To summarize, as directed by the Commission, we will start giving requalification examinations in conjunction with scheduled visits for replacement exams. We are targeting at least one site visit to each facility this year and expect to administer requalification examinations to 20%of the licensed operators.

Our initial plans are to conduct the requalification exams during replacement exams; however, we will work out availability and schedules with each utility. Tn the Commission paper, the staff proposed that for utilities with a plant specific sirulator, the requalification exam will be given only on the simulator.

Otherwise, a written exam and practical test vill be given. Failure of the exam will require accelerated retraining in weak areas, as is required now, and NRC reexamination.

If significant weaknesses in the utility requalificatlon program are revealed by the exams, NRC administered requalification exams for all license renewal applicants will be likely until the requalification program has been sufficiently upgraded.

Details of the.program are in the Commdssion paper. No ComMission action has been taken at this time.Suggestion:

NRC should periodically issue a listing of generic weak points.Response: When our automated system is operational, we intend to issue quarterly informa.tion reports that will include observed weak areas. It will also include areas of concern at NRC that might affect the content of future exams and general information on the exams. We hope to be producing these reports in the very near future.

Suggestion:

Cold plants need amplification of R. Denton's March 28, 1980 letter regarding experience requirements.

Response: It is difficult to provide better generic guidance than exists in the letter Task Action Plan Item I.A.2.1 NUREG-0737 and NUREG 0094. Specific cases can be discussed with the appropriate OLB Section Leader. The OLB policy is to grant exemtotlns or.walvers only In specific cases, not on a generic basis.Therefore, the requirements should be discussed with the Section Leaders.

ENCLOSURE

2 LIST OF ATTENDEES NAME & TITLE COMPANY Hugh Thompson Bruce Wilson Joe McMi1len Robert Campbell Ted Szymanski Bruce Boger Rcnald Eaton Rornald Maines Robert Keller John Munro Len Wiens Tom Hamrick Jim Evans Ray Hallmark Ron Burdge Dan F.. Moore Frank Thompson Lee Williams Paul Hobbs R. J. Bursey J. F. Crosby Acting Director, DHFS OLB Examiner Region III Examiner OLB Examiner OLB Examiner OLR Examiner OLB Examiner OLB Examiner OLB Examiner OLB Examiner OLB Examiner Mgr. Training Director, Su Ops Gen. Mgr. -Dev. Div.Supv. -Nuclear Training Supy. Oper. Fund, Trng.Trng. Supt.Sr. Trng. Supt.Consultant Eval USNRC USNRC USNRC USNRC USNRC USNRC USNRC 11SNRC USNRC USNRC USNRC Union Carbide -ORNL Westinghouse Energy Inc.NUSTC Ga. Power Co.WPPSS Ala. Power Co.Union Electric Co.NPO Inc.ItNPO I

-2 -P. L. Flncher J. R. Bynam R. G. Jones E. W. Merschoff J. G. Cook J. Macdonald J. Barba J. Yoe S. Jones Eugene Carlson Jay Wheeler Joe Zerbo Bill Landon Don Tall Fred Curling Larry Edmonds Andy Neufer Tom Houghton Rick Zollitch Warren R. Forrest Clyde Gilbert Mark D. Shepherd Training Supv.Tech Supervisor Trng. Superintendent Sr. Trng. Supyr.Trng. Supvr.Trna.Florida Power & Light Co.TVA TVA NRC JPC CE CE Baltimore Gas & Electric Co.Baltimore Gas & Electric Co.Pennsylvania Power & Light Co.PECO General Physics Conn. Yankee PASNY/FITZ

VEPCO VEPCO PROS K34C, Inc.Niagara lIohawk Unin Electric Co.Northeast Utilities Florida Power S Light Co.;I

3 -I 4 Terry L. Wood Harry L: Mathis Jerry Scholand Dr. Ron Bruno Ernest Chattfield Wendell H. Barron John Gass Michael Williams H. T. Babb Fred Dacimo Tim Martin Ken Beatty J. R. Wzlkev Robert L. Lewis Rick Goodrick S. D. Schile R. M. Koehler R. J. Barrett Dean Crawford Putch Colby G. J. Ashworth Dr. C. M. Overbey Trng.Mgr. Nucl Trng.Mgr. WNTC Supt. -Trng.*Trng. Mgr.Trng. Sup.Trng. Sup.Trng. Mgr.Trng.OSS Trng. Supv.Trng. Supv.Trng. Shift Eng.WENP Asst. Supv.Certification Examiner Trng.Trng. Mgr.BWR Sirulator Dir.Manager Sr. Staff Supv.PQS Section Leader WPC Southern Calf. Edison Co.Westinghouse Wisconsin Electric Co.Yankee Atomic Power Co.Carolina Power S Light Omaha Public Power District SCE& -SCE&G Northeast Utilities Pacific Gas & Electric Co.Florida Power S Light Corp.TVA TVA General Electric ATTS, Inc.Duke Power Conpany GPU Singer-Link Singer-Link Consumers Power Co.NRC/DHFS

-4 -A. Fullerton J. H. Reed David Nelson G. Bockhold J. Lloy6 S. Crouch Jim Hicky Rob Anderson R. W. Bulver Jack Hau Chuck Maney Brendan Moroney Joseph Gonyecu Mike Sellman Gene Earney Bob Jansky Art Morris Dick Morrill William T. Gott Marty Langan Br#; E. Crane Bill Olsen Research Associate Research Associate Trng. Coodinator mgr./Nuc.

Trng.Trng. Supervisor Sr. Trnq. Cons.Trng. Mhgr.Trng. Coordinaitor Supt. Nuc. Training Trng. Sup Instructor Mgr. -Prod. Jrng.Trng. Supt. Pt Prog. Supt.Shift Supv. Trng.Asst. Trng. Coor.Trng. Supervisor Trng. Director Nuc. Inst.Nuc. Trng. Mgr.Sr. Trng. Spec.ORNL ORNE IUM Elec.Georgia Power PSE&G ATTS, Inc.Toledo Edison Co.Iowa Electric Phila. Electric Co.SMUD Commonwealth Edison NUS NSP Northern States Power Co.PSP NPD Rochester Gas & Electric Co.Rochester Gas & Electric Co.Cincinnati Gas & Electric Louisana Power & Light Florila Power Corp.Boston Edison Co.

-S -I II Charles Bogolin Larry Vieder Saul J. Harris Ed Force Bill Garrison Ed Thorndyke Art Shean Dan McNeal T. Lempges R. Joe Johnson Dennis Ockernan Charles Cowan Dave Roth A. Shauver William Odell Ray Wadas Martin Block Jim Vassello Bob Clark Sam Newton Bob Ecam Tom Higgins Operation Super.Prog. Spec. Ruc. Trng.Nuclear Program Mngr.Trng. Coordinator Shift Supervisor Trng. Supervisor Trng. Director Shift Supervisor V.P. Nuc. Gen.Trng. Mgr.Trng.Trng. Coordinator V.P.Dir.Mgr. Instruction Trng.Supt. Operation Trng.Op. Trng. Ygr.Trng. Sup.Gulf States Carolina Power & Light EEI Arkansas Power & Light Co.Arkansas Power & Light Co.Carolina Power & Light Co.Maine Yankee Atomic Power Co.Cincinnati Gas & Electric Niagara Mohawk TVA General Electric Philadelphia Electric General Physics Corp.General Physics Corp.B&W P.S.C. of Colo.P.S.C. of Colo.DL Co.Battel le GPU Nuc. TMI AP&L Commonwealth Ed.I

-6 -L. E. 'Al' Kanous Ken Rottkamp Jon Rengston Zeinab Sabri Richard P. Bogate Norman Pgre Craig Kvafme R. M. Stallnan Tony Vinnola Don Neighbors Bob Martin Nick Corithard Art Mah Dave Fawcett C. L. Turner N. W. Hough S. G. Jones SE C. H. Noe SE Dir. Nuc. Trng.Trng. Inst.Trng. Sup.Director -Nuc. Trng.Simulator Instructor fterations NRC Contractor NRC Contractor NRC Contractor ORB #3 KG&E Mgr. Training KG&E Training Supv.Op. Trng. Supv.Director Huc. Trng.Trng. Supv.Detroit Ed.LILCO PUSTC LPAL Duke Power Co.Duke Power Co.Operator Exam Branch, EG&G Operator Exam Branch, EG&G Operator Exam Branch, EG&G NRC NRC GPU Texas Utilities Carolina Power & Light Co.TVA TVA i