ML20057C406
| ML20057C406 | |
| Person / Time | |
|---|---|
| Issue date: | 08/30/1993 |
| From: | Barchi T NRC OFFICE OF THE INSPECTOR GENERAL (OIG) |
| To: | |
| References | |
| OIG-93A-10, NUDOCS 9309280332 | |
| Download: ML20057C406 (159) | |
Text
I I
OFFICE OF THE INSPECTOR GENERAL I
US NUCLEAR I
REGULATORY COMMISSION j
I RESULTS OF I
NUCLEAR SAFETY-RELATED INFORMATION SYSTEMS j
USER SATISFACTION SURVEY OIG/93A-10 August 30,1993 I
l I
ADIT R3? ORT
-l I
ggR REcg g
4 0
I s&
o
<t i
f' S
O
\\
lb g D
%ms/
I iSR'2ggga2ggg;go j
PDR l
I
I I
- [(
+
o, UNITED STATES 7,
NUCLEAR REGULATORY COMMISSION
.j WASHINGTON. D C. 20555 o.,,
a
/
August 30,1993 OFFICE OF THE I
INSPECTOR GENERAL I
MEMORANDUM FOR: James M. Taylor Executive Director for Operations M
M FROM:
Thomas 7archi I-Assistant Inspector General for Audits E
aB
SUBJECT:
NUCLEAR SAFETY-RELATED INFORMADON SYSTEMS USER SATISFACrlON SURVEY Attached is the Office of the Inspector General's audit report entitled,"Results of Nuclear Safety-Related Information Systems User Satisfaction Survey".
Several respondents to our survey requested that they be provided a copy of our results when the survey was completed. Consequently, this report provides the results of our suvey of approximately 200 users of 9 NRC safety-related information systems and does not contain conclusions or recommendations.
I In conjunction with the user sur,ey, we solicited the views of managers throughout the agency regarding the usefulness of the agency's safety-related information systems and the l
quality of the agency's system support services. In a separate report, we will provide our analysis of both user and management opinions and make recommendations, as necessary, to improve NFTs systems development and maintenance program.
Attachment:
As stated I
,')
i l
{$
Ea ec:
H. Thompson, EDO J. Sniezek, EDO l
S. Chilk, SECY W. Parler, OGC D. Rathbun, GPA G. Cranford, IRM T. Murley, NRR E. Jordan, AEOD E. Beckjord, RES R. Bernero, NMSS J. Lieberman, OE g*
T. Martin, RI 3
S. Ebneter, RII J. Martin, RIII g
J. Milhoan, RIV E
B. Faulkenberry, RV J. Blaha, EDO g
J. Funches, ICC E
R. Scroggins, OC P. Norry, ADM g:
C. Kamrnerer, OSP E
I I
I:
i Il
t I
Nuclear Safety-Related information Systems Survey I
REPORT SYNOPSIS In fiscal year 1992, the Office of the Inspector General (OIG) began the implementation of its long-term strategy to determine the effectiveness of the U.S. Nuclear Regulatory Commission's (NRC) information resources g
management program. During the course of our initial audit work, concerns were raised regarding how well the agency's major automated information systems supported NRC's mission of protecting the public health and safety.
Because of these concerns, OIG decided to survey the NRC staff and senicr managers to obtain their views and experiences regarding the agency's safety-I related information systems.
User opinions regarding system use and support services were obtained using a questionnaire-style survey instrument. Several respondents to our survey requested that they be provided a copy of our results when the survey was l
completed. Therefore, this report provides the detailed results of that user survey for each of the nine systems for which data was collected.
In conjunction with the user survey, OlG solicited the views of managers throughout the agency regarding the usefulness of the agency's safety-related automated information systems and the quality of the agency's system support services. In a separate report, OIG will provide its analysis of both user and management opinions and make recommendations, as necessary, to improve l
NRC's systems development and maintenance program.
I I
I I
l osonmo r.ge i i
I?
I Nuclear Safetyeetated Information Systems Survey TABLE OF CONTENTS REPORT SYNOPSIS i
I INTRODUCTION...............................
1 BACKGROUND 1
SURVEY RESULTS.............................
4 I
SECTION I, EATS...........
5 SECTION II, SINET..........................
22 SECTION III, G LDB..........................
39 SECTION IV, IEVENTS.......................
56 I
S ECTION V, MIPS...........................
73 1
SECTION VI, OLTS..........................
90 SECTION VII, SIMS..........................
107 SECTION VIII, SALP.........................
124 APPENDICES I
Objectives, Scope, and Methodology I
II System Descriptions l
III Major Contributors To This Report IV U.S. NRC Functional Organization Chart I
I
Nuclear Safety-Rotated information Systems Survey I
INTRODUCTION In fiscal year 1992, the Office of the Inspector General (OIG) began the irnplementation ofits long-term strategy to determine the effectiveness of the U.S. Nuclear Regulatory Commission's (NRC) information resources I
management program. During the course of our initial audit work, concerns were raised regarding the usefulness of the agency's major automated l
information systems in supporting NRC's mission of protecting the public health and safety. Because of these concerns, OIG decided to survey the NRC staff and senior managers to obtain their views and experiences I
regarding the agency's safety-related information systems.
I User opinions regarding system use and support services were obtained using a questionnaire-style survey instrument, developed and tested with the assistance of the Federal Systems Integration and Management Center l
(FEDSIM), Office of Technical Assistance, Information Resources Management Service, U.S. General Services Administration. This report provides the results of that user survey. For details regarding our objectives, scope, and methodology, see Appendix I.
Concurrently, OIG solicited the views of managers throughout the agency regarding the usefulness of these systems and the quality of the agency's system support services. The results of that work will be released in a separate report.
BACKGROUND l
NRC manages its safety-related mission primarily through its five regional offices and the offices of Analysis & Evaluation of Operational Data (AEOD), Enforcement (OE), Nuclear Material Safety & Safeguards (NMSS),
Nuclear Reactor Regulation (NRR), and Nuclear Regulatory Research (RES).
NRC management, technical, and administrative staff in these offices depend I
heavily on automated information systems to support numerous mission-critical programs.
I OlG/VIA-10 Page 1
OUl i
Nuclear Safety-Related Information Systems Survey The Office of Information Resources Management (IRM) is responsible for NRCs information resources management program. This program provides a wide range of services,which includes information systems development and E:
maintenance. IRM identified 16 systems as NRCs safety-related information 5
systems. Table 1.1 lists these systems, their sponsor offices, their operational dates, and the computer environments in which they reside.
l' TABLE 1.1:
SPONSOR OPERATIONAL COMPUTER SYSTEM OFFICE DATE ENVIRONMENT 2
Enforcement Action Tracking OE FY 1992 SINET - NIH System (EATS)
Mainframe 2
Event / Unit Update System AEOD FY 1991 SINET - NIH 2
(SINET )
Mainframe General License Data Base NMSS FY 1987 NRC 9370 System (GLDB)
Minicomputer l'
2 Inspection Follow-up System NRR FY 1991 SINET - NIH (IFS)
Mainframe 2
Inspection Procedure Authority NRR FY 1989 SINET - NIH g
System (IPAS)
Mainframe E
Inspection Report Tracking NRR FY 1977 NIH Mainframe
, Sptem (IRTS) l
- NRC's Shared Information Network.
- Although SINET is the current acronym for this system, it should not be confused with the "SINET" that refers to NRC's Shared g
Information Network on the National Institute of Health (NIH) g, Mainframe.
ono n w io rap 2 5,
I Nuclear Safety-Related info-dation Systems Survey
)
SPONSOR OPERATIONAL COMPUTER SYSTEM OFFICE DATE ENVIRONMENT Integrated Events System NRR FY 1992 SINET - NIH (IEVENTS)
Mainframe Licensing Tracking System NMSS FY 1985 NRC 9370 (LTS)
Minicomputer 2
Master Inspection Planning NRR FY 1989 SINET - NIH System (MIPS)
Mainframe j
Operator Licensing Tracking NRR FY 1983 NIH Mainframe I
System (OIJ3) i 2
Part 21 System (P21)
NRR FY 1991 SINET - NIH Mainframe 2
Probabilistic Risk Assessment IRM FY 1989 SINET - NIH System (PRA)
Mainframe I
Safety Issues Management NRR FY 1986 NIH Mainframe System (SIMS)
Services and Training NMSS FY 1986 NRC 9370 Information System (STIS)
Minicomputer I
Systematic Assessment of NRR FY 1988 SINET - NIH Licensee Performance (SALP)
Mainframe Transportation Approval NMSS FY 1986 NIH Mainframe I
Package Information System (TAPIS) l I
1 2NRC's Shared Information Network.
I OlG/9M-10 Page 3 I
ER Nuclear Safety-Related Information Systems Survey From this list, OIG and FEDSIM judgmentally selected a sample of nine systems. This sample was selected to reflect a variety of user offices and mission applications. A description of each system surveyed is included in g
Appendix II.
E SURVEY RESULTS Individual results for all systems surveyed, except for the PRA system, are l
included as Sections I through VIII of this report. The PRA system had only one user listed on its accession list. When OIG surveyed that user, he said g
he had never used the system and thus could offer no further information.
5 The purpose of this report is to provide the agency with the results of the user survey. In a separate report, OIG will provide its analysis of both user and management opinions and make recommendations, as necessary, to improve NRC's systems development and maintenance program.
I OlG/VM40 Page 4 5m
Nuclear Safety-Related Information Systems Survey SYSTEM: ENFORCEMENT ACTION TRACKING SYSTEM (EATS)
I NUMBER OF RESPONDENTS = = 11 I
Computer System Evaluation: The following questions are designed to obtain user opinions regarding:
I Check how often you use this system?
1 l
Number of responses to this question = = 10 1
Daily 2
Weekly J
Monthly 1
Annually
}
Never 0
Other i
2.
Activities that the system is used to support include (check all that apply):
1 I
l NRC Policy J
Research J
litigation J
Enforcement 0
Investigation 1
Inspections 0
Nuclear Reactor 0
Nuclear Materials O
Congressional lnquiries Regulation Regulation J
other I
onc/9wio Page 5
i Nuclear Safety-Related information Systems Survey I!
3.
How is the system used? (check all that apply)
J Transaction processing (i.e. clerical and record keeping functions) 1 5 Management Reports 1
Decision Support (such as "what-if' analysis)
J Plannmg or Strategic Decision Making 1 Document Retrieval
.3 Other 1
l 4.
Indicate (by circling the appropriate number) the importance of the system in relation to the work of your office or department:
i Number of responses to this question = = 8 Breakdown of responses:
Not Important Undecided Important Very Impoatant Not Applicable 0
2 3
3 0
i I
I olo/93Mo rase 6 E
Nuclear Safety-Related information Systems Survey Information System Evaluation:.
I 5.
Are there any problems relating information in this system to information contained in other systems?
Number of responses to this question = = 8 Breakdown of responses:
Deenitely Yes To Some Extent Undecided Probably Not Definitely Not Not Applicable 0
2 0
1 2
3 I
I 6.
Are there any incompatibilities / obstacles between this system and others?
Number of responses to this question = = 8 g
Breakdown of responses:
Definitely Yes To Some Extent Undecided Probably Not Definitely Not Not Applicable 0
3 0
0 2
3 7.
Do you believe the system duplicates other processes or systems?
I Number of responses to this question = = 8 Breakdown of responses:
...c, Yes 1o S _ E.,e.t U.d,eed P,omb,, Not t e.ite,, Not Not s,,ue.bie 0
1 0
0 6
1 I
OlG/YM-10 Page 7
)
I Nuclear Safety-Related Information Systems Survey 8.
Does the information duplicate information contained in other data bases?
Number of responses to this question = = 8 Breakdown of responses:
Dennitely Yes To Some Enent Undecided Probably Not Definitely Not Not Applicable 0
2 1
1 4
0 9.
Do you perform any manual activities (such as maintaining records, editing, calculating, or j
summarizing data to supplement the functions of this system?
Number of responses to this question = = 9 l
Breakdown of responses:
I Dennitely Yes To Some Extent Undecided Probably Not Definitely Not Not Applicable 1
0 0
4 4
0 oiafm-w nge a E.
i Nuclear Safety-Related Information Systems Survey Evaluation ofInput Process:
I 10.
Do you supply input data for this system?
Number of responses to this question = = 9 Breakdown of responses:
Definitely Yes To Some Extent Undecided Probably Not Definitely Not Not Appilcable 2
1 1
0 5
0 I
11.
Is the input process user-friendly?
g Number of responses to this question = = 9 Breakdown of responses:
Definitely Yes To Some Extent Undecided Probably Not Definitely Not Not Applicable 2
2 1
0 0
4 i
I 12.
Does the input process save clerical effort?
Number of responses to this question = = 9 Breakdown of responses:
Definitely Yes To Some Extent Undecided Probably Not Definitely Not Not Applicable 2
1 1
0 1
4 l
OIG/93A-10 Page 9 I
fl U
Nuclear Safety-Related information Systems Survey 13.
Does the data entry format on the screen correspond with NRC input documents and office
]
procedures?
. Number of responses to this geestion = = 8 Breakdown of responses:
Definitely Yes To Some Extent Undecided Probably Not Dennitely Not Not Applicable 1
2 1
0 0
4 I;
I-14.
Does the system prompt for codes and values?
I, Number of responses to this question = = 8 1
Breakdown of responses:
Definitely Yes To Some Extent Undecided Probably Not Definitely Not Not Applicable i
2 1
1 0
0 4
1
- 15. Are the codes and values documented and easy to remember?
Number of responses to this question = = 8 Breakdown of iesponses:
Definitely Yes To Some Extent Undecided Probably Not Definitely Not Not Applicable 0
2 2
0 0
4 oIG/1M-10 Page 10 I'
=
Nucioar Safety-Related information Systems Survey 16.
Is there immediate feedback when incorrect data is entered?
Number of responses to this question = = 8 Breakdowm of responses:
Definitely Yes To Some Extent Undecided Probably Not Dennitely Not Not Applicable
+
0 2
1 0
0 5
i l
- 17. Are error messages easy to understand?
Number of rc ponses to this question = = 8 Breakdown of responses:
1 Dennitely Yes To Some Extent Undecided Probably Not Definitely Not Not Applicable 1
2 1
0 0
4 i
i OlG/9M-10 Page 11 I
Nudoar Safety-Related information Systems Survey Evaluation of Outputs:
- 18. In your judgement, are outputs:
l a.
Accurate and reliable?
Number of responses to this question = = 8 Breakdown of responses:
Dennitely Yes To Some Extent Undecided Probably Not Definitely Not Not Applicable 3
3 2
0 0
0 b.
Timely, and available when needed?
Number of responses to this question = = 8 Breakdown of responses:
Definitely Yes To Some Extent Undecided Probably Not Definitely Not Not Applicable J
3 2
0 0
0 I
c.
Up-to-date?
Number of responses to this question = = 8 I
Breakdown of responses:
Definitely Yes To Some Extent Undecided Probably Not Definitely Not Not Applicable 3
4 1
0 0
0 I
ononn-io rap 12 I
Nuclear Safety-Related Information Systems Survey d.
Useful?
Number of responses to this question = = 8 Breakdown of responses:
I Definitely Yes To Some Extent Undecided Probably Not Definitely Not Not Appilcable 3
4 1
0 0
0 e.
Understandable?
Number of responses to this question = = 8 Breakdown of responses:
Definitely Yes To Some Extent Undecided Probably Not Definitely Not Not Appilcable 3
4 1
0 0
0 I
I I
I OlG/91410 Page 13 w
Nuclear Safety-Related Information Systeme Survey 1
iII Evaluation of Operating Processes:
)
19.
Is the system easy to access or log in to?
Number of responses to this question = = 9 i
Breakdown of responses:
Definitely Yes To Some Extent Undecided Probably Not Dennitely Not Not Applicable l
2 4
1 0
1 1
I 20.
Is the system sufficiently tutorial to assist you during operations?
Number of responses to this question = = 8 Breakdown of responses:
Definitely Yes To Some Ertent Undecided Probably Not Definitely Not Not Applicable 0
3 3
0 1
1 21.
Is the system user-friendly?
Number of responses to this question = = 8 Breakdown of responses:
I Definitely Yes To Some Extent Undecided Probably Not Definitely Not Not Applicable l
0 2
3 2
0 1
OlG/Y3A-10 Page 14 5
=
I I
Nuclear Safety-Related Information Systems Survey I.-
- 22. Are the queries easy to perform?
l Number of responses to this question = = 8 i
Breakdown of responses:
Definitely Yes To Some Extent Undecided Probably Not Definitely Not Not Applicable 1
1 2
3 0
1 I
I
- 23. Are procedures well documented?
l Number of responses to this question = = 8 Breakdown of responses:
' Definitely Yes To Some Extent Undecided Probably Not Definitely Not Not Applicable
+
l 1
3 2
2 0
0 I
- 24. Is the system slow to respond?
Number of responses to this question = = 8 Breakdown of responses:
l I
Definitely Yes To Some Extent Undecided Probably Not Definitely Not Not Applicable 1
2 1
1 3
0 l
nr 15 oiofnuo I
5, B1 I,
Nuclear Safety-Related Information Systems Survey 25.
Do you experience any hardware problems (such as storage space, system down time?)
Number of responses to this question = = 8 Breakdown of responses:
Definitely Yes To Some Extent Undecided Probably Not Definitely Not Not Applicable 0
0 2
0 4
2 I
26.
Do you experience any functions that terminate regularly due to:
a.
user / errors Number of responses to this question = = 8 Breakdown of responses:
l Definitely Yes To Some Extent Undecided Probably Not Definitely Not Not Applicable 1
1 1
1 3
1 b.
software problems Number of responses to this question = = 8 Breakdown of responses:
Definitely Yes To Some Extent Undecided Probably Not Definitely Not Not Applicable E
i 0
0 1
1 3
3 I
g
~,.
Nudear Safety-Related Information Systems Survey c.
hardware / communications failures Number of responses to this question = = 8 Breakdown of responses:
Dennitely Yes To Some Extent Undecided Probably Not Dennitely Not Not Applicable 0
2 1
1 2
2 I
I I
l t
I I
I g
~,,
i i
j
Nuclear Safety-Related information Systems Survey Evaluation of Maintenance Services:
- 27. Do you think the system is well maintained?
Number of responses to this question = = 8 Breakdown of responses:
Dennitely Yes To Some Extent Undecided Probably Not Dennitely Not Not Applicable l
1 4
3 0
0 0
- 28. /Je IRM supported staff / contractors accessible when you have problems or questions?
Number of responses to this question = = 8 Breakdown of responses:
Definitely Yes To Some Extent Undecided Probably Not Definitely Not Not Applicable j
i
)
1 0
4 0
0 3
29.
Does the staff follow-up to ensure that problems and/or questions are fully resolved?
j Number of responses to this question = = 8 l1 Breakdown of responses:
Definitely Yes To Some Extent Undecided Probably Not Dennitely Not Not Applicable 2
1 1
1 0
3 onopwso n,is e
in
Nuclear Safety-Related Information Systems Survey 30.
Do you think problems are solved on a timely basis?
Number of responses to this question = = 8 Breakdown of responses:
Definitely Yes To Some Extent Undecided Probably Not Definitely Not Not Applicable 1
2 1
1 0
3 2
I 1
I i
I I
OlGfIM-10 Page 19
Ea Nuclear Safety-Related information Systems Survey 8 valuation of Systems Development Services:
31.
Have you participated in committee meetings or work sessions to discuss computer requirements with IRM staff?
Number of responses to this question = = 9 Breakdown of responses:
Definitely Yes To Some Extent Undecided Pn>bably Not Definitely Not Not Applicable 2
1 0
0 6
0 32.
Do you feel that user involvement during system development is sufficient?
Number of responses to this question = = 8 Breakdown of responses:
Definitely Yes To Some Extent Undecided Probably Not Definitely Not Not Applicable 2
1 1
3 1
0 33.
Do you think that there is consensus among users on system requirements?
Number of responses to this question = = 8 l
Breakdown of responses:
Definitely Yes To Some Extent Undecided Probably Not Definitely Not Not Applicable 0
2 1
2 3
0 OlG/91410 Page 2D E.
I Nuclear Safety-Related information Systems Survey 34.
Do you feel IRM staff members are responsive to your needs?
^ l Number of responses to this questien = = 8 Breakdown of responses:
I Dennitely Yes To Some Extent Undecided Probably Not Dennitely Not Not Applicable 2
0 2
1 0
3 I
35.
Could you effectively perform your duties:
a.
Without the system?
Number of responses to this question = = 9 Breakdown of responses:
Not Appilcable Yes No 1
6 2
b.
If queries / reports were generated less often?
Number of responses to this question = = 9 Breakdown of responses:
Yes No Not Applicable 4
3 2
I g
E s
L Nuclear Safety-Related Information Systems Survey i
CYSTEN:
EVENT / UNIT UPDAYE SYSTEM (SINET)
MUNBER OF RESPONDENTS==
9 Computer System Evaluation: The following questions are designed to obtain user opinions regarding:
1.
Check how often you use this system?
Number of responses to this question== 9 i
3 Daily 0
Veekly 1
Monthly 1
Annually 4
Never O_
Other I
2.
Activities that the system is used to support include (check all that apply):
l NRC Policy 0
Research 0
Litigation
_. 2_
Enforcement J
Investigation 4
Inspections 2
Nuclear Reactor 0
Nuclear Materials 1
Congressional Regulation Regulation Inquiries J
Other OlGf/3A-10
% 22 j
i
)
s,
I Nudear Safety-Related information Systems Survey 3.
How is the system used?
(check all that apply) 2 Transaction processing (i.e. clerical and record keeping functions)
J Management Reports 3 Decision Support (such as "what-if" analysis) 3 Planning or Strategic Decision Making 3 Document Retrieval 3 Other 4.
Indicate (by circling the appropriate number) the importance of the system in relation to the work of your office or department:-
Number of responses to this question==
5 Breakdown of responses:
Not Very Not Important Undecided Important Important Applicable 2
0 2
1 0
I I
osarna-so r., a I
EE Nuoaar Safety-Related Information Systems Survey Information System Evaluation:
{
5.
Are there any problems relating information in this system to information contained in other systems?
E !
El Number of responses to this question==
5 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
1 O
3 0
1 0
1 l
6.
Are there any incompatibilities / obstacles between this system and others?
Number of responses to this question==
5 Breakdown of responses:
Dsfinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
4 0
0 C
0 1
7.
Do you believe the system duplicates other processes or systems?
Number of responses to this question==
5 Breakdown of responses:
)
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
1 1
0 2
0 OlG/9M-10 I V 24 5=
I l
Nudear Safety-Related Information Systems Survey 8.
Does the information duplicate information contained in other data bases?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
2 1
1 0
0 i I 9.
Do you perform any manuel activities (such as maintaining records, j
editing, calculating, or summarizing data to supplement the i
functions of this system?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
1 0
0 1
0 l
I l I l
osopwto r., 25 l
L
___________________________________________j
Nuclear Safety-Related information Systems Survey Evaluation of Input Process:
- 10. Do you supply input data for this system?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicab.e 3
1 0
0 1
0
- 11. Is the input process user-friendly?
Number of responses to this question==
5 Breakdown of responses:
Dofinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
1 0
0 1
0 I
- 12. Does the input process save clerical effort?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
1 1
0 2
0 i
osan.w-io rwa
Nuclear Safety-Related information Systems Survey
- 13. Does the data entry format on the screen correspond with NRC input documents and office procedures?
Number of responses to this question==
5 Breakdown of responses:
Dsfinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
2 0
1 0
1 i
I I
14.
i Does the system prompt for codes and values?
Number of responses to this question==
4 Breakdown of responses:
I Yes Definitely To Some Probably Definitely Not Extent Undecided Not Not Applicable 1
1 0
0 2
0
- 15. Are the codes and values documented and easy to remember?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not j
Yes Extent Undecided Not Not Applicable 2
0 0
1 1
1 1
I I
~~
~
I 4
Ea Nuclear Safety-Related Information Systems Survey
- 16. Is there immediate feedback when incorrect data is entered?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 2
1 1
0 0
1
- 17. Are error messages easy to understand?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
2 1
0 0
1 I
I h
I I
~
~=
Nuclear Safety-Rolated Information Systems Survey Evaluation of Outputs:
- 18. In your judgement, are outputs:
- a. Accurate and reliable?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
4 0
0 0
0 I
- b. Timely, and available when needed?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
1 1
0 2
0 a
- c. Up-to-date?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable
{
1 2
0 0
2 0
I otopwto Par 29
l Nuclear Safety-Related information Systems Survey
- d. Useful?
Number of responses to this question==
5 l
Breakdown of responses:
Dsfinitely To Some Probably Definitely Not l
Yes Extent Ur ',ecided Not Not Applicable 2
0 1
1 1
0
- e. Understandable?
Number of responses to this question==
5 Breakdown of responses:
l Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 2
3 0
0 0
0 l
l I
l I
I I
l l
OlG/9%10 gy y
\\
P
~&
y l
Nuclear Safety-Related Information Systems Survey I
1 Evaluation of Operatiny Processes:
- 19. Is the system easy to access or leg in to?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 2
1 0
0 1
1 I
- 20. Is the system sufficiently tutorial to assist you during operations?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
1 0
1 1
1 1
- 21. Is the system user-friendly?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 2
0 0
2 0
1 e,_.
\\
Nuclear Safety-Related Information Systems Survey Ii i
- 22. Are the queries easy to perform?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 2
0 1
0 1
1
- 23. Are procedures well documented?
Number of responses to this question==
5 j
Breakdown of responses:
j Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
2 0
1 0
1 I
1
- 24. Is the system slow to respond?
Number of responses to this question==
4 Il Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
1 1
0 1
1 I'
l onc/9wn re n 1
1 m-
,)
Nuclear Safety-Rc4ated Information Systems Survey
- 25. Do you experience any hardware problems (such as storage space, system down time?)
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
2 0
1 1
1
- 26. Do you experience any functions that terminate regularly due tot
- a. user / errors Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
0 0
0 4
1 4
b, software problems Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
1 0
2 1
1 I
01Gf/M-10 Pete 33
E U
Nuclear Safety-Related Information Systems Survey
- c. hardware / communications failures Number of responses to this question==
5 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
1 0
1 1
1 h
t I
I I
a.
I I
Nuclear Safety-Related Information Systems Survey j
i I
Evaluation of Maintenance services I
- 27. Do you think the system is well maintained?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
3 1
0 0
0 f
- 28. Are IRM supported staff / contractors accessible when you have I
problems or questions?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not I.
Yes Extent Undecided Not Not Applicable 4
0 0
0 0
1 1
- 29. Does the staff follow-up to ensure that problems and/or questions are fully resolved?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
1 0
0 0
1 I
g
l i
Eal I,
Nuclear Safety-Related Information Systems Survey 1
- 30. Do you think problems are solved on a timely basis?
Number of responses to this question==
5 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable i
3 0
0 1
0 1
1 l
1 I
Il I
OlG/MA-10 Page 36 s.
u
Nucioar Safety-Related information Systems Survey I
ent Servicess Evaluation of Systems Develo I
- 31. Have you participated in committee meetings or work sessions to discuss computer requirements with IRM staff?
Number of responses to this question==
5 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 2
1 0
0 2
O l
- 32. Do you feel that user involvement during system development is sufficient?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
1 3
0 0
0
- 33. Do you think that there is consensus among users on system requirements?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 2
1 0
0 2
0 I
hgr 37 01Gr/W10
Nuclear Safety-Related information Systems Survey
- 34. Do you feel IRM staff members are responsive to your needs?
Number of responses to this question==
5 Breakdown of responses:
l Dsfinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable B
2 1
2 0
0 0
- 35. Could you effectively perform your duties:
- a. Without the system?
Ilumber of responses to this question==
5 Breakdown of responses:
Not Yes No Applicable 2
3 0
b.
If queries / reports were generated less often?
Number of responses to this question==
5 Breakdown of responses:
Not Yes No Applicable 1
3 1
onopwto rap as I=
Nuclear Safety-Rolated Information Systems Survey CYSTEM:
GENERAL LICENSE DATA BASE SYSTEM (GLDB)
NUMBER OF RESPONDENTS==
3 computer System Evaluation: The following questions are designed to cbtain user opinions regarding:
1.
Check how often you use this system?
Number of responses to this question== 3 1
Daily 0
Weekly 1
Monthly 1
0 Annually O_
Never 1
Other 2.
Activities that the system is used to support include (check all that apply):
1 NRC Policy
_1 Research
_0 Litigation 1
Enforcernent 1
Investigation
_0_
Inspections 0
Nuclear Reactor i
Nuclear Materials
_0 Congressional Regulation Regulation Inquiries
_1 Other I
OlG/9W10 Page 39 1
I
EB Nuclear Safety 4 elated Information Systems Survey 3.
How is the system used?
(check all that apply) 2 Transaction processing (i.e. clerical and record keeping functions) 2 Management Reports l Decision Support (such as "what-if" analysis)
_3_ Planning or Strategic Decision Making
_0_
Document Retrieval
_1, Other 4.
Indicate (by circling the appropriate number) the importance of the system in relation to the work of your office or department:
Number of responses to this question==
3 Breakdown of responses:
Not Very Not Important Undecided Important Important Applicable 0
0 1
2 0
I ola r m -io r., 40 1
=,
Nuclear Safety-Related information Systems Survey I
Information 87 stem Evaluation:
I 5.
Are there any problems relating information in this system to information contained in other systems?
Number of responses to this question==
3 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
0 0
0 0
3 I
6.
Are there any incompatibilities / obstacles between this system and others?
Number of responses to this question==
3 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
0 0
0 0
2 7.
Do you believe the system duplicates other processes or systems?
Number of responses to this question==
3 Breakdown of responses:
l I
l Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
0 0
1 2
0 I
OlG/9W10 Page 41
Ei 5'
Nuclear Safety-Related Information Systems Survey 8.
Does the information duplicate information contai;.ed in other data l
bases?
[
Number of responses to this question==
3 j
Breakdown of responses:
Definitely To Some Probably Definitely Not I
Yes Extent Undecided Not Not Applicable T
0 0
0 1
2 0
[
I 9.
Do you perform any manual activities (such as maintaining records, editing, calculating, or summarizing data to supplement the functions of this system?
Number of responses to this question==
3 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 2
0 0
0 1
0 I
I I
I OKin3A-10 rage 42 5e
l l
l I
Nuclear Safety-Related information Systems Survey I
Evaluation af Input Procesar
- 10. Do you supply input data for this system?
Number of responses to this question==
3 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 2
0 0
0 1
0 I
- 11. Is the input process user-friendly?
Number of responses to this question==
3 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
0 1
0 1
1 1
- 12. Does the input process save clerical effort?
Number of responses to this question==
3 l
Breakdown of responses:
Definitely To Some Probably Definitely Not
[
Yes Extent Undecided Not Not Applicable 0
0 0
2 0
1 I
I
~ <>
I 1
I' Nuclear Safety-Related Information Systems Survey
- 13. Does the data entry format on the screen correspond with NRC input documents and office procedures?
Number of responses to this question==
3 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
0 0
1 1
1 1
- 14. Does the system prompt for codes and values?
Number of responses to this question==
3 Breakdown of responses:
Dsfinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Appliccble
=
0 1
0 0
1 1
- 15. Are the codes and values documented and easy to remember?
I Number of responses to this question==
3 l
Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable
(
0 0
0 0
1 2
l I
clo/nA-10 rage 44 i
I..
Nuclear Safety-Related Information Systems Survey
- 16. Is there immediate feedback when incorrect data is entered?
Number of responses to this question==
3 Breakdown of responses:
Definitely To Come Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
0 0
1 2
0
- 17. Are error messages easy to understand?
Number of responses to this question==
3 B.*eakdown of responses:
Definitely To Some Probably Definitely Not I
Yes Extent Undecided Not Not Applicable 0
1 0
0 2
0 4
I OlG/VM-10 Page 45 i
E, a
Nuclear Safety-Related Information Systems Survey Evaluation of Outputs:
- 18. In your judgement, are outputs:
- a. Accurate and reliable?
Number of responses to this question==
3 Breakdown of responses:
Dsfinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
0 1
1 0
0
- b. Timely, and available when needed?
Number of responses to this question==
3 Breakdown of responses:
I, Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
0 1
2 0
0
- c. Up-to-date?
Number of responses to this question==
3 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
0 0
0 0
0 olG/9M40 Page 46
=
i Ir Nuclear Safety-Rolated information Systems Survey
- d. Useful?
Number of responses to this question==
3 Breakdown of responses:
I Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 2
1 0
0 0
0
- e. Understandable?
Number of responses to this question==
3 Breakdown of responses:
Definitely To Some Probably Definitely Not I
Yes Extent Undecided Not Not Applicable 1
1 1
0 0
0 I
I 01G/9W10 Page 47 I
I Nuclear Safety-Related Information Systems Survey Evaluation cf Operating Processos:
- 19. Is the system easy to access or log in to?
Number of responses to this question==
3 Breakdown of responses:
Dsfinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
0 0
2 1
0
- 20. Is the system sufficiently tutorial to assist you during operations?
Number of responses to this question==
3 Breakdown of responses:
Dsfinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicabic 0
0 0
0 3
0 I
- 21. Is the system user-friendly?
Number of responses to this question==
3 I
Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
0 0
1 2
0 I
olonwto rage 48
l Nuclear Safety-Rotated Information Systems Survey i
- 32. Are the queries easy to perform?
l Number of responses to this question==
3 l
Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
0 0
1 2
0 1
l
- 23. Are procedures well documented?
Number of responses to this question==
3 1
l Breakdown of responses:
g Definitely To Some Probably Definitely Not
]
l E
Yes Extent Undecided Not Not Applicable l
O O
1 1
1 0
- 24. Is the system slow to respond?
)
\\
Number of responses to this question==
3 i
Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable j
I3 0
0 0
0 0
j onopwto r., 49 I
l
l O
U l
l Nuclear Safety-Related information Systems Survey l
l
- 25. Do you experience any hardware problems (such as storage space, system down time?)
l l
Number of responses to this question==
3 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 2
1 0
0 0
0
]
1 i
l l
- 26. Do you experience any functions that terminate regularly due to:
- a. user / errors Number of responses to this question==
3 E
Breakdown of responses:
Dafinitely To Some Probably Definitely Not 1
Yes Extent Undecided Not Not Applicable 1
0 2
0 0
0 b.
software problems N'imber of responses to this question==
3 l
l l
Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
0 2
0 0
0 olG/93A-10 Page 50 E
=
l
I I
Nuclear Safety-Rotated information Systems Survey
- c. hardware /communicat %as failures Number of responses to this question==
3 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
1 1
0 0
0 I
I i
I I
I I
I I
I I
OIG/13A-10 Page 51 m
J
l 1
l l
Nuclear Safety-flotated Information Systems Survey B
Evaluation of L11ntenance Services:
- 27. Do you think the system is well maintained?
Number of responses to this question==
3 Breakdown of responses:
Dsfinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
1 1
0 1
0
- 28. Are IRM supported staff / contractors accessible when you have problems or questions?
Number of responses to this question==
3 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
1 1
1 0
0 I
I
- 29. Does the staff follow-up to ensure that problems and/or questions are fully resolved?
Number of responses to this question==
3 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
0 1
1 1
0 I
orarmo rase 52 a
I I
Nuclear Safety-Related information Systems Survey I
- 30. Do you think problems are solved on a timely basis?
Number of responses to this question==
3 Breakdown of responses:
Definitely To Some Probably Defip*.cely Not Yes Extent Undecided Not Not Applicable 0
0 2
0 1
0 t
L m
[
[
[
OlG/9M-10 Page 53
I Nuclear Safety-Related Information Systems Survey Evaluation of ST*****
P"*"' 8""'i
- 31. Have you participated in committee meetings or work sassions to discuss computer requirements with IRM staff?
Number of responses to this question==
3 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not AITlicable 0
0 0
0 3
0
- 32. Do you feel that user involvement during system development is sufficient?
Number of responses to this question==
3 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
0 2
0 0
0 I'
- 33. Do you thir.k that there is consensus among users on system requirements?
Number of responses to this question==
3 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 2
0 1
0 0
0 l
i OlG/9M-10 g $4 m.
I I
Nuclear Safety-Related information Systems Survey I
- 34. Do you feel IRM staff members are responsive to your needs?
Number of responses to this question==
3 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
0 0
3 0
0 I
- 35. Could you offectively perform your duties a.
Without the system?
Number of responses to this question==
3 Breakdown of responses:
Not Yes No Applicable 1
2 0
I
- b. If queries / reports were generated less often?
Number of responses to this question==
3 Breakdown of responses:
Yes No Applicable 1
2 0
I I
g I
Ea Nuclear Safety-Related information Systems Survey CYSTEM:
INTEGRATED EVENTS SYSTEM (IEVENTS)
NUMBER OF RESPONDENTS==
80 computer System Evaluation: The following questions are designed to obtain user opinions regarding:
1.
Check how often you use this system?
Number of responses to this question== 77 12 Daily 8
Veekly J
Monthly
_1 Annually 45 Never J
Other 2.
Activities that the system is used to supnort ir. lude (check a1.1 ti,at apply) :
I J
NRC Policy 1
Research 1
Litigation 11 Enforcement 7
Investigation 18 Inspections 7
Nuclear Reactor 1
Nuclear Materials 3
Congressional Regu'.ation Regulation Inquiries 11 Other I
I I
~~
E
I I
Nuclear Safety-Related information Systems Survey I
3.
How is the system used?
(check all that apply)
_4, Transaction processing (i.e. clerical and record keeping functions) 1), Management Reports 6 Decision Support (such as "what-if" analysis) i
_7 Planning or Strategic Decision Making M Docwnent Retrieval
_5 Other I
I 4.
Indicate (by circling the appropriate number) the importance of the system in relation to the work of your office or department:
Number of responses to this question==
29 Breakdown of responses:
Not Very Not Important undecided Important Important Applicable I
2 2
6 11 8
I I
I I
I g
I
Ea, Nuclear Safety-Related information Systems Survey Information System Evaluation:
5.
Are there any problems relating information in this system to information contained in other systems?
Number of responses to this question==
30 Breakdown of responses:
D2 finitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
5 1
6 3
12 3
I 6.
Are there any incompatibilities / obstacles between this system and others?
1 Number of responses to this question==
30 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
1 11 3
9 3
7.
Do you believe the system duplicates other processes or systems?
Number of responses to this question==
30 Breakdown of responses:
Definitely To Some Probably Definitely Not l
Yes Extent Undecided Not Not Applicable 4
4 8
4 10 0
I OIc/9u.m rap 58 a
m
I I
Nuclear Safety-Related Ir. formation Systems Survey 8.
Does the information duplicate information contained in other data bases?
I Number of responses to this question==
30 Breakdown of responses:
Dsfinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 4
7 9
3 7
0 I
9.
Do you perform any manual activities (such as maintaining records, 3
editing, calculating, or summarizing data to supplement the
- l functions of this system?
l Number of responses to this question==
30 l
l Breakdown of responses:
g Definitely To Some Probably Definitely Not lg Yes Extent Undecided Not Not Applicable 4
3 2
1 20 0
l I
'I
,I II l
i v 59 osorr.u-io
a Nuclear Safety-Related information Systems Survey Evaluation of Input Process:
- 10. Do you supply input data for this system?
Number of responses to this question==
30 Breakdown of responses:
Dsfinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
2 0
0 23 2
I
- 11. Is the input process user-friendly?
Number of responses to this question==
28 Breakdown of responses:
Dsfinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable g
5.
6 2
4 0
2 14 I
- 12. Does the input process save clerical effort?
Number of responses to this question==
28 Breakdown of responses:
Definitely To Some Probably Definitely Not
]
Yes Extent Undecided Not Not Applicable
{
4 4
5 1
1 13 1I OlG/934-10 Page(4 W
l i
I Nuclear Safety-Related Information Systems Survey I
- 13. Does the data entry format on the screen correspond with NRC input documents and office procedures?
Number of responses to this question==
29 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable I
6 3
7 2
1 10 I
I
- 14. Does the system prompt for codes and values?
N"mber of responses to this question==
29 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecidad Not Not Applicable 4
4 5
2 4
10 I
- 15. Are the codes and values documented and easy to remember?
dumber of responses to this question==
29 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
4 7
1 2
12 I
I olG/91A-10 Pap 61
I Nuclear Safety-Related inforrnation Systems Survey
- 16. Is there immediate feedback when incorrect data is entered?
Number of responses to this question==
28 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 2
5 8
1 1
11 I
- 17. Are error messages easy to understand?
Number of responses to this question==
28 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
6 4
4 2
9 I
I I
I I
I onopu-10 rage a
I I
Nuclear Safety-Related information Systems Survey i
Evaluation of Outputs:
a.
,. u :-.. :. ;. : :....
. i ~ : g...~
...,..., - : <..,. : o,c. a. : ~.....
I
- 18. In your judgement, are outputs:
I
- a. Accurate and reliable?
Number of responser
'o this question==
30 Breakdown of responses:
I Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 13 10 4
0 2
1 I
I
- b. Timely, and available when needed?
Number of responses to this question==
29 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable I
10 8
5 2
3 1
l c.
Up-to-date?
Number of responses to this question==
30 Breakdown of responses.
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 11 6
5 4
3 1
i OIG/9M-10 Page 63
I.
Nuclear Safety-Related information Systems Survey Il
- d. Useful?
Number of responses to this question==
30 Breakdown of responses:
i Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 16 8
3 0
2 1
I
- e. Understandable?
Number of responses to this question==
30 Breakdown of responses:
Definitely T'a Some Probably Definitely Not 3
Yes Extent Undecided Not Not Applicable gi 15 11 2
0 1
1 g j g.
I!
I I
l a
w OIG/9M-10 Page 64 u
9
i I
Nuclear Safety-Related Information Systems Survey I
Evaluation of operating Processes:
I 19, Is the system easy to access or log in to?
Number of responses to this question==
30 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 16 9
0 1
4 0
I
- 20. Is the system suff!.ciently tutorial to assist you during I
operations?
Number of responses to this question==
30 Breakdown of responses:
Definitely To Some Probably Definitely Not I
Yes Extent Undecided Not Not Applicable 7
10 5
1 4
3 I
I al. Is the system user-friendly?
Number of responses to this question==
30 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 9
9 6
2 3
1 j
i Page(d olG/nA-10 r
I
I-Nuclear Safety-Related Information Systems Survey
- 22. Are the queries easy to perform?
Number of responses to this question==
30 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 4
10 8
2 3
3 I
- 23. Are procedures well documented?
j Number of responses to this question==
29 Breakdown of responses:
Dsfinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
4 11 2
6 5
I 24.
Is the system slow to respond?
Number of responses to this question==
30 i
Breakdown of responses:
1 Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable j
s 1
3 4
6 15 1
l 9
l; OlG/91A-10 Page(4 4
N l
Nuclear Safety-Rotated information Systems Survey I
25.
Do you experience any hardware problems (such as storage space, system down time?)
Number of responses to this question==
30 i
Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
2 2
3 18 2
I
- 26. Do you experience any functions that terminate regularly due tot a.
user /crrors Number of responses to this question==
30 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable I
2 1
6 4
15 2
I b.
software problems Number of responses to this question==
30 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 4
2 3
3 16 2
I I
I I
Ea Nuclear Safety-Related information Systems Survey
- c. hardware / communications failures Number of responses to this question==
30 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable
=,
5 2
3 5
13 2
I I
I I
I I!
.,,c.-
~-
n=j i
A I
Nuclear Safety-Related Information Systems Survey I
Evaluation of Maintenance Services:
- 27. Do you think the system is well maintained?
Number of responses to this question==
30 i
Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Fatent Undecided Not Not Applicable 8
5 11 2
3 1
I Are IRM supported staff / contractors accessible when you have I
- 28. problems or questions?
Number of responses to this question==
30 I
Breakdown of responses:
Definitely To Some Probably Definitely Not I
Yes fatent Undecided Not Not Applicable 7
3 9
3 1
7 Does the staff follow-up to ensure that problems and/or questions f
29.
are fully resolved?
Number of responses to this question==
29 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Fatent Undecided Not Not Applicable 7
4 8
2 0
8 I
I olG/93A-10 I
EU Nuclear Safety-Related information Systems Survey
- 30. Do you think problems are solved on a timely basis?
Number of responses to this question==
29 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Ihtent Undecided Not Not Applicable 5
8 6
1 1
8 I
I I
I
}
^
OIG/VM-10 Page~10 m
I Nuclear Safety-Related Information Systems Survey I
Evaluation of Systems Development Services:
I
- 31. Have you participated in committee meetings or work sessions to discuss computer requirements with IRM staff?
Number of responses to this question==
30 Breakdown of responses:
Definitely To Some Protably Definitely Not Yes Extent Undecided Not Not Applicable 2
1 0
0 26 1
I
- 32. Do you feel that user involvement during system development is sufficient?
Number of responses to this question==
30 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
1 9
4 9
4 I
- 33. Do you think that there is consensus among users on system requirements?
Number of responses to this question==
30 j
Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
5 9
4 6
5 I
rwn onarm-w I
ER Nuclear Safety-Rotated information Systems Survey
- 34. Do you feel IRM staff members are responsive to your needs?
Number of responses to this question==
30 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 7
4 4
6 3
6
- 35. Could you effectively perform your duties:
- a. Without the system?
Number of responses to this question==
30 Breakdown of responses:
Not Yes No Applicable 22 8
0 i
b.
If queries / reports were generated less often?
Number of responses to this question==
29 Breakdown of responses:
Not Yes No Applicable 17 6
6 I
OIG/9M-10 Page 72
I I
Nuclear Safety-Related information Systems Survey I
CYSTEMI MASTER IMSPECTION PL2"NING SYSTEM (MIPS)
NUMBER OF RESPONDENTS==
56 Computer System Evaluation: The following questions are designed to obtain user opinions regarding:
1.
Check how often you use this system?
Number of responses to this question== 52 l
Daily H
Weekly J
Monthly J
Annually H
Never J
Other 2.
nctivities that the system is used t.
supyort include (check all that apply):
I 8
NRC Policy 2
Research 1
Litigation 3
Enforcement 1
Investigation 32 Inspections 9
Nuclear Reactor 2
Nuclear Materials 1
Congressional Regulation Regulation Inquiries J
Other I
g
~,
I
I Nudear Safety-Related Information Systems Survey 3.
How is the system used?
(check all that apply) 13 Transaction processing (i.e. clerical and record keeping functions) l 14 Management Reports 4
_1 Decision Support (such as "what-if" analysis) 26 Planning or Strategic Decision Making I
_5_ Document Retrieval
_2_
Other I
4.
Indicate (by circling the appropriate number) the importance of the system in relation to the work of your office or depa tment:
Number of responses to this question==
36 f
Breakdown of responses:
Not Very Not Important Undecided Important Important Applicable 1
3 16 16 0
I I
olG/VM-10 Page 74
=
I I
Nuclear Safety-Related Information Systems Survey I
Evaluation:
InformationBJatent 5.
Are there any problems relating information in this system to information contained in other systems?
I Number of responses to this question'==
36 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 7
6 11 11 1
0 I
6.
Are there any incompatibilities / obstacles between this system and others?
Number of responses to this question==
36 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 6
7 13 8
2 0
7.
Do you believe the system duplicates other processes or systems?
I Number of responses to this question==
36 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable I
1 7
9 7
12 0
ola/wwlo rage 75 l
I
Ea Nuclear Safety-Related information Systems Survey 8.
Does the information duplicate information contained in other data bases?
Number of responses to this question==
36 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 2
9 14 6
5 0
9.
Do you perform any manual activities (such as maintaining records, editing, calculating, or summarizing data to supplement the functions of this system?
Number of responses to this question==
36 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 9
13 3
0 11 0
I
=;
J
I I
Nuclear Safety-Related Information Systems Survey
. Evaluation of Input Process
- 10. Do you supply input data for this system?
Number of responses to this question==
36 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 11 8
0 2
15 0
I
- 11. Is the input process user-friendly?
Number of responses to this question==
36 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
8 8
5 8
6
- 12. Does the input process save clerical effort?
Number of responses to this question==
36 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
4 10 4
13 5
I I
oso/vwio r.y n I
Ei U
Nuclear Safety-Related Information Sy:tems Survey
- 13. Does the data entry format on the screen correspond with NRC input documents and office procedures?
Number of responses to this question==
34 Breakdown of responses-Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable l
1 5
17 2
3 6
i i
- 14. Does the system prompt for codes and values?
gl 3i Number of responses to this question==
36 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Noe Applicable 6
6 12 3
2 7
- 15. Are the codes and values documented and easy to remember?
Number of responses to this question==
35 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 2
6 11 4
6 6
I.
onornA-to rage 78 5m
I-Nuclear Safety-Related Information Systems Survey I
- 16. Is there immediate feedback when incorrect data is entered?
Number of responses to this question==
36 l
Breakdown of responses:
Dafinitely To Some Probably Definitely Not l
Yes Extent Undecided Not Not Applicable 4
4 6
11 3
5 7
l l
I
- 17. Are error messages easy to understand?
Number of responses to this question==
36 Breakdown of responses:
Definitely To Some Probably Definitely Not I
Yes Extent Undecided Not Not Applicable 1
4 16 2
6 7
I I
I I
I
~-
I
Ea Nuclear Safety-Related information Systems Survey Evaluation of Outputs:
- 18. In your judgement, are outputs:
- a. Accurate end reliable?
Number of responses to thir, quastion==
36 Breakdown of responses:
Definitely To Some Probably Definitely Not l
Yes Extent Undecided Not Not Applicable 5
6 18 3
5 4
0 mg, I
- b. Timely, and available when needed?
Humber of responses to this question==
35 Breakdown of responses:
1 Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable
?
16 3
2 5
0 I,
i
- c. Up-to-date?
Number of responses to this question==
36 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable i
8 16 6
2 4
0 I'
I Ea
I Nuclear Safety-Rolated information Systems Survey
- d. Useful?
a' Number of responses to this question==
35 Breakdown of responses:
I Yes Definitely To Some Probably Definitely Not Extent Undecided Not Not Applicable 8
16 8
2 1
0
- e. Understandable?
Number of responses to this question==
35 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 9
17 6
3 0
0 I
I I
I I
I 1
I I
I
Ea; Nuclear Safety-Related Information Systems Survey Evaluation of Operating Processes:
- 19. Is the system easy to access or log in to?
Number of responses to this question==
36 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 5
9 10 1
2 9
I
- 20. Is the system sufficiently tutorial to assist you during operations?
Number of responses to this question==
36 Breakdown of responses:
D3 finitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
3 10 4
9 10
- 21. Is the system user-friendly?
Number of responses to this question==
36 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
3 8
4 11 9
i i
I.
onopwto rose 82 B.
I g
Nuclear Safety-Related information Systems Survey I
22.-Are the queries easy to perform?
Number of responses to this question==
36 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
4 10 6
6 10
- 23. Are procedures well docurtented?
Number of responses to this quastion==
36 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
7 11 6
3 9
.; 4. Is the system slow to respond?
Number of responses to this question==
36 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable I3 4
9 5
5 10 I
I e> -
~>
I
5m Nuclear Safety-Related Information Systems Survey
- 25. Do you experience any hardware problems (such as storage space, system down time?)
Number of responses to this question==
36 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
3 9
3 10 11
- 26. Do you experience any functions that terminate regularly due to:
- a. user / errors Number of responses to this question==
36 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 2
2 11 4
7 10 I.
- b. software problems Number of responses to this question==
36 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
1 11 3
8 10 Il.
I oiornMo race 84 E I
' I I
Nuclear Safety-Related Information Systems Survey I
- c. hardware / communications failures l
Number of responses to this question==
35 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
1 11 5
4 11 I
I i
I I
I I
g
_-e I
I Nuclear Safety-Related Information Systems Survey Evaluation of Maintenance services
- 27. Do you think the system is well maintained?
Number of responses to this question==
36 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
11 10 3
2 7
I
- 28. Are IRM supported staff /contracto:
accessible when you have problems or questions?
Number of responses to this question==
36 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Fatent Undecided Not Not Applicable 6
4 13 1
0 12 I
- 29. Does the staff follow-up to ensure that problems and/or questions are fully resolved?
Number of responses to this question==
36 Breakdown of responses:
Definitely To Some Probably Definitely Not Yos Extent Undecided Not Not Applicable 5
4 13 2
0 12 01cfm-10 Page 86 5m
Nuc! car Safety-Related information Systems Survey
- 30. Do you think problems are solved on a timely basis?
Number of responses to this question==
36 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
4 11 2
4 12 I
I I
I I
I I
I g
I
I!
l Nuclear Safety-Related information Systems Survey Evaluation of 87 stems Development Services:
l
- 31. Have you participated in committee meetings or work sessions to discuss computer requirements with IRM staff?
Number of responses to this question==
36 Breakdown of responses:
i Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 5
0 1
0 26 4
- 32. Do you feel that user involvement during system development is sufficient?
Number of responses to this question==
36 Breakdown of responses:
l Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable B
2 6
13 3
7 5
- 33. Do you think that there is consensus among users on system requirements?
Number of responses to this question==
36 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable i
0 4
11 6
10 5
I-g
~.
a.
si <
I I
Nuctoar Safety-Related Information Systems Survey
- 34. Do you feel IRM staff members are responsive to your needs?
Number of responses to this question==
36 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
10 14 1
0 8
I
- 35. Could you effectively perfoma your duties:
- a. Without the system?
Number of responses to this question==
35 Breakdown of responses:
Not Yes No Applicable I
27 8
o I
- b. If queries / reports were generated less often?
Number of responses to this question==
32 Breakdown of responses:
Not I
Yes No Applicable I
16 5
11 I
I I
l
Nuclear Safety-Rotated Information Systems Survey DYSTEM:
OPERATOR LICENSING TRACKING SYSTEM (OLTS)
NUMBER OF RESPONDENTS==
6 computer System Evaluation: The following questions are designed to g
obtain user opinions regarding:
m 1.
Check how often you use this system?
Number of responses to this question== 6 5
Daily 1
Weekly 0
Monthly 0
Annually 0
Never 0
Other 2.
Activities that the system is used to support include (check all that apply):
_0 NRC Policy
_0 Research
_0_
Litigation 1
Enforcement 0
Investigation
_0_
Inspections 3
Nuclear Reactor 0
Nuclear Materials
_1 Congressional Regulation Regulation Inquiries 2
Other oican-to rage 90 Ew
Nuclear Safety Related information Systems Survey I
3.
Ilow is the system used?
(check all that apply) 6 Transaction processing (i.e. clerical and record keeping functions) 6 Management Reports J Decision Support (such as "what-if" analysis) 2 Planning or Strategic Decision Making J Document Retrieval 0 Other 4.
Indicate (by circling the appropriate number) the importance of the system in relation to the work of your office or department:
Number of responses to this question==
6 Breakdown of responses:
I Not Very Not Important Undecided Important Important Applicable 0
0 0
6 0
I l
osa/ww.io race 91
I Nuclear Safety-Related Inforrnation Systems Survey Information BJaten Evaluation:
I S.
Are there any problems relating information in this system to information contained in other systems?
I Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
1 0
1 0
4 6.
Are there any incompatibilities / obstacles between this system and others?
Humber of responses to this question==
6 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
1 0
1 0
4 I-7.
Do you believe the system duplicates other processes or systems?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not j
Yes Extent Undecided Not Not Applicable j
0 0
0 0
5 1
OIGfnMO Page 92 5<
i Nuclear Safety-Related Information Systems Survey I
i 8.
Does the information duplicate information contained in other data j
bases?
Number of responses to this question==
6 Breakdown of responses:
I Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
0 0
0 6
0 I
9.
Do you perform any manual activities (such as maintaining records, editing, calculating, or summarizing data to supplement the functions of this system?
i Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable I
3 2
0 0
1 0
I I
OlG/7.M-10 Page 93
Ii Nuclear Safety-Related Information Systems Survey Evaluation of Input Process:
- 10. Do you supply input data for this system?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 5
0 0
0 1
0
- 11. Is the input process user-friendly?
Number of responses to this question==
6 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
2 0
1 0
0 I
- 12. Does the input process save clerical effort?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 4
1 0
0 1
0 I
OlG/93A-10 Page 94 Ia
I Nuclear Safety-Rotated information Systems Survey I
- 13. Does the data entry format on the screen correspond with NRC input documents and office procedures?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
2 0
0 0
1
- 14. Does the system prompt for codes and values?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 4
2 0
0 0
0 I
- 15. Are the codes and values documented and easy to remember?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 4
2 0
0 0
0 Page 95 olornMo
EE Nuclear Safety-Related Information Systems Survey
- 16. Is there immediate feedback when incorrect data is entered?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 4
1 1
0 0
0
- 17. Are error messages easy to understand?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
2 0
0 1
0 i
I!
I a.
a
Nuclear Safety-Rolated Information Systems Survey I
Evaluation of outputs:
- 18. In your judgement, are outputs:
- a. Accurate and reliable?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not I
Yes Extent Undecided Not Not Applicable 5
1 0
0 0
0
- b. Timely, and available when needed?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 5
1 0
0 0
0 I
- c. Up-to-date?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 5
1 0
0 0
0 I
g I
E U
Nuclear Safety-Rotated information Systems Survey
- d. Useful?
Number of responses to this question==
6 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 6
0 0
0 0
0
- e. Understandable?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 5
1 0
0 0
0 I.
1 9
OIG/9M-10 Page 98 l
~l I
I Nuclear Safety-Rotated information Systems Survey Evaluation of Operating Processes:
I
- 19. Is the system easy to access or log in to?
Number of responses to ttis question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
2 0
0 0
0 I
- 20. Is the system sufficiently tutorial to assist you during I
operations?
Number of responses to this question==
6 Breakdown of responses:
To Some Probably Definitely Not I
Definitely Yes Extent Undecided Not Not Applicable 3
1 0
0 1
1 I
- 21. Is the system user-friendly?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
2 1
0 0
0 o
I
i Ii
'l Nuclear Safety-Related Information Systems Survey
- 22. Are the queries easy to perform?
Number of responses to this question==
6 Breakdown of responses:
l' Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable B
1 3
0 0
2 0
I I
- 23. Are procedures well documented?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 2
1 1
1 0
1 l
- 24. Is the system slow to respond?
Humber of responses to this question==
6
[
Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable l
0 2
0 0
4 0
l l
olG/7M-10 Pap 100 i
=
Nuclear Safety-Related Information Systems Survey I
- 35. Do you experience any hardware problems (such as storage space, system down time?)
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable
{
0 2
0 1
3 0
I
- 2. 6. Do you experience any functions that terminate regularly due tot
- a. user / errors Number of responses to this question==
5 l
Breakdown of responses:
l Definitely To Some Probably Definitely Not I
Yes Extent Undecided Not Not Applicable
)
l 0
0 0
0 5
0
)
lI
- b. software problems Number of responses to this quastion==
5 I
Dreakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
1 0
1 3
0 l
I OlG/nA-10 Page 101 4
Nudear Safety-Related Information Systems Survey
- c. hardware / communications failures Number of responses to this question==
5 Breakdown of responses:
l Definitely To Some Probably Definitely Not Yes Ihtent Undecided Not Not Applicable 3
0 2
0 1
2 0
I I
I I
I I
OlG/93A.10 Page 102
=
Nuclear Safety-Related information Systems Survey i
Evaluation of Maintenance services I
- 27. Do you think the system is well maintained?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
3 0
0 0
0 I
- 28. Are IRM supported staff / contractors accessible when you have I
problems or questions?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not I
Yes Extent Undecided Not Not Applicable 0
2 1
0 1
1 I
- 29. Does the staff follow-up to ensure that problems and/or questions are fully resolved?
Mumber of responses to this question==
5 Breakdown of responses:
I Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
2 1
0 0
2 I
g I
l Nuclear Safety-Rotated Information Systems Survey I
- 30. Do you think problems are solved on a timely basis?
Number of responses to this question==
6 Breakdown of responses:
j Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable l
l 1
4 1
o o
o I
I I'
I l
l olo/9 w so nge nos 5
I Nuclear Safety-Related inforrnation Systems Survey I
Evaluation of ST***""
" P"*"' "*"'i ***
i I
- 31. Have you participated in committee meetings or work sessions to discuss computer requirements with IRM staff?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
1 0
0 4
0
- 32. Do you feel that user involvement during system development is sufficient?
Number of responses to this question==
6 i
Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
2 1
0 0
0 I
- 33. Do you think that there is consensus among users on system requirements?
Number of responses to this question==
6 Breckdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 3
3 0
0 0
0 I
~~
I I
l
i Eai l
Nuclear Safety-Related Information Systems Survey
- 34. Do you feel IRM staff members are responsive to your needs?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yos Extent Undecided Not Not Applicable l
l 3
2 1
0 0
0
- j i
- 35. Could you affectively perform your duties:
l
- a. Without the system?
Number of responses to this question==
6 1
Breakdown of responses:
l Not Yes No Applicable 0
6 0
I
- b. If queries / reports were generated less often?
l Number of responses to this question==
6 Breakdown of responses:
Not Yes No Applicable l
O 5
1 ola/ww.to Pap 106 E=
I I
Nuclear Safety Related information Systems Survey I
CYSTEM:
SAFETY ISSUES MANAGRWRMT SYSTEM (SIMS)
MUMBER OF RESPONDENTS==
10 computer System Evaluation: The following questions are designed to obtain user opinions regarding:
1.
Check how often you use this system?
Number of responses to this question== 8 0
Daily Q
Weekly 1
Monthly 1
Annually 1
Never 1
Other i
I 2.
Activities that the system is used to support include (check all that apply):
I O
STC Policy 0
Research 0
Litigation 1
Enforcement 0
Investigation J
Inspections 5
Nuclear Reactor 1
Nuclear Materials O
Congressional Regulation Regulation Inquiries 2
Other I
I I
~ '-
I
Nuclear Safety-Related Information Systems Survey l
3.
How is the system used?
(check all that apply) l Transaction processing (i.e. clerical and record keeping functions)
_3 Management Reports
_9 Decision Support (such as "what-if" analysis)
.l i
_2 Planning or Strategic Decision Making 5l 5l l Document Retrieval
_1_
Other i
t,
)
4.
Indicate (by circling the appropriate number) the importance of the system in relation to the work of your office or department:
I Number c,? responses to this question==
6 Breakdown of responses:
Not Very Not Important Undecided Important Important Applicable 1
1 3
1 0
I I
I OlG/93A-10 Page 12 E=
I Nuclear Safety-Related Information Systems Survey Information BJstem Evaluation:
5.
Are there any problems relating information in this system to information contained in other systems?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
1 1
1 1
1 6.
Are there any incompatibilities / obstacles between this system and others?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable i
0 2
1 1
1 1
l 7.
Do you believe the system duplicates other processes or systems?
Humber of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
1 0
1 3
1 OlG/9M-10 Page 109
E, 5
Nuclear Safety-Related Information Systems Survey 8.
Does the information duplicate information contained in other data bases?
Number of responses to this question==
5 Breakdown of responses:
Dofinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
0 1
1 2
0 9.
Do you perform any manual activities (such as maintaining records, editing, calculating, or summarizing data to supplement the j
functions of this system?
Number of responses to this question==
6 Breakdown of responses:
Dsfinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable I
l 0
0 1
0 4
1 l
I olG/91410 Page110 EB
Nuclear Safety-Related information Systems Survey I'EvaluationofInputProcess:
I
- 10. Do you supply input data for this system?
Number of responses to this question==- 6 i
~
Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
0 0
0 6
0 I-
- 11. Is the input process user-friendly?
I Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
1 1
2 0
1
- 12. Does the input process save clerical effort?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
2 2
1 0
1 OlGfr.L410 I"PC III I
J
1 Ea Nuclear Safety-Related information Systems Survey I
1
- 13. Does the data entry format on the screen correspond with NRC input documents and office procedures?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not j
Yes Extent Undecided Not Not Applicable 0
2 1
0 1
2
- 14. Does the system prompt for codes and values?
Number of responses to this question==
6 Breakdown of responses.
Dsfinitely To Sor.
Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
2 0
1 1
1 1>. Are the codes and values documented and easy to remember?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
1 2
1 1
1 I
l l
OIG/VM-10 Page 112 l
5 l
)
I I
Nuclear Safety-Related Information Systems Survey
- 16. Is there immediate feedback when incorrect data is entered?
Number of responses to this question==
6 j
Breakdown of responses:
l Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
3 0
2 0
1 I
- 17. Are error messages easy to understand?
' I Number of responses to this question==
6 Breakdown of responses:
Dsfinitely To Some Probably Definitely Not Y
Extent Undecided Not Not Applicable
' I es l
0 2
0 1
2 1
I I
I I
I l
i OIG/93A-10 Page 113 l
t.
Nuclear Safety-Rotated Information Systems Survey Evaluation of outputs:
- 18. In your judgement, are outputs:
l
- a. Accurate and reliable?
i Number of responses to this question==
6 Ii Breakdown of responses:
Dsfinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
2 2
0 0
1 I
- b. Timely, and available when needed?
Number of responses to this question==
6 Breakdown of responses:
Dsfinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
4 1
0 0
1 I
- c. Up-to-date?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable I
O 3
2 0
0 1
010/9wio rage u 4 s=
.I I
Nuclear Safety-Related information Systems Survey
- d. Useful?
Number of responses to this question==
6 Breakdown of responses:
Dofinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
4 1
0 0
1
- e. Understandable?
Number of responses to this question==
6 Breakdown of responses:
To Some Probably Definitely Not I
Definitely Yes Extent Undecided Not Not Applicable 1
3 0
0 1
1 I
i ciarnA-to rage 115
l l
l l
l Nuclear Safety-Related Information Systems Survey l
l Evaluation of Operating Processes:
E
- 19. Is the system easy to access or log in to?
Number of responses to this question==
6 l
Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
3 1
1 0
0 Ii l
- 20. Is the system sufficiently tutorial to assist you during operations?
]
Number of responses to this question==
6 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable i
0 1
2 1
2 0
- 21. Is the system user-friendly?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not l'
l Yes Extent Undecided Not Not Applicable B
1 0
1 3
1 1
0 1
1 i
l ORG/914-10 Page 116 Bs
I I
Nuclear Safety-Related Information Systems Survey I
- 22. Are the queries easy to perform?
Number of responses to this question==
6 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
0 1
2 1
2 I
- 23. Are procedures well documented?
Number of responses to this question==
6 Breakdown of responses:
I Yes Definitely To Some Probably Definitely Not Ehtent Undecided Not Not Applicable 0
0 1
2 2
1
- 24. Is the system slow to respond?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
2 1
1 1
0 OIG/V3A-10 Pap-117 I
Ea Nuclear Safety-Retated Information Systems Survey
- 25. Do you experience any hardware problems (such as storage space, system down time?)
Number of responses to this question==
6 Breakdown of responses:
Dsfinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
1 2
0 3
0
- 26. Do you experience any functions that terminate regularly due tot
- a. user / errors Number of responses to this question==
6 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
1 1
1 3
0 I
- b. software problems Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
2 2
0 2
0
=
l i
OIG/93A-10 Page 118 8 l
Nuclear Safety-Rolated Information Systems Survey
- c. hardware / communications failures Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
1 2
0 3
0 I
I I
I I
I I
OIGf/3A-10 Page 119 I
E=
Nuclear Safety-Related Information Systems Survey Evaluation of Maintenance services
- 27. Do you think the system is well maintained?
Number of responses to this question==
6 Breakdown of responses:
l Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
1 4
1 0
0 I
- 28. Are IRM supported staff / contractors accessible when you have problems or questions?
Number of responses to this question==
6 l
Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
5 0
0 0
0 Il
- 29. Does the staff follow-up to ensure that problems and/or questions are fully resolved?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
3 1
1 0
0 l
olG/934-10 Page 120
=
I I
Nuclear Safety-Related information Systems Survey
- 30. Do you think problems are solved on a timely basis?
Number of responses to this question==
6 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
3 1
1 0
0
?
I I
I I
I OlG/93A-10 Page 121
Il i
Nuclear Safety-Related information Systems Survey i
Evaluation of ST*****
F"*"* 8*"'*****
- 31. Have you participated in committee meetings or work sessions to discuss computer requirements with IRM staff?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
0 0
1 5
0 I
- 32. Do you feel that user involvement during system development is sufficient?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
1 2
2 0
1
- 33. Do you think that there is consensus among users on system requirements?
Number of responses to this question==
6 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
1 2
2 0
1 I,
- m. m
=
I I
Nuclear Safety-Related information Systems Survey I
- 34. Do you feel IRM staff members are responsive to your needs?
Number of responses to this question==
6 Breakdown of responses-Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
4 0
1 0
0
- 35. Could you effectively perform your duties:
- a. Without the system?
Number of responses to this question==
6 Breakdown of responses:
Not Yes No Applicable I
1 1
4 i
- b. If queries / reports were generated less often?
Number of responses to this question==
6 Breakdown of responses:
Not I
Yes No Applicable 2
0 4
i I
onornuo rage m I
Ea Nuclear Safety-Related Information Systems Survey CYSTEM:
8YSTEMATIC ABGESSMENT OF LICENSEE PERFORMANCE (SALP)
NUMBER OF RESPONDENTS==
10 Computer system Evaluation: The following questions are designed to obtain user opinions regarding:
1.
Check how often you use this system?
Number of responses to this question== 9 0
Daily s
0 Weekly 2
Monthly 1
Annually 1
Never 1
Other 2.
Activities that the system is used to support include (check all that apply):
_1_
NRC Policy 0
Research 0
Litigation 1
Enforcement 0
Investigation
_4 Inspections 2
Nuclear Reactor 0
Nuclear Materials O
Congressional Regulation Regulation Inquiries 0
Other I
II olornuo rage ne k.
I Nuclear Safety-Related information Systems Survey I
3.
How is the system used?
(check all that apply) 2 Transaction processing (i.e. clerical and record keeping functions) 2 Management Reports
_1_ Decision Support (such as "what-if" analysis)
_3 Planning or Strategic Decision Making 2 Document Retrieval 0 Other I
4.
Indicate (by circling the appropriate number) the importance of the system in relation to the work of your office or department:
Number of responses to this question==
4 Breakdown of responses:
Not Very Not Important Undecided Important Important Applicable 1
1 0
2 O
I I
I I
I g
~m I
n p;
LJ Nuclear Safety-Related Information Systems Survey Information d7 stem Evaluation:
5.
Are there any problems relating information in this system to information contained in other systems?
Number of responses to this question==
4 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Fatent Undecided Not Not Applicable 0
1 0
2 0
1 I
6.
Are there any incompatibilities / obstacles between this system and others?
Number of responses to this question==
4 Breakdown of responses:
ll Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 5
1 0
1 1
0 1
i 7.
Do you believe the system duplicates other processes or systems?
Number of responses to this question==
3 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
1 0
2 0
0 I
~~
I a=
I I
Nuclear Safety-Related Information Systems Survey 8.
Does the information duplicate information contained in other data bases?
Number of responses to this question==
3 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
0 1
1 1
0 I
9.
Do you perform any manual activities (such as maintaining records, editing, calculating, or summarizing data to supplement the functions of this system?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable t
I i
2 1
0 1
0 1
I I
i I
I I
I I
I
Nuclear Safety-Related Information Systems Survey Evaluation of Input Process:
- 10. Do you supply input data for this system?
Number of response,s to this question==
5 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
1 0
0 3
0 e
13 Is the input process user-friendly?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
0 1
1 1
1 I
- 12. Does the input process save clerical effort?
Number of responses to this question==
5 Breakdown of responses:
Dafinitely To Some Probably Definitely Not l
Yes Extent Undecided Not Not Applicable B
1 0
3 0
0 1
l I
olG/9M-10 Page 128 E
1 1
I Nuclear Safety-Related Information Systems Survey I
- 13. Does the data entry format on the screen correspond with NRC input documents and office procedures?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
2 0
1 1
1 I
I
- 14. Does the system prompt for codes and values?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
1 0
1 1
1 I
- 15. Are the codes and values documented and etsy to remember?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
1 2
1 0
1 I
onapwso rase no I
Nuclear Safety-Related Information Systems Survey
- 16. Is there immediate feedback when incorrect data is entered?
Number of responses to this question==
5 Breakdown of responses:
Dafinitely To Some Probably Definitely Not l
Yes Extent Undecided Not Not Applicable E
2 0
1 1
0 1
g 5
- 17. Are error messages easy to understand?
Number of responses to this question==
5 Breakdown of responses:
Dsfinitely To Some Probably Definitely Not Yas Extent Undecided Not Not Applicable 2
0 1
1 0
1 Ii I!
OIG/9wl0 rap Do
I Nuclear Safety Related information Systems Survey I
Evaluation of Outputs
- 18. In your judgement, are outputs:
- a. Accurate and reliable?
Number of responses to this question==
5 Breakdown of responses:
To Some Probably Definitely Not I
Definitely Yes Extent Undecided Not Not Applicable 1
1 0
0 1
I2
- b. Timely, and available when needed?
I Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable I
3 0
1 0
0 1
I c.
Up-to-date?
Number of responses to this question==
4 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 2
0 1
0 0
1 I
I
Il Nuclear Safety-Related information Systems Survey i
- d. Useful?
Number of responses to this question==
5 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 2
0 2
0 0
1
- e. Understandable?
Number of responses to this question==
5 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
3 0
1 0
1 I
I I
I' I
OlG/93A-10 Page 132 E
=
I i
Nuclear Safety-Related Information Systems Survey
~
Evaluation of operatiny Processes:
I
- 19. Is the system easy to access or log in to?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
3 0
0 0
1
- 20. Is the system sufficiently tutorial to assist you during operations?
Mumber of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
1 1
1 0
1 I
- 21. Is the system user-friendly?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
2 0
1 0
1 i
OlG/93A.10 Page III
5m Nuclear Safety-Related Inforrnation Systenis Survey
- 22. Are the queries easy to perform?
Number of responses to this question==
5 Breakdown of responses:
l Dsfinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 5
0 1
1 2
0 1
- 23. Are procedures well documented?
Number of responses to this question==
5 Breakdown of responses:
Dafinitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
1 2
1 0
1 I
- 24. In the system slow to respond?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
1 0
2 0
1 I
g
Nuclear Safety-Related Information Systems Survey
- 25. Do you experience any hardware problems (such as storage space, system down time?)
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
0 0
2 2
1
- 26. Do you experience any functions that terminate regularly due tot
- a. user / errors Number of responses to this question==
4 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
0 0
1 1
1 b.
software problems Number of responses to this question==
4 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
0 0
1 1
1 I
I I
olG/93A 10 Page 135 I
i
Il i E
Nuclear Safety-Related information Systems Survey
- c. hardware / communications failures Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
2 0
2 0
1 I
1
\\
Il I
1 OIG/9M-10 Pege 1%
sa
I-Nuciear Safety-Related Information Systems Survey P I Evaluation of Maintenance Services I
- 27. Do you think the system is well maintained?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
3 1
0 0
1 Are IRM supported staff / contractors accessible when you have I
- 28. problems or questions?
Number of responses to this question==
4 Breakdown of responses:
To Some Probably Definitely Not I.
Definitely Yes Extent Undecided Not Not Applicable 1
1 1
0 0
1 I
I
- 29. Does the staff follow-up to ensure that problems and/or questions are fully resolved?
I Humber of responses to this question==
4 Breakdown of responses:
1 Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
1 1
1 0
1 I
l i
Ea Nuclear Safety-Related information Systems Survey
- 30. Do you think problems are solved on a timely basis?
Number of responses to this question==
4 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
0 2
0 1
1 I
I I
I I
I I
onopwto rage na Ew
I Nuclear Safety-Related Inforrnation Systems Survey I
Evaluation of systems Development Services:
I
- 31. Have you participated in committee meetings or work sessions to discuss computer requirements with IRM staff?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 1
0 0
0 4
0 O
h
- 32. Do you feel that user involvement during system development is sufficient?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
0 0
1 2
2 i
- 33. Do you think that there is consensus among users on system requirements?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
0 1
1 2
1 I
I
E E
Nuclear Safety-Related Information Systems Survey
- 34. Do you feel IRM staff members are responsive to your needs?
Number of responses to this question==
5 Breakdown of responses:
Definitely To Some Probably Definitely Not Yes Extent Undecided Not Not Applicable 0
1 0
2 0
2 I
- 35. could you effectively perform your duties:
- a. Without the system?
a Number of responses to this question==
5 Breakdown of responses:
l Not Yes No Applicable E
3 2
0 b.
If queries / reports were generated less often?
Number of responses to this question==
5 Breakdown of responses:
Not Yes No Applicable 2
2 1
I I
olG/9M-10 Page 140 Eis
Appendbc l Nuclear Safety-Related Information Systems Survey OBJECTIVES, SCOPE, AND METHODOLOGY l-This survey was initiated to obtain user opinions regarding the use of the U.S.
Nuclear Regulatory Commission's (NRC) safety-related information systems and the quality of support received in relation to those systems. Our purpose I
in performing this survey was to (1) provide the agency with pertinent user opinion information and (2) identify areas that may warrant further Office of the Inspector General (OIG) review.
In a concurrent effort, OIG solicited the views of agency management l
regarding the usefulness of NRC's safety-related information systems and the quality of NRC's information support services. The results of that effort, as well as OIG's analysis of pertinent user survey results, will be discussed in a separate report.
I SURVEY INSTRUMENT DESIGN The survey was designed to elicit user opinions regarding a specified information system. The survey queried user opinions regarding system use, input processes, outputs, operating processes, and development and I
maintenance services.
A questionnaire-style survey instrument was developed and tested with the assistance of the Federal Systems Integration and Management Center (FEDSIM), Office of Technical Assistance, Information Resources Management Service, U.S. General Services Administration. FEDSIM also assisted OIG in testing and revising the survey instrument, as necessary.
During the test phase, written comments on the instrument were provided by I
the Deputy Executive Director for Operations, Nuclear Reactor Regulation, Regional Operations, and Research; the Director, Office of Information l
Resources Management (IRM); and representatives from the Office of Nuclear Reactor Regulation (NRR) and Region I.
OIG and FEDSIM observed representatives from the Offices of Nuclear Regulatory Research I
(RES) and Nuclear Material Safety & Safeguards (NMSS) complete the survey instrument and received their oral comments on the instrument.
I OlG/VW10 Pass: 1 d 3 I
l
I h!
Appendix I Nuclear Safety-Related Information Systems Survey As a result of the test phase, minor adjustments were made to the instrument and the universe of survey recipients was more narrowly defined. Many of the respondents identified in the preliminary survey sample did not use the systems. The sample universe was modified to include only those persons whose names appeared on the accession lists provided by IRM or the office sponsoring the system.
SAMPLE SELECTION AND RESPONSES OIG used the user accession lists to define the user sample universe. Only l
users from the five NRC regions, Office for Analysis & Evaluation of Operational Data (AEOD), Office of Enforcement (OE), NMSS, NRR, and g
RES were included in the sample universe. OIG judgmentally sampled those E
users for each of the nine sample systems, depending on the size and office stratification of each system's user universe. Table I.1 lists the number of users on the accession list from the targeted offices, surveys mailed, and responses received for each system. The sample chosen for the nine systems consisted of 206 users. OIG received 186 responses, yielding a 90% response rate.
I I
olG/93A-10 Page 2 d 3
Appendbc l Nuclear Safety-Related information Systems Survey I
TABLE L1:
I NUMBER NUMBER OF NUMBER OF ON SURVEYS RESPONSES I
SYSTEM ACCESSION MAILED RECEIVED LIST EATS 37 11 11 SINET 25 10 9
G DB 5
3 3
IEVENTS 908 92 80 MIPS 6%
59 56 OLTS 6
6 6
PRA 1
1 1
SIMS 38 12 10 SALP 42 12 10 TOTAL:
1,668 206 186 i
Our review was conducted in accordance with generally accepted Government auditing standards. Audit work pertinent to the user survey began in March 1993 and was completed in July 1993.
l l
I I
OlG/93A-10 Page 3 of 3 I
I Appendix Il Nuclear Safety-Related Information Systems Survey i
SYSTEM DESCRIPTIONS ENFORCEMENT ACTION TRACKING SYSEM (EATS) g The EATS system tracks escalated enforcement actions. In 1989, the Office of Enforcement requested that EATS be converted from the personal computer environment to the mainframe environment where it currently l
resides. All NRC regions have access to this system.
EVENT / UNIT UPDATE SYSTEM (SINET)
The SINET system was developed as part of phase one of the Corporate Data Network. This system tracks event notifications and Licensee Event Reports (LERs) and was supposed to be replaced by the Integrated Events System (IEVENTS). According to IRM, this system is still active because some agency users prefer its report format to IEVENTS.
GENERAL LICENSE DATA BASE SYSTEM (GLDB)
The GLDB system was developed to manage information regarding the general licenses for nuclear byproduct materials. The system was developed I
for use by NMSS.
i INTEGRATED EVENTS SYSTEM (IEVENTS)
The IEVENTS system was designed to incorporate Morning Reports (MRs) and Preliminary Notifications (PNs) into the corporate database (SINET). As g
mentioned above, IEVENTS was supposed to update and replace the Event / Unit Update System.
]
I m,
g
Bu Appendix il Nuclear Safety-Related information Systems Survey MASTER INSPECTION PLANNING SYSTEM (MIPS)
MIPS is a management tool used to design inspection plans for operating commercial reactors.
MIPS automatically includes those inspection procedcres that are part of the core, mandatory team, and safety issues inspection programs and allows for additional inspection activities to be planned and scheduled by the regional offices based on an NRC assessment of each licensee's performance.
OPERATOR LICENSING TRACKING SYSTEM (OLTS)
OLTS was developed to aid the Operator Licensing Branch, NRR, in tracking the logging of applications and licenses and in preparing statistical reports.
Among other things, this system maintains a record of all applications received for new and renewed operator licenses for all power and nonpower reactors.
PROBABILISTic RISK ASSESSMENT SYSTEM (PRA)
The PRA system was designed by IRM to provide a central repository of summary level information on all probabilistic risk assessments conducted for l
NRC monitored facilities.
SAFETY ISSUES MANAGEMENT SYSTEM (SIMS)
SIMS was developed to provide an effective management information system to ensure the timely resolution of safety and/or other regulatory concerns affecting nuclear power plants.
I OlG/91A-10 Page 2 of 3 5=1
i I
Appendbc il Nuclear Safeti-Rotated Information Systems Survey I
SYSTEh1ATIC ASSESShtENT OF LICENSEE PERFORh1ANCE (SALP) l The SALP system was designed to provide a central repository of summary level information on all SALP reviews conducted for NRC-monitored facilities.
I s
I I
I I
I I
I I
I I
I em -
m.,,,
I
I Appendix ill I
Nuclear Safety-Related Information Systems Survey MAJOR CONTRIBUTORS TO TIIIS REPORT I
Richard J. Donovan, Team Leader I
Corenthis B. Kelley, Senior Auditor l
Agapi Doulaveris, Management Analyst Judith L Leonhardt, Auditor I
I I
I I
I
J Appendbc IV Nuclear Safety-Related Information Systems Survey U.S. NRC FUNCTIONAL ORGANIZATION CHART DCEctTTNE DIRECTOR FOR OPERATIONS I
Assaf ant pon orsmA noms i
l I
p(MfTV EHCVTTVs (MMsCTo81 Pom DEPUTY EKICUTNs DIMECTOR PoA 0FnCs of wuCLieJu MATIru ALA S AFETY.
NuCLI AM REACTom R&OiAATEDu, PoucV PUutNavo sArsouAmos a orsRAfons suemni naoom ormaToms a mAsApen l
I I
I I
I I
I 4
omCs or orncs or omes os omes w omes w ornes or ormCs or sTAis PMoapuuAs smponcp4NT ufVs.sTamAftoers ADhessTRATmet PsmsommE CoissoUoATDN TW CoNTMouRt I
omca or suAu a ornCE or kuCLsAm OFTICE OF l
DesADVANT Aarn susassiss SM N N"'*"^"D""""
" " so*u*ARDs INFORMATION RESOURCES AND SAF or ortRATho4AL DATA I
MANAGEMENT l
l I
cenes or omes or REGONAL OmCES wucts.An maoukATony mucuAn maacton RESE.AMCM RsGULAYnom SIEGOh 8 MA flEGeoN G ATLANTA meason a cwAao remonw OALLAs sumon v san tvuusensco 1
l I
AREA AUDITED I
1 40*++66.
l I
OlG/MA-10 Pap 1 ofI
..