ML082270300
ML082270300 | |
Person / Time | |
---|---|
Site: | Wolf Creek ![]() |
Issue date: | 07/29/2008 |
From: | CS Innovations, Wolf Creek |
To: | Office of Nuclear Reactor Regulation |
References | |
GC 08-0024 6101-00200, Rev 3 | |
Download: ML082270300 (146) | |
Text
Enclosure VI to GC 08-0024 CS Innovations Report 6101-00200, "MSFIS V & V Report," Rev. 3 Non-proprietary
Vendor.Submittal Approval MAIN STEAM & FEEDWATER ISOLATION SYSTEM (M.SFS)
CONTROLS REPLACEMENT VEN DO R S U B M I TT AL APPROVAL t
Name/Descrioptioni Document Date VendOrr 'Comments-'
L
]
t
- /Reýv Subumitted Name t MSFIS: V&V Report 6101-00200 7/29/2008 CS Innovations The"prpose of Revision 3 is to provide R.v....proprietary and n0-io-pror*ietary versions of the.
document. No other sigifircat¢clianges to the p*evitus1*y approved Revision 2.
Approver Signature Approval Date 7/30/2008 Wolf Creek-Nuclear Operating Corporation PO Box 411 1550- Oxen Lane, NE Burlington, KS 66839.
Revision 0 Page~l of I
CS Innovations Non-Proprietary ALS Advanced Logic System 6101-00200 MSFIS V&V Report Revision 3 July 21, 2008 CS Innovations, LLC Scottsdale, AZ
© 2008 CS Innovations, LLC All Rights Reserved
MSFIS V&V Report Non-Proprietary CS Innovations LLC CS Innovations, LLC 9150 E Del Camino, Suite 110 Scottsdale, AZ, 85256 (623) 505-1055 Phone (623) 505-1055 Fax 6101-00200 - MSFIS V&V Report Revision 3 July 21, 2008 APPROVALS Approvals are available in the proprietary version of the document.
6101-00200, Rev 3 CS Innovations LLC 2008 Page 2 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC RECORD OF CHANGES Revision Date Description of changes Made by 0.0 Sept 10, 2007 Compilation of combined V&V Report in ALS format Steen Sorensen 0.2 October 1, 2007 Added a lot of content from FAT Steen Sorensen 1.0 January 31, 2008 General update based on WCNOC Feedback Steen Sorensen Sten Sogaard 2.0 February 22, 2008 Added information from FAT/SAT at WCGS in February Steen Sorensen 2008. Sten Sogaard Modified chapter 2 to reflect the PO change from a non-safety to safety PO.
Updated to reflect review cycle with WCNOC engineers 3 July 28, 2008 Added Proprietary / Non-Proprietary Statements Sten Sogaard OPEN ITEMS Item Description Status 1 Add the Requirement Stage information into the report, CLOSED 2 Migration from Non-safety PO to Safety-related PO CLOSED 3 Include the "re-performing" the inspection / FAT procedure, while WCNOC CLOSED monitors the process and credits it for being the SAT.
cs Innovations LLC 2008 Page 3 of 144 610 6101-00200, Rev 3 1-00200, Rev 3 CS Innovations ILILC 2008 Page 3 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC Table of Content 1 Introduction ........................................................................................................................................................ 9 1.1 P u rp o s e ..................................................................................................................................................... 9 1.2 Change from Non-safety to Safety-related PO (January 2008) .......................................................... 9 1.3 Sum m ary Project Description ........................................................................................................... 12 1.4 Sum m ary Project Tim eline ...................................................................................................................... 13 1.5 V&V Definitions ................................................................................................................................. .... 13 1.6 References .............................................................................................................................................. 13 2 V&V Overview .................................................................................................................................................. 14 2.1 Q uality Assurance Plan ........................................................................................................................... 14 2.2 Organization ............................................................................................................................................ 15 2.3 CSI V&V Team Responsibility ........................................................................................................... 15 2.4 Tool Identification & Classification .................................................................................................... 16 2.5 Hardware Identification ........................................................................................................................... 17 3 V&V Process .................................................................................................................................................... 18 3 .1 G e n e ra l ................................................................................................................................................... 18 3.2 Verification and Validation Process .................................................................................................. 18 3.3 Life Cycle V&V ........................................................................................................................................ 18 3.4 Verification and Validation Adm inistration ........................................................................................ 19 4 Planning (and Requirem ent) Stage ............................................................................................................ 20 4.1 Stage Sum m ary ...................................................................................................................................... 20 4.2 V&V Review of J-105A(Q ) - Replacem ent MSFIS System ............................................................... 22 4.3 6101-00001 - MSFIS Conceptual Design ........................................................................................ 24 4.4 6101-00000 - MSFIS Managem ent Plan ........................................................................................ 25 4.5 6101-00005- Configuration Managem ent Plan ............................................................................... 26 4.6 6101-00008 - MSFIS V&V Plan ...................................................................................................... 27 4.7 6101-00004 - MSFIS System Test Plan .......................................................................................... 28 4.8 6101-00006 - MSFIS Safety Assessm ent ......................................................................................... 28 5 Developm ent Stage ......................................................................................................................................... 31 5.1 Stage Sum mary ...................................................................................................................................... 31 5.2 V&V activities during ALS board developm ent ................................................................................. 32 5.3 VHDL Rapid Prototype Im plem entation ............................................................................................. 38 5.9 Review and Pre-Validation of EM I / RFI Surge ............................................................................... 53 5.10 Review : Seism ic Test Procedures .................................................................................................... 55 5.11 Dedication Plan ....................................................................................................................................... 55 5.12 Sum m ary: Design Phase V&V Activities........................................................................................... 56 6101-00200, Rev 3 CS Innovations LLC 2008 Page 4 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC 5.13 Com pletion of the Development Stage .............................................................................................. 56 6 Manufacturing (and Board Acceptance) Stage ........................................................................................... 57 6.6 V&V Review of NCR's ............................................................................................................................. 66 6.7 V&V Review of ECN's ............................................................................................................................. 66 6.8 Sum m ary of V&V Effort during Manufacturing Stage ........................................................................ 67 7 System Acceptance Test Stage ....................................................................................................................... 68 7.1 Stage Sum mary ...................................................................................................................................... 68 E 7.6 7.7 7.8 Review the System Configuration .....................................................................................................
V&V Review of NCR's .............................................................................................................................
V&V Review of ECN's .............................................................................................................................
76 77 77 7.9 Sum m ary of V&V Effort during Manufacturing Stage ........................................................................ 77 n
8 FAT/CGD/SAT - Installation (at W CGS) .................................................................................................... 78 P
6101-00200, Rev 3 CS Innovations LLC 2008 Page 5 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS innovations LLC Table of Tables Table 3-1 A V&V Activities ........................................................................................................................................... 19 0)
CD Table 6-8: NCR's issued in the Manufacturing Stage ........................................................................................... 66 Table 6-9 : ECN's issued in the Factory Acceptance Test Stage .......................................................................... 66 Table 7-4
- NCR's issued in the Factory Acceptance Test Stage....................................7; Table 7-54 ECN's issued in the Factory Acceptance Test Stage ......................................................................... 77 Fo CS Innovations LLC 2008 Page 6 of 144 Rev 3 6101-00200, Rev 6101-00200, 3 CS Innovations LLC 2008 Page 6 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC Table of Figures Figure 1-1 Planned Life Cycle, with Nutherm being the safety-related system provider .................................... 10 Figure 1-2 : Actual Life Cycle, with CS Innovations being the safety related system provider ............................. 11 F ig u re 1-3 : Id e a l Life Cyc le ........................................................................................................................................ 11 F ig u re 1-4 : P roje ct T ime line ....................................................................................................................................... 13 F igu re 2 -1 : Q A A ctiv itie s ............................................................................................................................................ 14 Figure 2-2 : V&V Oversight of the CSI Design Team ............................................................................................. 15 Figure 5-1: OnTime Defect Tracking .......................................................................................................................... 41 7C Figure 6-1 Board-level Automated Testing Environment ..................................................................................... 59 6101-00200, Rev 3 CS Innovations LLC 2008 Page 7 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC GLOSSARY OF TERMS Term Definition MSFIS Main Steam and Feedwater Isolation Actuation System SRD System Requirements Document HDD Hardware Design Document HRS Hardware Requirements Specification ECN Engineering Change Notice NC(R) Non-Conformance (Report)
CGDP Commercial Grade Dedication Plan CGDR Commercial Grade Dedication Report QAP Quality Assurance Plan V&V Verification and Validation VVP Verification and Validation Plan VVR Verification and Validation Report Term Definition CSI CS Innovations LLC, Scottsdale, Arizona Elite Elite Electronic Engineering INC, Downers Grove, Illinois Nutherm Nutherm International INC, Mount Vernon, Illinois WCNOC / WCGS Wolf Creek Nuclear Operating Corporation INC.
Owner of Wolf Creek Generating Station, Kansas.
Wyle Wyle Test Labs, Huntsville, Al http://www.wylelabs.com/
6101-00200, Rev 3 CS Innovations LLC 2008 Page 8 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC I Introduction 1.1 Purpose The Verification & Validation Report (WR) documents the Verification & Validation (V&V) process that was set forth in the Verification & Validation Plan (WP) used in the development of the ALS-based Class 1E safety-related Main Steam and Feedwater Isolation System (MSFIS) developed by CS Innovations (CSI) for Wolf Creek Generating Station (WCGS).
Customer Name Wolf Creek Nuclear Operating Corporation (WCNOC)
Customer P.O. # 734448/0 (Revision 0, initial P0, non safety related) 734448/1 (Revision 1, including NRC modifications) 734448/2 (Revision 2, Internal WCNOC revision) 734448/3 (Revision 3, safety related P0) 734448/4 (Revision 4, safety related P0 with updated IP rights)
Internal project ID# D101 The document presents the methodologies and summarizes the results of reviews, tests, and analyses that were deployed to verify and validate the specification, design, implementation, and testing of the MSFIS.
The purpose of the Verification and Validation process is to ensure that the system, including both the hardware and the FPGA related components, meet the performance and reliability requirements set forth in the customer's technical specifications and the governing standards.
The MSFIS V&V Report is planned to be released in 3 steps:
" MSFIS V&V Report, rev 1, following the System/Factory Acceptance Test, Scottsdale, September 2007.
" MSFIS V&V Report, rev 2, following the Factory/Site Acceptance Test, Burlington, February 2008
" MSFIS V&V Report, rev ?, following the Installation o Expected in RF16 (March/April 2008)
The intent of this document is to capture the V&V related activities performed by CSI's independent V&V group. The VVR is a living document, which will be updated periodically throughout the project. The final report will include information regarding all phases of the project and will summarize the entire V&V effort of the CSI independent V&V group.
This VVR reflects the fact that this is a hardware project, which includes the traditional stages of a hardware system. The V&V report has been partitioned in sections following the 'Stages' defined in the V&V plan (each containing multiple phases).
The stages include the Planning stage (section 4), Development stage (section 5), Manufacturing stage (6), System test stage (7), FAT/GCD/SAT-Installation stage (section 8), Operation stage (section 10) - see the project life cycle shown in Figure 1-2.
1.2 Change from Non-safety to Safety-related P0 (January 2008)
As indicated in section 1.1 above, the Customer/Supplier relationship initially outlined in the 6101-00000 - MSFIS Management Plan was changed in Q4'07/Q1'08. This change occurred after the equipment had been delivered from CSI to Nutherm and Nutherm had completed FAT & Commercial Grade Dedication tasks.
The consequence of this change in relationship was a change in the PO's scope and responsibilities.
6101-00200, Rev 3 CS Innovations LILC 2008 Page 9 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC Further, this had consequences to CSI's V&V scope, where an additional step was added to the project life cycle -
see section 1.2.2.
1.2.1 The Initial plan (PO 734448/1)
Initially the planned relationship was:
" Equipment supplier: CS Innovations, LLC
" Safety related vendor: Nutherm International, Inc
" Customer: WCNOC The V&V flow that was initially planned is indicated below Stage Planning Development Manufacturing Phase Concept Planning Requirements Design :Implementation, Test Manufacturing Test FProject Management Plan Requirem~
,ents Spec7s I e Pacts) ign11 I
Design Data F:1TetapetsI
.. unSI AcFm
- F T Test Oesi
- FIaln EFiI II Ra, Milestones Figure 1-1 Planned Life Cycle, with Nutherm being the safety-related system provider 1.2.2 The New Plan (734448/4)
Initially the planned relationship was:
" Equipment supplier: CS Innovations, LLC
" Customer: WCNOC. Where WCNOC has 3 independent V&V teams performing V&V independent of CSI. The three teams being Nutherm International, Baseline Engineering, and WCNOC Engineering.
6101-00200, Rev 3 CS Innovations LLC 2008 Page 10 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC SRtan. Planning Phase Concept Planning Requirements PrjeManagemen Pan:
F::--- ia eqoem.... Spec~s)
System Trels
_-_ IiZeplt F-iLII~l~a ::
F Plan Revision from non-safety to a safety related PO (7 Milest... s e $ 6 6 6d 6 6 6 6 Figure 1-2 : Actual Life Cycle, with CS Innovations being the safety related system provider The project life cycle shown in Figure 1-2 reflects the change occurring in January 2008, where CSI changed from supplying the equipment as commercial grade equipment, to supplying the equipment as a class 1E safety related product under the CSI Appendix B QA program.
The change included the insertion of an additional phase following the Nutherm FAT/CGD tasks/phase.
The purpose of the additional phase - referred to as FAT/CGD/SAT was threefold:
- 1) Re-perform the Factory Acceptance Test and re-inspect the board/system to bring the equipment back under control within the CSI Appendix B QA program.
- 2) Complete the CGD and issue the Certificate of Compliance (C of C).
- 3) WCNOC I&C technicians monitored and participated in the Test and Inspection activities in order for WCNOC to take credit for the testing performed by CSI as their Site Acceptance Test (SAT).
The FAT/CGD/SAT phase was performed at WCGS in February 2008.
1.2.3 Ideal The ideal ALS board life cycle is shown in Figure 1-3. For references please refer to 6002-00001 ALS QA Plan.
Stage Planning Development Manufacturing System Test Installation Operation Phase Concept Planning Requirements Design :Implementation: Test Manufacturing: Test Integration FAT Dedication SAT PIT Fproject Management Plan:a soardTraee I tan Tvelers T PlanZ Test DesignSpeclticatleTestII .Pees I Test Reports1 FG eAudits andRenleen System__
CG C fC~
Audits and Reviews -- C. I F-I.-
Status Accounting,Audit.and Rew _ _ :
Milsoestns~
Figure 1-3 : Ideal Life Cycle CS Innovations LLC 2008 Page 11 of 144 6101-00200, Rev 6101-00200, Rev 33 CS Innovations LLC 2008 Page 11 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC 1.3 Summary Project Description The Main Steam and Feedwater Isolation Actuation System (MSFIS) implements two separate, independent and redundant MSFIS subsystems:
" MSFIS Channel I (Separation Group 1) located in MSFIS Cabinet SA075A (train A).
" MSFIS Channel IV (Separation Group 4) located in MSFIS Cabinet SA075B (train B).
The controls in each channel process a set of contact input signals from other power plant systems and based upon a pre-determined logic the system will control a set of solenoids on 4 Main Steam Isolation Valves (AB-HV-14, AB-HV-17, AB-HV-20, AB-HV-1 1) and 4 main Feedwater Isolation Valves (AE-FV-39, AE-FV-40, AE-FV-41, AE-FV-42).
The controls in each cabinet contain the following components:
0 2 ALS Racks, one MS-rack and one FW-rack.
0 1 Assembly panel, with MS and FW components 0 Cables, between vendor and field terminal blocks The Advanced Logic System (ALS) is based on a modular digital hardware platform with input boards, output boards, logic control boards and power supply boards. This system is designed to provide reliable, deterministic operation and the platform utilizes redundant systems, proven hardware techniques, failure detection, fault isolation and fail-safe logic to provide a high integrity solution in a safety critical environment.
The system consists entirely of Commercial off-the-shelf (COTS) equipment. There is no embedded software (firmware) in the system. The unique FPGA image programmed into the FPGA devices located on the boards has been subject to an extensive V&V effort, which is documented in this report.
Cs Innovations LLC 2008 Page 12 of 144 6101-00200, Rev 6101-00200, Rev 33 CS Innovations LLC 2008 Page 12 of 144
IVISFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC 1.4 Summary Project Timeline The MSFIS project was initiated in April 2004 with conceptual discussions, requirement identification and architectural discussions. The project is expected to complete with installation at WCGS in spring 2008 during refueling outage 16.
NON-SAFETY P.O. NON-SAFETY P.O. NON-SAFETY P.O. SAFETY P.O.
200 2006 2007 > Planned I Install Date 0Q11 I Q2 I Q3 I Q4 Q1 I A Q2 I Q3 I Q4 Q1 I Q2 I Q3 I Q4 I 0Q1 Q 2>
Il
! FRF]
I WL6 TEST FSSR7 Pre-EO EO IPrototype FAT UL MF PCBIHW PCB Design & Builds Prototype ALS VHDL Production Build VHDL SIM FAT Complete VHDL ENV ALS / MSFIS VHDL rev. 0 PCB BASELINE VHDL BASELINE Conceptual and Architecture Design CS Innovations QA App. B Program ATU-101 ATU-102 TEST EQUIPMENT ATS-101 ATS-102 Figure 1-4: Project Timeline 1.5 V&V Definitions See IEEE Std 1012-1998 Annex G, Annex 1.
1.6 References Following is a list of references used throughout this document.
Ref Description 1 Specification J-105A(Q) for Replacement MSFIS System, WCGS, Rev 3 2 6101-00008 - MSFIS V&V Plan, CS Innovations, CS Innovations 3 6101-00005 - Configuration Management Plan, CS Innovations CS Innovations LLC 2008 Page 13 of 144 6101-00200, Rev Rev 3 3 CS Innovations LLC 2008 Page 13 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC 2 V&V Overview 2.1 Quality Assurance Plan Products provided under PO 734448/4 are being provided under the CS Innovations QA manual, rev 1, dated 5/16/2007, which complies with the applicable requirements of 10 CFR 50 Appendix B.
Defects are reportable according to the requirements of 10 CFR Part 21.
WCNOC has reviewed and approved the CSI 10CFR50 Appendix B QA program and has added CSI to the WCNOC approved suppliers list.
The Quality Assurance Plan (6101-00009 - MSFIS Quality Assurance Plan) was developed in accordance with the requirements of the Quality control Procedure (QCP 3).
2.1.1 Verification and Validation Plan A detailed Verification and Validation Plan (6101-00008 - MSFIS V&V Plan, CS Innovations) was developed for the project and was approved by WCNOC.
The V&V Plan defines the quality assurance steps that shall be invoked in each phase of the development program.
Specific requirements are imposed on the independent Verification and Validation team, which functions independently of the Design and Manufacturing team.
Several specific documents were developed in the process to govern the element of the Quality Assurance process that applied specifically to the FPGA devices.
Hardware Verification and Validation activities were governed by hardware specific documents that were prepared to govern the elements of the Quality Assurance process that applied specifically to the hardware.
Verification and Validation activities were applied essentially equally to both software and hardware aspects of the system development.
2.1.2 Configuration Management Plan A detailed configuration management plan (6101-00005 - Configuration Management Plan, CS Innovations) was developed for the project and was approved by WCNOC.
2.1.3 Relationship between QA related plans The V&V process described in this document is only one of several QA activities. Figure 2-1 shows 3 independent but related activities to all part of the overall quality assurance processes.
Quality Assurance Figure 2-1 : QA Activities 6101-00200, Rev 3 CS Innovations LLC 2008 Page 14 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC 2.2 Organization The organization of the V&V oversight of the CSI design team is illustrated in Figure 2-2.
Figure 2-2: V&V Oversight of the CSI Design Team WCNOC V&V WCNOC provide independent V&V of the CSI Design team. Independence include:
- Technical Independence
- Managerial Independence
- Financial Independence Nutherm V&V Nutherm provide independent V&V of the CSI Design team. Independence include:
- Technical Independence
- Managerial Independence
- Financial Independence Nutherm provides direct oversight and provides a second level of independent V&V in addition to CSI's internal V&V team. Further, Nutherm provides a set of independent dedication (which now serves as V&V) and qualification plans.
CSI V&V CSI's V&V team provide a technical Independent V&V team. The team is not financially and managerial independent, as the V&V manager also is the President of CSI.
The team consists of Steen Sorensen (V&V Manager), Thomas Christensen, and Paul Blaschka.
The Development activities and tests are verified and validated by the V&V group with significant technical competency.
CSI Design CSI's design team provides it own V&V functions, but no independence can be claimed.
The level of V&V performed by the design team is limited to one designer performing code review, performing test support for another, and reviewer documents for other designers.
2.3 CSI V&V Team Responsibility The CSI V&V team should cover all V&V activities to be performed during all phases of the life cycle.
The V&V Plan (6101-00008 - MSFIS V&V Plan) outlines the details of the work to be performed.
In summary the work includes:
" Analyzing system requirements to determine if they are consistent with, and within the scope of the system.
" Assuring that the requirements are testable and capable of being satisfied.
" Development, of test beds and test vectors.
" Prepare Acceptance Test Plans and verification matrixes, including test specifications and unit test plans.
" Conducting informal reviews and walkthroughs and inspections of the designs.
" Conducting Code inspections and/or walkthroughs.
6101-00200, Rev 3 CS Innovations LLC 2008 Page 15 of 144
IVISFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC U Conducting Unit testing software and data structures.
Development of detailed test procedures for the next two phases.
U Conducting tests per test procedures.
Documenting test performance, test completion, and conformance of test results versus expected results.
U Providing a test report that includes a summary of non-conformances found during testing.
Locating, recording, correcting, and retesting non-conformances.
U By test, analysis, and inspection, demonstrating that the developed system meets its functional, performance, and interface requirements.
2.4 Tool Identification & Classification Tools used throughout the project life cycle are documented in: '6000-00010 - ALS Design Tools'.
All tools are all classified as non-safety related.
The tool suite used for test and V&V includes:
0 Automated testing environments:
C-C'D
" Capture and replay:
B L A
" System monitor:
K
- Sequence checker:
K
- Syntax and data checker:
6101-00200, Rev 3 CS Innovations LLC 2008 Page 16 of 144
MSFIS V&V Report Non-Proprietary onPperySno CS Innovations LLC 2.5 Hardware Identification 2.5.1 Items on System level - ALS Racks, Panels and Cables WC-MSFIS System, SA075A (5101-200):
WC-MSFIS, MS ALS Rack 5101-100 WC-MSFIS, MF ALS Rack 5101-101 Assembly Panel, SA075A 4101-036 WC-MSFIS Cable, C1M1 4101-020 WC-MSFIS Cable, C1F1 4101-020 WC-MSFIS Cable, C1 M2 4101-024 WC-MSFIS Cable, C1 F2 4101-024 WC-MSFIS Cable, C1M3 4101-028 WC-MSFIS Cable, C1F3 4101-028 WC-MSFIS Cable, C1 M4 4101-032 WC-MSFIS Cable, C1F4 4101-032 WC-MSFIS System, SA075B (5101-201): _
WC-MSFIS, MS ALS Rack 5101-100 WC-MSFIS, MF ALS Rack 5101-101 Assembly Panel, SA075B 4101-038 WC-MSFIS Cable, C4M1 4101-022 WC-MSFIS Cable, C4F1 4101-022 WC-MSFIS Cable, C4M2 4101-026 WC-MSFIS Cable, C4F2 4101-026 WC-MSFIS Cable, C4M3 4101-030 WC-MSFIS Cable, C4F3 4101-030 WC-MSFIS Cable, C4M4 4101-034 WC-MSFIS Cable, C4F4 4101-034 2.5.2 Items on Rack level - ALS boards WC-MSFIS, MS/MF ALS Rack ALS-101, ALS Board, Core Logic Board 5101-007 ALS-201, ALS Board, Service & Test Board 5101-008 ALS-301-1, ALS Board, Input Board 5101-010 ALS-301-2, ALS Board, Input Board 5101-011 ALS-401-1, ALS Board, Output Board 5101-012 ALS-411-1, ALS Board, Output Board 5101-001 ALS-411-2, ALS Board, Output Board 5101-002 ALS-411-3, ALS Board, Output Board 5101-003 ALS-905, ALS Board, Power Supply Unit 5101-009 6101-00200, Rev 3 CS Innovations LLC 2008 Page 17 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC 3 V&V Process 3.1 General This report documents the V&V steps performed on the ALS-based MSFIS system and describes the V&V process as it was applied to the design process; including the hardware/system design, the manufacturing stage (ALS board testing including FPGA validation), and the implementation and acceptance testing of the complete MSFIS system.
3.2 Verification and Validation Process The Verification and Validation Plan (6101-00008 - MSFIS V&V Plan) was not initially developed to conform to the requirements of IEEE 1012-1998, since the standard is software specific, and does not require imposing requirements on the hardware. Due to the lack of better standards, the principles of a combination of IEEE 1012, IEEE 7-4.3.2 - 2003, and the DO-254 have been applied to both the hardware and the FPGA development. Thus, the V&V plan was applied to define the procedures and requirements for comprehensively evaluating the integrated system, as well as the developed FPGA/ALS boards, through each phase of the life cycle of the Main Steam and Feedwater Isolation Actuation System replacement project.
The V&V process provides the means to ensure that the entire system, including the developed FPGA image, meet the established functional, performance and interface requirements, and that the development process was performed in a manner to ensure predictable results and interface between each phase of the development cycle.
The specific areas addressed by the V&V plan are to ensure:
- a. That the system/board/FPGA developers and WCNOC have a mutual understanding of the system requirements.
- b. That the development process is devised to eliminate design errors.
- c. That the testing requirements demonstrate the quality of the hardware, especially the FPGA images.
- d. That the integrated system, hardware and FPGA devices, together complies with all applicable specifications.
3.3 Life Cycle V&V This section provides an overview of the V&V activities that were performed during each phase of the development process for the Main Steam and Feedwater Isolation Valve Actuation System.
Each of the following sections are dedicated to each stage of the development process - see Table 3-1.
The stages and phases used in the project life cycle have been shown/compared with IEEE 12207 and IEEE 1074 phases. Both IEEE standards focus on software projects, and are therefore not really applicable to a hardware project, such as the ALS-based MSFIS project.
The design process generally followed the "Waterfall" model of IEEE 1012 and IEEE 7-4.3.2, however, portions of the design and implementation phases overlapped somewhat, as will be noted in the detailed descriptions to follow.
Especially the hardware (board/PCB) development is done in multiple revisions which is traditional in board development.
The actual process used in a real-world problem is iterative in its nature. It was therefore decided to document the V&V effort in stages (as opposed to phases) - This offers a more complete picture of the effort on a configuration item in one place.
The V&V plan was performed in parallel to these stages and each stage was designated complete only after its output was verified to comply with the stage's requirements 6101-00200, Rev 3 CS Innovations LLC 2008 Page 18 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS innovations LLC CSI (this project)
IEEE 1074 IEEE 12207 Life Cycle Life Cycle Activity Period Done Life Cycle Process Development Process Activities Phases Stages Project Management Process Conceptual design Q2'2004 - Q1'2005 ,
Management Process Implementation Planning Planning Design planning Q4'2004 - Q2'2005 "
Concept (section 4)
Exploration System Requirement Analysis Requirements Requirements Q1'2005 - Q2'2006 /
System Allocation System Architecture Design Specification Q2'2005 - Q4'2006 V Requirements Software Requirement Analysis Design Design and analysis Q2'2004 - Q4'2006 (HW design and Dsg n nlss 020 420 Design Software Architecture Design FPG design FPGA design) d Development Implementation Jan'2006 - Apr'2006 V Software detailed Design (section 5) Prototyping Apr'2006 - Aug'2006 V Software coding and testing Implementation Tests Aug'2006 - May'2007 V Test (including EQ Test Aug'2006 - Feb'2007 V Implementation EQ test)
Manufacturing Manufacturing of V Software integration Manufacturing (section 6) boards, cables, panels May'2007 - Aug'2007 V/
Acceptance Test Acceptance Test Software Qualification Testing V System integration Integration System Test Integration VQ System Qualification Testing FAT (section 7) FAT V Software Installation FAT V Installation FAT/GCD/SAT Installation Dedication / C of C Feb'2008 (section 8) Site Acceptance Test Installation Installation Test April'2008 - TBD Operation Operation Operational Q2'2008 - TBD Surveillance Maintenance (section nla) Periodic Testing Q2'2008 - TBD Table 3-1 V&V Activities 3.4 Verification and Validation Administration 3.4.1 Anomaly Reporting and Resolution Any changes determined to be required after initial "Baselining" of affected elements of the design during any phase of the life cycle were implemented through the issue of an Engineering Change Notice (ECN). A task iteration policy was followed ifthe resolution of such anomalies required a design change or had an impact on design elements completed during a previous phase of the life cycle.
3.4.2 Task Iteration Policy Task iteration was triggered by a customer request, a reported problem, or by a non conformance report. The cause and corrective action were documented by an ECN. Based on the ECN, either a document change, a FPGA change, a hardware change, or an appropriate combination of the three was made. The ECN included identification of consequent changes required to other earlier prepared documents, or ifany tests or repeat of previously performed tests needed to be performed. If the item was changed, the corresponding documentation was updated and a test was performed on the affected part. The documentation went through the same thorough review and reconciliation process.
6101-00200, Rev 3 CS Innovations LLC 2008 Page 19 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC 4Planning (and Requirement) Stage 4.1 Stage Summary The following provides details of the V&V activities conducted during the Planning and Requirement stage of the project.
4.1.1 Stage Activities The V&V team shall be responsible for the following V&V tasks during the Concept, Planning and Requirement phases:
- 1) Review the following documents:
- a. J-105A(Q) - Replacement MSFIS System (Customer Requirement Specification)
- b. 6101-00001 - MSFIS Level-0 Specification (Conceptual design)
- i. Conceptual design document satisfies customer needs and is consistent with the PO.
Validate constraints of interfacing systems and constraints or limitations of proposed approaches. Analyze concept documents to validate that the following satisfy customer needs: System functionality, end-to-end system performance, operation and maintenance requirements, test requirements, environmental qualification requirements, etc.
- c. 6101-00000- MSFIS Management Plan
- 2) Generation of the following documents:
- a. 6101-00008 - MSFIS V&V Plan
- b. 6101-00004 - MSFIS System Test Plan
- c. 6101-00005 - Configuration Management Plan (CMP).
- d. 6101-00006 - MSFIS Safety Assessment
- e. 6000-00008 - ALS Board Test Plan
- 3) Conceptual explorations of critical issues
- a. Solid State output driver circuits 4.1.2 Stage V&V activities The V&V activities are twofold, i.e. generating a set of documents, and reviewing a set of documents.
The review methods employed in the V&V effort consists of dedicated and focused document reviews, where documents are reviewed and validated for the following characteristics:
Correctness CS Innovations LLC 2008 Page 20 of 144 Rev 3 6101-00200, Rev 3 CS Innovations LLC 2008 Page 20 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC Consistency Completeness Pr CD Verify the Specification satisfy specified configuration management procedures.
Accuracy L Readability Testability
§ Verify that there are objective acceptance criteria for validating the requirements of the Specification The V&V reviews performed in these phases require highly experience engineers with in-depth knowledge of the systems, the methods, the implementations and the processes.
4.1.3 Stage Acceptance The Criteria of Acceptance for a successful V&V effort during the planning stage is a set of approved documents -
see section 4.1.1.
CS Innovations LLC 2008 Page 21 of 144 6
6101-00200, Rev 3 101-00200, Rev 3 CS Innovations LLC 2008 Page 21 of 144
IVISFIS V&V Report Non-Proprietary CS Innovations ILLC MSFIS V&V Report Non-Proprietary CS Innovations LLC 4.2 V&V Review of J-105A(Q) - Replacement MSFIS System 4.2.1 Purpose Review customer specification for completeness and consistency. Because of the novelty of the ALS bases MSFIS system there was naturally many issues in the customer's specifications which had to be revised. An example of such issue was that the original specification required relays to be used.
Such inconsistencies between the customer specification and CS Innovations' conceptual design document and requirements specification was fed back to WCNOC and incorporated in later revisions.
4.2.2 When WCNOC made official releases of the J-1 05A(Q) specification throughout the project:
J-105A(Q) Revision 0 - Approved and released 09/14/2005 J-105A(Q) Revision 1 - Approved and released 04/04/2006 J-105A(Q) Revision 2 - Approved and released 08/08/2006 J-105A(Q) Revision 3 - Approved and released 06/29/2007 4.2.3 V&V Effort Review all requirements in customer specification. Ensure all requirements were clearly and precisely described and was defined such that their achievement was capable of being objectively verified and validated.
Feedback to WCNOC of the J-105A(Q) specification in 2 ways; (a) Informal reviews where editorial issues as we well as overall clarifications were conveyed to WCNOC (b) Written on formal WCNOC 'Document Comment Sheets' 4.2.4 Findings 6101-00200, Rev 3 CS Innovations LLC 2008 Paae 22 of 14[4 4
IVISFIS V&V Report Non-Proprietary CS Innovations LILC MSFIS V&V Report Non-Proprietary CS Innovations LLC 4.2.5 Result All findings identified by V&V activities were incorporated in the latest Customer Specification from WCNOC.
The specification was found to be acceptable.
CS Innovations LLC 2008 Page 23 of 144 6101-00200, Rev 6101-00200, Rev 3 3 CS Innovations LILC 2008 Page 23 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC 4.3 6101-00001 - MSFIS Conceptual Design 4.3.1 Purpose Conceptual design document satisfies customer needs and is consistent with the PO.
Validate constraints of interfacing systems and constraints or limitations of proposed approaches. Analyze concept documents to validate that the following satisfy customer needs: System functionality, end-to-end system performance, operation and maintenance requirements, test requirements, environmental qualification requirements, etc.
4.3.2 When C-CD 4.3.3 V&V Effort The V&V effort was mainly focused on review to ensure the technical aspects of the document were adequate, as well as the documentation meet the criteria's set forth in section 4.1.2.
4.3.4 Findings and Results All findings identified by V&V were immediately incorporated into the next revision of the un-released document.
The document (MSFIS_ConceptualDesignDocument_vl_0) was successful released to WCNOC.
6101-00200, Rev 3 CS Innovations LLC 2008 Page 24 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC 4.4 6101-00000- MSFIS Management Plan 4.4.1 Purpose The purpose of the V&V effort was the review of the Management Plan.
CD P
4.4.3 V&V Effort The V&V efforts related to the MSFIS Management plan was to review and provide feedback.
4.4.4 Findings and Result The MSFIS Management plan (6101-00000 - MSFIS Management Plan) implemented by CSI was adequate and acceptable.
4CD 6101-00200, Rev 3 CS Innovations LLC 2008 Page 25 of" 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC 4.5 6101-00005 - Configuration Management Plan 4.5.1 Purpose This CM Plan was initially implemented by Spectrum Technologies (3 rd party independent V&V engineering team involved in the initial phases of the project). Spectrum Technologies had been involved with the development of the MSFIS based system utilizing Allen Bradley PLC's at the Callaway Nuclear plant.
Later the scope changed, and CSI initiated the generation of a CM plan independent of the 3 rd party 10CFR50 Appendix B partners. This plan obsoletes the previous plans generated by Spectrum Technologies.
CD 4.5.3 V&V Effort The CM effort changed from being the reviewer of the CM plan (WCGS MSFIS Configuration Management Plan) to actual generation of the plan (6101-00005 - Configuration Management Plan).
4.5.4 Findings and Result The CM plan implemented by Spectrum Technologies was acceptable, but proved to be insufficient.
The CM plan (6101-00005 - Configuration Management Plan) implemented by CSI was adequate and acceptable.
6101-00200, Rev 3 CS Innovations LLC 2008 Page 26 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC 4.6 6101-00008 - MSFIS V&V Plan 4.6.1 Purpose This V&V Plan was initially implemented by Spectrum Technologies (3rd party independent V&V engineering team involved in the initial phases of the project). Spectrum Technologies had been involved with the development of the MSFIS based system utilizing Allen Bradley PLC's at the Callaway Nuclear plant.
Later the scope changed, and CSI initiated the generation of a V&V plan independent of the 3 rd party 10CFR50 Appendix B partners. This plan obsoletes the previous plans generated by Spectrum Technologies.
CD 4.6.3 V&V Effort The V&V effort changed from being the reviewer of the V&V plan (WCGS MSFIS System Verification and Validation Plan) to actual generation of the plan (6101-00008 MSFIS V&V Plan).
4.6.4 Findings and Result The V&V plan implemented by Spectrum Technologies was acceptable, but proved to be insufficient.
The V&V plan (6101-00008 - MSFIS V&V Plan) implemented by CSI was adequate and acceptable.
Cs Innovations LLC 2008 Page 27 of 144 Rev 3 6101-00200, Rev 6101-00200, 3 CS Innovations LILC 2008 Page 27 of 144
IVISFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC 4.7 6101-00004 - MSFIS System Test Plan 4.7.1 Purpose The V&V team was responsible for generation of the "6101-00004 - MSFIS System Test Plan" document.
CD CD 4.7.4 Findings All findings identified by V&V, Nutherm and WCNOC were immediately incorporated into the next revision of the un-released document.
4.7.5 Result 6101-00004 - MSFIS System Test Plan, Revision 0 was released, and used to validate the system function on the system which was sent to Nutherm for qualification.
6101-00004 - MSFIS System Test Plan, Revision 0.98 was released, and used during the FAT (MSFIS System Acceptance Test) performed in Scottsdale in Sept'2007 (see chapter 7).
6101-00004 - MSFIS System Test Plan, Revision 1 was released, and used during the FAT/CGD/SAT phase performed at WCGS in Feb'2008 (see chapter 8 - specifically section 8.3.5.2).
4.8 6101-00006 - MSFIS Safety Assessment This document was not initially planned to be generated by CSI, but instead was implemented by WCNOC's independent V&V engineer (Baseline Engineering) - the document is referred to as 'System Reliability Analysis for Advanced Logic System'.
Note: CSI release an independent safety assessment: '6101-00006 MSFIS Safety Assessment' in June 2007 (when a request was made by NRC).
CS Innovations LLC 2008 Page 28 of 144 Rev 3 6101-00200, Rev 6101-00200, 3 CS Innovations LLC 2008 Page 28 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC 4.9 6000-00008 - ALS Board Test Plan 4.9.1 Purpose The V&V team was responsible for generation of the "6000-00008 - ALS Board Test Plan" document.
4.9.2 When PCD The '6000-00014 - ALS Board Test Plan' document was released on the following dates:
Revision Date Description of changes 0.01 Feb 1,2008 Release 4.9.3 V&V Effort The V&V effort was mainly focused on generating the document, specifying the test system, specifying the test specifications, specifying the test cases and specifying the test procedures to test the ALS boards.
WCNOC provided independent review of the document. All document feedback was provided within document comments, which were then discussed on conference calls. WCNOC had less influence on the document due to the very technical nature of the implementation.
CD 6101-00200, Rev 3 CS Innovations LLC 2008 Page 29 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary Cs Innovations LLC CD CD 6101-00200, Rev 3 CS Innovations LLC 2008 Page 30 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC 5 Development Stage 5.1 Stage Summary The following provides details of the V&V activities conducted during the design phase, implementation phase and test phase of the development stage.
5.1.1 Stage Activities The Development stage consists of a:
- 1) Design Phase: where requirements are refined and the items are designed
- 2) Implementation Phase: where items are implemented
- 3) Test Phase: where items are tested and qualified.
Following a successful development stage the items can be baselined, and are then ready for production.
L The items which are designed, implemented and tested in the development stage include:
1' 5.1.2 Stage V&V activities A number of iterations affecting the outputs of previous phases were performed, affecting both the Conceptual Design and Requirements Phases. The specific iterations performed are detailed in the following description of the V&V activities performed during the Design Phase.
The methods employed in the V&V of the Design Phase consisted principally of visual review of documents and drawings against the preceding phase outputs, the engineering experience of the reviewers, and the writing of original documents to cover the required testing. The criteria for acceptance were the projections of the experienced personnel performing the work that the documents being reviewed and prepared would meet the requirements of the customer's specification and work properly after installation irrespective of the specification requirements.
The V&V tasks of the design phase of the development process for the MSFIS consisted of several activities as follows:
" Design Document Review:
o Review the J105A(Q) Customer Requirements Specification delivered by WCNOC
" Review and approval of Hardware Design Documents prepared by the design team
" On a continued basis verify the design, as well as the used design processes are in-line with the appropriate procedures. Conducting informal reviews, walkthroughs and inspections of the preliminary designs and associated data-base.
" Prepare the following documents:
o 6000-00008 - "ALS Board Test Plan" and verify its in-line with the design.
o 6101-00004 - "MSFIS System Test Plan" and verify its in-line with the design.
o 6101-00006 - "MSFIS Safety Assessment" and verify its in-line with the design.
6101-00200, Rev 3 CS Innovations LLC 2008 Page 31 of 144
IVISFIS V&V Report Non-Proprietary CS Innovations ILLC MSFIS V&V Report Non-Proprietary CS Innovations LLC 5.2 V&V activities during ALS board development 5.2.1 Purpose Review all internally generated design specification. The design specifications were reviewed to ensure it presented a structured description of the design and addressed all requirements presented in the customer specification.
Review and provide oversight of the design and implementation of the ALS boards. The V&V activities was introduces at the very beginning of the board developments and followed the boards from prototypes to final release.
The design specifications was reviewed and revised on a continuously basis with many informal meetings and reviews. The finals design specification was reviewed as a part of the either:
CD The design specifications reviewed by V&V are:
5F CD 5.2.2 ALS board development time-line The table below shows all ALS boards created as a part of the WC MSFIS project. In this context board development refer to engineering efforts associated with making electronic assemblies based on printed circuit board assemblies. For each item the design completion date and status has been listed.
P CS Innovations LLC 2008 Page 32 of 144 Rev 3 6101-00200, Rev 6101-00200, 3 CS Innovations LILC 2008 Page 32 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC CD CS Innovations LLC 2008 Page 33 of 144 Rev 33 6101-00200, Rev CS Innovations LLC 2008 Page 33 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC CD CS Innovations LLC 2008 Page 34 of 144 6101-00200, Rev3 Rev 3 CS Innovations LILC 2008 Page 34 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFiS V&V Report Non-Proprietary CS Innovations LLC 5.2.3 V&V Effort The V&V efforts included:
- Review of pre-release versions of schematics, Gerber artwork and BOMs, performed as informal reviews.
- Review of final release versions of schematics, Gerber artwork and BOMs.
- Review board design packet following CS Innovations Review Procedure (Reference 9002-00025 - "Board Design Review Procedure").
m CS Innovations LLC 2008 Page 35 of 144 Rev 3 6101-00200, Rev 6101-00200, 3* CS Innovations ILLC 2008 Page 35 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC CD 6101-00200, Rev 3 CS Innovations LLC 2008 Page 36 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC CD 5.2.5 Result The conclusion of the V&V activities which took place during the development of the ALS board is that all issues and finding identified by V&V have been resolved to the satisfaction of the V&V team. The findings which had been identified on older revisions were corrected and reviewed on later revisions. The issues found during the engineering versions of the board developments were viewed upon as being a normal and expected part of engineering development efforts.
The V&V team found all engineering changes was clearly identified and documented.
All final releases of the ALS boards were reviewed by V&V and found to be acceptable based on the above discussion, and no issues remained open at the exit of the development phase.
CS Innovations LLC 2008 Page 37 of 144 Rev 3 6101-00200, F~ev 3 CS Innovations LLC 2008 Page 37 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC 5.3 VHDL Rapid Prototype Implementation 5.3.1 Purpose The design team and V&V team made a rapid VHDL implementation in order to implement a prototype FPGA image. Prototyping was used as an integrated part of the system design process, in order to reduce the overall project risk. Prototyping was used to quickly putting together a working model in order to test various aspects of a design, illustrate ideas and new features and gather early customer feedback from WCNOC.
7D Cs Innovations LLC 2008 Page 38 of 144 6101-00200, Rev 6101-00200, Rev 33 CS Innovations LLC 2008 Page 38 of 144
IVISFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC P
CD CS Innovations LLC 2008 Rev 33 6101-00200, Rev CS Innovations LLC 2008 Page 39 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC CD 6101-00200, Rev 3 CS Innovations LLC 2008 Page 40 of 144
IVISFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC 5.5 V&V activities during FPGA development activities 5.5.1 Purpose To review and provide oversight over the implementation and testing of the FPGA images used on the FPGA based ALS boards.
The V&V team consisted of team members from the original fast prototype design team, who based on the experience gained from the prototype build had gained significant insight in the functionality and requirements of MSFIS. (Reference section 5.3).
Although the functionality of the functionality of the prototype was near identical to the functionality of the final system, none of the original VHDL code base was maintained between the prototype and the final design effort.
Only the physical FPGA's, the board, and the implementation tools were transferred over the final design.
The engineering team members chosen for the detailed design and implementation of the FPGA binaries was experienced FPGA/ASIC design engineers with a proven track record in design, implementation and test of digital circuits.
5.5.2 When The V&V efforts performed on the design activities related to the FPGA image was ongoing throughout the design, implementation and testing. To provide a better overview over these activities this section has been split up into 2 section describing activities taking place prior to release and the actives taking place as a part of the release.
7D Cs Innovations LLC 2008 Page 41 of 144 Rev 3 6101-00200, Rev 6101-00200, 3 CS Innovations LLC 2008 Page 41 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC P
CD 6101-00200, Rev 3 CS Innovations LLC 2008 Page 42 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC CD CS Innovations LLC 2008 Page 43 of 144 Rev 3 6101-00200, Rev 6101-00200, 3 CS Innovations LLC 2008 Page 43 of 144
IVISFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC CD CS Innovations LLC 2008 Page 44 of 144 Rev 33 6101-00200, Rev CS Innovations LLC 2008 Page 44 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC P,
CD CS Innovations LLC 2008 610 6101-00200, Rev 3 1-00200, Rev 3 CS Innovations LLC 2008 Page 45ofl144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC CD m
CS Innovations LLC 2008 Page 46 of 144 Rev 3 6101-00200, Rev 3 CS Innovations LLC 2008 Page 46 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC C-CD 5.5.5 Result The final result of the FPGA review was an approval signoff of the FPGA revision 1.00 for FPGA Image P/N:
ALS-101 FPGA Image P/N 1200-00000 ALS-201 FPGA Image P/N 1200-00001 ALS-301 FPGA Image PIN 1200-00002 ALS-401 FPGA Image P/N 1200-00003 ALS-411 FPGA Image P/N 1200-00004 7C 6101-00200, Rev 3 CS Innovations LLC 2008 Page 47 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC 5.6 Prepare V&V related Documents The V&V team was responsible for the creation of the 3 following documents.
- 1) 6000-00008 - "ALS Board Test Plan"
- 2) 6101-00004 - "MSFIS System Test Plan"
- 3) 6101-00006 - "MSFIS Safety Assessment" 5.6.1 ALS Board Test Plan The ALS board Test Plan (ATP) provides a detailed description of the Test Plan and Procedures used to test Advanced Logic System (ALS) Boards. The document includes the following:
" Test Plan - A comprehensive plan to conduct V&V and acceptance testing of ALS boards.
- Requirement Traceability Matrix - Describes the relationship between the test requirements and the associated test cases (test vectors) and test procedures which support V&V of the ALS boards.
- Test Procedures o Description of the verification and simulation test environments which are used for testing.
o Release test procedure used when releasing a new board revision.
o Description of an acceptance test plan used for test of board during manufacturing.
The Test Plan with all the described Test Procedures are used to formally sign-off the ALS Board for baselining, as well as the final validation and acceptance testing following the board manufacturing phase.
The ALS Board Test Plan was a developed by the V&V team with review support from engineering.
5.6.2 MSFIS System Test Plan The MSFIS System Test Plan contains a detailed plan for verification and validation of the Main Steam and Feedwater Isolation System (MSFIS).
The MSFIS test plan is created by V&V based on the requirements described in:
- J-105A(Q) - Specification for Replacement MSFIS System
- 6101-00002 - MSFIS System Specification A Requirement Traceability Matrix describes the relationship between a set of test requirements, the associated test vectors which support the V&V process.
The MSFIS Test Plan was a developed by the V&V team with review support from engineering.
The MSFIS Test Plan describes a test suite used for:
- System-level Automated Testing utilized the Automatic Test Equipment (ATE) developed by CS Innovations (see section 7.2.2). The ATE consists of an ATU-101 which is a dedicated hardware test system and the ATS-101 software suite which runs the golden test vector (GTV).
" System-level Manual Test Environment where the MSFIS system can be tested using an operator panel to provide inputs (OPEN, CLOSE, ESFAS, etc) and a load bank for creating a realistic load scenario.
The Test Plan with all the described Test Procedures are used to formally sign-off the MSFIS system.
5.6.3 MSFIS Safety Assessment The MSFIS safety assessment is performed to locate, identify, and assess the impact of a failure in the WCNOC MSFIS based on the Advanced Logic System (ALS). It includes a preliminary system safety assessment which identifies critical paths in MSFIS.
6101-00200, Rev 3 CS Innovations LLC 2008 Page 48 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC The Safety Assessment is used in the 6101-00002 - MSFIS System Specification, where it was used to guide the implementation of the ALS bases MSFIS.
_The Safety Assessment includes:
P CD Cs Innovations LLC 2008 6101-00200, Rev3 6101-00200, Rev 3 CS Innovations LILC 2008 Page 49 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC 5.7 Automated Test Equipment 5.7.1 Purpose The V&V team decided that the ability to perform automatic testing on the individual ALS board and on the MSFIS system was a priority. The automatic testing was not viewed upon as a replacement for automatic testing, but rather as the means to generate an extensive regression test suite which to be easily repeated during development and later for during manufacturing. Having an automated regression test suite enabled the CS Innovations in performing very extensive acceptance tests on all ALS board and the MSFIS system.
As a consequence the V&V team defined a set of requirements to an ATE. The ATE was defined a dedicated tool designed specifically for testing individual ALS boards as well as testing completed ALS Systems such as the
_MSFIS system.
P, P-9 CD m
Cs Innovations LLC 2008 Page 50 of 144 6101-00200, RevRev 33 CS Innovations LLC 2008 Page 50 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC CD 6101-00200, Rev 3 CS Innovations LLC 2008 Page 51 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC CD CD CS Innovations LLC 2008 Page 52 of 144 6101-00200, Rev3 6101-00200, Rev 3 CS Innovations LLC 2008 Page 52 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC 5.9 Review and Pre-Validation of EMI / RFI / Surge 5.9.1 Acceptance Criteria Meet the guidelines of:
" NUREG1.180revl
" EPRI TR-102323 rev 1 - 1997
" EPRI TR-102323 rev 2 - 2000
" EPRI TR-102323 rev 3 - 2004 CD m
CS Innovations LLC 2008 Page 53 of 144 Rev 3 6101-00200, Rev 6101-00200, 3 CS Innovations LLC 2008 Page 53 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC CD 6101-00200, Rev 3 CS Innovations LLC 2008 Page 54 of 144
IVISFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC 0)
CD 5.10 Review: Seismic Test Procedures The V&V effort related to Seismic Qualification was on a review and comment basis.
5.10.1 CSI Seismic V&V effort The V&V group performed multiple investigations into the durability, reliability and structural strength of the rack used in the ALS platform.
The rack was found to be acceptable for any class 1E RPS application.
5.10.2 Seismic Test Plan & Procedures Review Due to the arrangement between WCNOC, Nutherm and CSI, then CSI were in a 3 rd party reviewer role regarding the Seismic tests. CSI did not have approval rights to the Nutherm controlled test.
CSI reviewed Nutherm Seismic Test Procedure, S-128P, on each occupation of its release:
CSI did not have any significant feedback on the Seismic tests.
5.10.3 Seismic Test Execution Nutherm conducted the seismic test a Wyle Test Labs in January 2007.
WCNOC provided mechanical engineering oversight.
CSI was not present at the test.
The results are documented by Nutherm Qualification Report in the 'WCN-9715R, Rev.0 (February 2007).
KC cs Innovations LLC 2008 Page 55 of 144 6
6101-00200, Rev 3 101-00200, Rev 3 CS Innovations ILILC 2008 Page 55 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary Cs Innovations LLC 5.12 Summary: Design Phase V&V Activities 5.12.1 Reviewed & Approved Documents The following documents were prepared by the Design team, and reviewed and approved by the V&V team.
CD 5.12.2 Prepared Documents The following documents were prepared by the V&V team.
0)
CD 5.13 Completion of the Development Stage The V&V conclusion of the Development Stage was that all development efforts were completed in a satisfactory manner. Engineering prototypes were created of the ALS based MSFIS system and used to provide engineering with proof of design/concept before finalizing the design. V&V reviewed and audited the development team throughout the developments and found that the following items had been performed to the satisfaction of the V&V team:
" ALS board had been development and tested
- FPGA developments had been developed and tested
- Test Plan and Test Procedures had been created
- Assembly and traveler documents had been prepared to ensure consistent manufacturing
" A thorough EQ plan was created
- Qualification Prototype of MSFIS was created and passed EQ EQ Testing was accomplished with an acceptable and satisfactory result, and meets and exceeds:
" Reg. Guide 1.180 rev 1
" EPRI 102323 rev 1
" EPRI 102323 rev 2
" EPRI 102323 rev 3 Most test with a margin greater than 20dB. The design is suitable for commercial plants, nuclear subs, and carrier applications.
EMI test performed by CSI to independently validate EMI performance.
Rev 33 Cs Innovations LLC 2008 Page 56 of 144 6101-00200, Rev 6101-00200, CS Innovations ILLC 2008 Page 56 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC Manufactuineg (and Bor
_______________ Bard Acpae)_Stage Acceptance t The V&V effort during the manufacturing stage was twofold:
" V&V Review of Procedures used in Manufacturing
" V&V Review of Traveler's 7C Rev 33 Cs Innovations LLC 2008 Page 57 of 144 6101-00200, Rev 6101-00200, CS Innovations LLC 2008 Page 57 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC P,
P7 P
CD Cs Innovations LLC 2008 Page 58 of 144 6101-00200, Rev 33 6101-00200, Rev CS Innovations LLC 2008 Page 58 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFiS V&V Report Non-Proprietary CS Innovations LLC P
CD 6.4 Review of Test Equipment The ALS Test Unit (AUT-101) as shown below in Figure 6-1 is the main test tool used for automated tests. Each of the ALS Board was tested using the ATU-101. All tests executed within the ATE verification environment support self-checking tests and produce a PASS/FAIL upon completion of the test execution. The test environment provide significant test coverage of each board, which together with the associated manual test procedure provide a complete Board Acceptance Test.
ALS Test Equipment (ATE)
Figure 6-1 Board-level Automated Testing Environment I7P CS Innovations LLC 2008 Page 59 of 144 6101-00200, Rev 6101-00200, Rev 3 3 CS Innovations LLC 2008 Page 59 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC 6.4.2 Review of Test Equipment In particular, the V&V team focused on reviewing the GTV's vectors, which resulted in the final vector suite.
A large numbers of tests were conducted by the V&V group to gain confidence in the GTV's and the test equipment itself, including the ATS-101 software suite and the ATU-101 hardware tester.
CD 6101-00200, Rev 3 CS Innovations LLC 2008 Page 60 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC P3 P7 0
CD 6101-00200, Rev 3 CS Innovations LLC 2008 Page 61 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC 0"
C-)
CS Innovations LLC 2008 Page 62 of 144 Rev 33 6101-00200, Rev CS Innovations LLC 2008 Page 62 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFiS V&V Report Non-Proprietary CS Innovations LLC CD CS Innovations LLC 2008 Rev 33 6101-00200, Rev CS Innovations LLC 2008 Page 63 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC CD CS Innovations LLC 2008 Rev 3 6101-00200, Rev 6101-00200, 3 CS Innovations LILC 2008 Page 64 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC CD CD Cs Innovations LLC 2008 Page 65 of 144 Rev 3 6101-00200, Rev 3 CS Innovations LLC 2008 Page 65 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC 6.6 V&V Review of NCR's Twenty-two NC was generated during the Manufacturing Stage - see Table 6-8. The complete list of NC's generated during the MSFIS project can be seen in Appendix D : NCR's Related to MSFIS.
Non Conformance # State NC101- 0001 Closed NC101- 0002 Closed NC101- 0003 Closed NC101- 0004 Closed NC101- 0005 Closed NC101- 0006 Closed NC101- 0007 Closed NC101- 0008 Closed NC101- 0009 Closed NC101- 0010 Closed NC101- 0011 Closed NC101- 0012 Closed NC101- 0013 Closed NC101- 0014 Closed NC101- 0015 Closed NC101- 0016 Closed NC101- 0017 Closed NC101- 0018 Closed NC101- 0019 Closed NC101- 0020 Closed NC101- 0021 Closed NC101- 0022 Closed Table 6-8 : NCR's issued in the Manufacturing Stage 6.7 V&V Review of ECN's One ECN was generated from the board acceptance test process during the Manufacturing Stage.
INon Conformance,# State ECN101-0003 Closed Table 6-9 : ECN's issued in the Factory Acceptance Test Stage CD 6101-00200, Rev 3 CS Innovations LLC 2008 Page 66 of 144
IVISFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS innovations LLC 6.8 Summary of V&V Effort during Manufacturing Stage All Items (see list in section 2.5.2) were tested and validated.
All travelers, procedures, work-instructions and reports were review and approved.
All travelers filled out during manufacturing were review and approved.
All NCR's were review and approved.
All ECN's were review and approved.
The ALS Board Acceptance Testing was executed according to the acceptance test procedure. The validation testing was successful and the device tested met all of the requirements of the ALS Specification.
Cs Innovations LLC 2008 Page 67 of 144 6101-00200, Rev 6101-00200, Rev 33 CS Innovations ILLC 2008 Page 67 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC System Acceptance Test Stage Important note:
The original plan with the 'WCNOC MSFIS Project' called for Nutherm to be the 10CFR50 Appendix B vendor, and the FAT would therefore be performed by Nutherm, at Mount Vernon, II, using the Nutherm FAT procedure.
However, in order for CSI to insure a quality delivery, an independent system test plan (6101-00004),
was developed. The system test plan tested the delivered equipment to the same degree (or in fact better) than the Nutherm manual FAT procedure would do. The test consisted of both manual and automatic aspects utilizing the ATE equipment.
The Test Plan/Procedure was executed, as if in fact, the equipment was being delivered to WCNOC as 10CFR50 Appendix B safety related equipment.
The only exception to an ordinary I0CFR50 Appendix B delivery was the lack of a C of C issued in the end after the testing.
7.1 Stage Summary In the system test stage the verified hardware components produced in the manufacturing stage is integrated into a completed system, capable of performing the function described in the customer requirements. CSI performs a very exhaustive system tests suite to provide a complete verification that the system meet the customer requirements.
7::
CS Innovations LLC 2008 Page 68 of 144 6101-00200, RevRev 33 CS Innovations LLC 2008 Page 68 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC P
CD 6101-00200, Rev 3 CS Innovations LLC 2008 Page 69 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC CD 6101-00200, Rev 3 CS Innovations LLC 2008 Page 70 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC C) m CS Innovations LLC 2008 Page 71 of 144 6101-00200, Rev 33 6101-00200, Rev CS Innovations LLC 2008 Page 71 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS innovations LLC CD Cs Innovations LLC 2008 Rev 3 6101-00200, Rev 6101-00200, 3 CS Innovations LLC 2008 Page 72 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC CD 6101-00200, Rev 3 CS Innovations LLC 2008 Page 73 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC 7.3 V&V Review of Procedures used in MSFIS Acceptance Testing Nutherm FAT procedure, the Technical Procedure TPS-9064, rev 0 was released a series of times in the period from May-July 2006.
The Nutherm FAT procedure was an independent re-compilation of CSI's 6101-00005 - MSFIS System Test Plan.
CSI conducted a complete review of the rev. 0 and provided the feedback to Nutherm with the required changes related to functionality and performance. Feedback reference: "Review - FAT - 2007-05-29.pdf".
7.4 V&V Monitoring and Participation in Test Execution The V&V effort included active participation during the system Acceptance testing to ensure all processes and tools operate as expected.
CI 6101-00200, Rev 3 CS Innovations LLC 2008 Page 74 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFiS V&V Report Non-Proprietary CS Innovations LLC CD CS Innovations LLC 2008 Page 75 of 144 Rev 3 6101-00200, Rev 3 CS Innovations LLC 2008 Page 75 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFiS V&V Report Non-Proprietary CS innovations LLC 7.6 Review the System Configuration The V&V review included verification of the System configuration of all the MSFIS racks.
0D CD 6101-00200, Rev 3 CS Innovations LLC 2008 Page 76 of 144
IVISFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC 7.7 V&V Review of NCR's One NC was generated during the Factory Acceptance Stage - see Table 6-8. The complete list of NC's generated during the MSFIS project can be seen in Appendix D : NCR's Related to MSFIS.
NonConformance# State NC101- 0023 Closed Table 7-4: NCR's issued in the Factory Acceptance Test Stage P
CD 7.8 V&V Review of ECN's One ECN was generated during the Factory Acceptance Test, as a consequence to the non-conformance report NC101-0023 (see section 7.7).
Non Conf6rm cS.# jtatie .
ECN101-0004 Closed Table 7-5: ECN's issued in the Factory Acceptance Test Stage ECN101-0004 was successfully implemented and closed.
The complete list of ECNs can be seen in Appendix E: ECN's Related to MSFIS Project.
7.9 Summary of V&V Effort during Manufacturing Stage All Items (see list in section 2.5.1) were tested and validated.
All travelers, procedures, work-instructions and reports were review and approved.
All travelers filled out during manufacturing were review and approved.
All NCR's were review and approved.
All ECN's were review and approved.
The MSFIS system Acceptance Testing was executed according to the acceptance test procedure. The validation testing was successful and the device tested met all of the requirements of the MSFIS System Specification as well as the J-105A(Q).
CS Innovations LLC 2008 Page 77 of 144 6101-00200, Rev 6101-00200, Rev 33 CS Innovations LLC 2008 Page 77 of 144
IVISFIS V&V Report Non-Proprietary CS Innovations LLC FAT/CGDISAT Installation (at WCGS The goal of the testing and inspection activities was to allow WCNOC receipt inspection to transition the MSFIS system into safety related storage in the WCGS warehouse.
Cs Innovations LLC 2008 Page 78 of 144 Rev 3 6101-00200, Rev 3 CS Innovations LLC 2008 Page 78 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC 7
PCD 6101-00200, Rev 3 CS Innovations LLC 2008 Page 79 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC CD F
CD 6101-00200, Rev 3 CS Innovations LLC 2008 Page 80 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC CD 6101-00200, Rev 3 CS Innovations LLC 2008 Page 81 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC CD 8.8 Conclusion The FAT/SAT was completed successfully.
Test incidences and nonconformance's were resolved to the satisfaction of V&V.
CS Innovations LLC 2008 Page 82 of 144 Rev 3 6101-00200, Rev 3 CS Innovations LLC 2008 Page 82 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC P0" CD Rev 33 Cs Innovations LLC 2008 610 1-00200, Rev 6101-00200, CS Innovations LLC 2008 Page 83 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC C"
CD m
CS Innovations LLC 2008 Page 84 of 144 6
6101-00200, Rev 33 101-00200, Rev CS Innovations LLC 2008 Page 84 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC P
CD CS Innovations LLC 2008 Page 85 of 144 Rev 3 6101-00200, Rev 3 CS Innovations LLC 2008 Page 85 of 144
IVISFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC CD 6101-00200, Rev 3 CS Innovations LLC 2008 Page 86 of 144
MSFIS V&V Report Non-Proprietary CS Innovations LLC CD 6101-00200, Rev 3 CS Innovations LLC 2008 Page 87 of 144
IVISFIS V&V Report Non-Proprietary CS Innovations LLC MSFIS V&V Report Non-Proprietary CS Innovations LLC CD CS Innovations LLC 2008 Page 88 of 144 6101-00200, Rev 33 6101-00200, Rev CS Innovations LLC 2008 Page 88 of 144
I MSFIS V&V Report Non-Proprietaryabce CS Innovations LLC Non~Proprietaryabce CS Innovations LLC CS Innovations LLC 2008 Page 89 of 144 6
6101-00200, Rev 33 101-00200, Rev CS Innovations LLC 2008 Page 89 of 144
I MSFIS V&V Report Non-Proprietarya,b,c,e CS Innovations LLC CS Innovations LLC 2008 Page 90 of 144 Rev 3 6101-00200, Rev 6101-00200, 3 CS Innovations LLC 2008 Page 90 of 144
I MSFIS V&V Report Non-Proprietaryabce CS Innovations LLC Non~Proprietaryabce CS Innovations LLC 6101-00200, Rev 3 CS Innovations LLC 2008 Page 91 of 144
I MSFIS V&V Report Non-Proprietarya,b,c,e CS Innovations LLC 6101-00200, Rev 3 CS Innovations LLC 2008 Page 92 of 144
I MSFIS V&V Report Non-Proprietarya bce CS Innovations LLC MSFIS V&V Report Non~Proprietaryabce CS Innovations LLC 6101-00200, Rev 3 CS Innovations LLC 2008 Page 93 of 144
Non-Proprietarya'b,c,e CS Innovations LLC I MSFIS V&V Report CS Innovations LLC 2008 Page 94 of 144 6101-00200, Rev 33 CS Innovations LLC 2008 Page 94 of 144
I MSFIS V&V Report Non-Proprietarya,b,c,e CS Innovations LLC CS Innovations LLC 2008 Page 95 of 144 Rev 3 6101-00200, Rev 6101-00200, 3 CS Innovations LLC 2008 Page 95 of 144
I MSFIS V&V Report Non-Proprietaryabce CS Innovations LLC Non~Proprietaryabce CS Innovations LLC CS Innovations LLC 2008 Page 96 of 144 Rev 3 6101-00200, Rev 3 CS Innovations LILC 2008 Page 96 of 144
MSFIS V&V Report Non-Proprietarya,b c,e CS Innovations LLC CS Innovations LLC 2008 Page 97 of 144 Rev 33 6101-00200, Rev CS Innovations LLC 2008 Page 97 of 144
MSFIS V&V Report Non-Proprietarya,b,ce CS Innovations LLC 6101-00200, Rev 3 CS Innovations LLC 2008 Page 98 of 144
MSFIS V&V Report Non-Proprietary a, bce CS Innovations LLC MSFIS V&V Report Non~Proprietaryabce CS Innovations LLC 6101-00200, Rev 3 CS Innovations LLC 2008 Page 99 of 144
MSFIS V&V Report Non-Proprietarya,b c,e CS innovations LLC 6101-00200, Rev 3 CS Innovations LLC 2008 Page 100 of 144
MSFIS V&V Report Non-Proprietarya,b c,e CS Innovations LLC 6101-00200, Rev 3 CS Innovations LLC 2008 Page 101 of 144
MSFIS V&V Report Non-Proprietaryabce CS Innovations LLC MSFIS V&V Report Non~Proprietaryabce CS Innovations LLC 6101-00200, Rev 3 CS Innovations LLC 2008 Page 102 of 144
MSFIS V&V Report Non-Proprietary'a,bc,e CS Innovations LLC 6101-00200, Rev 3 CS Innovations LLC 2008 Page 103 of 144
MSFIS V&V Report Non-Proprietary a ,b,c e CS Innovations LLC MSFIS V&V Report Non~Proprietaryabce CS Innovations LLC CS Innovations LLC 2008 Page 104 of 144 6101-00200, Rev 33 6101-00200, CS Innovations LLC 2008 Page 104 of 144
MSFIS V&V Report Non-Proprietary',b,,,, CS Innovations LLC MSFIS V&V Report Non~Proprietarya bce CS Innovations LLC 6101-00200, Rev 3 CS Innovations LLC 2008 Page 105 of 144
MSFIS V&V Report Non-Proprietary a ,b ce CS Innovations LLC MSFIS V&V Report Non~Proprietaryabce CS Innovations LLC 6101-00200, Rev 3 CS Innovations LLC 2008 Page 106 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 107 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 108 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 109 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 110 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 111 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 112 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 113 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 114 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 115 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 116 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 117 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 118 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 119 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 120 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 121 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 122 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 123 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 124 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 125 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 126 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 127 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 128 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 129 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 130 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 131 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 132 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 133 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 134 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 135 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 136 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 137 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 138 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 139 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 140 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 141 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 142 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 143 of 144
MSFIS V&V Report Non-Proprietary (4)(ii)a,c,e Page 144 of 144