ML17304B488
| ML17304B488 | |
| Person / Time | |
|---|---|
| Site: | NuScale |
| Issue date: | 10/31/2017 |
| From: | Rad Z NuScale |
| To: | Document Control Desk, Office of New Reactors |
| Shared Package | |
| ML17304B487 | List: |
| References | |
| AF-1017-56885, RAIO-1017-56884 | |
| Download: ML17304B488 (34) | |
Text
RAIO-1017-56884 October 31, 2017 Docket No.52-048 U.S. Nuclear Regulatory Commission ATTN: Document Control Desk One White Flint North 11555 Rockville Pike Rockville, MD 20852-2738
SUBJECT:
NuScale Power, LLC Response to NRC Request for Additional Information No.
220 (eRAI No. 8805) on the NuScale Design Certification Application
REFERENCE:
U.S. Nuclear Regulatory Commission, "Request for Additional Information No.
220 (eRAI No. 8805)," dated September 12, 2017 The purpose of this letter is to provide the NuScale Power, LLC (NuScale) response to the referenced NRC Request for Additional Information (RAI).
The Enclosures to this letter contain NuScale's response to the following RAI Questions from NRC eRAI No. 8805:
18-3 18-4 is the proprietary version of the NuScale Response to NRC RAI No. 220 (eRAI No.
8805). NuScale requests that the proprietary version be withheld from public disclosure in accordance with the requirements of 10 CFR § 2.390. The proprietary enclosures have been deemed to contain Export Controlled Information. This information must be protected from disclosure per the requirements of 10 CFR § 810. The enclosed affidavit (Enclosure 3) supports this request. Enclosure 2 is the nonproprietary version of the NuScale response.
This letter and the enclosed responses make no new regulatory commitments and no revisions to any existing regulatory commitments.
If you have any questions on this response, please contact Steven Mirsky at 240-833-3001 or at smirsky@nuscalepower.com.
Sincerely, Zackary W. Rad Director, Regulatory Affairs NuScale Power, LLC NuScale Power, LLC 1100 NE Circle Blvd., Suite 200 Corvalis, Oregon 97330, Office: 541.360.0500, Fax: 541.207.3928 www.nuscalepower.com
RAIO-1017-56884 Distribution: Gregory Cranston, NRC, OWFN-8G9A Samuel Lee, NRC, OWFN-8G9A Demetrius Murray, NRC, OWFN-8G9A : NuScale Response to NRC Request for Additional Information eRAI No. 8805, proprietary : NuScale Response to NRC Request for Additional Information eRAI No. 8805, nonproprietary : Affidavit of Zackary W. Rad, AF-1017-56885 NuScale Power, LLC 1100 NE Circle Blvd., Suite 200 Corvalis, Oregon 97330, Office: 541.360.0500, Fax: 541.207.3928 www.nuscalepower.com
NuScale Response to NRC Request for Additional Information eRAI No. 8805, proprietary NuScale Power, LLC 1100 NE Circle Blvd., Suite 200 Corvalis, Oregon 97330, Office: 541.360.0500, Fax: 541.207.3928 www.nuscalepower.com
NuScale Response to NRC Request for Additional Information eRAI No. 8805, nonproprietary NuScale Power, LLC 1100 NE Circle Blvd., Suite 200 Corvalis, Oregon 97330, Office: 541.360.0500, Fax: 541.207.3928 www.nuscalepower.com
Response to Request for Additional Information Docket No.52-048 eRAI No.: 8805 Date of RAI Issue: 09/12/2017 NRC Question No.: 18-3 Title 10 of the Code of Federal Regulations (10CFR) Section 52.47(a)(8) requires an applicant for a design certification to provide a final safety analysis report (FSAR) that must include the information necessary to demonstrate compliance with any technically relevant portions of the Three Mile Island requirements set forth in 10 CFR 50.34(f), except paragraphs (f)(1)(xii),
(f)(2)(ix), and (f)(3)(v). Section 10 CFR 50.34(f)(2)(iii) requires an applicant to "Provide, for Commission review, a control room design that reflects state-of-the-art human factor principles prior to committing to fabrication or revision of fabricated control room panels and layouts.
Chapter 18, Human Factors Engineering, of NUREG-0800, Standard Review Plan for the Review of Safety Analysis Reports for Nuclear Power Plants: LWR Edition, and NUREG-0711, "Human Factors Engineering Program Review Model, identify criteria the staff uses to evaluate whether an applicant meets the regulation. The applicant stated in the FSAR, Tier 2, Section 18.0, "Human Factors Engineering - Overview," that its human factors engineering (HFE) program incorporates accepted HFE standards and guidelines including the applicable guidance provided in NUREG-0711, Revision 3. This regulatory basis applies to all questions in this request for additional information (RAI).
Question 1 Criteria 5.4 (2) in NUREG-0711 states that The applicant should describe the screening methodology used to select the tasks for analysis, based on criteria specifically established to determine whether analyzing a particular task is necessary.
The screening methodology used for task analysis (TA) is described in the HFE Program Management Plan (PMP); DCD Tier 2, Section 18.4.2.1; and also in the Task Analysis Results Summary Report.
The HFE PMP, Section 6.3 states: Tasks are first screened. From the wide range of plant operating conditions, any task that meets the following criteria receives a more detailed TA Section 6.3 lists the criteria.
While the staff understands that any task that meets the stated criteria receives a more detailed TA, it is not clear whether a task received or will receive a more detailed TA if it meets ANY of the stated criteria or ALL of the stated criteria. If a task only receives a detailed TA if it meets ALL of the criteria, this may screen out a large amount of tasks, which could result in a NuScale Nonproprietary
TA that is not comprehensive. This could result in a negative impact on elements such as the HSI design that rely on the input from TA.
Please revise the application to clarify whether a task must have met any, some, or all of the criteria listed above to be selected for a detailed TA.
NuScale Response:
NuScale performed detailed task analysis (TA) on all tasks.
References to task analysis screening will be removed in:
the TA Results Summary Report (RSR), RP-0316-17616, Section 3.3.2, the HFE Program Management Plan (PMP), RP-0914-8534, Section 6.3, and Tier 2 FSAR Section 18.4.2.1 task screening methodology.
FSAR Section 18.4, the HFE PMP, RP-0914-8534, and the TA RSR, RP-0316-17616 have been revised to clarify that all identified tasks were subject to detailed TA.
Impact on DCA:
Tier 2 FSAR Sections 18.1 and 18.4., the Human Factors Engineering (HFE) Program Management Plan, and the HFE Task Analysis Results Summary Report have been revised as described in the response above and as shown in the markup provided with this response.
NuScale Nonproprietary
NuScale Final Safety Analysis Report Human Factors Engineering Program Management 18.1.5 Human Factors Engineering Technical Program 18.1.5.1 Applicability and Status of Human Factors Engineering Elements In addition to the HFE program management plan addressed in Section 18.1, the other elements of the HFE program outlined in NUREG-0711 and listed in Section 18.0 are applicable to the HFE program. These other elements are described in Section 18.2 through 18.12. Figure 18.1-1 provides an overview of the HFE process, including primary inputs to the process and the HFE program's integration into the design process through HFEITS.
18.1.5.2 Human Factors Engineering Activity Completion Schedules The HFE activity completion schedules are addressed in Table 18.1-1.
18.1.5.3 Standards and Specifications The HFE standards and specifications, which are sources of HFE requirements imposed on the design process, are identified in the quality assurance program description (refer to Section 17.5).
18.1.5.4 Human Factors Engineering Facilities, Equipment, Tools, and Techniques Section 18.1.1.4 addresses the facilities that are part of the HFE program scope. Tools and techniques used to support the HFE program elements include
- design guidelines.
- design verification checklists.
- low fidelity aids such as mock-ups (computer-aided drawings or physical representations of HSI).
- unit simulator (capable of supporting single-unit HSI, training, and procedure evaluation and analysis but having little or no shared or multi-unit simulation capability).
- multi-unit control room simulator (capable of supporting single, shared, and multi-unit HSI, as well as training, procedure, and S&Q analysis).
- relational requirements management software (e.g., DOORS).
18.1.6 References RAI 18-3 18.1-1 NuScale Power, LLC, "Human Factors Engineering Program Management Plan,"
RP-0914-8534, Revision 34.
18.1-2 Table, HFE Documents for the NuScale DCD (sic) Application, U.S. Nuclear Regulatory Commission, April 11, 2016, Agencywide Documents Access and Management System Accession No. ML16034A181.
Tier 2 18.1-9 Draft Revision 1
NuScale Final Safety Analysis Report Task Analysis their success paths. The HSI design (Section 18.7) uses the detailed TA results and inventory of alarms, controls, and indications to establish alarm logic, display and control designs, and grouping of HSI inventory especially for task-oriented screens.
18.4.2 Methodology RAI 18-3 The TA process includes the following steps:
- screen for applicableidentify tasks
- develop detailed task narrative
- decompose tasks
- develop operational sequence diagram
- verify IHA(s)
- identify task attributes
- identify high workload tasks
- identify task job position
- determine knowledge and abilities
- define task support requirements
- assess the workload
- determine inventory of alarms, displays, and controls to support performance of tasks Not all steps may be needed for each task, and the level of detail for the tasks depends on the complexity of the task.
RAI 18-3 18.4.2.1 Task ScreeningIdentification Methodology RAI 18-3 Tasks to be analyzed are determined using established selection criteria, and includeAll tasks, regardless of their importance, are analyzed so that the full extent of the work load can be determined. Examples of tasks to be analyzed include:
- important human actions determined through the human reliability portion of the PRA and deterministic means (i.e., transient and accident analyses, diversity and defense-in-depth coping analyses (D3CA)). The methodology for determining important human action is discussed in Section 18.6
- tasks that have negative consequences if performed incorrectly.
- tasks that are new or performed significantly differently from those in plants with similar systems and components.
- tasks related to monitoring and interacting with automated systems, automated-by-consent systems, and the use of automated support aids for personnel, such as Tier 2 18.4-2 Draft Revision 1
NuScale Final Safety Analysis Report Task Analysis computer-based procedures and adaptive automation features, such as for the critical safety function displays.
- tasks related to identifying the failure or degradation of automation, and other I&C computer-based systems, and those tasks required for implementing backup responses.
- tasks anticipated to impose high demands on personnel (such as administrative tasks that contribute to workload and challenge the operators' ability to monitor the plant).
- tasks with potential concerns for personnel safety.
RAI 18-3 DeterminationIdentification of tasks to be analyzed is performed by subject matter experts on the basis of their experience at current operating nuclear plants. The process typically includes review of operating experience and available system design material.
18.4.2.2 Personnel Task Narrative RAI 18-3 For the tasks that are screened inidentified for TA using the criteriaas described in Section 18.4.2.1, detailed task narratives (descriptions) are prepared. The task narratives provide:
- a description of the objectives of a specific system's operator tasks.
- an overview of the activities personnel are expected to accomplish to complete the task.
- a definition of alarms, information, controls, and task support needed to accomplish the task.
- a basic outline of the procedure steps.
The task narratives contain requisite detail for a reviewer to correlate the described task objectives to the results of the completed task analysis. The length of the narrative is commensurate with the complexity of the task it describes.
Task narratives are revised as relationships among tasks are better defined.
18.4.2.3 Relationships Among Tasks A task may include multiple subtasks that are needed to complete a task. In order to identify the stimulus and response relationship for each lowest level task, each task is decomposed by identifying the parent task, subtasks, and task elements. The lowest level task (element) is a discrete human action, cognitive or physical, executed to support a task.
An operational sequence diagram is created and used for certain tasks as necessary to aid in evaluating the flow of information between the operators and the HSI from the Tier 2 18.4-3 Draft Revision 1
NuScale Final Safety Analysis Report Task Analysis behavior during task performance, and operating experience reviews. If measurements are not feasible, independent assessments of time required for IHAs are developed by two different subject matter experts.
As discussed in Section 18.6, analysis of the HFE element treatment of IHAs identified no IHAs that require additional staffing for the operation of the NuScale Power Plant.
18.4.3 Results The function allocations determined as part of the HFE element functional requirements analysis and function allocation (see Section 18.3) provided the foundation for TA. Detailed task analysis is the foundation for the HSI design, the development of operating procedures and the operator training program.
RAI 18-3 Tasks were selectedidentified for analysis that represented a range of operating modes for a 12-module plant, including startup, normal operations, low-power and shutdown conditions, transient conditions, abnormal conditions, emergency conditions, and severe accident conditions, including those that affected multiple modules simultaneously.
RAI 18-3 Tasks were selected on the basis of the screening methodology discussed in Section 18.4.2.1. As discussed in Section 18.6, evaluation of the PRA results identified two risk-important human actions; evaluation of the deterministic analysis results identified no deterministically important human actions. NuScale utilized a high-fidelity simulator as a testbed for validating task completion times. The performance of the IHA within the allowed time was verified during the staffing plan validation as part of the HFE element S&Q (see Section 18.5).
Task analysis provided input to the HSI inventory and characterization, and for the HSI style guide, which provide the foundations for the HSI design (see Section 18.7), and from which HSI design verification and task support verification are performed. Task support verification, performed as part of the human factors verification and validation activities (see Section 18.10), ensures that the alarms, information, controls, and task support needed for personnel to perform their tasks are provided.
Task analysis was a major input for the development of the scenarios used for the staffing plan validation. TA identified highly challenging tasks, (e.g., those tasks that are considered to be high stress, and those that have high error potential, high cognitive workload). These tasks were used to develop scenarios to determine the adequacy of the plant staffing and qualifications as part of the HFE element S&Q (see Section 18.5).
The workload identified during TA were used to guide additional function allocation to automation to reduce workload.
Task analysis also produced the basic knowledge and abilities catalog necessary for training and qualifying operators, and for establishing the mechanisms required to validate staffing goals.
Tier 2 18.4-6 Draft Revision 1
NuScale Final Safety Analysis Report Task Analysis The results of the TA are documented in Reference 18.4-1.
18.4.4 Reference RAI 18-3 18.4-1 NuScale Power, LLC, Human Factors Engineering Task Analysis Results Summary Report, RP-0316-17616, Revision 01.
Tier 2 18.4-7 Draft Revision 1
+XPDQ)DFWRUV(QJLQHHULQJ3URJUDP0DQDJHPHQW3ODQ
53 13
5HY
+XPDQ)DFWRUV(QJLQHHULQJ
3URJUDP0DQDJHPHQW3ODQ
5HYLVLRQ
'RFNHW 352-
1X6FDOH3RZHU//&
1(&LUFOH%OYG6XLWH
&RUYDOOLV2UHJRQ
ZZZQXVFDOHSRZHUFRP
&RS\ULJKWE\1X6FDOH3RZHU//&
L
+XPDQ)DFWRUV(QJLQHHULQJ3URJUDP0DQDJHPHQW3ODQ
53 13
5HY
- HYDOXDWH WKH DJJUHJDWH LPSDFW WR SHUVRQQHO FRQVLGHULQJ DOO IXQFWLRQV DVVLJQHG WR
WKHP
- DOORFDWH WKH IXQFWLRQ WR D GLVFUHWH DOORFDWLRQ FULWHULD WR LPSURYH RYHUDOO GHVLJQ
FRQVLVWHQF\
7RROV IRU WKH )5$)$ SURFHVV LQFOXGH DQ )5$)$ GDWDEDVH WKDW SURGXFHV D IXQFWLRQDO
UHTXLUHPHQWVKLHUDUFK\FKDUW
7DVN$QDO\VLV
7KH 1X6FDOH +)( SURJUDP LQFOXGHV D 7$ $V VKRZQ LQ 7DEOH WKH 7$ DFWLYLW\
GRFXPHQWDWLRQ FRQVLVWV RI DQ 565 7KH 565 5HIHUHQFH GHVFULEHV WKH 7$
SURFHVVPHWKRGRORJ\DQGWKHILQGLQJVIURPWKH7$
7DVNV DUH ILUVW VFUHHQHG )URP WKH ZLGH UDQJH RI SODQW RSHUDWLQJ FRQGLWLRQV DQ\ WDVN
WKDW PHHWV WKH IROORZLQJ FULWHULD UHFHLYHV D PRUH GHWDLOHG WDVN DQDO\VLV$OO WDVNV
UHJDUGOHVVRIWKHLPSRUWDQFHDUHDQDO\]HGVRWKDWWKHIXOOH[WHQWRIWKHZRUNORDGFDQEH
GHWHUPLQHG ([DPSOHV RI WDVNV WR EH DQDO\]HG LQFOXGH EXW DUH QRW OLPLWHG WR WKH
IROORZLQJ
- WDVNV WKDW LQFOXGH LPSRUWDQW KXPDQ DFWLRQV DV GHWHUPLQHG IURP VDIHW\ DQDO\VLV
SUREDELOLVWLFULVNDVVHVVPHQW 35$ DQGGLYHUVLW\DQGGHIHQVHLQGHSWK ' FRSLQJ
DQDO\VLVIRUWKHLQVWUXPHQWDWLRQDQGFRQWUROV\VWHPV
- WDVNVWKDWLISHUIRUPHGLQFRUUHFWO\FRXOGLPSDFWQXFOHDUVDIHW\RUSRZHUJHQHUDWLRQ
- WDVNVWKDWDUHQHZRUSHUIRUPHGLQDPDQQHUVLJQLILFDQWO\GLIIHUHQWIURPVLPLODUWDVNV
LQWKHH[LVWLQJLQGXVWU\
- WDVNVUHODWHGWRPRQLWRULQJDXWRPDWHGV\VWHPVWKDWDUHLPSRUWDQWWRVDIHW\
- WDVNVUHODWHGWRUHFRJQL]LQJWKHIDLOXUHRUGHJUDGDWLRQRIDXWRPDWHGHTXLSPHQWDQG
SHUIRUPDQFHRIDVVRFLDWHGWDVNVWKDWLPSOHPHQWEDFNXSUHVSRQVHV
- DGPLQLVWUDWLYHWDVNVDQGVXSSRUWDLGVVXFKDVUHIHUHQFHPDWHULDOVKDUGFRS\JUDSKV
DQGFDOFXODWRUVWKDWSODFHDODUJHEXUGHQRQWKHFRQWUROURRPSHUVRQQHO
- PDLQWHQDQFHRUWHVWLQJWDVNVWKDWDUHLPSRUWDQWWRVDIHW\
- WDVNV ZLWK SRWHQWLDO HIIHFWV RQ SHUVRQQHO VDIHW\ VXFK DV PDLQWHQDQFH WDVNV
SHUIRUPHGLQWKHFRQWDLQPHQW
$IWHUFDWHJRUL]DWLRQLGHQWLILFDWLRQDWDVNQDUUDWLYHLVZULWWHQWR GHVFULEHWKHREMHFWLYHV
RI D VSHFLILF V\VWHP¶V RSHUDWRU WDVNV DQG SURYLGH DQ RYHUYLHZ RI WKH DFWLYLWLHV
SHUVRQQHO DUH H[SHFWHG WR DFFRPSOLVK WR FRPSOHWH WKH WDVN 1DUUDWLYH GHVFULSWLRQV RI
RSHUDWRUDFWLYLWLHVFRQWDLQUHTXLVLWHGHWDLOIRUDUHYLHZHUWR FRUUHODWHWKHGHVFULEHGWDVN
REMHFWLYHVWRWKHUHVXOWVRIWKHFRPSOHWHG7$7KHQDUUDWLYHLVEULHIIRUVLPSOHWDVNVEXW
KDVJUHDWHUGHWDLOIURPPRUHFRPSOH[WDVNV
7KHGHWDLOHG7$LQYROYHV
- GHFRPSRVLWLRQRIWDVNHOHPHQWV
&RS\ULJKWE\1X6FDOH3RZHU//&
+XPDQ)DFWRUV(QJLQHHULQJ3URJUDP0DQDJHPHQW3ODQ
53 13
5HY
'HVLJQ,PSOHPHQWDWLRQ
7KH1X6FDOH+)(SURJUDPLQFOXGHVGHVLJQLPSOHPHQWDWLRQ7KH',,3GHVFULEHVWKH',
SURFHVV DQG LQFOXGHV WKH RXWSXW GRFXPHQWDWLRQ UHTXLUHPHQWV 1R 565 LV UHTXLUHG IRU
WKLV HOHPHQW VLQFH FRQIRUPDQFH RI WKH DVEXLOW GHVLJQ WR WKH YHULILHG DQG YDOLGDWHG
GHVLJQLVFRQILUPHGE\DQ,7$$&
',GHPRQVWUDWHVWKDWWKHGHVLJQWKDWLVLPSOHPHQWHGDFFXUDWHO\UHIOHFWVWKHGHVLJQWKDW
KDV EHHQ YHULILHG DQG YDOLGDWHG GXULQJ KXPDQ IDFWRUV 9 9 ,I WKH ', SURJUDP HOHPHQW
LGHQWLILHV GLIIHUHQFHV VXFK DV VLWHVSHFLILF DVSHFWV WKDW ZHUH QRW LQFOXGHG LQ 9 9 RU
GHVLJQFKDQJHVWKDWRFFXUDIWHU9 9WKRVHGLIIHUHQFHVDUHHYDOXDWHGWRGHWHUPLQHDQ\
LPSDFWWRWKHDQDO\VLVUHVXOWVIURPDOOSUHYLRXV+)(SURJUDPHOHPHQWVLQFOXGLQJ9 9
- KLOHVXFFHVVIXO,69PDUNVWKHHQGRIKXPDQIDFWRUV9 9WKH+6,GHVLJQFRQWLQXHVWR
EH FKDOOHQJHG GXULQJ WKH RSHUDWRU WUDLQLQJ SURJUDP $Q\ 3ULRULW\ +('V JHQHUDWHG
GXULQJ 9 9 WKDW DUH GHWHUPLQHG WR UHTXLUH UHVROXWLRQ DQG DQ\ +('V JHQHUDWHG DIWHU
FRPSOHWLRQRI9 9DUHUHVROYHGGXULQJ',
+XPDQ3HUIRUPDQFH0RQLWRULQJ
+XPDQ SHUIRUPDQFH PRQLWRULQJ +30 EHJLQV DIWHU ', LV FRPSOHWHG DQG FRQWLQXHV IRU
WKH OLIH RI WKH SODQW +30 LV LQWHQGHG WR GHWHFW GHJUDGDWLRQ LQ RSHUDWRU SHUIRUPDQFH
FRPSDUHGWRWKHSHUIRUPDQFHREVHUYHGGXULQJLQWHJUDWHGV\VWHPYDOLGDWLRQ'HJUDGDWLRQ
PD\ EH GXH WR PDQ\ IDFWRUV WKDW RFFXU RYHU WKH OLIH RI WKH SODQW LQFOXGLQJ FKDQJHV LQ
SHUVRQQHOFKDQJHVLQSODQWFXOWXUHFKDQJHVLQWUDLQLQJPHWKRGVRUFKDQJHVLQWKH+6,
GHVLJQLWVHOI7KH+30SURJUDPLQFOXGHV
- PRQLWRULQJDQGLQYHVWLJDWLQJSHUFHLYHGRUGRFXPHQWHGUHGXFHGKXPDQSHUIRUPDQFH
- DQDO\]LQJFDXVHVRIUHGXFHGKXPDQSHUIRUPDQFH
- GHYHORSLQJFRUUHFWLYHDFWLRQSODQVIRULPSURYHPHQW
- PDLQWDLQLQJ D FXOWXUH RI FRQWLQXRXV PRQLWRULQJ RI KXPDQ SHUIRUPDQFH WKURXJK
RSHUDWLQJH[SHULHQFHUHYLHZ
- WUDLQLQJDQGTXDOLILFDWLRQ
- FKDQJHPDQDJHPHQW PRGLILFDWLRQSURFHVVFRQILJXUDWLRQPDQDJHPHQW
- XVHRIWKHSODQWVLPXODWRU
- LQGHSHQGHQWUHYLHZVDQGDXGLWV
+30 LV D FDWDO\VW IRU FRUUHFWLYH DFWLRQV RYHU WKH OLIH RI WKH SODQW WKH &2/ DSSOLFDQW
PDQDJHVLWVRZQFRUUHFWLYHDFWLRQVSURJUDP
+30 LV D UHVSRQVLELOLW\ RI WKH &2/ DSSOLFDQW $Q +30 ,3 LV SURGXFHG DV SDUW RI WKH
1X6FDOH +)( SURJUDP DV JXLGDQFH IRU WKH &2/ DSSOLFDQW RYHU WKH OLIH RI WKH SODQW1R
LPSOHPHQWDWLRQSODQRU565LVVXEPLWWHGDVSDUWRIWKHGHVLJQFHUWLILFDWLRQDSSOLFDWLRQ
&RS\ULJKWE\1X6FDOH3RZHU//&
+XPDQ)DFWRUV(QJLQHHULQJ3URJUDP0DQDJHPHQW3ODQ
53 13
5HY
5HIHUHQFHV
6RXUFH'RFXPHQWV
861XFOHDU5HJXODWRU\&RPPLVVLRQ³+XPDQ)DFWRUV(QJLQHHULQJ3URJUDP
5HYLHZ0RGHO'185(*5HY1RYHPEHU
861XFOHDU5HJXODWRU\&RPPLVVLRQ³6WDQGDUG5HYLHZ3ODQIRUWKH5HYLHZRI
6DIHW\$QDO\VLV5HSRUWVIRU1XFOHDU3RZHU3ODQWV /:5(GLWLRQ+/-+XPDQ
)DFWRUV(QJLQHHULQJ 185(*&KDSWHU '5HYLVLRQ0DUFK
5HIHUHQFHG'RFXPHQWV
86&RGHRI)HGHUDO5HJXODWLRQV³&RQWHQWVRI$SSOLFDWLRQV 7HFKQLFDO
,QIRUPDWLRQ'6HFWLRQ I LLL 3DUW&KDSWHU,7LWOH³(QHUJ\'
&)5 I LLL
86&RGHRI)HGHUDO5HJXODWLRQV³&RQWHQWVRI$SSOLFDWLRQV 7HFKQLFDO
,QIRUPDWLRQ'6HFWLRQ D 3DUW&KDSWHU,7LWOH³(QHUJ\' &)5
D
86&RGHRI)HGHUDO5HJXODWLRQV³7UDLQLQJDQG4XDOLILFDWLRQVRI1XFOHDU3RZHU
3ODQW3HUVRQQHO'6HFWLRQ3DUW&KDSWHU7LWOH³(QHUJ\' &)5
86&RGHRI)HGHUDO5HJXODWLRQV³2SHUDWRUV¶/LFHQVHV'3DUW&KDSWHU,7LWOH
³(QHUJ\' &)5
1X6FDOH3RZHU//&1X6FDOH4XDOLW\0DQDJHPHQW3ODQ3/
1X6FDOH3RZHU//&1X6FDOH'HVLJQ&RQWURO1343
861XFOHDU5HJXODWRU\&RPPLVVLRQ³+XPDQ)DFWRUV(QJLQHHULQJ +)(
,QVLJKWVIRU$GYDQFHG5HDFWRUV%DVHG8SRQ2SHUDWLQJ([SHULHQFH'
185(*&5-DQXDU\
1X6FDOH3RZHU//&+XPDQ)DFWRUV(QJLQHHULQJ2SHUDWLQJ([SHULHQFH5HYLHZ
5HVXOWV6XPPDU\5HSRUW535HY$
1X6FDOH3RZHU//&+XPDQ)DFWRUV(QJLQHHULQJ)XQFWLRQDO5HTXLUHPHQWV
$QDO\VLVDQG)XQFWLRQ$OORFDWLRQ5HVXOWV6XPPDU\5HSRUW53
5HY$
1X6FDOH3RZHU//&+XPDQ)DFWRUV(QJLQHHULQJ7DVN$QDO\VLV5HVXOWV
6XPPDU\5HSRUW535HY$
1X6FDOH3RZHU//&+XPDQ)DFWRUV(QJLQHHULQJ6WDIILQJDQG4XDOLILFDWLRQV
5HVXOWV6XPPDU\5HSRUW535HY$
&RS\ULJKWE\1X6FDOH3RZHU//&
+XPDQ)DFWRUV(QJLQHHULQJ3URJUDP0DQDJHPHQW3ODQ
53 13
5HY
1X6FDOH3RZHU//&+XPDQ)DFWRUV(QJLQHHULQJ7UHDWPHQWRI,PSRUWDQW
+XPDQ$FWLRQV5HVXOWV6XPPDU\5HSRUW535HY$
1X6FDOH3RZHU//&+XPDQ6\VWHP,QWHUIDFH'HVLJQ5HVXOWV6XPPDU\
5HSRUW53 5HY$
7DEOH³+)('RFXPHQWVIRUWKH1X6FDOH'&' VLF $SSOLFDWLRQ'861XFOHDU
5HJXODWRU\&RPPLVVLRQ$SULO$JHQF\ZLGH'RFXPHQWV$FFHVVDQG
0DQDJHPHQW6\VWHP$FFHVVLRQ1XPEHU0/$
1X6FDOH3RZHU//&+XPDQ)DFWRUV9HULILFDWLRQDQG9DOLGDWLRQ,PSOHPHQWDWLRQ
3ODQ53 5HY
&RS\ULJKWE\1X6FDOH3RZHU//&
+XPDQ)DFWRUV(QJLQHHULQJ7DVN$QDO\VLV5HVXOWV6XPPDU\5HSRUW
5313
5HYLVLRQ
+XPDQ)DFWRUV(QJLQHHULQJ7DVN$QDO\VLV
5HVXOWV6XPPDU\5HSRUW
5HYLVLRQ
'RFNHW 352-
1X6FDOH3RZHU//&
1(&LUFOH%OYG6XLWH
&RUYDOOLV2UHJRQ
ZZZQXVFDOHSRZHUFRP
&RS\ULJKWE\1X6FDOH3RZHU//&
&RS\ULJKWE\1X6FDOH3RZHU//&
L
+XPDQ)DFWRUV(QJLQHHULQJ7DVN$QDO\VLV5HVXOWV6XPPDU\5HSRUW
5313
5HYLVLRQ
&217(176
$EVWUDFW
([HFXWLYH6XPPDU\
,QWURGXFWLRQ
3XUSRVH
6FRSH
$EEUHYLDWLRQVDQG'HILQLWLRQV
,PSOHPHQWDWLRQ
7DVN$QDO\VLV3URFHVV2YHUYLHZ
7DVN$QDO\VLV7HDP&RPSRVLWLRQDQG5HVSRQVLELOLWLHV
0HWKRGRORJ\
7DVN$QDO\VLV'HYHORSPHQW
7DVN6FUHHQLQJ,GHQWLILFDWLRQ
7DVN'HWHUPLQDWLRQ0HWKRGRORJ\
1RUPDO$EQRUPDO(PHUJHQF\DQG$ODUP5HVSRQVH3URFHGXUH7DVNV
6XUYHLOODQFH7HVW,QVSHFWLRQDQG0DLQWHQDQFH3URFHGXUH7DVNV
7DVNVZLWK3RWHQWLDOO\1HJDWLYH&RQVHTXHQFHV 1RW,GHQWLILHGDV
,PSRUWDQW+XPDQ$FWLRQV
2SHUDWLRQDO6HTXHQFH'LDJUDPV
'HWDLOHG7DVN1DUUDWLYHV
7LPH5HTXLUHGIRU3HUIRUPLQJ7DVNV
3HUVRQQHO5HTXLUHGIRU3HUIRUPLQJ7DVNV
7DVN6XSSRUW5HTXLUHPHQWV
7DVN&RQVLGHUDWLRQV
,QYHQWRU\RI$ODUPV&RQWUROVDQG'LVSOD\V
.QRZOHGJHDQG$ELOLWLHV,GHQWLILFDWLRQ
,WHUDWLYH1DWXUHRI7DVN$QDO\VLV
)XQFWLRQDO5HTXLUHPHQWV$QDO\VLVDQG)XQFWLRQ$OORFDWLRQDQG7DVN
$QDO\VLV'DWDEDVH
1HZ7DVN&ULWHULD
$QDO\VLVRI)HDVLELOLW\DQG5HOLDELOLW\IRU,PSRUWDQW+XPDQ$FWLRQV
6XPPDU\RI5HVXOWV
&RS\ULJKWE\1X6FDOH3RZHU//&
LY
+XPDQ)DFWRUV(QJLQHHULQJ7DVN$QDO\VLV5HVXOWV6XPPDU\5HSRUW
5313
5HYLVLRQ
^^
`` D F
)LJXUH 'DWDEDVHVWUXFWXUH
7DVN$QDO\VLV7HDP&RPSRVLWLRQDQG5HVSRQVLELOLWLHV
7$LVFRQGXFWHGDQGVXSSRUWHGE\DQH[SHULHQFHGWHDPWKDWLQFOXGHVLQSXWIURPWKH+)(
WHDP DQG IURP WKH V\VWHP HQJLQHHULQJ VDIHW\ DQDO\VLV DQG RSHUDWLRQV RUJDQL]DWLRQV
7KH TXDOLILFDWLRQV RI WKH +)( WHDP PHPEHUV DUH DV VWLSXODWHG LQ WKH 1X6FDOH +)(
SURJUDPPDQDJHPHQWSODQ 303 5HIHUHQFH
7KH 7$ WHDP OHDG DQG WKH UHPDLQGHU RI WKH WHDP DUH VHOHFWHG E\ WKH +)( VXSHUYLVRU
IURPWKH+)(WHDPPHPEHUV$VGHVFULEHGLQWKH+)(303WKH+)(VXSHUYLVRUKDVWKH
DXWKRULW\DQGRUJDQL]DWLRQDOSODFHPHQWWRUHDVRQDEO\HQVXUHWKDWWKHWDVNVDVVLJQHGWR
WKH7$SHUVRQQHOZKRGRQRWGLUHFWO\UHSRUWWRWKHVXSHUYLVRUDUHFRPSOHWHG
7KH7$WHDPLQFOXGHVD)5$)$ 7$GDWDEDVHFRRUGLQDWRU$VVLJQHGE\WKHWHDPOHDG
WKH GDWDEDVH FRRUGLQDWRU LV UHVSRQVLEOH IRU PDQDJLQJ WKH LQIRUPDWLRQ WKDW LV UHFRUGHG
VFUHHQHGUHYLHZHGDQGGLVSRVLWLRQHGLQWKH)5$)$ 7$GDWDEDVH
7KH 7$ WHDP LQFOXGHV VHYHUDO VHQLRU UHDFWRU RSHUDWRUV DQG RWKHU SHUVRQQHO ZLWK
VLJQLILFDQWH[SHULHQFHLQWKHRSHUDWLRQRIFRPPHUFLDOQXFOHDUSRZHUSODQWV
$ 7$ WHDP DQG 7$ WHDP OHDG DUH VHOHFWHG E\ WKH +)( VXSHUYLVRU IURP DYDLODEOH +)(
WHDPPHPEHUVWRFRQGXFW7$7KH7$WHDPOHDGLVUHVSRQVLEOHIRU
&RS\ULJKWE\1X6FDOH3RZHU//&
+XPDQ)DFWRUV(QJLQHHULQJ7DVN$QDO\VLV5HVXOWV6XPPDU\5HSRUW
5313
5HYLVLRQ
- RUJDQL]LQJWKH7$WHDP
- GLUHFWLQJWKHGHYHORSPHQWRIWKH)5$)$ 7$GDWDEDVH
- DVVLJQLQJWHDPPHPEHUUHVSRQVLELOLWLHV
- PDQDJLQJUHVRXUFHVDQGUHYLHZVFKHGXOH
- HQVXULQJ WKDW 7$ LVVXHV DUH FRPSOHWHG ZLWK VXSSRUWLQJ GRFXPHQWDWLRQ DQG HQWHUHG
LQWRKXPDQIDFWRUVHQJLQHHULQJLVVXHWUDFNLQJV\VWHP +)(,76 DVQHFHVVDU\
- SURGXFWLRQRIWKH)5$)$ 7$GDWDEDVHUHSRUWV
5HVSRQVLELOLWLHV RI 7$ WHDP PHPEHUV FRQGXFWLQJ WKH UHYLHZV DQG GLVSRVLWLRQ WKH
LQGLYLGXDOUHYLHZLWHPVLQFOXGH
- UHYLHZLQJ7$GRFXPHQWDWLRQIRULGHQWLILFDWLRQRI
DFFXUDF\RIWKHIXQFWLRQDOUHTXLUHPHQWVDQDO\VLV
WDVNGHWHUPLQDWLRQ
- UHYLHZLQJWKHGDWDEDVHDQGXVLQJUHSRUWVWRFURVVH[DPLQHWKHUHVXOWV
- FRQWLQXLQJUHYLVLRQVWRWKHGDWDDVQHFHVVDU\
7KH)5$)$DQG7$GDWDEDVHDGPLQLVWUDWRULVUHVSRQVLEOHIRUWKHIROORZLQJ
- HQVXULQJWKHGDWDLVSURSHUO\HQWHUHGLQWKHGDWDEDVH
- IRUPDWWLQJUXQQLQJUHSRUWVWRSURYLGHRXWSXWIURPWKHGDWDEDVH
7KH+)(WHDPLVUHVSRQVLEOHIRUVXSSRUWLQJWKHWDVNDQDO\VLV7KHTXDOLILFDWLRQVRIWKH
+)(WHDPPHPEHUVVXSSRUWLQJWKLV+)(SURJUDPHOHPHQWDUHVWLSXODWHGLQWKHFXUUHQW
1X6FDOH+)(303 5HIHUHQFH 7KH)5$)$ 7$GDWDEDVHFRRUGLQDWRUPDQDJHV
WKHLQIRUPDWLRQWKDWLVSXWLQWRVFUHHQHGUHYLHZHGDQGGLVSRVLWLRQHGLQWKH)5$)$
7$GDWDEDVH
&RS\ULJKWE\1X6FDOH3RZHU//&
+XPDQ)DFWRUV(QJLQHHULQJ7DVN$QDO\VLV5HVXOWV6XPPDU\5HSRUW
5313
5HYLVLRQ
0HWKRGRORJ\
7KH +)( SURJUDP LQFOXGHV 7$ DV SDUW RI D VHULHV RI DQDO\VHV WKDW UHOLHV SULPDULO\ RQ
GHVLJQ GRFXPHQWV VXEMHFW PDWWHU H[SHUWV 60( DQG RSHUDWLQJ H[SHULHQFH 7$ LV D
UHVRXUFHIRU6 4GHYHORSPHQWRI+6,SURFHGXUHVDQGWUDLQLQJSURJUDP)RUHIILFLHQF\
WKH WHDP FRQGXFWV WKH )5$)$ DQG 7$ LQ VHTXHQFH RU LQ SDUDOOHO GHSHQGLQJ RQ WKH
FRPSOH[LW\ RI WKH IXQFWLRQV DQG DVVRFLDWHG WDVNV :KHUH IXQFWLRQV DQG WDVNV DUH QRW
FRPSOH[KDYHORZVDIHW\VLJQLILFDQFHRUDUHQRWH[SHFWHGWRYDU\VLJQLILFDQWO\IURPKRZ
RWKHU FRPPHUFLDO QXFOHDU SRZHU SODQWV FRQGXFW WKHP WKH )5$ )$ DQG 7$ VHTXHQFH
PD\H[WHQGIXUWKHUWRLQFOXGHSUHOLPLQDU\GHYHORSPHQWRI+6,SURFHGXUHVDQGWUDLQLQJ
7KH7$PHWKRGRORJ\UHPDLQVWKHVDPHZKHWKHUFRQGXFWHGDORQHRUDVWKHILUVWVWHSLQD
VHULHV5LJLGVHTXHQFLQJLVQRWSUDFWLFDOIRU+)(DQDO\VHVDVWKHLWHUDWLYHQDWXUHRIERWK
WKHGHVLJQDQGWKH+)(SURFHVVQHFHVVLWDWHVVLJQLILFDQWIOH[LELOLW\)RUH[DPSOHQHZRU
PRGLILHGWDVNVLQWKHWDVNDQDO\VLVZRXOGUHTXLUHXSGDWLQJWKHIXQFWLRQDOORFDWLRQWDEOH
FRQYHUVHO\ FKDQJHV WR WKH IXQFWLRQ DOORFDWLRQ WDEOH DUH UHIOHFWHG LQ WKH WDVN DQDO\VLV
7KRVH FKDQJHV DUH PDGH RU WKH QHFHVVDU\ FKDQJHV EHFRPH +)( LVVXHV DQG DUH
WUDFNHGXVLQJ+)(,76
7DVN$QDO\VLV'HYHORSPHQW
7KHVWHSVHTXHQFHIRU7$GHYHORSPHQW UHIHUWR)LJXUH LVDVIROORZV
6FUHHQIRUDSSOLFDEOH,GHQWLI\WDVNV
'HYHORSGHWDLOHGWDVNQDUUDWLYH
'HFRPSRVHWDVNV
'HYHORSRSHUDWLRQDOVHTXHQFHGLDJUDP
9HULI\,+$V
,GHQWLI\WDVNDWWULEXWHV
,GHQWLI\KLJKZRUNORDGWDVNV
,GHQWLI\WDVNMRESRVLWLRQ
'HWHUPLQH.$V
'HILQHWDVNVXSSRUWUHTXLUHPHQWV
,GHQWLI\SHUIRUPDQFHVKDSLQJIDFWRUV DVVHVVZRUNORDG
'HWHUPLQH LQYHQWRU\ RI FRPSRQHQWV DODUPV GLVSOD\V DQG FRQWUROV WR VXSSRUW
DFFRPSOLVKPHQWRIWDVNV
2XWSXWWR+6,XVDELOLW\WHVWLQJFRQWUROURRPVWDIILQJSODQYDOLGDWLRQSURFHGXUHVDQG
WUDLQLQJ
0RGLILHGWDVNVRUQHZWDVNVDUHUHYLHZHGIRU7$GHYHORSPHQW
&RS\ULJKWE\1X6FDOH3RZHU//&
+XPDQ)DFWRUV(QJLQHHULQJ7DVN$QDO\VLV5HVXOWV6XPPDU\5HSRUW
5313
5HYLVLRQ
^^
`` D F
)LJXUH 7DVNDQDO\VLVIORZSDWK
&RS\ULJKWE\1X6FDOH3RZHU//&
+XPDQ)DFWRUV(QJLQHHULQJ7DVN$QDO\VLV5HVXOWV6XPPDU\5HSRUW
5313
5HYLVLRQ
7DVN6FUHHQLQJ,GHQWLILFDWLRQ
7DVNV WR EH DQDO\]HG UHSUHVHQW D UDQJH RI SODQW RSHUDWLQJ PRGHV LQFOXGLQJ VWDUWXS
QRUPDO RSHUDWLRQV ORZSRZHU DQG VKXWGRZQ FRQGLWLRQV WUDQVLHQW FRQGLWLRQV DEQRUPDO
FRQGLWLRQVHPHUJHQF\FRQGLWLRQVDQGVHYHUHDFFLGHQWFRQGLWLRQV
$OOWDVNVUHJDUGOHVVRIWKHLPSRUWDQFHDUHDQDO\]HGVRWKDWWKHIXOOH[WHQWRIWKHZRUN
ORDG FDQ EH GHWHUPLQHG 7KH([DPSOHV RI WDVNV WR EH DQDO\]HG LQFOXGH EXW DUH QRW
OLPLWHGWRWKHIROORZLQJ
- ,+$VGHWHUPLQHGWKURXJKWKHKXPDQUHOLDELOLW\SRUWLRQRIWKH35$DQGGHWHUPLQLVWLF
PHDQV HJ 7$$ '&$ 7$ IRU ,+$V DVVXPHV XVH RI WKH DODUPV FRQWUROV
GLVSOD\V DXWRPDWLRQ DQG SURFHGXUHV WKDW DUH QRUPDOO\ DYDLODEOH DQG RSHUDEOH
GXULQJWKHVFHQDULREHLQJDQDO\]HG
- WDVNV QRW LGHQWLILHG DV ,+$V WKURXJK SUREDELOLVWLF RU GHWHUPLQLVWLF PHDQV EXW ZKLFK
KDYHQHJDWLYHFRQVHTXHQFHVLISHUIRUPHGLQFRUUHFWO\
- WDVNVWKDWDUHLGHQWLILHGWREHQHZFRPSDUHGWRFXUUHQWO\RSHUDWLQJQXFOHDUSODQWV
- WDVNV WKDW ZKLOH QRW QHZ DUH SHUIRUPHG VLJQLILFDQWO\ GLIIHUHQWO\ IURP WKH FXUUHQWO\
RSHUDWLQJQXFOHDUSODQWV
- WDVNV UHODWHG WR PRQLWRULQJ DQG FRQWURO RI DXWRPDWHG V\VWHPV WKDW DUH LPSRUWDQW WR
SODQWVDIHW\DQGWKHXVHRIDXWRPDWHGVXSSRUWDLGVIRUSHUVRQQHOVXFKDVFRPSXWHU
EDVHGSURFHGXUH
- WDVNV UHODWHG WR LGHQWLI\LQJ WKH IDLOXUH RU GHJUDGDWLRQ RI DXWRPDWLRQ DQG
LPSOHPHQWLQJEDFNXSUHVSRQVHV
- WDVNV DQWLFLSDWHG WR LPSRVH KLJK GHPDQGV RQ SHUVRQQHO HJ DGPLQLVWUDWLYH WDVNV
WKDWFRQWULEXWHWRZRUNORDGDQGFKDOOHQJHDELOLW\WRPRQLWRUWKHSODQW
- WDVNV LPSRUWDQW WR SODQW VDIHW\ WKDW DUH XQGHUWDNHQ GXULQJ PDLQWHQDQFH WHVWV
LQVSHFWLRQVDQGVXUYHLOODQFHV
- WDVNVZLWKSRWHQWLDOFRQFHUQVIRUSHUVRQQHOVDIHW\
'HWHUPLQDWLRQ,GHQWLILFDWLRQRIWDVNVWREHDQDO\]HGLVSHUIRUPHGE\60(VRQWKHEDVLVRI
WKHLU H[SHULHQFH DW FXUUHQW RSHUDWLQJ QXFOHDU SODQWV 7KH SURFHVV W\SLFDOO\ LQFOXGHV
UHYLHZRIRSHUDWLQJH[SHULHQFHDQGDYDLODEOHV\VWHPGHVLJQPDWHULDO
7DVN'HWHUPLQDWLRQ0HWKRGRORJ\
1RUPDO$EQRUPDO(PHUJHQF\DQG$ODUP5HVSRQVH3URFHGXUH7DVNV
$OO WDVNV ZLWKLQ VFRSH DUH DQDO\]HG IRU QRUPDO DEQRUPDO DQG HPHUJHQF\ UHVSRQVH
RSHUDWLQJ SURFHGXUHV 7DVNV EDVHG RQ XVH RI RSHUDWLQJ SURFHGXUHV DUH DQDO\]HG LQ
JUHDWHUGHWDLOLQODWHULWHUDWLRQVDVWKHSODQWGHVLJQSURJUHVVHV3HUVRQQHOSHUIRUPLQJWKH
DQDO\VHV LQFOXGH IRUPHU RSHUDWRUV RI FRPPHUFLDO 86 QXFOHDU SRZHU SODQWV DQG RWKHU
60(V 3URFHGXUHV DUH QRW DYDLODEOH IRU LQLWLDO 7$ WKHUHIRUH WKH WDVNV DQDO\]HG DUH
&RS\ULJKWE\1X6FDOH3RZHU//&
+XPDQ)DFWRUV(QJLQHHULQJ7DVN$QDO\VLV5HVXOWV6XPPDU\5HSRUW
5313
5HYLVLRQ
EDVHGRQSURFHGXUHVIURPVLPLODUV\VWHPVDQGSURFHVVHV VHH6HFWLRQDQG
6HFWLRQH[DPSOHV
6XUYHLOODQFH7HVW,QVSHFWLRQDQG0DLQWHQDQFH3URFHGXUH7DVNV
7DVNVUHODWHGWRVXUYHLOODQFHWHVWLQVSHFWLRQDQGPDLQWHQDQFHSURFHGXUHVLQWKHPDLQ
FRQWURO URRP 0&5 SHUIRUPHG E\ WKH FRQWURO URRP VWDII DUH VFUHHQHG IRU
DSSOLFDELOLW\LGHQWLILHG +XPDQ HUURUV GXULQJ WKH SHUIRUPDQFH RI VXUYHLOODQFH WHVW
LQVSHFWLRQDQGPDLQWHQDQFHSURFHGXUHVPD\UHVXOWLQFRPSRQHQWVEHLQJLQDVWDWHWKDW
LQGXFHVDSODQWWUDQVLHQWRUWULJJHUVDSUHFXUVRUWRDSODQWWUDQVLHQW,QERWKFDVHVWKH
VXUYHLOODQFHWHVWLQVSHFWLRQDQGPDLQWHQDQFHDFWLRQVDUHVHOHFWHGIRUWDVNDQDO\VLVWR
LGHQWLI\ GHIHQVHV DJDLQVW WKHVH HUURUV 7KH SURFHVV LV LWHUDWLYH LQ QDWXUH DQG LV NHSW
FXUUHQWRYHUWKHSODQW¶VOLIHF\FOHIURPGHVLJQGHYHORSPHQWWKURXJKGHFRPPLVVLRQLQJ
6DIHW\UHODWHG VXUYHLOODQFH WHVW LQVSHFWLRQ DQG PDLQWHQDQFH WDVNV DUH VFUHHQHG
LQLGHQWLILHG 7R VHOHFW ZKLFK ULVN VLJQLILFDQW VXUYHLOODQFH WHVW LQVSHFWLRQ DQG
PDLQWHQDQFHWDVNVDUHWREHDQDO\]HGW7KH60(UHYLHZVWKHGHVLJQPDWHULDODYDLODEOH
LQFOXGLQJ V\VWHP GHVLJQ SDFNDJHV SLSLQJ DQG LQVWUXPHQW GLDJUDPV 3 ,'V ORJLF
GLDJUDPVDQGHOHFWULFDOVFKHPDWLFVIRUHDFKV\VWHPWKHWDVNLQYROYHVDQGGHWHUPLQHV
WKH WDVNV QHFHVVDU\ WR SHUIRUP WKH VXUYHLOODQFH WHVW LQVSHFWLRQ DQG PDLQWHQDQFH
IXQFWLRQVRIWKHV\VWHP6XUYHLOODQFHWHVWLQVSHFWLRQDQGPDLQWHQDQFHDFWLYLWLHVWKDWE\
60( MXGJPHQW KDYH FKDOOHQJHG RSHUDWLQJ FUHZV DW FXUUHQW FRPPHUFLDO 86 RSHUDWLQJ
QXFOHDUSODQWVRUZKLFKSRWHQWLDOO\LPSDFWWKHDELOLW\RID1X6FDOHSODQWRSHUDWLQJFUHZ
WRPDQDJHXSWRWZHOYHXQLWVLQRQHFRQWUROURRPDUHVHOHFWHGIRU7$
7KH 60( GRFXPHQWV WKH VDIHW\UHODWHG VXUYHLOODQFH WHVW LQVSHFWLRQ DQG PDLQWHQDQFH
DFWLYLWLHV IRU HDFK V\VWHP XVLQJ WKH WHFKQLFDO VSHFLILFDWLRQV DV WKH EDVLV 6\VWHPV DUH
GLVWULEXWHGDPRQJVHYHUDO60(VIRUWKLVVHOHFWLRQSURFHVV$Q60(ZKRGLGQRWFRQGXFW
WKHHYDOXDWLRQIRUDVSHFLILFV\VWHPUHYLHZVWKHUHVXOWVGRFXPHQWDWLRQIRUFRPSOHWHQHVV
DQGFRQILUPDWLRQRIWKHWDVNVHOHFWLRQV VHH6HFWLRQH[DPSOHV
7DVNVZLWK3RWHQWLDOO\1HJDWLYH&RQVHTXHQFHV 1RW,GHQWLILHGDV,PSRUWDQW+XPDQ
$FWLRQV
1HJDWLYH FRQVHTXHQFHV DUH GHILQHG DV DQ\ DFWLRQ WDVN RU FRQGLWLRQ WKDW SODFHV
SHUVRQQHOHTXLSPHQWRUWKHSODQWLQMHRSDUG\([DPSOHVLQFOXGH
- DFRQGLWLRQUHTXLULQJDQXQSODQQHGGRZQSRZHU
- DFRQGLWLRQUHTXLULQJDUHDFWRUWULSRULQLWLDWLRQRIHPHUJHQF\HTXLSPHQW
- DQHPHUJHQF\DFWLRQOHYHOGHFODUDWLRQ
- D FRQGLWLRQ WKDW SODFHV WKH SODQW LQ DQ XQSODQQHG WHFKQLFDO VSHFLILFDWLRQ DFWLRQ
VWDWHPHQWHQWU\WKDWUHTXLUHVSODQWVKXWGRZQ
- KHQ VHOHFWLQJ KXPDQ DFWLRQV WKDW DUH QRW LGHQWLILHG DV ,+$V EXW KDYH SRWHQWLDOO\
QHJDWLYHFRQVHTXHQFHV VXFKDVSUHFXUVRUVWRSODQWWUDQVLHQWV 60(VUHYLHZWKH2(5
WKH35$DQGXVHWKHLURZQH[SHULHQFH$FWLYLWLHVUHODWHGWRWUDQVLHQWVRU35$WKDWE\
&RS\ULJKWE\1X6FDOH3RZHU//&
+XPDQ)DFWRUV(QJLQHHULQJ7DVN$QDO\VLV5HVXOWV6XPPDU\5HSRUW
5313
5HYLVLRQ
^^
`` D F
)LJXUH 2SHUDWLRQDOVHTXHQFHGLDJUDPWDVNGHFRPSRVLWLRQH[DPSOH
'HWDLOHG7DVN1DUUDWLYHV
)RU WDVNV WKDW DUH VFUHHQHG LQLGHQWLILHG IRU 7$ D GHWDLOHG WDVN QDUUDWLYH LV ZULWWHQ 7KH
SXUSRVHRIWKHQDUUDWLYHLVWRSURYLGH
- DGHVFULSWLRQRIWKHREMHFWLYHVRIDVSHFLILFV\VWHP VRSHUDWRUWDVNV
- DQRYHUYLHZRIWKHDFWLYLWLHVSHUVRQQHODUHH[SHFWHGWRDFFRPSOLVKWRFRPSOHWHWKH
WDVN
- DGHVFULSWLRQRIDODUPVLQIRUPDWLRQFRQWUROVDQGWDVNVXSSRUWQHHGHGWRDFFRPSOLVK
WKHWDVN
- DEDVLFRXWOLQHRIWKHSURFHGXUHVWHSV
&RS\ULJKWE\1X6FDOH3RZHU//&
+XPDQ)DFWRUV(QJLQHHULQJ7DVN$QDO\VLV5HVXOWV6XPPDU\5HSRUW
5313
5HYLVLRQ
6XPPDU\RI5HVXOWV
7KHIXQFWLRQDOORFDWLRQVGHWHUPLQHGDVSDUWRIWKH+)(HOHPHQW)5$DQG)$SURYLGHWKH
IRXQGDWLRQIRU7$'HWDLOHGWDVNDQDO\VLVLVWKHIRXQGDWLRQIRUWKHGHYHORSPHQWRI
RSHUDWLQJSURFHGXUHVDQGWKHRSHUDWRUWUDLQLQJSURJUDP
7DVNDQDO\VLVDOORZVWKH+)(WHDPPHPEHUWRLGHQWLI\WDVNVDQGGLVWLQJXLVKEHWZHHQ
V\VWHPWDVNVSODQWUHODWHGWDVNVDODUPUHVSRQVHWDVNVDQGVXUYHLOODQFHWDVNV7KH
SURFHVVDOVRDVVLVWVWKHWHDPPHPEHULQGHWHUPLQLQJWKHMRESRVLWLRQ V UHVSRQVLEOHIRU
WKHWDVNV+6,LQYHQWRU\DQGWDVNDQGHOHPHQWDWWULEXWHV^^
`` D F
7KUHHLOOXVWUDWLYHV\VWHPH[DPSOHVDUHLQFOXGHGLQWKLVUHSRUW7KHV\VWHPVLQFOXGHGDUH
FKHPLFDO DQG YROXPH FRQWURO V\VWHP &9&6 '+56 DQG HPHUJHQF\ FRUH FRROLQJ
V\VWHP (&&6 7KHVH H[DPSOHV ZHUH FKRVHQ VLQFH &9&6 LV D FRPSOLFDWHG V\VWHP
KDV D VDIHW\ UHODWHG DQG ULVN VLJQLILFDQW IXQFWLRQ DQG FRQWDLQV DQ LPSRUWDQW KXPDQ
DFWLRQ WKDW LI LW IDLOV ZRXOG OHDG WR WKH QHHG WR SHUIRUP DQRWKHU ,+$ WR XQLVRODWH DQG
LQLWLDWH FRQWDLQPHQW LQMHFWLRQ YLD WKH FRQWDLQPHQW IORRGLQJ DQG GUDLQ V\VWHP &)'6
'+56 DQG (&&6 DUH UHODWLYHO\ VLPSOH V\VWHPV EXW KDYH VDIHW\UHODWHG DQG ULVN
VLJQLILFDQWIXQFWLRQV,QDGGLWLRQWRWKH7$UHVXOWVRIWKHWKUHHH[DPSOHV\VWHPVWKH7$
UHVXOWVRIWKHUHPDLQLQJ1X6FDOHV\VWHPVDUHDOVRDYDLODEOHLQWKHGDWDEDVH
6\VWHP7DVN$QDO\VLV5HVXOWV
$V GLVFXVVHG LQ 6HFWLRQ WDVNV DUH VHOHFWHGLGHQWLILHG IRU DQDO\VLV WKDW UHSUHVHQW D
UDQJH RI RSHUDWLQJ PRGHV IRU D PRGXOH SODQW LQFOXGLQJ VWDUWXS QRUPDO RSHUDWLRQV
ORZSRZHU DQG VKXWGRZQ FRQGLWLRQV WUDQVLHQW FRQGLWLRQV DEQRUPDO FRQGLWLRQV
HPHUJHQF\ FRQGLWLRQV DQG VHYHUH DFFLGHQW FRQGLWLRQV 6HYHUH DFFLGHQW FRQGLWLRQV
LQFOXGHWKRVHWKDWDIIHFWPXOWLSOHXQLWVVLPXOWDQHRXVO\
&RS\ULJKWE\1X6FDOH3RZHU//&
+XPDQ)DFWRUV(QJLQHHULQJ7DVN$QDO\VLV5HVXOWV6XPPDU\5HSRUW
5313
5HYLVLRQ
7DVNVDUHVHOHFWHGRQWKHEDVLVRIWKHVFUHHQLQJPHWKRGRORJ\GLVFXVVHGLQ6HFWLRQ
(YDOXDWLRQ RI WKH 35$ UHVXOWV LGHQWLILHG WZR ,+$V 5HIHUHQFH (YDOXDWLRQ RI WKH
GHWHUPLQLVWLFDQDO\VLVUHVXOWVLGHQWLILHGQR,+$V 5HIHUHQFH
^^
`` D F
&RS\ULJKWE\1X6FDOH3RZHU//&
+XPDQ)DFWRUV(QJLQHHULQJ7DVN$QDO\VLV5HVXOWV6XPPDU\5HSRUW
5313
5HYLVLRQ
^^
`` D F (&,
)LJXUH ([DPSOHRI&9&6DODUPUHVSRQVHSURFHGXUH
6XUYHLOODQFH7DVN'HWHUPLQDWLRQ5HVXOWV
7DVNV UHODWHG WR VXUYHLOODQFH WHVW LQVSHFWLRQ DQG PDLQWHQDQFH SURFHGXUHV DUH
VFUHHQHG IRU DSSOLFDELOLW\ RILGHQWLILHG IRU 7$ +XPDQ HUURUV GXULQJ WKH SHUIRUPDQFH RI
VXUYHLOODQFHWHVWDQGLQVSHFWLRQPD\UHVXOWLQFRPSRQHQWVEHLQJLQDVWDWHWKDWLQGXFHV
D SODQW WUDQVLHQW RU FDQ WULJJHU D SUHFXUVRU WR D SODQW WUDQVLHQW ,Q ERWK FDVHV WKH
VXUYHLOODQFH WHVW DQG LQVSHFWLRQ DFWLRQV DUH VHOHFWHG IRU WDVN DQDO\VLV WR LGHQWLI\
GHIHQVHVDJDLQVWWKHVHHUURUV
^^
`` D F
&RS\ULJKWE\1X6FDOH3RZHU//&
+XPDQ)DFWRUV(QJLQHHULQJ7DVN$QDO\VLV5HVXOWV6XPPDU\5HSRUW
5313
5HYLVLRQ
5HIHUHQFHV
6RXUFH'RFXPHQWV
861XFOHDU5HJXODWRU\&RPPLVVLRQ³+XPDQ)DFWRUV(QJLQHHULQJ3URJUDP
5HYLHZ0RGHO'185(*5HY
5HIHUHQFHG'RFXPHQWV
1X6FDOH+XPDQ)DFWRUV(QJLQHHULQJ3URJUDP0DQDJHPHQW3ODQ53
5HY
+XPDQ)DFWRUV(QJLQHHULQJ)XQFWLRQDO5HTXLUHPHQWV$QDO\VLVDQG)XQFWLRQ
$OORFDWLRQ5HVXOWV6XPPDU\5HSRUW53
&RQWURO5RRP6WDIILQJ3ODQ9DOLGDWLRQ5HVXOWV53
+XPDQ)DFWRUV(QJLQHHULQJ+XPDQ6\VWHP,QWHUIDFH5HVXOWV6XPPDU\5HSRUW
53
+XPDQ)DFWRUV(QJLQHHULQJ7UHDWPHQWRI,PSRUWDQW+XPDQ$FWLRQV5HVXOWV
6XPPDU\5HSRUW53
&RS\ULJKWE\1X6FDOH3RZHU//&
Response to Request for Additional Information Docket No.52-048 eRAI No.: 8805 Date of RAI Issue: 09/12/2017 NRC Question No.: 18-4 Question 2 Criteria 5.4 (2) in NUREG-0711 states that The applicant should describe the screening methodology used to select the tasks for analysis, based on criteria specifically established to determine whether analyzing a particular task is necessary.
The screening methodology used for task analysis TA is described in the HFE Program Management Plan (PMP); DCD Tier 2, Section 18.4.2.1; and also in the Task Analysis (TA)
Results Summary Report (RSR).
DCD Tier 2, Section 18.4.2.1 states that Determination of tasks to be analyzed is performed by subject matter experts on the basis of their experience at current operating nuclear plants. The process typically includes review of operating experience and available system design material.
Section 3.3.2 of the TA RSR states, To select which risk-significant surveillance, test, inspection, and maintenance tasks are to be analyzed, the SME reviews the design material available, including system design packages, piping and instrument diagrams (P&IDs), logic diagrams, and electrical schematics for each system the task involves activities that by SME judgment have challenged operating crews at current commercial U.S. operating nuclear plants, or which potentially impact the ability of a NuScale plant operating crew to manage up to twelve units in one control room, are selected for TA. An SME who did not conduct the evaluation for a specific system reviews the results documentation for completeness and confirmation of the task selections.
The staff understands that SME judgment (informed via personal experience, operating experience and plant design documents) is used to select the tasks that meet the criteria for a detailed TA. In addition, the staff understands that for surveillance, test, inspection, and maintenance tasks, a SME who did not conduct the evaluation for a specific system reviews the results documentation for completeness and confirmation of the task selections. Thus, some amount of agreement/peer checking is taking place for the task selection. However, it is not clear whether this agreement/peer-checking process is used for other task types (e.g., tasks with potentially negative consequences). The review process helps provide assurance that individual biases are accounted for as the threshold for inclusion or exclusion of tasks in a NuScale Nonproprietary
category may vary widely among SMEs, which could result in a non-comprehensive TA and have a negative impact on elements such as the HSI design that rely on the input from TA.
Please describe whether an agreement/peer checking process has been used for the selection of all tasks for TA and, if not, how individual bias has been accounted for to ensure that the results of the task analysis are repeatable and accurate. Please revise the application to include any additional information about the review process for tasks and how bias has been accounted for.
NuScale Response:
Detailed task analysis (TA) was performed for all identified tasks. Because all tasks were selected for detailed TA, there is no need for a peer checking process.
No further changes to the FSAR, HFE PMP, and the HFE TA RSR technical reports were made.
Impact on DCA:
There are no impacts to the DCA as a result of this response.
NuScale Nonproprietary
Affidavit of Zackary W. Rad, AF-1017-56885 NuScale Power, LLC 1100 NE Circle Blvd., Suite 200 Corvalis, Oregon 97330, Office: 541.360.0500, Fax: 541.207.3928 www.nuscalepower.com
NuScale Power, LLC AFFIDAVIT of Zackary W. Rad I, Zackary W. Rad, state as follows:
- 1. I am the Director, Regulatory Affairs of NuScale Power, LLC (NuScale), and as such, I have been specifically delegated the function of reviewing the information described in this Affidavit that NuScale seeks to have withheld from public disclosure, and am authorized to apply for its withholding on behalf of NuScale.
- 2. I am knowledgeable of the criteria and procedures used by NuScale in designating information as a trade secret, privileged, or as confidential commercial or financial information. This request to withhold information from public disclosure is driven by one or more of the following:
- a. The information requested to be withheld reveals distinguishing aspects of a process (or component, structure, tool, method, etc.) whose use by NuScale competitors, without a license from NuScale, would constitute a competitive economic disadvantage to NuScale.
- b. The information requested to be withheld consists of supporting data, including test data, relative to a process (or component, structure, tool, method, etc.), and the application of the data secures a competitive economic advantage, as described more fully in paragraph 3 of this Affidavit.
- c. Use by a competitor of the information requested to be withheld would reduce the competitor's expenditure of resources, or improve its competitive position, in the design, manufacture, shipment, installation, assurance of quality, or licensing of a similar product.
- d. The information requested to be withheld reveals cost or price information, production capabilities, budget levels, or commercial strategies of NuScale.
- e. The information requested to be withheld consists of patentable ideas.
- 3. Public disclosure of the information sought to be withheld is likely to cause substantial harm to NuScale's competitive position and foreclose or reduce the availability of profit-making opportunities. The accompanying Request for Additional Information response reveals distinguishing aspects about the methods and processes by which NuScale develops and implements its HFE elements.
NuScale has performed significant research and evaluation to develop a basis for this methods and processes and has invested significant resources, including the expenditure of a considerable sum of money.
The precise financial value of the information is difficult to quantify, but it is a key element of the design basis for a NuScale plant and, therefore, has substantial value to NuScale.
If the information were disclosed to the public, NuScale's competitors would have access to the information without purchasing the right to use it or having been required to undertake a similar expenditure of resources. Such disclosure would constitute a misappropriation of NuScale's intellectual property, and would deprive NuScale of the opportunity to exercise its competitive advantage to seek an adequate return on its investment.
AF-1017-56885
- 4. The information sought to be withheld is in the enclosed response to NRC Request for Additional Information No. 20, eRAI No. . The enclosure contains the designation "Proprietary" at the top of each page containing proprietary information. The information considered by NuScale to be proprietary is identified within double braces, "((" in the document.
- 5. The basis for proposing that the information be withheld is that NuScale treats the information as a trade secret, privileged, or as confidential commercial or financial information. NuScale relies upon the exemption from disclosure set forth in the Freedom of Information Act ("FOIA"), 5 USC § 552(b)(4), as well as exemptions applicable to the NRC under 10 CFR §§ 2.390(a)(4) and 9.17(a)(4).
- 6. Pursuant to the provisions set forth in 10 CFR § 2.390(b)(4), the following is provided for consideration by the Commission in determining whether the information sought to be withheld from public disclosure should be withheld:
- a. The information sought to be withheld is owned and has been held in confidence by NuScale.
- b. The information is of a sort customarily held in confidence by NuScale and, to the best of my knowledge and belief, consistently has been held in confidence by NuScale.
The procedure for approval of external release of such information typically requires review by the staff manager, project manager, chief technology officer or other equivalent authority, or the manager of the cognizant marketing function (or his delegate), for technical content, competitive effect, and determination of the accuracy of the proprietary designation. Disclosures outside NuScale are limited to regulatory bodies, customers and potential customers and their agents, suppliers, licensees, and others with a legitimate need for the information, and then only in accordance with appropriate regulatory provisions or contractual agreements to maintain confidentiality.
- c. The information is being transmitted to and received by the NRC in confidence.
- d. No public disclosure of the information has been made, and it is not available in public sources. All disclosures to third parties, including any required transmittals to NRC, have been made, or must be made, pursuant to regulatory provisions or contractual agreements that provide for maintenance of the information in confidence.
- e. Public disclosure of the information is likely to cause substantial harm to the competitive position of NuScale, taking into account the value of the information to NuScale, the amount of effort and money expended by NuScale in developing the information, and the difficulty others would have in acquiring or duplicating the information. The information sought to be withheld is part of NuScale's technology that provides NuScale with a competitive advantage over other firms in the industry.
NuScale has invested significant human and financial capital in developing this technology and NuScale believes it would be difficult for others to duplicate the technology without access to the information sought to be withheld. I declare under penalty of perjury that the foregoing is true and correct. Executed on10/31/2017. Zackary W W. Rad AF-1017-56885}}