ML15119A310: Difference between revisions

From kanterella
Jump to navigation Jump to search
(Created page by program invented by StriderTol)
(Created page by program invented by StriderTol)
 
(3 intermediate revisions by the same user not shown)
Line 2: Line 2:
| number = ML15119A310
| number = ML15119A310
| issue date = 04/02/2015
| issue date = 04/02/2015
| title = Seabrook - Miscellaneous Exam Material (Folder 1)
| title = Miscellaneous Exam Material (Folder 1)
| author name = Bryant R
| author name = Bryant R
| author affiliation = NextEra Energy Seabrook, LLC
| author affiliation = NextEra Energy Seabrook, LLC
Line 19: Line 19:


=Text=
=Text=
{{#Wiki_filter:f\.JE:<Tera WRITTEN EXAMINATION  
{{#Wiki_filter:f\.JE:<Tera ENE..BQX~                        WRITTEN EXAMINATION ITEM REVIEW                        Page 1 of 2
,. ,,, .. *"'"""' -NUCLEAR ITEM REVIEW Page 1 of 2 mrr Directions: (Refer to TR-AA-230-1004 SAT Implementation)
    ,. ,,,.. *"'"""' - NUCLEAR mrr Directions: (Refer to TR-AA-230-1004 SAT Implementation)
Complete this analysis for each question missed by 40% of the students.
Complete this analysis for each question missed by                 ~ 40% of the students.
Evaluation Title/Number:
Evaluation Title/Number:                                             2015 LOIT NRC exam Date the examination was administered:                               3/31/15 Number of questions on the examination:                               100 Number of questions that were missed by     ~ 30% of the 5
2015 LOIT NRC exam Date the examination was administered:
students:
3/31/15 Number of questions on the examination:
Number of students evaluated:                                         9 Number of students who failed the exam:                               0 Percent of students who failed the examination:                       0 Complete page 2 of this form.
100 Number of questions that were missed by 30% of the 5 students:
Indicate AR number(s) generated as a result of this analysis (or indicate "NONE"):
Number of students evaluated:
Review performed by:
9 Number of students who failed the exam: 0 Percent of students who failed the examination:
Date:
0 Complete page 2 of this form. Indicate AR number(s) generated as a result of this analysis (or indicate "NONE"): Review performed by: Date: Approved by:
Approved by:
Revision 1 i'Jr:-)<1*era'*  
TR-M-230-~.                    Revision 1
... WRITTEN EXAMINATION ITEM REVIEW ,. , """ NUClEAR Page 2 of 2 f
 
* FLEET EACH QUESTION THAT WAS MISSED 30% OF THE STUDENTS % of # of students Review Conclusions Comment Section Question students who missed the Include a comment for each Number who missed question ANO A. B. c. D. E. F. G. H. "NO" answer. If a corrective action is the question failed the exam generated, list the corrective action number on the front page. 11 54 0 [8]Y rg]Y rg]Y [8]Y [8]Y [8]Y [8]Y [8]Y ON ON ON ON ON ON ON ON 17 45 0 [8]Y rg]Y rg]Y [8]Y [8]Y IZ!Y IZ!Y IZ!Y ON ON ON ON ON ON ON ON 31 54 0 IZ!Y [8]Y [8]Y IZ!Y IZ!Y IZ!Y IZ!Y IZ!Y ON ON ON ON ON ON ON ON 61 33 0 IZ!Y IZ!Y IZ!Y IZ!Y IZ!Y IZ!Y IZ!Y IZ!Y ON ON ON ON ON ON ON ON DY DY DY DY IZ!Y IZ!Y IZ!Y IZ!Y This is a KIA based question from IZI N IZI N !ZIN ON ON ON ON the NRC exam. There is no 97 60 0 specific learning objective but it is a KIA match from random selection process for the exam. DY DY DY DY DY DY DY DY ON ON ON ON ON ON ON ON DY DY DY DY DY DY DY DY ON ON ON ON ON ON ON ON Review
i'Jr:-)<1*era'*
EN_&sect;_f=3.~ . .                                   WRITTEN EXAMINATION ITEM REVIEW                                                                       Page 2 of 2  f *
    ,. ,"""   NUClEAR FLEET
                            ~IST  EACH QUESTION THAT WAS MISSED                             BY~      30% OF THE STUDENTS Review Conclusions                                            Comment Section
                          % of     # of students Question             students   who missed the                                                                                   Include a comment for each Number           who missed     question ANO     A.       B.     c.       D.       E.       F.     G.       H.       "NO" answer. If a corrective action is the question failed the exam                                                                             generated, list the corrective action number on the front page.
[8]Y     rg]Y   rg]Y   [8]Y       [8]Y [8]Y [8]Y [8]Y 11            54              0 ON       ON ON ON ON ON ON ON
[8]Y     rg]Y   rg]Y   [8]Y       [8]Y     IZ!Y     IZ!Y     IZ!Y 17            45              0 ON       ON ON ON ON ON ON ON 31           54             0 IZ!Y     [8]Y   [8]Y   IZ!Y       IZ!Y     IZ!Y     IZ!Y     IZ!Y ON       ON ON ON ON ON ON ON 61           33             0 IZ!Y     IZ!Y   IZ!Y   IZ!Y       IZ!Y     IZ!Y     IZ!Y     IZ!Y ON       ON ON ON ON ON ON ON DY DY DY                 DY         IZ!Y     IZ!Y IZ!Y         IZ!Y This is a KIA based question from IZI N IZI N !ZIN         ~N        ON ON ON ON                         the NRC exam. There is no 97           60             0                                                                               specific learning objective but it is a KIA match from random selection process for the exam.
DY       DY     DY     DY         DY       DY       DY DY ON       ON ON ON ON ON ON ON DY       DY     DY     DY         DY       DY       DY       DY ON       ON ON ON ON ON ON ON Review


== Conclusions:==
== Conclusions:==
Review the question for each of the areas            A. Does the test question tie directly to the learning objective(s)?
identified in A through H and check a "Y" for "Yes" or "N" for "No" to    B. Is the test question at the same cognitive level as the tested objective(s)?
determine if there is a discrepancy with the question. For any 'NO'      C. Does the lesson plan/ instructor guide provide information to support the objective(s)?
response(s) to A-H, initiate a corrective action if needed to define      D. Is the training material content correct regarding the exam answer (that is, does the material support the answer or does it lead to an incorrect answer)?
the issues and document the corrective action number on the front E. Is there ONLY one correct answer provided on the exam?
page. Attach this form electronically to the corrective action (if        F. Does the exam answer key indicate the correct answer?
written) and file the paper copy with the exam key. One corrective        G. Does the test question meet the guidance in TR-AA-230-1002 SAT Design Phase?
action may be used to document multiple issues.                          H. Is this an acceptable test question per response of A-G (i.e. all 'YES' responses)?
Verify response to column H is 'YES' if no corrective action is indicated.
TR-AA-230-1004-F02, Revision 1
Standard Item Analysis Report On NRCl Version A Course#:      2013-2015 LOIT                                                      Instructor:
Course
==Title:==
2013-2015 LOIT                                                      Description 2013-2015 LOIT Day/Time:                                                                        TermNear:
Total Possible Points:        75.00          Median Score:                  69.33                  Highest Score:  73.00 Standard Deviation:          1.81            Mean Score:                    69.78                  Lowest Score:    67.00 Student in this group:        9              Reliability Coefficient (KR20): 0.01 Student Records Based On:    All Students Correct Group Responses    Point    Correct              Response Frequencies -
* indicates correct answer    Non No. Total    Upper27% Lower27% Biserial    Answer        A      B    c      D                                        Distractor 1      100.00%    100.00%  100.00%      0.00    B            0    *9    0      0                                    ACD 2      77.78%    100.00%    50.00%      0.52    D            0      0    2    *7                                    AB 3      100.00%    100.00%  100.00%      0.00    c            0      0  *9      0                                    ABD 4      100.00%    100.00%  100.00%      0.00    B            0    *9    0      0                                    ACD 5      66.67%      50.000/o  50.00%      0.17    B            0    *6    I      2                                    A 6      100.00%    100.00%  100.00%      0.00    c            0      0  *9      0                                    ABD 7      100.00%    100.00%  100.00%      0.00    B            0    *9    0      0                                    ACD 8      100.00%    100.00%  100.00%      0.00    c            0      0  *9      0                                    ABD 9      100.00%    100.00%  100.00%      0.00    A            *9      0    0      0                                    BCD 10    100.00% 100.00%      100.00%      0.00    c            0      0  *9      0                                    ABD 11      44.44%      0.00%    50.00%    -0.38    B            0    *4    1      4                                    A 12    100.00%    100.00%    100.00%      0.00    D            0      0    0    *9                                    ABC 13    100.00%    100.00%    100.00%      0.00    c            0      0  *9      0                                    ABD 14    100.00%    100.00%    100.000/o    0.00    A            *9      0    0      0                                    BCD 15      88.89%    100.00%    50.00%      0.54    A            *8      0    1      0                                    BD 16    100.00%    100.00%    100.00%      0.00    c            0      0  *9      0                                    ABD 17      55.56%    100.00%    50.00%      0.51    c            0      0  *5      4                                    AB 18    100.00%    100.00%    100.00%      0.00    c            0      0  *9      0                                    ABD 19    100.00%    100.00%    100.00%      0.00    A            *9      0    0      0                                    BCD 20    100.00%    100.00%    100.00%      0.00    c            0      0  *9      0                                    ABD 21    100.00%    100.00%    100.00%      0.00    B            0    *9    0      0                                    ACD 22    100.00%    100.00%    100.00%      0.00    c            0      0  *9      0                                    ABD 23      88.89%    100.00%    50.00%      0.54    D            0      1    0    *8                                    AC 24    100.00%    100.00%    100.00%      0.00    B            0    *9    0      0                                    ACD 25      88.89%    100.00%    50.00%      0.35    A            *8      1    0      0                                    CD 26    100.00%    100.00%    100.00%      0.00    B            0    *9    0      0                                    ACD 27    100.000/o  100.00%    100.00%      0.00    D            0      0    0    *9                                    ABC 28    100.00%    100.00%    100.00%      0.00    c            0      0  *9      0                                    ABD 29      77.78%    100.00%    50.00%      0.52    B            1    *7    1      0                                    D 30    100.00%    100.00%    100.00%      0.00    B            0    *9    0      0                                    ACD 31      44.44%    100.00%    50.00%      0.36    D            1      1    3    *4 32    100.00%    100.00%    100.00%      0.00    D            0      0    0    *9                                    ABC 33    100.00% 100.00%      100.00%      0.00    B            0    *9    0      0                                    ACD 34    100.00%    100.00%    100.00%      0.00    D            0      0    0    *9                                    ABC 35      88.89%    100.00%    100.00%    -0.04      c            1      0  *8      0                                    BD 36      77.78%    1(1').00%  100.00%      0.23    A            *7      1    0      1
* c 37    100.00%    100.00%    100.00%      0.00    D            0      0    0    *9                                    ABC 38    100.00%    100.00%    100.00%      0.00    B            0    *9    0      0                                    ACD Page I of2                                              03/31/15
Standard Item Analysis Report On NRCl Version A Course#:      2013-2015 LOIT                                                    Instructor:
Course
==Title:==
2013-2015 LOIT                                                      Description 2013-2015 LOIT Day/Time:                                                                        Term/Year:
Total Possible Points:        75.00          Median Score:                  69.33                  Highest Score:  73.00 Standard Deviation:          1.81            Mean Score:                    69.78                  Lowest Score:  67.00 Student in this group:        9              Reliability Coefficient (KR20): 0.01 Student Records Based On:    All Students Correct Group Responses    Point    Correct              Response Frequencies -
* indicates correct answer    Non No. Total    Upper27% Lower27% Biserial    Answer        A      B    c      D                                        Distractor 39    100.00%    100.00%  100.00%      0.00    D            0      0    0      *9                                  ABC 40    100.00%    100.00%  100.00%      0.00    c            0      0  *9      0                                  ABD 41    100.00%    100.00%  100.00%      0.00    B            0    *9    0      0                                  ACD 42    100.00&deg;/o 100.00%    100.00%      0.00    B            0    *9    0      0                                  ACD 43    100.00%    100.00%  100.00%      0.00    c            0      0  *9      0                                  ABD 44      77.78%      50.00%    50.00%    -0.21    B            0    *7    2      0                                  AD 45      77.78%      50.00%    50.00%    -0.07    B            0    *7    0      2                                  AC 46    100.00% 100.00%      100.00%      0.00    c            0      0  *9      0                                  ABD 47    100.00%    100.00%  100.00%      0.00    B            0    *9    0      0                                  ACD 48      88.89% 100.00%      100.00%    -0.04    D              1    0    0      *8                                  BC 49      88.89'1/o  100.00%  100.00%      0.15    A            *8      I    0      0                                  CD 50    100.00%    100.00%  100.00%      0.00    D            0      0    0      *9                                  ABC 51    100.00%    100.00%  100.00%      0.00    B            0    *9    0      0                                  ACD 52    100.00%    100.00%  100.00%      0.00    D            0      0    0      *9                                  ABC 53    100.00% 100.00%      100.00%      0.00    B            0    *9    0      0                                  ACD 54    100.00%    100.00%  100.00%      0.00    D            0      0    0      *9                                  ABC 55    100.00% 100.00%      100.00%      0.00    A            *9      0    0      0                                  BCD 56    100.00%    100.00%  100.00%      0.00    c            0      0  *9      0                                  ABD 57    100.00%    100.00%  100.00%      0.00    c            0      0  *9      0                                  ABD 58    100.00% 100.00%      100.00%      0.00    A            *9      0    0      0                                  BCD 59    100.00% 100.00%      100.00%      0.00    c            0      0  *9      0                                  ABD 60      77.78% 100.00%      100.00%    -0.21    A            *7      1    0      1                                  c 61      66.67% 100.00%        50.00%      0.30    D              1    0    2      *6                                  B 62    100.00%    100.00%  100.00%      0.00    D            0      0    0      *9                                  ABC 63    100.00% 100.00%      100.00%      0.00    B            0    *9    0      0                                  ACD 64      77.78% 100.00%      100.00%    -0.07    A            *7      1    0      1                                  c 65    100.00%    100.00%  100.00%      0.00    D            0      0    0      *9                                  ABC 66    100.00%    100.00%  100.00%      0.00    B            0    *9    0      0                                  ACD 67      88.89'1/o  100.00%  100.00%      0.15    D              1    0    0      *8                                  BC 68    100.00%    100.00%  100.00%      0.00    c            0      0  *9      0                                  ABD 69    100.00%    100.00%  100.00%      0.00    B            0    *9    0      0                                  ACD 70      88.89%    100.00%  100.00%      0.15    B            0    *8    1      0                                  AD 71      88.89%    100.00%  100.00%      0.15    B            0    *8    0      I                                  AC 72      88.89'1/o  100.00%    50.00%      0.54    c            0      0  *8      1                                  AB 73      88.89%    100.00%    50.00%      0.35    A            *8      1    0      0                                  CD 74    100.00%    100.00%  IOQ.00%      0.00    A            *9      0    0      0
* BCD 75      77.78%    100.00%    50.00%      0.38    B            0    *7    0      2                                  AC Page 2 of2                                            03/31115


Review the question for each of the areas A. Does the test question tie directly to the learning objective(s)?
Standard Item Analysis Report On NRCSRonll Version A Course#:        2013-2015 LOIT                                                      Instructor:
identified in A through H and check a "Y" for "Yes" or "N" for "No" to B. Is the test question at the same cognitive level as the tested objective(s)?
Course
determine if there is a discrepancy with the question.
 
For any 'NO' C. Does the lesson plan/ instructor guide provide information to support the objective(s)?
==Title:==
response(s) to A-H, initiate a corrective action if needed to define D. Is the training material content correct regarding the exam answer (that is, does the the issues and document the corrective action number on the front material support the answer or does it lead to an incorrect answer)? page. Attach this form electronically to the corrective action (if E. Is there ONLY one correct answer provided on the exam? F. Does the exam answer key indicate the correct answer? written) and file the paper copy with the exam key. One corrective G. Does the test question meet the guidance in TR-AA-230-1002 SAT Design Phase? action may be used to document multiple issues. H. Is this an acceptable test question per response of A-G (i.e. all 'YES' responses)?
2013-2015 LOIT                                                        Description 2013-2015 LOIT Day/Time:                                                                          TennNear:
Verify response to column H is 'YES' if no corrective action is indicated.
Total Possible Points:        25.00            Median Score:                    23.25                  Highest Score:  24.00 Standard Deviation:            0.75            Mean Score:                      23.20                  Lowest Score:  22.00 Student in this group:        5                Reliability Coefficient (KR20): 0.00 Student Records Based On:      All Students Correct Group Responses      Point    Correct              Response Frequencies -
TR-AA-230-1004-F02, Revision 1 Standard Item Analysis Report On NRCl Version A Course#: 2013-2015 LOIT Course Title: 2013-2015 LOIT Day/Time:
* indicates correct answer   Non No. Total    Upper27% Lower27% Biserial      Answer        A      B    c      D                                      Distractor 1        0.00%      0.00%      0.00%      0.00      x            0      5    0      0                                    ACD 2        0.00%      0.00%      0.00%      0.00      x            0      0    1      4                                    AB 3        0.00%      0.00%      0.00%    0.00      x            0      0    5      0                                    ABD 4        0.000/o    0.00%      0.00%     0.00     x            0      5    0      0                                    ACD 5        0.00%       0.00%     0.00%       0.00    x            0      3     1      1                                    A 6        0.000/o    0.00%       0.00%     0.00     x            0      0    5      0                                    ABD 7        0.00%       0.00%       0.00%     0.00     x            0      5     0      0                                    ACD 8        0.00%       0.00%       0.00%     0.00     x            0      0    5      0                                    ABD 9        0.00%       0.00%       0.00%     0.00     x              5    0    0      0                                    BCD 10      0.00%       0.00%       0.00%     0.00     x              0    0    5      0                                    ABD 11      0.00%       0.000/o    0.000/o    0.00     x              0    2    0      3                                    AC 12      0.00%       0.00%       0.00%     0.00     x            0      0    0      5                                    ABC 13      0.00%       0.00%     0.00%       0.00     x            0      0    5      0                                    ABD 14      0.00%       0.00%       0.00%     0.00     x              5    0    0      0                                    BCD 15      0.00%       0.00%       0.00%     0.00     x            4      0    1      0                                    BD 16      0.000/o    0.00%       0.00%     0.00    x              0    0    5      0                                    ABD 17      0.000/o    0.00%       0.00%     0.00     x              0    0    3      2                                    AB 18      0.00%       0.00%       0.00%     0.00    x              0    0    5      0                                    ABD 19      0.00%       0.00%       0.00%     0.00     x              5    0    0      0                                    BCD 20      0.00%       0.00%       0.00%     0.00     x              0    0    5      0                                    ABD 21      0.00%       0.00%       0.00%     0.00     x              0    5    0      0                                    ACD 22      0.00%       0.00%       0.00%     0.00     x              0    0    5      0                                    ABD 23      0.00%       0.00%       0.00%     0.00     x              0    1    0      4                                    AC 24      0.00%       0.00%       0.00%     0.00     x              0    5    0      0                                    ACD 25      0.00%       0.00%       0.00%     0.00     x              4    1    0      0                                   CD 26       0.00%       0.00%       0.00%     0.00     x              0    5    0      0                                    ACD 27       0.00%       0.00%       0.00%     0.00     x              0    0    0      5                                    ABC 28      0.00%       0.00%       0.00%     0.00     x              0    0    5      0                                    ABD 29      0.00%       0.00%       0.00%     0.00     x              1    3    1      0                                    D 30      0.00%       0.00%       0.00%     0.00    x              0    5    0      0                                    ACD 31      0.00%       0.00%       0.00%     0.00     x              0      1    0      4                                    AC 32      0.00%       0.00%       0.00%     0.00     x              0    0    0      5                                    ABC 33      0.00%       0.00%       0.00%     0.00     x              0    5    0      0                                    ACD 34      0.00%       0.00%       0.00%     0.00    x              0    0    0      5                                    ABC 35      0.00%       0.00%       0.00%     0.00     x              0    0    5      0                                    ABD 36      O.Q<>o/o    0.00%       0.00%     0.00     x              5    0    0    ,o                                    BCD 37      0.000/o    0.00%       0.00%      0.00    x              0    0    0      5                                    ABC 38      0.00%      0.00%      0.00%      0.00    x              0     5    0     0                                   ACD Page 1 of3                                              03/31/15
Total Possible Points: 75.00 Standard Deviation:
 
Student in this group: 1.81 9 Student Records Based On: All Students Correct Group Responses Point No. Total Upper27% Lower27% Biserial 1 100.00% 100.00% 100.00% 0.00 2 77.78% 100.00% 50.00% 0.52 3 100.00% 100.00% 100.00% 0.00 4 100.00% 100.00% 100.00% 0.00 5 66.67% 50.000/o 50.00% 0.17 6 100.00% 100.00% 100.00% 0.00 7 100.00% 100.00% 100.00% 0.00 8 100.00% 100.00% 100.00% 0.00 9 100.00% 100.00% 100.00% 0.00 10 100.00% 100.00% 100.00% 0.00 11 44.44% 0.00% 50.00% -0.38 12 100.00% 100.00% 100.00% 0.00 13 100.00% 100.00% 100.00% 0.00 14 100.00% 100.00% 100.000/o 0.00 15 88.89% 100.00% 50.00% 0.54 16 100.00% 100.00% 100.00% 0.00 17 55.56% 100.00% 50.00% 0.51 18 100.00% 100.00% 100.00% 0.00 19 100.00% 100.00% 100.00% 0.00 20 100.00% 100.00% 100.00% 0.00 21 100.00% 100.00% 100.00% 0.00 22 100.00% 100.00% 100.00% 0.00 23 88.89% 100.00% 50.00% 0.54 24 100.00% 100.00% 100.00% 0.00 25 88.89% 100.00% 50.00% 0.35 26 100.00% 100.00% 100.00% 0.00 27 100.000/o 100.00% 100.00% 0.00 28 100.00% 100.00% 100.00% 0.00 29 77.78% 100.00% 50.00% 0.52 30 100.00% 100.00% 100.00% 0.00 31 44.44% 100.00% 50.00% 0.36 32 100.00% 100.00% 100.00% 0.00 33 100.00% 100.00% 100.00% 0.00 34 100.00% 100.00% 100.00% 0.00 35 88.89% 100.00% 100.00% -0.04 36 77.78% 1(1').00%
Standard Item Analysis Report On NRCSRonll Version A Course#:      2013-2015 LOIT                                                      Instructor:
100.00% 0.23 37 100.00% 100.00% 100.00% 0.00 38 100.00% 100.00% 100.00% 0.00 Instructor:
Course
Description 2013-2015 LOIT TermNear:
 
Median Score: 69.33 Highest Score: Mean Score: 69.78 Lowest Score: Reliability Coefficient (KR20): 0.01 Correct Response Frequencies
==Title:==
-* indicates correct answer Answer A B c D B 0 *9 0 0 D 0 0 2 *7 c 0 0 *9 0 B 0 *9 0 0 B 0 *6 I 2 c 0 0 *9 0 B 0 *9 0 0 c 0 0 *9 0 A *9 0 0 0 c 0 0 *9 0 B 0 *4 1 4 D 0 0 0 *9 c 0 0 *9 0 A *9 0 0 0 A *8 0 1 0 c 0 0 *9 0 c 0 0 *5 4 c 0 0 *9 0 A *9 0 0 0 c 0 0 *9 0 B 0 *9 0 0 c 0 0 *9 0 D 0 1 0 *8 B 0 *9 0 0 A *8 1 0 0 B 0 *9 0 0 D 0 0 0 *9 c 0 0 *9 0 B 1 *7 1 0 B 0 *9 0 0 D 1 1 3 *4 D 0 0 0 *9 B 0 *9 0 0 D 0 0 0 *9 c 1 0 *8 0 A *7 1 0 1
2013-2015 LOIT                                                      Description 2013-2015 LOIT Day/Time:                                                                        TermNear:
* D 0 0 0 *9 B 0 *9 0 0 Page I of2 73.00 67.00 Non Distractor ACD AB ABD ACD A ABD ACD ABD BCD ABD A ABC ABD BCD BD ABD AB ABD BCD ABD ACD ABD AC ACD CD ACD ABC ABD D ACD ABC ACD ABC BD c ABC ACD 03/31/15 Standard Item Analysis Report On NRCl Version A Course#: 2013-2015 LOIT Course Title: 2013-2015 LOIT Day/Time:
Total Possible Points:        25.00          Median Score:                    23.25                  Highest Score:  24.00 Standard Deviation:          0.75            Mean Score:                      23.20                  Lowest Score:  22.00 Student in this group:        5              Reliability Coefficient (KR20): 0.00 Student Records Based On:    All Students Correct Group Responses    Point    Correct              Response Frequencies *
Total Possible Points: 75.00 Standard Deviation:
* indicates correct answer    Non No. Total    Upper27% Lower27% Biserial    Answer        A      B    c     D                                        Distractor 39      0.00%      0.00%      0.00%      0.00    x            0     0     0     5                                    ABC 40      0.000/o    0.00%      0.00%      0.00    x            0     0     5      0                                   ABD 41      0.000/o    0.00%      0.00%      0.00    x            0     5    0     0                                   ACD 42      0.00%      0.00%    0.00%      0.00    x            0     5    0     0                                   ACD 43      0.00%      0.00%    0.00%      0.00    x            0     0     5      0                                   ABD 44      0.000/o    0.00%    0.00%      0.00    x            0     3    2      0                                   AD 45      0.00%      0.00%    0.00%      0.00    x            0     3    0     2                                    AC 46      0.00%      0.00%    0.00%      0.00    x            0      0    5      0                                   ABD 47      0.00%      0.00%    0.00%      0.00     x            0      5    0      0                                    ACD 48      0.00%      0.00%      0.00%      0.00    x            0      0    0      5                                    ABC 49      0.00%      0.00%      0.00%    0.00      x            5      0    0      0                                    BCD 50      0.00%      0.00%      0.00%     0.00     x            0      0    0      5                                    ABC 51      0.00%     0.00%     0.00%    0.00     x            0      5    0      0                                    ACD 52      0.00%     0.00%     0.00%     0.00     x            0      0    0      5                                    ABC 53      0.00%     0.000/o   0.00%     0.00     x            0      5    0      0                                    ACD 54      0.00%      0.00%     0.00%     0.00     x            0      0    0      5                                    ABC 55      0.00%     0.00%     0.00%     0.00      x            5      0    0      0                                    BCD 56      0.00%     0.00%     0.00%     0.00     x            0      0    5      0                                    ABD 57      0.000/o    0.00%     0.00%     0.00     x            0      0    5      0                                    ABD 58      0.00%     0.00%     0.00%     0.00      x            5      0    0      0                                    BCD 59      0.000/o   0.00%     0.00%     0.00     x            0      0    5      0                                    ABD 60      0.00%      0.00%     0.00%     0.00     x            5      0    0      0                                    BCD 61      0.00%     0.00%     0.00%     0.00     x            0      0    1      4                                    AB 62      0.00%     0.00%     0.00%     0.00     x            0      0    0      5                                    ABC 63      0.00%     0.00%     0.00%     0.00     x            0      5    0      0                                    ACD 64      0.00%     0.00%     0.00%     0.00     x            4      1    0      0                                    CD 65      0.00%     0.00%     0.00%     0.00     x            0      0    0      5                                    ABC 66      0.00%     0.00%     0.00%     0.00     x            0      5    0      0                                    ACD 67      0.00%     0.00%     0.00%     0.00     x            0      0    0      5                                    ABC 68      0.00%     0.00%     0.00%     0.00     x            0      0    5      0                                    ABD 69      0.00%     0.00%     0.00%     0.00     x            0      5    0      0                                    ACD 70      0.00%     0.00%     0.00%     0.00      x            0      4    1      0                                    AD 71      0.00%     0.00%     0.00%     0.00     x            0      4    0      1                                    AC 72      0.000/o    0.00%     0.00%     0.00     x            0      0    4      1                                    AB 73      0.00%     0.00%     0.00%     0.00     x            4      I    0      0                                    CD 74      0.00%     0.0~      0.00%     0.00     x            5      0    0      0
1.81 Student in this group: 9 Student Records Based On: All Students Correct Group Responses Point No. Total Upper27% Lower27% Biserial 39 100.00% 100.00% 100.00% 0.00 40 100.00% 100.00% 100.00% 0.00 41 100.00% 100.00% 100.00% 0.00 42 100.00&deg;/o 100.00% 100.00% 0.00 43 100.00% 100.00% 100.00% 0.00 44 77.78% 50.00% 50.00% -0.21 45 77.78% 50.00% 50.00% -0.07 46 100.00% 100.00% 100.00% 0.00 47 100.00% 100.00% 100.00% 0.00 48 88.89% 100.00% 100.00% -0.04 49 88.89'1/o 100.00% 100.00% 0.15 50 100.00% 100.00% 100.00% 0.00 51 100.00% 100.00% 100.00% 0.00 52 100.00% 100.00% 100.00% 0.00 53 100.00% 100.00% 100.00% 0.00 54 100.00% 100.00% 100.00% 0.00 55 100.00% 100.00% 100.00% 0.00 56 100.00% 100.00% 100.00% 0.00 57 100.00% 100.00% 100.00% 0.00 58 100.00% 100.00% 100.00% 0.00 59 100.00% 100.00% 100.00% 0.00 60 77.78% 100.00% 100.00% -0.21 61 66.67% 100.00% 50.00% 0.30 62 100.00% 100.00% 100.00% 0.00 63 100.00% 100.00% 100.00% 0.00 64 77.78% 100.00% 100.00% -0.07 65 100.00% 100.00% 100.00% 0.00 66 100.00% 100.00% 100.00% 0.00 67 88.89'1/o 100.00% 100.00% 0.15 68 100.00% 100.00% 100.00% 0.00 69 100.00% 100.00% 100.00% 0.00 70 88.89% 100.00% 100.00% 0.15 71 88.89% 100.00% 100.00% 0.15 72 88.89'1/o 100.00% 50.00% 0.54 73 88.89% 100.00% 50.00% 0.35 74 100.00% 100.00% IOQ.00% 0.00 75 77.78% 100.00% 50.00% 0.38 Median Score: Mean Score: Instructor:
* BCD 75      0.00%     0.00%      0.00%     0.00     x            0      3    0     2                                    AC 76    100.00%   100.00%   100.00%     0.00     A            *5      0    0     0                                   BCD Page 2 of3                                              03/31/15
Description 2013-2015 LOIT Term/Year:
 
69.33 69.78 Highest Score: Lowest Score: Reliability Coefficient (KR20): 0.01 Correct Response Frequencies
Standard Item Analysis Report On NRCSRonll Version A Course#:      2013-2015 LOIT                                                    Instructor:
-* indicates correct answer Answer A B c D D 0 0 0 *9 c 0 0 *9 0 B 0 *9 0 0 B 0 *9 0 0 c 0 0 *9 0 B 0 *7 2 0 B 0 *7 0 2 c 0 0 *9 0 B 0 *9 0 0 D 1 0 0 *8 A *8 I 0 0 D 0 0 0 *9 B 0 *9 0 0 D 0 0 0 *9 B 0 *9 0 0 D 0 0 0 *9 A *9 0 0 0 c 0 0 *9 0 c 0 0 *9 0 A *9 0 0 0 c 0 0 *9 0 A *7 1 0 1 D 1 0 2 *6 D 0 0 0 *9 B 0 *9 0 0 A *7 1 0 1 D 0 0 0 *9 B 0 *9 0 0 D 1 0 0 *8 c 0 0 *9 0 B 0 *9 0 0 B 0 *8 1 0 B 0 *8 0 I c 0 0 *8 1 A *8 1 0 0 A *9 0 0 0
Course
* B 0 *7 0 2 Page 2 of2 73.00 67.00 Non Distractor ABC ABD ACD ACD ABD AD AC ABD ACD BC CD ABC ACD ABC ACD ABC BCD ABD ABD BCD ABD c B ABC ACD c ABC ACD BC ABD ACD AD AC AB CD BCD AC 03/31115 Standard Item Analysis Report On NRCSRonll Version A Course#: 2013-2015 LOIT Course Title: 2013-2015 LOIT Day/Time:
 
Total Possible Points: Standard Deviation:
==Title:==
Student in this group: 25.00 0.75 5 Student Records Based On: All Students Correct Group Responses Point No. Total Upper27% Lower27% Biserial 1 0.00% 0.00% 0.00% 0.00 2 0.00% 0.00% 0.00% 0.00 3 0.00% 0.00% 0.00% 0.00 4 0.000/o 0.00% 0.00% 0.00 5 0.00% 0.00% 0.00% 0.00 6 0.000/o 0.00% 0.00% 0.00 7 0.00% 0.00% 0.00% 0.00 8 0.00% 0.00% 0.00% 0.00 9 0.00% 0.00% 0.00% 0.00 10 0.00% 0.00% 0.00% 0.00 11 0.00% 0.000/o 0.000/o 0.00 12 0.00% 0.00% 0.00% 0.00 13 0.00% 0.00% 0.00% 0.00 14 0.00% 0.00% 0.00% 0.00 15 0.00% 0.00% 0.00% 0.00 16 0.000/o 0.00% 0.00% 0.00 17 0.000/o 0.00% 0.00% 0.00 18 0.00% 0.00% 0.00% 0.00 19 0.00% 0.00% 0.00% 0.00 20 0.00% 0.00% 0.00% 0.00 21 0.00% 0.00% 0.00% 0.00 22 0.00% 0.00% 0.00% 0.00 23 0.00% 0.00% 0.00% 0.00 24 0.00% 0.00% 0.00% 0.00 25 0.00% 0.00% 0.00% 0.00 26 0.00% 0.00% 0.00% 0.00 27 0.00% 0.00% 0.00% 0.00 28 0.00% 0.00% 0.00% 0.00 29 0.00% 0.00% 0.00% 0.00 30 0.00% 0.00% 0.00% 0.00 31 0.00% 0.00% 0.00% 0.00 32 0.00% 0.00% 0.00% 0.00 33 0.00% 0.00% 0.00% 0.00 34 0.00% 0.00% 0.00% 0.00 35 0.00% 0.00% 0.00% 0.00 36 O.Q<>o/o 0.00% 0.00% 0.00 37 0.000/o 0.00% 0.00% 0.00 38 0.00% 0.00% 0.00% 0.00 Instructor:
2013-2015 LOIT                                                      Description 2013-2015 LOIT Day/Time:                                                                        Term/Year:
Description 2013-2015 LOIT TennNear:
Total Possible Points:        25.00           Median Score:                  23.25                  Highest Score:  24.00 Standard Deviation:          0.75            Mean Score:                    23.20                  Lowest Score:  22.00 Student in this group:        5              Reliability Coefficient (KR20): 0.00 Student Records Based On:    All Students Correct Group Responses    Point    Correct              Response Frequencies -
Median Score: 23.25 Highest Score: Mean Score: 23.20 Lowest Score: Reliability Coefficient (KR20): 0.00 Correct Response Frequencies
* indicates correct answer    Non No. Total    Upper27% Lower27% Biserial    Answer        A      B    c      D                                        Distractor 77    100.00% 100.00%       100.00%     0.00     c            0      0  *5      0                                    ABO 78    100.00% 100.00%       100.00%     0.00    B            0    *5    0      0                                    ACD 79    100.00%    100.00%  100.00%      0.00    B            0    *5    0      0                                   ACD 80      80.00% 100.00%        0.00%      0.80    B             1    *4    0     0                                   CD 81    100.00% 100.00%      100.00%      0.00    D            0       0   0     *5                                    ABC 82    100.00% 100.00%      100.00%      0.00    B             0     *5  0     0                                   ACD 83    100.00% 100.00%      100.00%      0.00    A            *5      0   0     0                                   BCD 84      80.00% 100.00%      100.00%      0.13    B             0     *4  1      0                                   AD 85    100.00% 100.00%      100.00%      0.00    D             0      0   0     *5                                    ABC 86    100.00% 100.00%      100.00%      0.00    A           *5      0   0     0                                   BCD 87      80.00%      0.00%  100.00%    -0.53    A            *4      I  0     0                                   CD 88      80.00% 100.00%          0.00%    0.80    c              0     1  *4      0                                   AD 89    100.00% 100.00%      100.00%      0.00    B              0     *5  0     0                                   ACD 90    100.00% 100.00%      100.00%      0.00    c             0     0 *5      0                                    ABD 91    100.00% 100.00%      100.00%      0.00    A           *5      0   0     0                                   BCD 92    100.00% 100.00%      100.00%      0.00    c              0      0  *5      0                                   ABD 93    100.00% 100.00%      100.00%      0.00    D             0     0   0     *5                                    ABC 94      80.00%    100.00%  100.00%    -0.53    A           *4      1   0     0                                   CD 95      80.00% 100.00%      100.00%      0.13    c             0     0 *4      1                                   AB 96    100.00% 100.00"A. 100.00%      0.00    A           *5      0   0     0                                   BCD 97      40.00%    100.00%      0.00%    0.87    B              2     *2   0      1                                    c 98    100.00% 100.00%      100.00%      0.00     A            *5      0  0      0                                    BCD 99    100.00% 100.00%      100.00%      0.00    B             0    *5  0      0                                    ACD 10    100.00% 100.00%      100.00%      0.00    D              0      0  0    *5                                    ABC Page 3 of3                                            03/31115
-* indicates correct answer Answer A B c D x 0 5 0 0 x 0 0 1 4 x 0 0 5 0 x 0 5 0 0 x 0 3 1 1 x 0 0 5 0 x 0 5 0 0 x 0 0 5 0 x 5 0 0 0 x 0 0 5 0 x 0 2 0 3 x 0 0 0 5 x 0 0 5 0 x 5 0 0 0 x 4 0 1 0 x 0 0 5 0 x 0 0 3 2 x 0 0 5 0 x 5 0 0 0 x 0 0 5 0 x 0 5 0 0 x 0 0 5 0 x 0 1 0 4 x 0 5 0 0 x 4 1 0 0 x 0 5 0 0 x 0 0 0 5 x 0 0 5 0 x 1 3 1 0 x 0 5 0 0 x 0 1 0 4 x 0 0 0 5 x 0 5 0 0 x 0 0 0 5 x 0 0 5 0 x 5 0 0 ,o x 0 0 0 5 x 0 5 0 0 Page 1 of3 24.00 22.00 Non Distractor ACD AB ABD ACD A ABD ACD ABD BCD ABD AC ABC ABD BCD BD ABD AB ABD BCD ABD ACD ABD AC ACD CD ACD ABC ABD D ACD AC ABC ACD ABC ABD BCD ABC ACD 03/31/15 
 
' . Standard Item Analysis Report On NRCSRonll Version A Course#: 2013-2015 LOIT Course Title: 2013-2015 LOIT Day/Time:
2015 Written Exam questions and responses.
Total Possible Points: Standard Deviation:
Question    Student 5      *      , ' Question: What does pressure boundary mean?
25.00 0.75 Student in this group: 5 Student Records Based On: All Students Correct Group Responses Point No. Total Upper27% Lower27% Biserial 39 0.00% 0.00% 0.00% 0.00 40 0.000/o 0.00% 0.00% 0.00 41 0.000/o 0.00% 0.00% 0.00 42 0.00% 0.00% 0.00% 0.00 43 0.00% 0.00% 0.00% 0.00 44 0.000/o 0.00% 0.00% 0.00 45 0.00% 0.00% 0.00% 0.00 46 0.00% 0.00% 0.00% 0.00 47 0.00% 0.00% 0.00% 0.00 48 0.00% 0.00% 0.00% 0.00 49 0.00% 0.00% 0.00% 0.00 50 0.00% 0.00% 0.00% 0.00 51 0.00% 0.00% 0.00% 0.00 52 0.00% 0.00% 0.00% 0.00 53 0.00% 0.000/o 0.00% 0.00 54 0.00% 0.00% 0.00% 0.00 55 0.00% 0.00% 0.00% 0.00 56 0.00% 0.00% 0.00% 0.00 57 0.000/o 0.00% 0.00% 0.00 58 0.00% 0.00% 0.00% 0.00 59 0.000/o 0.00% 0.00% 0.00 60 0.00% 0.00% 0.00% 0.00 61 0.00% 0.00% 0.00% 0.00 62 0.00% 0.00% 0.00% 0.00 63 0.00% 0.00% 0.00% 0.00 64 0.00% 0.00% 0.00% 0.00 65 0.00% 0.00% 0.00% 0.00 66 0.00% 0.00% 0.00% 0.00 67 0.00% 0.00% 0.00% 0.00 68 0.00% 0.00% 0.00% 0.00 69 0.00% 0.00% 0.00% 0.00 70 0.00% 0.00% 0.00% 0.00 71 0.00% 0.00% 0.00% 0.00 72 0.000/o 0.00% 0.00% 0.00 73 0.00% 0.00% 0.00% 0.00 74 0.00%
Reply: Means pressure boundary of #2 seal.
0.00% 0.00 75 0.00% 0.00% 0.00% 0.00 76 100.00% 100.00% 100.00% 0.00 Median Score: Mean Score: Instructor:
8                  Question: Does this question assume this is how we operate now?
Description 2013-2015 LOIT TermNear:
Reply: Yes.
23.25 23.20 Highest Score: Lowest Score: Reliability Coefficient (KR20): 0.00 Correct Response Frequencies
14                Question: Should I assume normal controller alignemt?
*
Reply: Yes 16                Question: Answer A and C would both require the reactor to be tripped.
* indicates correct answer Answer A B c D x 0 0 0 5 x 0 0 5 0 x 0 5 0 0 x 0 5 0 0 x 0 0 5 0 x 0 3 2 0 x 0 3 0 2 x 0 0 5 0 x 0 5 0 0 x 0 0 0 5 x 5 0 0 0 x 0 0 0 5 x 0 5 0 0 x 0 0 0 5 x 0 5 0 0 x 0 0 0 5 x 5 0 0 0 x 0 0 5 0 x 0 0 5 0 x 5 0 0 0 x 0 0 5 0 x 5 0 0 0 x 0 0 1 4 x 0 0 0 5 x 0 5 0 0 x 4 1 0 0 x 0 0 0 5 x 0 5 0 0 x 0 0 0 5 x 0 0 5 0 x 0 5 0 0 x 0 4 1 0 x 0 4 0 1 x 0 0 4 1 x 4 I 0 0 x 5 0 0 0
A would be faster. Should we answer based on no operator action?
* x 0 3 0 2 A *5 0 0 0 Page 2 of3 24.00 22.00 Non Distractor ABC ABD ACD ACD ABD AD AC ABD ACD ABC BCD ABC ACD ABC ACD ABC BCD ABD ABD BCD ABD BCD AB ABC ACD CD ABC ACD ABC ABD ACD AD AC AB CD BCD AC BCD 03/31/15 Standard Item Analysis Report On NRCSRonll Version A Course#: 2013-2015 LOIT Course Title: 2013-2015 LOIT Day/Time:
Reply: I cannot give you any information.
Total Possible Points: Standard Deviation:
23                Question: Should IR level be in amps?
Student in this group: 25.00 0.75 5 Student Records Based On: All Students Correct Group Responses Point No. Total Upper27% Lower27% Biserial 77 100.00% 100.00% 100.00% 0.00 78 100.00% 100.00% 100.00% 0.00 79 100.00% 100.00% 100.00% 0.00 80 80.00% 100.00% 0.00% 0.80 81 100.00% 100.00% 100.00% 0.00 82 100.00% 100.00% 100.00% 0.00 83 100.00% 100.00% 100.00% 0.00 84 80.00% 100.00% 100.00% 0.13 85 100.00% 100.00% 100.00% 0.00 86 100.00% 100.00% 100.00% 0.00 87 80.00% 0.00% 100.00% -0.53 88 80.00% 100.00% 0.00% 0.80 89 100.00% 100.00% 100.00% 0.00 90 100.00% 100.00% 100.00% 0.00 91 100.00% 100.00% 100.00% 0.00 92 100.00% 100.00% 100.00% 0.00 93 100.00% 100.00% 100.00% 0.00 94 80.00% 100.00% 100.00% -0.53 95 80.00% 100.00% 100.00% 0.13 96 100.00% 100.00"A.
Reply: Correct as written.
100.00% 0.00 97 40.00% 100.00% 0.00% 0.87 98 100.00% 100.00% 100.00% 0.00 99 100.00% 100.00% 100.00% 0.00 10 100.00% 100.00% 100.00% 0.00
46                Question: What is the meaning of "current"?
* Median Score: Mean Score: Instructor:
Reply: Means all bulleted items has occurred and time is now.
Description 2013-2015 LOIT Term/Year:
44                Question: Should I assume its the controlling channel?
23.25 23.20 Highest Score: Lowest Score: Reliability Coefficient (KR20): 0.00 Correct Response Frequencies
Reply: Yes 45                Question: "5" Hg back pressure" is it absolute?
-* indicates correct answer Answer A B c D c 0 0 *5 0 B 0 *5 0 0 B 0 *5 0 0 B 1 *4 0 0 D 0 0 0 *5 B 0 *5 0 0 A *5 0 0 0 B 0 *4 1 0 D 0 0 0 *5 A *5 0 0 0 A *4 I 0 0 c 0 1 *4 0 B 0 *5 0 0 c 0 0 *5 0 A *5 0 0 0 c 0 0 *5 0 D 0 0 0 *5 A *4 1 0 0 c 0 0 *4 1 A *5 0 0 0 B 2 *2 0 1 A *5 0 0 0 B 0 *5 0 0 D 0 0 0 *5
Reply: Called NRC, Chris Lally. Decided to add A the Hg. (hgA) to indicate it is absolute. Made change to master exam. Wrote on white board and called attention to entire class.
* Page 3 of3 24.00 22.00 Non Distractor ABO ACD ACD CD ABC ACD BCD AD ABC BCD CD AD ACD ABD BCD ABD ABC CD AB BCD c BCD ACD ABC 03/31115 2015 Written Exam questions and responses.
97                 Question: Did rest of surveillance get completed. Cycling of PORV is part of RC-OT004. (Note, this is incorrect and was not told to student.)
Question Student # 5 * , ' Question:
What does pressure boundary mean? Reply: Means pressure boundary of #2 seal. 8 Question:
Does this question assume this is how we operate now? Reply: Yes. 14 Question:
Should I assume normal controller alignemt?
Reply: Yes 16 Question:
Answer A and C would both require the reactor to be tripped. A would be faster. Should we answer based on no operator action? Reply: I cannot give you any information.
23 Question:
Should IR level be in amps? Reply: Correct as written. 46 Question:
What is the meaning of "current"?
Reply: Means all bulleted items has occurred and time is now. 44 Question:
Should I assume its the controlling channel? Reply: Yes 45 Question:
"5" Hg back pressure" is it absolute?
Reply: Called NRC, Chris Lally. Decided to add A the Hg. (hgA) to indicate it is absolute.
Made change to master exam. Wrote on white board and called attention to entire class. 97 Question:
Did rest of surveillance get completed.
Cycling of PORV is part of RC-OT004. (Note, this is incorrect and was not told to student.)
Reply: Called NRC, Chris Lally. Decided to tel student that they have all information required.
Reply: Called NRC, Chris Lally. Decided to tel student that they have all information required.
71 Question:
71                 Question: Is the time, 15 minutes, the time taken to install and remove the shielding?
Is the time, 15 minutes, the time taken to install and remove the shielding?
Reply: Answer question as written.
Reply: Answer question as written. 44 Question:
44                 Question: What does initially mean?
What does initially mean? Reply: Right then. 85 Question:
Reply: Right then.
How can you answer question without P fig 2 Reply: You have all the information you need. 87 Question:
85                 Question: How can you answer question without P fig 2 Reply: You have all the information you need.
Were you successful in E-2? Reply: If it were unsuccessful it would be specified.
87                 Question: Were you successful in E-2?
71 Question:
Reply: If it were unsuccessful it would be specified.
Is this after 6 or 12 seconds? Reply: Answer what's going to happen?
71                 Question: Is this after 6 or 12 seconds?
PROCTOR SRO RO SRO RO SRO RO SRO RO SRO era ENERGY-United States Nuclear Regulatory Commission December 22, 2014 Docket 50-443 SBK-L-14238 Attn: Mr. David Silk, Senior Operations Engineer/
Reply: Answer what's going to happen?
Chief Examiner 2100 Renaissance Blvd., Suite 100 King of Prussia, PA 19406-2713 Seabrook Station Submittal of Information for Operator Licensing Examinations SEABROOK In a letter dated October 1, 2014, NextEra Energy Seabrook, LLC was requested to furnish documentation to support the administration of Senior Reactor Operator and Reactor Operator licensing examinations scheduled for the week of March 23, 2015. The letter requested examination outlines be provided by January 8, 2015 with the written examinations, operating tests, and supporting reference materials identified in Attachment 3 of ES-201, "Initial Licensing Examination Process; Examination Security," to be furnished by February 6, 2015. Per your request, NextEra Energy Seabrook, LLC encloses the examination outlines as follows: ES-201-2, Examination Outline Quality Checklist ES-201-3, Examination Security Agreement ES-301-1, Administrative Topics ES-301-2, Control Room/In-Plant Systems Outline ES-301-5, Transient and Event Checklist ES-D-ls, Scenario Outlines ES-401-2, PWR Examination Outline ES-401-3, Generic Knowledge and Abilities Outline ES-401-4, Record of Rejected K/As Outline of Sampling Methodology and Kl A Suppression Report The information provided in the enclosure is confidential in nature and is not for release to the public NextEra Energy Seabrook, LLC. 626 Lafayette Rd, Seabrook, NH 03874 U.S. Nuclear Regulatory Commission SBK-L-14238/Page 2 Should you have any questions regarding this matter, please contact Mr. Ed Pigott, Operations Training Supervisor, at (603) 773-7192.
 
PROCTOR SRO RO         SRO RO SRO         RO SRO RO         SRO
 
era ENERGY-           SEABROOK December 22, 2014 Docket 50-443 SBK-L-14238 United States Nuclear Regulatory Commission Attn: Mr. David Silk, Senior Operations Engineer/ Chief Examiner 2100 Renaissance Blvd., Suite 100 King of Prussia, PA 19406-2713 Seabrook Station Submittal of Information for Operator Licensing Examinations In a letter dated October 1, 2014, NextEra Energy Seabrook, LLC was requested to furnish documentation to support the administration of Senior Reactor Operator and Reactor Operator licensing examinations scheduled for the week of March 23, 2015. The letter requested examination outlines be provided by January 8, 2015 with the written examinations, operating tests, and supporting reference materials identified in Attachment 3 of ES-201, "Initial Licensing Examination Process; Examination Security," to be furnished by February 6, 2015.
Per your request, NextEra Energy Seabrook, LLC encloses the examination outlines as follows:
ES-201-2, Examination Outline Quality Checklist ES-201-3, Examination Security Agreement ES-301-1, Administrative Topics ES-301-2, Control Room/In-Plant Systems Outline ES-301-5, Transient and Event Checklist ES-D-ls, Scenario Outlines ES-401-2, PWR Examination Outline ES-401-3, Generic Knowledge and Abilities Outline ES-401-4, Record of Rejected K/As Outline of Sampling Methodology and Kl A Suppression Report The information provided in the enclosure is confidential in nature and is not for release to the public NextEra Energy Seabrook, LLC.
626 Lafayette Rd, Seabrook, NH 03874
 
U.S. Nuclear Regulatory Commission SBK-L-14238/Page 2 Should you have any questions regarding this matter, please contact Mr. Ed Pigott, Operations Training Supervisor, at (603) 773-7192.
Sincerely, NextEra Energy Seabrook, LLC cc (Without Enclosures):
Sincerely, NextEra Energy Seabrook, LLC cc (Without Enclosures):
Document Control Desk D. Dorman, NRC Region I Administrator D. E. Jackson, NRC Region I Operations Branch Chief J. Lamb, NRC Project Manager, Project Directorate I-2 P. Cataldo, NRC Senior Resident Inspector era* ENERGV-United States Nuclear Regulatory Commission Attn: Mr. David Silk, Senior Operations Engineer/Chief Examiner 2100 Renaissance Blvd., Suite 100 King of Prussia, PA 19406-2713 Seabrook Station January 22, 2015 Docket 50-443 SBK-L-15011 Submittal of Information for Operator Licensing Examinations  
Document Control Desk D. Dorman, NRC Region I Administrator D. E. Jackson, NRC Region I Operations Branch Chief J. Lamb, NRC Project Manager, Project Directorate I-2 P. Cataldo, NRC Senior Resident Inspector
 
era*
ENERGV-           SEABROOK January 22, 2015 Docket 50-443 SBK-L-15011 United States Nuclear Regulatory Commission Attn: Mr. David Silk, Senior Operations Engineer/Chief Examiner 2100 Renaissance Blvd., Suite 100 King of Prussia, PA 19406-2713 Seabrook Station Submittal of Information for Operator Licensing Examinations


==Reference:==
==Reference:==
SBK-L-14238, Submittal oflnformation for Operator Licensing Examinations, December 22, 2014 In a letter dated October 1, 2014, NextEra Energy Seabrook, LLC was requested to furnish documentation to support the administration of Senior Reactor Operator and Reactor Operator licensing examinations scheduled for the week of March 23, 2015. The letter requested examination outlines be provided by January 8, 2015 with the written examinations, operating tests, and supporting reference materials identified in Attachment 3 of ES-201, "Initial Licensing Examination Process; Examination Security," to be furnished by February 6, 2015.
Per your request, NextEra Energy Seabrook, LLC encloses simulator scenarios, Job Performance Measures (JPMs) and related supporting reference materials identified in Attachment 3 of ES-201, "Initial Licensing Examination Process; Examination Security." The remaining requested information will be submitted by February 6, 2015.
The information provided in the enclosure is confidential in nature and is not for release to the public.
NextEra Energy Seabrook, LLC.
626 Lafayette Rd, Seabrook, NH 03874
U.S. Nuclear Regulatory Commission SBK-L-15011/Page 2 Should you have any questions regarding this matter, please contact Mr. Ed Pigott, Operations Training General Supervisor, at (603) 773-7192.
Sincerely, NextEra Energy Seabrook, LLC Licensing Manager cc (Without Enclosures):
Document Control Desk NRC Region I Administrator D. E. Jackson, NRC Region I Operations Branch Chief J. Lamb, NRC Project Manager, Project Directorate 1-2 NRC Senior Resident Inspector


SBK-L-14238, Submittal oflnformation for Operator Licensing Examinations, December 22, 2014 SEABROOK In a letter dated October 1, 2014, NextEra Energy Seabrook, LLC was requested to furnish documentation to support the administration of Senior Reactor Operator and Reactor Operator licensing examinations scheduled for the week of March 23, 2015. The letter requested examination outlines be provided by January 8, 2015 with the written examinations, operating tests, and supporting reference materials identified in Attachment 3 of ES-201, "Initial Licensing Examination Process; Examination Security," to be furnished by February 6, 2015. Per your request, NextEra Energy Seabrook, LLC encloses simulator scenarios, Job Performance Measures (JPMs) and related supporting reference materials identified in Attachment 3 of ES-201, "Initial Licensing Examination Process; Examination Security." The remaining requested information will be submitted by February 6, 2015. The information provided in the enclosure is confidential in nature and is not for release to the public. NextEra Energy Seabrook, LLC. 626 Lafayette Rd, Seabrook, NH 03874 U.S. Nuclear Regulatory Commission SBK-L-15011/Page 2 Should you have any questions regarding this matter, please contact Mr. Ed Pigott, Operations Training General Supervisor, at (603) 773-7192.
era' ENERGY~
cc (Without Enclosures):
SEABROOK February 5, 2015 Docket 50-443 SBK-L-15022 United States Nuclear Regulatory Commission Attn: Mr. David Silk, Senior Operations Engineer/Chief Examiner 2100 Renaissance Blvd., Suite 100 King of Prussia, PA 19406-2713 Seabrook Station Submittal of Information for Operator Licensing Examinations
Document Control Desk NRC Region I Administrator Sincerely, NextEra Energy Seabrook, LLC Licensing Manager D. E. Jackson, NRC Region I Operations Branch Chief J. Lamb, NRC Project Manager, Project Directorate 1-2 NRC Senior Resident Inspector era' United States Nuclear Regulatory Commission Attn: Mr. David Silk, Senior Operations Engineer/Chief Examiner 2100 Renaissance Blvd., Suite 100 King of Prussia, PA 19406-2713 Seabrook Station February 5, 2015 Docket 50-443 SBK-L-15022 Submittal of Information for Operator Licensing Examinations  


==References:==
==References:==
: 1. SBK-L-14238, Submittal oflnformation for Operator Licensing Examinations, December 22, 2014 2. SBK-L-15011, Submittal oflnformation for Operator Licensing Examinations, January 22, 2015 SEABROOK In a letter dated October 1, 2014, NextEra Energy Seabrook, LLC was requested to furnish documentation to support the administration of Senior Reactor Operator and Reactor Operator licensing examinations scheduled for the week of March 23, 2015. The letter requested examination outlines be provided by January 8, 2015 with the written examinations, operating tests, and supporting reference materials identified in Attachment 3 of ES-201, "Initial Licensing Examination Process; Examination Security," to be furnished by February 6, 2015. Per your request, NextEra Energy Seabrook, LLC encloses the written examinations and supporting reference materials identified in Attachment 3 of ES-201, "Initial Licensing Examination Process; Examination Security." The information provided in the enclosure is confidential in nature and is not for release to the public. NextEra Energy Seabrook, LLC. 626 Lafayette Rd, Seabrook, NH 03874 U.S. Nuclear Regulatory Commission SBK-L-15022/Page 2 Should you have any questions regarding this matter, please contact Mr. Ed Pigott, Operations Training General Supervisor, at (603) 773-7192.
: 1. SBK-L-14238, Submittal oflnformation for Operator Licensing Examinations, December 22, 2014
cc (Without Enclosures):
: 2. SBK-L-15011, Submittal oflnformation for Operator Licensing Examinations, January 22, 2015 In a letter dated October 1, 2014, NextEra Energy Seabrook, LLC was requested to furnish documentation to support the administration of Senior Reactor Operator and Reactor Operator licensing examinations scheduled for the week of March 23, 2015. The letter requested examination outlines be provided by January 8, 2015 with the written examinations, operating tests, and supporting reference materials identified in Attachment 3 of ES-201, "Initial Licensing Examination Process; Examination Security," to be furnished by February 6, 2015.
Document Control Desk NRC Region I Administrator Sincerely, NextEra Energy Seabrook, LLC ' . I I i ) ' I h,1 < ' . '-I ' Michael Ossing Licensing Manager D. E. Jackson, NRC Region I Operations Branch Chief J. Lamb, NRC Project Manager, Project Directorate I-2 NRC Senior Resident Inspector}}
Per your request, NextEra Energy Seabrook, LLC encloses the written examinations and supporting reference materials identified in Attachment 3 of ES-201, "Initial Licensing Examination Process; Examination Security."
The information provided in the enclosure is confidential in nature and is not for release to the public.
NextEra Energy Seabrook, LLC.
626 Lafayette Rd, Seabrook, NH 03874
 
U.S. Nuclear Regulatory Commission SBK-L-15022/Page 2 Should you have any questions regarding this matter, please contact Mr. Ed Pigott, Operations Training General Supervisor, at (603) 773-7192.
Sincerely, NextEra Energy Seabrook, LLC
                                                    . I~
I ~JJ&-
i ) '       I ~
h,1   <
                                        ' . '-       I   '
Michael Ossing Licensing Manager cc (Without Enclosures):
Document Control Desk NRC Region I Administrator D. E. Jackson, NRC Region I Operations Branch Chief J. Lamb, NRC Project Manager, Project Directorate I-2 NRC Senior Resident Inspector}}

Latest revision as of 13:22, 5 February 2020

Miscellaneous Exam Material (Folder 1)
ML15119A310
Person / Time
Site: Seabrook NextEra Energy icon.png
Issue date: 04/02/2015
From: Bryant R
NextEra Energy Seabrook
To: David Silk
Operations Branch I
Shared Package
ML14254A318 List:
References
TAC U01915
Download: ML15119A310 (15)
v • d • e


Text

f\.JE:<Tera ENE..BQX~ WRITTEN EXAMINATION ITEM REVIEW Page 1 of 2

,. ,,,.. *"'"""' - NUCLEAR mrr Directions: (Refer to TR-AA-230-1004 SAT Implementation)

Complete this analysis for each question missed by ~ 40% of the students.

Evaluation Title/Number: 2015 LOIT NRC exam Date the examination was administered: 3/31/15 Number of questions on the examination: 100 Number of questions that were missed by ~ 30% of the 5

students:

Number of students evaluated: 9 Number of students who failed the exam: 0 Percent of students who failed the examination: 0 Complete page 2 of this form.

Indicate AR number(s) generated as a result of this analysis (or indicate "NONE"):

Review performed by:

Date:

Approved by:

TR-M-230-~. Revision 1

i'Jr:-)<1*era'*

EN_§_f=3.~ . . WRITTEN EXAMINATION ITEM REVIEW Page 2 of 2 f *

,. ,""" NUClEAR FLEET

~IST EACH QUESTION THAT WAS MISSED BY~ 30% OF THE STUDENTS Review Conclusions Comment Section

% of # of students Question students who missed the Include a comment for each Number who missed question ANO A. B. c. D. E. F. G. H. "NO" answer. If a corrective action is the question failed the exam generated, list the corrective action number on the front page.

[8]Y rg]Y rg]Y [8]Y [8]Y [8]Y [8]Y [8]Y 11 54 0 ON ON ON ON ON ON ON ON

[8]Y rg]Y rg]Y [8]Y [8]Y IZ!Y IZ!Y IZ!Y 17 45 0 ON ON ON ON ON ON ON ON 31 54 0 IZ!Y [8]Y [8]Y IZ!Y IZ!Y IZ!Y IZ!Y IZ!Y ON ON ON ON ON ON ON ON 61 33 0 IZ!Y IZ!Y IZ!Y IZ!Y IZ!Y IZ!Y IZ!Y IZ!Y ON ON ON ON ON ON ON ON DY DY DY DY IZ!Y IZ!Y IZ!Y IZ!Y This is a KIA based question from IZI N IZI N !ZIN ~N ON ON ON ON the NRC exam. There is no 97 60 0 specific learning objective but it is a KIA match from random selection process for the exam.

DY DY DY DY DY DY DY DY ON ON ON ON ON ON ON ON DY DY DY DY DY DY DY DY ON ON ON ON ON ON ON ON Review

Conclusions:

Review the question for each of the areas A. Does the test question tie directly to the learning objective(s)?

identified in A through H and check a "Y" for "Yes" or "N" for "No" to B. Is the test question at the same cognitive level as the tested objective(s)?

determine if there is a discrepancy with the question. For any 'NO' C. Does the lesson plan/ instructor guide provide information to support the objective(s)?

response(s) to A-H, initiate a corrective action if needed to define D. Is the training material content correct regarding the exam answer (that is, does the material support the answer or does it lead to an incorrect answer)?

the issues and document the corrective action number on the front E. Is there ONLY one correct answer provided on the exam?

page. Attach this form electronically to the corrective action (if F. Does the exam answer key indicate the correct answer?

written) and file the paper copy with the exam key. One corrective G. Does the test question meet the guidance in TR-AA-230-1002 SAT Design Phase?

action may be used to document multiple issues. H. Is this an acceptable test question per response of A-G (i.e. all 'YES' responses)?

Verify response to column H is 'YES' if no corrective action is indicated.

TR-AA-230-1004-F02, Revision 1

Standard Item Analysis Report On NRCl Version A Course#: 2013-2015 LOIT Instructor:

Course

Title:

2013-2015 LOIT Description 2013-2015 LOIT Day/Time: TermNear:

Total Possible Points: 75.00 Median Score: 69.33 Highest Score: 73.00 Standard Deviation: 1.81 Mean Score: 69.78 Lowest Score: 67.00 Student in this group: 9 Reliability Coefficient (KR20): 0.01 Student Records Based On: All Students Correct Group Responses Point Correct Response Frequencies -

  • indicates correct answer Non No. Total Upper27% Lower27% Biserial Answer A B c D Distractor 1 100.00% 100.00% 100.00% 0.00 B 0 *9 0 0 ACD 2 77.78% 100.00% 50.00% 0.52 D 0 0 2 *7 AB 3 100.00% 100.00% 100.00% 0.00 c 0 0 *9 0 ABD 4 100.00% 100.00% 100.00% 0.00 B 0 *9 0 0 ACD 5 66.67% 50.000/o 50.00% 0.17 B 0 *6 I 2 A 6 100.00% 100.00% 100.00% 0.00 c 0 0 *9 0 ABD 7 100.00% 100.00% 100.00% 0.00 B 0 *9 0 0 ACD 8 100.00% 100.00% 100.00% 0.00 c 0 0 *9 0 ABD 9 100.00% 100.00% 100.00% 0.00 A *9 0 0 0 BCD 10 100.00% 100.00% 100.00% 0.00 c 0 0 *9 0 ABD 11 44.44% 0.00% 50.00% -0.38 B 0 *4 1 4 A 12 100.00% 100.00% 100.00% 0.00 D 0 0 0 *9 ABC 13 100.00% 100.00% 100.00% 0.00 c 0 0 *9 0 ABD 14 100.00% 100.00% 100.000/o 0.00 A *9 0 0 0 BCD 15 88.89% 100.00% 50.00% 0.54 A *8 0 1 0 BD 16 100.00% 100.00% 100.00% 0.00 c 0 0 *9 0 ABD 17 55.56% 100.00% 50.00% 0.51 c 0 0 *5 4 AB 18 100.00% 100.00% 100.00% 0.00 c 0 0 *9 0 ABD 19 100.00% 100.00% 100.00% 0.00 A *9 0 0 0 BCD 20 100.00% 100.00% 100.00% 0.00 c 0 0 *9 0 ABD 21 100.00% 100.00% 100.00% 0.00 B 0 *9 0 0 ACD 22 100.00% 100.00% 100.00% 0.00 c 0 0 *9 0 ABD 23 88.89% 100.00% 50.00% 0.54 D 0 1 0 *8 AC 24 100.00% 100.00% 100.00% 0.00 B 0 *9 0 0 ACD 25 88.89% 100.00% 50.00% 0.35 A *8 1 0 0 CD 26 100.00% 100.00% 100.00% 0.00 B 0 *9 0 0 ACD 27 100.000/o 100.00% 100.00% 0.00 D 0 0 0 *9 ABC 28 100.00% 100.00% 100.00% 0.00 c 0 0 *9 0 ABD 29 77.78% 100.00% 50.00% 0.52 B 1 *7 1 0 D 30 100.00% 100.00% 100.00% 0.00 B 0 *9 0 0 ACD 31 44.44% 100.00% 50.00% 0.36 D 1 1 3 *4 32 100.00% 100.00% 100.00% 0.00 D 0 0 0 *9 ABC 33 100.00% 100.00% 100.00% 0.00 B 0 *9 0 0 ACD 34 100.00% 100.00% 100.00% 0.00 D 0 0 0 *9 ABC 35 88.89% 100.00% 100.00% -0.04 c 1 0 *8 0 BD 36 77.78% 1(1').00% 100.00% 0.23 A *7 1 0 1
  • c 37 100.00% 100.00% 100.00% 0.00 D 0 0 0 *9 ABC 38 100.00% 100.00% 100.00% 0.00 B 0 *9 0 0 ACD Page I of2 03/31/15

Standard Item Analysis Report On NRCl Version A Course#: 2013-2015 LOIT Instructor:

Course

Title:

2013-2015 LOIT Description 2013-2015 LOIT Day/Time: Term/Year:

Total Possible Points: 75.00 Median Score: 69.33 Highest Score: 73.00 Standard Deviation: 1.81 Mean Score: 69.78 Lowest Score: 67.00 Student in this group: 9 Reliability Coefficient (KR20): 0.01 Student Records Based On: All Students Correct Group Responses Point Correct Response Frequencies -

  • indicates correct answer Non No. Total Upper27% Lower27% Biserial Answer A B c D Distractor 39 100.00% 100.00% 100.00% 0.00 D 0 0 0 *9 ABC 40 100.00% 100.00% 100.00% 0.00 c 0 0 *9 0 ABD 41 100.00% 100.00% 100.00% 0.00 B 0 *9 0 0 ACD 42 100.00°/o 100.00% 100.00% 0.00 B 0 *9 0 0 ACD 43 100.00% 100.00% 100.00% 0.00 c 0 0 *9 0 ABD 44 77.78% 50.00% 50.00% -0.21 B 0 *7 2 0 AD 45 77.78% 50.00% 50.00% -0.07 B 0 *7 0 2 AC 46 100.00% 100.00% 100.00% 0.00 c 0 0 *9 0 ABD 47 100.00% 100.00% 100.00% 0.00 B 0 *9 0 0 ACD 48 88.89% 100.00% 100.00% -0.04 D 1 0 0 *8 BC 49 88.89'1/o 100.00% 100.00% 0.15 A *8 I 0 0 CD 50 100.00% 100.00% 100.00% 0.00 D 0 0 0 *9 ABC 51 100.00% 100.00% 100.00% 0.00 B 0 *9 0 0 ACD 52 100.00% 100.00% 100.00% 0.00 D 0 0 0 *9 ABC 53 100.00% 100.00% 100.00% 0.00 B 0 *9 0 0 ACD 54 100.00% 100.00% 100.00% 0.00 D 0 0 0 *9 ABC 55 100.00% 100.00% 100.00% 0.00 A *9 0 0 0 BCD 56 100.00% 100.00% 100.00% 0.00 c 0 0 *9 0 ABD 57 100.00% 100.00% 100.00% 0.00 c 0 0 *9 0 ABD 58 100.00% 100.00% 100.00% 0.00 A *9 0 0 0 BCD 59 100.00% 100.00% 100.00% 0.00 c 0 0 *9 0 ABD 60 77.78% 100.00% 100.00% -0.21 A *7 1 0 1 c 61 66.67% 100.00% 50.00% 0.30 D 1 0 2 *6 B 62 100.00% 100.00% 100.00% 0.00 D 0 0 0 *9 ABC 63 100.00% 100.00% 100.00% 0.00 B 0 *9 0 0 ACD 64 77.78% 100.00% 100.00% -0.07 A *7 1 0 1 c 65 100.00% 100.00% 100.00% 0.00 D 0 0 0 *9 ABC 66 100.00% 100.00% 100.00% 0.00 B 0 *9 0 0 ACD 67 88.89'1/o 100.00% 100.00% 0.15 D 1 0 0 *8 BC 68 100.00% 100.00% 100.00% 0.00 c 0 0 *9 0 ABD 69 100.00% 100.00% 100.00% 0.00 B 0 *9 0 0 ACD 70 88.89% 100.00% 100.00% 0.15 B 0 *8 1 0 AD 71 88.89% 100.00% 100.00% 0.15 B 0 *8 0 I AC 72 88.89'1/o 100.00% 50.00% 0.54 c 0 0 *8 1 AB 73 88.89% 100.00% 50.00% 0.35 A *8 1 0 0 CD 74 100.00% 100.00% IOQ.00% 0.00 A *9 0 0 0
  • BCD 75 77.78% 100.00% 50.00% 0.38 B 0 *7 0 2 AC Page 2 of2 03/31115

Standard Item Analysis Report On NRCSRonll Version A Course#: 2013-2015 LOIT Instructor:

Course

Title:

2013-2015 LOIT Description 2013-2015 LOIT Day/Time: TennNear:

Total Possible Points: 25.00 Median Score: 23.25 Highest Score: 24.00 Standard Deviation: 0.75 Mean Score: 23.20 Lowest Score: 22.00 Student in this group: 5 Reliability Coefficient (KR20): 0.00 Student Records Based On: All Students Correct Group Responses Point Correct Response Frequencies -

  • indicates correct answer Non No. Total Upper27% Lower27% Biserial Answer A B c D Distractor 1 0.00% 0.00% 0.00% 0.00 x 0 5 0 0 ACD 2 0.00% 0.00% 0.00% 0.00 x 0 0 1 4 AB 3 0.00% 0.00% 0.00% 0.00 x 0 0 5 0 ABD 4 0.000/o 0.00% 0.00% 0.00 x 0 5 0 0 ACD 5 0.00% 0.00% 0.00% 0.00 x 0 3 1 1 A 6 0.000/o 0.00% 0.00% 0.00 x 0 0 5 0 ABD 7 0.00% 0.00% 0.00% 0.00 x 0 5 0 0 ACD 8 0.00% 0.00% 0.00% 0.00 x 0 0 5 0 ABD 9 0.00% 0.00% 0.00% 0.00 x 5 0 0 0 BCD 10 0.00% 0.00% 0.00% 0.00 x 0 0 5 0 ABD 11 0.00% 0.000/o 0.000/o 0.00 x 0 2 0 3 AC 12 0.00% 0.00% 0.00% 0.00 x 0 0 0 5 ABC 13 0.00% 0.00% 0.00% 0.00 x 0 0 5 0 ABD 14 0.00% 0.00% 0.00% 0.00 x 5 0 0 0 BCD 15 0.00% 0.00% 0.00% 0.00 x 4 0 1 0 BD 16 0.000/o 0.00% 0.00% 0.00 x 0 0 5 0 ABD 17 0.000/o 0.00% 0.00% 0.00 x 0 0 3 2 AB 18 0.00% 0.00% 0.00% 0.00 x 0 0 5 0 ABD 19 0.00% 0.00% 0.00% 0.00 x 5 0 0 0 BCD 20 0.00% 0.00% 0.00% 0.00 x 0 0 5 0 ABD 21 0.00% 0.00% 0.00% 0.00 x 0 5 0 0 ACD 22 0.00% 0.00% 0.00% 0.00 x 0 0 5 0 ABD 23 0.00% 0.00% 0.00% 0.00 x 0 1 0 4 AC 24 0.00% 0.00% 0.00% 0.00 x 0 5 0 0 ACD 25 0.00% 0.00% 0.00% 0.00 x 4 1 0 0 CD 26 0.00% 0.00% 0.00% 0.00 x 0 5 0 0 ACD 27 0.00% 0.00% 0.00% 0.00 x 0 0 0 5 ABC 28 0.00% 0.00% 0.00% 0.00 x 0 0 5 0 ABD 29 0.00% 0.00% 0.00% 0.00 x 1 3 1 0 D 30 0.00% 0.00% 0.00% 0.00 x 0 5 0 0 ACD 31 0.00% 0.00% 0.00% 0.00 x 0 1 0 4 AC 32 0.00% 0.00% 0.00% 0.00 x 0 0 0 5 ABC 33 0.00% 0.00% 0.00% 0.00 x 0 5 0 0 ACD 34 0.00% 0.00% 0.00% 0.00 x 0 0 0 5 ABC 35 0.00% 0.00% 0.00% 0.00 x 0 0 5 0 ABD 36 O.Q<>o/o 0.00% 0.00% 0.00 x 5 0 0 ,o BCD 37 0.000/o 0.00% 0.00% 0.00 x 0 0 0 5 ABC 38 0.00% 0.00% 0.00% 0.00 x 0 5 0 0 ACD Page 1 of3 03/31/15

Standard Item Analysis Report On NRCSRonll Version A Course#: 2013-2015 LOIT Instructor:

Course

Title:

2013-2015 LOIT Description 2013-2015 LOIT Day/Time: TermNear:

Total Possible Points: 25.00 Median Score: 23.25 Highest Score: 24.00 Standard Deviation: 0.75 Mean Score: 23.20 Lowest Score: 22.00 Student in this group: 5 Reliability Coefficient (KR20): 0.00 Student Records Based On: All Students Correct Group Responses Point Correct Response Frequencies *

  • indicates correct answer Non No. Total Upper27% Lower27% Biserial Answer A B c D Distractor 39 0.00% 0.00% 0.00% 0.00 x 0 0 0 5 ABC 40 0.000/o 0.00% 0.00% 0.00 x 0 0 5 0 ABD 41 0.000/o 0.00% 0.00% 0.00 x 0 5 0 0 ACD 42 0.00% 0.00% 0.00% 0.00 x 0 5 0 0 ACD 43 0.00% 0.00% 0.00% 0.00 x 0 0 5 0 ABD 44 0.000/o 0.00% 0.00% 0.00 x 0 3 2 0 AD 45 0.00% 0.00% 0.00% 0.00 x 0 3 0 2 AC 46 0.00% 0.00% 0.00% 0.00 x 0 0 5 0 ABD 47 0.00% 0.00% 0.00% 0.00 x 0 5 0 0 ACD 48 0.00% 0.00% 0.00% 0.00 x 0 0 0 5 ABC 49 0.00% 0.00% 0.00% 0.00 x 5 0 0 0 BCD 50 0.00% 0.00% 0.00% 0.00 x 0 0 0 5 ABC 51 0.00% 0.00% 0.00% 0.00 x 0 5 0 0 ACD 52 0.00% 0.00% 0.00% 0.00 x 0 0 0 5 ABC 53 0.00% 0.000/o 0.00% 0.00 x 0 5 0 0 ACD 54 0.00% 0.00% 0.00% 0.00 x 0 0 0 5 ABC 55 0.00% 0.00% 0.00% 0.00 x 5 0 0 0 BCD 56 0.00% 0.00% 0.00% 0.00 x 0 0 5 0 ABD 57 0.000/o 0.00% 0.00% 0.00 x 0 0 5 0 ABD 58 0.00% 0.00% 0.00% 0.00 x 5 0 0 0 BCD 59 0.000/o 0.00% 0.00% 0.00 x 0 0 5 0 ABD 60 0.00% 0.00% 0.00% 0.00 x 5 0 0 0 BCD 61 0.00% 0.00% 0.00% 0.00 x 0 0 1 4 AB 62 0.00% 0.00% 0.00% 0.00 x 0 0 0 5 ABC 63 0.00% 0.00% 0.00% 0.00 x 0 5 0 0 ACD 64 0.00% 0.00% 0.00% 0.00 x 4 1 0 0 CD 65 0.00% 0.00% 0.00% 0.00 x 0 0 0 5 ABC 66 0.00% 0.00% 0.00% 0.00 x 0 5 0 0 ACD 67 0.00% 0.00% 0.00% 0.00 x 0 0 0 5 ABC 68 0.00% 0.00% 0.00% 0.00 x 0 0 5 0 ABD 69 0.00% 0.00% 0.00% 0.00 x 0 5 0 0 ACD 70 0.00% 0.00% 0.00% 0.00 x 0 4 1 0 AD 71 0.00% 0.00% 0.00% 0.00 x 0 4 0 1 AC 72 0.000/o 0.00% 0.00% 0.00 x 0 0 4 1 AB 73 0.00% 0.00% 0.00% 0.00 x 4 I 0 0 CD 74 0.00% 0.0~ 0.00% 0.00 x 5 0 0 0
  • BCD 75 0.00% 0.00% 0.00% 0.00 x 0 3 0 2 AC 76 100.00% 100.00% 100.00% 0.00 A *5 0 0 0 BCD Page 2 of3 03/31/15

Standard Item Analysis Report On NRCSRonll Version A Course#: 2013-2015 LOIT Instructor:

Course

Title:

2013-2015 LOIT Description 2013-2015 LOIT Day/Time: Term/Year:

Total Possible Points: 25.00 Median Score: 23.25 Highest Score: 24.00 Standard Deviation: 0.75 Mean Score: 23.20 Lowest Score: 22.00 Student in this group: 5 Reliability Coefficient (KR20): 0.00 Student Records Based On: All Students Correct Group Responses Point Correct Response Frequencies -

  • indicates correct answer Non No. Total Upper27% Lower27% Biserial Answer A B c D Distractor 77 100.00% 100.00% 100.00% 0.00 c 0 0 *5 0 ABO 78 100.00% 100.00% 100.00% 0.00 B 0 *5 0 0 ACD 79 100.00% 100.00% 100.00% 0.00 B 0 *5 0 0 ACD 80 80.00% 100.00% 0.00% 0.80 B 1 *4 0 0 CD 81 100.00% 100.00% 100.00% 0.00 D 0 0 0 *5 ABC 82 100.00% 100.00% 100.00% 0.00 B 0 *5 0 0 ACD 83 100.00% 100.00% 100.00% 0.00 A *5 0 0 0 BCD 84 80.00% 100.00% 100.00% 0.13 B 0 *4 1 0 AD 85 100.00% 100.00% 100.00% 0.00 D 0 0 0 *5 ABC 86 100.00% 100.00% 100.00% 0.00 A *5 0 0 0 BCD 87 80.00% 0.00% 100.00% -0.53 A *4 I 0 0 CD 88 80.00% 100.00% 0.00% 0.80 c 0 1 *4 0 AD 89 100.00% 100.00% 100.00% 0.00 B 0 *5 0 0 ACD 90 100.00% 100.00% 100.00% 0.00 c 0 0 *5 0 ABD 91 100.00% 100.00% 100.00% 0.00 A *5 0 0 0 BCD 92 100.00% 100.00% 100.00% 0.00 c 0 0 *5 0 ABD 93 100.00% 100.00% 100.00% 0.00 D 0 0 0 *5 ABC 94 80.00% 100.00% 100.00% -0.53 A *4 1 0 0 CD 95 80.00% 100.00% 100.00% 0.13 c 0 0 *4 1 AB 96 100.00% 100.00"A. 100.00% 0.00 A *5 0 0 0 BCD 97 40.00% 100.00% 0.00% 0.87 B 2 *2 0 1 c 98 100.00% 100.00% 100.00% 0.00 A *5 0 0 0 BCD 99 100.00% 100.00% 100.00% 0.00 B 0 *5 0 0 ACD 10 100.00% 100.00% 100.00% 0.00 D 0 0 0 *5 ABC Page 3 of3 03/31115

2015 Written Exam questions and responses.

Question Student 5 * , ' Question: What does pressure boundary mean?

Reply: Means pressure boundary of #2 seal.

8 Question: Does this question assume this is how we operate now?

Reply: Yes.

14 Question: Should I assume normal controller alignemt?

Reply: Yes 16 Question: Answer A and C would both require the reactor to be tripped.

A would be faster. Should we answer based on no operator action?

Reply: I cannot give you any information.

23 Question: Should IR level be in amps?

Reply: Correct as written.

46 Question: What is the meaning of "current"?

Reply: Means all bulleted items has occurred and time is now.

44 Question: Should I assume its the controlling channel?

Reply: Yes 45 Question: "5" Hg back pressure" is it absolute?

Reply: Called NRC, Chris Lally. Decided to add A the Hg. (hgA) to indicate it is absolute. Made change to master exam. Wrote on white board and called attention to entire class.

97 Question: Did rest of surveillance get completed. Cycling of PORV is part of RC-OT004. (Note, this is incorrect and was not told to student.)

Reply: Called NRC, Chris Lally. Decided to tel student that they have all information required.

71 Question: Is the time, 15 minutes, the time taken to install and remove the shielding?

Reply: Answer question as written.

44 Question: What does initially mean?

Reply: Right then.

85 Question: How can you answer question without P fig 2 Reply: You have all the information you need.

87 Question: Were you successful in E-2?

Reply: If it were unsuccessful it would be specified.

71 Question: Is this after 6 or 12 seconds?

Reply: Answer what's going to happen?

PROCTOR SRO RO SRO RO SRO RO SRO RO SRO

era ENERGY- SEABROOK December 22, 2014 Docket 50-443 SBK-L-14238 United States Nuclear Regulatory Commission Attn: Mr. David Silk, Senior Operations Engineer/ Chief Examiner 2100 Renaissance Blvd., Suite 100 King of Prussia, PA 19406-2713 Seabrook Station Submittal of Information for Operator Licensing Examinations In a letter dated October 1, 2014, NextEra Energy Seabrook, LLC was requested to furnish documentation to support the administration of Senior Reactor Operator and Reactor Operator licensing examinations scheduled for the week of March 23, 2015. The letter requested examination outlines be provided by January 8, 2015 with the written examinations, operating tests, and supporting reference materials identified in Attachment 3 of ES-201, "Initial Licensing Examination Process; Examination Security," to be furnished by February 6, 2015.

Per your request, NextEra Energy Seabrook, LLC encloses the examination outlines as follows:

ES-201-2, Examination Outline Quality Checklist ES-201-3, Examination Security Agreement ES-301-1, Administrative Topics ES-301-2, Control Room/In-Plant Systems Outline ES-301-5, Transient and Event Checklist ES-D-ls, Scenario Outlines ES-401-2, PWR Examination Outline ES-401-3, Generic Knowledge and Abilities Outline ES-401-4, Record of Rejected K/As Outline of Sampling Methodology and Kl A Suppression Report The information provided in the enclosure is confidential in nature and is not for release to the public NextEra Energy Seabrook, LLC.

626 Lafayette Rd, Seabrook, NH 03874

U.S. Nuclear Regulatory Commission SBK-L-14238/Page 2 Should you have any questions regarding this matter, please contact Mr. Ed Pigott, Operations Training Supervisor, at (603) 773-7192.

Sincerely, NextEra Energy Seabrook, LLC cc (Without Enclosures):

Document Control Desk D. Dorman, NRC Region I Administrator D. E. Jackson, NRC Region I Operations Branch Chief J. Lamb, NRC Project Manager, Project Directorate I-2 P. Cataldo, NRC Senior Resident Inspector

era*

ENERGV- SEABROOK January 22, 2015 Docket 50-443 SBK-L-15011 United States Nuclear Regulatory Commission Attn: Mr. David Silk, Senior Operations Engineer/Chief Examiner 2100 Renaissance Blvd., Suite 100 King of Prussia, PA 19406-2713 Seabrook Station Submittal of Information for Operator Licensing Examinations

Reference:

SBK-L-14238, Submittal oflnformation for Operator Licensing Examinations, December 22, 2014 In a letter dated October 1, 2014, NextEra Energy Seabrook, LLC was requested to furnish documentation to support the administration of Senior Reactor Operator and Reactor Operator licensing examinations scheduled for the week of March 23, 2015. The letter requested examination outlines be provided by January 8, 2015 with the written examinations, operating tests, and supporting reference materials identified in Attachment 3 of ES-201, "Initial Licensing Examination Process; Examination Security," to be furnished by February 6, 2015.

Per your request, NextEra Energy Seabrook, LLC encloses simulator scenarios, Job Performance Measures (JPMs) and related supporting reference materials identified in Attachment 3 of ES-201, "Initial Licensing Examination Process; Examination Security." The remaining requested information will be submitted by February 6, 2015.

The information provided in the enclosure is confidential in nature and is not for release to the public.

NextEra Energy Seabrook, LLC.

626 Lafayette Rd, Seabrook, NH 03874

U.S. Nuclear Regulatory Commission SBK-L-15011/Page 2 Should you have any questions regarding this matter, please contact Mr. Ed Pigott, Operations Training General Supervisor, at (603) 773-7192.

Sincerely, NextEra Energy Seabrook, LLC Licensing Manager cc (Without Enclosures):

Document Control Desk NRC Region I Administrator D. E. Jackson, NRC Region I Operations Branch Chief J. Lamb, NRC Project Manager, Project Directorate 1-2 NRC Senior Resident Inspector

era' ENERGY~

SEABROOK February 5, 2015 Docket 50-443 SBK-L-15022 United States Nuclear Regulatory Commission Attn: Mr. David Silk, Senior Operations Engineer/Chief Examiner 2100 Renaissance Blvd., Suite 100 King of Prussia, PA 19406-2713 Seabrook Station Submittal of Information for Operator Licensing Examinations

References:

1. SBK-L-14238, Submittal oflnformation for Operator Licensing Examinations, December 22, 2014
2. SBK-L-15011, Submittal oflnformation for Operator Licensing Examinations, January 22, 2015 In a letter dated October 1, 2014, NextEra Energy Seabrook, LLC was requested to furnish documentation to support the administration of Senior Reactor Operator and Reactor Operator licensing examinations scheduled for the week of March 23, 2015. The letter requested examination outlines be provided by January 8, 2015 with the written examinations, operating tests, and supporting reference materials identified in Attachment 3 of ES-201, "Initial Licensing Examination Process; Examination Security," to be furnished by February 6, 2015.

Per your request, NextEra Energy Seabrook, LLC encloses the written examinations and supporting reference materials identified in Attachment 3 of ES-201, "Initial Licensing Examination Process; Examination Security."

The information provided in the enclosure is confidential in nature and is not for release to the public.

NextEra Energy Seabrook, LLC.

626 Lafayette Rd, Seabrook, NH 03874

U.S. Nuclear Regulatory Commission SBK-L-15022/Page 2 Should you have any questions regarding this matter, please contact Mr. Ed Pigott, Operations Training General Supervisor, at (603) 773-7192.

Sincerely, NextEra Energy Seabrook, LLC

. I~

I ~JJ&-

i ) ' I ~

h,1 <

' . '- I '

Michael Ossing Licensing Manager cc (Without Enclosures):

Document Control Desk NRC Region I Administrator D. E. Jackson, NRC Region I Operations Branch Chief J. Lamb, NRC Project Manager, Project Directorate I-2 NRC Senior Resident Inspector

Retrieved from "https://kanterella.com/w/index.php?title=ML15119A310&oldid=2448896"