ML14248A490: Difference between revisions
StriderTol (talk | contribs) (Created page by program invented by StriderTol) |
StriderTol (talk | contribs) (Created page by program invented by StriderTol) |
||
Line 17: | Line 17: | ||
=Text= | =Text= | ||
{{#Wiki_filter:ES-401 Written Examination Quality Checklist Date of Exam: | {{#Wiki_filter:ES-401 Written Examination Quality Checklist Date of Exam: | ||
Level: Rq 0 SAO 0 It em D escr iption 1. Questions and answers are technically accu r ate a nd app li cab le to the facility. | Level: Rq 0 SAO 0 It em D escr iption 1. Questions and answers are technically accu r ate a nd app li cab le to the facility. | ||
: 2. a. b. N R C K!As a re referenced for all questions. | : 2. a. b. N R C K!As a re referenced for all questions. | ||
F ac ility l earning objectives a r e referenced as available. | F ac ility l earning objectives a r e referenced as available. | ||
: 3. SAO questions are ap propriate in acco rd ance with Section D.2.d of ES-4 01 4. The samp l ing process was random a nd systema t ic (If more than 4 RO or 2 SAO quest i ons were r epeate d from th e last 2 NRC licensing exams , co nsult the NRR OL program office). 5. 6. 7. Question duplication f r om the license scree ning/audi t exam was controlled as ind ic at ed below (ch ec k the item ap pli es) and appears ap propriate: audit exa m was systematically and randomly developed; or audit exam was complet ed before the l icen se ex a m w as st arted; or ___ the exa minations were deve lo ped indep e nd e ntly; o r ..... the licensee c ertifies th a t there is no duplication; or __ ot her (explain) | : 3. SAO questions are ap propriate in acco rd ance with Section D.2.d of ES-4 01 4. The samp l ing process was random a nd systema t ic (If more than 4 RO or 2 SAO quest i ons were r epeate d from th e last 2 NRC licensing exams , co nsult the NRR OL program office). 5. 6. 7. Question duplication f r om the license scree ning/audi t exam was controlled as ind ic at ed below (ch ec k the item ap pli es) and appears ap propriate: audit exa m was systematically and randomly developed; or audit exam was complet ed before the l icen se ex a m w as st arted; or ___ the exa minations were deve lo ped indep e nd e ntly; o r ..... the licensee c ertifies th a t there is no duplication; or __ ot her (explain) | ||
Bank use m ee t s limits (no more than 75 pe r cent from the bank , a t least 10 percent new, an d the re st new or modified); | Bank use m ee t s limits (no more than 75 pe r cent from the bank , a t least 10 percent new, an d the re st new or modified); | ||
enter the ac tual RO I SAO-only q ue stion distribution(s) a t right. Memory C/A Between 50 and 60 percent o f th e questions on the RO exam a re written a t the c omprehension/ | enter the ac tual RO I SAO-only q ue stion distribution(s) a t right. Memory C/A Between 50 and 60 percent o f th e questions on the RO exam a re written a t the c omprehension/ | ||
ana ly sis leve l; the SAO exa m may exceed 60 percent if the r an domly se l ec t e d K!As supp ort the h i gher cogniti v e levels; en t e r t h e actua l RO I SAO question d i strib ut io n (s) at right. L(D 8. References/handouts provided do not gi v e away answers or aid in the elimination of distractors. | ana ly sis leve l; the SAO exa m may exceed 60 percent if the r an domly se l ec t e d K!As supp ort the h i gher cogniti v e levels; en t e r t h e actua l RO I SAO question d i strib ut io n (s) at right. L(D 8. References/handouts provided do not gi v e away answers or aid in the elimination of distractors. | ||
: 9. Quest ion content conforms with specif i c KIA sta tem e nts in the p r ev i ously a pprov ed e xamination outline and is appropria t e for tile tier t o which they a re assigned; deviations a re justified. | : 9. Quest ion content conforms with specif i c KIA sta tem e nts in the p r ev i ously a pprov ed e xamination outline and is appropria t e for tile tier t o which they a re assigned; deviations a re justified. | ||
: 10. Question psychometric quality and format meet th e gu id el ine s in ES Appendix B. 1 1. The e xam contains the required number o f one-point , multiple cho i ce items; the total i s correct and agrees with the value on t h e co v er sheet. --a t-1/k tJL*11 t) I ,. tl<t f a. A u thor , .. | : 10. Question psychometric quality and format meet th e gu id el ine s in ES Appendix B. 1 1. The e xam contains the required number o f one-point , multiple cho i ce items; the total i s correct and agrees with the value on t h e co v er sheet. --a t-1/k tJL*11 t) I ,. tl<t f a. A u thor , .. | ||
Name I /2 . 1: ofk{l.f f: | Name I /2 . 1: ofk{l.f f: | ||
/'}':t./ ---b. Facility Review<lr | /'}':t./ ---b. Facility Review<lr | ||
(*) c. NRC Chi e i E xa m i n e r (#) d. NRC R e gio na l Supervisor N ote: | (*) c. NRC Chi e i E xa m i n e r (#) d. NRC R e gio na l Supervisor N ote: | ||
* The fa cility r e v i ew e r's no t e xamin a tions. Initial b* c# he-* }Jij.l. I"\ A | * The fa cility r e v i ew e r's no t e xamin a tions. Initial b* c# he-* }Jij.l. I"\ A | ||
Line 34: | Line 34: | ||
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: | ES-401 Written Examination Quality Checklist Form ES-401-6 Facility: | ||
Date of Exam:&ftft<>!.o/ | Date of Exam:&ftft<>!.o/ | ||
Exam L e vel: RoD SR0[2g_ ../ Initial Item Description a b. 1. Questions and answers are technically accura te a nd a QJJiic able to the A<-2. a. NRC KJAs a re referenced for all questions. ¥ b. Facility le a rning objecti v es are referenced as available. | Exam L e vel: RoD SR0[2g_ ../ Initial Item Description a b. 1. Questions and answers are technically accura te a nd a QJJiic able to the A<-2. a. NRC KJAs a re referenced for all questions. ¥ b. Facility le a rning objecti v es are referenced as available. | ||
: 3. SA O questions are a ppropriate in accorda n ce with Section D.2.d of ES-401 qt.-4. The sampling process was random and systematic (If more than 4 RO or 2 SAO questions we r e repeated from the last 2 NRC licensing exams, consult the N RR OL _Qrogram office). 5. Question duplic a tion from the li cense screeni ng/audit exam was contro lled as indi ca ted below (c he c k th e item t hat a ppli es) an d a ppe a rs appropriate | : 3. SA O questions are a ppropriate in accorda n ce with Section D.2.d of ES-401 qt.-4. The sampling process was random and systematic (If more than 4 RO or 2 SAO questions we r e repeated from the last 2 NRC licensing exams, consult the N RR OL _Qrogram office). 5. Question duplic a tion from the li cense screeni ng/audit exam was contro lled as indi ca ted below (c he c k th e item t hat a ppli es) an d a ppe a rs appropriate | ||
: audit exam was systematica lly a nd r a ndomly deve l oped; or _the audit exam was completed before th e license exam was sta rt ed; or 4l _ th e examinations were developed independen tly; or _ the licensee certifies that there is no duplication | : audit exam was systematica lly a nd r a ndomly deve l oped; or _the audit exam was completed before th e license exam was sta rt ed; or 4l _ th e examinations were developed independen tly; or _ the licensee certifies that there is no duplication | ||
; or _other (ex plain) 6. B an k use meets limits (no more th an 75 percent Bank Modified New from the b a nk, at least 1 0 p e r c ent new, and the res t II | ; or _other (ex plain) 6. B an k use meets limits (no more th an 75 percent Bank Modified New from the b a nk, at least 1 0 p e r c ent new, and the res t II | ||
()!CJ 1'1 1§61; 11--new or modified); ente r the a ctua l R O I SA O-only question distribution(s) a t right. 7. Between 50 a nd 60 percent of the questions on the RO Memory C/A e xam are written at the compre h e nsion/ ana ly sis level; the SAO exam may e xceed 60 percent if the randomly /I It/ | ()!CJ 1'1 1§61; 11--new or modified); ente r the a ctua l R O I SA O-only question distribution(s) a t right. 7. Between 50 a nd 60 percent of the questions on the RO Memory C/A e xam are written at the compre h e nsion/ ana ly sis level; the SAO exam may e xceed 60 percent if the randomly /I It/ | ||
qt. se lected KJAs support the higher cognitive l evels; enter the act u a l RO I SAO question distribution(s) at r ight. 8. Referenc es/handouts provided do not give a w a y a nsw e rs tifiJ J 1.. or a id in th e e limi natio n of di s tractors. | qt. se lected KJAs support the higher cognitive l evels; enter the act u a l RO I SAO question distribution(s) at r ight. 8. Referenc es/handouts provided do not give a w a y a nsw e rs tifiJ J 1.. or a id in th e e limi natio n of di s tractors. | ||
: 9. Quest i on content conforms with specific KJA s t atements in the previously approv e d #'--exam ination outline and is ap propri a t e for the tier to wh i c h they are assig ned; de viations are jus ti fi e d. 1 0. Qu es tion p s ychom e tric quali ty and format m ee t the guide l i nes i n ES App e ndi x B. 'efP ;j'-11. T h e exa m co nta i ns th e r equired number of one-point , mu l tip l e choice it ems; 4t.. th e tot a l is corr ec t a nd a gr ees with th e v a lu e on the co v e r s h eet. tZ P?; N a m e I Signatu r e -,{ $.. D ate a. Author \>ta-r r. | : 9. Quest i on content conforms with specific KJA s t atements in the previously approv e d #'--exam ination outline and is ap propri a t e for the tier to wh i c h they are assig ned; de viations are jus ti fi e d. 1 0. Qu es tion p s ychom e tric quali ty and format m ee t the guide l i nes i n ES App e ndi x B. 'efP ;j'-11. T h e exa m co nta i ns th e r equired number of one-point , mu l tip l e choice it ems; 4t.. th e tot a l is corr ec t a nd a gr ees with th e v a lu e on the co v e r s h eet. tZ P?; N a m e I Signatu r e -,{ $.. D ate a. Author \>ta-r r. | ||
: b. Fac ility R e vi e w e r (*) ,.rl A 'f(IJ/t1 c. NRC Chief Exa m iner(#) ff4-J tV\D vn 1:b0 I !D,, .f /1<r/f/t d. NRC R eg i ona l Supervisor #f V" Note: | : b. Fac ility R e vi e w e r (*) ,.rl A 'f(IJ/t1 c. NRC Chief Exa m iner(#) ff4-J tV\D vn 1:b0 I !D,, .f /1<r/f/t d. NRC R eg i ona l Supervisor #f V" Note: | ||
* The facility re v iewer's initials/signa tur e are no t a ppli ca bl e for NRC-deve l oped examinations. # In dependent NRC re v ie w er initia l items in Co lumn " c"; chief exa mi ner co n c ur re n ce r eq uir e d.}} | * The facility re v iewer's initials/signa tur e are no t a ppli ca bl e for NRC-deve l oped examinations. # In dependent NRC re v ie w er initia l items in Co lumn " c"; chief exa mi ner co n c ur re n ce r eq uir e d.}} |
Revision as of 05:45, 28 April 2019
ML14248A490 | |
Person / Time | |
---|---|
Site: | Byron |
Issue date: | 06/13/2014 |
From: | Walton R K NRC/RGN-III/DRS/OLB |
To: | Exelon Generation Co |
Shared Package | |
ML14140A562 | List: |
References | |
Download: ML14248A490 (2) | |
Text
ES-401 Written Examination Quality Checklist Date of Exam:
Level: Rq 0 SAO 0 It em D escr iption 1. Questions and answers are technically accu r ate a nd app li cab le to the facility.
- 2. a. b. N R C K!As a re referenced for all questions.
F ac ility l earning objectives a r e referenced as available.
- 3. SAO questions are ap propriate in acco rd ance with Section D.2.d of ES-4 01 4. The samp l ing process was random a nd systema t ic (If more than 4 RO or 2 SAO quest i ons were r epeate d from th e last 2 NRC licensing exams , co nsult the NRR OL program office). 5. 6. 7. Question duplication f r om the license scree ning/audi t exam was controlled as ind ic at ed below (ch ec k the item ap pli es) and appears ap propriate: audit exa m was systematically and randomly developed; or audit exam was complet ed before the l icen se ex a m w as st arted; or ___ the exa minations were deve lo ped indep e nd e ntly; o r ..... the licensee c ertifies th a t there is no duplication; or __ ot her (explain)
Bank use m ee t s limits (no more than 75 pe r cent from the bank , a t least 10 percent new, an d the re st new or modified);
enter the ac tual RO I SAO-only q ue stion distribution(s) a t right. Memory C/A Between 50 and 60 percent o f th e questions on the RO exam a re written a t the c omprehension/
ana ly sis leve l; the SAO exa m may exceed 60 percent if the r an domly se l ec t e d K!As supp ort the h i gher cogniti v e levels; en t e r t h e actua l RO I SAO question d i strib ut io n (s) at right. L(D 8. References/handouts provided do not gi v e away answers or aid in the elimination of distractors.
- 9. Quest ion content conforms with specif i c KIA sta tem e nts in the p r ev i ously a pprov ed e xamination outline and is appropria t e for tile tier t o which they a re assigned; deviations a re justified.
- 10. Question psychometric quality and format meet th e gu id el ine s in ES Appendix B. 1 1. The e xam contains the required number o f one-point , multiple cho i ce items; the total i s correct and agrees with the value on t h e co v er sheet. --a t-1/k tJL*11 t) I ,. tl<t f a. A u thor , ..
Name I /2 . 1: ofk{l.f f:
/'}':t./ ---b. Facility Review<lr
(*) c. NRC Chi e i E xa m i n e r (#) d. NRC R e gio na l Supervisor N ote:
- The fa cility r e v i ew e r's no t e xamin a tions. Initial b* c# he-* }Jij.l. I"\ A
- fit-(ZUW f-t.-R\i.W # __
NRC initial items!:: Co lu mn " c"; chiHf e xa m iner concurre n ce r e q uir ed.========-=-
ES-401 Written Examination Quality Checklist Form ES-401-6 Facility:
Date of Exam:&ftft<>!.o/
Exam L e vel: RoD SR0[2g_ ../ Initial Item Description a b. 1. Questions and answers are technically accura te a nd a QJJiic able to the A<-2. a. NRC KJAs a re referenced for all questions. ¥ b. Facility le a rning objecti v es are referenced as available.
- 3. SA O questions are a ppropriate in accorda n ce with Section D.2.d of ES-401 qt.-4. The sampling process was random and systematic (If more than 4 RO or 2 SAO questions we r e repeated from the last 2 NRC licensing exams, consult the N RR OL _Qrogram office). 5. Question duplic a tion from the li cense screeni ng/audit exam was contro lled as indi ca ted below (c he c k th e item t hat a ppli es) an d a ppe a rs appropriate
- audit exam was systematica lly a nd r a ndomly deve l oped; or _the audit exam was completed before th e license exam was sta rt ed; or 4l _ th e examinations were developed independen tly; or _ the licensee certifies that there is no duplication
- or _other (ex plain) 6. B an k use meets limits (no more th an 75 percent Bank Modified New from the b a nk, at least 1 0 p e r c ent new, and the res t II
()!CJ 1'1 1§61; 11--new or modified); ente r the a ctua l R O I SA O-only question distribution(s) a t right. 7. Between 50 a nd 60 percent of the questions on the RO Memory C/A e xam are written at the compre h e nsion/ ana ly sis level; the SAO exam may e xceed 60 percent if the randomly /I It/
qt. se lected KJAs support the higher cognitive l evels; enter the act u a l RO I SAO question distribution(s) at r ight. 8. Referenc es/handouts provided do not give a w a y a nsw e rs tifiJ J 1.. or a id in th e e limi natio n of di s tractors.
- 9. Quest i on content conforms with specific KJA s t atements in the previously approv e d #'--exam ination outline and is ap propri a t e for the tier to wh i c h they are assig ned; de viations are jus ti fi e d. 1 0. Qu es tion p s ychom e tric quali ty and format m ee t the guide l i nes i n ES App e ndi x B. 'efP ;j'-11. T h e exa m co nta i ns th e r equired number of one-point , mu l tip l e choice it ems; 4t.. th e tot a l is corr ec t a nd a gr ees with th e v a lu e on the co v e r s h eet. tZ P?; N a m e I Signatu r e -,{ $.. D ate a. Author \>ta-r r.
- b. Fac ility R e vi e w e r (*) ,.rl A 'f(IJ/t1 c. NRC Chief Exa m iner(#) ff4-J tV\D vn 1:b0 I !D,, .f /1<r/f/t d. NRC R eg i ona l Supervisor #f V" Note:
- The facility re v iewer's initials/signa tur e are no t a ppli ca bl e for NRC-deve l oped examinations. # In dependent NRC re v ie w er initia l items in Co lumn " c"; chief exa mi ner co n c ur re n ce r eq uir e d.