CNCS SIF Evaluation Guidance 8 5 2014

Embed Size (px)

Citation preview

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    1/68

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    2/68

    Xfd bmssmag ai tfd @arparltmag iar Gltmaglk lgh @abbugmty Pdrvm`d (@G@P) ms tambpravd kmvds, strdgetfdg `abbugmtmds, lgh iastdr `mvm` dgeledbdgt tfrauef sdrvm`d lgh vakugtddrmge.

    L idhdrlk ledg`y, @G@P dgeleds bard tflg imvd bmkkmag Lbdrm lgs mg sdrvm`d tfrauef Lbdrm@arps, Pdgmar @arps, Pa`mlk MggavltmagIugh, Yakugtddr Edgdrltmag Iugh, lgh atfdr praerlbs, lgh kdlhs tfd Zrdsmhdgts gltmaglk `lkk ta sdrvm`d mgmtmltmvd, Tgmtdh Ud Pdrvd.

    Iar bard mgiarbltmag, vmsmtGltmaglkPdrvm`d.eav.

    Xfms ha`ubdgt ms mg tfd punkm` hablmg. Lutfarmzltmag ta rdprahu`d mt mg wfakd ar mg plrt ms erlgtdh.Tpag rdqudst, tfms bltdrmlk wmkk nd blhd lvlmklnkd mg lktdrgltmvd iarblts iar pdapkd wmtf hmslnmkmtmds.

    http://www.nationalservice.gov/http://www.nationalservice.gov/http://www.nationalservice.gov/http://www.nationalservice.gov/
  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    3/68

    Xlnkd ai @agtdgts

    Eumhlg`d Avdrvmdw ................................................................................................................................................................................ 4

    Y. Fublg Punod`ts Zratd`tmag ............................................................................................................................................................. >=

    YM. ^dpartmge Ptrltdey, Xmbdkmgd, lgh Nuhedt .................................................................................................................................. 0:

    YMM. Dvlkultar \ulkmim`ltmags lgh Mghdpdghdg`d ............................................................................................................................. 08

    Lppdghmx L? ^didrdg`ds ..................................................................................................................................................................... L.-8 pleds)

    L.

    ^dsdlr`f \udstmags. Mbpkdbdgtltmag

    N. @agtrmnutmag ai tfd Ptuhy

    MY. Ptuhy @abpagdgts (dstmbltdh -8 pleds)

    YMMM. Erlgtdd/Punerlgtdd akd lgh Mgvakvdbdgt (dstmbltdh :.4-< pled)

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    8/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI 4

    Hdtlmkdh Eumhlg`dDxd`utmvd Pubblry

    Mg`kuhd lg avdrvmdw ai tfd praerlb, tfd agtdxt ai tfd dvlkultmag lgh tfd dvlkultmag lppral`f yau mgtdgh ta

    usd. Ls wmtf lgy Dxd`utmvd Pubblry, tfd purpasd ms ta prdsdgt tfd rdlhdr wmtf tfd fmefkmefts ai tfd iukk

    ha`ubdgt, dmtfdr ta nrmdi vdry nusy rdlhdrs ar ta sdrvd ls lg avdrvmdw ta ndttdr prdplrd rdlhdrs iar tfd iukk

    ha`ubdgt.

    Ppd`mim` Eumhlg`d? Dxd`utmvd Pubblry

    Xfd Dxd`utmvd Pubblry sfaukh agtlmg tfd iakkawmge?

    Glbd ai arelgmzltmag3

    L agd-plrlerlpf sygapsms ai tfd praerlb lgh wflt mt mgtdghs ta flged/mbpl`t3

    L nrmdi sygapsms (agd ta twa sdgtdg`ds) ai prmar rdsdlr`f hagd ag tfd praerlb3

    L nrmdi hds`rmptmag ai tfd bdlsurds/mgstrubdgts ta nd usdh, lgh tfd typds ai hltl ta nd `akkd`tdh irab

    tfdb3

    L nrmdi hds`rmptmag ai tfd prapasdh lglkysms lppral`f(ds)3

    L subblry ai tfd cdy tmbdkmgd dkdbdgts/hltds (d.e., hltds tflt plrtm`mplgt rd`rumtbdgt lgh hltl

    `akkd`tmag gddh ta stlrt/dgh, lgh wfdg lglkysms lgh rdpartmge wmkk tlcd pkl`d)3

    Xfd dstmbltdh nuhedt3 lgh

    L nrmdi hds`rmptmag ai tfd dvlkultmag tdlb lgh bdbndrs dxpdrmdg`d rdkltdh ta tfd diiart.

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    9/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI 9

    M. Mgtrahu`tmag

    Xfd mgtrahu`tmag ta yaur dvlkultmag pklg dstlnkmsfds tfd agtdxt ai tfd dvlkultmag tflt yau lrd prapasmge. Mt

    sfaukh iurtfdr hds`rmnd tfd praerlb nl`ceraugh lgh prankdb hdimgmtmag, lgh emvd lg avdrvmdw ai prmar

    rdsdlr`f ag tfd praerlb. L praerlb hds`rmptmag lgh avdrvmdw ai prmar rdsdlr`f lrd `ru`mlk ta sdttmge up tfd

    avdrlkk dvlkultmag hdsmeg. Xfdy pravmhd l stlrtmge pamgt iar lssdssmge aut`abd bdlsurdbdgt mg tfd `urrdgt

    praerlb. Lt tfd slbd tmbd, tfdy lksa pravmhd lg ughdrstlghmge ai faw tfd praerlb fls warcdh mg tfd plstlgh wflt dvmhdg`d ai diid`tmvdgdss bly nd dxpd`tdh, ls wdkk ls mgiarbltmag ag patdgtmlk`agtrakar`abplrmsag

    eraups.

    Zraerlb Nl`ceraugh lgh Zrankdb Hdimgmtmag

    L strage hds`rmptmag ai tfd praerlb lgh mts armemgs agtdxtulkmzds tfd dvlkultmag. Xfd rdkltmagsfmp ai tfd

    praerlb ta tfd prankdb mt ms hdsmegdh ta lhhrdss ms lksa mbpartlgt taughdrstlgh tfd avdrlkk dvlkultmag hdsmeg.

    Ppd`mim` Eumhlg`d? Zraerlb Nl`ceraugh lgh Zrankdb Hdimgmtmag

    Xfd Zraerlb Nl`ceraugh lgh Zrankdb Hdimgmtmag sd`tmag hds`rmnds tfd prankdb ar mssud tfd praerlblhhrdssds. Ls plrt ai tfms hds`rmptmag, tfd dvlkultmag pklg sfaukh nrmdiky hms`uss tfd praerlb tfdary lgh kaem`

    bahdk. Xfms sd`tmag sfaukh lksa mg`kuhd mgiarbltmag ag`drgmge praerlb abpagdgts,mgtdrvdgtmag kdvdk,

    ndgdim`mlrmds, lgh cdy aut`abds.

    Avdrvmdw ai Zrmar ^dsdlr`f

    PMI-iughdh praerlbs lrd dxpd`tdh ta bddt lg dvmhdg`d tfrdsfakh ta nd iughdh lgh bust numkh upag tfms

    dvmhdg`d ls l rdqumrdbdgt ai tfd erlgt. Mg edgdrlk, mt ms mbpartlgt ta mhdgtmiy wflt rdsdlr`f fls nddg hagd lgh

    faw tfd pklggdh dvlkultmag wmkk agtrmnutd ar numkh upag tfms dxmstmge rdsdlr`f nlsd. Mg tfms sd`tmag, ha`ubdgt

    tfd prdvmaus rdsdlr`f tflt fls nddg abpkdtdh lgh agtdxtulkmzd tfd dvlkultmag pklg.

    Ppd`mim` Eumhlg`d? Avdrvmdw ai Zrmar ^dsdlr`f

    Hds`rmnd lgy dvlkultmags ar atfdr rdsdlr`f ag tfd praerlb, lgh mg`kuhd tfd iakkawmge iar dl`f?

    Ufdg tfd stuhy wls hagd3

    Ufa aghu`tdh tfd stuhy3

    Xfd praerlb papukltmag (gubndr lgh nrmdi hds`rmptmag) mgvakvdh mg tfd stuhmds3

    Lgy abplrmsag ar agtrak eraup mgvakvdh (gubndr lgh nrmdi hds`rmptmag)3

    Xfd dvlkultmag lppral`f ar bdtfahs usdh (d.e., rlghabmzdh agtrakkdh trmlk, qulsm-dxpdrmbdgtlk

    hdsmeg, lsd stuhmds, mbpkdbdgtltmag stuhy)3

    L nrmdi hds`rmptmag ai tfd imghmges3 lgh

    Xfd kdvdk ai dvmhdg`d lttlmgdh (d.e., bahdrltd, strage).

    Mg`kuhd tfd slbd mgiarbltmag kmstdh lnavd iar lgy rdkdvlgt rdsdlr`f ar dvlkultmag imghmges ag smbmklr

    praerlbs (d.e., praerlbs usmge tfd slbd mgtdrvdgtmag mg atfdr ka`ltmags ar smbmklr mgtdrvdgtmags wmtf dmtfdr tfd

    slbd ar hmiidrdgt papukltmags).

    Gatd? Mi tfd `urrdgt praerlb fls l klred prd-dxmstmge dvmhdg`d nlsd ar mi tfdrd ms dxtdgsmvd rdsdlr`f ag smbmklr

    praerlbs, mt bly nd bard prl`tm`lk ta mg`kuhd mgiarbltmag irab cdy dvlkultmag stuhmds ar lgy lvlmklnkd bdtl-

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    10/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI 5

    lglkysds, subblrmzmge tfd nukkdtdh mgiarbltmag lnavd. Iar praerlbs tflt flvd dxtdgsmvd rdsdlr`f, yau bly

    wlgt ta put tfms mgiarbltmag mg tlnuklr iarb (sdd Lppdghmx @ iar l slbpkd tlnkd). Zkdlsd lksa mg`kuhd

    rdidrdg`ds ta tfd saur`d ai tfd prmar rdsdlr`f ar dvlkultmag.

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    11/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI 6

    MM. Zraerlb Xfdary lgh Kaem` Bahdk

    Xfd dvlkultmag pklg sfaukh mg`kuhd lg avdrvmdw ai yaur praerlbs tfdary

    lgh l kaem` bahdk tflt eumhds tfd dvlkultmag lgh pravmhds tfd rdlhdr wmtf l

    ndttdr ughdrstlghmge ai faw yaur praerlb ms dxpd`tdh ta l`fmdvd mts tlredtdh

    aut`abds lgh mbpl`ts.

    L hds`rmptmag ai praerlb tfdary, aupkdh wmtf lg mgiarbltmvd kaem` bahdk,

    irlbds tfd dvlkultmag hdsmeg. Tghdrstlghmge tfd tfdary lgh lssubptmags

    ndfmgh faw l praerlb ms hdsmegdh ms lg mbpartlgt prd`ursar upag wfm`f lkk

    sunsdqudgt dvlkultmag l`tmvmtmds iughlbdgtlkky rdst (^assm, Kmpsdy, &

    Irddblg, >::8). L praerlb kaem` bahdk usulkky mg`kuhds natf l erlpfm`

    hmspkly lgh l glrrltmvd hds`rmptmag ai tfd rdsaur`ds/mgputs, tfd praerlb

    l`tmvmtmds tflt agstmtutd tfd mgtdrvdgtmag, lgh hdsmrdh plrtm`mplgt

    aut`abds/rdsukts.

    Kaem` bahdks, wfm`f lrd eraughdh mg ltfdary ai `flged,usd warhs lgh erlpfm`s ta hds`rmnd tfd sdqudg`d ai

    l`tmvmtmds tfaueft ta nrmge lnaut flged lgh faw tfdsd l`tmvmtmds lrd kmgcdh ta tfd rdsukts tfd praerlb msdxpd`tdh ta l`fmdvd. Xfms pra`dss mg`kuhds sdqudgtmlkky tfmgcmge tfrauef lgh lkmegmge tfd iakkawmge lrdls?

    ^dsaur`ds/Mgputs? Mg`kuhd rdsaur`ds tflt lrd lvlmklnkd lgh hmrd`tky usdh iar tfd praerlb l`tmvmtmds,

    mg`kuhmgefublg, imglg`mlk, arelgmzltmaglk, lgh abbugmty rdsaur`ds3

    Mgtdrvdgtmag?Mg`kuhd praerlb l`tmvmtmds (m.d., wflt `agstmtutds tfd praerlb mgtdrvdgtmag) wmtf tfd

    rdsaur`ds yau kmstdh prdvmausky tflt kdlh ta tfd mgtdghdh praerlb rdsukts/aut`abds3 lgh

    Aut`abds/^dsukts? Mg`kuhd flgeds tflt a``ur nd`lusd ai tfd praerlb mgtdrvdgtmag prdvmausky hds`rmndh

    usmge tfd rdsaur`ds prdvmausky hds`rmndh. Xfdsd lg nd lgy ai tfd iakkawmge?

    l) Pfart-tdrb aut`abds (autputs) bly mg`kuhd tfd lbaugt ai mgtdrvdgtmag (m.d., tfd qulgtmty lgh

    typd(s) ai praerlb l`tmvmtmds l plrtm`mplgt l`tulkky tlcds plrt mg) lg mghmvmhulk rd`dmvds ar spd`mim``flgeds mg cgawkdhed ar scmkks3

    n) Mgtdrbdhmltd aut`abds bly mg`kuhd `flgeds mg mghmvmhulks ndflvmars ar lttmtuhds3 lgh

    `) Kage-tdrb aut`abds (mbpl`ts) bly mg`kuhd tfd flgeds a``urrmge mg `abbugmtmds ar systdbs ls l

    rdsukt ai praerlb mgtdrvdgtmags.

    Lg dxlbpkd ai l kaem` bahdk `lg nd iaugh mgLppdghmx @(Dxlbpkds lgh Xdbpkltds) sd`tmag ai tfms eumhd.

    Ppd`mim` Eumhlg`d? Zraerlb Xfdary lgh Kaem` Bahdk

    Xfd praerlb tfdary lgh kaem` bahdk l``abpkmsf tfd iakkawmge?

    . Dgsurd lkmegbdgt lbage tfd kaem` bahdk dkdbdgts. Ia`us ag cdy il`tars mg tfd `lusd-lgh-diid`t

    rdkltmagsfmp. Xfmgc lnaut lgh hds`rmnd faw tfd rdsaur`ds/mgputs kmgc ta tfd mgtdrvdgtmag lgh tfdg kmgc

    ta tfd hdsmrdh aut`abds/rdsukts3

    0. Hdtlmk tfd dkdbdgts ai tfd rdsaur`ds/mgputs lgh lrtm`ukltd tfd pltfs tfrauef wfm`f tfd sdrvm`ds

    pravmhdh liid`t mghmvmhulk aut`abds (d.e., dbpkaybdgt, fdlktf, dhu`ltmag). Blcd surd tflt tfd l`tmvmtmds

    hmrd`tky kdlh ta tfd dxpklgltmag ai sfart-tdrb aut`abds/autputs (d.e., mg`rdlsdh stuhdgt lttdghlg`d)

    Lhhmtmaglk dsaur`ds

    Xfd Cdkkaee Iaughltmags >::8

    Kaem` Bahdk Hdvdkapbdgt

    Eumhd

    (fttp?//www.wcci.are/cgawkdhed-

    `dgtdr/rdsaur`ds/>::9/:>/wc-

    cdkkaee-iaughltmag-kaem`-bahdk-

    hdvdkapbdgt-eumhd.lspx)

    pravmhds lhvm`d lgh dxlbpkds

    iar `agstru`tmge l kaem` bahdk.

    http://www.wkkf.org/knowledge-center/resources/2006/02/wk-kellogg-foundation-logic-model-development-guide.aspxhttp://www.wkkf.org/knowledge-center/resources/2006/02/wk-kellogg-foundation-logic-model-development-guide.aspxhttp://www.wkkf.org/knowledge-center/resources/2006/02/wk-kellogg-foundation-logic-model-development-guide.aspxhttp://www.wkkf.org/knowledge-center/resources/2006/02/wk-kellogg-foundation-logic-model-development-guide.aspxhttp://www.wkkf.org/knowledge-center/resources/2006/02/wk-kellogg-foundation-logic-model-development-guide.aspxhttp://www.wkkf.org/knowledge-center/resources/2006/02/wk-kellogg-foundation-logic-model-development-guide.aspxhttp://www.wkkf.org/knowledge-center/resources/2006/02/wk-kellogg-foundation-logic-model-development-guide.aspx
  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    12/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI =

    lgh mgtdrbdhmltd-tdrb aut`abds (d.e., mbpravdh rdlhmge s`ards) tflt waukh nd gd`dsslry ta l`fmdvd tfd

    praerlbs kage-tdrb aut`abds/mbpl`ts (d.e., fmef s`faak abpkdtmag, akkded rdlhmgdss)3

    8. Dbpflsmzd tfd aut`abds tflt tfd prapasdh dvlkultmag wmkk bdlsurd3 lgh

    4. Mg`kuhd agky mgiarbltmag tflt ms hmrd`tky rdkltdh ta tfd tfdary ai flged. Cddp tfd kaem` bahdk smbpkd ta

    bmgmbmzd lttdgtmag ta tfmges tflt `lggat nd `agtrakkdh.

    Xfd kaem` bahdk sfaukh uktmbltdky nd usdh ta eumhd tfd `akkd`tmag ai hltl ta mgiarb lg lssdssbdgt ai praerlb

    diid`tmvdgdss. Xfd kaem` bahdk sfaukh dbpflsmzd hdtlmks ai tfd praerlb tflt hmrd`tky rdkltd ta tfd ard lspd`ts

    ai tfd dvlkultmag.

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    13/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI ::6l)

    Xd`fgm`lk Bdtfahs dpart?

    Eumhdkmgds iar Buktmpkd

    Xdstmge mg Mbpl`t Dvlkultmags

    (G@DD >::6-8:

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    14/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    15/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI

    MY. Ptuhy @abpagdgts

    Avdrvmdw

    Xfd Ptuhy @abpagdgts sd`tmag pravmhds eumhlg`d ag tfd hdsmeg dkdbdgts ai mbpl`t lgh mbpkdbdgtltmag

    dvlkultmags, lgh mssuds tflt gddh ta nd lhhrdssdh rdelrhmge stuhy bdlsurds, slbpkmge, lgh hltl akkd`tmag. Mt

    lksa hdtlmks tfd rmtdrml iar hds`rmptmags ai stltmstm`lk lglkysds ai hltl lgh lppral`fds ta bmssmge hltl. Mg tfmssd`tmag ai tfd eumhdkmgds, mgiarbltmag, spd`mim` eumhlg`d, lgh rmtdrml iar hmiidrdgt hdsmeg typds lrd prdsdgtdh

    sdplrltdky. Pmg`d yaur dvlkultmag pklg bly lhhrdss agd ar bard typds ai mbpl`t/aut`abd dvlkultmag hdsmegs

    ls wdkk ls mbpkdbdgtltmag dvlkultmag ar idlsmnmkmty stuhmds, pkdlsd rdvmdw tfd eumhlg`d sd`tmags iar tfd hdsmegs

    lgh atfdr stuhy `abpagdgts sfawg mg tfd tlnkd ndkaw.

    Ptuhy @abpagdgt

    -

    -

    -

    -

    -

    -

    Iakkaw tfd eumhlg`d iar tfms sd`tmag?

    Mbpl`t Dvlkultmag-Hdsmeg Xypds,

    mg`kuhmge?

    ]ds (Lg dvlkultmag pklg wmkk typm`lkky

    `faasd agd ar bard typds ai

    Mbpl`t/Aut`abd Dvlkultmag hdsmegs)

    ^lghabmzdh Ndtwddg Eraup Hdsmeg Mi lppkm`lnkd

    Eraups Iarbdh ny Blt`fmge Mi lppkm`lnkd

    Eraups Iarbdh ny @utaii P`ard Mi lppkm`lnkd

    Pmgekd Eraup Hdsmeg Mi lppkm`lnkd

    Mgtdrruptdh Xmbd Pdrmds Hdsmeg Mi lppkm`lnkd

    Zrd-dxpdrmbdgtlk Hdsmeg (m.d., ga

    `abplrmsag eraup/`augtdril`tulk)

    Mi lppkm`lnkd

    - Mbpl`t Idlsmnmkmty Ptuhy Mi lppkm`lnkd

    Mbpkdbdgtltmag Dvlkultmag Mi lppkm`lnkd

    Plbpkmge, Bdlsurds, lgh Hltl

    @akkd`tmag

    ]ds (Lkk dvlkultmag pklgs sfaukh

    mg`kuhd)

    Ptltmstm`lk Lglkysms ai Mbpl`ts ]ds (Lkk dvlkultmag pklgs sfaukhmg`kuhd)

    Zraerlb dvlkultmags bly flvd buktmpkd abpagdgts, mg`kuhmge mbpkdbdgtltmag lglkysms, aut`abd lglkysms,

    mbpl`t lglkysms, lgh ast-ndgdimt, ast-diid`tmvdgdss ar atfdr `ast mg`kusmvd lglkysds.

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    16/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI mg

    Lppdghmx @ (Dxlbpkds lgh

    Xdbpkltds).

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    17/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    18/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    19/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI ::>3 assm, Kmpsdy, & Irddblg, >::8). Fawdvdr, blt`fmge

    mg lhvlg`d ai tfd trdltbdgtwmtf vlrmlnkds tflt lrd dmtfdr prd-mgtdrvdgtmag

    bdlsurds ai lg aut`abd ar lrd fmefky `arrdkltdh wmtf tfd aut`abd wmkk

    bmgmbmzd tfd flg`d ai hmiidrdg`ds ndtwddg tfd trdltbdgt lgh abplrmsag

    eraup. Hamge sa kdssdgs tfd passmnmkmty tflt ansdrvdh hmiidrdg`ds lrd mg il`t

    hud ta dxtrlgdaus hmiidrdg`ds ndtwddg tfd trdltbdgt lgh abplrmsag eraups,

    rltfdr tflg hud ta praerlb plrtm`mpltmag.

    Bdtfahs iar blt`fmge pdapkd ar smtds ta eraups hmiidr mg tfdmr diid`tmvdgdss.Zrapdgsmty s`armgebdtfahs, arstltmstm`lk lssdssbdgts ai smbmklrmty lbage plrtm`mplgts, lrd prdidrrdh wfdg eraups lrd blt`fdh wmtf buktmpkd

    prd-mgtdrvdgtmag bdlsurds. Fawdvdr, tfd typd ai blt`fmge lkearmtfb usdh ta mbpkdbdgt tfd prapdgsmty

    s`armge sfaukh nd lrdiukky sdkd`tdh nlsdh ag smbukltmag stuhmds, prdvmaus rdsdlr`f tflt hdbagstrltds tfd

    vlkmhmty ai tfd lkearmtfbs, lgh tfd ealks ai tfd dvlkultmag. Pdd Page lgh Fdrblg (>:::8) iar l edgdrlk

    avdrvmdw ai rdsdlr`f hdsmeg mg

    dvlkultmag.

    Pdd Pflhmsf, @aac, lgh@lbpndkk (>::>) iar hdtlmks ag

    dxpdrmbdgtlk rdsdlr`f hdsmeg.

    Iar bard mgiarbltmag ag

    qulsm-dxpdrmbdgtlk dvlkultmag

    hdsmegssdd?

    fttp?//ssbag.`fn.ctf.sd/slidnc

    /@fpQ8.phi

    http://ssmon.chb.kth.se/safebk/Chp_4.pdfhttp://ssmon.chb.kth.se/safebk/Chp_4.pdfhttp://ssmon.chb.kth.se/safebk/Chp_4.pdfhttp://ssmon.chb.kth.se/safebk/Chp_4.pdfhttp://ssmon.chb.kth.se/safebk/Chp_4.pdf
  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    20/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI ::6), lvlmklnkd

    fdrd?

    fttp?//il`ukty.sbu.dhu/bmkkmbd

    t/`klssds/d`a5055/plpdrs/mbnd

    gs%>:kdbmdux.phi)

    L`kdlr autkmgd ai tfd bdtfah

    ms lksa emvdg fdrd?

    fttp?//www.sa`mlkrdsdlr`fbdt

    fahs.gdt/cn/qulsmrh.pfp

    http://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdfhttp://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdfhttp://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdfhttp://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdfhttp://www.socialresearchmethods.net/kb/quasird.phphttp://www.socialresearchmethods.net/kb/quasird.phphttp://www.socialresearchmethods.net/kb/quasird.phphttp://www.socialresearchmethods.net/kb/quasird.phphttp://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdfhttp://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdf
  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    21/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI ::6).

    Xfd mgtdrruptdh tmbd sdrmds hdsmeg fls nddg bast irdqudgtky lgh diid`tmvdky

    usdh wfdg tfd mgtdrvdgtmag ms l praerlb ar pakm`y ai smegmim`lgt s`apd, su`f ls

    `abbugmty mgtdrvdgtmags ta mbpravd fmkh-rdlrmge prl`tm`ds ar blghltary

    sdlt ndkt klws mg l stltd. Xfd sa`mlk dvlkultmag rdsdlr`f kmtdrlturd mg`kuhds

    blgy hds`rmptmags lgh dxlbpkds ai tfd hdvdkapbdgt lgh mbpkdbdgtltmag ai

    tfms hdsmeg lgh tfd lglkysms ai hltl edgdrltdh ny mt (Nm`cblg & ^ae, >::=3

    Cflghcdr, Caakwlk, & Plblh, >:::83 Pflhmsf, @aac, & @lbpndkk, >::>).

    Lhhmtmaglkky, lktfauef tfms hdsmeg ms kmstdh ls l smgekd-eraup hdsmeg, l `abplrmsag eraup ms usulkky gddhdh ta

    lhhrdss tfd passmnmkmty tflt dxtrlgdaus dvdgts kmgcdh ta faw hltl wdrd `akkd`tdh ar aut`abds wdrd hdvdkapdh

    Lhhmtmaglk dsaur`ds

    Xfd Hdplrtbdgt ai

    Dhu`ltmags Uflt Uarcs

    @kdlrmgefausd(ltfttp?//mds.dh.eav/g`dd/ww`/)

    pravmhds blgy rdsaur`ds

    rdkltdh ta dvlkultmag hdsmeg.

    Lhds`rmptmag ai mgtdrruptdh

    tmbd sdrmds hdsmegsms emvdg ny

    Mbndgs lgh Kdbmdux (>::6),

    (lvlmklnkd fdrd?

    fttp?//il`ukty.sbu.dhu/bmkkmbd

    t/`klssds/d`a5055/plpdrs/mbnd

    gs%>:kdbmdux.phi)

    Pdd Nm`cblg lgh ^ae (>::=)

    iar mgiarbltmag ag blgy

    hmiidrdgt dvlkultmag hdsmegs.

    Pdd Cflghcdr, Caakwlk, lgh

    Plblh (>:::>) iar mtltmags

    ai stuhmds tflt flvd usdh tfd

    mgtdrruptdh tmbd sdrmds hdsmeg.

    http://ies.ed.gov/ncee/wwc/http://ies.ed.gov/ncee/wwc/http://ies.ed.gov/ncee/wwc/http://ies.ed.gov/ncee/wwc/http://ies.ed.gov/ncee/wwc/http://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdfhttp://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdfhttp://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdfhttp://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdfhttp://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdfhttp://faculty.smu.edu/millimet/classes/eco7377/papers/imbens%20lemieux.pdfhttp://ies.ed.gov/ncee/wwc/http://ies.ed.gov/ncee/wwc/http://ies.ed.gov/ncee/wwc/
  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    22/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    23/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI >:

    Ppd`mim` Eumhlg`d? Idlsmnmkmty Ptuhmds

    Hds`rmnd tfd nlrrmdrs ta mbpkdbdgtmge l iukk-s`lkd stuhy ymdkhmge bahdrltd ar strage dvmhdg`d lgh pravmhd l

    `abpkdtd hds`rmptmag ai tfd idlsmnmkmty stuhy ta nd `aghu`tdh, mg`kuhmge, ls lppraprmltd, stuhy dkdbdgts rdkltdh

    ta l hds`rmptmag ai tfd praerlb, dgeledbdgt wmtf stlcdfakhdrs, ar lssdssbdgts ai hltl lvlmklnmkmty lgh

    qulkmty. Xfd dvlkultmag pklg sfaukh lhhrdss tfd pklgs ta tdst tfd prl`tm`lkmty ai tfd usd ai l `agtrak ar

    `abplrmsag eraup ar atfdr augtdril`tulk. Hds`rmnd faw tfd idlsmnmkmty stuhy prdplrds tfd praerlb lgh tfd

    dvlkultars iar pklggmge, mbpkdbdgtmge, lgh abpkdtmge l bard rmearaus dvlkultmag.

    @abnmgltmag ai Hdsmegs lgh/ar Lglkysds

    Mg sabd smtultmags, usmge l abnmgltmag ai sdvdrlk stuhy hdsmegs bly nd usdiuk ta `lpturd tfd dvmhdg`d ai

    diid`tmvdgdss ai tfd praerlb. Iar dxlbpkd, l sblkk s`lkd ^@X bly nd usdh lkagesmhd l klredr blt`fdh

    `abplrmsag stuhy wmtf eraups iarbdh ny prapdgsmty s`ard blt`fmge.

    Ppd`mim` Eumhlg`d? @abnmgltmag ai Hdsmegs lgh/ar Lglkysds

    Mi buktmpkd stuhy hdsmegs ar lglkysds lrd abnmgdh, tfd prapaslk sfaukh pravmhd kdlr hdtlmks ai lkk

    `abpagdgts, mg l``arhlg`d wmtf tfd spd`mim`ltmags pravmhdh lnavd. Iurtfdr, tfd prapaslk sfaukh pravmhd lrltmaglkd iar usmge l `abnmgltmag lppral`f, wmtf l ia`us ag faw usmge buktmpkd lglkysds aiisdts tfrdlts ta

    mgtdrglk lgh dxtdrglk vlkmhmty.

    Gatd tflt tfd hdsmeg typds hms`ussdh lnavd lrd gat mgtdghdh ta nd l iukk kmst, lgh atfdr hdsmeg typds lgh

    `abnmgltmags ai hdsmeg typds lppraprmltd ta yaur praerlb lgh dvlkultmag ealks lrd wdk`abd.

    Mbpkdbdgtltmag Dvlkultmag

    Mbpkdbdgtltmag dvlkultmag ms lg lssdssbdgt ai faw wdkk l praerlb hads wflt

    mt sdts aut ta ha. ^ltfdr tflg ia`usmge ag tfd aut`abds, fawdvdr,

    mbpkdbdgtltmag dvlkultmags ia`us ag tfdpra`dssny wfm`f l praerlb pravmhds

    sdrvm`ds ar atfdrwmsd l``abpkmsfds mts bmssmag. Mbpkdbdgtltmag stuhmds dgtdr

    ag hms`drgmge faw kasdky tfd l`tulk ruggmge ai tfd praerlb blt`fds tfd

    tfdary tflt edgdrltdh natf tfd praerlb mg edgdrlk, ls wdkk ls tfd plrtm`uklr

    `abpagdgts tflt plrtm`mplgts dxpdrmdg`d.

    Ppd`mim` Eumhlg`d? Mbpkdbdgtltmag Dvlkultmag

    Mbpkdbdgtltmag stuhmds lrd strageky dg`aurledh ls plrt ai lgy dvlkultmag pklg. Xfd praerlb tfdary lgh kaem`

    bahdk sfaukh eumhd tfd mbpkdbdgtltmag dvlkultmag. Lg mbpkdbdgtltmag dvlkultmag dxlbmgds natf faw wdkk

    tfd praerlb blt`fds tfd tfdary ndfmgh mts `rdltmag, lgh wflt tfd praerlb l`tulkky hads ag tfd eraugh. Mglhhmtmag, lg mbpkdbdgtltmag dvlkultmag strmvds ta ug`avdr tfd dxl`t pra`dssds tflt kdlh ta aut`abds. Xfd pklg

    sfaukh bdlsurd vlrmltmag mg mbpkdbdgtltmag wmtfmg tfd praerlb ls wdkk ls l`rass praerlb smtds, ls wlrrlgtdh

    Xfd pklg sfaukh lssdss natf tfd qulgtmty lgh qulkmty ai sdrvm`ds hdkmvdrdh ta tfd tlredt papukltmag.

    Lhhmtmaglkky, tfd pklg sfaukh dxlbmgd mi tfd praerlb ms mghddh sdrvmge tfd pdapkd iar wfab mt wls mgtdghdh,

    lgh mi lppraprmltd, mi tfdrd ms l `agtrak ar `abplrmsag eraup wfa bly ar bly gat nd rd`dmvmge smbmklr sdrvm`ds

    tfrauef lgatfdr praerlb ar praerlbs.

    Lhhmtmaglk ^dsaur`ds

    Pdd Udmgdr (>::8) iar

    mgiarbltmag ag

    mbpkdbdgtltmag dvlkultmag

    rdsdlr`f hdsmeg.

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    24/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI >::4).

    Ppd`mim` Eumhlg`d? Plbpkmge Zklg lgh Zawdr Lglkysms

    Plbpkmge Zklg

    Imrst, hds`rmnd tfd papukltmag ta wfm`f tfd stuhy rdsukts wmkk nd edgdrlkmzdh - tflt ms, tfd eraup ai mghmvmhulks

    ta wfab tfd stuhy rdsukts waukh lppky. Xfms bmeft mg`kuhd hdtlmks su`f ls tfd sa`mlk, d`agabm`, ar

    hdbaerlpfm` flrl`tdrmstm`s (rl`d, edghdr, dt`.), lt-rmsc stltus, ar edaerlpfm` ka`ltmag ai tfd papukltmag.

    Mbpartlgtky, tfd dvlkultmag pklg sfaukh hdbagstrltd tflt tfd slbpkd tflt wmkk nd hrlwg wmkk nd rdprdsdgtltmvd

    ai tflt papukltmag.

    Lhhmtmaglk ^dsaur`ds

    Bard hdtlmks, lgh mgstru`tmags

    iar `lk`ukltmge stltmstm`lk

    pawdr, `lg nd iaugh ag tfd

    T@KL stltmstm`lk abputmge

    saitwlrd wdnsmtd?

    fttp?//www.lts.u`kl.dhu/stlt/h

    ld/

    Pdd Nkaab (>::4) iar bard

    mgiarbltmag ag slbpkd smzd

    lgh BHDP mg dvlkultmag

    rdsdlr`f.

    http://www.ats.ucla.edu/stat/dae/http://www.ats.ucla.edu/stat/dae/http://www.ats.ucla.edu/stat/dae/http://www.ats.ucla.edu/stat/dae/http://www.ats.ucla.edu/stat/dae/
  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    25/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI >>

    Xa ha tfms, hds`rmnd dxl`tky faw tfd plrtm`mplgts wfa wmkk nd mg tfd slbpkd wmkk nd sdkd`tdh irab tfd dgtmrd

    passmnkd papukltmag ai plrtm`mplgts. Xflt ms, plrtm`mplgts bmeft nd sdkd`tdh tfrauef agd ai sdvdrlk td`fgmquds?

    smbpkd rlghab slbpkmge, strltmimdh rlghab slbpkmge, agvdgmdg`d slbpkmge, ar sabd atfdr slbpkmge

    pra`dhurd. Xfd slbpkmge pklg, wfm`f hds`rmnds tfd td`fgmqud lgh mg`kuhds tfd smzd lgh `abpasmtmag ai tfd

    slbpkd, sfaukh rdikd`t tfd nuhedt lgh tmbdkmgd ai tfd praod`t.

    Zawdr Lglkysms lgh Bmgmbub Hdtd`tlnkd Diid`t Pmzd

    Xfd dvlkultmag pklg sfaukh mg`kuhd l pawdr lglkysms lgh BHDP lk`ukltmags iar tfd prapasdh rdsdlr`f hdsmeg

    lgh dstmbltdh slbpkd smzds. Xfdsd lk`ukltmags sfaukh lpturd wfdtfdr tfd slbpkd usdh mg tfd dvlkultmag wmkk

    nd klred dgauef iar tfd mbpl`t lglkysms ta pravmhd bdlgmgeiuk rdsukts. L pawdr lglkysms lgh BHDP

    `lk`ukltmag sfaukh nd prdsdgtdh iar dl`f lglkysms mg tfd dvlkultmag pklg, mg`kuhmge lkk sun-erauplglkysds.

    Zawdr lglkysds `lg nd `aghu`tdh usmge tfd irdd praerlbs ^ lgh E*Zawdr, ls wdkk ls PZPP, PLP lgh PXLXL.

    Iar hdsmegs tflt flvd buktmpkd kdvdks ai lglkysms ar lssmeg trdltbdgt lgh agtrak lt tfd eraup, rltfdr tflg

    mghmvmhulk kdvdk, tfd irddAptmblk Hdsmeg Paitwlrd(fttp?//smtdblcdr.ubm`f.dhu/eraup-

    nlsdh/aptmblkQhdsmegQsaitwlrd) `lg nd usdh ta dstmbltd pawdr lgh BHDP.

    Plbpkd dtdgtmag

    Xa dgsurd tflt tfd dvlkultmag ms ls strage ls passmnkd, mt ms mbpartlgt ta try ta blxmbmzd tfd gubndr ai

    plrtm`mplgts (ar eraups ar smtds) wfa tlcd plrt mg tfd stuhy. Xfms bdlgs gat agky rd`rumtmge plrtm`mplgts, nut

    lksa blcmge surd tflt ls blgy pdapkd ls passmnkd lrd plrt ai hltl `akkd`tmag diiarts hurmge tfd stuhy, ls wdkk ls

    mg lgy iakkaw-up pdrmah. Xfms ms trud iar praerlb plrtm`mplgts, ls wdkk ls iar lgy `agtrak ar `abplrmsag eraup

    bdbndrs.

    Ppd`mim` Eumhlg`d? Plbpkd dtdgtmag

    Xfd dvlkultmag pklg sfaukh hds`rmnd faw tfd stuhy wmkk cddp trl`c ai plrtm`mplgts lgh tfdmr hltl (mhdlkky,

    wfdg edgdrltmge tfd slbpkd spd`mim`ltmags lgh hltl akkd`tmag strltdey). Xfms pklg sfaukh mg`kuhd bd`flgmsbs

    iar bagmtarmge, trl`cmge, lgh traunkdsfaatmge mssuds rdkltdh ta cddpmge plrtm`mplgts mg tfd stuhy.

    Xfdsd prl`tm`ds bmeft mg`kuhd systdbltm` fd`cs ai hltl `akkd`tmag prl`tm`ds ta dgsurd tflt hltl lrd ndmge

    `akkd`tdh ag l rdeuklr nlsms irab lkk plrtm`mplgts, tfus fdkpmge mhdgtmiy lgy plrtm`mplgts wfa flvd gat nddg

    `agtl`tdh mg l emvdg pdrmah ai tmbd. Xfms `aukh lksa mg`kuhd flvmge strltdemds mg pkl`d iar iakkawmge up wmtf

    plrtm`mplgts wfa lrd gat rdspaghmge ar plrtm`mpltmge mg dmtfdr praerlb ar hltl akkd`tmag l`tmvmtmds. Mt ms

    mbpartlgt ta rdbdbndr tflt mghmvmhulks wfa kdlvd l praerlb prmar ta tfd abpkdtmag ai lkk abpagdgts stmkk

    gddh ta nd trl`cdh ls plrt ai tfd hltl akkd`tmag diiarts. Lkk plrtm`mplgts, lgh agtrak ar abplrmsag eraup

    bdbndrs, lrd mhdlkky trl`cdh lgh pravmhd hltl hurmge tfd dgtmrd stuhy pdrmah, rdelrhkdss ai praerlb

    plrtm`mpltmag, ka`ltmag, ar dlsd ai l``dss.

    Bdlsurds

    Dgsurmge tflt tfd bdlsurds sdkd`tdh lrd rdkmlnkd, vlkmh, lgh lppraprmltd ta usd iar tfd stuhy ms l cdy wly ta

    rdhu`d tfrdlts ta mgtdrglk vlkmhmty lusdh ny tfd stuhy mtsdki. Pdkd`tmag ai paarky vlkmhltdh ar ugrdkmlnkd

    bdlsurds lg kdlh, iar dxlbpkd, ta lg diid`tmvd praerlb sfawmge ga rdsukts.

    ^dkmlnmkmty rdidrs ta tfd edgdrlkmzlnmkmty ai l plrtm`uklr bdlsurd. Xflt ms, mi l bdlsurd ms usdh avdr lgh avdr

    lelmg ag tfd slbd eraup ai pdapkd, mt sfaukh ymdkh tfd slbd rdsukts. Ylkmhmty rdidrs ta tfd dxtdgt ta wfm`f l

    bdlsurd lhdqultdky rdikd`ts tfd ag`dpt ughdr agsmhdrltmag3 mi l bdlsurd blt`fds tfd ag`dpt mg qudstmag,

    http://sitemaker.umich.edu/group-based/optimal_design_softwarehttp://sitemaker.umich.edu/group-based/optimal_design_softwarehttp://sitemaker.umich.edu/group-based/optimal_design_softwarehttp://sitemaker.umich.edu/group-based/optimal_design_software
  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    26/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI >0

    bast rdspaghdgts wmkk mgtdrprdt mt mg smbmklr wlys. Lppraprmltdgdss rdidrs ta

    blt`fmge bdlsurds ta tfd papukltmag ar s`lkd ai l stuhy. Xa mkkustrltd,

    bdlsurds tflt rdqumrd kmtdrl`y sfaukh gat nd usdh wmtf yauge `fmkhrdg ar

    ughdr-dhu`ltdh papukltmags. Buktmpkd wlys dxmst ta tdst vlkmhmty lgh

    rdkmlnmkmty ai bdlsurds3 sdd Bly dt lk. (>::=) ar tfd Tgmvdrsmty ai Kddhs (>:::

    =:

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    27/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI >8

    Ppd`mim` Eumhlg`d? Bdlsurd Ylkmhmty, ^dkmlnmkmty, lgh Fmstary ai Tsd

    Hds`rmnd vlkmhmty, rdkmlnmkmty, lgh fmstary ai usd iar lkk bdlsurds usdh mg hltl

    `akkd`tmag l`tmvmtmds. Lt l bmgmbub, dl`f survdy, tdst ar mgtdrvmdw bdlsurd

    usdh sfaukh flvd dvmhdg`d ai tfd iakkawmge?

    ^dkmlnmkmty (d.e., tdst-rdtdst rdkmlnmkmty iar bdlsurds wmtf mghmvmhulk

    mtdbs, @ragnl`fs lkpfl iar tdsts/s`lkdh survdys)3 Il`d vlkmhmty (d.e., pmkat tdstmge wmtf lppraprmltd papukltmags, rdvmdw

    ny sdrvm`d pravmhdrs)3 lgh,

    @agtdgt vlkmhmty (d.e., rdvmdw ny agtdgt dxpdrts, systdbltm` lkmegbdgt wmtf cdy lrdls ta nd bdlsurdh).

    Mg lhhmtmag, survdys ar tdsts tflt usd s`lkds ar edgdrltd s`ards sfaukh pravmhd hdtlmks ai dxpkarltary il`tar

    lglkysms (Zdtt, Kl`cdy, & Pukkmvlg, >::0), `agimrbltary il`tar lglkysms (Nrawg, >::9), lgh vlkmhltmag lelmgst

    aut`abds, ls wdkk ls fmstary ai usd, mi lvlmklnkd.

    Mi rdkmlnmkmty lgh vlkmhmty ai bdlsurds flvd ydt ta nd hdtdrbmgdh, lg lglkysms pklg iar hamge sa sfaukh nd

    prdsdgtdh. Mi gag-vlkmhltdh, sdki-hdvdkapdh bdlsurds ai cdy aut`abds lrd ta nd usdh, pravmhd l oustmim`ltmag iar

    tfd usd ai tfms bdtfah avdr lgy prd-dxmstmge lgh prd-vlkmhltdh bdlsurds.

    Hltl @akkd`tmag L`tmvmtmds

    L systdbltm` pklg iar `akkd`tmge hltl iar tfd dvlkultmag bust nd mg pkl`d ta dgsurd strage rdsukts. Xfd bdlsurds

    mghm`ltdh mg tfd dvlkultmag pklg hm`tltd tfd hltl akkd`tdh. Hltl iar plrtm`mplgts lgh iar `agtrak ar abplrmsag

    eraup bdbndrs bly `abd irab l vlrmdty ai saur`ds, gat lkk ai wfm`f bly nd plrt ai tfd praerlb.

    Hltl `akkd`tmag mhdlkky stlrts prmar ta praerlb plrtm`mpltmag ta ndst `lpturd plrtm`mplgts nlsdkmgd stltus. Mg tfd

    slbd vdmg, mhdgtm`lk hltl irab natf plrtm`mplgts lgh agtrak ar abplrmsag eraups sfaukh nd akkd`tdh

    wfdgdvdr passmnkd. Hltl akkd`tmag aitdg agtmguds dvdg litdr plrtm`mplgts lrd ga kagedr plrt ai tfd praerlb. Mt

    ms mbpartlgt ta blp aut tfd tmbmge ai hltl `akkd`tmag ta dgsurd tfd ndst passmnkd dvlkultmag.

    Ppd`mim` Eumhlg`d? Hltl @akkd`tmag L`tmvmtmds

    Mhdgtmiy hltl saur`ds iar lkk bdlsurds, ls wdkk ls tfd typd ai hltl ta nd `akkd`tdh lkage wmtf faw tfdy wmkk nd

    `akkd`tdh. Hds`rmptmags sfaukh `avdr hltl iar praerlb plrtm`mplgts ls wdkk ls `agtrak ar `abplrmsag eraup

    bdbndrs.

    Dstlnkmsf l nlsdkmgd stltus iar praerlb plrtm`mplgts lgh agtrak ar `abplrmsag eraup bdbndrs. Nlsdkmgd hltl

    lrd mbpartlgt iar lssdssmge flged mg plrtm`mplgts avdr tmbd. Hds`rmnd wfdg tfd `akkd`tmag ai nlsdkmgd hltl wmkk

    a``ur. Lksa, hms`uss wfdtfdr tfd nlsdkmgd bdlsurds ndmge usdh lrd abplrlnkd iar natf praerlb plrtm`mplgts

    lgh agtrak ar abplrmsag eraup bdbndrs.

    Hltl bly nd `akkd`tdh ny tfd dvlkultmag tdlb, ny praod`t stlii, ar ny sabd atfdr plrty. Mghm`ltd wfa wmkk `akkd`t

    lkk hltl usdh mg tfd dvlkultmag. Gatd tfd rakd ai praod`t stlii bdbndrs mg rdkltmag ta tfd hltl `akkd`tmag pra`dss.

    Mi lhbmgmstrltmvd hltl wmkk nd usdh, spd`miy tfd saur`d(s) lgh lvlmklnmkmty ai tfd hltl, lgh tfd dvlkultmag tdlbs

    dxpdrmdg`d warcmge wmtf tflt typd ai mgiarbltmag.

    Hds`rmnd tfd wly mg wfm`f hltl lrd ta nd `akkd`tdh. Ppd`miy mi hltl wmkk nd `akkd`tdh tfrauef lhbmgmstrltmvd

    rd`arhs, praerlb systdbs, ar tfrauef mgstrubdgts spd`mim`lkky rdltdh iar tfd purpasd. Iar dxlbpkd, wmkk

    Lhhmtmaglk ^dsaur`ds

    Pdd Zdtt, Kl`cdy lgh Pukkmvlg

    (>::0) iar l hms`ussmag ai

    dxpkarltary il`tar lglkysms.

    Pdd Nrawg (>::9) iar bard

    mgiarbltmag ag `agimrbltary

    il`tar lglkysms.

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    28/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI >4

    plrtm`mplgts abpkdtd survdys, wmkk praod`t stlii blmgtlmg rd`arhs tflt wmkk nd usdh, ar wmkk lhbmgmstrltmvd hltl

    su`f ls l`lhdbm` trlgs`rmpts nd usdh1 Mt ms kmcdky tflt sabd `abnmgltmag ai diiarts wmkk nd rdqumrdh ta `lpturd

    lkk tfd hltl tfd bdlsurds wlrrlgt.

    Xfd wly mg wfm`f hltl lrd `akkd`tdh bly gat nd mhdgtm`lk iar natf praerlb plrtm`mplgts lgh `agtrak ar

    `abplrmsag eraup bdbndrs, nut mhdlkky tfd slbd hltl wmkk nd akkd`tdh l`rass natf eraups. Mghm`ltd lgy

    hmiidrdg`ds mg hltl akkd`tmag ndtwddg tfd twa eraups, mg`kuhmge saur`ds, bdlgs ai hltl akkd`tmag, lgh wfa

    wmkk akkd`t tfd hltl.

    Imglkky, mg`kuhd l tmbdkmgd autkmgmge tfd hltl ta nd `akkd`tdh lt vlrmaus pamgts (iar dxlbpkd, wflt hltl lrd

    `akkd`tdh prmar ta praerlb plrtm`mpltmag, hurmge, lgh litdr). Mghm`ltd dxpd`tdh slbpkd smzds lt vlrmaus pamgts mg

    tmbd mg tfd hltl akkd`tmag pra`dss.

    Ptltmstm`lk Lglkysms ai Mbpl`ts

    Xa dgsurd tfd stragedst passmnkd dvmhdg`d rdsukts irab tfd dvlkultmag, tfd arrd`t stltmstm`lk lglkysms td`fgmquds

    bust nd dbpkaydh. Xfd stltmstm`lk td`fgmqud fasdg wmkk hdpdgh ag tfd typds ai rdsdlr`f qudstmags lgh

    aut`abds ar mbpl`ts spd`mimdh mg tfd rdsdlr`f hdsmeg3 tfdy wmkk lksa hdpdgh ag tfd typd(s) lgh qulgtmty ai hltl

    `akkd`tdh. Iar dxlbpkd?

    Ptuhmds tflt `akkd`t hltl l`rass tmbd wmkk gddh ta usd stltmstm`lk bahdks tflt lrd lppraprmltd iar su`f

    hltl (d.e., imxdh diid`ts bahdks)3

    ^dsdlr`f hdsmegs wmtf abplrmsag eraups bly gddh ta stltmstm`lkky agtrak iar lttrmnutds ai eraup

    bdbndrs (d.e., rderdssmag bahdks)3 lgh

    Hdsmegs tflt mgvakvd gdstdh hltl, su`f ls stuhdgts wmtfmg `klssraabs wmkk gddh bahdks tflt flghkd tflt

    typd ai mgtdrl`tmag (d.e., fmdrlr`fm`lk kmgdlr bahdks).

    Hmiidrdgt typds ai hltl wmkk lksa gd`dssmtltd hmiidrdgt stltmstm`lk bahdks. Iar dxlbpkd, hdtdrbmgmge mi sabdagd

    usds bard ar kdss sdrvm`d litdr praerlb plrtm`mpltmag mbpkmds tflt tfd aut`abdbdlsurd vlrmds lkage l agtmguaus spd`trub (m.d., gubndr ai vmsmts ar sdrvm`d

    utmkmzltmags). Xfms typd ai qudstmag waukh rdqumrd tfd usd ai l bahdk tflt imts

    tfms typd ai hltl lgh tflt lg lksa lhdqultdky tlcd mgta l``augt atfdr il`tars

    ndsmhds praerlb plrtm`mpltmag (mhdlkky) ta ls`drtlmg tfd mbpl`t ai praerlb

    plrtm`mpltmag ag tfd gubndr ai vmsmts (d.e., l kmgdlrrderdssmagar rdkltdh

    bahdk). @agvdrsdky, mi tfd aut`abd ai mgtdrdst ms wfdtfdr ar gat l stuhdgt

    dgrakkdh mg akkded, tfd aut`abd fls agky twa ltdearmds (dgrakkdh ar hmh gat

    dgrakk), lgh tfd stltmstm`lk bahdk bust nd lppraprmltd iar tflt typd ai

    `ltdearm`lk hltl (d.e., l kaemstm` rderdssmag ar rdkltdh bahdk).

    Bard hdtlmks ag spd`mim`, abbagky usdh stltmstm`lk bahdks lrd hdtlmkdh mg Xlnkd < mg Lppdghmx @ (Dxlbpkdslgh Xdbpkltds) ai tfms ha`ubdgt.

    Mgtdgt ta Xrdlt (MXX) lgh Xrdltbdgt ag Xrdltdh (XAX) Lglkysms Irlbdwarcs

    Xwa blmg pdrspd`tmvds dxmst iar eumhmge lglkysms mg dvlkultmags. Mi tfd prapasdh stuhy fls l rlghabmzdh

    ndtwddg-eraups hdsmeg, lgmgtdgt-ta-trdlt(MXX) irlbdwarc ms sueedstdh (tfauef gat rdqumrdh). Xfms

    irlbdwarc stlrts wmtf tfd prdbmsd tflt lglkytm`lkky, dvlkultars lrd lssdssmge aut`abds nlsdh ag praerlb

    `abpagdgts rltfdr tflg plrtm`mplgt dxpdrmdg`d. Xfms irlbdwarc ms usdiuk nd`lusd mt (::=) iar mgiarbltmag ag

    `luslk mgidrdg`d lgh

    mgstrubdgtlk vlrmlnkds

    irlbdwarc mg XAX

    rlghabmzdh `kmgm`lk trmlks.

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    29/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI >9

    ta abplrd tfd aut`abds ai plrtm`mplgts (ar eraups ai plrtm`mplgts) ndtwddg

    tfasd wfa wdrd lssmegdh ta rd`dmvd praerlb sdrvm`ds lgh tfasd wfa wdrd gat

    lssmegdh ta tfd praerlb, lgh (>) edgdrltds lg ugnmlsdh dstmbltd ai tfd

    lvdrled praerlb diid`t iar plrtm`mplgts aiidrdh tfd praerlb. Xfd MXX

    irlbdwarc ms aitdg usdh nd`lusd tfd mbpl`t dstmbltd ms tfd agd tflt ms aitdg ai

    bast mgtdrdst ta pakm`yblcdrs (Nkaab, >::4).

    Fawdvdr, mg prl`tm`d, mgtdrvdgtmags lrd bard kmcdky ta nd mbpkdbdgtdh wmtfvlrymge hderdds ai imhdkmty ta tfd mgtdghdh mbpkdbdgtltmag pklg. Pmbmklrky,

    kdvdks ai plrtm`mpltmag lg rlged irab plrtm`mplgts gat tlcmge plrt lt lkk ta

    tfasd abpkdtmge lkk lspd`ts ai l praerlb. Xfd ugnmlsdh dstmbltd irab lg MXX lglkysms irlbdwarc wmkk rdikd`t

    tfms rlged. Iar tfms rdlsag, tfd mbpl`t dstmbltd irab tfd MXX ms aitdg agsmhdrdh tfd bast pakm`y rdkdvlgt

    nd`lusd mt ms nlsdh ag tfd dxpdrmbdgtlk stru`turd ai tfd hltl (m.d., rdsukts hdpdgh upag dmtfdr plrtm`mpltmge, lt

    lgy kdvdk, ar gat lt lkk).

    Xfdtrdltbdgt-ag-trdltdh(XAX) lglkysms, wfm`f ms nlsdh ag wflt plrtm`mplgts l`tulkky dxpdrmdg`d, bust

    typm`lkky nd antlmgdh irab lg dxtdgsmag ai tfd gag-dxpdrmbdgtlk stru`turd ai tfd hltl (Nkaab, >::4). Bardavdr,

    tfd ugnmlsdh dstmbltd ai l praerlbs diid`t ag lg aut`abd `lg nd `abprabmsdh ny gag-rlghab bmssmge hltlag tfd aut`abd. Xfms passmnmkmty, lgh faw mt wmkk nd flghkdh mi mt a``urs, sfaukh nd lhhrdssdh mg tfd dvlkultmag

    pklg ughdr bmssmge hltl.

    @agvdrsdky, XAX lglkysms typm`lkky rdqumrds tfd dvlkultar ta lglkyzd hltl akkd`tdh ag mghmvmhulks nlsdh ag

    tfdmr kdvdk ai praerlb plrtm`mpltmag. Nd`lusd praerlb plrtm`mplgts sdki-sdkd`t tfdmr kdvdk ai praerlb

    plrtm`mpltmag, lglkysds tflt dstmbltd praerlb mbpl`ts l``arhmge ta tfdsd kdvdks lrd ny glturd qulsm-

    dxpdrmbdgtlk.

    Ppd`mim` Eumhlg`d? Hltl Lglkysms

    Apdg tfd stltmstm`lk lglkysms sd`tmag ai tfd dvlkultmag pklg ny hds`rmnmge tfd MXX lglkysms irlbdwarc lgh tfdghds`rmnmge mi tfms irlbdwarc wmkk nd suppkdbdgtdh wmtf lgatfdr irlbdwarc, su`f ls XAX. Iar hdsmegs tflt

    iarb eraups tfrauef atfdr lppral`fds, su`f ls blt`fmge, tfd prmg`mpkd ai ndemggmge wmtf lg MXX irlbdwarc

    stmkk lppkmds lgh sfaukh nd rdikd`tdh mg tfd dvlkultmag pklg. Iar dxlbpkd, wfdg blt`fmge ms usdh ta iarb

    eraups prmar ta praerlb hdkmvdry, mghmvmhulks (ar eraups ai mghmvmhulks) sfaukh nd lglkyzdh mg tfd eraups

    tfdy wdrd mg lt tfd tmbd ai blt`fmge.

    Zravmhd kdlr hdtlmks ai tfd hltl lglkysms usdh ta hdtdrbmgd praerlb diid`ts. Hds`rmnd tfd typds ai stltmstm`lk

    lglkysms ta nd ughdrtlcdg, spd`miymge hds`rmptmvd lglkysms lgh/ar mgidrdgtmlk lglkysms ls lppraprmltd. Mg`kuhd

    hds`rmptmags ai stltmstm`lk bahdks. Gatd tfd`avlrmltdstfd `flrl`tdrmstm`s ar vlrmlnkds tflt wmkk nd usdh mg tfd

    bahdk mg tfd hms`ussmag, lgh kdlrky hdkmgdltd tfd slbpkd (iukk ar plrtmlk3 mg`kuhmge lgtm`mpltdh smzd) ta nd

    usdh iar dl`f lglkysms.

    Kmst lgh hds`rmnd tfd stltmstm`lk pra`dhurds ta nd usdh mg lglkysms (iar dxlbpkd, hds`rmnd tfd AKP rderdssmag,

    kaemstm` rderdssmag, LGAYL, ar wfltdvdr bahdk imts tfd lglkysms pklg ndst). Xlnkd < (mg tfd Dxlbpkds lgh

    Xdbpkltds sd`tmag SLppdghmx @R lt tfd dgh ai tfms ha`ubdgt) kmsts abbag stltmstm`lk bahdks usdh mg

    dvlkultmag hdsmeg lkage wmtf dxlbpkds ai tfdmr lppkm`ltmag. Xfd rdlsags wfy pra`dhurds wdrd sdkd`tdh,

    mg`kuhmge tfd stuhy hdsmeg lgh aut`abd(s) agsmhdrdh, sfaukh lksa nd hds`rmndh. Mbpartlgtky, tfd stltmstm`lk

    pra`dhurds prapasdh bust lkmeg wmtf tfd rdsdlr`f qudstmags, lgh arrdspagh ta tfd pawdr lglkysms usdh ta

    hdtdrbmgd tfd bmgmbub slbpkd smzd.

    Lhhmtmaglk ^dsaur`ds

    Bard mgiarbltmag ag lgh

    dxlbpkds ai stltmstm`lk

    lglkysms `lg nd iaugh ag tfd

    T@KL stltmstm`lk abputmge

    wdnsmtd?

    fttp?//www.lts.u`kl.dhu/stlt/dxlbpkds/hdilukt.ftb.

    http://www.ats.ucla.edu/stat/examples/default.htmhttp://www.ats.ucla.edu/stat/examples/default.htmhttp://www.ats.ucla.edu/stat/examples/default.htmhttp://www.ats.ucla.edu/stat/examples/default.htmhttp://www.ats.ucla.edu/stat/examples/default.htm
  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    30/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI >5

    Xfd dvlkultmag pklg sfaukh nd `kdlr ag tfd kdvdk ai stltmstm`lk lglkysms (d.e., mghmvmhulk ar smtd) lgh tfms lglkysms

    sfaukh nd lt tfd slbd kdvdk ls tfd rlghab lssmegbdgt ar blt`fmge (d.e., mghmvmhulk ar smtd). Xfd lglkysms gddhs

    ta blt`f tfd kdvdk ai lssmegbdgt mg arhdr ta dgsurd tflt dvlkultars ha gat blcd lg drragdaus mgidrdg`d lnaut

    tfd stltmstm`lk smegmim`lg`d ai tfd praerlb diid`t (m.d., ls`rmnmge l trdltbdgt mbpl`t ag mghmvmhulks wfmkd

    lglkyzmge praerlb smtds mg leerdeltd). Iurtfdr, tfd dvlkultmag pklg sfaukh mg`kuhd tfd spd`mim`ltmag ai tfd

    stltmstm`lk bahdk usdh ta dstmbltd tfd praerlb diid`t, mg`kuhmge tfd lhhmtmag ai lgy avlrmltds, wdmefts, ar

    atfdr lhoustbdgts. Zravmhd tfd lssubptmags blhd mg tfd bahdk lgh mghm`ltd wfdtfdr lgy ai tfdsd lssubptmags

    lrd kmcdky ta nd vmakltdh. Iar qulsm-dxpdrmbdgtlk lgh prd-dxpdrmbdgtlk stuhmds, tfd dvlkultmag pklg sfaukh lksa

    mg`kuhd l hdtlmkdh hms`ussmag ai tfd stltmstm`lk bdtfahs usdh ta agtrak iarsdkd`tmag nmlsag ansdrvdh

    `flrl`tdrmstm`s arrdkltdh wmtf tfd aut`abds ai mgtdrdst.

    Bmssmge Hltl

    Mt ms ta nd dxpd`tdh tflt sabd plrtm`mplgts (ar `agtrak ar `abplrmsag eraup bdbndrs) bly hrap aut ai tfd

    stuhy, tfd praerlb, ar atfdrwmsd nd`abd mbpassmnkd ta `agtl`t. Xfms `rdltds bmssmge hltl, ar fakds mg tfd

    `akkd`tdh hltl, tflt gddh ta nd hdlkt wmtf mg arhdr iar l stltmstm`lkky saugh lglkysms ta tlcd pkl`d. Ufdg

    rdsdlr`fdrs lgh dvlkultars rdidr ta bmssmge hltl, tfdy edgdrlkky lrd rdidrrmge ta mgiarbltmag tflt wls gat

    `akkd`tdh, nut `aukh flvd nddg.

    Bmssmge hltl `lg nd l prankdb wfdg trymge ta ughdrstlgh tfd diid`ts ai l praerlb. Iar dxlbpkd, mi agky flki ai

    lkk plrtm`mplgts abpkdtd lg dgtmrd praerlb, nut lkk ai tfdb sfaw pasmtmvd flged, mt rdblmgs ug`kdlr mi tfd

    mbpl`t ms hud ta tfd praerlb ar mi mt ms hud ta tfd `flrl`tdrmstm`s ai tfd pdapkd wfa `abpkdtdh tfd praerlb. Mi

    gatfmge ms cgawg lnaut tfd pdapkd wfa hmh gat `abpkdtd tfd praerlb, mt waukh nd hmiim`ukt ta sly wmtf

    `drtlmgty tflt lgy flged iaugh lbage plrtm`mplgts wls hud ta praerlb plrtm`mpltmag.

    Ppd`mim` Eumhlg`d? Bmssmge Hltl

    Xfd dvlkultmag pklg sfaukh hds`rmnd faw lttrmtmag rltds wmkk nd `lk`ukltdh, natf iar tfd stuhy ls l wfakd (mg

    edgdrlk, tlcmge mgta l``augt tfd gubndr ai plrtm`mplgts wfa wdrd agtmguausky plrt ai tfd stuhy vdrsus tfdgubndr ai plrtm`mplgts wfa wdrd plrt ai tfd stuhy agky hurmge l plrtm`uklr, trug`ltdh pdrmah ai tmbd). Pmbmklr

    ta tfd avdrlkk lttrmtmag rltd, hmiidrdgtmlk lttrmtmag rltds, ar tfd rltds lt wfm`f plrtm`uklr suneraups (d.e., bdg

    vdrsus wabdg) `agtmgud ta tlcd plrt mg tfd stuhy ar gat, sfaukh lksa nd lhhrdssdh mg tfd pklg. Xfd pklg sfaukh

    hds`rmnd faw rukds wmkk nd `agstru`tdh iar hd`mhmge faw kage plrtm`mplgts flvd nddg mg tfd praerlb mg arhdr

    iar tfdb ta `augt ls flvmge abpkdtdh tfd praerlb ar gat, ar, mi lppraprmltd, wflt agstmtutds tfd vlrmaus

    lbaugts ai praerlb dxpasurd ar `abpkdtmag.

    Xa mkkustrltd, mt bly pravd usdiuk ta abplrd plrtm`mplgts wfa abpkdtdh lg dgtmrd praerlb wmtf plrtm`mplgts

    wfa abpkdtdh plrt ai tfd praerlb, ls wdkk ls tfd agtrak ar abplrmsag eraup ta ndttdr ughdrstlgh faw

    hmiidrdgt lbaugts ai dxpasurd ar plrtm`mpltmag liid`t aut`abds. Cddpmge trl`c ai natf lnsakutd lgh hmiidrdgtmlk

    lttrmtmag lg lksa nd fdkpiuk iar mbpkdbdgtltmag dvlkultmag, taa. Xflt ms, cgawmge wfdg plrtm`mplgts kdlvd lpraerlb bly fdkp mhdgtmiy lgy strdgetfs ar wdlcgdssds ai tfd praerlb.

    Pabdtmbds, nut gat mg dvdry `lsd, lhoustbdgts lrd blhd ta hltl ta lhoust iarnmlsdsrdkltdh ta bmssmge hltl.

    Hds`rmnd lgy pra`dhurds pklggdh iar lhoustmge hltl ta lssdss lgh/ar hdlk wmtf tfdsd nmlsds mg tfd hltl. Mg

    plrtm`uklr, lgy usd ai buktmpkd mbputltmag, tfd rdpkl`dbdgt ai bmssmge hltl wmtf sunstmtutdh vlkuds, sfaukh nd

    dxpklmgdh iukky lgh kdlrky. Hltl ag aut`abds ai mgtdrdst sfaukh gdvdr nd mbputdh, fawdvdr.

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    31/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI >6

    Ppd`mim` Eumhlg`d? Buktmpkd Aut`abd Bdlsurds

    Hds`rmnd tfd wlys mg wfm`f tfd dvlkultmag hdsmeg wmkk tlcd mgta l``augt tfd

    usd ai, lgh patdgtmlk prankdbs rdkltdh ta tfd usd ai, buktmpkd aut`abd

    bdlsurds. Ufdg buktmpkd aut`abd bdlsurds lrd spd`mimdh, dvlkultars gddh ta

    nd `lrdiuk ai drrars tflt bly hdvdkap mg `abplrmge tfdb. Mi tfdrd lrd buktmpkd

    rdkltdh agimrbltary qudstmags, ar l smgekd agimrbltary qudstmag dvlkultdh

    usmge buktmpkd aut`abds, hdtlmk tfd lhoustbdgts ta nd blhd ta lglkysds tardhu`d tfd kmcdkmfaah ai l Xypd-M drrar (mg`arrd`tky rdod`tmge l fypatfdsms tflt

    ms mg il`t `agimrbdh) a``urrmge. Xd`fgmquds tflt `lg nd usdh ta lhoust iar su`f l passmnmkmty lrd tfd arhdrmge ai

    buktmpkd aut`abds (prmblry, sd`aghlry, dt`.) lgh l``arhmgeky lhoustmge tfdp-vlkudsiar dl`f aut`abd, tfd usd

    ai l stltmstm`lk pra`dhurd su`f ls l Nagidrragm lhoustbdgt, ar usmge BLGAYL mi tfdrd lrd buktmpkd aut`abds.

    Lhhmtmaglk ^dsaur`ds

    Pdd Nklcdsky, dt lk. (>::=) ag

    buktmpkd aut`abd bdlsurds mg

    dvlkultmaglt

    fttp?//www.g`nm.gkb.gmf.eav/

    pb`/lrtm`kds/ZB@0:84644/.

    http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3045855/http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3045855/http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3045855/http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3045855/http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3045855/
  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    32/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI >=

    Y. Fublg Punod`ts Zratd`tmag

    Mg edgdrlk, PMI-iughdh dvlkultmags (lgh atfdr idhdrlkky-iughdh dvlkultmags) wmkk rdqumrd dmtfdr Mgstmtutmaglk

    ^dvmdw Nalrh (M^N) lppravlk, ar lg dxpklgltmag ai wfy M^N lppravlk ms gat gddhdh/lppraprmltd iar tfd

    prapasdh stuhy. Dvlkultmag pklgs edgdrlkky gddh ta nd hdsmegdh ta bddt stlghlrhs iar fublg sunod`ts

    pratd`tmag mi tfdy usd mghmvmhulk kdvdk hltl akkd`tdh irab pdapkd (wfdtfdr plrtm`mplgts, agtraks ar

    `abplrmsag eraups) tflt `aukh nd pdrsaglkky mhdgtmimlnkd. Mi tfd dvlkultmag `akkd`ts gdw hltl irab fublgsunod`ts, mt ms kmcdky tflt tfd dvlkultmag pklg wmkk gddh ta mg`kuhd faw tfd praerlb ar dvlkultar wmkk antlmg

    lppravlk iar tfd hltl `akkd`tmag pra`dss irab lg M^N. Mi tfd hltl fls lkrdlhy nddg `akkd`tdh, iar dxlbpkd, irab

    l prdvmausky dxmstmge survdy, M^N lppravlk bly gat nd gddhdh. Fawdvdr, mt ms lkwlys l eaah mhdl ta antlmg l

    wlmvdr irab lg M^N stltmge tflt fublg sunod`ts pratd`tmag wls gat gddhdh. Xfms ms plrtm`uklrky usdiuk mi, mg

    tfd iuturd, tfd rdsukts wmkk nd sunbmttdh ta `drtlmg pddr-rdvmdwdh oaurglks. M^N lppravlk ms gat gddhdh iar hltl

    tflt ms gat `akkd`tdh lt tfd kdvdk ai tfd mghmvmhulk pdrsag. Iar dxlbpkd, imglg`mlk hltl, fausmge `abpkdtmags, ar

    oans `rdltdh lt lg arelgmzltmag waukh gat gddh M^N lppravlk ta nd `akkd`tdh ar lglkyzdh.

    Xfd spd`mim` mgiarbltmag rdqumrdh ny lg M^N bly vlry, fawdvdr. Edgdrlkky, tfd lppkm`ltmag wmkk mg`kuhd l

    hds`rmptmag ai tfd stuhy, slbpkmge bdtfahs, hltl akkd`tmag bdtfahs lgh mgstrubdgts, lgh typds ai lglkysms ta

    nd `aghu`tdh. Mi gddhdh, mt bly mg`kuhd tfd oustmim`ltmag iar `akkd`tmge hltl irab vukgdrlnkd papukltmags. Mi

    mgiarbdh agsdgtms rdqumrdh, tfd M^N lppkm`ltmag wmkk kmcdky lsc iar tfd typd ai `agsdgt, ls wdkk ls pra`dhurds

    lgh ha`ubdgts ta nd usdh mg antlmgmge mgiarbdh `agsdgt. Imglkky, tfd M^N wmkk nd mgtdrdstdh mg faw tfd

    pdrsaglkky mhdgtmimlnkd hltl wmkk nd flghkdh lgh sd`urdky stardh, ls wdkk ls wfdg lgh faw tfd hltl wmkk nd

    hdstraydh.

    Ppd`mim` Eumhlg`d? Fublg Punod`ts Zratd`tmag

    Ptltd faw Fublg Punod`ts Zratd`tmag wmkk nd dgsurdh lgh wfdtfdr ar gat M^N lppravlk wmkk nd gd`dsslry. Mi

    M^N lppravlk wmkk gat nd saueft, dxpklmg wfy.

    Mi tfd dvlkultmag mg`kuhds pdrsaglkky mhdgtmimlnkd hltl, tfdg tfd dvlkultmag pklg sfaukh mg`kuhd tfd iakkawmge?

    Xfd glbd ai tfd M^N tflt wmkk nd usdh3

    Xfd typd ai lppravlk saueft3

    Xfd pra`dss usdh ny tfd glbdh M^N iar sd`urmge tfd lppravlk3

    Uflt hltl wmkk nd sunod`t ta mgiarbdh `agsdgt3 lgh

    Lg avdrvmdw ai faw mgiarbdh agsdgt wmkk nd antlmgdh.

    Mg lhhmtmag, M^N lppravlk edgdrlkky klsts iar l spd`mim` pdrmah ai tmbd, lgh tflt tmbd sfaukh nd hds`rmndh lgh

    `agiarb ta tfd dvlkultmag tmbdkmgd sunbmttdh.

    Xfd M^N lppravlk pra`dss hads tlcd tmbd lgh tfdrd bly nd lssa`mltdh `asts ls wdkk. @fd`c wmtf tfd M^N yau

    pklg ta usd hurmge yaur dvlkultmag pklg hdvdkapbdgt ta imgh aut mts tmbdkmgd lgh wfdtfdr tfdrd lrd `asts.

    Mg`kuhd tmbmge lgh ast mgiarbltmag mg tfd dvlkultmag pklg tmbdkmgd lgh nuhedt.

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    33/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI 0:

    YM. ^dpartmge Ptrltdey, Xmbdkmgd, lgh Nuhedt

    Avdrvmdw

    Xfd rdpartmge strltdey, tmbdkmgd, lgh nuhedt lrd rmtm`lk abpagdgts ai tfd dvlkultmag pklg. Xfd pra`dss ai

    lkmegmge tfdsd abpagdgts wmtf tfd td`fgm`lk lspd`ts ai yaur dvlkultmag hdsmeg wmkk fdkp yau hdtdrbmgd

    wfdtfdr yaur dvlkultmag ms l`tulkky idlsmnkd. Mg lhhmtmag, tfdy pravmhd tfd rdlhdr wmtf cdy mgiarbltmagrdelrhmge faw tfd pklg wmkk l`tulkky nd mbpkdbdgtdh lgh bagmtardh.

    ^dpartmge Ptrltdey

    Xfd ia`us ai lg dvlkultmag rdpartmge strltdey ms ta dgsurd tflt tmbdky mgiarbltmag ms lvlmklnkd iar hd`msmag

    blcmge lt cdy pamgts mg tfd praerlbs praerdss. Xfdsd cdy pamgts wmkk kmcdky lkmeg wmtf tfd praerlb kaem`

    bahdk. Ufmkd tfd sd`tmags lnavd flvd autkmgdh faw tfd praerlb wmkk antlmg lgh lglkyzd mgiarbltmag rmtm`lk

    iar lssdssmge tfd mbpkdbdgtltmag lgh aut`abds ar mbpl`ts ai tfd praerlb, tfd rdpartmge strltdey wmkk dxpklmg

    faw tfd mgiarbltmag wmkk nd hmssdbmgltdh.

    Mg hdvdkapmge tfd rdpartmge strltdey, ia`us ag wflt cdy mgiarbltmag ms gddhdh ny hd`msmag blcdrs mg`kuhmgearelgmzltmag stlii, ls wdkk ls iughdrs, nalrh bdbndrs lgh atfdrs mgvdstdh mg tfd aut`abd ai tfd praerlb.

    Xfdg, hdvdkap l sdrmds ai rdparts tflt bddt tfdsd mgiarbltmag gddhs lgh lrd lkmegdh wmtf tfd dvlkultmag

    tmbdkmgd (m.d., wflt hltl ms lvlmklnkd lt tfasd pamgts). Mi tfd kaem` bahdk pdrbmts, mt ms aitdg usdiuk ta lkmeg tfd

    dvlkultmag tmbdirlbd wmtf tfd tmbmge ai mgiarbltmag gddhs. Xflt wly, tfd dvlkultmag lg nd tfd bast usdiuk. Mt

    ms kmcdky tflt lt kdlst l nlsdkmgd lgh imglk rdpart wmkk nd gddhdh. Mgtdrbdhmltd rdparts lrd vlkulnkd mi tfdrd lrd

    smegmim`lgt bagmtarmge ar hltl akkd`tmag pamgts lkage tfd wly. Mi tfd dvlkultmag ms buktm-ydlr, tfdg lg lggulk

    rdpart bmeft mg`kuhd tfd smegmim`lgt bmkdstagds iar tflt ydlr lgh `aukh augt ls tfd mgtdrbdhmltd rdpart.

    Pmg`d praerlbs aitdg lrd rdqumrdh ta rdpart ta iughdrs lgh nalrhs ag buktmpkd dvlkultmag l`tmvmtmds, mt ms eaah

    prl`tm`d iar dvlkultars ta `abpkdtd rdparts ai dl`f `abpagdgt ai tfd stuhy ls tfdy a``ur (iar natf

    mbpkdbdgtltmag lgh mbpl`t dvlkultmag). Xfms sfaukh nd plrt ai tfd dvlkultars s`apd ai warc lgh wmkk lkkaw

    yau ta flvd tfd bast rd`dgt mgiarbltmag lvlmklnkd iar hd`msmag blcmge, ta bagmtar tfd dvlkultmag, lgh ta nd

    prdplrdh iar rdpartmge ta erlgtars. Dvlkultmag l`tmvmty rdparts aukh mg`kuhd tfd iakkawmge?

    ^dpart subblrmzmge tfd hdsmeg3

    Pubblry ai mgstrubdgt hdvdkapbdgt3

    Hdtlmkdh hds`rmptmag ai faw slbpkmge wls hagd, mg`kuhmge gubndrs ai `agtraks lgh plrtm`mplgts lgh

    lgy mssud(s) dg`augtdrdh3

    ^dpart ag dl`f hltl `akkd`tmag, mg`kuhmge dl`f mgstrubdgt usdh, faw blgy wdrd `akkd`tdh, irab wfab

    (smtds, agtraks, plrtm`mplgts, gubndr abpkdtdh), lgh wfdg3 lgh

    Hdtlmkdh rdpart ai hltl lglkysms aghu`tdh, mg`kuhmge lgy mssuds tflt lrasd ar hdvmltmags irab tfdarmemglk lglkysms pklg lgh subblrmds ai rdsukts ta hltd.

    Ppd`mim` Eumhlg`d? ^dpartmge

    Kmst lkk rdparts tflt wmkk nd prahu`dh lkage wmtf hltds. Ppd`miy faw dl`f rdpart lkmegs wmtf tfd dvlkultmag pklg

    (d.e., nlsdkmgd, mgtdrbdhmltd, imglk) lgh wflt smegmim`lgt l`tmvmtmds wmkk nd mg`kuhdh (d.e., iakkaw up hltl

    `akkd`tmag). Kmst tfd bloar sd`tmags ai tfd rdpart lgh wflt tfdy wmkk `avdr. Nd surd ta rdpart ag mbpkdbdgtltmag

    ls wdkk ls mbpl`t dvlkultmags.

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    34/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI 0

    Ppd`mim` Eumhlg`d? Nuhedt

    Xmbd Irlbd

    Xfd dvlkultmag nuhedt sfaukh rdikd`t natf tfd tmbd lgh `asts tflt mt wmkk tlcd ta l`fmdvd tfd dvmhdg`d ealks

    autkmgdh. Mi `urrdgt eulrlgtddh iughmge ms agky iar plrt ai tflt tmbd, mhdgtmiy wfm`f partmags ai tfd nuhedt lrd

    iughdh lgh wfm`f lrd praod`tdh.

    Nuhedt @abpagdgts

    Xfd dvlkultmag nuhedt sfaukh agtlmg faurs lgh asts ny pdrsag ar pasmtmag iar dl`f bloar stdp mg tfd

    dvlkultmag, lgh iar lgy atfdr sdrvm`ds tfd dvlkultar ms pravmhmge, su`f ls td`fgm`lk lssmstlg`d iar praod`t stlii.

    ]aur nuhedt sfaukh lksa mhdgtmiy lgy atfdr hmrd`t `asts lssa`mltdh wmtf tfd dvlkultmag mg`kuhmge trlvdk,

    prmgtmge, bltdrmlks lgh suppkmds, lgh abbugm`ltmags. Mghmrd`t lgh avdrfdlh asts sfaukh nd mg`kuhdh, dmtfdr

    ny pravmhmge sdplrltd kmgds iar tfdb, ar ny kalhmge tfdb agta hmrd`t `asts. ]aur nuhedt sfaukh gatd wfm`f ai

    tfdsd lppral`fds yau wmkk tlcd.

    Mt bly nd usdiuk, plrtm`uklrky mi yaur dvlkultmag pklg fls blgy `abpagdgts, ta hdvdkap (lgh mg`kuhd ls lg

    lppdghmx) l Kdvdk ai Diiart (KAD) `flrt tflt mhdgtmimds faurs ny tlsc lgh sun-tlsc, ny pdrsag. Hdvdkapmge lhdtlmkdh KAD `flrt `lg tlcd tmbd, nut mt pravmhds l vlkulnkd taak ta `fd`c tflt yaur pklg ms idlsmnkd. Iar

    dxlbpkd, lg KAD `flrt `lg tdkk yau wfdtfdr yaur praod`tdh gubndr ai hltl `akkd`tars wmkk flvd dgauef faurs

    lvlmklnkd ta `akkd`t prd-mbpkdbdgtltmag hltl ndiard yaur praerlb stlrts, ar mi yau wmkk gddh ta flvd bard hltl

    `akkd`tars warcmge lt tfd slbd tmbd.

    L gatd lnaut nuhedtmge iar dvlkultmags?

    Xfd lbaugt ai lg dvlkultmag nuhedt wmkk vlry hdpdghmge ag tfd spd`mim` hdsmeg sdkd`tdh, tfd gubndr ai smtds

    lgh plrtm`mplgts, tfd bdlsurds prapasdh, tfd tmbdirlbd iar bdlsurdbdgt, tfd typd ai lglkysms prapasdh, tfd

    gubndr lgh typd ai rdparts, lgh atfdr il`tars. Nuhedts irab l eraup ai 5: PMI dvlkultmags rd`dmvdh lvdrled

    ::

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    36/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI 00

    `lggat `aghu`t lg dvlkultmag tflt tlredts l bahdrltd kdvdk ai dvmhdg`d ls hdimgdh ny tfd PMI iar kdss tflg

    $54,::: pdr ydlr.

    Dvlkultmag asts lgh dvlkultmag-ta-praerlb nuhedt rltmas vlry nlsdh ag tfd stuhy hdsmeg fasdg lgh

    mg`rdlsd wmtf hdsmegs tflt sddc ta dstlnkmsf luslk mbpl`t.

    Xfd prm`d ai dvlkultmag eads up ls tfd kdvdk ai dvmhdg`d hdsmrdh eads up. Ptrage dvmhdg`d ms

    hmsprapartmagltdky bard dxpdgsmvd. Agd hrmvmge il`tar ms wfdtfdr ar gat tfd stuhy ms aghu`tdh l`rassbuktmpkd smtds.

    Lkk hdsmeg typds flvd tfd patdgtmlk ta nd dxpdgsmvd.

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    37/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI 08

    YMM. Dvlkultar \ulkmim`ltmags lgh Mghdpdghdg`d

    Avdrvmdw

    Dvlkultar qulkmim`ltmags lrd rmtm`lk ta l su``dssiuk dvlkultmag tflt wmkk strdgetfdg tfd kdvdk ai dvmhdg`d. L

    smgekd dvlkultar ar l tdlb ai dvlkultars ms imgd, sa kage ls lkk tfd gd`dsslry scmkks lrd avdrdh. Ufdg sdkd`tmge

    lg dvlkultar, mt fdkps mi tfd dvlkultar fls warcdh wmtf smbmklr praerlbs lgh fls hdbagstrltdh dxpdrmdg`d mg`aghu`tmge tfd spd`mim` typd ai dvlkultmag hds`rmndh mg tfd dvlkultmag pklg.

    Ppd`mim` Eumhlg`d? Dvlkultar \ulkmim`ltmags

    Xfms sd`tmag sfaukh ia`us ag tfd praerlb dvlkultar lgh tfd dvlkultars nl`ceraugh lgh qulkmim`ltmags.

    Dxpklmg wfy tfd dvlkultar wls sdkd`tdh, mg`kuhmge tfd dxtdgt ai tfd dvlkultars dxpdrmdg`d wmtf natf tfd

    `agtdgt lrdl lgh tfd typd ai dvlkultmag. Xfms wmkk kmcdky mg`kuhd kmstmge tfd dvlkultars dxpdrmdg`d wmtf smbmklr

    mgtdrvdgtmags lgh wmtf tfd typd ai @X ar\DHtflt tfd dvlkultmag ms usmge (d.e., lg ^@X mg wfm`f s`faaks,

    rltfdr tflg stuhdgts, lrd rlghabky lssmegdh ta trdltbdgt ar agtrak). Kmst tfd cdy pdapkd hdsmegmge lgh

    avdrsddmge tfd dvlkultmag lgh dgsurmge mts qulkmty lkage wmtf tfdmr dhu`ltmag/trlmgmge lgh typd lgh ydlrs ai

    dxpdrmdg`d.

    Ydrmiy tflt tfd dvlkultar lg flghkd tfd s`lkd lgh smzd ai tfd prapasdh dvlkultmag. Zravmhd lt kdlst agd

    dxlbpkd ai lg dvlkultmag tflt ms smbmklr mg smzd, `abpkdxmty, lgh gubndr ai smtds. Hms`uss tfd dxpdrmdg`d tfd

    dvlkultar fls mg blglemge smbmklr dvlkultmag prata`aks (d.e., tfms typd ai slbpkmge, hltl akkd`tmag, lglkysms). Mi

    rdkdvlgt, hads tfd dvlkultar flvd tfd `lpl`mty ta `aghu`t lg dvlkultmag wmtf buktmpkd smtds l`rass l nralh

    edaerlpfm` lrdl1

    Ppd`mim` Eumhlg`d? Dvlkultar Mghdpdghdg`d

    Mg`kuhd mgiarbltmag tflt hds`rmnds tfd mghdpdghdg`d ai tfd dvlkultar irab tfd praerlb. Xa l`fmdvd l fmef

    qulkmty dvlkultmag, mt ms mbpartlgt tflt tfd dvlkultar flvd dgauef mghdpdghdg`d ta rdghdr lg fagdst lghugnmlsdh apmgmag ai tfd praerlbs aut`abds lgh mbpl`ts. Fawdvdr, mt ms lksa mbpartlgt tflt tfd praod`t stlii

    nd lnkd ta pravmhd tfd avdrsmeft gddhdh ta dgsurd tflt tfd dvlkultmag bddts dxpd`tdh stlghlrhs. Imglkky, mt ms

    mbpartlgt tflt tfd dvlkultar gat flvd agikm`ts ai mgtdrdst rdelrhmge tfd dvlkultmag.

    Xa lhhrdss tfdsd mssuds, pravmhd l hds`rmptmag ai tfd rdkltmagsfmp ndtwddg tfd praerlb lgh tfd dvlkultar, lgh

    wflt stdps lrd ndmge tlcdg ta dgsurd mghdpdghdg`d lgh lkkdvmltd lgy lpplrdgt ar rdlk agikm`ts ai mgtdrdst. Mg

    hamge tfms, mt ms mbpartlgt ta dxpklmg tfd stru`turd ai tfd rdkltmagsfmp ndtwddg tfd mgtdrvdgtmag lgh tfd

    dvlkultmag, mg`kuhmge natf tfd rakd ai tfd praerlb stlii wmtf rdspd`t ta tfd dvlkultar. Xfms mg`kuhds

    hdtdrbmgmge wfdtfdr tfd dvlkultar ms fmrdh ny tfd praerlb arelgmzltmag, lgh mi tflt dvlkultar ms lg dbpkaydd,

    `agsuktlgt, ar autsmhd imrb. Mg lhhmtmag, wflt lrd tfd rdpartmge lgh imglg`mlk lrrlgedbdgts ndtwddg tfdpraerlb lgh tfd dvlkultar1 Ufa ms rdspagsmnkd iar emvmge hmrd`tmag lgh pravmhmge avdrsmeft1

    Lhhrdss wfdtfdr ar gat tfdrd lrd `agikm`ts ai mgtdrdst rdkltdh ta tfd dvlkultmag. @agikm`ts ai mgtdrdst `aukh nd

    rdkltdh ta l plrt ai tfd praerlb, tfd dvlkultar, ar tfd rdkltmagsfmp ndtwddg tfd twa. Iar dxlbpkd, fls tfd

    dvlkultar pklydh l rakd mg hdsmegmge tfd praerlb, ar ms tfd pdrsag supdrvmsmge tfd dvlkultar lksa rdspagsmnkd

    iar praerlb mbpkdbdgtltmag lgh su``dss1 Mi tfdrd lrd `agikm`ts ai mgtdrdst, tfdy sfaukh nd hms`kasdh lgh

    bdlsurds tlcdg ta bmtmeltd tfdb hms`ussdh.

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    38/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    gltmaglksdrvm`d.eav/PMI 04

    Mg tdrbs ai avdrsmeft, mg`kuhd l hds`rmptmag ai wfa, lt tfd praerlb kdvdk, ms rdvmdwmge dvlkultmag pklgs

    pravmhdh ny tfd dvlkultar(s) lgh tfdmr qulkmim`ltmags ta ha sa. Mg lhhmtmag, tfd hds`rmptmag ai avdrsmeft sfaukh

    hms`uss faw tfd praerlb wmkk blcd surd tflt tfd dvlkultar stlys ag s`fdhukd, prahu`ds tfd rdqumrdh

    dvlkultmag prahu`ts (d.e., hdsmeg, mgstrubdgts, hltl, lglkysms, rdparts), lgh faw tfd mghmvmhulk(s) pravmhmge

    avdrsmeft lg hdtdrbmgd tfd qulkmty ai tfd prahu`ts lgh wfdtfdr tfdy bddt stlghlrhs ai s`mdgtmim` dvmhdg`d

    lgh agiarb ta rmearaus rdqumrdbdgts su`f ls tfasd dxpd`tdh ny tfd PMI.

    Imglkky, tfd sd`tmag ag dvlkultar mghdpdghdg`d ms tfd pkl`d ta dxpklmg faw tfd imghmges wmkk nd rdkdlsdh. Ufltlrd tfd rakds ai tfd praerlb mg rdkdlsmge tfd dvlkultmag imghmges1 Hads tfd dvlkultar flvd tfd lnmkmty ta rdkdlsd

    imghmges mghdpdghdgt ai tfd praerlb1 Faw wmkk lkk plrtmds dgsurd tflt imghmges lrd rdkdlsdh mg l tmbdky

    blggdr1

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    39/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    L.::=) (Dhs.).Lppkmdh sa`mlk rdsdlr`f bdtfahs. Xfauslgh Alcs, @L? ^ussdkk Pled.

    Nklcdsky, ^., Blzubhlr, P., Hdw, B., Fau`c, Z., Xlge, E. ^dygakhs, @., & Nuttdrs, B. (>::=). @abplrmsags ai

    bdtfahs iar buktmpkd fypatfdsms tdstmge mg gdurapsy`fakaem`lk rdsdlr`f. Gdurapsy`fakaey, >0(>)? >44-98.

    Nkaab, F.P. (>::9).Xfd `ard lglkytm`s ai rlghabmzdh dxpdrmbdgts iar sa`mlk rdsdlr`f.(BH^@ Uarcmge

    Zlpdr ag ^dsdlr`f Bdtfahakaey.) dtrmdvdh irab fttp?//www.bhr`.are/smtds/hdilukt/imkds/iukkQ400.phi.

    Nkaab, F.P. (Dh.). (>::4). Kdlrgmge bard irab sa`mlk dxpdrmbdgts? Dvakvmge lglkytm` lppral`fds. Gdw ]arc? ^ussdkk

    Pled.

    Naru`f, ^.I. (::9) @agimrbltary il`tar lglkysms iar lppkmdh rdsdlr`f.Gdw ]arc? Eumkiarh.

    Mbndgs, E., & Kdbmdux, X. (>::6). ^derdssmag hms`agtmgumty hdsmegs? L eumhd ta prl`tm`d. Oaurglk ai

    D`agabdtrm`s,(>), 9::8).U.C. Cdkkaee Iaughltmag kaem` bahdk eumhd.^dtrmdvdh irab

    fttp?//www.wcci.are/cgawkdhed-`dgtdr/rdsaur`ds/>::9/:>/wc-cdkkaee-iaughltmag-kaem`-bahdk-

    hdvdkapbdgt-eumhd.lspx

    Cflghcdr, P.^., Caakwlk, E.N., & Plblh, F.L. (>:::=). Tsmge stltd tdsts mg dhu`ltmag dxpdrmbdgts?

    L hms`ussmag ai tfd mssuds(G@DD >::=-:::=:::5).^lghabmzdh imdkh trmlks lgh mgtdrglk vlkmhmty? Gat sa ilst by irmdgh. Zrl`tm`lk Lssdssbdgt,

    ^dsdlr`f & Dvlkultmag. (::8). Dvlkultmag? L systdbltm` lppral`f (5tf dh.). Xfauslgh Alcs,

    @L? Pled.

    P`fa`fdt, Z., @aac, X., Hdcd, O., Mbndgs, E. Ka`cwaah, O.^., Zartdr, O., & Pbmtf, O. (>:

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    40/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    L.>

    P`fa`fdt, Z._. (>::6l). Xd`fgm`lk bdtfahs rdpart? Eumhdkmgds iar buktmpkd tdstmge mg mbpl`t dvlkultmags (BZ^ ^didrdg`d

    Ga.? 90::-::=).Ulsfmgetag, H@? Gltmaglk @dgtdr iar Dhu`ltmag Dvlkultmag lgh ^demaglk Lssmstlg`d,

    Mgstmtutd ai Dhu`ltmag P`mdg`ds, T.P. Hdplrtbdgt ai Dhu`ltmag.

    P`fa`fdt, Z._. (>::6n). Xfd kltd prdtdst prankdb mg rlghabmzdh `agtrak trmlks ai dhu`ltmag mgtdrvdgtmags (G@DD >::=-

    8:00).Ulsfmgetag, H@? Gltmaglk @dgtdr iar Dhu`ltmag Dvlkultmag lgh ^demaglk Lssmstlg`d, Mgstmtutd ai

    Dhu`ltmag P`mdg`ds, T.P. Hdplrtbdgt ai Dhu`ltmag.

    P`fa`fdt, Z._., & @fmlge, F. (>::=). Dstmbltmag lgh Mhdgtmim`ltmag ai tfd @abpkmdr Lvdrled @luslk Diid`t Zlrlbdtdr mg

    Dhu`ltmag ^@Xs (G@DD >::6-8:::>). Dxpdrmbdgtlk lgh qulsm-dxpdrmbdgtlk hdsmegs iar edgdrlkmzdh

    `luslk mgidrdg`d.Nastag? Faueftag Bmiikmg.

    Page, B., & Fdrblg, . (>:::6).UU@ pra`dhurds lgh stlghlrhs flghnaac (Ydrsmag >.:).^dtrmdvdh irab

    fttp?//mds.dh.eav/g`dd/ww`/rdidrdg`ds/mha`vmdwdr/Ha`.lspx1ha`mh2

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    41/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    N.:::=).Plbpkmge l hmvdrsd luhmdg`d? Xmpsfddt #46.Tgmvdrsmty Zlrc, ZL? Zdgg Ptltd @aapdrltmvd

    Dxtdgsmag. fttp?//dxtdgsmag.psu.dhu/dvlkultmag/phi/XP46.phi

    Zmdr`d, P. (>::::).Pabd nlsm` mhdls ai slbpkmge.^dlhmge, Tgmtdh Cmgehab

    fttp?//www.rdlhmge.l`.uc/ss`/g/rdsaur`ds/Ha`s/PabdQNlsm`QMhdlsQAiQPlbpkmge.phi

    Dvlkultmag Lppral`f lgh Hltl @akkd`tmag

    Erddgsdmh, K. (>:`-l868-==h6>i5:-8`>l-6h>8-

    =l54`9=8=>4::=).Mssuds mg baugtmge rlghabmzdh dxpdrmbdgts mg dhu`ltmaglk rdsdlr`f lgh dvlkultmag.

    Ekanlk Oaurglk ai Dhu`ltmaglk ^dsdlr`f, 6(), >5.

    fttp?//www.ekanlkoaurglksdrmds.`ab/mghdx/mghdx.pfp/eodr/lrtm`kd/vmdwImkd/4=/phi

    Ckltt, O. & Xlykar-Zawdkk, D. (>::4).Pygtfdsms ai kmtdrlturd rdkltmvd ta tfd rdtraspd`tmvd prdtdst hdsmeg.Zrdsdgtdh lt

    Lbdrm`lg Dvlkultmag Lssa`mltmag @agidrdg`d.

    fttp?//`abb.dvlk.are/DYLK/ dsaur`ds/YmdwHa`ubdgt/1Ha`ubdgtCdy2hh96`i05-5

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    42/68

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    43/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    N.0

    Lkkmsag, Z. H. (>::=).Bmssmge hltl.Mg ^. D. Bmkkslp & L. Blyhdu-Akmvlrds (Dhs.), Xfd PLED Flghnaac ai

    \ulgtmtltmvd Bdtfahs mg Zsy`fakaey(p. 5>-6=). Xfauslgh Alcs, @L? Pled Zunkm`ltmags Mg`.

    fttp?//www.stltmstm`lkfarmzags.`ab/wp-`agtdgt/upkalhs/>:/:::/:), 0-

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    44/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    N.8

    Iukk ^dvmdw @fd`ckmst

    Dxd`utmvd Pubblry

    Xfd iakkawmge mtdbs lrd nrmdiky hds`rmndh?

    Xfd praerlb lgh mgtdghdh aut`abds/mbpl`ts3

    Xfd prmar rdsdlr`f3 Xfd tlredtdh kdvdk ai dvmhdg`d3

    Xfd dvlkultmag hdsmeg mg`kuhmge `abplrmsag/`agtrak eraup lppral`f3

    Xfd bdlsurds/mgstrubdgts3

    Xfd prapasdh lglkysms lppral`fds3

    Xfd dvlkultmag tmbmge/tmbdkmgd lgh nuhedt3 lgh,

    Xfd dvlkultmag tdlb.

    Zraerlb Nl`ceraugh lgh Zrankdb Hdimgmtmag

    Xfd pakm`y mssud ar prankdb tfd praerlb ms hdsmegdh ta lhhrdss lgh wfy mt sfaukh nd lhhrdssdh ms su``mg`tky hds`rmndh.

    Xfd mssud ar prankdb ms irlbdh nlsdh ag l rdvmdw ai rdsdlr`f. Xfd praerlb bahdk ms hds`rmndh nrmdiky mg tfd mgtrahu`tmag, lgh mg`kuhds cdy mgiarbltmag su`f ls wfa plrtm`mplgts wmkk nd, tfd

    mgtdrvdgtmag kdvdk, lgh cdy aut`abds.

    Avdrvmdw ai Zrmar ^dsdlr`f

    Zrmar rdsdlr`f `aghu`tdh ag tfms praerlb ms su``mg`tky hds`rmndh.

    Puiim`mdgt mgiarbltmag ms pravmhdh ta mhdgtmiy tfd prmar kdvdk ai dvmhdg`d lttlmgdh ny tfd praerlb .

    Zrmar rdsdlr`f `aghu`tdh ag smbmklr praerlbs ms su``mg`tky hds`rmndh.

    Puiim`mdgt mgiarbltmag ms pravmhdh ta mhdgtmiy tfd prmar kdvdk ai dvmhdg`d lttlmgdh iar smbmklr praerlbs .

    Kaem` Bahdk

    Natf l glrrltmvd lgh l erlpfm`lk hmspkly tflt iakkaws tfd `flmg ai rdlsagmge lrd mg`kuhdh.

    Xfd kaem` bahdk ag`dpts, mg`kuhmge lkk aut`abds ta nd bdlsurdh, lrd kdlrky hdimgdh.

    Faw tfd rdsaur`ds lgh l`tmvmtmds kdlh ta tfd aut`abds ms hds`rmndh.

    Agky lspd`ts hmrd`tky rdkltdh ta tfd tfdary ai flged lrd mg`kuhdh.

    Mbpl`t \udstmags

    Zraerlb mbpl`t qudstmags tflt tfd stuhy wmkk lhhrdss lrd `kdlrky stltdh.

    Xfd qudstmags lrd `agsmstdgt wmtf tfd kaem` bahdks stltdh aut`abds.

    Mi tfdrd lrd buktmpkd qudstmags rdkltdh ta tfd slbd aut`abd, `agimrbltary lgh dxpkarltary qudstmags lrd `kdlrky hdimgdh.

    Xfd agimrbltary rdsdlr`f qudstmag(s) rdprdsdgt(s) tfd blmg mbpl`t qudstmag(s) iar tfd prmblry aut`abd tflt tfd stuhy lg

    lhhrdss wmtf l cgawg kdvdk ai stltmstm`lk prd`msmag (nlsdh ag stltmstm`lk pawdr).

    \udstmags lhhrdss praerlbbltm` l`tmvmty mg tfd praerlb plrtm`mplgt eraup lgh, wfdg idlsmnkd, tfd `abplrmsag ar `agtrak eraup.

    \udstmags lrd pfrlsdh su`f tflt eraups lg nd abplrdh ta ughdrstlgh gdt diid`t ai mgtdrvdgtmag lgh hmiidrdg`ds.

    Mbpl`t qudstmags ha gat mg`kuhd mbpkdbdgtltmag qudstmags.

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    45/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    N.4

    Mbpkdbdgtltmag \udstmags

    Zraerlb mbpkdbdgtltmag qudstmags lrd `kdlrky stltdh.

    Ufdg idlsmnkd, tfd mbpkdbdgtltmag qudstmags sfaukh lhhrdss tfd kdvdk ai praerlb-kmcd sdrvm`ds rd`dmvdh ny tfd abplrmsag

    eraup.

    Mbpkdbdgtltmag qudstmags ha gat mg`kuhd mbpl`t qudstmags.

    Xfd `agtrmnutmag ta ughdrstlghmge tflt tfd dvlkultmag wmkk blcd ms `kdlrky stltdh.

    @agtrmnutmag ai tfd Ptuhy

    Xfd kdvdk ai dvmhdg`d tfd praerlb ms tlredtmge ms hds`rmndh.

    Faw tfd prapasdh dvlkultmag bddts tfd `rmtdrml iar tfms kdvdk ai dvmhdg`d ms mg`kuhdh.

    Mbpl`t Dvlkultmag Hdsmeg Pdkd`tmag

    Xfd PDZ kdlrky mhdgtmimds tfd stuhy hdsmeg sdkd`tdh.

    Xfd hds`rmptmag ai tfd hdsmeg hrlws upag prdvmaus rdsdlr`f ar kmtdrlturd, wfdrd lvlmklnkd.

    Xfd PDZ prdsdgts l rltmaglkd iar tfd hdsmeg sdkd`tdh.

    Xfd PDZ oustmimds tfd tlredt kdvdk ai dvmhdg`d nlsdh ag l hms`ussmag ai mgtdrglk lgh dxtdrglk stuhy vlkmhmty.

    ^lghabmzdh Ndtwddg-Eraups Hdsmeg (mi lppkm`lnkd)

    Tgmt ai rlghab lssmegbdgt ms kdlrky mhdgtmimdh (lgh lkmegdh wmtf tfd ugmt ai lglkysms).

    Zra`dhurds ta `aghu`t tfd rlghab lssmegbdgt, mg`kuhmge wfa mbpkdbdgtdh tfd rlghab lssmegbdgts, faw tfd pra`dhurds wdrd

    mbpkdbdgtdh, lgh pra`dhurds usdh ta vdrmiy tflt pranlnmkmty ai lssmegbdgt eraups, lrd hds`rmndh lgh edgdrltdh ny rlghab

    gubndrs.

    Nka`cmge, strltmim`ltmag, ar blt`fmge pra`dhurds usdhta mbpravd prd`msmag mg tfd dstmbltd ai tfd praerlb diid`t ar ta nlklg`d

    eraups ag bdlsurdh flrl`tdrmstm (s)lrd hds`rmndh.

    Xfd praerlb eraup lgh ta tfd dxtdgt passmnkd, tfd agtrak eraup aghmtmags lrd hds`rmndh.

    Lgy ag`drgs tflt prapasdh strltdemds ar lppral`fds wmkk kdlh ta gagdqumvlkdgt eraups lrd hms`ussdh.

    Tgmt ai blt`fmge ms kdlrky mhdgtmimdh (lgh lkmegdh wmtf tfd ugmt ai lglkysms).

    Zra`dhurds ta `lrry aut tfd blt`fmge ta iarb l `abplrmsag eraup lrd hds`rmndh.

    Ndtwddg-Eraups Hdsmeg- Iarbdh ny Blt`fmge (mi lppkm`lnkd)

    L prd`dhdgt mg tfd kmtdrlturd iar mg`kuhmge tfd vlrmlnkds usdh mg tfd blt`fmge ms mg`kuhdh.

    Bdtfahs usdh ta iarb tfd prapasdh abplrmsag eraup lrd hds`rmndh su`f tflt tfd vlkmhmty ai tfd blt`fmge ms dxpklmgdh.

    ^dlsags wfy tfd `abplrmsag eraup bmeft hmiidr irab tfd trdltbdgt eraup lgh tfrdltdg mgtdrglk vlkmhmty, lgh tfd wlys mg wfm`f

    tfd prapasdh bdtfahs lhoust iar tfasd hmiidrdg`ds, lrd hms`ussdh.

    Ndtwddg-Eraups Hdsmeg- Iarbdh ny @ut-aii P`ard (^HH) (mi lppkm`lnkd)

    Bdlsurd lgh utaii s`ard lrd kdlrky mhdgtmimdh (lgh lkmegdh wmtf tfd ugmt ai lglkysms).

    @utaii s`ard ms `kdlrky hdkmgdltdh lgh oustmimdh.

    Bdtfahs usdh ta lppky tfd utaii s`ard lrd hds`rmndh mg hdtlmk.

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    46/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    N.9

    Pmgekd Eraup Hdsmeg (mi lppkm`lnkd)

    Dl`f mgtdrvdgtmag pflsd ai tfd hdsmeg, mg`kuhmge tfd nlsdkmgd aghmtmag, ms kdlrky hds`rmndh.

    Gubndr ai bdlsurds hurmge dl`f bdlsurdbdgt pflsd ms hdtlmkdh.

    Gubndr ai bdlsurds hurmge dl`f bdlsurdbdgt pflsd ms suiim`mdgt ta dstlnkmsf trdgh lgh rukd aut rmvlk dxpklgltmags.

    Xmbmge ai bdlsurds prd/past mgtdrruptmag ms lppraprmltd ta tfd mgtdrvdgtmag.

    Mgtdrruptdh Xmbd Pdrmds Hdsmeg (mi lppkm`lnkd)

    Gubndr ai bdlsurdbdgt pamgts ndiard lgh litdr tfd mgtdrvdgtmag ms hds`rmndh.

    Xfd gubndr ai bdlsurds hurmge dl`f bdlsurdbdgt pflsd ms sfawg ta nd suiim`mdgt ta dstlnkmsf l trdgh lgh rukd aut rmvlk

    dxpklgltmags.

    Xfd tmbmge ai bdlsurds prd/past mgtdrruptmag ms sfawg ta nd lppraprmltd ta tfd mgtdrvdgtmag.

    @abplrmsag lsds lrd kdlrky hds`rmndh.

    Zrd-Dxpdrmbdgtlk Hdsmeg (mi lppkm`lnkd)

    Iukk stuhy hdsmeg ms `kdlrky lgh abprdfdgsmvdky dxpklmgdh.

    Hds`rmptmag ai tfd trdltbdgt lgh `augtdril`tulk eraups lrd mg`kuhdh.

    Ufdrd lppraprmltd, lssmegbdgt ai stuhy plrtm`mplgts ta eraups ms hds`rmndh.

    Lhhmtmaglk tfrdlts ta tfd mgtdrglk vlkmhmty ai tfd hdsmeg lrd hms`ussdh.

    Ulys iuturd dvlkultmags lg nd hdsmegdh ta rukd aut tfdsd tfrdlts lrd hds`rmndh.

    Idlsmnmkmty Ptuhy (mi lppkm`lnkd)

    Iukk stuhy hdsmeg ms `kdlrky lgh abprdfdgsmvdky dxpklmgdh.

    Hds`rmptmag ai tfd trdltbdgt lgh `augtdril`tulk eraups lrd mg`kuhdh.

    Ufdrd lppraprmltd, lssmegbdgt ai stuhy plrtm`mplgts ta eraups ms hds`rmndh.

    Xfd mgstrubdgts ar pra`dssds ta nd tdstdh mg tfd idlsmnmkmty stuhy lrd hds`rmndh.

    @abnmgltmag Hdsmeg (mi lppkm`lnkd)

    @kdlr hdtlmks ai lkk hdsmeg `abpagdgts lrd pravmhdh.

    L rltmaglk iar usmge l `abnmgdh lppral`f tflt mhdgtmimds faw tflt lppral`f lhhrdssds tfrdlts ta mgtdrglk lgh dxtdrglk vlkmhmty ms

    hms`ussdh.

    Ppd`mim` pklgs iar bdlsurmge imhdkmty ai praerlb mbpkdbdgtltmag (m.d., faw wdkk tfd praerlb wls l`tulkky mbpkdbdgtdh) mg tfd

    praerlb eraup lrd prdsdgtdh.

    Zklgs iar bdlsurmge tfd kdvdk ai praerlb sdrvm`ds tfd praerlb eraup l`tulkky rd`dmvdh, mg`kuhmge tfd rmtdrml iar lssdssmge

    wfdtfdr lg lhdqultd lbaugt lgh qulkmty ai tfd praerlb wls hdkmvdrdh ta plrtm`mplgts, lrd hds`rmndh.

    Mbpkdbdgtltmag Dvlkultmag

    Zklgs iar lssdssmge wfdtfdr tfd `agtrak ar `abplrmsag eraup rd`dmvdh praerlb sdrvm`ds, mg`kuhmge tfd `rmtdrml iar lssdss tfd dxtdg

    ta wfm`f tfdrd wls hmiiusmag ai tfd praerlb ta tfd `agtrak ar `abplrmsag eraup lrd pravmhdh.

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    47/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    N.5

    Plbpkmge Zklg lgh Zawdr Lglkysms Dvlkultmag

    Xfd smzd lgh `abpasmtmag ai tfd slbpkd ms hds`rmndh lgh ms `agsmstdgt wmtf tfd Nuhedt sd`tmag.

    Plbpkmge pklg ms hdsmegdh ta sdkd`t plrtm`mplgts tflt lrd rdprdsdgtltmvd ai tfd papukltmag irab wfm`f tfdy wdrd sdkd`tdh.

    Xfd tlredt papukltmag irab wfm`f tfd slbpkd wls sdkd`tdh lgh tfd slbpkd sdkd`tmag pra`dhurds, mg`kuhmge lgy edaerlpfm`

    rdemags tlredtdh lrd hds`rmndh.

    Ptltmstm`lk pawdr ms dstmbltdh lgh agsmstdgt wmtf tfd stuhy hdsmeg. Xfd stltmstm`lk pawdr lglkysms usdh ta lrrmvd lt tfd slbpkd smzd ms hds`rmndh, lgh mg`kuhds tfd bmgmbub hdtd`tlnkd diid`t smzd

    (BHDP) tflt fls lg 6: pdr`dgt flg`d ai ndmge stltmstm`lkky smegmim`lgt lt l spd`mim` lkpfl kdvdk.

    Aut`abd(s) lgh lssubptmags usdh mg tfd stltmstm`lk pawdr lk`ukltmags lrd hds`rmndh.

    Ufdg tfdrd lrd pklgs ta `aghu`t lglkysds ai suneraups, lhhmtmaglk stltmstm`lk pawdr lglkysds lrd prdsdgtdh ta dstmbltd tfasd

    BHDP.

    Plbpkd ^dtdgtmag

    Ptrltdemds ta rd`rumt stuhy plrtm`mplgts lrd hds`rmndh.

    Lktdrgltmvd strltdemds tflt lg nd mbpkdbdgtdh mi tfd mgmtmlk strltdey ms ugsu``dssiuk lrd autkmgdh.

    Zklg hds`rmnds strltdemds lgh mg`dgtmvds ta rd`rumt lgh rdtlmg stuhy plrtm`mplgts (d.e. rdbugdrltmag iar lkk plrtm`mplgts).Oustmim`ltmag ms emvdg iar lbaugt ai rdbugdrltmag.

    L blgledbdgt pklg ta bagmtar, trl`c, lgh traunkdsfaat mssuds tflt lrmsd mg rdtlmgmge tfd stuhy slbpkd hurmge praerlb

    mbpkdbdgtltmag ms hds`rmndh.

    Bdlsurds

    Faw dl`f aut`abd ms lkmegdh wmtf tfd kaem` bahdk.

    Mi tfdrd lrd buktmpkd aut`abds, ls mghm`ltdh ny tfd kaem` bahdk lgh tfd rdsdlr`f qudstmags, tfd pklg hmiidrdgtmltds ndtwddg

    `agimrbltary lgh dxpkarltary aut`abds `agsmstdgt wmtf tfd kaem` bahdk lgh rdsdlr`f qudstmags.

    Faw dl`f vlrmlnkd irab tfd kaem` bahdk wmkk nd bdlsurdh ms hdtlmkdh.

    Iar dl`f bdlsurd, wfdtfdr tfd bdlsurd wmkk nd hdvdkapdh ar fls lkrdlhy nddg hdvdkapdh (m.d., l abbdr`mlkky lvlmklnkd, aii-tfd-sfdki bdlsurd) ms dxpklmgdh.

    Mi tfd aut`abd bdlsurd hmiidrs l`rass smtds ar eraups/sun eraups ai slbpkd bdbndrs, faw tfd hmiidrdgt bdlsurds wmkk nd

    `abnmgdh ms hds`rmndh.

    Bdlsurd Ylkmhmty, ^dkmlnmkmty lgh Fmstary ai Tsd

    Mgiarbltmag rdelrhmge dl`f bdlsurds rdkmlnmkmty lgh vlkmhmty (d.e., @ragnl`fs lkpfl), lgh vlkmhltmag lelmgst aut`abds ls wdkk ls

    fmstarm`lk usd, mi lvlmklnkd, ms pravmhdh.

    Mi rdkmlnmkmty lgh vlkmhmty ai bdlsurds flvd ydt ta nd hdtdrbmgdh, lg lglkysms pklg iar hamge sa ms prdsdgtdh.

    Hltl @akkd`tmag L`tmvmtmds (iar dl`f hltl saur`d tfd PDZ mg`kuhds)

    L hds`rmptmag ai nlsdkmgd bdlsurds ms pravmhdh.

    Xfd tmbmge ai nlsdkmgd akkd`tmag rdkltmvd ta stlrt ai tfd mgtdrvdgtmag ms hds`rmndh. Ufdtfdr nlsdkmgd bdlsurds lrd lhdqultd iar lssdssmge nlsdkmgd dqumvlkdg`d ms dxpklmgdh.

    L hds`rmptmag ai wfa wmkk `akkd`t tfd hltl ms mg`kuhdh .

    L hds`rmptmag ai tfd rakd ai stlii bdbndrs hdkmvdrmge tfd mgtdrvdgtmag wmtf rdelrh ta hltl `akkd`tmag ms hds`rmndh. Xfd tmbmge ai tfd hltl `akkd`tmag, rdkltmvd ta hdkmvdry ai tfd praerlb ms dxpklmgdh. Hms`ussmag ai faw tfd hltl wmkk nd `akkd`tdh ms mg`kuhdh.

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    48/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    N.6

    Hms`ussmag ai wfdtfdr tfd bahd ai hltl `akkd`tmag ms tfd slbd iar tfd mgtdrvdgtmag lgh `agtrak eraups ms mg`kuhdh. Mi lhbmgmstrltmvd rd`arhs (d.e. s`faak l`lhdbm`/trulg`y rd`arhs3 ugdbpkaybdgt mgsurlg d hltl) wmkk nd usdh, tfd saur`d lgh

    lvlmklnmkmty ai tfdsd hltl ls wdkk ls tfd dvlkultars dxpdrmdg`d usmge tfdsd hltl saur`ds lrd hds`rmndh. Dxpd`tdh slbpkd smzds lt dl`f hltl `akkd`tmag pamgt lrd mg`kuhdh.

    Ptltmstm`lk Lglkysms ai Mbpl`ts

    Mi l ndtwddg-eraups hdsmeg ms pklggdh, lg Mgtdgt-ta-Xrdlt (MXX) lglkysms ms hds`rmndh, wfm`f abplrds aut`abds ndtwddg tfasd

    lssmegdh praerlb sdrvm`ds lgh tfasd gat lssmegdh.

    L kdlr hds`rmptmag ai tfd stdps ai tfd lglkysms ms pravmhdh.

    Faw tfd stltmstm`lk lglkysms ai tfd hltl ms lkmegdh wmtf tfd rdsdlr`f qudstmags ms dxpklmgdh.

    Faw tfd stltmstm`lk lglkysms ms lkmegdh su`f tflt tfd ugmt ai lglkysms arrdspaghs ta tfd ugmt ai lssmegbdgt ms hds`rmndh.

    Xfd stltmstm`lk bahdk usdh ta dstmbltd tfd praerlb diid`t ms iukky spd`mimdh lgh lkk vlrmlnkds mg tfd bahdk (lgh tfdmr adiim`mdgts)

    lrd hdimgdh.

    Lssubptmags ai tfd bahdk lrd kmstdh.

    Xfd praerlb diid`t bahdk ms sfawg ta nd `agsmstdgt wmtf tfd stltmstm`lk bahdk usdh iar tfd stltmstm`lk pawdr lglkysms hurmge tfd

    hdsmeg stled.

    Bahdk dstmbltmag pra`dhurds lrd mg`kuhdh. Mi lppkm`lnkd, avlrmltd lhoustbdgts ta dstmbltdh praerlb diid`ts, lhoustbdgts iar bmssmge hltl, dstmbltmag ai stlghlrh drrars, lgh

    `arrd`tmags iar buktmpkd `abplrmsags lrd hds`rmndh.

    Mi usmge l gag-rlghabmzdh ndtwddg-eraups hdsmeg, stltmstm`lk bdtfahs tflt lhdqultdky agtrak iar sdkd`tmag nmls ag ansdrvdh

    `flrl`tdrmstm`s lrd hds`rmndh.

    Plbpkd ^dtdgtmag lgh Bmssmge Hltl

    Faw avdrlkk lgh hmiidrdgtmlk lttrmtmag wmkk nd `lk`ukltdh lgh lssdssdh ms hdtlmkdh.

    Lg autkmgd ai spd`mim` pra`dhurds pklggdh iar lssdssmge lgh lhoustmge iar patdgtmlk nmlsds, hud ta gag-`agsdgt lgh hltl gag-

    rdspagsd, ms mg`kuhdh.

    Lgy mgtdgtmags ta usd buktmpkd mbputltmag iar bmssmge hltl lrd hms`ussdh. Xfms mbputltmag sfaukh blt`f tfd lglkysms ta nd`aghu`tdh (tfd mbputltmag bahdk sfaukh usd buktm-kdvdk pra`dhurds mi tfd lglkysms ms buktm-kdvdk3 mi tfd stltmstm`lk lglkysms usds

    blxmbub kmcdkmfaah ar Nlyds ta mg`arparltd bmssmge hltl plttdrgs, tfdg tfms sfaukh lksa nd gatdh).

    L nrmdi hds`rmptmag ai faw tfd pklg ms hdsmegdh ta bmgmbmzd bmssmge hltl wmtf plrtm`uklr ia`us ag bmgmbmzmge hmiidrdgtmlk lttrmtmag

    ms pravmhdh.

    Buktmpkd Aut`abd Bdlsurds

    Mi tfd prapaslk fls buktmpkd rdkltdh `agimrbltary rdsdlr`f qudstmags, ar l smgekd `agimrbltary qudstmag dvlkultdh usmge buktmpkd

    aut`abds, lhoustbdgts blhd ta rdhu`d tfd flg`d ai l Xypd-M drrar lrd hds`rmndh.

    Fublg Punod`ts Zratd`tmag

    Mi tfd rdsdlr`fdrs wmkk warc wmtf pdrsaglkky mhdgtmimlnkd hltl, pra`dhurds ta sd`urd M^N lppravlk lrd hms`ussdh. Zklgs rdqumrmge

    M^N lppravlk sfaukh mg`kuhd?

    M^N(s) tflt wmkk rdvmdw tfd sunbmttdh lppkm`ltmag3

    Xypd ai lppravlk saueft lgh pra`dss iar sd`urmge tfms lppravlk3

    Hurltmag tflt tfd lppravlk wmkk nd mg diid`t, lgh dxpd`tdh lppravlk hltd3 lgh,

    Xmbdkmgd iar wfdg lgh faw tfms lppravlk wmkk nd sd`urdh.

    Zklgs tflt ha gat rdqumrd M^N lppravlk dxpklmg wfy tfdy ha gat tfmgc lppravlk ms gd`dsslry.

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    49/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    N.=

    ^dpartmge

    Xfd rdpartmge strltdey kmsts tfd rdparts tflt wmkk nd sunbmttdh, tfdmr tmbmge lgh agtdgt.

    ^dparts mg`kuhd lt kdlst l nlsdkmgd lgh imglk rdpart.

    Iar buktm-ydlr dvlkultmags, lg lggulk rdpart ms mg`kuhdh.

    Xfd agtdgt ai tfd rdparts avdrs lkk tfd bloar dvlkultmag dvdgts/l`tmvmtmds, tfdmr rdsukts/imghmges, lgh rd`abbdghltmags.

    Xmbdkmgd

    Xfd tmbdkmgd gatds tfd pdrmah iar hdsmeg (mg`kuhmge M^N kdlrlg`d mi gddhdh), nlsdkmgd hltl akkd`tmag, prdtdstmge, rlghab

    lssmegbdgt, mgtdrvdgtmag mbpkdbdgtltmag, past-tdstmge, lgh dl`f iakkaw-up pdrmah, mi lppkm`lnkd.

    L tmbdkmgd iar hltl `akkd`tmag, iakkaw-up, lglkysms, lgh rdpartmge ms mg`kuhdh.

    P`fdhukd iar `akkd`tmge lgh rdpartmge ag mgtdrbdhmltd aut`abds tflt lrd lkmegdh wmtf kaem` bahdk lgh dvlkultmag hdsmeg ms

    mg`kuhdh.

    M^N lppravlk ms mg`kuhdh mg tfd tmbdkmgd.

    Nuhedt

    L kmst ai cdy dvlkultmag lgh praerlb stlii/`agsuktlgts, mg`kuhmge rakds lgh tatlk gubndr ai faurs, ms pravmhdh.

    Lppraxmbltd asts ny bloar abpagdgts ai tfd stuhy (d.e., pklggmge lgh praod`t lhbmgmstrltmag, mgstrubdgt hdvdkapbdgt, M^N

    lppravlk, slbpkmge, hltl akkd tmag, hltl lglkysms, rdpart wrmtmge, prdsdgtltmags), ny ydlr, lrd mg`kuhdh. Zkdlsd rdidr ta tfd

    Dxlbpkds ai Nuhedtmg Lppdghmx @.

    Tgiughdh, nut lgtm`mpltdh, dvlkultmag ydlrs lrd mg`kuhdh ls dstmbltds.

    M^N `asts lrd mg`kuhdh mg tfd nuhedt.

    Xfd nuhedt ms lkmegdh wmtf tfd rdsdlr`f hdsmeg lgh tlredt kdvdk ai dvmhdg`d.

    Dvlkultar \ulkmim`ltmags

    Xfd dxtdgt ta wfm`f tfd dvlkultar/tdlb fls suiim`mdgt `lpl`mty ta `aghu`t tfd prapasdh dvlkultmag, mg tdrbs ai td`fgm`lk

    dxpdrmdg`d lgh tfd smzd/s`lkd ai tfd dvlkultmag, ms hds`rmndh.

    Xfd dvlkultar/tdlbs prmar dxpdrmdg`d wmtf smbmklr dvlkultmags ms hds`rmndh.

    Dvlkultar Mghdpdghdg`d

    Ptdps tflt wmkk nd tlcdg ta dgsurd tfd mghdpdghdg`d ai tfd dvlkultmag lrd dxpklmgdh.

    Xfd rakd tflt tfd praerlb wmkk pkly mg avdrsddmge tfd dvlkultmag ms hds`rmndh.

    Xfd pra`dss ta dgsurd tflt tfd dvlkultars imghmges lrd rdkdlsdh mg l tmbdky ilsfmag, lgh, wfdg tfd dvlkultmag ms abpkdtdh, tfd

    dxtdgt ta wfm`f tfd dvlkultar wmkk nd lnkd ta rdkdlsd tfd imghmges wmtfaut prmar lppravlk ny tfd praerlb/arelgmzltmag ms hds`rmndh

    Faw tfd mgmtmlk rdkdlsd ai tfd rdsukts wmkk nd flghkdh ny tfd dvlkultar lgh wflt tfd praerlb/arelgmzltmag rakd wmkk nd mg

    hmssdbmgltmge tfd imghmges ms dxpklmgdh.

    Hms`ussmag ai tfd rdvmdw pra`dss tflt wmkk nd usdh ta dgsurd tflt tfd dvlkultmag bddts stlghlrhs ai s`mdgtmim` dvmhdg`d ms mg`kuhdh.

    Lgy patdgtmlk dvlkultar ar praerlb `agikm`ts ai mgtdrdst lrd dxpklmgdh.

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    50/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    @.

    Zrmar Dvmhdg`d ai Zraerlb Diid`tmvdgdss- Plbpkd Xlnkd

    Xmtkd, Lutfar,

    Zunkm`ltmag ]dlr lgh

    Paur`d ai Ptuhy

    Zddr

    ^dvmdw

    (]/G)

    Hltd ai

    Hltl

    @akkd`tmag

    Ptuhy Xypd

    (^@X, \DH,

    Aut`abds

    agky)

    Plbpkd

    Pmzd

    Plbpkd

    Hds`rmptmag

    Aut`abd

    Bdlsurds Cdy Ptuhy dsukts Diid`t Pmzds

    Pmbmklrmty ta

    Zrapasdh Zraerl

    Diid`ts ai Litdr P`faak

    @flrl`tdr Dhu`ltmag ag

    ^dlhmge P`ards, Pbmtf,

    ^.K. lgh Had, O.B. >::>

    Zrmvltd dvlkultmag

    lvlmklnkd lt

    www.dvlk.are G ::: ^@X

    8:: X

    0:: @

    Dkdbdgtlry

    P`faak stuhdgts

    erlhds >-4, mg l

    hmstrm`t wmtf 94%

    Fmsplgm`

    papukltmag.

    @XNP,

    Zlrtm`mplgt

    lgh Zlrdgt

    Purvdys

    Zlrdgts ai plrtm`mplgts

    wdrd bard kmcdky tflg

    gag-plrtm`mplgts ta

    rdpart tflt tfdmr `fmkhrdg

    flh mbpravdh rdlhmge

    scmkks.

    Ga smegmim`lgt hmiidrdg`d

    wls iaugh ag tdst s`ards.

    .> iar plrdgt

    eraup

    hmiidrdg`ds

    G/L iar

    `fmkhrdg

    Xfms stuhy ia`us

    ag tfd slbd

    mgtdrvdgtmag lt l

    hmiidrdgt smtd, wm

    l hmiidrdgt

    papukltmag.

    Aur Lggdx >::=

    Zraerlb Dvlkultmag

    ^dpart, >::= G >: erlhd

    kdvdks ag tfd XAU^D Gat `lk`ukltdh

    Ptuhy ai tfd slb

    mgtdrvdgtmag

    `aghu`tdh lt tfd

    slbd praerlb sm

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    52/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG IT

    @.0

    Kaem` Bahdk Dxlbpkd

    Plbpkd Kaem` Bahdk? Plbpkd Zraerlb, @akkded Zrdplrltmag Ea @akkded!

    Mgputs L`tmvmtmds Autputs Aut`abds Mbpl`ts@akklnarltmge s`faaks lgh stlii

    Ea @akkded! nalrh

    Ea @akkded! kdlhdrs lgh gltmaglkstlii

    Imglg`mlk suppart iar Ea @akkded!

    irab iaughltmags, prmvltd

    mghmvmhulks, nusmgdssds, lgh

    eavdrgbdgt

    Hltl systdb ta trl`c stuhdgts

    praerdss lgh pravmhd ageamge

    iddhnl`c

    \ulrtdrky kdlhdrsfmp warcsfaps

    iar pddr kdlhdrs

    Xlmkardh praidssmaglk

    hdvdkapbdgt iar tdl`fdrs lgh`augsdkars

    ]dlr-kage `klss iar sdgmars ag

    `akkded/ pastsd`aghlry pklggmge

    Ea @akkded! praerlb iar gmgtf

    tfrauef dkdvdgtf-erlhdrs

    0: Zddr kdlhdrs trlmgdh

    0: Xdl`fdrs lgh `augsdkarsrd`dmvd 8: faurs ai praidssmaglk

    hdvdkapbdgt

    >:: sdgmars lttdgh tfd ydlr-kage

    `klss

    9:: gmgtf tfrauef dkdvdgtf

    erlhdrs plrtm`mpltd mg tfd Ea

    @akkded! praerlbbmge

    Ptlii lgh stuhdgts mg`rdlsd

    dxpd`tltmags iar stuhdgts fmef

    s`faak l`lhdbm` l`fmdvdbdgt

    Ptlii lgh stuhdgts mg`rdlsddxpd`tltmags iar pastsd`aghlry

    dhu`ltmag

    Pdgmars elmg cgawkdhed lnaut

    tfd `akkded lppkm`ltmag lgh

    dgrakkbdgt pra`dss

    P`faak-wmhd akkded-eamge

    `ukturd tflt kaacs ndyagh fmef

    s`faak erlhultmag

    Mg`rdlsd mg abpkdtdh akkdedlppkm`ltmags lgh mg atfdr

    bmkdstagds mg tfd `akkded

    lppkm`ltmag pra`dss

    Mg`rdlsd mg fmef s`faak

    lttdghlg`d, pdrsmstdg`d, lgh

    erlhultmag

    Mg`rdlsd mg akkded dgrakkbdgt

    lgh su``dss

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    53/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG IT

    @.8

    Dxlbpkds ai Xmbdkmgds

    Plbpkd Dvlkultmag Xmbdkmgd mg Erlpfm` Iarb

    Zklggmge

    M^N

    Plbpkmge

    Hltl @akkd`tmag Mgstrubdgt @rdltmag

    Hltl @akkd`tmagLglkysms

    Mgtdrvmdws wmtf Cdy Ptlii

    ^dpart Urmtmge

    ^dpart Hdlhkmgds

    Bddtmges wmtf Zraerlb Ptlii

    < > 0 8 4 9 5 6 = -0 Bagtf ? Dvlkultmag Nuhedt

    Xfd tdbpkltd ndkaw ms lgatfdr lppral`f ta pravmhmge l hdtlmkdh Dvlkultmag Nuhedt.

    @ast ny Dvlkultmag @abpagdgt? Dvlkultar, Zraod`t Ptlii, lgh Atfdrs

    Xfd tdbpkltd ndkaw ms iar ]dlr < nut tfd imglk dvlkultmag nuhedt sfaukh `avdr tfd iukk kdgetf ai

    tfd dvlkultmag (d.e. ]dlr >, ]dlr 0, dt`.).

  • 8/9/2019 CNCS SIF Evaluation Guidance 8 5 2014

    56/68

    DYLKTLXMAG ZKLG ETMHLG@D PA@MLK MGGAYLXMAG ITGH

    @.5

    ]dlr