3
6WDWLVWLFV6WXG\6KHHW 3DJHRI Simpson: Paradox and Confounding &RUUHODWLRQYV&DXVDWLRQ 2IWHQZHQRWLFHDVWURQJDVVRFLDWLRQEHWZHHQWZRYDULDEOHV$VWURQJDVVRFLDWLRQ EHWZHHQYDULDEOHVLVQHFHVVDU\IRUWKHUHWREHDFDXVDOUHODWLRQVKLSEHWZHHQWKHP%XW EHIRUHZHFDQFRQFOXGHWKDWRQHYDULDEOHFDXVHVRUDIIHFWVWKHRWKHUZHPXVWEHDZDUH RIWKHSRVVLELOLW\RIFRQIRXQGLQJFRPPRQUHVSRQVHRUOXUNLQJYDULDEOHV &RQIRXQGLQJ 6XSSRVHDWUDFNFRDFKEHOLHYHVDVWURQJDVVRFLDWLRQH[LVWVEHWZHHQWRWDOSUDFWLFHWLPH VSHQWRQWKHKLJKMXPSDQGWUDFNPHHWSHUIRUPDQFH/HW[EHWKHH[SODQDWRU\YDULDEOH WRWDOSUDFWLFHWLPH/HW\EHWKHUHVSRQVHYDULDEOHKHLJKWMXPSHGDWDWUDFNPHHW $FRQIRXQGLQJRUKLGGHQYDULDEOH]DFWLQJKHUHZRXOGEHWKHDWKOHWHVQDWXUDOKLJK MXPSDELOLW\6RPHRQHZKRKDVQWSUDFWLFHGPXFKFRXOGZLQWKHKLJKMXPSHYHQWDWD WUDFNPHHWVLPSO\EHFDXVHRIJUHDWHUQDWXUDODELOLW\:HVD\WKDWWKHYDULDEOHQDWXUDO DELOLW\FRQIRXQGVWKHHIIHFWRIWKHH[SODQDWRU\YDULDEOH[WRWDOSUDFWLFHWLPHRQWKH UHVSRQVHYDULDEOH\WUDFNPHHWSHUIRUPDQFH,QWKLVFDVHWZRWKLQJVKDYHDSRWHQWLDO HIIHFWRQWKHUHVSRQVHYDULDEOHEXWVLQFHZHRQO\PHDVXUHGRQHRIWKHPSUDFWLFHDQ\ GLIIHUHQFHVLQKHLJKWMXPSHG\LVJRLQJWRDSSHDUWRFRPHRQO\IURPGLIIHUHQFHVLQ SUDFWLFH[,QIDFWWKHYDULDEOHDELOLW\DOVRFRQWULEXWHVWRKHLJKWMXPSHGEXWZHFDQW VHHLWVHIIHFWEHFDXVHZHKDYHQWPHDVXUHGLW :HVD\WKDWWZRYDULDEOHV[DQG]DUHFRQIRXQGHGZKHQZHFDQWLVRODWHWKHLUVHSDUDWH HIIHFWVRQWKHUHVSRQVHYDULDEOH\%RWKPD\KDYHDQHIIHFWRQ\RUSHUKDSVRQO\RQH GRHVEXWWKHLUHIIHFWVDUHFRQIXVHGRUFRQIRXQGHGZLWKRQHDQRWKHULIZHGRQW PHDVXUHERWK[DQG]7KHYDULDEOH]LVDOXUNLQJYDULDEOHLQWKLVFDVH,WKDVDQHIIHFW ZHFDQVHHEXWZHFDQWWHOOZKHUHWKHHIIHFWUHDOO\FRPHVIURPIURP[RUIURP VRPHZKHUHHOVH &RPPRQ5HVSRQVH $VWURQJQHJDWLYHDVVRFLDWLRQH[LVWVEHWZHHQWKHQXPEHURI79VHWVLQDJLYHQFRXQWU\ DQGWKHQXPEHURIVWDUYLQJSHRSOHWKHUH7KHPRUH79VHWVDFRXQWU\KDVWKHIHZHU VWDUYLQJSHRSOHLWKDV6XSSRVHZHFRQFOXGHWKDWLQFUHDVLQJWKHH[SODQDWRU\YDULDEOH[ WKHQXPEHURI79VHWVZRXOGGLPLQLVKWKDWFRXQWU\VQXPEHURIVWDUYLQJSHRSOHWKH UHVSRQVHYDULDEOH\:HPLJKWWU\WRUHGXFHVWDUYDWLRQE\VHQGLQJWKDWFRXQWU\79VHWV ,QUHDOLW\RQHOXUNLQJYDULDEOH²DQDWLRQVZHDOWK²FDXVHVDFRPPRQUHVSRQVHDPRQJ WKHRWKHUYDULDEOHV,WFDXVHVDQLQFUHDVHLQWKHQXPEHURI79VHWVDQGDGHFUHDVHLQWKH QXPEHURISHRSOHVWDUYLQJ+HUHZHZRXOGVD\WKDWWKHFDXVDOUHODWLRQVKLSEHWZHHQ WHOHYLVLRQVHWVDQGVWDUYDWLRQLVVSXULRXVRUIDOVHVLQFHWKH\DUHERWKMXVWHIIHFWVRID WKLUGIDFWRUZHDOWK &RPPRQUHVSRQVHRFFXUVZKHQFKDQJHVLQDQH[SODQDWRU\YDULDEOH[DQGD UHVSRQVHYDULDEOH\DUHERWKGULYHQE\DOXUNLQJYDULDEOH]

Simpson Paradox Statistics

  • Upload
    ldlewis

  • View
    213

  • Download
    1

Embed Size (px)

DESCRIPTION

Statistics Study Guide for Simpson Paradox and Confounding

Citation preview

  • 6WDWLVWLFV6WXG\6KHHW 3DJHRISimpson: Paradox and Confounding

    &RUUHODWLRQYV&DXVDWLRQ

    2IWHQZHQRWLFHDVWURQJDVVRFLDWLRQEHWZHHQWZRYDULDEOHV$VWURQJDVVRFLDWLRQEHWZHHQYDULDEOHVLVQHFHVVDU\IRUWKHUHWREHDFDXVDOUHODWLRQVKLSEHWZHHQWKHP%XWEHIRUHZHFDQFRQFOXGHWKDWRQHYDULDEOHFDXVHVRUDIIHFWVWKHRWKHUZHPXVWEHDZDUHRIWKHSRVVLELOLW\RIFRQIRXQGLQJFRPPRQUHVSRQVHRUOXUNLQJYDULDEOHV

    &RQIRXQGLQJ

    6XSSRVHDWUDFNFRDFKEHOLHYHVDVWURQJDVVRFLDWLRQH[LVWVEHWZHHQWRWDOSUDFWLFHWLPHVSHQWRQWKHKLJKMXPSDQGWUDFNPHHWSHUIRUPDQFH/HW[EHWKHH[SODQDWRU\YDULDEOHWRWDOSUDFWLFHWLPH/HW\EHWKHUHVSRQVHYDULDEOHKHLJKWMXPSHGDWDWUDFNPHHW

    $FRQIRXQGLQJRUKLGGHQYDULDEOH]DFWLQJKHUHZRXOGEHWKHDWKOHWHVQDWXUDOKLJKMXPSDELOLW\6RPHRQHZKRKDVQWSUDFWLFHGPXFKFRXOGZLQWKHKLJKMXPSHYHQWDWDWUDFNPHHWVLPSO\EHFDXVHRIJUHDWHUQDWXUDODELOLW\:HVD\WKDWWKHYDULDEOHQDWXUDODELOLW\FRQIRXQGVWKHHIIHFWRIWKHH[SODQDWRU\YDULDEOH[WRWDOSUDFWLFHWLPHRQWKHUHVSRQVHYDULDEOH\WUDFNPHHWSHUIRUPDQFH,QWKLVFDVHWZRWKLQJVKDYHDSRWHQWLDOHIIHFWRQWKHUHVSRQVHYDULDEOHEXWVLQFHZHRQO\PHDVXUHGRQHRIWKHPSUDFWLFHDQ\GLIIHUHQFHVLQKHLJKWMXPSHG\LVJRLQJWRDSSHDUWRFRPHRQO\IURPGLIIHUHQFHVLQSUDFWLFH[,QIDFWWKHYDULDEOHDELOLW\DOVRFRQWULEXWHVWRKHLJKWMXPSHGEXWZHFDQWVHHLWVHIIHFWEHFDXVHZHKDYHQWPHDVXUHGLW

    :HVD\WKDWWZRYDULDEOHV[DQG]DUHFRQIRXQGHGZKHQZHFDQWLVRODWHWKHLUVHSDUDWHHIIHFWVRQWKHUHVSRQVHYDULDEOH\%RWKPD\KDYHDQHIIHFWRQ\RUSHUKDSVRQO\RQHGRHVEXWWKHLUHIIHFWVDUHFRQIXVHGRUFRQIRXQGHGZLWKRQHDQRWKHULIZHGRQWPHDVXUHERWK[DQG]7KHYDULDEOH]LVDOXUNLQJYDULDEOHLQWKLVFDVH,WKDVDQHIIHFWZHFDQVHHEXWZHFDQWWHOOZKHUHWKHHIIHFWUHDOO\FRPHVIURPIURP[RUIURPVRPHZKHUHHOVH

    &RPPRQ5HVSRQVH

    $VWURQJQHJDWLYHDVVRFLDWLRQH[LVWVEHWZHHQWKHQXPEHURI79VHWVLQDJLYHQFRXQWU\DQGWKHQXPEHURIVWDUYLQJSHRSOHWKHUH7KHPRUH79VHWVDFRXQWU\KDVWKHIHZHUVWDUYLQJSHRSOHLWKDV6XSSRVHZHFRQFOXGHWKDWLQFUHDVLQJWKHH[SODQDWRU\YDULDEOH[WKHQXPEHURI79VHWVZRXOGGLPLQLVKWKDWFRXQWU\VQXPEHURIVWDUYLQJSHRSOHWKHUHVSRQVHYDULDEOH\:HPLJKWWU\WRUHGXFHVWDUYDWLRQE\VHQGLQJWKDWFRXQWU\79VHWV,QUHDOLW\RQHOXUNLQJYDULDEOHDQDWLRQVZHDOWKFDXVHVDFRPPRQUHVSRQVHDPRQJWKHRWKHUYDULDEOHV,WFDXVHVDQLQFUHDVHLQWKHQXPEHURI79VHWVDQGDGHFUHDVHLQWKHQXPEHURISHRSOHVWDUYLQJ+HUHZHZRXOGVD\WKDWWKHFDXVDOUHODWLRQVKLSEHWZHHQWHOHYLVLRQVHWVDQGVWDUYDWLRQLVVSXULRXVRUIDOVHVLQFHWKH\DUHERWKMXVWHIIHFWVRIDWKLUGIDFWRUZHDOWK

    &RPPRQUHVSRQVHRFFXUVZKHQFKDQJHVLQDQH[SODQDWRU\YDULDEOH[DQGDUHVSRQVHYDULDEOH\DUHERWKGULYHQE\DOXUNLQJYDULDEOH]

  • 6WDWLVWLFV6WXG\6KHHW 3DJHRI6LPSVRQV3DUDGR[DQG&RQIRXQGLQJ

    6LPSVRQV3DUDGR[

    ,PDJLQHWZRVFKRROGLVWULFWV&ORXG\9DOOH\DQG6XQQ\VLGH)RUWZR\HDUVLQDURZWKHUDWLR

    leviesschoolattemptedleviesschoolsuccessful

    LVKLJKHULQWKH&ORXG\9DOOH\VFKRROGLVWULFW%87ZKHQWKHWZR\HDUVDUHFRPELQHG6XQQ\VLGHKDVDKLJKHUUDWLR:KDWFRXOGKDYHFDXVHGWKHUHYHUVDO",QWKLVFDVHLWVDKLGGHQRUOXUNLQJYDULDEOHWKHQXPEHURIVFKRROOHYLHVLQHDFKGLVWULFW5HDGRQDQG\RXOOVHHKRZLQIRUPDWLRQLQWKLVNLQGRIYDULDEOHLVORVWZKHQGDWDIURPWZRJURXSVDUHOXPSHGWRJHWKHULQDWZRZD\WDEOH

    &RQVLGHUWZRPLQRUOHDJXHEDVHEDOOWHDPVWKH3LORWVDQGWKH6HQDWRUV%DVHEDOOWHDPVDUHVHSDUDWHGLQWRGLYLVLRQV(DFKWHDPKDVDZLQORVVUHFRUGZLWKLQWKHLUGLYLVLRQDQGWKH\KDYHDZLQORVVUHFRUGIRUJDPHVDJDLQVWWHDPVLQWKHRWKHUGLYLVLRQ)RUH[DPSOHHDFK(DVWHUQLYLVLRQWHDPKDVDZLQORVVUHFRUGIRUJDPHVSOD\HGDJDLQVW(DVWHUQLYLVLRQWHDPVDQGDZLQORVVUHFRUGIRUJDPHVSOD\HGDJDLQVW:HVWHUQLYLVLRQWHDPV7KHUHLVDOVRDQRYHUDOOZLQORVVUHFRUGWKDWFRPELQHVJDPHVDJDLQVWWHDPVLQERWKGLYLVLRQV

    :LQORVVUHFRUGVFDQEHH[SUHVVHGLQWHUPVRIWKHSURSRUWLRQRIJDPHVZRQFDOOHGWKHDYHUDJH,VLWSRVVLEOHWKDWWKH3LORWVFRXOGKDYHDEHWWHUDYHUDJHWKDQWKH6HQDWRUVKDYHZKHQORRNLQJVHSDUDWHO\DWJDPHVDJDLQVWWKH(DVWDQGWKH:HVWGLYLVLRQVEXWWKDWWKH6HQDWRUVKDYHDEHWWHURYHUDOOZLQORVVUHFRUGWKDQWKH3LORWV"

  • 6WDWLVWLFV6WXG\6KHHW 3DJHRI6LPSVRQV3DUDGR[DQG&RQIRXQGLQJ

    7KHNH\OLHVLQDWKLUGYDULDEOHWKHGLYLVLRQLQZKLFKWKHJDPHVZHUHSOD\HG1RWLFHWKDWWKHWZRWHDPVFRPELQHGZLQRIJDPHVDJDLQVWWKH(DVWEXWRQO\RIJDPHVDJDLQVWWKH:HVW:HFRXOGSUREDEO\FRQFOXGHWKDWWKH:HVWLVDPXFKWRXJKHUGLYLVLRQZLWKEHWWHUWHDPVWKDWDUHKDUGHUWREHDWWKDQWKHHDVWHUQWHDPV

    +HUHVWKHNH\7KH3LORWVKDGWRSOD\WKH:HVWWHQWLPHVWKH6HQDWRUVRQO\ILYH6RHYHQWKRXJKWKHRYHUDOODYHUDJHIRUWKH6HQDWRUVLVKLJKHUWKH3LORWVDUHUHDOO\WKHEHWWHUWHDPVLQFHWKH\YHKDGWRSOD\PRUHJDPHVDJDLQVWWRXJKHUWHDPV7KHRYHUDOOZLQORVVDYHUDJHVLQWKHVHFRQGWDEOHGRQWWHOOXVHQRXJKVLQFHWKHVHFRQGWDEOHGRHVQWLQFOXGHDWKLUGLQIOXHQWLDOYDULDEOHWKHGLYLVLRQLQZKLFKWKHJDPHVZHUHSOD\HG:HFDOOWKLVLQIOXHQWLDOYDULDEOHWKHGLYLVLRQDOXUNLQJYDULDEOHVLQFHLWLVQWYLVLEOHLQWKHWZRZD\WDEOHDQG\HWLWVWURQJO\DIIHFWVWKHUHVXOWV,QIRUPDWLRQLQWKLVYDULDEOHZDVORVWZKHQGDWDIURPWKHWZRGLYLVLRQVZHUHOXPSHGWRJHWKHU:KHQZHIDLOWRLQFOXGHDSRWHQWLDOO\LPSRUWDQWOXUNLQJYDULDEOHLQRXUDQDO\VLVZHFDQGUDZWKHZURQJFRQFOXVLRQVVLQFHWKHHIIHFWRIWKHOXUNLQJYDULDEOHUHPDLQVKLGGHQ

    BBBBBBBBBBBBBBBBBB

    &RS\ULJKW$3(;2QOLQH/HDUQLQJ,QF$OOULJKWVUHVHUYHG$GYDQFHG3ODFHPHQWDQG$3DUHUHJLVWHUHG

    WUDGHPDUNVRIWKH&ROOHJH%RDUG7KLVPDWHULDOLVLQWHQGHGIRUWKHH[FOXVLYHXVHRI$3(;HQUROOHGVWXGHQWV

    $Q\XQDXWKRUL]HGFRS\LQJUHXVHRUUHGLVWULEXWLRQLVSURKLELWHG