and Communica.on Technologies (ICT) in Evalua ... · PDF fileEvalua.on Implementa.on &...

EmergingOpportuni.esInforma.onandCommunica.onTechnologies(ICT)

inEvalua.onPrac.ce

LindaRa(ree,IndependentConsultantOECD-DACMee:ng,April27,2016

WhyshouldwecareaboutICTsinEvalua.on?

Deviceexplosion

hBp://conceptdraw.com/How-To-Guide/network-icon

SocialMediaexplosion

hBp://socialmedia.biz/wp-content/uploads/2015/09/social-media.jpg

Dataexplosion

hBp://cdn.business2community.com/wp-content/uploads/2015/06/big-data-cloud-e1383271750410-460x394.png

Thereisanewecosystemtounderstandandtapinto

(asappropriateanduseful)

GrowinguseofICTintheProgramCycle

Repor.ng,Sharing,Learning

Evalua.on

Implementa.on&Monitoring

Planning

Datacollec.onResearch

DocumentsharingReal-.medata

BigdataVisualiza.onsCommunica.on

Diagnosis

Buy?Build?Whoismakingdecisionswiththedata?

Privacy?Context?Extrac.on?Ethics?

Howtogetbeyondmobiledatacollec.on?

But…HypevsReality

DataDashboards!

BigData!

Mobiledatacollec.on!

Biggapsincapacity.Resistance.

Sensorsand“InternetofThings!”

How?Why?When?touse

ICTs?

Areagenciesnimbleenoughtousereal-.me

data?

Real-.meData!

BeneficiaryFeedbackLoops!

Where’stheevidenceforICTin

M&E?

So,howcanICTstrengthenevalua.on?

Datacollec.on

Structureddatagathering

Decentralizeddatagathering

Data‘harves:ng’

‘Real-:me’data

New&MixedMethods

Constructvalidity

ComplexityEvalua:on

Mul:-dimensionalindicators

BeBertriangula:on

Dataanalysis&visualiza.on

‘BigData’&datascienceapproaches

Dashboardsfordecisionmaking

Datavisualiza:ontoshareconclusions

Equity-focusedevalua.onWideningthebaseforinputvia

mobile

Incorpora:ngreal-:mefeedback

Sharingevalua:onresultswithcommuni:es

NewChallengesandRiskswithICT-enabledEvalua.on

Opera.onal/Ins.tu.onal

Highinvestmentinnewdigitalsystems

Technology-drivenprocesses&methods

InsufficientaBen:ontoins:tu:onalchangeprocesses

MethodologicalSelec:onandsamplebias

Dataqualityandrigor

Validitychallenges

Fallacyoflargenumbers

Extrac:veprocesses

Failuretoiden:fyunintendedconsequences

EthicalandLegal

Changingnatureofprivacyrisks

Datarightsandownershipofpersonaldata

Decisionsmovingawayfromtheground

LiBleevidenceonICTandM&E

12Tips

TipsforICTandM&E1. Start with a high-quality M&E plan

2. Ensure design validity

3. Determine whether and how new ICTs can add value to your M&E plan

4. Select or assemble the right combinaEon of ICT and M&E tools

5. Adapt and test the process with different audiences and stakeholders

6. Be aware of different levels of access and inclusion

TipsforICTandM&E7. Understand moEvaEon to parEcipate, incenEvize

8. Review/ensure privacy and protecEon measures, risk analysis

9. Try to idenEfy unintended consequences of using ICTs in the evaluaEon

10. Build in ways for the ICT-enabled evaluaEon process to strengthen local capacity

11. Measure what maVers – not what a cool ICT tool allows you to measure.

12. Use and share the evaluaEon learnings effecEvely through social media.

lindaraXree@gmail.com

Thankyou!