Embed Size (px)
Citation preview
EmergingOpportuni.esInforma.onandCommunica.onTechnologies(ICT)
inEvalua.onPrac.ce
LindaRa(ree,IndependentConsultantOECD-DACMee:ng,April27,2016
WhyshouldwecareaboutICTsinEvalua.on?
Deviceexplosion
hBp://conceptdraw.com/How-To-Guide/network-icon
SocialMediaexplosion
hBp://socialmedia.biz/wp-content/uploads/2015/09/social-media.jpg
Dataexplosion
hBp://cdn.business2community.com/wp-content/uploads/2015/06/big-data-cloud-e1383271750410-460x394.png
Thereisanewecosystemtounderstandandtapinto
(asappropriateanduseful)
GrowinguseofICTintheProgramCycle
Repor.ng,Sharing,Learning
Evalua.on
Implementa.on&Monitoring
Planning
Datacollec.onResearch
DocumentsharingReal-.medata
BigdataVisualiza.onsCommunica.on
Diagnosis
Buy?Build?Whoismakingdecisionswiththedata?
Privacy?Context?Extrac.on?Ethics?
Howtogetbeyondmobiledatacollec.on?
But…HypevsReality
DataDashboards!
BigData!
Mobiledatacollec.on!
Biggapsincapacity.Resistance.
Sensorsand“InternetofThings!”
How?Why?When?touse
ICTs?
Areagenciesnimbleenoughtousereal-.me
data?
Real-.meData!
BeneficiaryFeedbackLoops!
Where’stheevidenceforICTin
M&E?
So,howcanICTstrengthenevalua.on?
Datacollec.on
Structureddatagathering
Decentralizeddatagathering
Data‘harves:ng’
‘Real-:me’data
New&MixedMethods
Constructvalidity
ComplexityEvalua:on
Mul:-dimensionalindicators
BeBertriangula:on
Dataanalysis&visualiza.on
‘BigData’&datascienceapproaches
Dashboardsfordecisionmaking
Datavisualiza:ontoshareconclusions
Equity-focusedevalua.onWideningthebaseforinputvia
mobile
Incorpora:ngreal-:mefeedback
Sharingevalua:onresultswithcommuni:es
NewChallengesandRiskswithICT-enabledEvalua.on
Opera.onal/Ins.tu.onal
Highinvestmentinnewdigitalsystems
Technology-drivenprocesses&methods
InsufficientaBen:ontoins:tu:onalchangeprocesses
MethodologicalSelec:onandsamplebias
Dataqualityandrigor
Validitychallenges
Fallacyoflargenumbers
Extrac:veprocesses
Failuretoiden:fyunintendedconsequences
EthicalandLegal
Changingnatureofprivacyrisks
Datarightsandownershipofpersonaldata
Decisionsmovingawayfromtheground
LiBleevidenceonICTandM&E
12Tips
TipsforICTandM&E1. Start with a high-quality M&E plan
2. Ensure design validity
3. Determine whether and how new ICTs can add value to your M&E plan
4. Select or assemble the right combinaEon of ICT and M&E tools
5. Adapt and test the process with different audiences and stakeholders
6. Be aware of different levels of access and inclusion
TipsforICTandM&E7. Understand moEvaEon to parEcipate, incenEvize
8. Review/ensure privacy and protecEon measures, risk analysis
9. Try to idenEfy unintended consequences of using ICTs in the evaluaEon
10. Build in ways for the ICT-enabled evaluaEon process to strengthen local capacity
11. Measure what maVers – not what a cool ICT tool allows you to measure.
12. Use and share the evaluaEon learnings effecEvely through social media.
