23
Edition dW AkAdEmiE | 2021 octobEr 2019 – FEbruAry 2020 Case Study: EthioCheck Lab Developing Fact-Checking strategies with Human Centered Design — insights of an approach in Ethiopia

octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

  • Upload
    others

  • View
    2

  • Download
    0

Embed Size (px)

Citation preview

Page 1: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

Edi t ion dW Ak AdEmiE | 202 1

o c t o b E r 2 0 1 9 – F E b r u A r y 2 0 2 0

Case Study: EthioCheck LabDeveloping Fact-Checking strategies with Human Centered Design — insights of an approach in Ethiopia

Page 2: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

o c t o b E r 2 0 1 9 – F E b r u A r y 2 0 2 0

Case Study: EthioCheck LabDeveloping Fact-Checking strategies with Human Centered Design — insights of an approach in Ethiopia

Katrin Proschek, Julius Endert

Page 3: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

Contents

EthioCheck Lab — Initial Workshops 7

1. introduction: A Human-centered Approach to Fact-checking in Ethiopia 8

2. Generative models and tools — Workshop methodology 102.1 Project Approach 1: Human-Centered Design (HCD) 112.2 Project Approach 2: Design Thinking 13

3. Process and Findings: Solutions from user-driven collaboration 143.1 Workshop 1 — Context of Use Analysis 15

3.1.1 Structure of Workshop 153.1.2 ContextofUseAnalysis―Step1:GroupDiscussionsinWorldCaféFormat 153.1.3 ContextofUseAnalysis―Step2:StakeholderandUserMapping 173.1.4 SummaryofStakeholderAnalysisandGroupDiscussions 183.1.5 ContextofUseAnalysis―Step3:TransferAnalysis 233.1.6 ContextofUseAnalysis―Step4:InitiateIdeation 283.1.7 ConclusionofFirstWorkshop―IdentificationofFact-CheckerNeeds 29

3.2 Workshop2—IdeationandProblemSolving 313.2.1 Structure of Workshop 313.2.2 IdeationandProblemSolving―Step1:Howmightwe…? 313.2.3 IdeationandProblemSolving―Step2:CollaborativePrototyping 333.2.4 IdeationandProblemSolving―Step3: Answering Key Questions for a First Service Design 353.2.5 IdeationandProblemSolving: RecommendationsforNextStepstoImplementEthioCheckLabBasedonUserNeeds 37

4. observations and conclusions from a dW Akademie perspective 38

Literature 41

Annex 42

PUBL I SHERDeutsche Welle53110BonnGermany

RESPONS IBLECarstenvonNahmen

AUTHORKatrin ProschekJulius Endert

PHOTOgR A PHERPetros Teka

EDI TOR SDeanneCorbettKarolinaLuczakSantanaMikiasSebsibeStephen VirchowLouisaWright

L AyOUTChristianLück

PUBL I SHEDFebruary2021

© DW Akademie

Imprint

4 5DW Akademie Case Study: EthioCheck Lab

Page 4: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

EthioCheck Lab — Initial Workshops

DW Akademie initiated a human-centered design (HCD) pro-cess as a starting point for a media development project in Ethiopia.Theaimwastodevelopabetterunderstandingandassess the current situation regarding misinformation and dis-information. The process with journalists and media experts fromEthiopiawasconductedbetweenOctober2019andFeb-ruary2020inAddisAbabainordertofindanacceptedandfea-siblewaytosupportfact-checkinginEthiopia.

How to use this document: This case study shows the process of gaining insights into the “context of use” for fact-checkers and the main results of the ideation on fact-checking initiatives within the very diverse Ethiopian context.

goal of the HCD approach: Tofindanacceptedandfeasibleway to launch a fact-checking initiative in Ethiopia.

Method: A LeanUX (lean user experience) approach basedon HCD and design thinking tools was applied. It combinesthe HCD context of use analysis with design thinking ideation methods in a series of workshops in order to identify important contextualfactorsinEthiopiaandgenerateideasabouthowtobestsupportfact-checkersinEthiopia.

Opportunity: OngoingreformsinEthiopiahaveledtoanopen-ing up of the media landscape.

Challenges: Increasedaccesstoallmannerofinformationandthe spread of mis- and disinformation, coupled with low media literacy,iscontributingtotheescalationofconflictsthrough-out the country.

©

Petr

os T

eka

Mikias Sebsibe who works as Project Manager for DW Akademie in Ethiopia

Design Thinking is a set of methods to explore context specificchallengesbyfocusingonfindingcreativesolu-tionsforrealproblemsofpeople.

Human-Centered Design (HCD) is a creative approach to problemsolvingthatdevelopssolutionsbyinvolvingthehumanperspective in all steps of the problem-solvingprocess.Ithelpstomakesystemsmoreusablebyearlyintegration of occupational science, ergonomics and usability knowledge in product developments. It takesplace inobservingtheproblemwithincontext (contextofuse),brainstorming,conceptualizing,developingandimplementing the solution.

LeanUXisawaytocombinemethodsofdifferenttacticsin order to effectively use few resources and reach max-imum impact.

Design Thinking

HCD - Human-Centred Design

Lean UX

7DW Akademie Case Study: EthioCheck Lab

Page 5: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

Ethiopia’s media landscape is opening up as a result of ongoing political reforms in the country. These reforms have allowed moremediahousestopopup,bothonlineandoffline.Ethio-piancitizensnowalsohavegreateropportunitytoparticipatein political discourse via the internet, especially on social media platforms. There is generally less fear of persecution and sus-picionofdissentingvoices.Currently,onlyabout18percentofcitizensnationwidehave internetaccess.Butas thenumberofinternetconnectionscontinuestogrow,itistobeexpectedthatmorepeoplewillbecomeactiveusers.

However,thisnewfreedomhasalsoenabledmis-anddisin-formation to spread,particularly online.Given the low levelofmedialiteracy,mis-anddisinformationarecontributingtoconflictsinpartsofthecountry.Thelatestoutbreaksofvio-lence in 2020 and the resulting internet shutdown are evidence of how sensitive the situation still is.

Risk-sensitive approach as a guiding principle

ConflictsbetweencertaingroupsofEthiopia’spopulationweretaken into consideration when designing the project strategy inordertoprepareforpotentialtensionsbetweenworkshopparticipants. Facilitators and trainers needed to have options at the ready so they could react sensitively and supportively to the participants’ group communication. After all, part of their task was to create a level of mutual understanding among the participatinggroups;otherwisethecollaborativeworkneededfor the development of independent and neutral ideas for fact-checkingapproacheswouldnotbepossible.

Currently, there is little consolidated effort in Ethiopia to develop systematic fact-checking mechanisms to counter the negative effects of mis- and disinformation on society. Reception of news andinformationisstronglyinfluencedbystate-affiliatedmedia,aswellaspoliticalandculturalfactors.Itisthereforeveryimpor-tant to gain insight into the context facing fact-checkers in Ethi-opia,anddevelopideasforfact-checkinginitiativessuitableforthe particularities of the Ethiopian context.

InOctober2019,DeutscheWelleAkademie(DWAkademie)ini-tiated a media development research project aimed at under-standing and assessing the current situation regarding misin-formation and disinformation in Ethiopia. The goal of the proj-ect was to analyze context-specific factors for fact-checkingtogetherwithexpertsandjournalistsbasedinEthiopia,andtodevelop a strategy to support fact-checking in Ethiopia.

Some factors, such as the newness of the topic of fact-check-ing and the limited timeframe for the research, presented challenges. The diverse regional contexts in the country also required smart management to focus the user research, and at the same time consider all essential aspects and players.

ApartnerfromAddisAbabawithexperienceinHCDprojects,iceaddis, worked in close cooperation with DW Akademie to make sure all relevant factors were considered. Code for Africa (Code4Africa),anorganizationwithyearsofexperiencework-ing on fact-checking initiatives in several African countries, was consulted for insights on the regional perspective. Code4Africa is also a long-time partner of DW Akademie, especially in pro-jects in Kenya.

1Introduction: A Human-Centered Approach to Fact-Checking in Ethiopia

9DW Akademie Case Study: EthioCheck Lab

1 . i n t r o d u c t i o n

The situation in Ethiopia is really worrisome. The mainstream media doesn’t have the resources, the capacity or the skills to respond to disinformation or fake news.Abel Wabella, Blogger and Fact-Checker, Ethiopia

Fact-Checking is a new concept in Ethiopia and exchanging ideas from different perspectives was very important.Tsion Aklilu, freelance writer

Page 6: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

As a framework, HCD provides a set of methods and tools to do context research and design products or systems in a partici-patory manner. This is essential when developing projects with local partners and ensures that cultural and political contexts are considered. Design thinking is a human-centered approach with a focus on the development of creative ideas through teamwork.

Duetolimitedtimeandresources,aLeanUX1(LeanUserExperi-ence)approachwasselected.ItisaphilosophyoriginatingfromagileworkingenvironmentscombiningHCDmethodsofcon-text of use analysis with ideation methods of design thinking. TheprojectcoveredtheperiodfromOctober2019toFebruary2020 and included extensive research as well as two five-day workshopsinAddisAbaba.Thefirstworkshopfocusedonanapproach to identify important contextual factors in Ethiopia and the second workshop used these results to generate ideas abouthowtosupportfact-checkersinEthiopia.

2.1 Project Approach 1: Human-Centered Design (HCD)

FourkeyactivitiescharacterizetheHCDapproach:contextofuse analysis, specification of user requirements, production of design solutions and evaluation of these design solutions. HCD is dedicated to developing a product or a service for, and with, actual users.2

1 Gothelf,20132 TechnicalCommitteeISO/TC159,2019

Context of Use Analysis — Learn from the users you are designing for

How information is collected during context of use analysis dependsontheaccessibilityofsourcesandhumanresourcesandthetimeavailable.Tobeeffective,contextofuseanalysisneeds to include the actual actors experts from the country or region — in this case, people who are already active fact-check-ers, journalists, media experts and other civil society experts. Involving experts provides valuable sources of knowledgeaboutthecontextofuse,thetasksfutureproductswillsupport,and how likely users are to work with future products, systems or services.User involvement should be active, whether by acting as asource of relevant data or evaluating already known solutions for their context. The people who are involved should have skills, characteristics and experience that reflect the range of usersforwhomthesystemsorservicesarebeingdesigned.Thenature and frequency of this involvement can vary throughout design and development, depending on the type of project. The effectiveness of user involvement increases as the interaction betweenthedevelopersandtheusersincreases.ForcontextofuseanalysisintheEthioCheckLabprocess,auserresearchworkshopoffivedayswasheld,whereEthiopianbasedexpertscontributedtheirknowledge.Methodologiesusedinthiswork-shopanditsresultsaredescribedinchapter3.

2Generative Models and Tools — Workshop Methodology

Figure 1 Source: DIN ISO 9241-210 (adapted by Katrin Proschek)

Human-Centered Design cycle ISO 9241-2102

Plan the Human-Centered Design process

Evaluating the design

Design solution meets user requirements

Producing design solutions

Specifying the user requirements

Analysis: Understanding and specifying the context of use

Iterate where appropriate

11DW Akademie Case Study: EthioCheck Lab

2 . G E n E r A t i v E m o d E l S A n d t o o l S

Page 7: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

2.2 Project Approach 2: Design Thinking

DesignthinkingdescribesanapproachforHCDwithaheavyfocus on the development of creative ideas through teamwork.

It can be described as a 5-step process:

– Step 1: Empathize — Research your users’ needs – Step 2: Define — State your users’ needs and problems ThesefirsttwostepsareveryrelatedtotheHCDcycles foranalyzingandspecifyingsteps

– Step 3: Ideate — Challenge assumptions and create ideas based on design thinking

– Step 4: Prototype — Start to create solutions – Step 5: Test — Try your solutions out

These last steps are related to the HCD cycles for prototyping and evaluation

InEthiopia,systemicfact-checkinghasnotyetbeenestablished.Therefore, itwasvery important for theEthioCheckLabpro-cessnotonlytoanalyzethecontextofuse,buttocreateideastogetherwithexpertsbasedinEthiopiaforfuturesolutionsandservices that can support fact-checking in Ethiopia.

Step 3 of design thinking (challenge assumptions and create ideas)formedamethodologicalbaseforthisideationprocess.Theworkshop challengedassumptionsby formulating “Howmightwe…?”questions.Basedonthesechallenges,thepartici-pantsdevelopedideasabouthowtoaddressthem.

Figure 2 Source: d.school Executive Education, Hasso Plattner Institute of Design at Stanford University (adapted by Katrin Proschek)

The five steps of Design Thinking

Test

PrototypeDefine

IdeateEmpathize

©

Petr

os T

eka

Lensa Kebede from iceaddis

13DW Akademie Case Study: EthioCheck Lab

2 . G E n E r A t i v E m o d E l S A n d t o o l S

Page 8: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

The methodological approach for the EthioCheck Lab wasacombinationofcontextofuseanalysisplusa first ideationphase,followedbyaproblem-solvingideationandprototypingphase.Giventhisapproach,thewholeprocesswasstructuredandrealizedintwoworkshops.Thefindingsandresultswereevaluatedanddocumentedbetweenandaftertheworkshops.

3.1 Workshop 1 — Context of Use Analysis

InDecember2019,a five-dayHCDworkshopwith20partici-pantsfromthemediasector,civilsociety,IT-techenterprisesandteachinginstitutionswasheldinAddisAbaba.Thisworkshop followed a four-step strategy: two steps to analyze the fact- checking context, one step to consider whether known solutions fromothercontextscouldbetransferredtoEthiopia,andafirstideationonhowfact-checkinginEthiopiacouldberealized.

3.1.1 Structure of Workshop

– World Café: Collect the participants’ knowledge and opin-ionsaboutmis-anddisinformationinordertoidentifymajortopics and issues (3.1.1)

– Stakeholder Analysis: Identifyallpersonsandinstitutionsthatare involved or have an interest in mis- and disinformation in Ethiopia to understand their structures and connections (3.1.2)

– Transfer Studies: Learnaboutsolutionsalreadyatwork in other country contexts and discuss how these solutions could work in Ethiopia (3.1.3)

– Ideation 1: Explore participants’ initial ideas for fact-check-ing products and let them introduce their ideas in a short pitch presentation (3.1.4)

3.1.2 Context of Use Analysis

Step 1: Group Discussions in World Café Format

Why and how: Collecting the knowledge and opinion of par-ticipants aboutmis- anddisinformation inorder to identifymajor topics and issues was the first step. To make sure every-bodycouldcontributetoeachtopic,differenttopicsweredis-cussedatfourtables.Eachparticipantalsocontributedtoallthe topics in a group discussion.

The four table topics were:

– Identifyanddescribeexamplesofassumedorprovenmis-ordisinformation in Ethiopia.

– What are the known or assumed sources of mis- or disin-formation?Howwelldoparticipantsunderstandthedefini-tions?Aretheretermsinlocallanguagesformis-anddisin-formation?

– What is the impact of mis- or disinformation on Ethiopian society, and why is it so important to give people tools for fact-checking?

– What are the needs of journalists and what were the out-comesofmis-ordisinformation?

3Process and Findings: Solutions from User-Driven Collaboration

Figure 3 Source: d.school Executive Education, Hasso Plattner Institute of Design at Stanford University (adapted by Katrin Proschek)

Context of use Analysis for EthioCheck Lab ― Methodological strategy of workshop 1

Context of Use Analysis

1.Groupdiscussions

Transfer Analysis

3.Groupdiscussionsandcollaborative

analysis of solutions for transfer

Context of Use Analysis

2. Co-creation of stakeholder maps and persona descriptions

Ideation

4.Createabusinessaround fact-checking

World Café Stakeholder Analysis

Transfer Workshop

Elevator Pitches

15DW Akademie Case Study: EthioCheck Lab

3 . P r o c E S S A n d F i n d i n G S

Page 9: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

3.1.3 Context of Use Analysis

Step 2: Stakeholder and User Mapping

Why: The design of products, systems and services should take into account the people who will use them, as well as other stakeholder groups, including those who could be affected(directlyorindirectly)bytheiruse.Therefore,allrelevantuserandstakeholdergroupsshouldbeidentified.Constructingsys-temsbasedonaninappropriateorincompleteunderstandingof user needs is one of the major sources of failure.

At the start of the project, it was not clear who the key stake-holdersthatshouldbeincludedinfuturefact-checkingprojectsinEthiopiawere.Wefacedthechallengeofanalyzingalreadyestablished activities as well as not-yet-discovered potentialstakeholders.

How: The task was to identify all persons and institutions who are involved or have an interest in mis- and disinformation in Ethiopia. Participants worked in four groups to create stake-holdermappings and visualizationsof stakeholders in ordertocategorizethemandunderstandtheirstructuresandcon-nections. Participants were asked to also consider govern-ment, media providers, private sector and civil society. This wasaveryfruitfulprocessbecauseeachgroupdevelopedanindividual focus during their discussions and the results gave valuableinsightsaboutstakeholdersrelevanttofact-checkingin Ethiopia. The following figure shows stakeholder map frag-mentscreatedbyparticipantsthatdescribegroupsinterestedin fact-checking.

Summary of group Discussions

First of all, it was important for the participants to verify that thetermsbeingusedintheprocesswereclearlyunderstoodin the same way. Ethiopia is a country with a great diversity of languages.Akeyinsightherewasthechallengeindescribingthedifferencebetween“misinformation”and“disinformation”in the different languages spoken.

Participants initially conflated misinformation and disinforma-tion with “fake news”. Participants widely agreed on the def-inition of disinformation. Some suggested strong formula-tions, such as: “Disinformation is any inaccurate information that takes someone into a grave.” Concerning misinformation, therewasadebateaboutwhetherfalseinformationcanbedis-seminated for a positive outcome. For example, there’s a say-inginAmharicthatlyingisacceptableifit’sdonetoarbitratebetweenfoes.

Mainstream media was generally perceived as being lessengaged in spreading disinformation. However, in reality, some mainstreamoutlets are influencedby theirownership struc-

ture and are engaged in the spread of disinformation. Partic-ipants also saw mainstream media houses as doing very little whenitcomestofact-checking,eitherbyverifyingordebunk-ing mis- and disinformation. Participants observed that themainstreammediacanalsobeinfluencedbysocialmediaactiv-ists.Anotherfactormentionedwasthatmisinformationcanbespreadinthecontextofgovernmentpublicrelations.

There was an agreement that some influencers are a source of mis- or disinformation. Their motives range from politics, eth-nicity or personal gains such as fame or money via social media.

The following needs were identified:

– Reliableinformationfromgovernmentofficialsandothersources

– Fact-checking, digital skillsets – Legalreinforcementonaccountability/policy – Legalprotectionformediapractitioners – Educational content to upgrade skills – OpenDataandautomatedfact-checkingtools – Financial support

©

Petr

os T

eka

World Café discussion table

©

Petr

os T

eka

Stakeholder mapping in groups

16 17DW Akademie Case Study: EthioCheck Lab

3 . P r o c E S S A n d F i n d i n G S

Page 10: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

3.1.4 Summary of Stakeholder Analysis and Group Discussions

Those who produce content on mainstream, social and other media were identified as a group with a strong interest in fact-checking. Therefore, one group mentioned journalists and writers as an important stakeholder group and gave exam-ples of people in this group who are especially interested in fact-checking.

Another group investigated actual or possible fact-checkingproviders, as well as who could support those fact-checkers.

Anissuethatbecameobviouswastheveryurgentneedtosup-port a very small group of individual journalists who are pres-entlyactiveinfact-checkingonaregularbasis.

Thisrealizationhelpedthegrouptofocusonmappingstakeholders who are already involved in fact-checking in Ethiopian society.

One group put a special focus on who is presently usingfact-checking services, or who might do so in the near future.

Theparticipants’stakeholdermappingsprovidedvaluablevari-ations, for example, different perceptions of how stakehold-ersareconnectedandwhatroletheyhave.Manystakeholdermappings also showed where individual persons fulfill a cer-tain role or represent a group (e.g. as disseminators of mis- or disinformation).

Weanalyzedallparticipantmappingsandidentifiedfouruseror stakeholder groups:

– Content creators – Content disseminators – Content recipients – Institutionalstakeholders

Figure 4 Source: Examples of stakeholder mappings created by participants (adapted by Katrin Proschek)

Figure 5 Source: Katrin Proschek

Summary Visualization of Stakeholder Analysis

Universities InternationalOrganizations

Government

Stakeholders

Governmentofficials

Information NetworkSecurity Agency (INSA)

Ethiopian Broadcasting Authority(EBA)

Electoral Board

Center for Advancement of Rights and Democracy (CARD)

ForeignMediaOutlets(BBCAmharic,VOA...)

Commercial Organizations

Institutionallydependent

Content Creators

Civil societyDW Akademie

Foreign and local Communities

Embassies MediaProfessionals

AssociationsForeign NewsMedia

Stakeholders

EducationalInstitution

Universities Bots??

Platforms

Private Sector

Hotels

University Students

PublicTransport Regular TradersTour Agents

Civic Society Organization

Institutions

UniversitiesReligious groups Political partiesMediaOutlets DemocracyInstitutions eg. Rights groups

Ethiopian and internationalNGOs

Content Creators Content Disseminators

GovernmentaffiliatedMedia

Houses

Non-Governmentaffiliated

MediaHouses

International Media

Individual recipients of content

Content recipients

Disseminators of verified content

supporter

Trustworthy Content Creators

supporter

Disseminators of Mis-orDisinformation

opponentMis-orDisinformation

Content Creators

opponent

18 19DW Akademie Case Study: EthioCheck Lab

3 . P r o c E S S A n d F i n d i n G S

Page 11: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

Duetotimelimitationsitwasimpossibletocontinueworkingon all the user and stakeholder groups, so a decision was made to focus further ideation and prototyping on trustworthy con-tentcreatorswhocouldalsobepotentialfact-checkers.

ItisveryimportanttobearinmindthataudiencesinEthiopiaarediverseinmanyaspects.Moreresearchaboutafuturecom-munity of fact-checkers is necessary to explore all their needs.

The following tables summarize the conclusions, especiallyfor the focal user group: fact-checkers or community of fact-checkers(thetaskswereidentifiedbyparticipantsoftheHCD process).

Fact-checkers: – Verifyandpublishverifiedcontent – Contact a network of sources to fact-check information – Fact-checktheirowncontentbeforepublishing – Fact-checkinformationpublishedbyothersinordertorespond/react

– Proactively share information with their audiences to gain their trust

– Cooperate with others in fact-checking

concluSionS – Fact-checkers need knowledge, skills and experience in

sharing – They need access to fast internet and other means of

communication and incentives to do their work – Collaborationamongfact-checkerscouldincreasethe

quality of fact-checking in Ethiopia and strengthen their reputations

Goals and Tasks of Fact-Checking

Mis- and disinformation in Ethiopia has multiple sources and characteristics: – A wide variety of sources — including government sources,politicalactorsandpublicfigures—wereidenti-fiedbyparticipants.Theyinclude: –Mainstreammedia(governmentorprivate) –Individualswithapoliticalagenda –Anonymouspeople/pagesonsocialmedia – Activists on social media –Mediacompanies – Some Ethiopians in the diaspora, especially thosebasedintheUS

concluSionS – Numerousactors,mostwithpoliticalmotives,areen-

gaged in mis- and disinformation in Ethiopia. – Mainstreammediaoutletsarenotdoingmuchtocounter

the spread of mis- and disinformation. An Ethiopian fact-checking community has to develop a strategy to buildthepublic’strustintheirworkwhileremainingunbiased.

– AnEthiopianfact-checkingcommunityhastobepoliti-cally sensitive and have the expertise needed to maintain neutral analysis of news.

Sources of Mis- and Disinformation

Social media platforms are the main channels for fact-checking: – FacebookandTelegramarethepreferredchannelsused

for fact-checking activities.

concluSionS – Fact-checkers are almost exclusively operating on social

media. Regions and populations with little or no internet access are thus excluded.

– Using mainstream media outlets in the future is key to verifyinganddisseminatingfact-checkedcontent.Lead-ing media outlets should work to strengthen fact-check-ingskillsamongjournalists.Awarenessneedstoberaised among media managers and owners of media companies.

Preferred Channels

©

Petr

os T

eka

A participant in a discussion with the trainer

Participants in a warm-up exercise

Katrin Proschek, trainer and HCD facilitator

21DW Akademie Case Study: EthioCheck Lab

3 . P r o c E S S A n d F i n d i n G S

Page 12: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

Recent Developments and Situation – OngoingpoliticalreformsinEthiopiahaveledtoan

opening up of the media landscape. Ethiopians have increased access to information.

– The upcoming elections could particularly motivate some actors to spread mis- and disinformation.

– InEthiopia,therehasbeennoconsolidatedefforttodevelop systematic fact-checking mechanisms.

– Demand for fact-checked content is high among the population.

concluSionS – This current situation is the initial motivation for DWA

to start supporting fact-checking work in Ethiopia now.

Specifics of Languages and Use of Terms – Therearenoexacttermstodistinguishbetween

mis- and disinformation in Ethiopian languages. – (yehaset mereja) – (yetesasate mereja) – ―Tigrigna(Tseleme) – OduuSobaa(AfaanOromoo) – Qaldid (Somali) – ThefirsttwowordsareinAmharic,theyliterallytranslate

as false information. – Participantscouldn’tfindtermsthatdistinguishbetween

mis- and disinformation. – The Tigrigna word has a somewhat negative connotation thatcomesclosetothedefinitionofdisinformation.

– TheAfanOromoandSomaliwordtranslatesasfalseinformation or fake news.

concluSionS – Thismightbeachallengewhenexplainingand

promoting the importance of fact-checking and its goals in local languages.

Cultural Diversity – Regional, cultural and educational diversity in Ethiopia bringstheriskthatactivitiesworkinginone(regional)context could fail in another (regional) context.

– Ethiopia has a multi-ethnic population speaking almost 80differentlanguages.

– Italsohasalonghistoryofregionalandinter-ethnicconflicts.

concluSionS – First steps should concentrate on supporting and buildingafact-checkingcommunitythatisbasedin AddisAbaba,butparticipationofactorsfromother regionsshouldbeencouragedfromthebeginningin

ordertobringtheregionalperspectiveandexpertiseinto the community.

– Disseminationoffact-checkingintothedifferentregionsandcontextsshouldalwaysbeguidedbypartnerswithregional expertise.

Professional Environment – Mediahousesarenotveryactiveinfact-checkingand

invest limited to no resources in verifying information. Investinginbuildingcapacitiesinmediahousesiskey.

– Conflict-relatedevents,particularlyinremoteregions,require manual investigation (contacting sources etc.) in order to verify information. This is time consuming and potentially dangerous (example mentioned: abductionofDembiDoloUniversitystudentsin January 2020).

concluSionS – Journalistsdofact-checkingwithoutfinancialand

structural support. – Fact-checkingisnotjustapurelyoffice-orcomputer- basedjobinEthiopia.

– Resourcesforcommunicationandtravellingwillbeneeded as well as a network that can provide regional coverageforinformationresearchandverification.

Media Literacy – The impact of mis- and disinformation is strongly connectedtolowMediaandInformationLiteracy.

– “MostpeoplebelievewhatevertheyseeonFacebook”(EliasMeseret).

concluSionS – Inthelongterm,MediaandInformationLiteracy(MIL)

activities should accompany fact-checking initiatives. – Fact-checkingitselfcanbeafactortofosterMIL. Therefore,fact-checkingactivitiesshouldbe communicatedtothepublicinatransparentand understandableway.

– Fact-checkedcontentshouldbedisseminatedina strategicandeffectiveway.

Ethiopian context, Culture and Languages

– Developed, systematic fact-checking is not yet existent in Ethiopia.

– Fact-checkingisonlydonebyafewindividualsinEthiopia.People who regularly do fact-checking in Ethiopia are ei-ther“lonefighters”orgroupswithaninterestinfosteringawareness of mis- and disinformation, i.e. universities.

– ThejournalistEliasMeseretpublisheshisactivitiesonaFacebookpageandonTwitter,wherehehassome130,000 followers. He recently initiated a WhatsApp group with 11 other journalists to share tasks on fact-checkingandhealsocontributestotheTelegramgroupTIKVAH(1.1mill.followers,October2020).

concluSionS – The user research showed a rising awareness of the need forfact-checking,butevenlargemediahousesdonotprovidesufficientresourcesforfact-checkingtotheirjournalists.

– Inadditiontomediahouses,the“lonefighters”orstu-dentgroupsneedtobesupportedintheirefforts.

Active Fact-Checkers and Fact-Checking related initiatives

3.1.5 Context of Use Analysis

Step 3: Transfer Analysis

Why: Fact-checking is a familiar process in many countries. Therefore,theparticipantsstronglywishedtolearnaboutsolu-tionsalreadybeingusedeffectivelyinothercountriesanddis-cuss how such solutions could work in Ethiopia.

How: Two existing solutions were introduced to the partici-pants, followedbyadiscussionabout ifandhowthesesolu-tions could be transferred to the Ethiopian context. Partici-pantsworkedingroupstoanalyzethesolutionsandidentifyfactors for implementation in the Ethiopian context.

FactCheckMongolia(Solution1),anapproachsupportedbyDWAkademie,wasintroducedbyJuliusEndert.FactCheckMongo-liaisaverificationplatformforjournalists,runonthecollabo-rativeplatformTrulyMedia.

PesaCheck(Solution2)was introducedbyEricMugendi,whoformerly worked at PesaCheck, an organization affiliatedwithCodeforAfricathatoperatesinKenya,Uganda,TanzaniaandotherAfricancountries. It runson thecollaborative toolMeedan.

Forthegroupanalysisonhowthesesolutionscouldbetrans-ferred to the Ethiopian context, a template was provided to doc-ument the results in a structured manner.

The main tasks for the Transfer Analysis were:

1. IdentifyhowthecontextinEthiopiaisdifferentandidentifywhathastobedonetomakeasolutionlikethiswork.

2. Identify themost importantstakeholdersofyour toolbytakingthemfromthestakeholdermapfromDayOneoftheworkshop.

3. Transferthemostimportantidentifiedstakeholderstothe“ImportantStakeholders”sectionofthetransfergrid.

4. Fill in the other three sections during the group discussion: – Materialsandwork:Describeeverythingthatisneededtocreatetheproduct/serviceinthenewcontext.(Materials,human resources, etc.) – Differencesoftransferarea:Describespecificfeaturesofthetopicthatwillbedifferentduetothenewlocalcontext.(Otherlanguage/differenttrafficinfrastructure,etc.) – Challenges:Describeanticipatedobstaclesinthenewlocalcontext or challenges to necessary adaptations.

22 23DW Akademie Case Study: EthioCheck Lab

3 . P r o c E S S A n d F i n d i n G S

Page 13: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

Figure 6 Source: Katrin Proschek

Transfer Grid ― Fill in to analyze what is needed for transfer of a solution to Ethiopian context

Materialandwork Differences of transfer area

Challenges ImportantStakeholders

©

Petr

os T

eka

Fact-checking experts Julius Endert (DW Akademie) and Eric Mugendi (formerly PesaCheck)

24 25DW Akademie Case Study: EthioCheck Lab

3 . P r o c E S S A n d F i n d i n G S

Our biggest challenge is how manual the process of fact-checking is.Eric Mugendi, fact-checker, Kenya

Page 14: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

Results Summary of Transfer Analysis

©

Petr

os T

eka

Zelalem Gizachew pitching a solution idea

FAc tcHEck monGol i A PES AcHEck

– A fact-checking association – Collaborativefact-checkingbetweendifferentmediahousesledbyanindependentorganizationofqualifiedfact-check-ersviaacollaborationtool

– Find independent people that are experts in journalism, technologyandlegalprocedures,whoareabletoputoutopendataforthepublic

– Resourcesneededtoachievethis:Workspace/office,inter-net,finance,legalprotection,knowledgebase,networkandconnection to media houses and digital tools

– Current on-going legal reforms in media, including access to information laws as well as amendments to Civil Societies andCharitiesLaw

– Lackofsimilaractivitiesinthecountrymeansthereisampleopportunity for interest and potential success (no concerns aboutasaturatedlandscape)

– Liberalizationofthetelecomsectoraswellasprivatizationof Ethio Telecom, the state-owned telecom provider

– Greatpublicinterestinthearea.Itishighlysoughtafter – Thereislessconcernwhenitcomestotheavailabilityofdataingovernmentoffices.Itisjustnotaccessible

Materials and Work (transcriptions of participants’ worksheets)

Describeeverythingneededtocreatetheproduct/serviceinthenewcontext—materials,humanresources,etc.

FAc tcHEck monGol i A PES AcHEck

– Mediahouses(GOV,regional,federal,privateetc.) – Social media – Government – Political parties – Regionalorganizations – Educational sector – Activists – Influentialindividualsandestablishments – Foreign actors

– Governmentbodies(e.g.attorneygeneral,EthiopianBroad-castingAuthority,NationalIntelligenceSecurityServices,InformationNetworkSecurityAgency)

– Ethio Telecom – EthiopianMediaCouncil – Central Statistics Agency – Journalist associations – Mediaorganizations(publicandcommercial) – Localcivilsocietyorganizations – Socialmediainfluencers/politicians – Economicandfinancialassociations – InternationalandlocalorganizationssuchasDWA,C4D,CARDInterNews,BBCMediaActionetc.)

Important Stakeholders (transcriptions of participants’ worksheets)

Describeeverythingneededtocreatetheproduct/serviceinthenewcontext—materials,humanresources,etc.

FAc tcHEck monGol i A PES AcHEck

– Geographicalarea – Demographic diversity – Populationsize – Ethnic and language diversity – Publicliteracy – Internetpenetrationlevel – HighGDPdifference – Historicalbackground – Differentgovernmentsystem – Country relationship

– Lackofstrongcivilsociety – Lowinternetpenetration – Lownewspapercirculation.Alsoconcentratedinthecapital

Addis – Lowliteracyrate(adultliteracyabout40%) – Limitedsocialmediausage(about6millionFacebookusers

in a population of 100+ million) – Lowlevelofmedialiteracy – Challengestoinformationaccess(accessisverydifficultdespitealawthatguaranteescitizens’righttoit)

Differences of Transfer Area (transcriptions of participants’ worksheets)

DescribespecificfeaturesofthetopicthatwillbedifferentduetothenewEthiopiancontext—otherlanguage,differenttrafficinfrastructure, etc.

FAc tcHEck monGol i A PES AcHEck

– Acceptancebytheauthorities – Accesstofinances – Lackofcommonground – Noexistingpolicytopromotefact-checkingorganizations – Biasesofvariousinterestgroups

– Politicalwillandcommitmentyettobetested – Accesstofinancestocarryoutproject – Polarizedpoliticalenvironment – Languagebarriersbecauseofdiversity – Lackofadequatedigitaldatabase – Nointernationalpaymentsystemonline – Internetshutdownapossibility

Challenges (transcriptions of participants’ worksheets)

Describeanticipatedobstaclesinthenewlocalcontextorchallengestonecessaryadaptations.

26 27DW Akademie Case Study: EthioCheck Lab

3 . P r o c E S S A n d F i n d i n G S

Page 15: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

©

Petr

os T

eka

| cr

eate

d by

par

ticip

ants

Ethio Check and Habesha Check, two of four elevator pitch results

3.1.6 Context of Use Analysis

Step 4: Initiate Ideation

Why: The intention of this step was to explore initial ideas for fact-checkingproducts/brandsandintroducetheminashortpitch presentation. This gave the participants an opportunity to change their focus from analysis of the current situation to a creative process of developing visions for the future together. For the facilitators, it is a very good step to explore how much the participants’ ideas match their own.

How/“The elevator pitch”: The instructions for the partici-pantswere: “Imagine you are in an elevatorwith a possiblesponsor and the time you have until you reach your floor is all you have to convince them of your idea for a fact-checking solu-tion in Ethiopia. Please prepare for this elevator pitch with your groupanddescribeyourideainthreeminutes.”

Results Summary of Initial Ideation

All four ideas were dedicated to creating a collaborativeapproachforfact-checkers.Alloftheideasinvolvedawebsite,the use of fact-checking tools and a physical office. The most frequently mentioned risks were security for fact-checkers and financialsustainability.Another importantpointwastrainingandcapacitybuildingforjournalistsandfact-checkers.

The group who created the “Habesha Check” idea, for exam-ple,describeditas“anorganizationdedicatedtotraining[peo-ple in]media literacyskillsbyworkingwithschoolsanduni-versities”. Habesha Check would work with media houses and regional media as well as central and regional government orga-nizations.Itwasimportantforthegrouptopointoutthatthiswouldonlyworkwithstablepoliticalandfinancialconditions.

The Ethio-Checkideadescribedaworkingfact-checkingcom-panydedicatedtoverifyingandpublishinginformation.Ethio -Checkshouldbefreeforthepublicandofferpaidfact-checkingservices for institutions and government.

3.1.7 Conclusion of first workshop

Identification of Fact-Checker Needs

At the end of the first workshop, the DW Akademie team agreed thattheywerefacingacomplexservicedesignchallenge.Manyaspects of fact-checking in Ethiopia were still uncovered. There wasastrongneedtocollaboratewithexperiencedearlyadap-tors and support the initiators with a protected environment tobuildtheircapacities.Therewasalsoconsensusontheneedfor an Ethiopian partner to take the lead in the implementation. DW Akademie and other partners or donors could take the role tosupportanemergingorganizationthat isacceptedbykeyplayers in the Ethiopian media landscape.

In their elevator pitches, participants clearly demonstratedtheir awareness that a fact-checking community or company does not only have the task of checking and verifying informa-tion.Itwastimetodigdeeperandidentifydesignchallengesfor ideation. To do this, fact-checking user needs were identi-fiedinordertosummarizethemostimportantresultsinaread-ableandunderstandableformat.

Auserneed(UN)is:“Aprerequisiteidentifiedasnecessaryforauser, or a user group, to achieve a goal, implied or stated within a specific context of use”.1

It’simportanttokeepuserneedsindependentfromanypro-posedsolution.Theyrepresentthegapsbetweenwhatshouldbeandwhatis.Theyarethebasistoidentifythekeychallengesand help to phrase them as challenges for design thinking pro-cesses. After product ideas are identified, they help to derive and structure user requirements for those solutions.

1 ThomasGeis,2016

FAc t- cHEck Er S in E tHioPi A nEEd . . .

... expertise and practical knowledge on how to do fact-checking. UN01

...politicalsupport/protectionofpressfreedomandindependentjournalism. UN02

... institutional support to provide resources and security. UN03

... opportunities to support each other in fact-checking, to share information and to develop strategies to fight mis- and disinformation.

UN04

... access to information sources that allow them to verify information. UN05

...protectionfrommis-anddisinformation/hatespeechfromothersaboutthem. UN06

... digital solutions that help them in the process of fact-checking. (fact-checkingandcollaborationwitheachother)

UN07

User Needs

28 29DW Akademie Case Study: EthioCheck Lab

3 . P r o c E S S A n d F i n d i n G S

Page 16: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

3.2 Workshop 2 — Ideation and Problem Solving

InFebruary2020,afollow-upworkshopusingadaptedmeth-odologies from design thinking practice was held in Addis Ababa.Thisworkshopfollowedathree-stepstrategy:onesteptodiscusskeyquestionsaboutpotentialsolutionsinthecon-textoffact-checking,onesteptocollaborativelyprototypethediscussed options and finally, one step to conceptualize theimplementation strategy for use in Ethiopia

3.2.1 Structure of Workshop

– Ideation 2: Identifyandanswercorequestionsbasedontheresultsofthefirstworkshop(3.2.2)

– Prototyping: Find concrete products and strategies via a fa-cilitated co-creation process (3.2.3)

– ProblemSolving:Discussstrategicquestionsaboutneeds,re-quirements and partners for anticipated implementation (3.2.4.)

3.2.2 Ideation and Problem Solving

Step 1: How might we …?

Why: Inthefirststepof ideation,majorchallengeshavetobeidentifiedandsolutionsforthesechallengeshavetobediscussed.

How: Inmostdesignthinkingprocesses,allparticipantsworktogetherto identifychallenges.Butour limitedtimeframedid

notallowforthis.Therefore,basedontheresultsoftheprevi-ous workshop — especially the user needs and the resulting insights about the local environment from the contextofuseanalysis—theEthioCheckLabteamidentifiedcorequestionstheparticipants should discuss in preparation for a deeper ideation process. Each of the questions was discussed in groups together withoneDWAkademieexpertateachtable,andtheresultsweredocumentedbyusingabrainstormingcanvastemplate.

Key questions to prepare the co-creation process:

– How might we incentivize continuous collaboration offact-checkers (material and non-material, common goals, ownership,etc.)?

– Howmightwepromotecollaborativetoolsforfact-checking(visibility,trustacceptance)?

– Howmight we recruit and select testers for collaborativefact-checking?

– How might we provide training (in terms of formats and chan-nels) for journalists and other content creators on fact-check-ingandverification?

– Howmightwedefinetargetgroupsforcapacitybuildingforfact-checking?

– Howmightwebuildacceptanceandtrustforcollaborativefact-checkingamongthepublic?

– Howmightwefacilitatecollaborationoffact-checkerswithcollaborativetools?

– How might we manage the risks when strengthening groups of fact-checkers and how can we mitigate these (risks for fact-checkers,risksofabuseoffact-checking)?

– Howmightwedisseminateverifiedcontent(whichchannels)? – Howmightwe integratedifferentgroups forcollaboration(journalistsandFC)?

– Howmightwelinkupfact-checkerswith journalists/mediahouses?

Figure 7 Source: d.school Executive Education, Hasso Plattner Institute of Design at Stanford University (adapted by Katrin Proschek)

Ideation and Prototyping for EthioCheck Lab ― Methodological Strategy of Workshop 2

Ideation

1.Groupdiscussionsaboutidentified challenges

Solving

3. Find solutions for concrete challenges

Prototyping

2.Collaborativeideationon prototyping tasks

How might

we?Prototyping

Answering key

questions

©

Petr

os T

eka

Participant drawing ideas in the ideation phase

31DW Akademie Case Study: EthioCheck Lab

3 . P r o c E S S A n d F i n d i n G S

Page 17: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

©

Petr

os T

eka

Discussing “How might we... ? questions” with participants

Results summary of the “How might we …?” discussions

Key ideas from participants:

– Incentives for fact-checkers to encourage continuous col-laborationshouldbedoneintwoways.Ofcourse,financialsupportisimportant,butparticipantsseeanequallystrongbenefitincreatingasupportivecommunityforthem,anet-workoffact-checkerswheretheyreceivecapacitybuilding,jobopportunities,safetyandrecognitionfortheirwork.An-other important factor is to establish regional institutionsandenableregionalfact-checkerstoparticipate.Encourag-ing a positive attitude among fact-checkers so that they have asupportiveattituderatherthanacompetitiveonewillbeimportantforsuccessfulcollaboration.

– Topromotecollaborativetoolsforfact-checking,atransparentselection process for fact-checking participants is important. ToolsshouldbecustomizedfortheEthiopiancontext,allow-ing diversity and easy access. A campaign, including a launch event,TV,radioandsocialmediaadvertisements,cankickofftheprocessoffindingparticipantsandmakingtheinitiativeknowntothepublic.CollaborationwithotherEthiopianbasedorinternationalassociationswillhelptobuildareputation.

– Fact-checkers forparticipation in theprojectcanbe foundamong journalists, bloggers and social media activists.Other important groups for recruitment are universitycommunities.Inaddition,recruitingmembersofbigmediahousesandotherorganizations—privateaswellasgovern-ment owned — is important.

– Tocreatetrustforcollaborativefact-checkingamongthepub-lic,onekeyfeaturewillbeaplatformtoreportmis-anddisin-formation to the fact-checking network. To encourage trust, thefact-checkingnetworkshouldbebrandedandpromotedasanindependentfact-checkinginstitutionthatisfinanciallynon-partisan, independent and run by diverse teams whoproduceverificationreportsinallmajorlanguages.

– Tofacilitatethecollaborationoffact-checkersviacollabora-tivetools, it is importanttocreateacollaborativeenviron-ment(hubs,software,socialmediagroup)wherefact-check-ers can share information. To enable participation andcollaboration,fact-checkersshouldreceiveiterativeandcon-tinuous training on fact-checking tools.

– Tominimizerisksforfact-checkers,theyshouldagreeonacode of conduct for their work. This code of conduct should undergocontinuousassessment.Workflowstomasscheck(verify) fact-checking information will strengthen the posi-tionoffact-checkers.Oneideawastoestablishaseparatebodytocheckthefact-checkers’work.

– The fact-checking network should introduce ongoing risk mappingandputoutregularalertsaboutpossiblerisksoffact-checking. Fact-checkers should be trained to developsafety and situation awareness, as well as skills in digital se-curity.Theorganizationemployingthefact-checkersshouldbelegallyaccountableforthemand,forinstance,offerlegaldefense for the fact-checkers or provide health insurance for anyharmtowhichtheymightbeexposed.

– Verifiedcontentshouldbedisseminatedinseverallanguagesandthroughallpossiblechannels:traditionalprintmedia,TV,andradio,aswellasinternet-basedplatformsandsocialmedia.

3.2.3 Ideation and Problem Solving

Step 2: Collaborative Prototyping

Why: To provoke participants to create more concrete products and strategies, the facilitator team transformed the results of the“Howmightwe...?”discussionsintosixprototypingtasks:To provoke participants to create more concrete products and strategies, the facilitator team transformed the results of the “Howmightwe...?”discussionsintosixprototypingtasks:

– DevelopascoutingandselectionapproachforDWAtofindcandidates for collaborative fact-checking. With whomshouldDWAcooperateduringthisprocess?

– Create a collaborativeworkenvironment for a communityof fact-checkers (common goals and rules, code of conduct, communication channels).

– Buildatrustedlabel/brandforcollaborativefact-checkinginEthiopia.

– Developalaunchcampaignforcollaborativefact-checking. – Developasetofservicesforpublicengagementinfact-check-ingtobuildacceptanceandtrust.

– Form a coalition to advocate fact-checking in Ethiopia involv-ing national and international stakeholders.

This step is quite unusual. Prototypes are normally created basedonthe“Howmightwe…?”questions.But inthiscase,there’s a high degree of complexity to the solutions needed. What’srequiredisaservicedesign—asmartcombinationoforganizationsolutions,human-to-humanservicesandtechni-cal solutions — rather than one product solution. The six tasks identifiedaboverepresentcomponentsofapossibleservicedesign for fact-checking.

How: Tohelpparticipantsdescribe theprototypes, theNABCmodel1 (Need, Approach,Benefits, Competition)wasused as abasis.Butbecausecompetitionwasnotamajorconcernforbuild-ing a fact-checking community, the Competition section was replacedwithPrototype/Visualization,whereparticipantscouldwritedowntheirthoughtsaboutthemajorchallengesforproductdevelopment.Thetemplatedevelopedforthisprocesswas:Need,Approach,Benefits,RisksandPrototype/Visualization(NABR).

Results Summary of Collaborative Prototyping

Theoutcomeofthisprototypingdescribesimportantcompo-nents and factors for the implementation of solutions. The fol-lowingexampleisthedescriptionofhowtocreateacollabora-tive work environment of fact-checkers.

1 Carlson & Wilmot, 2006

©

Petr

os T

eka

| cr

eate

d by

par

ticip

ants

Example of filled-in ideation template

©

Petr

os T

eka

| cr

eate

d by

par

ticip

ants

Prototype result example using the NABR template

32 33DW Akademie Case Study: EthioCheck Lab

3 . P r o c E S S A n d F i n d i n G S

Page 18: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

3.2.4 Ideation and Problem Solving

Step 3: Answering Key Questions for a First Service Design

Why: After prototyping single components of fact-checking services, it was time to develop a vision of a service design. The idea was that the service design should incorporate all the find-ingsofthecontextanalysisprocessconductedbythepartici-pants,andcombineitwithexpertknowledgeandresultsfroma parallel ideation process on how DW Akademie could actually support fact-checking work in the Ethiopian context.

How: Two types of methodological approaches were followed.

Approach 1

TheinternationalandregionalexpertswoulddoabrainstormforaservicedesignthatcouldworkinEthiopiaonthebasisofallthe previous findings and ideas. The service design is then pre-sentedtoworkshopparticipantsfordiscussionandfeedback.

Throughthisprocess,aservicedesigntitled“OpenFactCheckLab”wasdeveloped.TheFactCheckLab “isanopenphysicalspace, set up in conjunction with an Ethiopian implementation

partner. This design foresees the step-by-step creation of afact-checkingcommunitybyrecruiting,thentrainingandtest-ingfact-checkingenvironments.Itaimstoprovideaphysicalaswellasvirtualspacewithawebsiteforfact-checkers.Thefirstphase of this vision is providing a learning space for fact-check-ersandbuildingatrustedfact-checkingcommunity.Inthesec-ondphase,thespacecouldalsofunctionasanincubatorofpro-fessional fact-checking projects.”

Following the presentation, key questions were developed and discussed among the participants.

Four important questions were discussed, each of them in parallel groups:

Question1:Whatare therequirements, responsibilitiesanddutiesforanimplementationpartner?

Question 2: Howdowerecruitandincentivizeparticipantsandtesters?

Question3:Howwillwetestcollaborativetools?Question4:Whatdoesthewebsitelooklike?

Participants were asked to include answers and recommen-dations in terms of the:

– Purpose – Target group – Languages – Risks – Prototypeofthewebsiteinterface

Results Summary

Beloware thekey resultsof thediscussionsamongpartici-pants working in two groups:

– Apartnerbasedinthecountryshouldberesponsibleforthecoordination,organizationandimplementation.

– Specificactivitiesofthelocalpartnerincludeprovidingtheworkingspace,recruitingparticipantsandpublicrelations.Thepartnershouldbecapableofhandlingfinanceandad-ministration issues.

– Asetofrecruitmentcriteriashouldbedevelopedandan-nounced through open calls using traditional and online media.

– Ideasofwhatawebsitecouldlooklike,especiallyaftergo-ing public with fact-checking services were developed intwogroups(fig.15).Bothgroupsunderstoodanddesignedthe website as a portal targeting the public to promotefact-checking activities.

– Incentives for participants included: access to workingspace including online; training and networking oppor-tunities; publicity and acknowledgments (certificates); fi-nancial support (e.g. stipends, micro grants); and access to fact-checkingtools(e.g.subscription).

nEEdS A PProACh

– Common goal – Todevelopcredibility – Access to multiple information sources – Access to multiple domain experts – Automation – Communication(robust) – Financial support

– Associations – Code of conduct – Common digital platforms – Legalformat – Subscriptionfee

bEnEF i t S r i Sk S

– Fertile environment to do fact-checking – Refinementofinformation – Increasetheaccuracyofthefact-checkingprocess – Increasetheintegrityofthefact-checkingprocess – Bringthefact-checkerstothespotlight – Cutcostsbysharingresources – Protection (community)

– Unexpected shutdown – Conflictofroles – Compromised internal trust – Digitalvulnerabilities

Protot yPE

Setupaknowninternaldigitalproduct/platform for a group of fact-checkers. This platform should include: – Communication tool – Knowledgebase – Webandmobilealert – OfflineaccessandUnstructuredSupplementary

Service Data (USSD) support – Toughcyberguardsecurity – User-friendly design – Multilingualversions

Create a collaborative Work Environment for a Community of Fact-Checkers (transcriptions of participants’ worksheets)

©

Petr

os T

eka

| cr

eate

d by

par

ticip

ants

Brainstorming result for an Open FC Lab service design

34 35DW Akademie Case Study: EthioCheck Lab

3 . P r o c E S S A n d F i n d i n G S

Page 19: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

People fall for false information because they like to believe in it.Eric Mugendi, fact-checker, Kenya

3 . P r o c E S S A n d F i n d i n G S

Approach 2

The parallel ideation process followed the approach of reach-ingouttokeymediaandcivilsocietyactorswhowerenotableto attend the two workshops. This approach not only allowed the team to gainmore feedback on ideas developed duringtheworkshops,butalsoresulted in thedevelopmentofnewservice designs. The discussion with an Ethiopian media think tank,MersaMediaInstitute,yieldedaservicedesigndubbed“EthioCheckLab”.

EthioCheckLabshiftedthefocusofinterventionfromindivid-ualfact-checkerstomediahouses.Thevisionistoestablishandsupport structures within already existing media houses. The ideawasinformedbypreviousfindingsthatmediahousesarecurrentlynotdoingmuchinthewayofverification.Theobjec-tive of this vision is to set up fact-checking desks in selected mediahousesinastructuredandsustainableway.

Key questions discussed

Question1:Whatare therequirements, responsibilitiesanddutiesofimplementingpartners?

Question2:Howdowegoaboutselectingthemediahouses?Question 3: What kind of organizational support can be

provided?Question4:Howcanwetestcollaborationamongthemedia

houses?

Results Summary

Below are the core outcomes from exchanges with mediaactorsonthekeyquestionslistedabove:

– AnEthiopianpartnerorganizationwithdeepunderstandingof the media landscape in Ethiopia is critical to take the lead in implementingtheproject.Itsroleismorefocusedonprovid-ing local expertise in the development of strategies, project management and administration of funds (than, i.e., provid-ing resources such as a working space)

– Selection criteria that take into account the media context of EthiopiashouldbedevelopedjointlybetweentheEthiopianpartnerandDWAkademie.Securingbuy-infromeachmediahouse is critical for the success of the project.

– Theselectedmediahousesshouldbewillingtoinvestsomeresources (human as well as material resources) in the proj-ect. For example, they could provide space for training on their premises, which would also guarantee attendance.

– Apartfromskillstrainingonfact-checking,organizationalde-velopmentsupportcouldbeprovidedintheformofasouth-to-south exchange with Code for Africa, which has experience in setting up fact-checking desks in other African media houses.

– Experiencesgainedinselectedmediahousesshouldbedoc-umentedandanalyzedtoassessoptionsforscalingup.

3.2.5 Ideation and Problem Solving

Recommendations for Next Steps to Implement EthioCheck Lab Based on User Needs

Basedontheuserneedsandtheprototypesolutionscreatedin the design thinking process, DW Akademie and the facilitator teamidentifiedsomeinitialideasforstepsthatcouldbetakento support fact-checking in Ethiopia.

– Findapartnerorganization/institutioninEthiopiathatwantsto cooperate in the area of fact-checking. Support this part-nerwithfinances,expertiseandcontinuousexchange. (re-latedUserNeedsUN02,03,05)

– Cooperate with already active fact-checkers as multipliers, co-trainersandlocalexperts.(relatedUserNeedUN04)

– Find a group of early adaptors who want to do fact-checking aspartoftheirprofessionalwork.(relatedUserNeedUN04)

– Capacitybuilding—conductfact-checkingtrainingsforme-dia houses, early adaptors and train local trainers in order to continue fact-checking training, also in local languages. (relatedUserNeedUN01)

– Encourageandfinance south-southpartnershipsbetweenfact-checking organizations in Ethiopia and neighboringcountriessuchasKenya.(relatedUserNeedUN04)

– Testdigital toolsforcollaborativefact-checking,trainpart-ners to use them and set up a test platform where future fact-checkers can exercise collaborative fact-checking in aprotectedenvironment.(relatedUserNeedsUN01,06,07)

– Support the implementing partner with funds, expertise and continuous exchange over the coming years. (related User NeedsUN04,03,05,06)

©

Petr

os T

eka

Participants listen to Eric Mugendi's presentation

37DW Akademie Case Study: EthioCheck Lab

Page 20: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

4Observations and Conclusions from a DW Akademie perspective

At the start of the project, it was clear that fact-checking in Ethi-opia isonlycurrentlybeingdonebyafewindividualsand/orsmall groups. This was an enormous challenge for the HCD approach, with its reliance on a comprehensive description of context of use. Additionally, the timeframe for the project was very tight and did not allow for a longer user research phase with more time-consuming methods such as interviews or observations.

How we made it work

Collaboration with Ethiopian and regional partners:Fortheprocess,itwasextremelyvaluablethatwewereabletocombineEthiopianexpertisewithcontributionsfrominterna-tional and regional experts.

The Ethiopian partner iceaddis had a very well-establishednetwork and identified and invited qualified workshop partic-ipantsinaveryshorttime.Inaddition,iceaddishadpreviousexperience inHDCprojects andwas able to co-facilitate theworkshops.Thiswasofgreatvalue,particularlybecausetheycould efficiently interpret important instructions into Amharic andtranslatevaluableresultsbackintoEnglish.Theteamcouldalways rely on iceaddis’ advice to interact with participants appropriately, given the Ethiopian cultural context. This helped to avoid misunderstandings among everyone involved.

Regional East-African domain expertisewas brought inwiththehelpofEricMugendi,whoformerlyworkedatPesaCheckandcontributedexperiencefromhisworktolinkfact-checkingknowledgewithreallifeexamplesintheneighboringcountryof Kenya. This was very relevant for the Ethiopian participants as well as for the international experts from DW Akademie.

Iterative change management to improve the process: Itwas very helpful to start and continuously feed thework-shopswithwell-definedandstandardizedmethods.Butaftereach workshop day, it was necessary to analyze the day’sresultswiththeteam,inordertodecidewhatwouldbethebestnext step. This was an unusually intense process. The facilitator teammaintainedclosecollaborativeexchangeandshowedalotofflexibility,mutualunderstandingandexpertiseinselect-ing and adapting their approach for the next day.

Learnings from the project team

OnemajorconclusionisthattheHCDprocesshastobeflexi-bleinmethodology,iterative,andco-drivenbypartnersbasedin the country, particularly when dealing with a topic that is as new and untested as fact-checking in Ethiopia. It requires adeep mutual understanding of the project goals and processes.

In a future project, we would allow more time for the facilita-tors to reach such an understanding and agree on important strategic approaches before working with the participants. We also recommend planning collaborative pre-workshop research activities, such as interviews with previously identi-fiedstakeholdersandobservationsoftheas-isprocesses.This not only provides valuable knowledge for the workshop, but also gives the team an opportunity to become acquainted with each other.

It was also important to recognize that the issue of fact-check-ing cannot be treated in isolation from existing conflicts in a country. Conflict sensitivity is very important in the selection of participants, in the design of the workshop and in the dis-cussion of the topic. Possible solutions should be reviewed to see if they meet the requirements of conflict sensitivity.

It was helpful to work with a consulting HCD professional,whobroughtintheexpertisetosuggestalternativesfornextsteps and explain their advantages and disadvantages to sup-port smart team decisions. The downside was that these expla-nations were sometimes very time consuming, in particular becausetheyrequiredtheteammemberstoacquireHCDordesignthinkingskills,andthenbeabletoquicklyapplythemto:a)reflectonthepastday’sprogressandb)simultaneouslydrawconclusions for the upcoming workshop’s strategies. Addition-ally,individualteammembers’rolesasfacilitatorshadtosome-timesberedefined.

For future projects, we recommend at least one additional preparation day for the team to get know to each other, explore individual abilities to contribute to facilitation and agree on a mutual facilitation strategy, especially with regard to change management. We also strongly recom-mend planning enough time for the daily team reviews, in order to avoid stress.

The benefit of human-centered approaches is considerable.Developingfor,andwith,usersminimizestheriskofcreating“bad”productsandhelpscreateavaluablemindsetof itera-tive improvement among the co-creators. This, in turn, will help developproductsthataremoresustainableandmaintainable.

39DW Akademie Case Study: EthioCheck Lab

4 . o b S E r v A t i o n S A n d c o n c l u S i o n S

Digital media plays a role in disseminating misinformation and hate speech. That’s why we need to find digital solutions.Maeruf Fetu, Project Lead @Ewnet.et

Page 21: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

Literaturegothelf, J. (2013).LeanUX:ApplyingLeanPrinciplestoImprove

UserExperience.Bejing,Cambridge,Franham,Cologne;Sebastopol,Tokyo:O’Reilly.

Technical Committee ISO/TC 159, E. S.-s. (2019). ISO/FDIS9241-210:2019.Ergonomicsofhuman-systeminteraction―Part210:Human-centereddesignfor interactive systems.

Thomas geis, K. P. (7. JUNI 2016).UXQBe.V.―InternationalUsabilityandUXQualificationBoard.Retrievedon 15April2020fromCertifiedProfessionalforUsabilityandUserExperience―UserRequirementsEngineering:https://uxqb.org/en/documents/

©

Petr

os T

eka

Yosef Alemayehu from iceaddis facilitating group work

41DW Akademie Case Study: EthioCheck Lab

l i t E r A t u r E

Page 22: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

PROJEC T COORDIN AT ION DW A K A DEMIEKarolinaLuczakSantanaMikiasSebsibeStephen Virchow

WORK SHOP FAC IL I TATOR S FROM ICE A DDI SMarkosLemmaYosef AlemayehuLensaKebedeAbelAsrat

DOM A IN E X PERT SEricMugendi,AfricaPMMeedan, formerlyCodeforAfrica/PesaCheckJulius Endert, DW Akademie

HCD TR A INER A ND E vA LUAT IONKatrinProschek,icebauhause.V.

Katrin is an HCD consultant with many years of experience supporting HCD processesforGermanindustryaswellas international cooperation proj-ects.Sheisaboardmemberoficebau-haus e.V., a network of experts with the goal of fostering international under-standing and promoting international development cooperation (icebauhaus.com).

©

Petr

os T

eka

Participants of the HCD Process in Addis Ababa

42

Page 23: octob Er 2019 – F EbruAry 2020 Case Study: EthioCheck Lab

dw-akademie.com

DW Akademie is Deutsche Welle’s center for international media development, journalism training and knowledge transfer. Ourprojectsstrengthenthehumanrighttofreedomofexpressionand unhindered access to information. DW Akademie empowers peopleworldwidetomakeindependentdecisionsbasedonreliablefacts and constructive dialogue.

DWAkademieisastrategicpartneroftheGermanFederalMinistryfor Economic Cooperation and Development. We also receive fundingfromtheFederalForeignOfficeandtheEuropeanUnionand are active in approximately 50 developing countries and emerging economies.

DWAkademie

@dw_akademie

DWAkademie

dw.com/newsletter-registration

dw.com/mediadev