International Benchmarking and Evaluation of Outreach ...€¦ · Mistake #10. Not having a code of...

International Benchmarkingand Evaluation of Outreach

Activities of IP Offices

Guriqbal Singh JaiyaDirector, SMEs Division

World Intellectual Property Organization

As the Cheshire Cat said toAlice: “If you don’t knowwhere you’re going, any roadwill take you there.” t f going,

• re.”

FOCUS

Aligning Organizational and Individual GoalsVision � Skills � Incentives � Resources � Action Plan Change

Skills � Incentives � Resources � Action Plan ConfusionVision � Incentives � Resources � Action Plan AnxietyVision � Skills � Resources � Action Plan Slow changeVision � Skills � Incentives � Action PlanFrustrationVision � Skills � Incentives � Resources False starts

Alignment

EVALUATION

Evaluation is thesystematiccollectionandanalysisof dataneededto makedecisions,aprocessin which mostwell-runprogramsengagefrom theoutset.

EVALUATION

• An evaluationcanbeanimportanttool inimprovingthequality of a programif it isintegratedinto thefabric of theprogramratherthanaddedon afterthefact.

• Programpersonnelaremorelikely to usetheresultsof anevaluationwhentheyplay a rolein decidingwhatto examine,conductingtheevaluation,andinterpretingtheresults.

EVALUATION

• Many reasonsto conductevaluations,suchas:

• To determinetheeffectivenessof programsforparticipants;

• To documentthatprogramobjectiveshavebeenmet;

• To provideinformationaboutservicedeliverythatwill beusefulto programstaff andotheraudiences;and

• To enableprogramstaff to makechangesthatimproveprogrameffectiveness.

EVALUATION

In otherwords,evaluationshelpto fosteraccountability,determinewhetherprograms"make a difference," andgivestaff theinformationtheyneedtoimprove servicedelivery.

EVALUATION

• ProcessEvaluationsdescribeandassessmaterialsandactivities

• OutcomeEvaluationsstudytheimmediateor directeffectson beneficiaries

• Impact Evaluations look beyondtheimmediateresultsof policies,instruction,orservicesto identify longer-termaswell asunintendedeffects

EVALUATION

• Regardlessof the kind of evaluation,allevaluationsusedata collectedin a systematicmanner. Thesedata may be quantitative orqualitative.

• Successfulevaluationsoften blend quantitativeand qualitative data collection.

• The choiceof which to useshould be madewith anunderstandingthat there is usually more than oneway to answerany given question.

EVALUATION

In otherwords,evaluationshelpto fosteraccountability,determinewhetherprograms"make a difference," andgivestaff theinformationtheyneedtoimprove servicedelivery.

• Benchmarking is thecontinuoussearchforrelevantbestpracticesthatleadto superiorperformanceandcustomersatisfaction,bymeasuringagainstandlearningfrom otherpartsof sameorganization,competitorsorcompaniesrecognizedasleaders.

BENCH MARKING

• Benchmarking is thecontinuoussearchforrelevantbestpracticesthatleadto superiorperformanceandcustomersatisfaction,bymeasuringagainstandlearningfrom otherpartsof sameorganization,competitorsorcompaniesrecognizedasleaders.

BENCH MARKING

• Benchmarking is theprocessof measuringyour operationsagainstsimilar operationsforthepurposeof improvingyour businessprocesses.Thepurposeof benchmarkingis toimproveproductsandprocessesto bettermeetcustomerneeds.Thelinkageof thebusinessprocessto customerneedsis critical toeffectivebenchmarking.

BENCH MARKING

BENCH MARKING

Benchmarking is a powerful tool for drivingcontinual improvement. It delivers 3 criticalinputs to improving quality and productivity:

• a comparisonof businessperformanceversusthecompetition and the world's "Best-in-Class”

• an understandingof how the “Best-in-Class”achievesuperior performancelevels

• answersto how gapscan be closedbetweentheorganization and the “Best-in-Class”

BENCH MARKING

Benchmarking looks at bestpractices:

• Internally amongdivisions;•Within the industry; and•Outside the industry - “out-of-box”.

BENCH MARKING

Typesof Benchmarking• Industry Group Measurements• "Best Practice" studies• CooperativeBenchmarking• Competitive Benchmarking

BENCH MARKING

Typesof Benchmarks:- Internal : a comparisonof internaloperationsand

processes.

- External/Competitive: directcomparisonof companyoperationsto otherorganizationsto determineareasforimprovement.

- Functional/Industry/Non-competitive: comparisonoffunctionsacrossthesame,broadindustry,orcomparisonof similar functionswithin unrelatedindustriesto identify trendsandinnovations.

BENCH MARKING

ChangeManagementRequiresProject managementskills

aswell asunderstanding the behavioralaspectsof change.The overall processusually requires three different teams(different charters, not necessarilydifferent people)

BENCH MARKING

ChangeManagement1. A NeedsAssessmentTeam to identify key customer

needsandtheir status:•Needsthat are not being met (cost,quality,

timeliness,etc.)•Needsthat are met better by the competition

(hiring consultants)•Needsthat are being met but can be

improved.

BENCH MARKING

ChangeManagement

2. TheBenchmarking Team takestheNeedsAssessmentresultsto designtherequiredbenchmarkingproject.

BENCH MARKING

ChangeManagement3. A Problem SolvingTeam to takethe

actionrequiredto changetheauditprocessidentifiedby theBenchmarkTeam.TheProblemSolvingTeamalsohelpsto identify newcustomerissuesfor a continuouschangemanagementloop.

BENCH MARKING

Key Components•Data gathering through detailedsurveysof measuresand processes;

•Identification of bestperformers;and

•Site visits to the bestperformers

BENCH MARKING

The 7 main stepsof a benchmarking study are:1. Determining which functions to benchmark,

2. Identifying the key performancevariablestomeasure (critical successfactors) for the business,

3. Identifying “BEST IN CLASS” in thosefields,assessingand comparing their performance,

4. Identifying reasonsfor performancedifferences,

5. Measuring your own businessperformance,6. Specifyingprograms and actionsto closethe

gap,and7. Implementing and monitoring results.

BENCH MARKING

What is ProcessBenchmarking?A processwhich analyzesandevaluates

themannerin which anorganizationperformsits functionsandactivities,comparestheseprocessesto internaland/orexternalprocesses,identifiesandthenincorporatesbestpracticesto improveperformanceto gaina competitiveadvantage.

BENCH MARKING

The BasicBenchmarking Process- Plan: Identify andunderstandyour processes;

identify benchmarkprocessandindicator- Analyze: compareyour organizationto the

benchmarkindicatorto identify performancegaps- Develop:developgoalsandperformancelevels;

developclearactionplan- Action: implementactionplan- Review: monitorresultsandadjuststepsaccordingly

BENCH MARKING

Pitfalls of ProcessBenchmarking:- Must prepareto performbenchmarking- 70%of all processimprovementinitiativesfail

dueto: lack of relevance,leadership,perseveranceandplanning.

- Typical blocksto success:no buy-in frommanagement,no champion,wrongpeopleinvolved,failure to considercustomer,too long orcostly.

BENCH MARKING

Benefitsof ProcessBenchmarking:- Createsbetterunderstandingof currentprocesses

and(potentially)improvesthoseprocesses- A preciseway to measuregapsin performance- Setsrealisticperformancegoalsandactionplans- Bringsinnovativeideasandaccelerateschange- Teambuilding tool

BENCH MARKING

• Benchmarkingis usuallypartof alargereffort, usuallya ProcessRe-engineeringor Quality Improvementinitiative

• Benchmarkingis a tool to helpyouimproveyour businessprocesses.Anybusinessprocesscanbebenchmarked.

BENCH MARKING

Avoid theseten benchmarkingmistakesMistake #1.Confusing benchmarking with

participating in a survey.

Mistake #2.Thinking there are pre-existing"benchmarks" to be found.

Mistake #3.Forgetting about servicedeliveryand customersatisfaction.

• Mistake #4.The processis too large andcomplexto be manageable.

BENCH MARKING

Avoid theseten benchmarkingmistakesMistake #5.Confusing benchmarking with

research.

Mistake #6.Misalignment.

Mistake #7.Picking a topic that is too intangibleand difficult to measure.

Mistake #8.Not establishingthe baseline.

Mistake #9.Not researchingbenchmarkingpartners thoroughly.

BENCH MARKING

Avoid theseten benchmarkingmistakesMistake #10.Not having a codeof ethics

and contract agreedwith partners. Yourpartnersshouldbeclearaboutwhatyou areseekingto learnfrom them,how thatinformationwill betreated,who will haveaccessto it andfor whatpurposesit will beused.Ideally, this shouldbeformally agreed.

BENCH MARKING

Pointsto watch:• Rememberthatthemostimportantissuesmaychangewith time.

• Don't try to benchmarktoo manythingsto beginwith. Beginwith thetwo or threehighestpriorities,thengraduallyaddothersasthefirst batchbecomespartof your normalactivities.

• Don'twastetime benchmarkingthingsthatare'justniceto know'.Everybenchmarkshouldbeaimedat improvingperformancein anareathatcontributesto profitsor customersatisfaction.

• Themorepreciselyyou definewhatyou wantto measure,themoreusefultheinformationyou gatherwill be.

• Beforeyou startcomparingwith othercompanies,testthebenchmarkswithin your ownorganization,to makesuretheyreally work. If you aremeasuringthewrongthing,or can'tgettheinformationyou needinsidethecompany,you will bewastingyour time goingoutside.

Information Collection

• May-June2001:A questionnairewassentto all IPoffices,SME focal points,anda numberofadditionalnationalinstitutions.

• On thebasisof repliessomeexperienceswerecompiledandpublishedon SMEswebsite.

• Not a proper benchmarking exercise, ratheracompilationof experiencesor "best practices" ofa numberof institutions

• "best practices" aredocumentedstrategiesandtacticsemployedby highly admiredinstitutions.

General Trends andConclusions

• New role of IP Offices (beyondthe registrationfunction)

• GovernmentSME support institutions are beginningtoinclude IP in someof their activities and servicestoSMEs

• Cooperationbetweenvarious SME supportinstitutions, chambersof commerceand industry, IPoffices,SME associations,incubators, R&D Centers,universities

• Useof new technologiesfor the provision of servicesand information to SMEs

Rangeof activities mentioned

1. Awareness-raisingand TrainingActivities

2. TechnologicalInformation Services3. Financial Assistance

4. CustomisedAdvisory Services5. Assistanceon IP Exploitation

Commercialisationand/orTechnology Transfer

Awareness-raisingand Training• Seminars,conferencesand campaignsfor entrepreneurs,

researchers,inventors and studentsin areasof technicalexpertise;

• IP guides,brochuresand other information material;• Web siteswith practical information on IP issuesfor

entrepreneurs;• Collection and disseminationof casestudieson useof IP by

SMEs;• Customizedtraining manualsfor enterprisesoperating in

specificsectors(e.g. biotechnology,etc.);• Basichelpdeskfunctions of IP officesor chambersof commerce• Multi-media products

Awareness-raisingand Training

• Radio and/or televisionprograms on issuesrelating to IPand innovation;

• Integrating IP issuesin entrepreneur training programs;• E-learning programs for entrepreneursand business

advisers/consultants;• Proactivevisits to SMEs.• Participation in businessfairs, contribution to business

magazinesand other promotional activities for the benefitof SMEs

Awareness-raisingand Training

Three stagesthatwill needto betakenconsecutivelyhavebeenidentifiedif publicawarenessis to beimproved:

• a bench-markingexerciseto assesscurrentlevelsofawarenessandunderstandingof intellectualpropertyandto providea baselinefrom which theeffectivenessof anyawarenesscampaigncanbeassessed;

• anawarenesscampaigntargetedat anygroupsspecificallyidentifiedby thebenchmarkingexercise;and

• anexerciseto assesstheeffectivenessof anycampaign.

TechnologicalInformationServices

• Practical workshopsfor entrepreneurson how to usepatentdatabases;

• Freeaccessto IP databases(on-line or in given locations);• Provision of a rangeof value-addedtechnologicalinformation

services,often at discount rate for SMEs;• Establishmentof patent libraries with specializedstaff within

universities,technologyparks, businessincubators, researchcentersand chambersof commerce;

• Regular provision of information on recentpatentsin a giventechnical field and/or patent maps;

• Developmentof multilingual IP databases;and

Financial Assistance

• Feereductionsfor SMEs applying for IP rights;

• Financial assistanceto SMEs applying for IP rightsdomesticallyor abroad (either in the form of grants, subsidiesor favorable loans);often aspart of broader program (e.g.export promotion program)

• Partnership betweenIP office and associationof patentattorneysfor providing legaladviceto SMEs,either free or atan affordable (lower) price.

CustomisedIP Advice• Legal and/or commercialassistanceto enterpriseson how to

managetheir IP assetsand how to developan IP strategy;• Promotion of, and legalassistanceon, the useof collective

marks, certification marks and GIs by SMEs;• Pilot projects on IP managementwith a selectedgroup of

enterprises;• Trademark searchesand/or assistancein the creation of

trademarks or other distinctive signs(e.g.collectivemarks;• IP audits (free-of-chargeor at discountedrate);• Assistancewith IP clearanceassessments(i.e.

freedom-to-operate);

Assistanceon IP Exploitation

• Creation of databaseson licensabletechnologies(e.g. virtualmarketplacesfor IP);

• Toolsand/or assistancefor the valuation of IP assets;• Businessfairs of licensabletechnologieswherepotential

licenseesand licensorsmay meet;• Advice for licensingnegotiations;• Programsto facilitate and createincentivesfor technology

transfer; and• Establishmentof technologylicensingoffices(TLOs) within

universitiesand public sectorresearchcenters.

THANKTHANK YOUYOU