PRR 389Module 1: Concepts, Philosophy, ProcessModule 2: Goals, Objectives, Perf. MeasuresModule 3: Data Gathering & AnalysisModule 4: Forecasts & ImpactsModule 5: Communication/Reporting

Planning/Research/EvaluationConcepts: Definitions & PhilosophyPurposes: Why plan, evaluate?Processes : Systematic StepsTypes of Plans, Evaluations, Research

DefinitionsPlanning = preparation for decision makingEvaluation = process of judging the merit or worth of somethingResearch = application of scientific methods to answer questions Pairs: Evaluation research, research planning, planning evaluation

Related termsDesignPolicyManagementData gathering Decision makingAnalysis

Comprehensive planningSystems of facilities and programsMultiple providers and stakeholders

Why Plan?Prepare for/anticipate futureEstablish goals, directionsCoordinate various activities & programsBalance needs/wants with available resourcesEstablish systematic steps to achieve goalsRequirements for funding

Messes1. Not well defined2. Multiple ill-defined objectives3. Multiple decision makers4. Incomplete information.5. Dynamic.6. Multiple stakeholders7. Uncertainty

Characteristics of Recreation & TourismNature of R/TDiversity of activitiesHard to defineFreedom of choiceA frill, worthy of serious study?Supply CharacteristicsServicesFragmented providers/industriesPublic-private non-profit mixRole of consumer in providing experienceExternalities, public goods, common property resources

Characteristics (cont)Demand CharacteristicsDemand for what?Dispersed useSubstitution not understoodMulti-purpose tripsPeaking of demandPrices/marketsMethodologicalFuzzy conceptsWeak Measures/measurementsPlanning- management-research gapsInterdisciplinary, young as sciences go

TrendsGovernment-private roles, privatizationFederal, state, local rolesPartnerships, cooperation vs competitionIncreasing accountabilityConvergence of public & private/business approachesScale, pricingShifting markets, activitiesLinkages with health, crime, aging, economic dev., diversity & other societal issues

Incremental vs Comprehensive PlanningLindblom, science of muddling through planning is ..IncrementalRemedialSerialExploratoryFragmentedSatisficingIterative

Patton & Sawicki Tips for planning/policy analysisFocus quickly on central decision criteriaAvoid tool box approachLearn to deal with uncertaintySay it with numbersMake analysis simple and transparentCheck the factsLearn to advocate positions of othersGive client analysis, not decisionsPush boundaries of policy envelopeNo such thing as correct, rational, complete, comprehensive analysis

Steps in Planning ProcessDefine the systemEstablish goals and objectivesGather informationGenerate AlternativesEvaluate AlternativesSelect & ImplementMonitorIterate

Types of plansBy geographic scope/extentBuilding, Facility, Site Master Plan (Design)Community, Regional, State, National, System of Parks/ProgramsBy Activity/FunctionHousing, transportation, recreation tourism, land use, open space, physical plan, comprehensive plan Program, maintenance, safety, security, risk management, budget personnel, marketingBy TimeFeasibility, Short Long Range, Strategic Plan, annual performance plan, EIS.

Specific TypesCommunity recreation planDestination BrandingEnvironmental impact statementBusiness Marketing PlanFeasibility studyCommunity or Regional tourism plan

Why Evaluate - the Academic listTo assess merits of alternative programsTo discover whether & how well objectives are being fulfilledTo determine the reasons for successes & failures.To uncover the principles underlying a successful program.To refine, revise, update or track a program

Why Evaluate- "The Real List"

1. Because we are required to2. To make better decisions.3. To learn from experience4. To justify programs5. To kill programs

Research EvaluationEvaluation Research

Purposes of ResearchAnswer management questions - applied researchFor sake of knowing - pure or basic researchAnswer research questions - methodologicalDevelop/test management alternatives - developmental researchAssess worth or merit of programs - evaluation research

Research Purposes - IIExploratoryDescriptiveExplanatoryPredictive

Ways of Knowing or Establishing belief or truthTraditionAuthorityRepetition/TenacityScience

ScienceBody of Knowledge

systematicabstractgeneralparsimoniousMethod of Inquiry

logicalinductiondeductionself-correctiveempirical

Scientific ManagementApplication of scientific principles to management and decision making

systematic information gatheringempirical, objective, self-corrective

Process -- StepsResearch

define problemobjectives/hypotheses literature reviewresearch methodsgather data/analysisconclusionsfurther researchEvaluation

describe program evaluation criteria program scopingevaluation methodsgather data/analysisconclusionsmodify program?Planning

define systemspecify goals/objectivesgather infogenerate alternativesevaluate alternativeschoose & implementmonitor, evaluateIterate

Types of Evaluationby Program Stageformative (conceptualization/design)]

process (implementation)

summative (outcomes, impacts, efficiency)

Types - By ApproachStandardsnorm-basedcriterion-referenced

Goals and objectives

Impacts or effects

Types- by methodQualitative - quantitativeSecondary data - PrimarySurvey - ExperimentInternal vs externalWho - Peers, participants, superiors, subordinates, scientists

Evaluation CriteriaEffort - qnty and qlty of inputsPerformance - qnty and qlty of outputsAdequacy - meet needs?Efficiency - benefits/costsEquity - distributional issues, fairness

Process EvaluationIdentifies how and why program worksattributes recipientsconditionseffectssingle or multipleintended or side effectstiming & duration, long/short termcognitive, affective or behavioral

Types by program area/subareaEmphasis: Parks, Tourism, Interp, Program Mgmt, Commercial Rec, ...

Program : lands, facilities, personnel, budget, marketing, PR, maintenance, design, policies, plans

Types of ResearchBasic - AppliedExploratory, Descriptive, Explanatory, PredictiveIn-house / out- houseby discipline - sociological, psych, economicsby topic - boating, wilderness, legal, tourism, ...by method - survey, expmt, ...

Examples of Evaluation StudiesCommunity needs assessmentFeasibility study, SWOT analysisProgram Audits, Market auditCost/benefit, Cost effectiveness analysisImpact assessmentImportance-performance analysis

Principles for EvaluatorsSystematic InquiryCompetenceIntegrity/HonestyRespect for peopleResponsibility for public welfare

Goal free evaluation (GFE)Dont worry about goals look at all effectsProblems with goal achievement evaluationWhose goals, how measured?Unintended/side-effects; interaction effectsValues left behindCosts, alternatives/competing programsGeneralizabilitySynthesis