Max sumo and maxeva train the trainer meeting

Prague, 11 Feb 2012, Slide 1

MaxSumo and MAxEvaTrain the trainer meeting

EPOMM-PLUS

Prague

13th February, 2012

Before

After


Program for today

14.00 Introduction Friso (done)

14.10 How to Use MaxSumo Friso (done)

14.40 What is MaxEva and how does it work Karl-Heinz

14.50 Entering projects into MaxEva Paul

15.10 = Short Break = Group formation

15.20 Workshop: entering projects into MaxEva

16.40 = Short Break

16.50 Sharing your experiences Friso

17.10 Benchmarking Karl-Heinz & Paul

17.25 Closure Friso


MaxSumo:

plan

monitor

evaluate

of MM projects

3


How to use MaxSumo

1. About MaxSumo

2. Why use MaxSumo?

3. Why monitoring & evaluation?

4. How to measure the effects of MM projects?

5. How to use MaxSumo?

6. Cases


About MaxSumo

5


Why use MaxSumo?

• get more results out of your MM projects• easier to adjust• demonstrate the effects• benchmarking between projects• it’s becoming the standardized way of

MM monitoring and evaluation


About MaxSumo

• “System för Utvärdering av MObilitetsproject”• From Sweden• Further developed in the Max project• On its way to become the tool for MM project design, monitoring & evaluation• Based an old, well known methods• Simple, logical & flexible• From project start to evaluation


Why monitoring & evaluation?

8



• to monitor = to measure & to describe what is happening– collect, store and compile data

• to evaluate :– to determine the value in a systematic way– in order to answer questions:

• has the target been reached?• comparison with other projects• learn from results• explain causal relations



• measure the progress of a project• make it possible to adjust the project• make clear what measures are (not) effective• satisfy project officers, politicians, … yourself• create support for further actions

MM effects are often invisible !!

• MM projects tend to be cost-effective

PROVE IT !!


How to measure the effects of

MM projects?

11


When is a MM project successful?12

profits

cost savingsemployee satisfactioncorporate responsibility

accessibilityclimate &environmenthealthregional economyparking problems

“joy”“benefits”“ease”


Core indicator for success

Permanent behaviour change

by the target group

reduction of car mileage

Effects

higher revenues

employeesatisfaction

congestionCO2 new clients

This is what MaxSumo measures!


How to use MaxSumo

14


How to use MaxSumo

selecting targets & measures

1 start

project design & measuering progress

2 design & monitor

show & explainthe results

3 evaluate

enter resultsin MaxEva

select cost-effective measures


MaxSumo: the step by step approach

Mobility Management

System impacts

Assessment

Levels

A Project activities and outputs

B Awareness of mobility services provided

C Usage of mobility services provided

Assessm

ent of services

provided

D Satisfaction with mobility services provided

E Acceptance of mobility option offered

F Take up of mobility option offered

Assessm

ent of m

obility

option

s offered

G Satisfaction with the mobility option offered

H Long-term attitudes and behaviour

Overall

effects I System impacts

your activities

the results!

what you want the target group to do


Defining projects with MaxSumo (template 1)17

what you offer the target group

how many people adapt their travel

behaviour?

what you want the target group to do

what you aim for

which group of travellersyou need

what actors you need

indirecttarget group

productpromotionpriceplace


Example- test traveller (template 1)18

one month free PT ticket + information

would we succeed?

change solo driving car trips to PT on commuting trips

CO2 reduction +less congestion

employess travelling by car >= 3x/week by car

company management



Test traveller: template 1

Projectplan

overall goals

CO2 reduction +less congestion

target groups indirect target groups

target groups

employees travelling by car>= 3 times /week by car

company management of4 employers

Mobility services provided

one month free PT ticket+ information

meeting with CEO’scommunication package

Mobility option(s) offered

Change solo driving car trips to public transport on commuting trips

desired behaviour


Example: Test Traveller / Job ticket projectFramework conditions

Person-rel. factors Travel behaviour before: 5 % PT, 95 % car

Assessm

ent o

f services p

rovid

ed

MM project details: 10 posters, Intra net info, 4 meetings, 10000 E

Awareness: 48 % (480 employees)

Usage: 28 % (280 employees) particip. in info-meet.

Satisfaction: 80 % satisfied with info and test concept

Mo

bility o

ptio

n o

ffered

Acceptance: 6 % (54 people) signed a contract

Take up: During test month: 85 % PT, 15 % car

Satisfaction: 90 % of TT satisfied with commuting by PT

Effects

Long-term att & beh: After 12 months: 40 % PT, 60 % car

System impacts: Car traffic: 110.000 km, CO2: 20 tonnes

20


Level Targets Indicators Methods When

Assessm. of

servicesprovided

A MM project details




Assessm.of

mobilityoption offered

E Acceptance of mobility options offered



Overall Effects


I System impacts21

Monitoring and Evaluation Plan (template 2)


Level Targets Indicators Methods When

Assessm of

servicesprovided

A MM project details XXX XXX


XXX XXX


XXX XXX


XXX XXX

Assessm.of

mobilityoption offered

E Acceptance of mobility options offered

XXX XXX


XXX XXX


XXX XXX

Overall Effects


XXX XXX

I System impacts XXX XXXFinal Conference WP B 22

Monitoring and Evaluation Plan (template 2)


Stage positioning (MaxSem)

verstokte automobilist net-niet reiziger

vaste gebruikerkeuzereiziger

pre-contemplation contemplation

maintenancepreparation/ action


Cases

24


Malmö: no ridiculous car trips


Malmö: no ridiculous car trips (Sweden)

levels result(s)

assessm

en

t of s

erv

ices

pro

vid

ed

A MM project details Write down your most ‘ridulous car trip ‘isinformation: website, billboard, campaign team

B awareness of mobility services provided

50% of inhabitants is aware of the campaign

C usage of mobility services provided

D satisfaction with mobility services provided

94% says it’s good that the city starts such a campaign

assessm

en

t of m

ob

ility o

ptio

n

off

ere

d

E acceptance of mobiltiy options offered

F take up of mobility options offered

16% has intended to drive less

G satisfaction with mobility options offered

overa

ll eff

ects

H long-term attitudes and behaviour

23% has changed attitudes9% drives less -= 14.000 persons

I system impacts


Carsharing promotion in Nijmegen East (NL)


Carsharing promotion in Nijmegen East (NL)

levels result(s)

assessm

en

t of s

erv

ices

pro

vid

ed

A MM project details 8 extra sharing cars in Nijmegen East3500 flyers; personal contacts with 5300 persons


50% is aware of the letter by the city26% is aware by message in the news paper9% knows the special event


870 want to receive more information1522 consider carsharing


n/a

assessm

en

t of m

ob

ility o

ptio

n

off

ere

d


46 new subscribers (3rd april – 9th dec 2009)


Figures available at Greenwheels


Figures available at Greenwheels

overa

ll eff

ects


46 new subscribers(growth of 27%) Rest of Nijmegen: 1% growth

I system impacts 4 of 8 sharing cars are put in place permanently16 less occupied parking places, 0,54 ton CO2 reduction, 46.000 less car kilometers, app. 5-20% increase of bike use/ PT use


E-bike promotion in the Netherlands


E-bike promotion in the Netherlands

levels result(s)

assessm

en

t of s

erv

ices

pro

vid

ed

A MM project details try an e-bike/ e-scooter for one monthcommunication via employers



22 employers with 3500 employees participate


?

assessm

en

t of m

ob

ility o

ptio

n

off

ere

d


292 employees participate


?


Employers and employees are enthusiastic

overa

ll eff

ects


?

I system impacts ?


MaxSumo gives you

- Help to manage and pilot

- Guidance on survey design:

- control group

- comparison group

- one group

- Practical help: Examples of questions

- Help throughout the whole process: stop and go

- Early results

- Comparable results

To be aware of…

- Clear objective

- Clear conceptions of services and options offered

- Best if used already in the planning stage

- You don´t have to use all levels

- Only provides a structure – still the same requirements on the competence of the evaluator

31


Program for today

14.00 Introduction Friso

14.10 How to Use MaxSumo Friso



15.10 = Group formation =


16.40 = Short Break



17.25 Closure Friso


MaxEva – from MAX to today

• As project database modeled on „SARA“ in Sweden• Based on MaxEvas‘ data we would like to become able to predict outcomes of

MM• Product from Trivector (SE) for MAX end 2009 – no public testing• Very low usage of MaxEva – reason many bugs and bad usability• With support from Trafikverket and KpVV – transfer from Trivector to

AMOR/EPOMM and a LOT of additional programming in 2011• 2012 complete rewriting of the programme, finished last Friday




Features of MaxEva

• Project data are publicly accessible via maps and benchmark functions• A LogIn lets you view ALL projects, but only change your own projects• It is a general evaluation tool NOT limited to MaxSumo evaluation method• It supports MaxSumo „levels“• It supports control-group and comparison group evaluation method• It supports awareness „stages“• Automatic calculation of mileage effects and CO2 effects• In the background the fleet emission data from countries „work“• Useful additional information can easily be added:

– Location on a google map– Additional files– Links (for example to ELTIS case study)

• Powerful Benchmark function• Other language versions can easily be produced (within a day, after

translation has been done)






MaxSumo data into MaxEva?41

What you offer the target group? YES

How many people adapt their travel behaviour? YES

What you want the target group to do?

YES

What you aim for?YES

Which group of travellersyou need? YES

What actors you need? PARTLY


Product?Promotion?Price?Place ?PARTLY - MaxExplorer

Map, Benchmarking,

Effects, Publication


Program for today

14.00 Introduction Friso

14.10 How to Use MaxSumo Friso



15.10 = Group formation =


16.40 = Short Break



17.25 Closure Friso