Reporting toolsWebinarThursday 5th September 2013

Your speaker today

Matt Roddan

Director, Employee Research

ORC International

Introduction

• highlights report– How to interpret the results in your highlights report

• Online Reporting / accesspoint– highlights

• Questions

accesspoint

Logging in

After following the link to the online tool, the first thing to do is log in. Easy! – just enter Username and Password and click ‘Log In’. If there are any difficulties had trying to log in, please contact your local IT.

accesspoint Document store / resources

Highlights reports

Webinars

Communication of results information

Action planning information

Survey questionnaire

highlights reports

Highlights reports to agencies

Design tailored to agency needs. The highlights reports highlight noteworthy data and present branch and divisional comparisons.

The following slides will explain how to interpret the information provided in thesereports

When in accesspoint, under Documents, you will be able to access and download your static ‘Highlight’ reports.

Highlights reports for managers

Quintile indicates the position of your agency when the 51 participating agencies are ranked against individual workplace factors and workplace outcomes. Graded into five 20%levels, ranging from top 20% to bottom 20%.

Highlights reports

11

Top 6 statements that have the maximum impact for your team and can increase your engagement score.

Predicts expected improvement if action is taken

Explore these statements in more detail with your team to have a better understanding of their responses and their ideas/solutions that can form part of your action plan.

Factors Factor analysis categorises each

statement into a theme Your % positive score may be

compared here to the average % positive of the area you belong to.

Benchmarks will only be used in sub-level highlight reports ie. % positive scores for a division will be benchmarked against % positive scores for theagency.

All Questions Allows you to see your full results for

each item under their respective workplace factor.

You can compare your % positive score to the average % positive of the division or branch where you work.

A variance of + / - 5% is also shown with different coloured text.

Highlights reports

12

What is the data saying?

What are the areas to

celebrate?

Why are people sitting on the

fence’?

What are the key issues?

Focus on the questions within the driver factors, not just the lowest scoring questions. The drivers have the biggest impact on engagement, and subsequently

on organisational performance.

Remember the importance of the agency context…

• Some questions are negatively worded i.e. strongly agree/ agree indicates a negative response

• Such questions have been coded such that the % positive score represents the % of respondents who disagree or strongly disagree

• Negatively worded questions are indicated with an * in the reporting outputs

• Example Question: * I intend to leave my organisation within the next 12 months

Strongly agree Agree Neither agree nor disagree Disagree Strongly disagree

1 2 3 4 5

Positive NegativeNeutral

Negatively worded questions

Positive NegativeNeutralPositive NegativeNeutral

• The majority of questions use a 5-point scale. Responses are collapsed into 3 categories.

• Example Question: My job makes good use of my skills and abilities

Be sure to look at the complete distribution of responses.

Mixed result — half positive, but most of the remaining neutral

Warning sign — half positive, large % negative

Strongly agree Agree Neither agree nor disagree Disagree Strongly disagree

1 2 3 4 5

Positive NegativeNeutral

50% 10%40%

50% 25%25%

Interpreting Results

Online reporting

highlights

Interactive access to the quantitative data online

Complete access to the full data set for your agency excluding free text comments In a format that enables filtering and querying of results Cut data according to demographic information Secure format and password protected Options to export pages into other formats

Accessing the online reporting tool

When in accesspoint, select the ‘highlights’ tab to access the tool

Simply press on the start button to launch the tool

When you first open the tool a pop up window will appear. This is where you can access guides and videos to help you through the tool.

Click on ‘Close this screen’ if you want to skip this introduction.

Welcome to highlights Welcome to highlights! The first page you will see is a dashboard of all key results From here, the tool can display findings by different Business unit and results views

1. Select your business unit Clicking this button will bring up the screen below

Here, the user can specify the group of data to be displayed.

This can be at the overall, division/branch or work unit.

This will depend on your access level.

1. Select your business unit

Please note, data can only be viewed if this group consists of at least 10 respondents. This assures the confidentiality of employee responses.

10

2. Select a view from the tabs along the top

Additional to the opening dashboard, there are five different ways of viewing the survey results in the highlights tool.

These will be detailed in the following slides.

Results: Full results This is the initial view for ‘Full results’. This shows the % Positive score for all questions

(the percentage of respondents that either ‘Agreed’ or ‘Strongly agreed’).

It also shows the results for all five options for each question.

Sometimes high levels of ‘Neither agree nor disagree’ or disagreement can help analysis of certain questions.

Results: Full results - Options

Furthermore, this view can be expanded by clicking ‘Options’.

To get specific data, the user can hover their cursor over one of the 5 response options.

This can be helpful when percentages are very small, as there is sometimes not enough space for the figure.

Results: Full results – Options: Questions

You can choose to select all questions or a particular section.

Under ‘Options’, the user can determine which questions are displayed and the types of responses shown (e.g., can show neutral or negative if preferred).

Results: Full results – Options: Benchmark variance

The benchmark variance shows how the results compare with the selected benchmark.

Variances in a shade of green are 5 or more % points favourable whereas those in a shade of red are 5 or more % points lower than the benchmark score.

An important reference point in comparing survey results is the comparison with Benchmark scores. These are average % positive scores from specific groups of organisations.

Comparisons: Compare work areas The ‘Compare work areas’ view exhibits comparisons between areas. The green and red

shading corresponds with the overall % positive. This is an effective way of quickly seeing which areas of the organisation answered questions more positively than others.

The comparison unit can be changed by clicking the ‘Change’ button.

Comparisons: Comparison units The pop up box allows you to add particular areas of the hierarchy to compare against. There is

the capability to bulk add and also bulk remove.

Demographics: Data breakdown This view shows how questions were answered by different demographic groups. The ‘Options’

tab is important for this view to specify which demographic comparisons displayed.

The red/green shading can be moderated by ‘variance highlighting’

‘All questions’ portrays a cross tabulation representation of all results. This can be useful if a user wishes to export the data into an Excel spreadsheet (e.g. To produce their own charts). Please note that data will only be available for groups with 10 or more responses.

All Questions:

Exporting

All of the data that is displayed in the highlights tool can be exported into either Adobe PDF or an Excel spreadsheet. This can be useful for printing or sending survey results.

By clicking ‘Export’, the adjacent window opens. Here, users can follow simple instructions to transfer information from highlights into these other formats.

Submitting feedback

By clicking on ‘Feedback’, users can provide their opinions to ORC International about different aspects of the survey results tool. And feedback is always appreciated!

Highlights also has an in-built review system.

Questions?