multirater.com

SIOP ‘99 Slide - 2

multirater.com

Behind the Scenesof a

Web-Based 360Feedback Process

Keith Rettig

SIOP ‘99 Slide - 3

multirater.com

Background

• High tech company

• Webmaster-for-hire

• Responsible for providing Technological innovation

Internet expertise

Quality of Service

• I/O domain knowledge Not required

But definitely beneficial

• Web site hosting & design domain knowledge Absolutely required

SIOP ‘99 Slide - 4

multirater.com

What You Should Expect From Your Vendor/Webmaster

• A “Can-Do” Attitude

• Should be coming to you with ideas

• If your survey, then fully customized interface

• If their survey, then fully personalized interface

• Number of Ratees is inconsequential Largest cost factor (second to setup of hardware &

software)

SIOP ‘99 Slide - 5

multirater.com

What You Should Expect From Your Vendor/Webmaster (continued)

• Number of Raters is even more inconsequential

• Security Data

Confidentiality

Anonymity

• Savings Cost

Time

Administration problems

SIOP ‘99 Slide - 6

multirater.com

Web-based 360˙ Benefits

• Cost savings

• Time savings

• Global access

• 24-7 availability

• Immediate processing

• Targeted surveys

• Targeted reminders

SIOP ‘99 Slide - 7

multirater.com

Web-based 360˙ Benefits

• Targeted second reminders. . .

• Data, data, data! Always up-to-date and always available

• Paperless office Paper “less” office at least?

Please?

• Cost savings

SIOP ‘99 Slide - 8

multirater.com

Interesting Facts

• 88% Return Rate! 90% if you include the raters who opted out

• 6420 Surveys completed of which

769 were declines of which

225 were auto-declined by system 127 were actual raters declining 417 were deleted for other reasons

SIOP ‘99 Slide - 9

multirater.com

Interesting Facts (continued)

• 320 Ratees have completed the process 21 Raters per ratee average Minimum 1 Rater Maximum 40 Raters

• Rater types requested 328 Supervisors 1828 Direct reports 1781 Indirect reports 2169 Peers 0 Customers 306 Self reports

SIOP ‘99 Slide - 10

multirater.com

Interesting Facts (continued)

• Rater confidentiality settings 3192 requested maximum level 1964 requested minimum (328 supervisors)

• Rater additional comments 2495 raters

44% of responding raters 52 words on average 39% overall for all surveys 21 words on average for all surveys

SIOP ‘99 Slide - 11

multirater.com

Ideas Anyone?

• Training selection Manual

Automatic

• Enhanced descriptions with each item

• “Wizard” type approaches to scoring

• Item branching

• Culture shaping

SIOP ‘99 Slide - 12

multirater.com

Ideas Anyone? (continued)

• Linkage with other data Organizational Structure

Performance

Pulse Surveys

Corporate Index

• Enhanced reporting Automatic feedback by system

Based on item score Based on multi-item scores

Link to training materials

• Real-time full-time 360˙ process