Integrating  Beta  Community  Testing  into  Development  using  Gamification

Jana  Gierloff,  InnoGames

Travel  Plan

Introduction

First  Stop

Construction  Zones

Switches

Future  Tracks

Introduction  -­‐ Train

• Cross-­‐platform  (Browser,  Mobile)  MMO,  RPG• 150+  million  registered  players• 350+  employees  from  30  nations• F2P  Publisher,  Developer

Introduction  -­‐ Conductor

• Since  2011  working  for  InnoGames• Currently  Senior  QA  Technical  Tester• Projects:  Tribal  Wars,  Forge  of  Empires

Introduction  -­‐ Passenger

• Care  for  the  customers  and  quality  of  the  product

• The  less  bugs  the  less  complaints

Introduction  -­‐ Passenger

• Dedicated  and  motivated  players• Like  to  play  with  a  minimum  of  

nuisance• Interested  in  new  content  before  it  

goes  live

First  Stop  -­‐ Gamification

Gamification is  the  use  of  game  thinking  and  game  mechanics  in  none-­‐game  contexts  to  

engage  users  in  solving  problems  and  increase  users’  self  contributions.

First  Stop  -­‐ Game  Mechanics

Bonuses

AchievementsCountdown

Discovery

Levels

Points Progress

Status

First  Stop  -­‐ Team

• Strengthening  the  Beta  team• Experienced  players  with  game  knowledge• Prior  testing  knowledge

• Direct  communication  channels• Faster  reaction  and  feedback  cycle

Construction  Zone  -­‐ Mission  Goal

• Activation  and  increasing  the  beta  testing  activities  • Increase  issue  spotting  rates  for  features  with  random  content  • Gauge  reactions  and  reception  of  a  slightly  more  regulated  

feedback  approach

Construction  Zone  -­‐ Missions

Rules• Template  usage• No  duplicates• No  comments,  discussions,  etc.• Not  “by  design”

Construction  Zone  -­‐ Missions

• Short  descriptions• TemplateTasks

• Questions• ProblemsTesting

• Error  reporting• Test  reportReport

Construction  Zone  -­‐ Mission  Result

• Reduction  of  defect  reporting  after  release  by  25%

• Bug  reports  of  higher  quality  by  beta  testers

• Increased  beta  testing  activities

Construction  Zone  -­‐ Experience

• Better  planning  certainty  in  bigger  teams• Steady  testing  activities  through  regular  feature  

updates• High  fluctuation  among  beta  testers

Switches  -­‐ Long-­‐term

• Everlasting  leaderboard• Points  &  levels

• Achievements• Badges

Switches  – Mid-­‐term

• Seasonal  leaderboard• 3  months  duration

Future  Tracks

• Automated  workflow• Bug  reporting  tool  integrated  into  forum• Extending  to  mobile

Thank  You!