Unreal conference slides

Embed Size (px)

DESCRIPTION

Slides from today's Indie Games Summit at FIU

Text of Unreal conference slides

  • 1.REAL GOOD UNREAL TESTING CHARLES P. SCHULTZ Author Game Testing All In One INDIE GAMES SUMMIT

2. TEST SUBJECTS

  • WHAT CAN I TEST?
  • UNREAL ENGINE VERSIONS, PORTS
  • MODS
  • LEVELS
  • WEAPONS, VEHICLES
  • PC, CONSOLE or MOBILE

INDIE GAMES SUMMIT 3. TEST OBJECTIVES

  • FIND BUGS
  • PINPOINT CAUSES
    • - Environment
    • - Repeatability
    • - Frequency
  • ESTABLISH WHAT WORKS
  • VERIFY FIXED BUGS
  • GIVE DEVS FEEDBACK

INDIE GAMES SUMMIT 4. TESTERS WEAPONS

  • PARAMETERS
  • MODELS
  • USE CASES
  • METHODS
  • TOOLS
  • PLAYER STYLES
    • - Achiever, Explorer, Killer, Socializer

INDIE GAMES SUMMIT 5. BOUNDARY VALUES

  • 0
  • MINIMUM
  • MAXIMUM
  • MAXIMUM + 1
  • SPECIAL VALUES
    • - High Scores
    • February 29 th
    • Zone Boundaries:KOTOR example

INDIE GAMES SUMMIT 6. GAME PHASES PRE-GAME ACTIVATE GAME START Initialize system components Load maps and game assets Establish network communication Game controllers detected etc. IN-GAME POST-GAME DEACTIVATE INDIE GAMES SUMMIT 7. DEFECT TRIGGERS

  • NORMAL BEHAVIOR
  • CONFIGURATION
  • STARTUP
  • EXCEPTIONS
  • STRESS
  • RESTART

INDIE GAMES SUMMIT 8. DEFECT TRIGGERS

  • NORMAL BEHAVIOR
    • typically 80 to 100% of tests
    • most costly to find
    • relatively low cost to repair
    • less effective as project progresses
    • serious issues removed before ship

INDIE GAMES SUMMIT 9. DEFECT TRIGGERS

  • CONFIGURATION
  • STARTUP
  • EXCEPTIONS
  • STRESS
  • RESTART
    • up to 20% of tests
    • higher rate of defects found per test
    • requirements may be lacking

INDIE GAMES SUMMIT 10. TRIGGER GOALS

  • NORMAL BEHAVIOR: 40%
  • CONFIGURATION: 20%
  • STARTUP : 10%
  • EXCEPTIONS: 20%
  • STRESS: 5%
  • RESTART: 5%
  • grow non-Normal test cases
  • elicit requirements from developers

INDIE GAMES SUMMIT 11. RESTART You can fast swap weapons to reload the first one to make it fire faster, for example you can shoot the sniper, quickly swap toanother weapon lets say hammer, swap back and shoot the sniper again as the reload time has been wiped BUG EXAMPLE INDIE GAMES SUMMIT 12. COMBINATORIAL TABLES

  • SELECT PARAMETERS TO TEST
  • - GUN, AMMO, RANGE
  • SELECT TEST VALUES FOR
  • EACH PARAMETER
  • - AMMO: 0, 1, MAXIMUM
  • PAIR EACH VALUE WITH ANOTHER
    • PARAMETERS VALUES
    • - AMMO=1 with
    • GUN=ROCKET, LINK GUN, SNIPER

INDIE GAMES SUMMIT 13. COMBINATORIAL TABLES

  • START WITH FIRST VALUE OF ONE PARAMETER

GUN AMMO RANGE ROCKET ROCKET ROCKET 0 1 MAX 1 MAX MAX+1 INDIE GAMES SUMMIT 14. COMBINATORIAL TABLES

  • FOR THE NEXT PARAMETER, CREATE NEW PAIRS

GUN AMMO RANGE ROCKET ROCKET ROCKET 0 1 MAX 1 MAX MAX+1 LINK GUN LINK GUN LINK GUN 0 1 MAX MAX MAX+1 1 INDIE GAMES SUMMIT 15. COMBINATORIAL TABLES

  • CONTINUE UNTIL ALL PAIRS ARE SATISFIED

GUN AMMO RANGE ROCKET ROCKET ROCKET 0 1 MAX 1 MAX MAX+1 LINK GUN LINK GUN LINK GUN 0 1 MAX MAX MAX+1 1 SNIPER SNIPER SNIPER 0 MAX 1 MAX+1 1 MAX INDIE GAMES SUMMIT 16. COMBINATORIALNOMICS

  • For our 3x3 matrix, we covered all pair combinations with only 9 tests. A set of 13 parameters with 3 valueswould require 1.5 million testsfor all combinations, but only requires 15 tests for pairs
  • FOR LARGE OR COMPLEX SETS OF PARAMETERS, USE A TOOL
  • ALLPAIRS
  • http://www.satisfice.com/tools.shtml

INDIE GAMES SUMMIT 17. TEST FLOW DIAGRAMS

  • Graphic model of a function or use case
  • Take the players point of view
  • Use loops
  • Add reverse flows
  • Can double as a design tool

INDIE GAMES SUMMIT 18. TEST FLOW DIAGRAMS

  • Start with an entry point and initial state

IN AMMO FULL 1. Start INDIE GAMES SUMMIT 19. TEST FLOW DIAGRAMS

  • Do something to change to another state

IN AMMO FULL NO AMMO 2. Fire All Ammo 1. Start INDIE GAMES SUMMIT 20. TEST FLOW DIAGRAMS

  • Can you go back to where you started?

IN AMMO FULL NO AMMO 2. Fire All Ammo 3.Reload 1. Start INDIE GAMES SUMMIT 21. TEST FLOW DIAGRAMS

  • Can you repeat anything?

IN AMMO FULL NO AMMO 4. Fire Weapon 5.Reload 2. Fire All Ammo 3.Reload 1. Start INDIE GAMES SUMMIT 22. TEST FLOW DIAGRAMS

  • Can you do something a different way?

IN AMMO FULL NO AMMO 4. Fire Weapon 5.Reload 2. Fire All Ammo 3.Reload 1. Start 6. Pick up fresh weapon INDIE GAMES SUMMIT 23. TEST FLOW DIAGRAMS

  • Provide an Exit point

IN AMMO FULL NO AMMO 4. Fire Weapon 5.Reload 2. Fire All Ammo 3.Reload 1. Start 6. Pick up fresh weapon OUT 7. Exit INDIE GAMES SUMMIT 24. TEST FLOW DIAGRAMS

  • Create tests from various paths

1,2,4,7 1,2,3,2,7 1,2,6,2,7 1,2,3,5,2,7 1,5,2,3,5,2,4,6,2,7 INDIE GAMES SUMMIT IN AMMO FULL NO AMMO 4. Fire Weapon 5.Reload 2. Fire All Ammo 3.Reload 1. Start 6. Pick up fresh weapon OUT 7. Exit 25. ANY QUESTIONS? 26. EXTRAS 27. ESCAPED PROBLEMS CONFIGURATION Unreal Tournament 3 flickers after playing for some time / UT3 Flickering screen Solution A : Make sure that you are using the latest drivers. Solution B : Turn down / Turn-ff Anisotropic Filtering in UT3s menu Unreal Tournament 3 models are the same for all players after playing the first map. Make sure that the Allow custom characters option is checked in the options. This is because there are times that the config dont get saved or some of the items in the options menu gets randomly checked. Make sure that the UT3 config is changed after ticking the allow custom characters option by checking the options menu again after closing. 28. CONFIGURATION Unreal Tournament 3 Configs dont get saved / UT3 settings and cd-key not saved / cd-key problemMake sure that the MY DOCUMENTS or and UT3 folder is not set as read-only Cannot Play Unreal Tournament 3 CampaignOpen the UTEngine.ini (My DocumentsMy GamesUnreal Tournament 3UTGameConfig) and change PumpWindowMessagesWhenRenderThreadStalled=False to PumpWindowMessagesWhenRenderThreadStalled=True ESCAPED PROBLEMS