54
Build Better Apps With TestFlight Beta Testing

Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Build Better Apps With TestFlight Beta Testing

Page 2: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

What is beta testing?

Page 3: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

❖ Known by many names; pilot test, field test, soft launch, etc.

❖ Final testing stage before release, with a feature complete app

❖ Test with “real users” in “real world” scenarios

❖ NOT a replacement for QC testing

Page 4: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Why beta test?

Page 5: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

What engineers say

Page 6: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

❖ Discover bugs and crashes that slipped through QC

❖ Test your app across different devices and environments

❖ Monitor and optimize app performance

❖ Test your infrastructure and make sure you’re ready to scale

Page 7: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

What product managers say

Page 8: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

❖ First chance to validate your app with users

❖ Uncover usability issues and understand how users interact with your app

❖ Get qualitative user feedback to put analytics into context

❖ Test on-boarding and documentation

❖ Inform your product roadmap

Page 9: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

What marketers say

Page 10: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

❖ Test the effectiveness of your marketing message and channels

❖ Get early adopters and evangelists

❖ Solicit testimonials and reviews for app launch

❖ Create a buzz around your app to boost acquisition

Page 11: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

What customer support say

Page 12: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

❖ Familiarize support with the app and its features

❖ Identify common customer issues and their solutions

❖ Prepare FAQs to minimize the burden after launch

Page 13: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

TestFlight beta testing

Page 14: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

TestFlight beta testing

➢ Distribute through TestFlight app

➢ Test up to 100 apps

➢ Test unlimited builds simultaneously

➢ Builds available for 90 days

Page 15: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Testers

❖ Internal tester

➢ App Store Connect users in organization

➢ Requires admin, app manager, developer, marketer, or technical role

➢ No beta review required

➢ Limited to 25 testers

Page 16: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Testers

❖ External tester

➢ Invite by email and arrange into groups

➢ Subject to beta review process

➢ Up to 10,000 testers.

Page 17: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Platform pros

❖ Integrated into App Store Connect

❖ Auto profile provisioning

❖ Bypass ad-hoc distribution limit

❖ OTA distribution

❖ A/B test unlimited builds

❖ Phased release

Page 18: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Platform limitations

❖ Beta app review process (1-2 days)

❖ Internal testers limited to 25

❖ No rollback for affected users

❖ No opt-in or open beta tests (yet!)

Page 19: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

How can Instabug help in beta testing

Page 20: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Sent your application to be tested

Page 21: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Buggy app

Page 22: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Receiving bug reports from Users

via email or a forum

Page 23: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Receiving bug reports from Users

Incomplete or missing context

Page 24: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation
Page 25: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation
Page 26: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation
Page 27: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation
Page 28: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation
Page 29: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation
Page 30: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation
Page 31: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation
Page 32: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation
Page 33: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation
Page 34: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation
Page 35: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Bug Details

Page 36: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

How can i reproduce this bug!

Page 37: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Repro Steps

Page 38: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Automatic Screen Recording

Page 39: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation
Page 40: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Session profiler

Page 41: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Spot weird UI bugs

Page 42: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Spot weird UI bugs

Page 43: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation
Page 44: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Spot server-side issues

Page 45: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Spot server-side issues

Page 46: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

We Automatically capture crashes too

Page 47: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Reply back to users

Page 48: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Explore more features and products at Instabug.com

In-app SurveysFeature Requests

Page 49: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Integrate with 1 line of code

Page 50: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

The top apps rely on Instabug for beta testing

Page 51: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation
Page 52: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Iterate Faster And Build Better Mobile Apps

Page 53: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

CocoaHeadsPromo Code

$150 Instabug credits

Instabug.com

Expire in 90 days

Page 54: Build Better Apps With TestFlight Beta Testingcocoaheadsmontreal.s3.amazonaws.com/2018...Get qualitative user feedback to put analytics into context Test on-boarding and documentation

Thank you!

[email protected]

Squashing Bugs For A Living!