41
Solving Mobile Test Automa3on Challenges with TestComplete

Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Embed Size (px)

DESCRIPTION

Mobile apps present new challenges to test teams. While many tried and true test techniques still apply, mobile testers need to be aware of how their app uses the device's battery, how it uses geo-location information and how the app handles interrupts. This talk will give you an insight into how to perform these tasks and more using SmartBear's TestComplete.

Citation preview

Page 1: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Solving  Mobile  Test  Automa3on  Challenges  with  TestComplete

Page 2: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Tradi3onal  Test  Automa3on

• Workflow  • Valida-on  • Record  &  Replay  •  Scrip-ng  

Page 3: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

What  Challenges    Do  Mobile  Devices  

Present?

Page 4: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Challenges

•  Inputs  •  Fragmenta-on  •  Interrupts  • Power  Consump-on  • Connec-vity  • Geoloca-on  Informa-on  

Page 5: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Inputs

Page 6: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014
Page 7: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014
Page 8: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Gestures

•  Swipes  •  Taps  • Pinches  • More  complex  ac-ons    

Page 9: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Approaches  I’ll  take

• Gesture  Recorder  

Page 10: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Orienta3ons

Page 11: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014
Page 12: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014
Page 13: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Approaches  I’ll  take

•  Set/GetOrienta-on  Commands  

Page 14: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Challenges

ü Inputs  •  Fragmenta-on  •  Interrupts  • Power  Consump-on  • Connec-vity  • Geoloca-on  Informa-on  

Page 15: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Fragmenta3on

Page 16: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Fragmenta3on

Graphic  courtesy  of  PCMag  

Page 17: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

½  of  1%  of  18,796  =    94  devices  

Page 18: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Different  Flavors  of  Android

Page 19: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014
Page 20: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Approaches  I’ll  Take

•  Standard  Eclipse  Emulator  

Page 21: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Challenges

ü Inputs  ü Fragmenta-on  •  Interrupts  • Power  Consump-on  • Connec-vity  • Geoloca-on  Informa-on  

Page 22: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Interrupts

Page 23: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Interrupt  Tes3ng

•  Texts  • Calls  • No-fica-ons  

Page 24: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Approaches  I’ll  take

• Calls  &  Texts  =  Skype  • Wifi  =  use  Windows  as  Hotspot  •  System  Prompt  =  Low  BaXery  

Page 25: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Skype  Interrup3on  System  Prep

•  Skype4COM  •  2  Skype  accounts  

Page 26: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Wifi  Interrup3on  System  Prep

• Configure  Windows  as  a  hotspot  •  Toggle  it  on/off  as  part  of  test  • Requires  a  wired  and  a  wireless  internet  connec-on  

Page 27: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Low  BaLery  Interrup3on  System  Prep

• Use  an  emulator  •  Send  Android  Shell  Commands  •  Telnet  

Page 28: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Telnet  System  Prep

•  Installed  separately  • Using  DotNetTelnet  from  hXp://dotneXelnet.sourceforge.net/  

Page 29: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Challenges

ü Inputs  ü Fragmenta-on  ü Interrupts  • Power  Consump-on  • Connec-vity  • Geoloca-on  Informa-on  

Page 30: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Power  Consump3on

Page 31: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

BaLery  Tes3ng

• Monitor  Power  Levels  • Adjust  Power  Levels  

Page 32: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Approaches  I’ll  Take

•  Special  TC  commands  to  get  power  level  

Page 33: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Challenges

ü Inputs  ü Fragmenta-on  ü Interrupts  ü Power  Consump-on  • Connec-vity  • Geoloca-on  Informa-on  

Page 34: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Connec3vity

Page 35: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Connec3vity  Tes3ng

• Dropped  Cellular  • Dropped  Wifi  • Dropped  Bluetooth  

Page 36: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Approaches  I’ll  take

• Cellular  –  Airplane  Mode  • Wifi  &  Bluetooth  –  special  TC  commands  

Page 37: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Challenges

ü Inputs  ü Fragmenta-on  ü Interrupts  ü Power  Consump-on  ü Connec-vity  • Geoloca-on  Informa-on  

Page 38: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Geoloca3on  Data

Page 39: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

Geoloca3on  Tes3ng

• GPS  Awareness  • GPS  Mocking  

Page 40: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014

TestComplete  Addresses

ü Tradi-onal  Workflows  ü Inputs  ü Fragmenta-on  ü Interrupts  ü Power  Consump-on  ü Connec-vity  ü Geoloca-on  Informa-on  

Page 41: Solving Mobile Test Automation Challenges with TestComplete - Nick Olivo | FalafelCON 2014