10
Text MOVING FROM GIP TO GIJ

Gip to Gij - Mozillawiki.mozilla.org/images/d/d0/Gip_to_Gij.pdf · • Developers must update integration tests to land • Gaia UI Test was designed for QA use only • This is a

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Gip to Gij - Mozillawiki.mozilla.org/images/d/d0/Gip_to_Gij.pdf · • Developers must update integration tests to land • Gaia UI Test was designed for QA use only • This is a

Text

MOVING FROM GIP TO GIJ

Page 2: Gip to Gij - Mozillawiki.mozilla.org/images/d/d0/Gip_to_Gij.pdf · • Developers must update integration tests to land • Gaia UI Test was designed for QA use only • This is a

FACTS ABOUT GIP

Page 3: Gip to Gij - Mozillawiki.mozilla.org/images/d/d0/Gip_to_Gij.pdf · • Developers must update integration tests to land • Gaia UI Test was designed for QA use only • This is a

GIP IS NOT A SEPARATE SUITE

• Gip is Gaia UI Test in disguise

• Gip comprises Gaia UI Tests that

- Work on B2G Desktop

- Declare no externals

- Have no intermittent failures

Page 4: Gip to Gij - Mozillawiki.mozilla.org/images/d/d0/Gip_to_Gij.pdf · • Developers must update integration tests to land • Gaia UI Test was designed for QA use only • This is a

GIP IS NOT INTENTIONAL

• Gip tests are not opted into execution

• Gip is a query of Gaia UI Test manifests

• Gip is all Gaia UI Tests not marked with

• external

• skip-if = device == “desktop”

Page 5: Gip to Gij - Mozillawiki.mozilla.org/images/d/d0/Gip_to_Gij.pdf · • Developers must update integration tests to land • Gaia UI Test was designed for QA use only • This is a

GIP CAUSES PROCESS ISSUES

• Developers must debug integration test failures

• Developers must update integration tests to land

• Gaia UI Test was designed for QA use only

• This is a fundamental conflict in assumptions

• Gaia UI Test should not be used for integration

Page 6: Gip to Gij - Mozillawiki.mozilla.org/images/d/d0/Gip_to_Gij.pdf · • Developers must update integration tests to land • Gaia UI Test was designed for QA use only • This is a

RETIRING GIP

Page 7: Gip to Gij - Mozillawiki.mozilla.org/images/d/d0/Gip_to_Gij.pdf · • Developers must update integration tests to land • Gaia UI Test was designed for QA use only • This is a

BASICS

• This applies to FxOS QA tests only: Gip(f1 f2 f3)

• All tests will continue to run on device as part of QA’s regression and acceptance test process

• Gij tests are owned by functional teams as part of their codebase

Page 8: Gip to Gij - Mozillawiki.mozilla.org/images/d/d0/Gip_to_Gij.pdf · • Developers must update integration tests to land • Gaia UI Test was designed for QA use only • This is a

STEPS (Q1)

1. Analyze current Gip tests

2. Divide by functional team and app==> WE ARE HERE <==

3. Find significant overlaps in coverage betweenGip and existing Gij tests

4. Retire any Gip tests that significantly overlap

Page 9: Gip to Gij - Mozillawiki.mozilla.org/images/d/d0/Gip_to_Gij.pdf · • Developers must update integration tests to land • Gaia UI Test was designed for QA use only • This is a

STEPS (Q2)

5. Propose each remaining test for porting and ownership by appropriate functional team

6. Where teams agree to take ownership, ports go on their backlog

7. FxOS QA Automation team will help teams port as available and needed

8. Where functional teams do not take ownership, tests will be retired

Page 10: Gip to Gij - Mozillawiki.mozilla.org/images/d/d0/Gip_to_Gij.pdf · • Developers must update integration tests to land • Gaia UI Test was designed for QA use only • This is a

QUESTIONS?