Upload
henrik-skupin
View
1.514
Download
1
Tags:
Embed Size (px)
DESCRIPTION
Basics of Mozmill and how this functional testing tool can help us to improve the quality of localized Firefox builds.
Citation preview
Mozmill meets L10n
Henrik Skupin
2 2
Agenda
I. Why another testing framework?
II. Basics of Mozmill
III. Mozmill for l10n testing
IV. Information
V. Q&A
3 3
Agenda
I. Why another testing framework?
II. Basics of Mozmill
III. Mozmill for l10n testing
IV. Information
V. Q&A
4 4
Missing Pieces
• Several testing frameworks available:"Mochitests, Reftests, Unit tests, …
BUT
• Complex user-centric functional testing too difficult
• Restart tests not possible (e.g. software update)
• Not easily usable by contributors to test "their applications
5 5
What we focus on…
• Automation of manual Litmus tests
• Continuous test execution (buildbot)
• Optimizing the release and feature testing process
• Easy usable environment to get more daily testers
Increasing the Quality of the Application
6 6
Agenda
I. Why another testing framework?
II. Basics of Mozmill
III. Mozmill for l10n testing
IV. Information
V. Q&A
7 7
What is Mozmill
• Framework for automated UI testing
• Available for applications built on the Mozilla Platform
• Runnable as both an extension and from command line
• Integrated Development Environment
• Extendable by Python scripts
• Full unit test API (JavaScript Unit test module)
8 8
Architecture
Python (Mozmill)
JsBridge
Application Process (Firefox, Thunderbird, ...) E
xten
sion
s
JsBridge Mozmill
Mozmill
IDE
Frame
9 9
Demo
• Mozmill IDE (Inspector / Recorder)
• Running a simple test
• Display of the test results
• Running existing tests via command line in a localized build
10 10
Agenda
I. Why another testing framework?
II. Basics of Mozmill
III. Mozmill for l10n testing
IV. Information
V. Q&A
11 11
Current l10n testing status
• Compare-locales script to check current status"(http://l10n.mozilla.org/dashboard/)
• No checks for undefined entities (XML parsing error) which can result in a broken application
• Localizer test-run on Litmus most commonly used for upcoming major releases
• No automated functional testing for localized"Firefox builds on a regular basis
12 12
Goals / Ideas for l10n Mozmill Tests
13 13
Demo
• Software Update test for a localized build
14 14
Agenda
I. Why another testing framework?
II. Basics of Mozmill
III. Mozmill for l10n testing
IV. Information
V. Q&A
15 15
Downloads & Code
• Mozmill Extension on AMO:"https://addons.mozilla.org/en-US/firefox/addon/9018
• PyPI packages for Mozmill:"http://pypi.python.org/pypi/mozmill "http://pypi.python.org/pypi/jsbridge"http://pypi.python.org/pypi/mozrunner
• Code repositories:"http://github.com/mikeal/mozmill "http://github.com/mikeal/jsbridge "http://github.com/mikeal/mozrunner
16 16
Documentation
• Main documentation on MDC:"https://developer.mozilla.org/en/Mozmill
• Mozmill test writing tutorial on QMO:"http://quality.mozilla.org/documents-home/code-docs/mozmill-test-creation/
• Mozmill-Dev Google Group:"http://groups.google.com/group/mozmill-dev
17 17
Questions
Developers
Mikeal Rogers (mikeal): [email protected]
Clint Talbert (ctalbert): [email protected]
Adam Christian (admc): [email protected]
Test creation
Henrik Skupin (whimboo): [email protected]
18 18
Agenda
I. Why another testing framework?
II. Basics of Mozmill
III. Mozmill for l10n testing
IV. Information
V. Q&A