Sqe Cognizant Finalslides

Embed Size (px)

Citation preview

  • 7/31/2019 Sqe Cognizant Finalslides

    1/27

    StickyMinds.com and Better Software magazine presents

    Avoid Throwaway Test AutomationSponsored by Cognizant

    Non-streaming participants should call 1-866-761-8643

    International Non-streaming participants should call 1-904-596-2362

  • 7/31/2019 Sqe Cognizant Finalslides

    2/27

    Setting the Context

    What we mean by automated testing

    Other types of tool-assisted testing

    Principles will apply to other types

    Many topics deserve more attention

    Automated testing is softwaredevelopment

  • 7/31/2019 Sqe Cognizant Finalslides

    3/27

    What Typically Goes Wrong

    Create automated tests that dont runanymore

    Spending too much time babysitting andmaintaining the automation

    Automated tests are too brittle

    Tools dont work in environment Automated tests not providing value

  • 7/31/2019 Sqe Cognizant Finalslides

    4/27

    Common Mistakes

    No plan for implementation

    No buy-in from staff or management

    No training for automators

    No time allotted to automate

    No time allotted for maintenance No framework for reusability

    Good intentions, poor execution

  • 7/31/2019 Sqe Cognizant Finalslides

    5/27

    Why Automate?

    Sounds cool

    Boss said so

    Cant keep up

    Lots of repetitive tests

    Lots of data driven tests Reduce time spent on regression testing

  • 7/31/2019 Sqe Cognizant Finalslides

    6/27

    Develop an Automation Plan

    Why you will automateWhat to automate

    When to automateWho will automate, execute, maintainHow to automate Framework

    How to report resultsWhere to run tests

  • 7/31/2019 Sqe Cognizant Finalslides

    7/27

    What to automate

    Smoke tests

    Repetitive tests

    Can run autonomously

    Big risks

    Take less time to automate than executeShould run 3-5 times without changing

    Data intensive tests

  • 7/31/2019 Sqe Cognizant Finalslides

    8/27

  • 7/31/2019 Sqe Cognizant Finalslides

    9/27

    Selecting the Right Tool

    Define your tool requirements

    What you need it to do

    Compatibility with your application

    Compatibility with your skillsets

    Try it out

    Beware of the hype

    Record and Playback rarely is that simple

  • 7/31/2019 Sqe Cognizant Finalslides

    10/27

    Open Source Tools

    Free to acquire, not to use

    More time required for implementation

    Installation and configuration

    Learning to use the product

    More technical skills required

    http://opensourcetesting.org

  • 7/31/2019 Sqe Cognizant Finalslides

    11/27

    Develop a Framework

    Organization of artifacts

    Aim for reusability

    Across features, product versions, and products Separate interface from functionality

    Dealing with common activities

    Object recognition

    Navigation

    Data validation

  • 7/31/2019 Sqe Cognizant Finalslides

    12/27

    Dealing with Change

    Plan for changes in UI

    How to respond to test failures

    Flexible object recognition Make tests data independent

    Reduce dependencies between tests

    Set up test data in cleanup scripts

    Script tests to use dynamic data

    Enlist help of developers to ease automation

  • 7/31/2019 Sqe Cognizant Finalslides

    13/27

    2008, Cognizant Technology Solutions. All Rights Reserved.The information contained herein is subject to change without notice.

    Automation Assessment

    Testing ServicesTesting Services

  • 7/31/2019 Sqe Cognizant Finalslides

    14/2714

    Objective

    BackgroundObjective

    Automation Assessment Approach

    Process

    Infrastructure

    Tools

    Framework

    Operating Model

    Best Practices

  • 7/31/2019 Sqe Cognizant Finalslides

    15/2715

    Assessment Scope

    1515

    Infrastructure

    OperatingModel

    Automation Prioritization Planning & Strategy Approach Estimation Model Documents Guidelines Review procedures & Checklists Metrics Collection Configuration management Audits/Assessments Change Management Environment management Process Defect management Maintenance Approach

    Scripting Standards User Guides Maintenance Process Handbook Dynamic Script Allocation Automation Review Tool KR portal Integration of automation

    scripts to test management tools

    Environment Management Test bed creation and maintenance

    Architecture & Type Test Data Management Reporting Mechanism Error & Exception

    Handling Folder Structure Scalability Reusability Function Library Object Repository Database Testing Batch Execution

    Functional Automation Test Management Configuration Management Defect Management License Management

    Roles & Responsibility Governance Model Organizational SLAs Project structuring Communication

    FocusAreas

    Assessment Scope

  • 7/31/2019 Sqe Cognizant Finalslides

    16/2716

    Process

    Communication and Collaboration (BAs, Developers, Manual Testers,etc)

    Identification and Prioritization

    Planning and Estimation

    Change Management

    Maintenance Approach

  • 7/31/2019 Sqe Cognizant Finalslides

    17/2717

    Tools

    Functional Automation

    Test Management

    Configuration Management

    Defect Management

    Open Source

  • 7/31/2019 Sqe Cognizant Finalslides

    18/27

    18

    Framework

    Architecture and Type

    Test Data Management

    Reporting Mechanism

    Reusability

    Maintainability

    Object Repository

    Database Testing

  • 7/31/2019 Sqe Cognizant Finalslides

    19/27

  • 7/31/2019 Sqe Cognizant Finalslides

    20/27

    20

    Best Practices

    Scripting Standards

    User Guides

    Maintenance Process Handbook

    Automation Review Tool

    KR portal

  • 7/31/2019 Sqe Cognizant Finalslides

    21/27

    21

    Operating Model

    Roles and Responsibilities

    Organizations SLAs

    Project Structuring

  • 7/31/2019 Sqe Cognizant Finalslides

    22/27

    22

    Assess current automation capabilities

    Identify the ideal automation tool

    Set up communication model and status reporting

    Structured methodology automation testing

    Define governance model

    Customized metrics framework

    Definition of automation framework

    Highlights

    Approach - Highlights

    Organization Organization structure, Training

    Methodology Automation approach, Functional

    automation, Metrics and reporting

    Use of reusable automation scripts

    Well defined independent and peer review procedures

    in place

    Defined communication and workload processes foronsite - offshore co-ordination

    Fully customized metrics framework for implementation

    across application

    Consolidation of automation tool

    Well defined Organization structure and Governancemodel in place

    Benefits

    Focus Areas

  • 7/31/2019 Sqe Cognizant Finalslides

    23/27

    23

    Testing Services Practice Overview

    IV&VINDEPENDENCE

    Over 70% of testing

    performed against code

    provided by client or third-

    party vendors.

    ALLIANCESEstablished alliances with

    leading tool vendors like

    Mercury, Borland & IBM

    Rational

    CLIENTS200+ Clients with 10+

    Deep clientengagements with over100 people

    CENTER OFEXCELLENCE

    Invested in focused

    groups around tools &

    frameworks to provide

    client value-adds

    PEOPLETeam of over

    5000 dedicated

    SQA professionals

    2001 & 2002 2003 2004 2005 2006 2007

    Offered as a distinct

    service offering tocustomers

    Established onsite-

    offshore model for

    testing

    End-to-end IV&V

    services providedBrought in domain

    alignment (Domain

    Product Testing and

    BA/QA Offering)

    Launched to provide

    specialized functionaltesting services to

    existing Cognizant

    customers

    Integrated with other

    value added services

    such as

    Performance

    testing

    Engaged with clients to

    setup Managed TestCenters

    Commenced new client

    engagements with Test

    Consulting

    Focused on Automation

    and Mainframe CoEs

    75

    Independent Verification & Validation Service (IV&V)

    Enhanced service

    offerings such ascompliance testing,

    package testing,

    White-box testing as

    well as Domain/

    Product Testing

    (VisionPLUS, FACETS

    & POS)

    BFS Insurance Communications Manlog Technology Healthcare Life Sciences IME

    ?

    Retail

    OUR DOMAIN FOUNDATIONIntegrated BA / QA Offering in

    collaboration with domain practices

    170

    8500 (E)

    Delivery excellence

    through deploymentof innovative

    methodologies.

    Expand Global

    footprint

    2400

    5000

    800

  • 7/31/2019 Sqe Cognizant Finalslides

    24/27

    24

    Value Adds

    AHEAD

    CRAFT

    WS Test

    ProfessionalDataXpress

    CRAFT 2.0

    CRAFT defines the method for scripting of businessfunctionalities as reusable libraries that are repetitiveamong test cases

    Bulk uploads QTP scripts,

    attachments and folderstructure to Quality Center

    SOA testing solutions to testbusiness logic. It enables

    client to execute data-drivenweb service testing withoutany programming knowledge

    CRAFT 2.0 is a tool whichstreamlines the test execution

    activity during test automation, itdynamically executes the testcases in multiple machines in adistributed environment

    DataXpress is a automatedtest generation tool which

    enables to streamline thetest data preparationactivity

  • 7/31/2019 Sqe Cognizant Finalslides

    25/27

    25

    QC2bugzilla

    ROI

    Calculator

    Watir Win2Pro

    Selenium testmanager

    It integrates and synchronizesthe defects managementmodule of Quality Center withthat of Bugzilla.

    Converts Winrunner

    scripts to QTPautomatically

    It is an automationfunctional test tooldeveloped for webautomation

    Return on investment details to have maximumtransparency to client before an automationengagement.

    Web Application Testing inRuby (WATIR) is an open

    source function testingframework to test any webapplication built on ASP, .NET,J2EE or PHP

    Value Adds

  • 7/31/2019 Sqe Cognizant Finalslides

    26/27

    2008, Cognizant Technology Solutions. All Rights Reserved.The information contained herein is subject to change without notice.

    Thank you

    Testing ServicesTesting Services

  • 7/31/2019 Sqe Cognizant Finalslides

    27/27

    Have a question for the speakers?

    Ask now.

    Q & A