27
* E-SPIN Web Application Testing and Performance Monitoring

and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

E-SPIN Web Application Testing and Performance Monitoring

Page 2: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

iMacros

iMacros is Automation Delivered

Whatever you do with a web browser, iMacros can automate it from web automation/web scripting, to

data extraction, to web testing, and much, much more.

Browser Automation

iMacros lets you record and replay repetitious work and is the only web automation software that works

with every website. Use iMacros to:

● Automatically fill-out forms just like an end-user would. You can easily download and

upload of text, images, files and web pages, handle PDF files, or take screenshots.

● Import or export data to and from web applications using CSV & XML files, databases, or

any other source.

● Update Excel and Access from the web.

iMacros eliminates the tedious repetition of checking the same sites every day, remembering

passwords, and filling out web forms. iMacros is the only form filler that can autofill web forms that

stretch over several pages. All information is stored in human-readable, plain text files that can be

edited easily. Passwords are stored securely with secure 256-Bit AES encryption.

Data Extraction

iMacros can also perform tasks that are the exact opposite of form filling, such as: finding and

extracting text (prices, product descriptions, stock quotes, etc.) and images from websites. iMacros

includes full Unicode support and works with every language, including multi-byte languages such as

Chinese.

Web Testing

Use iMacros for functional, performance, and regression testing of web applications. iMacros is the

only tool that can automate in-browser tests with Internet Explorer, Firefox and Chrome. It is also the

only tool to perform in-browser tests of Java, Flash, Flex or Silverlight applets and all AJAX elements.

The built-in STOPWATCH command captures exact web page response times for every step of a

process.

Page 3: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

iMacros

Web Browser API

The iMacros Scripting Interface gives you full programmatic control over the web browser, so even the

most complex tasks can be scripted, and there is no scripting language to learn. Use the 32/64 bit

iMacros API to remote control the iMacros Browser, Internet Explorer and Firefox.

iMacros WebBrowser Component for .NET

Available for purchase as a separate product, the iMacros WebBrowser Component for .NET makes it

easy to quickly add web automation to your applications. You also get a proven technology that has

been tested and debugged for more than ten years and is used in over 500,000 installations with

Royalty Free distribution.

System Requirements

● Windows 8/8.1, Windows 7, Windows XP SP3, Windows Server

2003/2008/2008R2/2012/2012R2

● Windows 32-bit(x86) and 64-bit(x64) systems supported

● Microsoft Internet Explorer 9, 10 or 11 (for Windows XP we also support IE8)

● Mozilla Firefox Version 21 and higher (optional, only for iMacros Firefox Add-On)

● Google Chrome Version 22 or later (optional, only for iMacros Chrome Add-On)

● 256MB of RAM (512MB recommended)

● Only 30 MB of available hard-disk space

Linux and Mac users: The iMacros for Firefox add-on and the iMacros for Chrome add-on support Win,

Mac and Linux.

Page 4: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

iMacros

The World’s Most Popular Web

Automation Solution

iMacros makes it easy for you to record and replay repetitious work and it’s the only web automation

software that works with every website, including sites use dialog boxes, frames, Javascript, Flash,

Flex, Java and AJAX.

Support for Internet Explorer, Firefox, and Chrome

With iMacros you can create and automate tasks across all major browsers, including Internet Explorer,

Firefox and Chrome. There is no new scripting language to learn, you have full programmatic control

over the web browser, so even the most complex tasks can be scripted.

Automate and Work More Efficiently

iMacros can run multiple instances simultaneously (“multi-threading”) and it can be scheduled to run in

the background while you work in other programs, or during non-work hours. iMacros provides visual

recording and playback of all web activity and the macros you create in one browser can be played

back or edited in another, as needed.

Form Filling

iMacros eliminates the tedious repetition of checking the same sites every day, remembering

passwords, and filling out web forms. iMacros is the only form filler that can autofill web forms that

stretch over several pages. All information is stored in human-readable, plain text files that can be

edited easily. Passwords are stored securely with secure 256-Bit AES encryption.

Page 5: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

iMacros

The World’s Most Popular Web

Automation Solution

Web Automation with Image Recognition

iMacros’ image recognition support lets you automate and test websites using images instead of

cumbersome X/Y coordinates. You tell iMacros how a button looks like and iMacros finds it on the

page. Even when the button has moved or if it has changed color or screen resolution. Since iMacros

relies only on the images that are rendered in the browser, it works independently of the underlying

technology.

Excel Web Queries

iMacros integrates directly with Excel and other MS Office applications, and comes with a complete

Excel VBA project that includes sample macros, scripts and the VBA program with source code. You

can easily customize the project to meet your needs.

Where Other Software Fails…

iMacros can interface your software with online databases and websites sites like Amazon, Ebay or

salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and

automate upload/download of data via a local, Intranet or Internet web interface.

iMacros can upload data from a spreadsheet to a website, or populate an Excel sheet with data from a

website.

iMacros can login to websites and navigate to a page, delete forum posting (which includes several

clicks like: “Are you sure?”, “Return to forum”, …). You can check for available jobs or items, entering

data to online search forms, and you can run these manually or have the action performed regularly on

an hourly basis or triggered by another program or script.

With iMacros you can automate almost anything.

Page 6: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

iMacros

Web Scraping, Data Extraction and Web MiningDo you need to screen-scrape web data into your database, spreadsheet or any other application? In

just minutes, you can use iMacros to do all the web-harvesting and web crawling you need –

automatically.

Extract Anything

Whether it’s price lists, stock information, financial data or any other type of data, iMacros can extract it.

Once you have your data, iMacros can write it to standard text files, including .csv or you can use

iMacros powerful scripting interface to save data directly to databases.

Multi-Thread Support

iMacros can multi-thread up to 50 instances at once with complete web crawling support. And iMacros

has full unicode support, it can extract text in all languages, including Asian languages such as

Chinese, Japanese and Korean.

Real-Word Use Cases

Some real-word examples of how our customers have used iMacros to extract data:

● Extract online pricing data, subtract one cent and add it to your online store.● Update internal systems with the latest exchange rates and stock-market quotations.● Gather leads from online business directories.● Gather search engine rankings.● Gather company information from many different directory websites.● Monitor order status from ecommerce portals. See what orders you still need to fulfill, when

they were ordered, and all applicable details.● Gather bookings for any type of resort, or area.● Gather price, quantity, item name, description, etc., from a supplier’s website.● Check competitor’s shipping rates on major shopping sites.● Monitor web-server availability and status.● Perform keyword and PPC research.● Extract product images and specification documents.● Extract useful information from encyclopedia and journal websites.● Check the meta information on pages of a website (description, keywords, page title).

Page 7: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

iMacros

Functional, Performance, and Regression

Testing

With iMacros you can quickly and easily automate functional, performance, and regression testing

across any website technology including Java, Flash, Flex or Silverlight applets and all AJAX elements.

And with iMacro built-in STOPWATCH command you can capture exact web page response times for

every step of a process.

Test with IE, Chrome and Firefox

With iMacros you can perform in-browser testing across all major browsers including Internet Explorer,

Firefox and Chrome. Test cases created in Internet Explorer work in Firefox and Chrome – and vice

versa. And with iMacros you have “multi-threading” – meaning you can run up to 50 separate instances

of iMacros at the same time.

Regression Testing

Regression testing with iMacros is easy and very flexible. When parsing a web site you want to find out

if a certain word exists on a web page to trigger further action (like saving the web page, printing the

page or running the next macro). This is also called keyword assertion or regression testing. If the

keyword does not exist, iMacros retries the keyword search automatically every second until a timeout

value is reached. If the keyword is still not found, iMacros reports an error. The automatic retry makes

web testing websites with AJAX easy. For standard websites, you can also combine a keyword search

to wait until a page changes.

Page 8: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

iMacros

Functional, Performance, and Regression

Testing

Testing AJAX Websites

Ajax-driven or JavaScript-heavy sites often require different strategies than when testing a regular site:

elements appear, disappear and change at any time. Because of its built-in “intelligence” iMacros can

automate many AJAX based websites using standard HTML based TAG commands. And it can

automate absolutely all AJAX elements with DirectScreen Technology. This allows in-browser testing of

even the most complicated AJAX elements, including sliders and drag & drop activity.

Table-Driven Testing

iMacros has built-in support for table-driven testing with its ability to read all csv formatted files (tables).

No additional coding or scripting is required. You can use any numbers of columns, and all kinds of

column content is supported (including full Unicode support). The number of table columns is

automatically detected.

Page 9: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

iMacros

Functional, Performance, and Regression

Testing

Testing AJAX Websites

Ajax-driven or JavaScript-heavy sites often require different strategies than when testing a regular site:

elements appear, disappear and change at any time. Because of its built-in “intelligence” iMacros can

automate many AJAX based websites using standard HTML based TAG commands. And it can

automate absolutely all AJAX elements with DirectScreen Technology. This allows in-browser testing of

even the most complicated AJAX elements, including sliders and drag & drop activity.

Table-Driven Testing

iMacros has built-in support for table-driven testing with its ability to read all csv formatted files (tables).

No additional coding or scripting is required. You can use any numbers of columns, and all kinds of

column content is supported (including full Unicode support). The number of table columns is

automatically detected.

Page 10: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

iMacros

A Full-Featured Web Browser API

Complete Web Browser Control from any Windows Programming

or Scripting Language.

The iMacros Enterprise Edition automatically installs the Web Browser API. With these powerful

commands you can control iMacros with any Windows programming language that supports the use of

COM objects. Almost all Windows programming languages support this technology, including the free

Windows Scripting Host, Visual Basic 6, Visual Basic .NET, C#, Java, Perl, Python, C++, ASP, PHP,

and ASP.NET.

Create Conditional Scripts That Can Do Anything

With the iMacros API, it’s easy to write scripts (in a scripting language of your choice) that allow you to:

Perform Internal Actions

● Incorporate if/else statements in your scripts to make decisions● Perform multi-loop actions● Parse data in your scripts to perform string manipulation● Write scripts that incorporate many variables● Make complex calculations in your scripts● Display GUI elements other than a simple prompt dialog● Handle error conditions, enabling you to write complex scripts

Perform External Actions

● Communicate with other applications (e.g. Excel)● Integrate with other tools/programs (e.g. web testing suites, web server scripts, email

servers, custom applications)● Call another macro to perform an action● Easily integrate data from external sources like databases● Write scripts that can save data to a database

Page 11: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

AlertFox

ALERTFOX REAL-TIME WEB UPTIME AND PERFORMANCE MONITORING

ALERTFOX: COMPLETE UPTIME & PERFORMANCE MONITORING

Page 12: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

AlertFox

Page 13: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

AlertFox

Page 14: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

AlertFox

Page 15: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

AlertFox

USE CASE: WEB APPS

MONITORING WEB APPLICATIONS INSIDE THE FIREWALL

Web applications inside the firewall are central to business and play a key role in employee

productivity. When they are slow or unavailable, business stalls. With AlertFox, you can easily verify

the availability and performance of your company's web apps.

USE CASE DETAILS

In our use case, several employees at the London office are having difficulty accessing the

company's ADP application. Our screenshot shows the delay in the server responding (red circle in

lower left) and we also see more details about the cause in the iMacros* popup (red circle upper

right). Let's see if AlertFox can show us what's behind the problem.

*If you're new to AlertFox, iMacros is the name of our transaction monitoring tool and it's the tool you would use to

create a monitored transaction. iMacros is available as a standalone application and as a browser plug-in.

Intermittent Downtime

Page 16: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

AlertFox

USE CASE: WEB APPSWhat AlertFox Show

ALERTFOX MONITORS ALL KEY APPLICATION PROCESSES

The IT team uses AlertFox to monitor resources across the distributed organization. Our snapshot shows

us that other regional offices are able to connect, and transactions like form completion and file upload are

working fine. The connectivity problem seems to be limited to the London office. Let's dig deeper.

USING ALERTFOX INSIDE THE FIREWALL

You can conveniently use the AlertFox iDrone virtual appliance inside your firewall to monitor company

web applications. With AlertFox, there's no need to open your firewall and potentially expose sensitive

company data (e. g. payment information or health insurance details). The only information sent back to

AlertFox from the iDrone appliance is the transaction macros and the performance data. All traffic between

the iDrone and the AlertFox servers is encrypted by SSL, so your macros are never exposed to a third

party.

However, if you feel uncomfortable editing/storing macros that contain passwords in plain text on the

AlertFox servers, you can opt to encrypt the passwords directly on your iDrone, so the login information

never leaves your premises. If you need a complete on premise solution (as opposed to AlertFox SAAS),

we offer this as well.

Page 17: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

AlertFox

USE CASE: WEB APPSAlertFox Overview Report

ERROR DETAILS

The AlertFox Overview report shows us what's happened with each monitored resource/transaction

(we call them sensors) over the last 24 hrs. Everything looks good except for the intermittent errors

(shown as small black squares) at the London office. To find out more we just use our mouse to click

on the hour block revealing the error details.

Page 18: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

AlertFox

USE CASE: WEB APPSView the Error Details

SENSOR DETAIL LOG

With the Sensor Detail Log report, we can see exactly when the problem occurred and the associated

error message generated by AlertFox. But what went wrong? Apparently, the page failed to load and

ultimately hit a timeout. We know that a number of steps occur during a successful page load, so which

step(s) isn't working?

Page 19: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

AlertFox

USE CASE: WEB APPSMulti Steps Graph

ALERTFOX MULTI-STEP GRAPH

The multi-step graph show us if one or more steps or resources are causing the problem in a monitored

transaction. This particular graph shows us data for five days and we see a a number of spikes in

runtime that are certainly associated with an application timeout. If a single step in the transaction is

taking too long, the transaction will timeout. The timeouts seem to be a connectivity issue - and not an

issue with the application itself.

Page 20: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

AlertFox

USE CASE: WEB APPSDrill Down

ROOT CAUSE ANALYSIS

Looking at a single day's multi-step graph, we can see that the many of the peaks show significant delays

in the page load time. Our data confirms the complaint by the London employees - the ADP application

was unavailable, most likely due to an intermittent issue with connectivity.

Page 21: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

AlertFox

USE CASE: WEB APPSSLA Monitoring

VERIFYING SLA'S

AlertFox can monitor web transactions and alert you if the performance is outside the agreed SLA

(illustrated here using the red vertical bars). As a result, your IT team can be notified the moment an

SLA breach occurs.

Page 22: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

AlertFox

USE CASE: WEB APPSReal Time Notification

WITH ALERTFOX YOU KNOW FIRST

To prevent loss of business, The IT team needs to know the moment a delay or outage occurs, so that they

can respond quickly and restore the web page service quality. With real-time notifications (SMS or email)

provided by AlertFox, the IT team can stay on top off any website performance issues.

HOW DOES ALERTFOX MONITOR VIDEO BUFFERING SPEED?

AlertFox uses an image recognition technology to verify the video is working correctly. It can measure the

time from the page load until the video starts to play, and alert you if there is a problem or a delay. You can

also use AlertFox to check on other events, such as the Flash player itself loading on the website.

Page 23: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

AlertFox

USE CASE: WEB APPSPerformance Details

UPTIME AND PERFORMANCE

A quick look at the e-commerce's site uptime and availability report shows no problems. With AlertFox, we

can view this data in near real-time, as well as with historical reports. To replicate the end user experience,

all uptime and performance tests (we call them sensors) are run from multiple monitoring locations in

Europe, the United States, and Asia. Next, let's take a look at the actual transaction detail.

Page 24: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

AlertFox

USE CASE: WEB APPSReading the Waterfall Diagrams

WHAT DOES A WATERFALL DIAGRAM SHOW?

Waterfall diagrams show the response time for each resource in a webpage, essentially the series of

actions that occur between a customer and your server, as they interact with a specific page on your

website.This data is visualized cumulatively and sequentially across a process.

Waterfall diagrams can look a little odd and even confusing, at first. What's important to know is that

each row represents a different object, such as text, an image, or a Javascript file, on a particular web

page. According to a 2013 survey done on the top 500 websites, the median web page size is 1095KB

and contains 91 resources (images, JavaScript, CSS files, etc) and each of these objects makes its

own roundtrip between the server and the browser.

For an IT team, a waterfall diagram can help simplify troubleshooting by clearly showing what's taking

the most time in the overall process.

Page 25: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

AlertFox

USE CASE: WEB APPSReviewing the Multi Step Report

TROUBLESHOOTING A TRANSACTION ERROR

The multi-step graph captures each step in the trial signup process. As you can see, the form

completion step stopped working at approximately 3 pm. With such a sudden change to the behavior,

perhaps it was the result of a website update? Let's take a look at the JavaScript operating behind the

form.

Page 26: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

AlertFox

USE CASE: WEB APPSViewing the Java Script Error

TEST AND FIND THE PROBLEM IN REAL-TIME

A quick inspection of the trial signup page in the browser editor reveals the problem. A JavaScript file was

published with a typo, LastNaame should be LastName. Problem solved. This should be an easy fix for

the team.

Page 27: and Performance Monitoring E-SPIN Web Application Testing · salesforce.com, use a programming interface (API) to control (script) Internet Explorer or Firefox, and automate upload/download

*

AlertFox

USE CASE: WEB APPSRun an instant test

TEST AN UPDATE IN REAL-TIME

Once the update has been made to the JavaScript and the page re-published, the IT team can use the

Instant sensor test feature in AlertFox to verify the fix solved the problem.