23
Company Confidential 1

Fut Lsi

Embed Size (px)

DESCRIPTION

Presentation

Citation preview

Page 1: Fut Lsi

Company Confidential 1

Page 2: Fut Lsi

Company Confidential

Index

• LSI-Patni Relationship

• Software Test life cycle

• Project Details

• Standard Used

• Testing Tools

• Metrics

• Quality

• Achievements

• Patni’s Contribution

Page 3: Fut Lsi

LSI - Patni Relationship

Page 4: Fut Lsi

Company Confidential

LSI-Patni Relationship

Patni’ has been working with LSI to supporting in following areas:•Understanding of the overall architecture•Design and Development of different Tools.•Developing and Testing Firmware•Enhancements for existing Tools•Migration work•Setting up the offshore development environment.

LSI is a leading global provider of innovative silicon, systems and software technologies that enable products which seamlessly bring people, information and digital content together. Including Custom and standard product ICs, adapters, systems and software that are trusted by the world's best known brands to power leading solutions in the Storage and Networking markets.

Page 5: Fut Lsi

Company Confidential

Software Test Life Cycle

• Requirement Phase

• Testing Phase

• Defect Validation Phase

• Delivery Phase

Project

Prerequisites

Resources Test Environment Documents Tools

Page 6: Fut Lsi

Company Confidential

Requirement Phase

To Gather Test Requirement from Client

Study client requirement

Prepare project plan & Time Estimation

Approve Test plan from Client

Page 7: Fut Lsi

Company Confidential

Testing Phase

Upload latest firmware from configuration tool (Clear Case)

Create and execute test script

Debug firmware if required

Analyze actual result with expected result

Update defect in configuration tool (Clear Quest )

Page 8: Fut Lsi

Company Confidential

Defect Validation Phase

Validate defect resolved by developer

Reject defect if persist after resolved

Communicate with developer for more

information

Closed Validated defects in Clear

Quest.

Page 9: Fut Lsi

Company Confidential

Delivery Phase

Deliver test script in Clear Case

Deliver test result to client

Conduct project review meeting

Page 10: Fut Lsi

Company Confidential

Project Details

• SATA Command testing

• MPI-2 Interface Testing

• ATA Passthrough Testing

• StoreLib IR Testing

• Integrated RAID 1E ASM Testing

• SimDiscovery Tool Testing

Page 11: Fut Lsi

Company Confidential

Test Setup

Server

HBA

HDD 1HDD 2HDD 3HDD 4

JBOD-1

HDD 1HDD 2HDD 3HDD 4

JBOD-2

Debugger

Desktop

Page 12: Fut Lsi

Company Confidential

SATA Command Testing

Requirement:

Firmware Unit testing of SCSI Primary commands (SPC) and SCSI Block commands (SBC) on SATA

device

Project Highlight:

1105 python script created and tested as a part of SATA commands testing.

User command for CM or command descriptor block (CDB) created to test 32 command set.

Efforts spent on SPC and SBC specification documents to get exact behavior of SATA commands.

Existing user commands and python scripts can be reused to test functionality of SATA commands.

Debug the firmware to find exact location of introduction of bug.

Communication with firmware development team to reproduce the detected bug.

Tested 1000+ python script as a part of SATA command regression testing.

Total 12 number of bugs reported.

100 % coverage to SATA command testing.

Only 3 Resources involved in SATA command testing.

Page 13: Fut Lsi

Company Confidential

MPI-2 Testing

Requirement:

To test functionality of Message Passing interface ( MPI-2)

specification

Project Highlight:

Total 512 perl script created and tested as a part of MPI-2 testing

Total 14 bugs reported for MPI-2 testing

Only 3 –resources involved for testing

100 % coverage to MPI2- Specification

Project completed and delivered on schedule

Page 14: Fut Lsi

Company Confidential

ATA Passthrough Testing

Requirement:

To test ATA Passthrough commands on SATA drive.

Project Highlight:

Total 22 ATA Passthrough commands consider for testing from following protocol group

Non data transfer commands

PIO data in commands

PIO Data out commands

DMA Data in Commands

DMA Data out commands

Total 400+ python script are expected in ATA Passthrough testing

10+ defects expected in ATA Passthrough testing

100 % ATA Passthrough specification coverage

Expected 0% schedule variance

Page 15: Fut Lsi

Company Confidential

StoreLib IR testing

Requirement:

To test StoreLibIR-2 Library provided by LSI ESG group

Project Highlight:

Testing of StoreLibIr-2 executed in two phases

StoreLibIR-2 Phase 1:

Created manual test case to covered all normal and abnormal scenarios.

Time constraint- As per schedule testing completed in 16 days

StoreLibIR-2 Phase 2:

Testing each and every data field of StoreLibIR-2 library

Expected more than 200+ perl script for StoreLibIR-2 library testing

Expected more than 20 defects in StoreLibIR-2 testing

100 % testing coverage to StoreLibIR -2 Library testing.

Page 16: Fut Lsi

Company Confidential

IR-1E and SimDiscovery testing

Integrated RAID -1E TestingRequirement:

To test Integrated RAID 1E ASM (Adjacent stripped mirroring)

Project Highlight:

Created perl script and manual test case to test IR 1E ASM testing

Expected more than 120 test cases

Expected more that 10 defects

100 % testing coverage

0 % schedule variance

SimDiscovery TestingRequirement:

To test Discovery process by using SimDiscovery simulation tool

Project Highlight:

Complex topology created and tested to simulate real scenarios.

Expected more than 20 defects

100 % coverage

Page 17: Fut Lsi

Company Confidential

Standards and Testing Tool

Standards : SCSI Block Commands (SBC-3)

SCSI Primary Commands (SPC-4)

ATA/ATPI command set (ATA8-ACS)

Testing Tool : Crack Monkey

GreenHills Probe

StoreLib Test

Fracture

Page 18: Fut Lsi

Company Confidential

Metrics-Project Efforts

Efforts ( Person Days)

SATA command 48%

MPI-2 27%

StoreLib IR 5%

SimDiscovery 6%

SATA Regression 9%

IR-1E 5%

SATA command

SATA Regression

MPI-2

IR-1E

StoreLib IR

SimDiscovery

Page 19: Fut Lsi

Company Confidential

Metrics- Reported Defects

No of Defects

9

2

14

5

3

12

SATA command

SATA Regression

MPI-2

IR-1E

StoreLib IR

SimDiscovery

No of Defects

Page 20: Fut Lsi

Company Confidential

Quality

Attended SCG quality training

Value addition to quality process

SCG quality process followed holistically

Maintained all the artifacts in clear Case

Attention towards improving SCG quality process

Page 21: Fut Lsi

Company Confidential

Achievments

On Time Schedule delivery

Achieved Defect Ratio

100 % testing coverage

Page 22: Fut Lsi

Company Confidential

Patni’s Contribution

200

6

200

7

200

8

200

9

201

0

Performan

ce

RAID

Controlle

rLSI Tarari

Processor

MultiCore Architecture in Mobile

Networks

An innovative blue print for an

asymmetrical

multicore architecture targeted at

mobile

networks

Industry’s first single chip, low cost solution

for content inspection

LSI as the worldwide leader in host bus

RAID

controller unit shipment

Patni

LSI

Minimum Resources

Maximum Efficiency

0 % Schedule Variance

100 % Code Coverage

Maximum Defect count

Page 23: Fut Lsi

Company Confidential