28
New Migration Solution NetApp Migration Tool Migration Professional Services Custom built to migrate of a NetApp (isi_vol_copy) Handle CIFS,NFS and mixed mode data along with permissions Faster and efficient– Minimize lengthy tree walks Eliminate additional hosts for migration – ships as a part of the OneFS operating system 10,000TB+ Migrated to date End to End handling of Data migration Project Planning and management Solution Architecture Environment analysis Test Planning Implementation and Handover Access to Global resource footprint EMC/Isilon PS team Delivered People Process Technology

Isilon Migration Solution Overview

  • Upload
    anon

  • View
    371

  • Download
    8

Embed Size (px)

DESCRIPTION

Isilon Migration Solution Overview

Citation preview

Page 1: Isilon Migration Solution Overview

New Migration SolutionNetApp Migration

ToolMigration

Professional Services

Custom built to migrate of a NetApp (isi_vol_copy)

Handle CIFS,NFS and mixed mode data along with permissions

Faster and efficient– Minimize lengthy tree walks

Eliminate additional hosts for migration – ships as a part of the OneFS operating system

10,000TB+ Migrated to date

End to End handling of Data migration

• Project Planning and management

• Solution Architecture

• Environment analysis

• Test Planning

• Implementation and Handover

Access to Global resource footprint

EMC/Isilon PS team Delivered

People

Process

Technology

Page 2: Isilon Migration Solution Overview

Isilon’s isi_vol_copyComparison with other host based tools

Page 3: Isilon Migration Solution Overview

A Typical host based migration solution – first full copy

Destination– Isilon

Host running Robocopy/Rsync

f2

f3

f1

Read/WriteFull copy vol\mkt to ifs\mkt

Open directory mkt

Read directory

create directoryRead/Write

Source– NetApp

Read/Writevol\mkt

Ifs\ mkt

Page 4: Isilon Migration Solution Overview

A Typical host based migration solution – first full copy

Destination– Isilon

Host running Robocopy/Rsync

f2

f3

f1

Read/WriteFull copy vol\mkt to ifs\mkt

Open directory mkt

Read directory

Begin tree walk

Open file ‘f3’

Read file ‘f3’

create directory

Create file ‘f1’

Write file ‘f1’

Read/Write

f1

Source– NetApp

Read/Writevol\mkt

Ifs\ mkt

Page 5: Isilon Migration Solution Overview

A Typical host based migration solution – first full copy

Destination– Isilon

Host running Robocopy/Rsync

f2

f3

f1

Read/WriteFull copy vol\mkt to ifs\mkt

Open directory mkt

Read directory

Begin tree walk

Open file ‘f3’

Read file ‘f3’

create directory

Create file ‘f2’

Write file ‘f2’

Read/Write

f1f2

Source– NetApp

Read/Writevol\mkt

Ifs\ mkt

Page 6: Isilon Migration Solution Overview

A Typical host based migration solution – first full copy

Destination– Isilon

Host running Robocopy/Rsync

vol\mkt

f2

f3

f1

Read/WriteFull copy vol\mkt to ifs\mkt

Open directory mkt

Read directory

Begin tree walk

Open file ‘f3’

Read file ‘f3’

create directory

Create file ‘f3’

Write file ‘f3’

Read/WriteIfs\ mkt

f1f2

f3

Source– NetApp

Read/Write

Page 7: Isilon Migration Solution Overview

A Typical host based migration solution – incremental copy

Destination– Isilon

Host running Robocopy/Rsync

f2

f3

f1

Read/Writeincremental copy vol\mkt to ifs\mkt

Open directory mkt

Read directory

Begin tree walk

create directory

Read directory

Begin treewalk

Read/Write

f1f2

f3

Source– NetApp

Read/Writevol\mkt

Ifs\ mkt

Page 8: Isilon Migration Solution Overview

A Typical host based migration solution – incremental copy

Destination– Isilon

Host running Robocopy/Rsync

f2

f3

f1

Read/Writeincremental copy vol\mkt to ifs\mkt

Open directory mkt

Read directory

Begin tree walk

create directory

Read directory

Begin treewalk

Read/Write

f1f2

f3

Source– NetApp

Read/Write

Check time stamp on ‘f1’

Check time stamp on ‘f1’

vol\mkt

Ifs\ mkt

Page 9: Isilon Migration Solution Overview

A Typical host based migration solution – incremental copy

Destination– Isilon

Host running Robocopy/Rsync

f2

f3

f1

Read/Writeincremental copy vol\mkt to ifs\mkt

Open directory mkt

Read directory

Begin tree walk

create directory

Read directory

Begin treewalk

Read/Write

f1f2

f3

Source– NetApp

Read/Write

If different

vol\mkt

Ifs\ mkt

Page 10: Isilon Migration Solution Overview

A Typical host based migration solution – incremental copy

Destination– Isilon

Host running Robocopy/Rsync

f2

f3

f1

Read/Writeincremental copy vol\mkt to ifs\mkt

Open directory mkt

Read directory

Begin tree walk

create directory

Read directory

Begin treewalk

Read/Write

f1f2

f3

Source– NetApp

Read/Write

Read file ‘f1’ Read file ‘f1’

Perform Hash and compare on both files

vol\mkt

Ifs\ mkt

Page 11: Isilon Migration Solution Overview

A Typical host based migration solution – incremental copy

Destination– Isilon

Host running Robocopy/Rsync

f2

f3

f1

Read/Writeincremental copy vol\mkt to ifs\mkt

Open directory mkt

Read directory

Begin tree walk

create directory

Read directory

Begin treewalk

Read/Write

f1f2

f3

Source– NetApp

Read/Write

Read file ‘f1’ Write to file ‘f1’

vol\mkt

Ifs\ mkt

Page 12: Isilon Migration Solution Overview

A Typical host based migration solution – incremental copy

Destination– Isilon

Host running Robocopy/Rsync

f2

f3

f1

Read/Writeincremental copy vol\mkt to ifs\mkt

Open directory mkt

Read directory

Begin tree walk

create directory

Read directory

Begin treewalk

Read/Write

f1f2

f3

Source– NetApp

Read/Write

Check time stamp on ‘f2’

Check time stamp on ‘f2’

vol\mkt

Ifs\ mkt

Page 13: Isilon Migration Solution Overview

A Typical host based migration solution – incremental copy

Destination– Isilon

Host running Robocopy/Rsync

f2

f3

f1

Read/Writeincremental copy vol\mkt to ifs\mkt

Open directory mkt

Read directory

Begin tree walk

create directory

Read directory

Begin treewalk

Read/Write

f1f2

f3

Source– NetApp

Read/Write

If different

vol\mkt

Ifs\ mkt

Page 14: Isilon Migration Solution Overview

A Typical host based migration solution – incremental copy

Destination– Isilon

Host running Robocopy/Rsync

f2

f3

f1

Read/Writeincremental copy vol\mkt to ifs\mkt

Open directory mkt

Read directory

Begin tree walk

create directory

Read directory

Begin treewalk

Read/Write

f1f2

f3

Source– NetApp

Read/Write

Read file ‘f2’ Read file ‘f2’

Perform Hash and compare on both files

vol\mkt

Ifs\ mkt

Page 15: Isilon Migration Solution Overview

A Typical host based migration solution – incremental copy

Destination– Isilon

Host running Robocopy/Rsync

f2

f3

f1

Read/Writeincremental copy vol\mkt to ifs\mkt

Open directory mkt

Read directory

Begin tree walk

create directory

Read directory

Begin treewalk

Read/Write

f1f2

f3

Source– NetApp

Read/Write

Read file ‘f2’ Write to file ‘f2’

vol\mkt

Ifs\ mkt

Page 16: Isilon Migration Solution Overview

A Typical host based migration solution – incremental copy

Destination– Isilon

Host running Robocopy/Rsync

f2

f3

f1

Read/Writeincremental copy vol\mkt to ifs\mkt

Open directory mkt

Read directory

Begin tree walk

create directory

Read directory

Begin treewalk

Read/Write

f1f2

f3

Source– NetApp

Read/Write

Check time stamp on ‘f3’

Check time stamp on ‘f3’

vol\mkt

Ifs\ mkt

Page 17: Isilon Migration Solution Overview

A Typical host based migration solution – incremental copy

Destination– Isilon

Host running Robocopy/Rsync

f2

f3

f1

Read/Writeincremental copy vol\mkt to ifs\mkt

Open directory mkt

Read directory

Begin tree walk

create directory

Read directory

Begin treewalk

Read/Write

f1f2

f3

Source– NetApp

Read/Write

If different

vol\mkt

Ifs\ mkt

Page 18: Isilon Migration Solution Overview

A Typical host based migration solution – incremental copy

Destination– Isilon

Host running Robocopy/Rsync

f2

f3

f1

Read/Writeincremental copy vol\mkt to ifs\mkt

Open directory mkt

Read directory

Begin tree walk

create directory

Read directory

Begin treewalk

Read/Write

f1f2

f3

Source– NetApp

Read/Write

Read file ‘f3’ Read file ‘f3’

Perform Hash and compare on both files

vol\mkt

Ifs\ mkt

Page 19: Isilon Migration Solution Overview

A Typical host based migration solution – incremental copy

Destination– Isilon

Host running Robocopy/Rsync

f2

f3

f1

Read/Writeincremental copy vol\mkt to ifs\mkt

Open directory mkt

Read directory

Begin tree walk

create directory

Read directory

Begin treewalk

Read/Write

f1f2

f3

Source– NetApp

Read/Write

Read file ‘f3’ Write to file ‘f3’

vol\mkt

Ifs\ mkt

Page 20: Isilon Migration Solution Overview

Key points to note Numerous CIFS/NFS client operations competing with

‘business workflows’

Tree walk and hashing bottleneck during incremental– Prolonged periods of incremental extends duration of

migration exponential to the file operations encountered on source during the migration

– Prolonged cut over windows on the source means extended downtime for end users

Provision additional hosts in the datacenter– Host count has to scale with growing file count , size and

copy rate– Separate hosts for CIFS and NFS migrations

Page 21: Isilon Migration Solution Overview

Isilon solution – full copyDestination

– Isilon

f2

f3

f1

Read/Write

Source– NetApp

Send NDMP stream Read NDMP stream

Full copy root\mkt to ifs\mkt

Root\mkt

Page 22: Isilon Migration Solution Overview

Isilon solution – full copyDestination

– Isilon

f2

f3

f1

Read/Write

Source– NetApp

Send NDMP stream Read NDMP stream

Full copy root\mkt to ifs\mkt

File system operations

Root\mkt

Ifs\ mkt

Page 23: Isilon Migration Solution Overview

Isilon solution – full copyDestination

– Isilon

f2

f3

f1

Read/Write

f1

Source– NetApp

Send NDMP stream Read NDMP stream

Full copy root\mkt to ifs\mkt

File system operations

Root\mkt

Ifs\ mkt

Page 24: Isilon Migration Solution Overview

Isilon solution – full copyDestination

– Isilon

f2

f3

f1

Read/Write

f1f2

Source– NetApp

Send NDMP stream Read NDMP stream

Full copy root\mkt to ifs\mkt

File system operations

Root\mkt

Ifs\ mkt

Page 25: Isilon Migration Solution Overview

Isilon solution – full copyDestination

– Isilon

f2

f3

f1

Read/Write

f1f2

f3

Source– NetApp

Send NDMP stream Read NDMP stream

Full copy root\mkt to ifs\mkt

File system operations

Root\mkt

Ifs\ mkt

Page 26: Isilon Migration Solution Overview

Isilon solution – full copyDestination

– Isilon

f2

f3

f1

Read/Write

f1f2

f3

Source– NetApp

Send NDMP stream with changes since

last copy

Read NDMP stream

Incremental copy root\mkt to ifs\mkt

File system operations

Root\mkt

Ifs\ mkt

Page 27: Isilon Migration Solution Overview

Benefits of isi_vol_copy Reduce client side operations and thereby overhead

on system performance

Leverages SnapDiff/ONTAP native file system operations to reduce tree walk/hashing overhead during migrations

Same tool handles CIFS/NFS. Ships as part of OneFS– Eliminate additional host requirements for migration– Utilize available compute resources on Isilon cluster for

migration

Page 28: Isilon Migration Solution Overview

Comparison MatrixIsi_vol_copy Robocopy Rsync

CIFS Data Supported Supported Not supported

NFS Data Supported Not supported Supported

Computing requirements

Ships with Isilon cluster Additional hosts need to be provisioned

Additional hosts need to be provisioned

Performance enhancement features

• Tree walk & Hashing optimization

• Avoidance of CIFS/NFS protocol operations

• Incremental copies

Incremental copies Incremental copies

Sources supported

NetApp only Any system supporting CIFS

Any system supporting NFS

ONTAP requirements

7.3 and above. No ‘cluster mode’ support

NA NA