Control the Chaos with Novell File Reporter

Control the Chaos with Novell® File Reporter

Doug [email protected]

Norm [email protected]

mailto:[email protected]

mailto:[email protected]

© Novell, Inc. All rights reserved.2

Agenda

• Customer Challenges

• Novell® File Management Suite Overview

• Novell File Reporter

• Summary

Novell® File Management SuiteIntroduction


The Iceberg in the Data CenterCould it sink you?

structured data

unstructured data

80% of all digitaldata is unstructured

Unstructured data is growing by 60% CAGR

Unstructured data resists utilization and reuse


Customer Challenges

• Explosive growth of unstructured data (files)• Regulatory compliance• Storage admin tasks highly manual and redundant• Costs in hardware, power, cooling, administration• More electronic collaboration = more files• Hidden value deep in file systems• Where to start?


File-based Data Growth

IDC, January 2009

“The fastest-growing data type is the file. Unstructured, file-based data is growing faster, is consuming more space, and is being retained longer. This is a challenge that touches every tier of storage, from primary to data protection to archiving.”


Just Adding Storage is Unsustainable

“Simply continuing to add more storage through traditional methods is unsustainable because many datacenters will be unable to provide the necessary power, space, or cooling. As a result, companies need to be more effective and efficient in the way they provide storage resources.”

IDC, December 2007


Do you know...

How many orphaned folders are on the network?

How many TB of MP3s?

How many documents haven't been accessed in the six months? The last year?

How many redundant files are stored?

Do you know how much space the files above take up on your network?

How much does it cost to power and cool?

How much time are you spending backing up?

Understanding your data better is the first step to rationalizing it


Two Approaches to Efficiency

Before Now

Why not control data at the source? Start with the user.

• Buy more disk• Manage blocks• Manage LUNs• Hierarchical Storage

Management• Storage Virtualization• Others

• Assess your current state• Customize policies for your

business requirements• Control data based on its

relevance• Automate mundane tasks• Optimize your file storage• Reduce back-up windows• Maintain streamlined

storage environment

The Novell® Solution


Enhance and Complement Novell® File Management Suite

Operating System / Driver

Storage Resource Management

Virtual Device Management

Volume / LUN

Physical Device Management

SAN / NAS / DAS

File

Blo

ck

Automated and Identity-DrivenFile System Management

Directory Services / Policy

File System

Novell FileManagement Suite

Traditional “Storage Resource Management”

domain populated by Storage Vendors

Universal Solution – Works With Any Incumbent Solution


Novell® File Management Suite

Policy-Based DataRelocation

Automated DataReporting

Identity-Driven Data Management


Stale data canbe relocated to

cheaper storagedevices

User creates, accesses, saves data

to disk

Lifecycle of Unstructured Data

Identity-DrivenData

Management

AutomatedData

Reporting

Back Up Back Up

Policy-basedData

Relocation

IT assesses data usagepatterns and makes or

adjust policies to optimizefixed resources

Automatedpolicies attachdata to usersand groups,

while keepingcosts low for IT


Identity-DrivenData Management

1. Novell® Storage ManagerIdentity-driven File Management

• Novell Storage Manager manages files and folders with polices based on user identities and roles

• IT customizes policies based on their own business rules, thereby automating redundant, low-value tasks over the life-cycle of the file

– Provisions and deprovisions based on identity

– Moves and restructures data (event driven)

– Load-balances

– Vaults and deletes files based on policyIdentity-Driven

Data Management


2. Novell® Dynamic File ServicesPolicy-based File Relocation

• Dynamic File Services automatically moves “stale” files from expensive primary storage to low-cost secondary storage, based on policies set by IT

• File tiering is accomplished without any impact to the end user; files appear to be exactly where originally stored

– Windows and Linux-based file systems

– Customizable policies based on identities and file metadata

– Automated tieringPolicy-based

File Relocation


2. Novell® Storage ReporterAutomated File Reporting

• Novell File Reporter inventories file systems to provide IT with a clear picture of storage resource usage across multiple categories, including user identities

• Reports can be used to construct and fine-tune policies for Novell Storage Manager and Novell Dynamic File Services

– Immensely scalable

– Scheduled or ad-hoc reporting

– Trend data and monitorAutomated

File Reporting


StorageManager

provisionsstorage

based onidentity and

policy

The Intelligent Way to Manage File Data

Dynamic FileServices allowsseamless tiering

of storageinfrastructures

based on policy

Novell StorageManager

Novell FileReporter

Back Up Back Up

NovellDynamic File

Services

File Reporter produces storageinventory reports that the

administrator can use to initiallyconstruct and later fine-tune

Dynamic Storage and StorageManager policies

Storage Managerpolicies govern

life-cycleautomation and compliance with

regard to file system data

Novell® File Reporter


Addressing File-based Data Growth

IDC, January 2009

“Nothing can be done to control the costs of file-based storage without knowing who is creating a majority of the data and to what end.”


Even with ample storage...

Without even a basic knowledge of:• How much you are storing• How much capacity if being used• What volumes are storing the most data• How old your data is

It’s probably costing you money!


Potential Needless Spending On

Tier 1 Storage Capacity

Storage Allocation

Power Consumption

Cooling

Maintenance

Additional Servers

More


• Storage devices are rolled out

• Assigned based on best guesses

• Basically ignored until a problem appears

Little Thought When Assigning Storage


Novell® File ReporterDesigned to Answer the Question

Are werunning outof storage?

If yes...Where?

And whyare we

running outof space?


Where Has All My Space Gone?

Has therebeen a

significantincreasein users?

In whatgroup?

Are there a lot of

redundantfiles?

Where?

Who hasthem?

Is spacebeing

abused?

By whom?Are weat risk?

Are wekeeping old filestoo long?

What are

typical usagepatterns?

When werethese fileslast used?

Who owns

them?

Are theyrelevant to

our business?

Novell® File ReporterArchitecture and Requirements


Novell® File Reporter

• Was developed to examine and report on terabytes of data

• In other words, millions of files and directories scattered among the various network storage devices that make up the network

• To do so efficiently, Novell File Reporter disperses the work load


Worst Case Assumptions

Built for Enterprise Level Report Size Assumptions

100 MillionDirectories

1 BillionFiles

750 MillionUnique

FileNames

100,000Unique

FileExtensions

200,000Owners

75 MillionDuplicate

FileNames


Report Types

System Inventory Report

Summary Report

Access Date Age Report

Modification Date Age Report

Filename Extension Report

Owner Report

Duplicate File Report

Comparison Report

Storage Cost Report

Triggered Reports

Filtered Report

Trending Report

Aggregation Report across multiple SR's

Policy-based Report (NSM Integration)

NFRAdmin


NetwareAgent

OES Linux Agent

Windows Agent

NSM 2.5 eDirectory

DSI eDirectory

NSM 2.5 Active Directory

DSIActive Directory

File Reporter Engine Server

NFRAdmin

Windows Server

SLESOES Linux

Generate Reports

Display Reports

Linux Agent

Scan

Scan

Scan

Scan

SR

SR

SR

SR

Netware

OES Linux

Windows Server

SLES

Novell® File Reporter Architecture



NetwareAgent

OES Linux Agent

Windows Agent

NSM 2.5 eDirectory

DSI eDirectory


DSIActive Directory


NFRAdmin

Windows Server

SLESOES Linux

Generate Reports

Display Reports

Linux Agent

Scan

Scan

Scan

Scan

SR

SR

SR

SR

Netware

OES Linux

Windows Server

SLES


Service Options – Active Directory

NSM Policies

License

Automatic


License


Straight Linux

License


Manually Defined Paths

AD Authentication AD Authorization NFR License Management Policy-based Reporting Automatic Storage Resource

Discovery Manual Storage Resource Definition





Manual

A) Automatic Mode B) Manual Mode

NSM 2.5DSI DSI

Windows Server Shares

Automatic


There are 2 options for eDirectory™ integration:

1. Use NSM 2.5 for AD 2. Use File Reporter’s Directory Services Interface (DSI)



License


Straight Linux

License







Manual


DSI DSIAutomatic


2. Use File Reporter’s Directory Services Interface (DSI)

Options without NSM 2.5 AD



NSM Policies

License

Automatic


License


Straight Linux

License









Manual


NSM 2.5DSI DSI


Automatic



Upgrade Path to NSM 2.5 AD – DSI in Automatic Mode Only

Upgrade Path


Service Options - eDirectory™

NSM Policies

License

Automatic


License


Straight Linux

License









Manual



NSM 2.5DSI DSIAutomatic

There are 2 options for eDirectory integration:

Netware

OESLinux

Netware

OESLinux



NetwareAgent

OES Linux Agent

Windows Agent

NSM 2.5 eDirectory

DSI eDirectory


DSIActive Directory


NFRAdmin

Windows Server

SLESOES Linux

Generate Reports

Display Reports

Linux Agent

Scan

Scan

Scan

Scan

SR

Netware

OES Linux

Windows Server

SLES

SR

SR

SR


NFRAdmin Management Interface

• Single Interface for management and reporting• Windows .NET 3.5 Application

– Windows XP SP3 or later, Vista SP1 or later, Windows 7

– Windows Server 2003 SP2 or later, Windows Server 2008

NFRAdmin


DSI ActiveDirectory


Automatically Discover Storage Resources

Automatic Mode

License

1. Authentication2. Authorization3. Verify License4. Build Resource Lists

Schedule Scans and Run Reports

Generate Reports


NFRAdmin




Policy-based Reporting

Automatically Discover Storage Resources

NSM Integrated

License

1. Authentication2. Authorization3. Verify License4. Build Resource Lists5. Policy-based Reporting

Schedule Scans and Run Reports

NFRAdmin Management Interface

• Single Interface for management and reporting• Windows .NET 3.5 Application

– Windows XP SP3 or later, Vista SP1 or later, Windows 7

– Windows Server 2003 SP2 or later, Windows Server 2008Generate Reports



NetwareAgent

OES Linux Agent

Windows Agent

NSM 2.5 eDirectory

DSI eDirectory


DSIActive Directory


NFRAdmin

Windows Server

SLESOES Linux

Generate Reports

Display Reports

Linux Agent

Scan

Scan

Scan

Scan

SR

Netware

OES Linux

Windows Server

SLES

SR

SR

SR



Windows Server

SLESOES Linux

Generate Reports

Display Reports


• Engine that runs Novell® File Reporter• Resides on:

– Novell Open Enterprise Server 2 running SUSE® Linux– SUSE Linux Enterprise 10– Microsoft Windows 2003 or 2008 Server

• Communicates with Novell Storage Manager 2.5 Engine for Integration


Windows Agent

Scan

SR

Share

File Reporter Engine Server (cont.)

• Processes the scans based on schedule• Compiles them for inclusion in a report• Provides all report information to user interface• Determines that a condition has been met for a triggered report• Monitors how many agents are online


Windows Server

SLESOES Linux

Generate Reports

Display Reports


NetwareAgent

OES Linux Agent

Windows Agent

NSM 2.5 eDirectory

DSI eDirectory


DSIActive Directory


NFRAdmin

Windows Server

SLESOES Linux

Generate Reports

Display Reports

Linux Agent

Scan

Scan

Scan

Scan

SR

Netware

OES Linux

Windows Server

SLES

SR

SR

SR



Netware

OES LinuxOES Linux

Agent

Windows Server

WindowsAgent

SLESLinux Agent

SR

SR

SR

SR

Storage Resources and Reporting Agents• A Storage Resource (SR) can be a server volume, Novell Storage

Manager policy, network folder path, or a Linux mount point• Agent performs a “Scan” of the SR to which it is assigned• Agents for:

– Netware®

– Open Enterprise Server 2 Linux– Windows 2003 and 2008 Server– SUSE® Linux

NetwareAgent


File Reporting Agents (cont.)

• Examines and reports on variety of file systems

– Novell Storage Services™

– Novell® Traditional

– Novell NCP™

– Windows NTFS

– Reiser

– ext3

NetwareNetwareAgent

OES LinuxOES Linux

Agent

Windows Server

WindowsAgent

SLESLinux Agent

SR

SR

SR

SR


• The Agent initiates a Scan of the Storage Resource (SR)• Scans are indexed and compressed data specific to a SR• A Scan is decompressed only when data within the scan will be used to

generate a report• A Scan includes comprehensive information on

– File types being stored and file size– Duplicate files, file owners– When files were created or last modified– Much more

Windows Agent

Scan

Compressed

NFRAdmin

Display Reports

Decompressed

Engine Server

Indexed SR

Share

Scans

Demo

Unpublished Work of Novell, Inc. All Rights Reserved.This work is an unpublished work and contains confidential, proprietary, and trade secret information of Novell, Inc. Access to this work is restricted to Novell employees who have a need to know to perform tasks within the scope of their assignments. No part of this work may be practiced, performed, copied, distributed, revised, modified, translated, abridged, condensed, expanded, collected, or adapted without the prior written consent of Novell, Inc. Any use or exploitation of this work without authorization could subject the perpetrator to criminal and civil liability.

General DisclaimerThis document is not to be construed as a promise by any participating company to develop, deliver, or market a product. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. Novell, Inc. makes no representations or warranties with respect to the contents of this document, and specifically disclaims any express or implied warranties of merchantability or fitness for any particular purpose. The development, release, and timing of features or functionality described for Novell products remains at the sole discretion of Novell. Further, Novell, Inc. reserves the right to revise this document and to make changes to its content, at any time, without obligation to notify any person or entity of such revisions or changes. All Novell marks referenced in this presentation are trademarks or registered trademarks of Novell, Inc. in the United States and other countries. All third-party trademarks are the property of their respective owners.

Technology

Control the Chaos with Novell File Reporter