© 2012 ANSYS, Inc. June 21, 20122

Scalable Storage and Data Management for Engineering Simulation

ANSYS IT Solutions Webcast Series

© 2012 ANSYS, Inc. June 21, 20123

2012 webcast series from ANSYS and our partners

Our goal is to provide ANSYS customers with•Recommendations on HW and system specification

•Best practice configuration, setup, management

•Roadmap and vision for planning

Upcoming Topics•Workstation Refresh ROI

•Cloud, mobile platforms, …

IT Solutions for ANSYS ‐Webcast Series

http://www.ansys.com/Support/Platform+Support/IT+Solutions+for+ANSYS+Webcast+Series+2012

© 2012 ANSYS, Inc. June 21, 20124

ANSYS Focus on IT Solutions

IT is the enabler for more effective use of engineering simulation. 

High Fidelity Results

Simulation allows engineering to know, not guess –but only if IT can deliver infrastructure suited for ever larger “mega”‐simulations

Design Exploration / Optimization

Product integrity requirements drive automated execution of 100’s of simulations, with important implications for the IT infrastructure

Average HPC infrastructure for ANSYS in our largest customers is 

well over 10,000 cores –and growing very fast

© 2012 ANSYS, Inc. June 21, 20125

Local computing infrastructure for simulation is transitioning to centralized HPC resources, shared by a globally distributed workforce.

HPC

Users

Centralized HPC and Global Collaboration

© 2012 ANSYS, Inc. June 21, 20126

Local computing infrastructure for simulation is being replaced by centralized HPC resources, shared by a globally distributed workforce.

Remote simulation workflow challenges center on data– Moving simulation files is expensive (people time and network bandwidth)

• Makes sense to co‐locate data storage and compute capacity – Shared data repositories enhance collaboration and IP management

• Data maintained securely, with access via remote graphics clients

Centralized HPC and Global Collaboration

© 2012 ANSYS, Inc. June 21, 20127

Scalable Storage and Data Management for Engineering Simulation

Today’s Agenda and Speakers

• Industry trends & challenges: Smart Computing for product development

• Prashant Avashia, Software Engineer, Systems and Technology Group, IBM

• Simulation data management for engineering productivity• Sanjay Angadi, Senior Product Manager, ANSYS

• Smart Storage ‐ scalable storage for simulation• Prashant Avashia, Software Engineer, Systems and Technology Group, IBM

•Question / Answer

© 2012 ANSYS, Inc. June 21, 20128

Industry trends & challenges: Smart Computing for product development

Prashant Avashia, Software Engineer, Systems and Technology Group, IBMpavashia@us.ibm.com

© 2012 ANSYS, Inc. June 21, 20129

Market Opportunities & Industry Challenges

Reality• New markets are stimulating growth for innovative products and services• Financial crises is forcing significant reductions in engineering budgets 

globally.• Continual pressure to shorten product development cycles and reduce costs.• Product development & manufacturing is now global, complex, and very 

competitive.• Integration challenges exist between Engineering Design, Simulation, 

Production:• Globally distributed workforce presence• Cross‐Domain Practices • Use of different systems, standards, tools, processes, and formats• Different OEM’s, supplier specifications, tolerances, and restrictions.• Different BOMS, versions, databases, accesses• Unique regulatory requirements, and compliances.• This results in complex processes, enormous data explosion, cross domain practices

© 2012 ANSYS, Inc. June 21, 201210

Leadership Vision & Strategy ‐ to sustain Enterprise Growth

Vision• Innovate new products & services

• Optimize the Global Value Chain

• Manage development complexity

Strategy• Smart Computing

• Rethink Sourcing Approaches. [Look at Extended Lead Times as a source of cost.]

• Optimize Engineering Resources. [Engineers ≠ System Administrators]

• Shift towards Mobile, Cloud and Big Data Technologies

• Centralize Data repositories for engineering, transportation, supply‐chain, tooling and mfg. transactions

• Access same data records from a range of  diverse applications such as EDI, PO, MO, code scanners 

• Simplify Everything

© 2012 ANSYS, Inc. June 21, 201211

Data Lifecycle & Operational Challenges

Engineers doing “IT” work instead of engineering and product development.• Configure servers and storage• Install & Tune software• Tune OS Kernels• Update Databases• Tune File Systems, Storage Systems• ….is this a familiar picture…?

Do Outsourced Engineers follow the same protocols, tools, & processes as Corporate Engineers?

• Engineering specifications, standards• CAD designs• Tooling• Processes

Is Engineering Design and  Product Quality consistent across geographical boundaries?

© 2012 ANSYS, Inc. June 21, 201212

Smarter Computing for Product & Service Development

Design Management & Process Control systems on consolidated, virtualized servers – for reduced cost, greater agility, scalability, efficiency, and availability

Compute intensive applications on HPC serversfor improved analytical and operational insight

Global file systems and scalable storage (block & file)for central control and world-wide access to valid data

Security: data protection -identity

and access managem

ent

Remote user access - supporting anytime, anywhere, collaborative work A

dvanced Service Managem

ent –optim

izing across Engineering & IT

Business & Engineering Desktops

Enterprise Computing

Technical Computing– Design Analysis &

3D Visualization

Storage

© 2012 ANSYS, Inc. June 21, 201213

AIX

RemoteVaultCache

HPC Files

Security: data protection, identity and access management

Advanced Service Management –optimizing across business and IT

Web browser

HTTPJDBCScript-RPCNFS/FTP/…

GlobalData Vault

LocalData Vault

RemoteData

VaultLS

F 3D Remote Clients

Analytics GPFS, SONAS,IBM Storage

Generalized PLM Operational Model

Web browser

WorkloadManagement

Content Management, Process Management, Enterprise Business Sys

DB (Metadata)

LocalDisks/SA N

User Access(Business, 2D/3D Engineering)

Enterprise Computing(Design/Process Control)

Storage(Design & Analysis Content)

Rich Client

2D/3D RemoteClient

Technical Computing(Design Work/Analysis)

© 2012 ANSYS, Inc. June 21, 201214

Simulation Data Management

Sanjay Angadi, Senior Product Manager, ANSYSsanjay.angadi@ansys.com 

© 2012 ANSYS, Inc. June 21, 201215

MegaBytes

KiloBytes

Tera/Peta

Search Model Build Runs ArchivalResults/ReportsTest ‐ Co‐relationTest ‐ Co‐relation

Explosion of CAE Data 

© 2012 ANSYS, Inc. June 21, 201216

Notable Industry Surveys

Source: CPDA(2007)

150 companiesSurveyed

(Heavy CAE Users)

• How do you manage the results generated by your CAE simulations?• How do you capture the simulation expertise of your engineers?

75 % of Engineering Knowledge & Data is loosely managed

Top Challenges of Understanding Product Behavior

Multiphysics effects, Increased Complexity, Many Variants

Source: Aberdeen Group;

April 2011

Need for collaboration, traceability and better management of CAE data

© 2012 ANSYS, Inc. June 21, 201217

• Engineering Challenges• Where is the existing data?

• How to Search, Retrieve, Compare, Reuse, Share?

• Change Management (for CAE)?• How to leverage previous decisions and lessons learnt? 

• How to capture best practices?• IT Challenges

• Centralization of data for efficiency• How to leverage the IT investments? (HPC)• Job Submission, Remote & Secure Access• Disaster recovery & Data Protection• Distributed data/team challenges

• Simplicity

Summary ‐ Key Challenges

ON DEVICE

ON DEMAND

ON APPLICATION

ON PLATFORM

PLATFORMAPPLICATIONSTORAGE

© 2012 ANSYS, Inc. June 21, 201218

ANSYS EKM Solution 

Business Initiatives (Current)

• Knowledge Management– Retain & Re‐use Simulation

• Collaboration – Integrate Teams (Local & Distributed)

• Best Practices Capture ‐ Human Capital Challenges, Simulation Consistency

• CAE Compliance ‐ IP Protection

KNOWLEDGEKNOWLEDGE

INFORMATIONINFORMATION

DATADATA

Collecting

Organizing

Summarizing

Analyzing

Synthesizing

Decision Making

© 2012 ANSYS, Inc. June 21, 201219

Summary

Thick Clients 

Thin Clients 

User Experience

Application Integration

LAN, WAN, Cloud Resource

Upload Download Search

Organize

CapabilitiesInfrastructure & Deployment

Simulation Data Repository

Execution & Visualization

SIMULATION IP KNOWLEDGE BASESIMULATION IP KNOWLEDGE BASE

QUALITY & TRACEABILITY QUALITY & TRACEABILITY 

Specifically designed with scale, scope and purpose of CAE

OOTBIntegration & Easy Extension

© 2012 ANSYS, Inc. June 21, 201220

Customer Opinion(s)

“We chose ANSYS EKM because our engineers in multiple locations frequently need to collaborate in real time. The tool’s data management capabilities make it straightforward for our engineers to organize and track multiple versions of files that are created during a typical design and analysis cycle.”

Dr. Martin LehmannHead, Simulation Filter Elements MANN+HUMMEL

Re-using historical data via EKM shaves time and uncertainty from the simulation process.

© 2012 ANSYS, Inc. June 21, 201221

Scalable Storage Architecture

Prashant Avashia, Systems and Technology Group, IBMpavashia@us.ibm.com

© 2012 ANSYS, Inc. June 21, 2012222

Technical Innovation in StorageThe Role of Intelligent Storage in Smart Computing

22

EfficiencyMinimize the expense

of data growth

Improve the tradeoff: Cost of data vs. business value

PerformanceKeep pace with very high transaction rates, throughputs

Provide data protection for high IOP/sec applications

ScaleAllow data growth without technology constraints

IntegrationIntegrate with other

infrastructures for complete solutions

Maintain data integrity,protections & security

© 2012 ANSYS, Inc. June 21, 201223

IBM SONAS and IBM Storwize V7000 Unified Storage Systems

Built-In Security: Support of authentication, access controls with AD, LDAP, Samba.

Built-in Tuned GPFS requires Zero tuning: Do more simulation runs in a shorter time, with reduced storage, and memory requirements.

Easy to carve out file systems: Support NFS, CIFS, FTP, HTTPS, SCP + iSCSI & FC

New generation GUI: Easy-to-use data management GUI. Common GUI for both systems.

Active Cloud Engine: Enable efficient distribution of files as objects in a single Global Namespace (Domain) existing across multiple physical locations.

IBM SONAS

IBM V7000 Unified

© 2012 ANSYS, Inc. June 21, 20122424

Product Positioning

Attribute Storwize V7000 Unified

SONAS

Max. # of Interface Nodes 2 30

Max # of Storage Nodes N/A 60

Max raw capacity of file storage 240 TB 21.6 PB

Max size of single shared file system (GPFS) 8 PB 8 PB

Max # of file systems within a single platform 64 256

Max size of a single file 8 PB 8 PB

Max # of files per system 4 Billion 4 Billion

Max # of dependent filesets per filesystem 256 3000

Max # of snapshots per file system 256 256,256

Maximum number of subdirectories per directory 65,536 65,536

Types of Services for Exports CIFS, NFS, FTP,SCP & HTTPS

CIFS, NFS, FTP,SCP & HTTPS

Maximum number of exports created per service 1000 Supported 1000 Supported

Maximum number of administrative user groups 128 128

© 2012 ANSYS, Inc. June 21, 201225 25

Active Cloud Engine: Multi-Site Wide Area Caching

Global Namespace = Easy, Rapid Access to any file from any location.

Increase GPFS file system capabilities across the engineering enterprise.

V7000 Unified systems share the same filesystem(s), with a remote SONAS.

Multiple Applications can share same data.

All systems can be managed from a single GUI console.

CORP DC(New York)

Periodic pre-fetch On Demand Pull

Edge (Reader) Edge (Writer)

PRODUCTION(Melaka, Malaysia)

ENGINEERING(Chicago, IL)

WAREHOUSE(Tracy, CA)

FGI/ASSEMBLY OPS(Guadalajara, Mexico)

ERP

S_CHAIN

CAM

CAD

APPLICATION DOMAIN

GLOBAL DATA

GLOBAL NAMESPACE

AdministratorSame GUI Console

Tape

© 2012 ANSYS, Inc. June 21, 20122626

Backup over NFS or CIFS Symantec NetBackupBackup – NDMP Symantec NetBackup/NDMP

CommVault SimpanaEMC Networker

Anti-Virus over CIFS or NFS Symantec EndPoint ProtectionAnti-Virus On-Access Symantec SAV for NAS

McAfee Virus Scan Enterprise for StorageDatabases Oracle 10g, Oracle RAC 11g – AIX and Linux

IBM DB2 - RHEL on x-serversVirtualization VMware ESX Server v3.5, VI 3.x

VMware vSphere v4.0, v4.1 and v5.0VMware ESX HA Clusters

Healthcare Teramedica VNA, ACUO VNAMedia and Entertainment ThursbyHPC (Oil & Gas) ParadigmHPC (Life Sciences) AccelerysHPC (Engineering) ANSYS

Supported ISV Applications(examples)

© 2012 ANSYS, Inc. June 21, 201227

Cluster file system implementation for scalability, speed, and reliability• Single shared file system view across all servers

• Unified presentation to users and for backup / management• Capacity can be easily expanded via addition of modular ‘storage bricks’ 

•SoNAS or server cluster• High speed IB network connection to compute cluster (optional) 

• Provides increased performance for I/O intensive workloads

IBM GPFS cluster file system

1GbE/10GbE network connection to clients and servers

Infiniband network connection to compute cluster / graphics servers

ANSYS EKM server clusterIBM SoNASStandalone

EKMServer

ANSYS EKM Data Storage Configurations 

© 2012 ANSYS, Inc. June 21, 201228

EKM/SONAS and EKM/Storwize V7000U Unique Capabilities

Single Global Name Space delivers Storage Efficiency: Improve utilization & efficiency.

Optimize with Tiered Storage: Separate Engineering & Production data into different storage pools.

Achieve a High‐Octane Performance Boost: Complete Simulation Runs faster with:• SSD Capability included in the V7000 Unified systems• Up to four 10 GbE Ethernet ports available in each interface node.• Up to 196GB memory available in each interface node available.

Built‐in Intelligent File systems management capabilities: Easily ensure data mobility, data repeatability, data versioning, and data re‐use capabilities. Examples:

• Easily replicate Oracle db/instances between a SONAS, and a Storwize V7000.• Simultaneously run multiple simulations on the same GPFS Cluster inside a SONAS, or a V7000 Unified 

system.

Integrate Distributed Teams with ACE: ACE enhances the capabilities of any GPFS file system across the engineering enterprise. 

• Different V7000 Unified systems could share the same data, with a centrally located SONAS system. 

© 2012 ANSYS, Inc. June 21, 201229

EKM/SONAS and EKM/Storwize V7000U Solution Benefits

Intelligent GPFS cluster – built‐in HPC computational capabilities: Not just a storage system ‐‐ do more computations, in shorter time, with less storage & memory resources.

Optimize Operations: Achieve improved alignment between supply and demand sides of your competitive supply chain.

Enhance Execution Efficiency: with the same GUI Console for any storage system.

Best Practice: Coupled with the intelligent file system & policy management capabilities built‐in with GPFS file system, ANSYS EKM provides benefits of standardization of processes, reduce data quality issues, reduce process complexity, and increase data reusability.

Intelligent Information management: Solution allows organizations to continuously track data usage, analyze patterns, and reorganize information pools real‐time. 

© 2012 ANSYS, Inc. June 21, 201231

Copyright © 2010 by International Business Machines Corporation.

No part of this document may be reproduced or transmitted in any form without written permission from IBM Corporation.Product data has been reviewed for accuracy as of the date of initial publication. Product data is subject to change without notice. This information could include technical inaccuracies or typographical errors. IBM may make improvements and/or changes in the product(s) and/or programs(s) at any time without notice. Any statements regarding IBM's future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only.References in this document to IBM products, programs, or services does not imply that IBM intends to make such such products, programs or services available in all countries in which IBM operates or does business. Any reference to an IBM Program Product in this document is not intended to state or imply that only that program product may be used. Any functionally equivalent program, that does not infringe IBM's intellectually property rights, may be used instead. It is the user's responsibility to evaluate and verify the operation of any on-IBM product, program or service.THE INFORMATION PROVIDED IN THIS DOCUMENT IS DISTRIBUTED "AS IS" WITHOUT ANY WARRANTY, EITHER EXPRESS OR IMPLIED. IBM EXPRESSLY DISCLAIMS ANY WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE OR NONINFRINGEMENT. IBM shall have no responsibility to update this information. IBM products are warranted according to the terms and conditions of the agreements (e.g., IBM Customer Agreement, Statement of Limited Warranty, International Program License Agreement, etc.) under which they are provided. IBM is not responsible for the performance or interoperability of any non-IBM products discussed herein.The provision of the information contained herein is not intended to, and does not, grant any right or license under any IBM patents or copyrights. Inquiries regarding patent or copyright licenses should be made, in writing, to:

IBM Director of LicensingIBM CorporationNorth Castle DriveArmonk, NY 10504-1785U.S.A.

TrademarksThe following terms are trademarks of International Business Machines Corporation in the United States, other countries, or both. Other company, product, and service names may be trademarks or service marks of others: IBM, the IBM logo, ON (logo) DEMAND BUSINESS, DB2, Enterprise Storage Server, FlashCopy, POWER5, Tivoli, TotalStorage, TotalStorage Proven, System Storage, System p, System i, System x, System z, AIX, eServer, xSeries, pSeries, iSeries, zSeries, and BladeCenter

Notice, Disclaimer, and Trademark Information