Upload
muchamad-jainuri
View
34
Download
1
Embed Size (px)
Citation preview
Data Center Challenges Current Data Center Challenges
Space, Power and Cooling
constrained in many legacy facilities
Upgrade work presents risk and business impact
New or refurbishment is capital intensive
Time to execute major new builds and retrofits is excessive
Legacy facilities are not optimized for energy efficiency
FOREST Response
Incremental provisioning means
the client doesn’t need to predict demand
Additional capacity projects can be carried out independently
FOREST is approximately 50% of the capital cost
FOREST configuration and deployments is a matter of months
FOREST energy efficiency (DCiE) is approaching 90%, best in class and PUE is measured at 1.3 or better.
Improving Data Center Efficiency
Optimize Cooling
Isolate hot / cold air
Use high Delta T
Minimize air movement
Optimize the power chain
High Voltage cabinet feeds
Minimize power conversions
Use HE power supplies
DC Power distribution
Deploy Higher Density
Less air movement
Short power runs
Virtualize on low power processors
Exploit lower power silicon
Increase utilization
3
Patented Vertical Cooling Technology
Helps increase overall data center density by allowing more servers and storage to be supported.
Helps reduce overall loads placed on CRAC units. Requires fewer CRAC units for equivalent IT load.
Award-winning, patented technology that leads the industry in energy efficient design.
Allows Cirrascale to continue to support the most powerful processors on the market at time of launch.
Racks can go in cold or hot aisles.
Cirrascale’s award-winning, patented Vertical Cooling Technology
VCT for Cirrascale’s BladeRack 2 Series Platforms
Patented Vertical Cooling Technology VCT for Cirrascale’s FOREST Container Platforms
Built using the same concepts as Cirrascale’s VCT for BladeRacks.
Fan power is reduced to only being 4% - 8% of overall load.
Refrigerant pumping overhead is just greater than 1%.
Similar cooling practice allows Cirrascale to utilize BladeRack 2 FM & FE blades in FOREST reducing customer overhead.
The only container on the market that utilizes this advanced technology.
FOREST Container Solution: Best in Class
Up to 26 Petabytes of Storage Capacity Up to 2,880 Servers
Energy Efficient
Products: Facilities
Category Winner
Computer and
Related Products
Category Winner
Flexible – Open – Reliable – Energy efficient – Scalable – Transportable
The Cirrascale FOREST Container Dimensions
– 40’(L) x 8’(W) x 9.6’(H)
– 20’(L) x 8’(W) x 9.6’(H)
Power
– 400 or 480VAC inputs
– Up to 350KW per Container
– DC power distribution to blades
– <1.05 PUE w/ fans, UPS, internal cooling
– ~1.25 PUE adding chilled water power
Capacity
– Up to 10 Carriages (Optional UPS)
– Up to 1520U - blades and utility rack
– Up to 1440 large servers, 2880 motherboards
Cooling
– Integrated Patented Vertical Cooling Technology™
with Overhead Refrigerant (R134a)
– Chilled water supply , ideal 45-55F at 280 GPM
Redundancy
– High Density, Fully Redundant (dual feed)
Fire Suppression – FM200
Internal View of Client Deployment
Up to 26 Petabytes or
2880 Servers
The Cirrascale FOREST Container Advantage
Patented Vertical Cooling Technology
Heterogeneous Solution
Third-party Rackmount
Easy to Access Equipment
Internal View of NASA Nebula NASA Nebula Installation via Crane
Turn-Key Data Center
Highest Proportion of Power to IT Systems
Compelling TCO
Density up to 26 Petabytes of Storage
Operational in hours
TCO Calculator – Container vs. Data Center
CIRRASCALE FOREST CapEx and OpEx 'total cost' tool Key Variables Shared Assumptions and Inputs Legend
IT Load in KW 2000 Inputs or Assumptions
Base Electricity Price in USD (per kWh) $0.10 Fixed Values
Data Center Container Calculated Values
Data Center - watts/square foot 150 1042
Construction cost / sq/ft (USD) - Tier II+ $2,000
PUE 1.8 1.2
Floor Space (sq/ft ) 13,333 1920
IT Load per container Kwatt 330
Number of Containers required 6
Costs Summary USD
CapEx $ 26,666,667 $ 12,120,000
Container as % of Data Center CapEx 45%
OpEx $ 5,298,293 $ 3,403,272
Container as % of Data Center OpEx 64%
5 year cumulative savings (USD) $ 10,176,650
$-
$5,000,000
$10,000,000
$15,000,000
$20,000,000
$25,000,000
$30,000,000
$35,000,000
$40,000,000
$45,000,000
1 2 3 4 5 6 7
7 Year Cumulative Savings
(Construction , Plant & Energy )
DATACENTER Cumulative CostFOREST Cumulative Cost
Capex Savings=46% $12M vs $26M
Opex Savings=64% $3.4M vs $5.3M 5 Year cumulative savings = $10.1M
Containerization– Use Cases
Monolithic Scale Out Financial services, exploration or
academic GRID
WEB 2.0 storage and compute clouds
Geographic advantage Locating latency sensitive applications at
or near consumer
Humanitarian/Military applications
Harnessing renewable energy
Business Continuity Online/Nearline backup without
impacting current estate.
Fulfilling regulatory requirements at lower cost
Tactical Capacity Swing space for a strategic upgrade
program
Low cost DC for new business in China – mitigate the need to build until the market is proven
Mobile data processing for military application
Liberate stranded power at legacy facility that is physically full but with excess MW
Container use cases largely similar to traditional DC
Short to medium term focused as follows :
Containers Change Data Centers Forever
• Up to 50% CapEx, Up to 70% OpEx vs. Best Data Centers Compelling economics
• 1.05 – 1.20 PUE (sometimes cool water is free)
• Fans - 15 vs. 45 watts per server (save 52kW in FANS)
• Same fans cool the equipment and “air-conditioning”
Dramatically better energy efficiency
• Short decision cycles – 90 days - Invest as you add capacity
• Short/efficient install times – 1-2 days, tested at factory
• Vendor responsible for power and cooling distribution
Much easier operational use
• Leasing of the integrated solution is easy
• No long depreciation data center that must be refurbished
• Significant Rebates from Utility companies Financially flexible
Cirrascale Energy Rebate Program
Onsite Energy - uniquely qualified to maximize customer rebates for FOREST Containers and Racks Understands the new container design efficiencies better than anyone else
Understands Vertical Cooling Technology for HVAC integration
Most thorough M&V for Cirrascale FOREST Containers and Racks
National coverage for multiple data centers Convenience for large customers
Proven, comprehensive energy savings calculator to quantify energy
savings and rebates for Cirrascale customers Up to $30-40k for Cirrascale Racks
Up to $300k for FOREST Containers
Local Utilities Don’t Maximize Rebates
Physical Characteristics: Size, Weight (Empty & Full) ISO Dry Cargo Steel Container
40’ x 8’ x 9’6” / 20’ x 8’ x 9’6”
Empty 40’ is 35,000lbs
20’ is 20,000lbs
Full Compute 40’ is 65,000lbs
20’ is 35,000lbs
Full Storage 40’ is 80,000lbs
20’ is 50,000lbs
FOREST Differentiators Vertical Cooling Technology
Lower fan burden relative to the competition, “more power to your blade”
Refrigerant based cooling
Lower operational risk, minimal condensation risk and better cooling efficiency
Direct current distribution
Less power conversions leading to better energy efficiency and near unity Power Factor.
Several reliability modes in one design and a common platform.
Building Blocks
Heat Exchangers
Evaporators
External UPS option
Rectifiers
Carriages
Humidification
Fire Suppression
SCADA management system
Dual Liebert XDP
Heat Exchangers
FOREST Rack Geometry
Top Fan Trays
480v to -48v
Rectification
8U per Carriage for
Network Switches
Each blade slot
has 2 Ethernet
ports per slot
passing through
the backplane
Isolators for shipping
and seisimic
The FOREST Carriage: A Rack Aggregation Module
Each carriage is equivalent to three racks.
Blade Types & Densities
FE Blades / Disk Blades
144 Blades per Carriage
Up to 1440 Blades per FOREST
12 HDDs per Storage Blade
21.5” (L) x 18.5” (H) x 1.72” (W)
FM Blades
180 Blades per Carriage
Up to 1800 Blades per FOREST
21.5” (L) x 12.9” (H) x 1.72” (W)
FM Blade
FE Disk Blade FE Blade
Blade and Rack Mount Integration
Rackmount 36” depth with Rackmount 24”
depth
Rackmount 24” depth with 2 Cirrascale
columns
Cirrascale Blade Columns
Fan power 4 - 8% of load
Refrigerant pumping overhead 1 - 3%
FOREST Vertical Cooling Airflow Simulation
FOREST uses a closed loop refrigerant-based cooling system
Chilled water is used to cool the refrigerant
The water is localized to one end of the container which reduces exposure in the event of water leakage
FOREST does NOT require downtime for cleaning of the micro channels!
FOREST Cooling System
PERF TILE FLOOR
SKINS ATTACHED TO BOTTOM OF C CHANNEL TO ALLOW 9” TO CARRIAGE BOTTOM OF AIR RETURN PLENUM
EVAPORATOR
Vertical Cooling Technology Airflow
LIEBERT XDP 175 KW
REFRIGERANT SUPPLY MANIFOLD
REFRIGERANT RETURN MANIFOLD
EVAPORATORS
FLEXIBLE HOSES
CHILLED WATER SUPPLY & RETURN PORTS
Chilled Water and Refrigerant Loops
REFRIGERANT SUPPLY MANIFOLD
REFRIGERANT RETURN MANIFOLD
FLOW REGULATOR (2 GPM)
FOAM FOR SEALING
Cooling Loop Design
DC Rectifier Design and Benefit X7500
Single phase rectifier 200 - 305vAC to -48vDC
8kW per rectifier
Three Hot Swap rectifiers per shelf
93% efficient (new design to 96%)
Up to two shelves per Carriage or Rack
Tolerates 1 cycle of dropout at 100% of load
Drives container PF to near unity
The AC power comes into the supplies and that power is isolated from the DC bus that feeds the servers. Thus all server load is applied against the common DC bus so wherever the load is coming from it sees the same bus. In other systems, the AC power comes directly to the servers, so the way the servers spread the load leads to the imbalance across the AC phases.
FOREST Redundancy Modes
40’ High Density
40’ High Availability
40’ Fault Tolerant
Carriage Capacity 10 Carriages 10 Carriages 10 Carriages
IT Load Max 330kw 330kw 165kw
Electrical Input Single 400/480 VAC – 600a
Single or Dual 400/480 VAC – 600a
Single or Dual 400/480 VAC – 300a
XDP Configuration Redundant pumps N Exchangers
Redundant pumps N Exchangers
Redundant pumps N+1 Exchangers
External UPS Optional Integrated system (N) External ( N+1)
FOREST Redundancy Modes
20’ High Density
20’ High Availability
20’ Fault Tolerant
Carriage Capacity 4 Carriages 4 Carriages 4 Carriages
IT Load Max 132kw 132kw 66kw
Electrical Input Single 400/480 VAC – 600a
Single or Dual 400/480 VAC – 600a
Single or Dual 400/480 VAC – 300a
XDP Configuration Redundant pumps N Exchangers
Redundant pumps N Exchangers
Redundant pumps N+1 Exchangers
External UPS Optional Integrated system (N) External ( N+1)
FOREST Chilled Water Plant Options
Cirrascale Chiller Sled/Container Available as sled or container
Can be stacked on FOREST compute container
Monitored and Managed by FOREST Management software
Chiller provides up to 110 Tons of cooling
Companies Like;
Active Power – Power House Utility Container includes
Generator
UPS
Each blade has two pass-through ports
Pass-through backplane can support 1GbE or 10GbE Ethernet
Carriages port count can support 3-ports per blade or 438-port
24” rackmount column can support Cisco 6509
36” rackmount column can support Cisco Nexus 7010 & 7018
Networking
Switches Each Carriage has four 2U
openings that support industry standard 1U or 2U Rackmount switches
Power provided is -48vDC
Depth limit is 20”
Example design based on integrated edge switching.
Fiber Inside the Container The Default Fiber Distribution inside the container consist of a single
Loose Tube with 12 Fibers, a MTP connector and a fanout into six pairs per Carriage
Fanouts to industry standard LC, MU, FC, SC and ST connectors are available
Connecting to a Container Facility connection to the container
Fiber connectivity via MTP
Watertight connectors
10 to 20 MTP connections
Up to 16 MPO connection
Copper RJ45 connectivity
Watertight connectors
4 RJ45 CAT6 connections
1 RJ45 dedicated BACnet port
1 RJ45 dedicated OOBM to HMI
Digital / Dry Contact connectivity
8 Digital Inputs / 16 Digital Outputs
4 Dry Contact Outputs
Chiller sled connectivity
ModBUS 2wire RTU interface
Management Features
Container Facility Monitoring, Logging and Alerts
BACnet/IP
Dry contacts
Server monitoring and light weight management
Power on/off/reset (including switches)
Console Aggregation
Local management network with gateway
Remote Access through PLC
Local Access through HMI and PLC
Integrated Systems Architecture (ISA) System Power Capping
Specifies the maximum power consumption by controlling blade power rack infrastructure power (through dynamic fan control).
System Thermal Optimization
Thermal optimization specifies the maximum exhaust temperature or maximum shelf temperature
Dynamic Processor Upgrade
Allows customers to upgrade blades by adding processors on-demand.
Dynamic Energy Management
Dynamically controls the power consumed in the system by managing power consumption by
the blades in the rack and the rack cooling infrastructure.
Blade Power Capping
Specifies maximum power consumption for a blade by controlling power state of processors
Why Cirrascale’s Container Capital & Expense efficient
Less than 55% of the comparative cost for a traditional Data Center ( capital)
65% operating budget of traditional build ( 5 year model )
Multiple Leasing options
Energy Efficient
Industry leading PUE , as low as 1.05
DC power distribution
Closed loop cooling
Deployment
90 days standard delivery
Maximum flexibility in location selection
Global support capability through partners
End to end systems manageability
SNMP and BACNet interface to industry standard consoles
1st Production Live Jan 2008