25
GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch – [email protected] Ruben Spruijt – [email protected]

GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –[email protected] Ruben Spruijt –[email protected]

  • Upload
    others

  • View
    3

  • Download
    0

Embed Size (px)

Citation preview

Page 1: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com

GPU Smackdown(on-premises and public clouds)

Supported by

Benny Tritsch – [email protected]

Ruben Spruijt – [email protected]

Page 2: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com

GPUs – Why?

Page 3: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com
Page 4: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com
Page 5: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com

What are the options?

Page 6: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com

GPU options on-premises

Page 7: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com
Page 8: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com

GPU options public clouds

Page 9: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com
Page 10: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com
Page 11: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com
Page 12: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com

NV6, NC12, NV24 – Cloud Workstation Workhorse• CPU: Xeon v3 – 2.60GHz• CPU: 6-• RAM: 56GB-224GB• GPU: 1-4 NVIDIA M60 GPU• Storage: Standard SSD – Azure

Page 13: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com

Personal notes:• Intel v3 CPUs – only 2.6GHz• NVIDIA Maxwell based GPUs• No ‘slicing’ of GPUs | No vGPU• No Smaller-size (cheaper) instance• Storage = options and be-aware!• Benchmark below = NV6

Page 14: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com

G2 – Kepler basedG3 – Maxwell basedElastic GraphicsGraphics (AMD) within AppStream

Page 15: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com

G3s – G3.16XL – Cloud Workstation Workhorse• CPU: Xeon v4 – 2.30GHz, 4-64 vCPU• RAM: 30-488GB• GPU: 1-4 NVIDIA M60 GPU• Storage: EBS

Personal notes:• Intel v3 CPUs – only 2.6GHz• NVIDIA Maxwell based GPUs• No ‘slicing’ of GPUs | No vGPU• No Small-size (cheaper) instance type w/ less RAM

and CPU

Page 16: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com

Personal notes G3:• Intel v4 CPUs – only 2.3GHz• NVIDIA Maxwell based GPUs• No ‘slicing’ of GPUs | No vGPU• Great to have small size (G3s.XL) workstation• EBS is good• Benchmark below = G3S.XL

Page 17: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com
Page 18: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com
Page 19: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com

Personal notes :• Intel CPUs – 2.0GHz – Meh!!• Choice! (P4,T4,P100) NVIDIA based GPUs• No ‘slicing’ of GPUs | No vGPU• Great to have flexibility in CPU/RAM config• Benchmark below = 1_x_nvidia-tesla-p4-vws

Page 20: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com
Page 21: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com
Page 22: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com
Page 23: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com
Page 24: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com
Page 25: GPU Smackdown (on-premises and public clouds) · GPU Smackdown (on-premises and public clouds) Supported by Benny Tritsch –benny@rdsgurus.com Ruben Spruijt –ruben@rspruijt.com

Thanks!

Supported by

Benny Tritsch – [email protected]

Ruben Spruijt – [email protected]