CMA. TCA Srinivasa Prasad €¦ · –Debug problems (suspend and resume the problem machine),...

Preview:

Citation preview

1

CMA. TCA Srinivasa Prasad+91 947 770 222710996tcasp@icmaim.inwww.tcasprasad.in

25/06/18 CMA. TCA Srinivasa Prasad

CloudComputing

Cloud – DemystArichetureTechnologyBenefitsChallenges & Concerns

3

CMA. TCA Srinivasa Prasad+91 947 770 222710996tcasp@icmaim.inwww.tcasprasad.in

25/06/18 CMA. TCA Srinivasa Prasad

4

WhatisCloudComputing?• CloudComputingisageneraltermusedtodescribeanew

classofnetworkbasedcomputingthattakesplaceovertheInternet,– basicallyasteponfromUtilityComputing– acollection/groupofintegratedandnetworkedhardware,softwareandInternetinfrastructure(calledaplatform).

– UsingtheInternetforcommunicationandtransportprovideshardware,softwareandnetworkingservicestoclients

• TheseplatformshidethecomplexityanddetailsoftheunderlyinginfrastructurefromusersandapplicationsbyprovidingverysimplegraphicalinterfaceorAPI(ApplicationsProgrammingInterface).

25/06/18 CMA. TCA Srinivasa Prasad

5

WhatisCloudComputing?

• Inaddition,theplatformprovidesondemandservices,thatarealwayson,anywhere,anytimeandanyplace.

• Payforuseandasneeded,elastic– scaleupanddownincapacityandfunctionalities

• Thehardwareandsoftwareservicesareavailableto– generalpublic,enterprises,corporationsandbusinessesmarkets

525/06/18 CMA. TCA Srinivasa Prasad

6

CloudSummary• CloudcomputingisanumbrellatermusedtorefertoInternetbaseddevelopmentandservices

• Anumberofcharacteristicsdefineclouddata,applicationsservicesandinfrastructure:– Remotelyhosted:Servicesordataarehostedonremoteinfrastructure.

– Ubiquitous:Servicesordataareavailablefromanywhere.– Commodified:Theresultisautilitycomputingmodelsimilartotraditionalthatoftraditionalutilities,likegasandelectricity- youpayforwhatyouwouldwant!

625/06/18 CMA. TCA Srinivasa Prasad

7

Architecture

• Thearchitecturebehindcloudcomputingisamassivenetwork.

• Thecloudcomputinginfrastructureconsistsofreliableservices.

• TheCloudappearsasasinglepointofaccessforallthecomputingneedsofconsumers.

9

CloudArchitecture

925/06/18 CMA. TCA Srinivasa Prasad

10

WhatisCloudComputing

10Adopted from: Effectively and Securely Using the Cloud Computing Paradigm by peter Mell, Tim Grance

• Sharedpoolofconfigurablecomputingresources• On-demandnetworkaccess• ProvisionedbytheServiceProvider

25/06/18 CMA. TCA Srinivasa Prasad

11

CloudComputingCharacteristics

11

Common Characteristics:

Low Cost Software

Virtualization Service Orientation

Advanced Security

Homogeneity

Massive Scale Resilient Computing

Geographic Distribution

Essential Characteristics:

Resource PoolingBroad Network Access Rapid Elasticity

Measured Service

On Demand Self-Service

Adopted from: Effectively and Securely Using the Cloud Computing Paradigm by peter Mell, Tim Grance

25/06/18 CMA. TCA Srinivasa Prasad

12

CloudServiceModels

12

Software as a Service (SaaS)

Platform as a Service (PaaS)

Infrastructure as a Service (IaaS)

Google App Engine

SalesForce CRM

LotusLive

Adopted from: Effectively and Securely Using the Cloud Computing Paradigm by peter Mell, Tim Grance

25/06/18 CMA. TCA Srinivasa Prasad

13

SaaSMaturityModel

13Source: Frederick Chong and Gianpaolo Carraro, “Architectures Strategies for Catching the Long Tail”

Level2:Configurablepercustomer

Level3:configurable&Multi-Tenant-Efficient

Level1:Ad-Hoc/Custom–OneInstancepercustomer

Level4:Scalable,Configurable&Multi-Tenant-Efficient

25/06/18 CMA. TCA Srinivasa Prasad

14

DifferentCloudComputingLayers

Application Service(SaaS)

Application Platform

Server Platform

Storage Platform Amazon S3, Dell, Apple, ...

3Tera, EC2, SliceHost, GoGrid, RightScale, Linode

Google App Engine, Mosso,Force.com, Engine Yard,Facebook, Heroku, AWS

MS Live/ExchangeLabs, IBM, Google Apps; Salesforce.comQuicken Online, Zoho, Cisco

1425/06/18 CMA. TCA Srinivasa Prasad

15

Services

Application

Development

Platform

Storage

Hosting

CloudComputingServiceLayersDescriptionServices – Complete business services such as PayPal, OpenID, OAuth, Google Maps, Alexa

Services

ApplicationFocused

InfrastructureFocused

Application – Cloud based software that eliminates the need for local installation such as Google Apps, Microsoft Online

Storage – Data storage or cloud based NAS such as CTERA, iDisk, CloudNAS

Development – Software development platforms used to build custom cloud based applications (PAAS & SAAS) such as SalesForce

Platform – Cloud based platforms, typically provided using virtualization, such as Amazon ECC, Sun Grid

Hosting – Physical data centers such as those run by IBM, HP, NaviSite, etc.

1525/06/18 CMA. TCA Srinivasa Prasad

16

BasicCloudCharacteristics• The“no-need-to-know”intermsoftheunderlyingdetailsofinfrastructure,applicationsinterfacewiththeinfrastructureviatheAPIs.

• The“flexibilityandelasticity”allowsthesesystemstoscaleupanddownatwill– utilisingtheresourcesofallkinds

• CPU,storage,servercapacity,loadbalancing,anddatabases

• The“payasmuchasusedandneeded”typeofutilitycomputingandthe“alwayson!,anywhereandanyplace”typeofnetwork-basedcomputing.

1625/06/18 CMA. TCA Srinivasa Prasad

17

BasicCloudCharacteristics

• Cloudaretransparenttousersandapplications,theycanbebuiltinmultipleways– brandedproducts,proprietaryopensource,hardwareorsoftware,orjustoff-the-shelfPCs.

• Ingeneral,theyarebuiltonclustersofPCserversandoff-the-shelfcomponentsplusOpenSourcesoftwarecombinedwithin-houseapplicationsand/orsystemsoftware.

1725/06/18 CMA. TCA Srinivasa Prasad

18

SoftwareasaService(SaaS)• SaaSisamodelofsoftwaredeploymentwhereanapplicationishostedasaserviceprovidedtocustomersacrosstheInternet.

• Saasalleviatestheburdenofsoftwaremaintenance/support– butusersrelinquishcontroloversoftwareversionsandrequirements.

• Termsthatareusedinthissphereinclude– PlatformasaService(PaaS)and– InfrastructureasaService(IaaS)

1825/06/18 CMA. TCA Srinivasa Prasad

19

Virtualization• Virtualworkspaces:

– Anabstractionofanexecutionenvironmentthatcanbemadedynamicallyavailabletoauthorizedclientsbyusingwell-definedprotocols,

– Resourcequota(e.g.CPU,memoryshare),– Softwareconfiguration(e.g.O/S,providedservices).

• ImplementonVirtualMachines(VMs):– Abstractionofaphysicalhostmachine,– HypervisorinterceptsandemulatesinstructionsfromVMs,andallows

managementofVMs,– VMWare,Xen,etc.

• ProvideinfrastructureAPI:– Plug-instohardware/supportstructures Hardware

OS

App App App

Hypervisor

OS OS

Virtualized Stack1925/06/18 CMA. TCA Srinivasa Prasad

20

VirtualMachines

• VMtechnologyallowsmultiplevirtualmachinestorunonasinglephysicalmachine.

Hardware

Virtual Machine Monitor (VMM) / Hypervisor

Guest OS(Linux)

Guest OS(NetBSD)

Guest OS(Windows)

VM VM VM

AppApp AppAppAppXen

VMWare

UML

Denalietc.

Performance: Para-virtualization (e.g. Xen) is very close to raw physical performance!

2025/06/18 CMA. TCA Srinivasa Prasad

21

VirtualizationinGeneral• Advantagesofvirtualmachines:

– Runoperatingsystemswherethephysicalhardwareisunavailable,

– Easiertocreatenewmachines,backupmachines,etc.,– Softwaretestingusing“clean”installsofoperatingsystemsandsoftware,

– Emulatemoremachinesthanarephysicallyavailable,– Timesharelightlyloadedsystemsononehost,– Debugproblems(suspendandresumetheproblemmachine),– Easymigrationofvirtualmachines(shutdownneededornot).– Runlegacysystems!

2125/06/18 CMA. TCA Srinivasa Prasad

22

Whatisthepurposeandbenefits?

• Cloudcomputingenablescompaniesandapplications,whicharesysteminfrastructuredependent,tobeinfrastructure-less.

• ByusingtheCloudinfrastructureon“payasusedandondemand”,allofuscansaveincapitalandoperationalinvestment!

• Clientscan:– PuttheirdataontheplatforminsteadofontheirowndesktopPCsand/orontheirownservers.

– Theycanputtheirapplicationsonthecloudandusetheserverswithinthecloudtodoprocessinganddatamanipulationsetc.

2225/06/18 CMA. TCA Srinivasa Prasad

23

Cloud-Sourcing• WhyisitbecomingaBigDeal:

– Usinghigh-scale/low-costproviders,– Anytime/placeaccessviawebbrowser,– Rapidscalability;incrementalcostandloadsharing,– CanforgetneedtofocusonlocalIT.

• Concerns:– Performance,reliability,andSLAs,– Controlofdata,andserviceparameters,– Applicationfeaturesandchoices,– InteractionbetweenCloudproviders,– NostandardAPI– mixofSOAPandREST!– Privacy,security,compliance,trust…

2325/06/18 CMA. TCA Srinivasa Prasad

24

SomeCommercialCloudOfferings

2425/06/18 CMA. TCA Srinivasa Prasad

25

CloudTaxonomy

2525/06/18 CMA. TCA Srinivasa Prasad

26

CloudStorage• SeverallargeWebcompaniesarenowexploitingthefactthattheyhavedatastoragecapacitythatcanbehiredouttoothers.– allowsdatastoredremotelytobetemporarilycachedondesktopcomputers,mobilephonesorotherInternet-linkeddevices.

• Amazon’sElasticComputeCloud(EC2)andSimpleStorageSolution(S3)arewellknownexamples– MechanicalTurk

2625/06/18 CMA. TCA Srinivasa Prasad

27

AmazonSimpleStorageService(S3)

• UnlimitedStorage.• Payforwhatyouuse:

– $0.20perGByteofdatatransferred,– $0.15perGByte-Monthforstorageused,– SecondLifeUpdate:

• 1TBytes,40,000downloadsin24hours- $200,

2725/06/18 CMA. TCA Srinivasa Prasad

28

UtilityComputing– EC2• AmazonElasticComputeCloud(EC2):

– Elastic,marshal1to100+PCsviaWS,– MachineSpecs…,– Fairlycheap!

• PoweredbyXen– aVirtualMachine:– DifferentfromVmwareandVPCasuses“para-virtualization”where

theguestOSismodifiedtousespecialhyper-calls:– HardwarecontributionsbyIntel(VT-x/Vanderpool)andAMD(AMD-V).– Supports“LiveMigration”ofavirtualmachinebetweenhosts.

• Linux,Windows,OpenSolaris• ManagementConsole/AP

2825/06/18 CMA. TCA Srinivasa Prasad

29

EC2– TheBasics

• LoadyourimageontoS3andregisterit.• BootyourimagefromtheWebService.• Openuprequiredportsforyourimage.• ConnecttoyourimagethroughSSH.• Executeyouapplication…

2925/06/18 CMA. TCA Srinivasa Prasad

30

OpportunitiesandChallenges• Theuseofthecloudprovidesanumberofopportunities:– Itenablesservicestobeusedwithoutanyunderstandingoftheirinfrastructure.

– Cloudcomputingworksusingeconomiesofscale:• Itpotentiallylowerstheoutlayexpenseforstartupcompanies,astheywouldnolongerneedtobuytheirownsoftwareorservers.

• Costwouldbebyon-demandpricing.• VendorsandServiceprovidersclaimcostsbyestablishinganongoingrevenuestream.

– Dataandservicesarestoredremotelybutaccessiblefrom“anywhere”.

3025/06/18 CMA. TCA Srinivasa Prasad

31

OpportunitiesandChallenges• Inparalleltherehasbeenbacklashagainstcloudcomputing:

– Useofcloudcomputingmeansdependenceonothersandthatcouldpossiblylimitflexibilityandinnovation:

• TheothersarelikelybecomethebiggerInternetcompanieslikeGoogleandIBM,whomaymonopolisethemarket.

• SomearguethatthisuseofsupercomputersisareturntothetimeofmainframecomputingthatthePCwasareactionagainst.

– Securitycouldprovetobeabigissue:• Itisstillunclearhowsafeout-sourceddataisandwhenusingtheseservicesownershipofdataisnotalwaysclear.

– Therearealsoissuesrelatingtopolicyandaccess:• Ifyourdataisstoredabroadwhosepolicydoyouadhereto?• Whathappensiftheremoteservergoesdown?• Howwillyouthenaccessfiles?• Therehavebeencasesofusersbeinglockedoutofaccountsandlosingaccesstodata.

3125/06/18 CMA. TCA Srinivasa Prasad

32

AdvantagesofCloudComputing

• Lowercomputercosts:– Youdonotneedahigh-poweredandhigh-pricedcomputertoruncloudcomputing'sweb-basedapplications.

– Sinceapplicationsruninthecloud,notonthedesktopPC,yourdesktopPCdoesnotneedtheprocessingpowerorharddiskspacedemandedbytraditionaldesktopsoftware.

– Whenyouareusingweb-basedapplications,yourPCcanbelessexpensive,withasmallerharddisk,lessmemory,moreefficientprocessor...

– Infact,yourPCinthisscenariodoesnotevenneedaCDorDVDdrive,asnosoftwareprogramshavetobeloadedandnodocumentfilesneedtobesaved.

3225/06/18 CMA. TCA Srinivasa Prasad

33

AdvantagesofCloudComputing

• Improvedperformance:– Withfewlargeprogramshoggingyourcomputer'smemory,youwillseebetterperformancefromyourPC.

– Computersinacloudcomputingsystembootandrunfasterbecausetheyhavefewerprogramsandprocessesloadedintomemory…

• Reducedsoftwarecosts:– Insteadofpurchasingexpensivesoftwareapplications,youcangetmostofwhatyouneedforfree-ish!

• mostcloudcomputingapplicationstoday,suchastheGoogleDocssuite.

– betterthanpayingforsimilarcommercialsoftware• whichalonemaybejustificationforswitchingtocloudapplications.

3325/06/18 CMA. TCA Srinivasa Prasad

34

AdvantagesofCloudComputing

• Instantsoftwareupdates:– Anotheradvantagetocloudcomputingisthatyouarenolongerfaced

withchoosingbetweenobsoletesoftwareandhighupgradecosts.– Whentheapplicationisweb-based,updateshappenautomatically

• availablethenexttimeyoulogintothecloud.

– Whenyouaccessaweb-basedapplication,yougetthelatestversion• withoutneedingtopayforordownloadanupgrade.

• Improveddocumentformatcompatibility.– Youdonothavetoworryaboutthedocumentsyoucreateonyour

machinebeingcompatiblewithotherusers'applicationsorOSes– Therearepotentiallynoformatincompatibilitieswheneveryoneis

sharingdocumentsandapplicationsinthecloud.

3425/06/18 CMA. TCA Srinivasa Prasad

35

AdvantagesofCloudComputing• Unlimitedstoragecapacity:

– Cloudcomputingoffersvirtuallylimitlessstorage.– Yourcomputer'scurrent1Tbyte harddriveissmallcomparedtothehundredsofPbytes availableinthecloud.

• Increaseddatareliability:– Unlikedesktopcomputing,inwhichifaharddiskcrashesanddestroyallyourvaluabledata,acomputercrashinginthecloudshouldnotaffectthestorageofyourdata.

• ifyourpersonalcomputercrashes,allyourdataisstilloutthereinthecloud,stillaccessible

– InaworldwherefewindividualdesktopPCusersbackuptheirdataonaregularbasis,cloudcomputingisadata-safecomputingplatform!

3525/06/18 CMA. TCA Srinivasa Prasad

36

AdvantagesofCloudComputing

• Universaldocumentaccess:– Thatisnotaproblemwithcloudcomputing,becauseyoudonottakeyourdocumentswithyou.

– Instead,theystayinthecloud,andyoucanaccessthemwheneveryouhaveacomputerandanInternetconnection

– Documentsareinstantlyavailablefromwhereveryouare

• Latestversionavailability:– Whenyoueditadocumentathome,thateditedversioniswhatyouseewhenyouaccessthedocumentatwork.

– Thecloudalwayshoststhelatestversionofyourdocuments• aslongasyouareconnected,youarenotindangerofhavinganoutdatedversion

3625/06/18 CMA. TCA Srinivasa Prasad

37

AdvantagesofCloudComputing

• Easiergroupcollaboration:– Sharingdocumentsleadsdirectlytobettercollaboration.– Manyusersdothisasitisanimportantadvantagesofcloudcomputing

• multipleuserscancollaborateeasilyondocumentsandprojects

• Deviceindependence.– Youarenolongertetheredtoasinglecomputerornetwork.– Changestocomputers,applicationsanddocumentsfollowyouthroughthecloud.

– Movetoaportabledevice,andyourapplicationsanddocumentsarestillavailable.

3725/06/18 CMA. TCA Srinivasa Prasad

38

DisadvantagesofCloudComputing

• RequiresaconstantInternetconnection:– CloudcomputingisimpossibleifyoucannotconnecttotheInternet.

– SinceyouusetheInternettoconnecttobothyourapplicationsanddocuments,ifyoudonothaveanInternetconnectionyoucannotaccessanything,evenyourowndocuments.

– AdeadInternetconnectionmeansnoworkandinareaswhereInternetconnectionsarefeworinherentlyunreliable,thiscouldbeadeal-breaker.

3825/06/18 CMA. TCA Srinivasa Prasad

39

DisadvantagesofCloudComputing

• Doesnotworkwellwithlow-speedconnections:– Similarly,alow-speedInternetconnection,suchasthatfoundwithdial-upservices,makescloudcomputingpainfulatbestandoftenimpossible.

– Web-basedapplicationsrequirealotofbandwidthtodownload,asdolargedocuments.

• Featuresmightbelimited:– Thissituationisboundtochange,buttodaymanyweb-basedapplicationssimplyarenotasfull-featuredastheirdesktop-basedapplications.

• Forexample,youcandoalotmorewithMicrosoftPowerPointthanwithGooglePresentation'sweb-basedoffering

3925/06/18 CMA. TCA Srinivasa Prasad

40

DisadvantagesofCloudComputing

• Canbeslow:– Evenwithafastconnection,web-basedapplicationscansometimesbeslowerthanaccessingasimilarsoftwareprogramonyourdesktopPC.

– Everythingabouttheprogram,fromtheinterfacetothecurrentdocument,hastobesentbackandforthfromyourcomputertothecomputersinthecloud.

– Ifthecloudservershappentobebackedupatthatmoment,oriftheInternetishavingaslowday,youwouldnotgettheinstantaneousaccessyoumightexpectfromdesktopapplications.

4025/06/18 CMA. TCA Srinivasa Prasad

41

DisadvantagesofCloudComputing

• Storeddatamightnotbesecure:– Withcloudcomputing,allyourdataisstoredonthecloud.

• ThequestionsisHowsecureisthecloud?

– Canunauthorisedusersgainaccesstoyourconfidentialdata?

• Storeddatacanbelost:– Theoretically,datastoredinthecloudissafe,replicatedacrossmultiplemachines.

– Butontheoffchancethatyourdatagoesmissing,youhavenophysicalorlocalbackup.

• Putsimply,relyingonthecloudputsyouatriskifthecloudletsyoudown.

4125/06/18 CMA. TCA Srinivasa Prasad

42

DisadvantagesofCloudComputing

• HPCSystems:– Notclearthatyoucanruncompute-intensiveHPCapplicationsthatuseMPI/OpenMP!

– Schedulingisimportantwiththistypeofapplication• asyouwantalltheVMtobeco-locatedtominimizecommunicationlatency!

• GeneralConcerns:– EachcloudsystemsusesdifferentprotocolsanddifferentAPIs

• maynotbepossibletorunapplicationsbetweencloudbasedsystems

– AmazonhascreateditsownDBsystem(notSQL92),andworkflowsystem(manypopularworkflowsystemsoutthere)

• soyournormalapplicationswillhavetobeadaptedtoexecuteontheseplatforms.

4225/06/18 CMA. TCA Srinivasa Prasad

43

TheFuture• Manyoftheactivitieslooselygroupedtogetherundercloud

computinghavealreadybeenhappeningandcentralisedcomputingactivityisnotanewphenomena

• GridComputingwasthelastresearch-ledcentralisedapproach

• Howeverthereareconcernsthatthemainstreamadoptionofcloudcomputingcouldcausemanyproblemsforusers

• Manynewopensourcesystemsappearingthatyoucaninstallandrunonyourlocalcluster– shouldbeabletorunavarietyofapplicationsonthesesystems

4325/06/18 CMA. TCA Srinivasa Prasad

44

CMA. TCA Srinivasa Prasad+91 947 770 222710996tcasp@icmaim.inwww.tcasprasad.in

25/06/18 CMA. TCA Srinivasa Prasad

Recommended