17
1/9/18 1 CSCI 402: Computer Architectures Introduction Fengguang Song Department of Computer & Information Science IUPUI Contents Course information Go through the course website and syllabus Chapter 1: Computer Abstractions and Technology §1.1: What is computer architecture State of the art: Top 500 Supercomputers 2

Contents - Computer and Information Science | Homefgsong/csci402/lecture_notes/Lecture_1.pdf · Department of Computer & Information Science IUPUI Contents ... – Computer Organization

  • Upload
    vutuong

  • View
    220

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Contents - Computer and Information Science | Homefgsong/csci402/lecture_notes/Lecture_1.pdf · Department of Computer & Information Science IUPUI Contents ... – Computer Organization

1/9/18

1

CSCI402:ComputerArchitectures

Introduction

Fengguang SongDepartmentofComputer&InformationScienceIUPUI

Contents

• Courseinformation– Gothroughthecoursewebsiteandsyllabus

• Chapter1:ComputerAbstractionsandTechnology– §1.1:Whatiscomputerarchitecture

• Stateoftheart:Top500Supercomputers

2

Page 2: Contents - Computer and Information Science | Homefgsong/csci402/lecture_notes/Lecture_1.pdf · Department of Computer & Information Science IUPUI Contents ... – Computer Organization

1/9/18

2

CourseInformation• Coursewebsite

– http://www.cs.iupui.edu/~fgsong/csci402– Slideswillbepostedontheabovelink(notonCanvas).

• Textbook– ComputerOrganizationandDesign: The

Hardware/SoftwareInterface,5thEdition,PattersonandHennessy.• Instructor

– Fengguang Song,SL 275,[email protected]:Tuesday4:30-6:20pmorbyappointment

• Teachingassistant– FengLi,SL228(TAOffice),[email protected]

• OfficeHours:Monday4-5pm,Wednesday4-5pm– Weijian Zheng(1/2TA),SL228(TAOffice),[email protected]

• OfficeHours:Thursday4:30-5:30pmorbyappointment• Prerequisites

– CSCI340– Knowbasicsoflogicdesign,machineorganization,finitestatemachine(FSM)– CanreadandunderstandANSICcode

3

YourGrade1. Midtermexam(35%)

– onMarch08,Thursday(markthisdate,nomakeupexam)2. Finalexam(35%)

– onMay03 (ItisNoneCumulative)3. Pop quizzes(10%)

– In-classquiz,usuallygivenafterwefinisha chapter– 2-4“simple”questions(youhave15minutes)– Purpose:Helptheinstructorknowyourprogress,alsohelpyouknowthestyle

oftheExamQuestions,andengageyoutoreviewtheslidesmorefrequently– Solutionswillbeannouncedimmediatelyafterthequiz– gradedbyourTA

4. Homework(15%)– Everychapterhasonehomework– AssignedeitheronTuesdayorThursdayinclass(lectureslidewillshowit)– SubmititthroughCanvas(youcanscanyourhardcopyandsubmitit)– gradedbyourTA.

5.Attendance(5%)(Iexpectyoutoattendallclasses)

4

Page 3: Contents - Computer and Information Science | Homefgsong/csci402/lecture_notes/Lecture_1.pdf · Department of Computer & Information Science IUPUI Contents ... – Computer Organization

1/9/18

3

HomeworkDueTime

• Thetypicalduedateandtimeis11:59:59PMeitheronMondaynight orWednesdaynight.Youwillhavebetweenoneandtwoweekstofinishthehomework.

• Nolatehomeworkisaccepted– Therehastobeacutoffline• Don’twantTAtogradeitagainandagain

– Importantly,homeworksolutionwillbepostedonlinethenextday

5

ImportantIssues• Academicmisconduct:

– Donotcopyotherpeople’ssolutions(homework,quiz,exams)• Workmustbeyourowneffort• Universityattendancepolicy:

– “Abasicrequirementisthatyouwillparticipateinallclassmeetingsandconscientiouslycompleteallrequiredcourseactivitiesand/orassignments.”

– Ifyoucannotmaketheclass,sendmeanemailinadvance.• Youareencouraged toaskquestionsinmyclasses

– Myphilosophy:“Thereisnosillyquestiontome”– Iwillalsotrytoleave5-10minutesattheendofeachclass,for

youtoaskanyquestionsyouwant

6

Page 4: Contents - Computer and Information Science | Homefgsong/csci402/lecture_notes/Lecture_1.pdf · Department of Computer & Information Science IUPUI Contents ... – Computer Organization

1/9/18

4

7

quiz1 quiz2 quiz3 quiz4 quiz510 3 10 10 1010 7 10 6 1010 9 7 7 9.510 1 10 0 910 6 9 9 09 6 9 7 108 6.5 8 3 410 4 6 3 96.5 2 10 8 99 4 4 7 8.59 3 5 10 9.5

5.5 6 5 8 96 7 8 10 9.5

9.5 4.5 6 8 03.5 8 8 9 104 4.5 0 0 07 5 6 6 9

9.5 1.5 8 5 9.59 4.5 4 6 8.59 3.5 5 8 10

5.5 4.5 8 4 64.5 1 4 7 68.5 1.5 8 3 68.5 0.5 8 2 8.58.5 0 6 7 8.56.5 0 0 1 09 0 0 0 8.5

5.5 0 3 4 88 0 7 3 82 2 5 1 6.5

7.5 0 4 0 8.55.5 0 6 0 00 0 7 4 8.5

9.5 0 7 6 3.59 2 6 0 83 0 2 1 7.55 0 0 0 00 0 9 0 0

7.5 2 8 4 80 0 3 0 00 0 5 3 6

2.5 0.5 6 4 03.5 0 6 6 08 0 5 0 07 4.5 0 0 0

CDF

A

B

Myobservationonattendance:

Redcolormeansthestudentdidn’tattendtheclass.

CooperationandPlagiarismPolicy• Studentsareencouragedtodiscussconceptsandprinciplesamongst

themselves.Suchdiscussionsmayhelpinabetterunderstandingofthetopicstaughtintheclass.– However,thestudentcooperationshouldnotresultinidenticalor

nearidenticalanswers/report/code/documentationforprojects,homework,termreports,etc.

• Duringtheexams,studentsshoulddotheworkontheirown(e.g.,donotlookatneighbors).StudentsarealsonotallowedtheuseofsmartphonesorotherInternetconnecteddevicesduringexams.

• Allclassworkandmaterialsubmittedforgradingmustbeyourowneffort,unlessspecifiedotherwisebytheInstructor.

• Propercredit(intheformofcitationsandreferences)shouldbegivenwhereverapplicable,anddirectcutting-and-pastingmustbeavoided,unlessindicatedasverbatim(e.g.,puttingthetextinquotationmarks).Ashorttutorialaboutplagiarismislocatedat:http://ulib.iupui.edu/files/pdf/tutorials/AvoidingPlagiarismTutorial.pdf.

8

Page 5: Contents - Computer and Information Science | Homefgsong/csci402/lecture_notes/Lecture_1.pdf · Department of Computer & Information Science IUPUI Contents ... – Computer Organization

1/9/18

5

OurDepartment’sPlagiarismPolicy• Policyagainstviolationsofacademicintegritywillbeenforcedatthe

Departmentallevelacrossmultiplecoursesandacrosstheentirestudyperiod.

• Ifastudentdoesnotabidebythispolicythenforthefirstviolation,he/shewillreceivezeropointforthatcomponentofthecourseandwillbereportedtotheDepartmentChairperson.

• Forasecondviolationofacademicintegrity(eveninadifferentcourse),thestudentwillreceiveaFAILING gradeforthecourse and,inaddition,anofficialreportingprocesswillbeinitiatedasperIUPUI'sStudentConductPoliciesthatcanbefoundhere:http://www.indiana.edu/~code/code/responsibilities/academic.

• Forathirdviolation,thedepartmentwillinitiatedismissal request• Thereisaprofessionalcodeofethicsforcomputerscientistsspecifiedby

themainprofessionalsociety,AssociationforComputingMachinery(ACM).ACM'sCodeofEthicsisfoundhere:[http://www.acm.org/about/code-of-ethics].

9

Anyquestionsaboutthecourse?

10

gradingpolicy?quiz?exam?homework?duetime?…

Aboutprovidingslidesbeforeclasses,Itypicallymodifytheslides10minutesbeforeourlectures.//toavoidinconsistentcopies.

Page 6: Contents - Computer and Information Science | Homefgsong/csci402/lecture_notes/Lecture_1.pdf · Department of Computer & Information Science IUPUI Contents ... – Computer Organization

1/9/18

6

WhyDoYouCareaboutComputerArchitecture?

• itisrequired,earncredits,togetyourbachelordegree,…?• Importantly(inalongterm)

– Itisaboutyourfuturecareerincomputerscience(jobhunting)– Thiscourseprovideessentialskillsandfoundation

• Fact:Goodprogrammerstendtowriteefficientsoftware!– Todothat,youneedtounderstandthehardware,thearchitecture,

andknowhowprogramisexecutedbythecomputer…• knowingarchitecturewillhelpyouwritemoreefficientprograms

– Today, weareentering multicore era,acclerators,ARM,Cloud,etc…– Youwilllearnalotofnewknowledgefromthiscourse:

• E.g.,youmaythinkyourprogramreadsdatadirectlyfrommemory(Q:isitcorrect?)

• E.g.,youmaythinkreadingafileisfasterthanwritingafile(Q:isitcorrect?)• E.g.,GPUisalwaysfasterthanCPU(Q:isitcorrect?)• E.g.,Runninganappon100-coreisalwaysbetterthan80-coremachine?• E.g.,(a+b)+c=a+(b+c)?• fasterCPUisthemostimportantwhenbuyingcomputers?… …

11

WhatisComputerArchitecture(CA)?

• “ComputerArchitecture (likeanyotherarchitecture)isanArt ofdeterminingtheneeds ofusersandthendesigningtomeettheneedsaseffectivelyaspossiblewithin economicandtechnologicalconstraints.”– fromthebook:“PlanningaComputerSystem:ProjectStretch”,ed.W.

Buchholz,1962.– Nowtheconceptismoregeneral.(e.g.,CAdefineswhateverneedsto

knowaboutcomputers)• Comprise3subcategories:

– InstructionSetArchitecture(ISA)• Wewilltalkalotaboutit

– Microarchitecture• HowtoimplementtheISA(e.g.,cachesize,pipeline,control,datapath)

– Systemdesign• Involvestheothercomponents:memorybus,DMA,virtualmemory,etc.

12

Page 7: Contents - Computer and Information Science | Homefgsong/csci402/lecture_notes/Lecture_1.pdf · Department of Computer & Information Science IUPUI Contents ... – Computer Organization

1/9/18

7

ComputerArchitecture

• Itisanimportantandexcitingsubject– AcombinationbetweenScienceandArt

• Abouthowtoutilize technologyappropriately• Performancecanbeenhancedbycreativity

– Differentassessmentmetrics• Performance (goal:increase)• Power/Heat (goal:decrease)• Cost (goal:decrease)• Reliability (goal:improve)• Scalability (goal:improve)

– Dependingonwhichmarketsegment• Goalsareassessedbydifferentweights• Typicaldesigns:server,desktop,laptop

– Also,zillionsofembeddedapplications

• Bottomline:ThissubjectiseconomicallycriticaltoanynationAppleMacPro(6-core,dualGPU),2017

13

$3,999.00

iMac27”$2,299.00

http://www.apple.com/shop/buy-mac/mac-pro

TheComputerRevolution• Historically,twodominantparadigmsforscientificdiscovery:

Theory andExperiments• Rapidprogressincomputertechnology

– Vacuumtubeà transistorà ICà VLSI– UnderpinnedbyMoore’sLaw(cpu,memory)– Soon,computersareeverywhere

• Inthe20th century,Simulation emergesasthe3rdparadigm• Today,BigDataisthe4thparadigm• Thenewcomputeradvancesmadenovelapplicationsfeasible

– Computersinautomobiles– Smartphones– Humangenomeproject(DNAsequenceanalysis)– Internetofthings,smarthome/city– SearchEngines

• Computersarepervasive!

14

Page 8: Contents - Computer and Information Science | Homefgsong/csci402/lecture_notes/Lecture_1.pdf · Department of Computer & Information Science IUPUI Contents ... – Computer Organization

1/9/18

8

ThisCourse’sFocus

Software

Hardware

TechnologySelection

Engineering

CS402Focus

“Architecture”

15

Dependingonwhichapplicationscomputershavebeenusedfor…• Personalcomputers• Servercomputers• Embeddedcomputers• Supercomputers

16

Page 9: Contents - Computer and Information Science | Homefgsong/csci402/lecture_notes/Lecture_1.pdf · Department of Computer & Information Science IUPUI Contents ... – Computer Organization

1/9/18

9

17

ClassesofComputers[1st]• Personalcomputers–Mostwellknownform– Forgeneralpurpose,runsavarietyofsoftware– Designissubjecttocost/performancetradeoff– Emphasizesgoodperformanceforsingleuser– $1K- $10K– Largestmarket(intermsofdollars)– Importantfactorstoconsider• Performance(compute&graphics)• Price!

– CPUClockrate->redherring!

18

ClassesofComputers[2nd]• ServercomputersGoal:Torunlargeapplicationsformultiple users– Usuallyonlyaccessedvianetwork– Highcapacity,highperformance,reliability– Rangefromsmallserverstobuildingsize– $10K&up– Usedforenterprise-widecomputing

• E.g.,web-servers,databaseservers– Importantfactorstoconsider:

• Availability(24-7),dependability• Scalability• Emphasizethroughput (manyusers)

throughput istherateatwhichsomethingcanbe

processed.e.g.#jobs/second

Page 10: Contents - Computer and Information Science | Homefgsong/csci402/lecture_notes/Lecture_1.pdf · Department of Computer & Information Science IUPUI Contents ... – Computer Organization

1/9/18

10

19

ClassesofComputers[3rd]• Embeddedcomputers

– Definition:isacomputerinsideanotherdevice,runningonepredeterminedapplication

– Hiddenascomponentsofsystems(e.g.,car,TV,airplane,etc.)– NoGUI(soyouneverknowyouareusingcomputers!)– Stringentpower/performance/costconstraints– <$1- $100K

– Fastestgrowingmarket(intermsofnumbers)– Importantfactorstoconsider:

• Price• Real-timeresponse• Power• Error-freesoftware/firmware Acombinationof

memoryandprogram

EmbeddedComputers(cont.)

• Thelargestclassofcomputersspanningthewidestrangeofapplications(among4classes)– Oftenhaveminimumperformancerequirements.e.g.,

– Oftenhavestringentlimitationsoncost.– Oftenhavestringentlimitationsonpowerconsumption.e.g.,

– Oftenhavelowtoleranceforfailure.Example?

20

mp3player

<$1000

Smartphone

TV

Page 11: Contents - Computer and Information Science | Homefgsong/csci402/lecture_notes/Lecture_1.pdf · Department of Computer & Information Science IUPUI Contents ... – Computer Organization

1/9/18

11

21

ClassesofComputers[4th]• Supercomputers– Supporthigh-end scientificandengineeringcalculations– HighestperformanceandHighestcost,representasmallfractionoftheoverallcomputermarket

– $1M- $30M+– Parallelsupercomputers

• Tightly-coupledprocessors• Uselowlatency,high-performancenetwork• Solvelargetime-criticalproblems

– Cloudcomputing• Loosely-coupledprocessors• Usehighlatency,verycost-efficientnetwork(e.g.,ethernet)• Solvelargeresource-criticalproblems

• Top500 Supercomputers– http://www.slideshare.net/top500/top500-list-november-2014 (onlineslides)

• Thelistingofthe500mostpowerfulcomputerintheworld

• Yardstick:Rmax fromtheLINPACKbenchmark– Ax=b,adensematrixproblem

• Updatedtwiceeveryyear– SC conferencesinUSAeveryNovember– ISCconferencesinGermanyeveryJune

• Alldataavailablefromwww.top500.org

22

Page 12: Contents - Computer and Information Science | Homefgsong/csci402/lecture_notes/Lecture_1.pdf · Department of Computer & Information Science IUPUI Contents ... – Computer Organization

1/9/18

12

NumberOneinthePast20Years

4

https://www.top500.org/resources/top-systems/

24

RankinginNovember2017

Page 13: Contents - Computer and Information Science | Homefgsong/csci402/lecture_notes/Lecture_1.pdf · Department of Computer & Information Science IUPUI Contents ... – Computer Organization

1/9/18

13

25

26

http://www.netlib.org/utk/people/JackDongarra/PAPERS/sunway-report-2016.pdf

Page 14: Contents - Computer and Information Science | Homefgsong/csci402/lecture_notes/Lecture_1.pdf · Department of Computer & Information Science IUPUI Contents ... – Computer Organization

1/9/18

14

Whobuildsthesesystems?

27

CPUsShare

28

Page 15: Contents - Computer and Information Science | Homefgsong/csci402/lecture_notes/Lecture_1.pdf · Department of Computer & Information Science IUPUI Contents ... – Computer Organization

1/9/18

15

Accelerators(53Systems)

29

GPUsShare

30

Page 16: Contents - Computer and Information Science | Homefgsong/csci402/lecture_notes/Lecture_1.pdf · Department of Computer & Information Science IUPUI Contents ... – Computer Organization

1/9/18

16

CountriesShare

31

PerformanceTrendinTop500

32

20011998

Page 17: Contents - Computer and Information Science | Homefgsong/csci402/lecture_notes/Lecture_1.pdf · Department of Computer & Information Science IUPUI Contents ... – Computer Organization

1/9/18

17

AppleA11CPU(iPhone8,iPhone8Plus,iPhoneX)

33

https://igotoffer.com/blog/apple-a11-full-information-specifications/

iOS 11 Throttles iPhone 6 And 7 To Half Speed Most Of The Time