EECS 482 Introduction to Operating Systemsweb.eecs.umich.edu/~harshavm/eecs482/lec1_handouts/lec1-intro.pdf · EECS 482 Introduction to Operating Systems Winter2018 Baris Kasikci

EECS 482Introduction to

Operating Systems

Winter 2018

[email protected]

(Thanks,HarshaMadhyastha fortheslides!)

January3,2018 EECS482– Lecture1 1

AboutMe

•Prof.Kasikci(Prof.K.),Prof.Baris(Prof.Barish)•AssistantProfessor• JoinedMichiganinFall’17• PhDfromEPFL• Previously,researcheratMicrosoftResearch• Previously,anembeddedsystemsdeveloper

• Interests:systemreliability,security,performance• EmployamixofmethodsfromOperatingSystems,ProgrammingLanguages,SoftwareEngineering,ComputerArchitecture

EECS482– Lecture1January3,2018 2

AboutYou

•[email protected]•[email protected] ifyouneedspecialarrangementforanydisabilities•Cometalktome• BBB4816,mydoorisalwaysopen• Anytimeaboutcareer,life,anydifficultiesyouarefacing,harddecisions,etc.• Duringofficehoursabout482


EECS482Staff

• Instructors•GSIs&IAs


AgendaforToday

•Whydoweneed482?

•Coursesyllabusandlogistics

•WhydoweneedanOSandwhatdoesitdo?

•HowdidOSesevolvetowhatwehavetoday?


Neuronstosilicon?

Ideas

High-LevelCode

MachineInstructions

Processors

Gates

EECS280,281(programming)

EECS483(compilers)

EECS370(comp.organization)

EECS270(digitaldesign)


Whatismissing?

•Bootstrapping:• Howdoesacomputerstartwhenyouturniton?• HowtogetaprogramintomemoryandhavetheCPUstartexecutingit?

•ConcurrentexecutionwithI/O:• Howtoreadkeyboardormouse?Printoutputtoscreen?• Howtorunmultipleprogramsatthesametime,withoutonebreakingtheother?

•Persistenceandsecurity:• Howtosaveyourdatawhenyouturnthecomputeroff?• Howtopreventotherusersfromaccessingyourdata?• Howcanmultipleusersusethesamecomputersecurely?


Whatismissing?

•Bootstrapping:• Howdoesacomputerstartwhenyouturniton?• HowtogetaprogramintomemoryandhavetheCPUstartexecutingit?

•ConcurrentexecutionwithI/O:• Howtoreadkeyboardormouse?Printoutputtoscreen?• Howtorunmultipleprogramsatthesametime,withoutonebreakingtheother?

•Persistenceandsecurity:• Howtosaveyourdatawhenyouturnthecomputeroff?• Howtopreventotherusersfromaccessingyourdata?• Howcanmultipleusersusethesamecomputersecurely?


YouwillbeabletoanswerallthesequestionsbytheendofEECS482

Objectivesofthisclass

•Wewillunderstandprinciplesofconcurrency• Oneparadigm:multi-threadedprogram• Principlesapplytootherforms(e.g.,event-based)

•WewillstudydesignprinciplesofanOS• ThiscourseisnotaboutspecificsofanyparticularOS

•WewilldevelopanunderstandingofOSimpactonapplicationperformanceandreliability• WhatcausesyourprogramtocrashwhenyoudereferenceNULL?• Howcanmultithreadedcodebeslowerthansingle-threadedcode?


Prerequisites

•EECS281•EECS370•ExtensiveC/C++programmingexperience(STL)•FamiliaritywithUNIX•Understandingofcomputerarchitecture

• Stackpointer• Programcounter• Low-levelexecutionofaprogram• Etc.

•Someunderstandingofpaging,TLB,caching


ClassHomepageandTools

•Classwebpage• http://web.eecs.umich.edu/~harshavm/eecs482/• Syllabus,slides,homework,etc.postedonclasswebpage• SubscribetoPiazza!• Announcementsandclassdiscussion


LectureSchedule

•CPU(threadsandconcurrency)•Memory(addressspaces)•Midterm•Network(sockets)•Storage(filesystems)•Aggregation:distributedsystemsandcasestudies


Lectures

•2sections• Mostlysynchronized,examswillhaveafewdifferentquestions

• Lecturecaptured(videosonline)

•Slidesandlecturenoteswillbepostedonthewebpage

•Textbook(highlyrecommended):• AndersonandDahlin,“OperatingSystems:PrinciplesandPractice”• Additionalreadingspostedonthewebpage


Lab/DiscussionSections

•OKtoattendanydiscussion• Aslongasthereareseats

Questionspostedseveraldaysinadvance• Dothembefore goingtoyoursection• Thispreparesyouwellforexams• Coverssomebackgroundknowledge

•NoDiscussionSessionsThisFriday!


Projects

•4projects• Writingaconcurrentprogram• Threadmanager• Virtualmemorypager• Multi-threadedsecurenetworkfilesystem

•Firstisindividual,doothersingroupsof2-3• RegisteryourGitHubid– we’llassignrepositories• Declareyourgroup(by1/22)viacoursewebpage• [email protected] iftaken482before• Can’treuseanycodeexceptforproject1.


Projectrecommendations

•Choosegroupmemberscarefully• Checkschedule,classgoals,style,etc.• UsePiazzatofindgroupmembers

•We’llevaluateeverymember’scontributions• Peerfeedback• gitlogandGitHubstatistics

•Groupcanfireoneofitsmembers(seesyllabus)


ProjectsareHARD!

•ProbablythehardestclassyouwilltakeatUMintermsofdevelopmenteffort• Projectswilltake95%ofyourtimeinthisclass

•Reasonforbeinghard:• Notnumberoflinesofcode!• Instead,newconcepts:threads,interrupts,addressspaces,namespacesetc.


Projectrecommendations

•Donotstartworkingonprojectsatlastminute!• Projectsareautograded(mustbemostlycorrect)• No.ofhoursyouputinorlinesofcodedon’tcount• Testingisintegralprocessofdevelopment

•Makegooduseofhelpavailable• ~20officehoursperweek(extrahourswhenprojectsaredue)• Therewillbelongqueues• MonitorandparticipateindiscussiononPiazza• Hintsduringlectures,discussions(alsointextbook!)


Policies

•Submission• 1submissionperdaytoautograder+3bonus• Dueatmidnight(harddeadline!)• 3latedaysbudgetacrossallprojects(ifyouhandinyourprojecttwodayslate,youwillhaveonelatedayleft)

•Collaboration• OkaytoclarifyproblemordiscussC++syntax• Notokaytodiscusssolutions• Pastsolutionsarealproblem(severalHCcases)


Exams(Tentative!)

•Midterm:February21st (6:30-8:30pm)

•Final:April23th (7-9pm)

•Nomakeupexams• Unlessdirecircumstances• Makesureyouscheduleinterviewsappropriately• E-mailme([email protected])withexceptions/conflicts


Gradingbreakdown

•Projects:• Project1:3%• Projects2,3,and4:15%each

•Mid-term:26%•Final:26%


Enrollment

Musthaveprerequisites(281&370orequivalent)

Overrides• Currentlynearcapforcoursestaffing• Hopemanycanenrollduetonormalchurn


Protipsforsuccessin482

•Startearlyonprojects

• LeverageGitHubandcommunicatewithteam

•Takeadvantageofavailablehelp• Gotoofficehours,post/monitorquestionsonPiazza

•Attendlecturesanddiscussions• Readtextbook,solvequestionsbeforediscussion

•Askquestionswhensomethingisunclear


WhyhaveanOS?

•Whatifapplicationsrandirectlyonhardware?

•Problems• Portability• Resourcesharing

Applications

Hardware


WhatisanOS?

•Theoperatingsystemisthesoftwarelayerbetweenuserapplicationsandthehardware

•OSis“allthecodethatyoudon’thavetowrite” toimplementyourapplication

OperatingSystem

Hardware

ApplicationsVirtualMachineInterface

PhysicalMachineInterface


RolesoftheOS

• Illusionist:Createabstractions• CPUà Threads• Memoryà Addressspace

•Government:Managesharedhardwareresources• Butatacost(taxes)

•ForanyareaofOS,ask• Whatinterfacedoeshardwarepresent?• WhatinterfacedoesOSpresenttoapplications?


OSandApps:2Perspectives

•Perspective1:applicationismainprogram• Getsservicesbycallingkernel(OS)• Example:printthistothescreen

•Problemswiththisview:• Howdoesapplicationstart?• Howdotasksoccurringoutsideanyprogram(e.g.receivingnetworkpackets)getdone?• Howdomultipleprogramsrunsimultaneouslywithoutmessingeachotherup?


OSandApplications

•Perspective2:OSismainprogram• Callsapplicationsassubroutines• Illusion:everyapprunsonitsowncomputer

• Lowerlayer(OS)invokeshigherlayer(apps)!•ApporprocessorreturnscontroltoOS•Correctperspective,butwhatisitthatmakestheOSthe“main”program?


WhytakeanOSclass?- 1

•Masteringconcurrency• Performancetodayachievedthroughparallelism• Masteryrequiredtobeatop-notchdeveloper

•Understandingwhatyouuse• UnderstandingtheOShelpsyouwritebetterapps• Functionality,performancetuning,simplicity,etc.

•Universalabstractionsandoptimizations• Caching,indirection,naming,atomicity,protection,…• Examples:Cloudcomputing,Webservices,mobile


WhytakeanOSclass?- 2

•BuildanOS•Conceptsreusedinmanyapplications• Google’swebserverfarm• AmazonWebServices(time-shared)• Hypervisors(VMWareESXserver)• NVDIAdevicedriver

•Softwaredevelopment• Designanabstraction• Makeitefficientlyusablebyothers

•Design-relatedinterviewquestions


Historyofoperatingsystems

•Singleoperatoratconsole

•Positives:• Interactive• Verysimple

•Downside:• Poorutilizationofexpensivehardware

time

humanI/OCPUI/OhumanI/OCPU



•Batchprocessing(usingpunchcards)• Goal:ImproveCPUandI/Outilizationbyremovinguserinteraction

•OSisbatchmonitor+libraryofstandardservices•Protectionbecomesanissue• Whywasn’tthisanissueforsingleoperatoratconsole?

•Notinteractive

timeI/OCPUI/OCPUI/OCPU



https://www.wired.com/2015/07/hackers-remotely-kill-jeep-highway/


•Multi-programmedbatch• ImproveutilizationbyoverlappingCPUandI/O

time

P1:CPUDiskCPUPrint

P2:DiskCPUPrintCPUPrint

P3:DiskCPU



•Multi-programmedbatch• ImproveutilizationbyoverlappingCPUandI/O

time

P1:CPUDiskCPUPrint

P2:DiskCPUPrintCPUPrint

P3:DiskCPU

OSbecomesmorecomplex!• Runsmultipleprocessesconcurrently• EnablessimultaneousCPUandI/O•MultipleI/Ostakeplacesimultaneously• Protectsprocessesfromeachother• But,stillnotinteractive



•Timesharing• Goal:Allowpeopletointeractwithprogramsastheyrun• Insight:Usercanbemodeledasa(veryslow)I/Odevice• Switchbetweenprocesseswhilewaitingforuser

time

P1:CPUDiskCPUPrint

P2:UserCPUUserCPUUser

P3:User DiskCPU



•Timesharing• Goal:Allowpeopletointeractwithprogramsastheyrun• Insight:Usercanbemodeledasa(veryslow)I/Odevice• Switchbetweenprocesseswhilewaitingforuser

time

P1:CPUDiskCPUPrint

P2:UserCPUUserCPUUser

P3:User DiskCPU


OSisnowevenmorecomplexLotsofsimultaneousjobsMultiplesourcesofnewjobs(peoplecanstartnewjobs)Interactivityisrestored


•OSstartedoutverysimple• Becamecomplextousehardwareefficiently

•ConsiderPCsandworkstations:• Isthemainassumption(hardwareisexpensive)stilltrue?

•HowdoesthisaffectOSdesign?• Don’tPCsneedtotimesharebetweenmultiplejobs?• Don’tPCsneedprotectionbetweenmultiplejobs?

PCsgraduallyaddedbacktime-sharingfeatures


Whatabouttoday?

•Cloudcomputing(e.g.AmazonEC2)• Ishardwareexpensive?• WhatotherOSfeaturesareneeded?

•Mobilecomputing(e.g.,Android/iOS)• Whatdrivesefficiency?• WhatOSfeaturesareneeded?


QuestionstoPonder

•Somewhatsurprisingly,OSescontinuetoevolve• WhatarethedriversofOSchange?• Newhardware,security,energy

•WhatispartofanOS?Whatisnot?• IsthewindowingsystempartofanOS?• OSresearchhasbecomeDist.Systemsresearch


Linuxvirtualmemorysystemoverhaul:https://www.theregister.co.uk/2018/01/02/intel_cpu_design_flaw/

TODOs

•Browsethecoursewebpage

•SubscribetoPiazza

•RegisteryourGitHubid

•Startfindingpartnersforprojectgroup(Jan22)


Documents

EECS 482 Introduction to Operating Systemsweb.eecs.umich.edu/~harshavm/eecs482/lec1_handouts/lec1-intro.pdf · EECS 482 Introduction to Operating Systems Winter2018 Baris Kasikci