CSE3320OperatingSystems

Synchronization

Jia RaoDepartmentofComputerScience and Engineering

http://ranger.uta.edu/~jrao

RecapoftheLastClass

• Multiprocessorschedulingo Twoimplementationsofthereadyqueue

o Loadbalancing

o Parallelprogramscheduling} Synchronizationsonshareddataandexecutionphases

} Causalityamongthreads

Inter-processorthreadcommunications

Inter-ProcessCommunication(IPC)• Three fundamental issues:

o How one process can pass information to another

o How to make sure two or more processes do not get into each other’s way when engaging in critical activities

o How to maintain proper sequencing when dependencies present

Howaboutinter-threadcommunication?

RaceConditions° Raceconditions:whentwoormoreprocesses/threadsare

readingorwritingsomeshareddata andthefinalresultsdependonwhorunspreciselywhen• Interrupts,interleavedoperations/execution

printer daemon

Dir[in] = X;in ++;

Dir[in] = Y;in ++;

MutualExclusionandCriticalRegions° Mutualexclusion:makessureifoneprocessisusinga

sharedvariableorfile,theotherprocesseswillbeexcludedfromdoingthesamething• Mainchallenge/issuetoOS:todesignappropriateprimitive

operationsforachievingmutualexclusion

° Criticalregions:thepartoftheprogramwherethesharedmemoryisaccessed

° Fourconditionstoprovidemutualexclusion• Notwoprocessessimultaneouslyincriticalregion• NoassumptionsmadeaboutspeedsornumbersofCPUs• Noprocessrunningoutsideitscriticalregionmayblockanother

process• Noprocessmustwaitforevertoenteritscriticalregion

MutualExclusionUsingCriticalRegions

Mutual exclusion using critical regions

MutualExclusionwithBusyWaiting

° Disabling interrupts: ° OS technique, not users’

° multi-CPU?

° Lock variables: ° test-set is a two-step process, not atomic

° Busy waiting: ° continuously testing a variable until some value appears

(spin lock)

BusyWaiting:StrictAlternation

0 1

What if P1’s noncritical_region() has lots more work than P0’s?

Proposed strict alternation solution to critical region problem(a) Process 0. (b) Process 1.

BusyWaiting:Peterson’s

Peterson's solution for achieving mutual exclusion

sharing

Differentfromstrictalternation

BusyWaiting:TSL

Entering and leaving a critical region using the TSL instruction

° TSL(TestandSetLock)

• Indivisible(atomic)operation,how?Hardware(multi-processor)

• HowtouseTSLtopreventtwoprocessesfromsimultaneouslyenteringtheircriticalregions?

SleepandWakeup° IssueIwithPeterson’s&TS:howtoavoidCPU-costlybusywaiting?

° IssueII:priorityinversionproblem• Considertwoprocesses,Hwith(strict)highpriorityandLwith(strict)

lowpriority,LisinitscriticalregionandHbecomesready;doesLhavechancetoleaveitscriticalregion?

° SomeIPCprimitivesthatblockinsteadofwastingCPUtimewhentheyarenotallowedtoentertheircriticalregions• Sleepandwakeup

SleepandWakeup– Producer-ConsumerProblem

Q1:Whatifthewakeupsignalsenttoanon-sleep(ready)process?

Q2: what is a wakeup waiting bit? Is one enough?

SemaphoresandP&VOperations° Semaphores:avariabletoindicatethe#ofpendingwakeups

° Downoperation(P;request): lock

• Checksifasemaphoreis>0,- ifso,itdecrementsthevalueandjustcontinue

- Otherwise,theprocessisputtosleepwithoutcompletingthedownforthemoment

° Up operation(V;release):unlock

• Incrementsthevalueofthesemaphore- ifoneormoreprocessesaresleepingonthesemaphore,oneofthemischosenbythesystem

(randomly)andallowedtocompleteitsdown(semaphorewillstillbe0)

° P&Voperationsareatomic,howtoimplement?

• SingleCPU:systemcalls,disablinginterruptstemporally

• MultipleCPUs:TSLhelp

TheProducer-consumerProblemw/Semaphores

UC.ColoradoSprings

Binary semaphores: if each process does a down before entering its critical region and an up just leaving it, mutual exclusion is achieved

For mutual exclusion and synchronization

Mutexes° Mutex:

• avariablethatcanbeinoneoftwostates:unlockedorlocked

• Asimplifiedversionofthesemaphores[0,1]

Give other chance to run so as to save self;What is mutex_trylock()?

Mutexes – User-spaceMulti-threading° Whatisakeydifferencebetweenmutex_lock andenter_region inmulti-

threadingandmulti-processing?

• Foruser-spacemulti-threading,athreadhastoallowotherthreads torunandreleasethelocksoastoenteritscriticalregion,whichisimpossiblewithbusywaitingenter_region

Two processes entering and leaving a critical region using the TSL instruction

Monitors° Monitor:ahigher-levelsynchronizationprimitive

• Onlyoneprocesscanbeactiveinamonitoratanyinstant,withcompiler’shelp;thus,howabouttoputallthecriticalregionsintomonitorproceduresformutualexclusion?

But, how processes block when they cannot proceed?

Condition variables, and two operations: wait() and signal()

Monitors(2)

Conditions are not counters; wait() before signal()Outline of producer-consumer problem with monitors

o only one monitor procedure active at one time (a process doing signal must exit the monitor immediately); buffer has N slots

Wakeup and sleep signals can lost, but not Wait and signal signals, why ?

Monitor(3)

• Proso Makemutualexclusionautomatic

o Makeparallelprogramminglesserror-prone

• Conso Compilersupport

MessagePassing

Communication without sharing memory

The producer-consumer problem with N messages

Barriers

• Use of a barrier (for programs operate in phases, neither enters the next phase until all are finished with the current phase) for groups of processes to do synchronization(a) processes approaching a barrier(b) all processes but one blocked at barrier(c) last process arrives, all are let through

ClassIPCProblems:DiningPhilosophers• Philosophers eat/think• Eating needs 2 forks• Pick one fork at a time • How to prevent deadlock & starvation

o Deadlock: both are blocked on some resource

o Starvation: both are running, but no progress made

The problem is useful for modeling processes that are competing for exclusive access to a limited number of resources, such as I/O devices

DiningPhilosophers(2)

A non-solution to the dining philosophers problemWhat happens if all philosophers pick up their left forks simultaneously?

Or, all wait for the same amount of time, then check if the right available?

What if random waiting, then check if the right fork available?

What performance if down and up on mutex before acquiring/replacing a fork?

DiningPhilosophers(3):Solutionpart1

DiningPhilosophers(4):Solutionpart2

TheReadersandWritersProblem

UC.ColoradoSprings

Summary• Raceconditions

• Mutualexclusionandcriticalregions

• Twosimpleapproacheso DisablinginterruptandLockvariables

• Busywaitingo Strictalternation,Peterson’sandTSL

• SleepandWakeup

• Semaphores

• Mutexes

• ClassicalIPCproblems

• Additionalpracticeo ReadLinuxdocumentation:LINUX_SRC/Documentation/spinlocks.txt

o Findtheimplementationofdown andup inLINUX_SRC/kernel/semaphore.c

o Spinlockv.s.Mutex:http://stackoverflow.com/questions/5869825/when-should-one-use-a-spinlock-instead-of-mutex