Multimedia Communications elsaddik ...elsaddik/abedweb/teaching/elg5121/pdf/2x09_MM... · 1 elsaddik 1 01_Introduction © elsaddik Multimedia Communications Multimedia Technologies

1

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com

101_Introduction © elsaddik

Multimedia Communications

Multimedia Technologies & Applications

Prof. Dr. Abdulmotaleb El SaddikMultimedia Communications Research LaboratorySchool of Information Technology and Engineering

University of OttawaOttawa, Ontario, Canada

elsaddik @ site.uottawa.caabed @ mcrlab.uottawa.ca

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


The Promise and Reality of Collaborative Computing

Introduction to Collaborative Computing

Characterization of Collaboration Tools

Where Are We Today?

Security as a Collaboration Enabler

Collaboration Standards

Challenges Implementing Collaboration Technologies

Video Conferencing Systems

Setting up for a Videoconference

2

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Introduction to Collaborative Computing

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Multimedia Applications

Distance LearningDistance Learning

Video ConferencingVideo Conferencing

Tele MedicineTele Medicine

SurveillanceSurveillance

Broadcast TVBroadcast TV

Conferencing

Broadcasting

Video on Demand

ConferencingConferencing

BroadcastingBroadcasting

Video on DemandVideo on Demand

3

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Conferencing—Room to Roomw

ww

.site

.uot

taw

a.ca

/~el

sadd

ikw

ww

.el-s

addi

k.co

m


Conferencing—Desktop

4

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Conferencing—Multipointw

ww

.site

.uot

taw

a.ca

/~el

sadd

ikw

ww

.el-s

addi

k.co

m


Broadcast—Live

E=mc2

E=mc2

E=mc2

E=mc2

5

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Multimedia -Authoring

Graphics Audio Video Text

Authoring

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Multimedia

CD-ROM- ISO 9660, Mac HFS, PhotoCD.

- etc....

DVDMMDatabaseFile system

Network- Interactive game- Video-on-demand

Authoring Distribution

6

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Broadcast—Pre-Recorded w

ww

.site

.uot

taw

a.ca

/~el

sadd

ikw

ww

.el-s

addi

k.co

m


Broadcast—Video Distribution

7

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Video on Demand

VideoServer

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Live & Pre-Recorded MM

VideoServer

E=mc2

E=mc2

E=mc2

E=mc2

8

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Rules

Rule #1Remote collaboration is not (and it does not claim to be) like face to face collaboration and it will probably never be like that

• May be one day when virtual reality will not be only a game anymore

Rule #2The computer does not have to be seen as a sobstitute to human interaction

• It is only an instrument!• Distance/Computer based training will

never sobstitute teachers completely! • I hope it for the best of humanity

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Business Drivers

Improve efficiency of teams through better collaboration and coordination within and across organizationsLeverage information and personnel assets within and across organizationsSupport geographically / temporally dispersed teamsEmpower teams with flexibility and responsiveness to increase competitive edge and deliver better customer satisfaction

9

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Electronic mail, teleconferencing, and Instant messaging (IM) allow communication between two or more computer users

• People can communicate in real time or delayed time

2001 Prentice Hall Concise 5.17

E-Mail, Teleconferences, & IM: Interpersonal Computing

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Real-time communication (synchronous):

– participants meet in real time– participants see each other’s typed

messages as they are typed– examples: Talk and Chat


Real-Time vs. Delayed Communication

10

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Delayed communication (asynchronous):

– Participants type, post,and read messages attheir convenience

– Participants share an electronic mailboxrelated to the group’spurpose

– Examples: email and Newsgroups


Real-Time vs. Delayed Communicationw

ww

.site

.uot

taw

a.ca

/~el

sadd

ikw

ww

.el-s

addi

k.co

m


The Groupware Paradigm & Technologies

sameplace

differentplaces

same time/Synchronous

different times/Asynchronous

face to face interactions

public computer screensdecision roomsbrainstorming tools

continuous task

team roomsgroup displaysshift work groupwareproject management

remote interactions

videoconferencingwalls & hallways

desktop conferencingshared viewsshared drawing/editors...

communication+coordination

emailbulletin boardsasynchronous conferencingschedulersversion control...

11

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Characterization of Synchronous Collaboration Tools

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Data Conferencing

Enables team members to interact in real time over data in an applicationShared whiteboard

Provides real time interaction over anelectronic whiteboard with display, gesture, and annotation capabilitiesCommon applications include remote presentation and group viewing and annotation of imagery or diagrams

Application sharing and Screen-sharingProvides real time interaction over applications, enabling users to simultaneously view and control the applicationCommon applications include remote,collaborative real time authoring/editing/reviewing, training, and presentation

12

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Teleconferencing

Just like the telephone, except you can see who you are talking to.

You can talk to one or many other people at the same time, just as with the telephone.

It is NOT video broadcasting.

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Two Types of Video Conferencing

Traditional InternetUse in special room; rare Use anywhere; ubiquitous

Uses ISDN telephone lines Uses Internet

High installation cost Low installation cost

High usage cost No usage cost

Usage at plateau Usage growing rapidlyProfessional operator Do-it-yourself

Centralized control Decentralized control

H.320 standard H.323 standard

13

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Videoconference Standards

Encoder DecoderDecoder

DecodingStandardized

Organized byNetwork Type

FocusedUpon

Interoperability

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Collaboration Standards

14

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Video Conferencing Standards

H.261H.261G.711G.711G.722G.722G.728G.728

T.120T.120

H.263H.263H.261H.261G.711G.711G.723G.723G.722G.722G.728G.728T.120T.120

VideoVideo

AudioAudio

DataData

VideoVideo

AudioAudio

DataData

ISDNISDN H.320H.320

LAN / IP H.323LAN / IP H.323

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


H.323 Defined

The H.323 standard is a summary recommendation that describes point-to-point and multipoint interoperability of audio and/or visual terminal equipment connected via a IP based non-guaranteed quality of service network.

15

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Key Functional Components

Terminal:Endpoint Equipment or “Terminal Application”

MCUProvides Multipoint Conference Connectivity

GatewayProvides Interoperability

GatekeeperManages “QoS”

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Terminal

H.323 terminals are client endpoints that must support:

H.225 call control signaling.H.245 control channel signaling.RTP/RTCP protocols for media packets.Audio codecs.

Video codecs support is optional

16

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


H.323 Terminal

H.263Video

G.711, G.722,G.723, G.728

Audio

T.120Data

H.245Control

H.225

FrameLANI/O LAN

Monitor

Camera

Microphone

Data Exchange

Audio

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Multipoint Control Unit - MCURequired With 3 or More Terminals In ConferenceInternals:

Multipoint ControllerMultipoint Processor

Implementation:Hardware BasedSoftware

17

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Gateway Requirements

H.320

H.261 VideoH.221 FrameG.7xx Audio

H.323


Network

Bandwidth

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Gateway Solution

H.320


H.323


Gateway Provides

Translation and

Transcoding

18

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


GatekeeperControl AccessCall RoutingAddress TranslationImplementation Not Required

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Remote collaboration: what hardware do we need?

Basic configurationStandard PC Sound card + SpeakersMicrophone

Optional devicesWebcam/cameraScannerTablet (es. Wacom, Mimio, etc)... ... ...

NETWORK CONNECTION

19

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


H.323 Implementation

Ethernet

Gateway

Multipoint Control Unit

H.320 Terminal

H.323Terminals

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Where Are We Today?

20

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


State of the Practice

•Market segment strong (5-10 years)•Stable technology base•Scaleable to enterprise•Some interoperability standards•Most tools have some security support

•Market segment strong (5-10 years)•Stable technology base•Scaleable to enterprise•Some interoperability standards•Most tools have some security support

EmailDiscussion

GroupsInformation sharing

IntranetsGroup

Calendaring

Mostly asynchronous collaborationCoordination and information sharingMostly asynchronous collaboration

Coordination and information sharing

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


•Current product offerings are largely young (3-5 years)•Issues with stability and scalability to support large conferences •Requires sufficient network bandwidth, reliability, and quality of service•Interoperability across tools, but can be spotty•Issues with security and firewall support

•Current product offerings are largely young (3-5 years)•Issues with stability and scalability to support large conferences •Requires sufficient network bandwidth, reliability, and quality of service•Interoperability across tools, but can be spotty•Issues with security and firewall support

State of the Art

Audio/VideoConferencing

SharedWhiteboard

shared by Peter Spellman

SharedApplicationText Chat

Synchronous collaborationVirtual meetings and interactive production

Synchronous collaborationVirtual meetings and interactive production

21

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Security as a Collaboration Enabler

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Collaboration and SecuritySecurity is often weakly addressed by collaboration toolsApproach: Integration of security services with applications

Authentication to verify identity and protect from spoofingAccess control within collaboration tool Data encryption to ensure privacy

Approach: Use of external security mechanisms to secure the networks and/or provide authenticated access

Firewall support to enable safe collaboration with partners (includes tailored firewall policies, and firewall proxies)De-militarized zone (DMZ) approachesExtranetsVirtual Private Networks (VPNs)

22

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Collaboration EnablersVirtual Private Networks (VPNs) provide secure communications channel between two entities

A private, encrypted tunnel

Extranets are a segment of an organization’s network that is shared with partners

Authenticated access enables presentation of tailored views of shared dataOften coupled with VPN technology

Internet

Firewall

RemoteClient

Client

FirewallClient

Internal Servers

Extranet Server

Source: C. Eliopoulos, MITRE

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Motivation for Using VPNs and ExtranetsAuthentication and encryption techniques ensure user authentication, data privacy, and integrityCost-effective way to eliminate expensive dedicated leased lines between sites and long distance calls for remote and mobile usersUsers can gain direct access to the company’s resources from anywhere due to the almost universal availability of the InternetFacilitates the compartmentalization of information exchanges among selected user groups or organizationsReplicated content and accompanying administration overhead no longer necessary

Source: C. Eliopoulos, MITRE

23

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Challenges Implementing Collaboration Technologies

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Challenges Implementing Collaboration

Infrastructure (easiest): Networks, systems, support

RemoteClient

Client

Client

Servers

Server

Culture (hardest): Learning a new “economics of trust”

Security (harder): Risk management vs. risk avoidance

24

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Infrastructure ChallengesNetworks

Bandwidth and bandwidth managementQuality of service and bandwidth reservationNetwork protocols (e.g., IP Multicast, ATM)

SystemsIntegration and interoperability

With other systems and applicationsWith partner’s collaboration environments

Maintainability, upgradability

SupportManaging large scale roll-outsRobust administration toolsTroubleshooting

Performance, scalability, reliability, cost

RemoteClient

Client

Client

Servers

Server

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Security ChallengesRisk management vs. risk avoidance

Security is often weakly addressed by collaboration toolsAuthentication to verify identity Access control within collaboration tools Data encryption to ensure privacyFirewall support for safe collaboration with partners

Some solutions available (e.g., VPNs, PKI, Extranets)

PoliciesThere are no policies for supporting virtual organizationsFlexible concept of operations to enable secure collaborationWillingness to challenge and evolve policiesto support collaboration goals

25

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Cultural Challenges (1 of 2)Learning a new “economics of trust”Modifying reward structure to incentivize team contributionsOrganizational readiness to change - timing is everything

Support from the top, clear benefits to participants

Dealing with resistance

Sharing ownership of the effort with partnersDealing with user’s fears

The person who does the work does not receive the benefitFailure to support exception handlingExisting power structure is modifiedWork crosses organizational linesImplicit behavior is made explicit

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Understanding how to evolve the technology and the business process to realize improvement

Concept of operations, planned roll-out process, clear goals, managing expectations, letting users evolve concept of operations and new collaborative process, training and user support

Understanding social scalability

• How you do establish virtual communities?

• What is the best way to run a virtual meeting, a virtual team?

Few publications to guide; learning on the job

Cultural Challenges (2 of 2)

26

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Video Conferencing Systems

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Desktop Video Conferencing Systems

In Person Silicon Graphics Video Compression in software

Person to Person/2 IBM Compressed video over ISDN, TR or Ethernet.

Polycom Polyspan Uses ISDN/IP; runs on PCs, or Special Hardware

Vis-a-Vis Motion Wordlinx Regular POT, switched 56 or ISDN; for PCs

Communique InSoft Good Video; multivendor platform

ShowMe Sun Microsystems For SPARCs over TCP/IP LANs

Sound Pict. Info. DEC For DECstation 5000 running UltrixV4.3

CU-See-Me Cornell Univ. For MACs and PCs over IP networks

MBONE Internet For UNIX workstations and PCs

ProShare Intel PCs

NetMeeting Microsoft PCs

Product Company Comments

27

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


FreeBased on TCP/IPBi-directionale Video conferenceApplication Sharing, File Transfer, Whiteboard, Chat, Instant MessagingDisadvantages:

Only two participantsNo recording possibleProblems with Firewall

Microsoft NetMeetingMicrosoft NetMeetingw

ww

.site

.uot

taw

a.ca

/~el

sadd

ikw

ww

.el-s

addi

k.co

m


Polyspan Viewstation SPPoint-to-Point Tool15 fps at 128 Kbit/s ISDN connectionEthernet LAN Port for IPCompatible with NetMeetingRecording capability and playback (TV/VHS)Disadvantage:

Problems with FirewallNo Multicasting

Polycom PolyspanPolycom Polyspan

28

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Applications

Telemedicine

College course among four universities, across the country.

Bringing a guest lecturer into a college course.

Bringing a VIP into a press conference, from across the world.

…

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com



29

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com



ClothingSolid color shirts“Busy” outfits blur when on cameraSimpler patterns aid the video compression

LightingSoft white lightLight from in frontStandard overhead lights don’t cut itThink of TV studio lightingCamera can not focus in low light

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com



BackdropNo Hard Lines or complicated patternsCan use a dry erase boardSolid color is ideal• Avoid red backgrounds

Give audience one thing to focus onAudio Setup

Separate Microphones and SpeakersTest levels ahead of time• Polycom’s “Generate Tone”• Polycom’s “Audio Meter”

May need to add echo canceling hardware

30

ww

w.s

ite.u

otta

wa.

ca/~

elsa

ddik

ww

w.e

l-sad

dik.

com


Documents

Multimedia Communications elsaddik ...elsaddik/abedweb/teaching/elg5121/pdf/2x09_MM... · 1 elsaddik 1 01_Introduction © elsaddik Multimedia Communications Multimedia Technologies