Multimedia Computing and Multimedia Computing and CommunicationsCommunicationsMultimedia Computing and Multimedia Computing and CommunicationsCommunications

C. Edward C. Edward ChowChowC. Edward C. Edward ChowChow

mcc chow 2

Outline of the TalkOutline of the TalkOutline of the TalkOutline of the Talk

SyllabusSyllabus

Introduction to Multimedia ComputingIntroduction to Multimedia Computing

Introduction to Multimedia Introduction to Multimedia CommunicationsCommunications

Ideas for Semester ProjectsIdeas for Semester Projects

mcc chow 3

MediaMediaMediaMedia

mediummedium (METHOD) (METHOD)noun [C] plural noun [C] plural mediamedia or or mediumsmediumsa method or way of expressing somethinga method or way of expressing something

new medianew media plural nounplural nounproducts and services that provide information or products and services that provide information or entertainment using computers or the Internet, entertainment using computers or the Internet, and not by traditional methods such as television and not by traditional methods such as television and newspapers: .and newspapers: . Cambridge Advanced Learner's DictionaryCambridge Advanced Learner's Dictionary

mediummedium (METHOD) (METHOD)noun [C] plural noun [C] plural mediamedia or or mediumsmediumsa method or way of expressing somethinga method or way of expressing something

new medianew media plural nounplural nounproducts and services that provide information or products and services that provide information or entertainment using computers or the Internet, entertainment using computers or the Internet, and not by traditional methods such as television and not by traditional methods such as television and newspapers: .and newspapers: . Cambridge Advanced Learner's DictionaryCambridge Advanced Learner's Dictionary

mcc chow 4

MultimediaMultimediaMultimediaMultimediaadjective [before noun]adjective [before noun]using a combination of moving and still pictures, using a combination of moving and still pictures, sound, music and words, especially in computers or sound, music and words, especially in computers or entertainmententertainmentCambridge Advanced Learner's Cambridge Advanced Learner's DictionaryDictionary

““A shaky noun/adjective can be broadly defined as A shaky noun/adjective can be broadly defined as electronically augmented or generated object and electronically augmented or generated object and experience that appeared to the senses.” experience that appeared to the senses.” Steve Steve WeinsteinWeinstein

““Multi- is not necessary, media already plural, a Multi- is not necessary, media already plural, a combination of more than one medium.” combination of more than one medium.” Mrinal Mrinal MandalMandal

Smell, touch and other senses should be included, Smell, touch and other senses should be included, but they are harder to transmitted over Internet. but they are harder to transmitted over Internet.

Disney Animal Kingdom, Bug of life theater under Disney Animal Kingdom, Bug of life theater under the life of tree with media presentation including the life of tree with media presentation including touch and smelltouch and smell

adjective [before noun]adjective [before noun]using a combination of moving and still pictures, using a combination of moving and still pictures, sound, music and words, especially in computers or sound, music and words, especially in computers or entertainmententertainmentCambridge Advanced Learner's Cambridge Advanced Learner's DictionaryDictionary

““A shaky noun/adjective can be broadly defined as A shaky noun/adjective can be broadly defined as electronically augmented or generated object and electronically augmented or generated object and experience that appeared to the senses.” experience that appeared to the senses.” Steve Steve WeinsteinWeinstein

““Multi- is not necessary, media already plural, a Multi- is not necessary, media already plural, a combination of more than one medium.” combination of more than one medium.” Mrinal Mrinal MandalMandal

Smell, touch and other senses should be included, Smell, touch and other senses should be included, but they are harder to transmitted over Internet. but they are harder to transmitted over Internet.

Disney Animal Kingdom, Bug of life theater under Disney Animal Kingdom, Bug of life theater under the life of tree with media presentation including the life of tree with media presentation including touch and smelltouch and smell

mcc chow 5

Multimedia ApplicationsMultimedia ApplicationsMultimedia ApplicationsMultimedia Applications

Digital librariesDigital libraries

Distance LearningDistance LearningInteractive Voice Response (IVR) Interactive Voice Response (IVR) VoiceXMLVoiceXML

Interactive TVInteractive TV

Tele-medicineTele-medicine

GameGame

Sniper tracking? (Vanderbilt)Sniper tracking? (Vanderbilt)

……..

Digital librariesDigital libraries

Distance LearningDistance LearningInteractive Voice Response (IVR) Interactive Voice Response (IVR) VoiceXMLVoiceXML

Interactive TVInteractive TV

Tele-medicineTele-medicine

GameGame

Sniper tracking? (Vanderbilt)Sniper tracking? (Vanderbilt)

……..

mcc chow 6

Classification of MediaClassification of MediaClassification of MediaClassification of Media

Perception: five sensesPerception: five senses

Representation: such as various Representation: such as various formatformatPCM/MP3/WAV; GIF/JPEG/PNG; PCM/MP3/WAV; GIF/JPEG/PNG; MPEG/AVI/QuickTimeMPEG/AVI/QuickTime

Presentation: tools/devices for I/OPresentation: tools/devices for I/O

Storage: CD/DVD/Hard DriveStorage: CD/DVD/Hard Drive

Transmission: wireless/fiber/coaxial Transmission: wireless/fiber/coaxial cablecable

Discrete (time independent) vs.Discrete (time independent) vs.Continuous (time dependent)Continuous (time dependent)

Perception: five sensesPerception: five senses

Representation: such as various Representation: such as various formatformatPCM/MP3/WAV; GIF/JPEG/PNG; PCM/MP3/WAV; GIF/JPEG/PNG; MPEG/AVI/QuickTimeMPEG/AVI/QuickTime

Presentation: tools/devices for I/OPresentation: tools/devices for I/O

Storage: CD/DVD/Hard DriveStorage: CD/DVD/Hard Drive

Transmission: wireless/fiber/coaxial Transmission: wireless/fiber/coaxial cablecable

Discrete (time independent) vs.Discrete (time independent) vs.Continuous (time dependent)Continuous (time dependent)

mcc chow 7

Type of Type of Media/ApplicationsMedia/ApplicationsType of Type of Media/ApplicationsMedia/Applications

Adapted from Mirinal Mandal’s “Multimedia Signals and Adapted from Mirinal Mandal’s “Multimedia Signals and Systems”Systems”Adapted from Mirinal Mandal’s “Multimedia Signals and Adapted from Mirinal Mandal’s “Multimedia Signals and Systems”Systems”

mcc chow 8

DVD vs. CDDVD vs. CDDVD vs. CDDVD vs. CD

Adapted from Steve Weinstein’s “Multimedia Internet”Adapted from Steve Weinstein’s “Multimedia Internet”

mcc chow 9

Display StandardsDisplay StandardsDisplay StandardsDisplay Standards

mcc chow 10

Multimedia WorkstationsMultimedia Workstationsat Home and Officeat Home and OfficeMultimedia WorkstationsMultimedia Workstationsat Home and Officeat Home and Office

Adapted from Mirinal Mandal’s “Multimedia Signals and Adapted from Mirinal Mandal’s “Multimedia Signals and Systems”Systems”

mcc chow 11

Networked Media CenterNetworked Media CenterPersonal ComputerPersonal ComputerNetworked Media CenterNetworked Media CenterPersonal ComputerPersonal Computer

Adapted from Steve Weinstein’s “Multimedia Internet”Adapted from Steve Weinstein’s “Multimedia Internet”Adapted from Steve Weinstein’s “Multimedia Internet”Adapted from Steve Weinstein’s “Multimedia Internet”

mcc chow 12

Multimedia PCMultimedia PCNext GenerationNext GenerationMultimedia PCMultimedia PCNext GenerationNext Generation

Adapted from Steve Weinstein’s “Multimedia Internet”Adapted from Steve Weinstein’s “Multimedia Internet”

mcc chow 13

Multimedia Multimedia CommunicationsCommunicationsMultimedia Multimedia CommunicationsCommunications

InternetPSTN

CableHeadEnd

ISP

ISP

DSLFiber

DSL

ISP

MPC

MCU

Office

Home

Wifi hot spot

Cable/Broadcast

Media

Cell PhonesTowers

Web/Streaming

server

MPC: Multimedia PCMCU: Multipoint Control UnitISP: Internet Service ProviderDSL: Digital Subscriber Loop

PSTN: Public Switched Telephone Network

mcc chow 14

Multimedia ExchangeMultimedia ExchangeMultimedia ExchangeMultimedia Exchange

P2P modelP2P model

Adapted from Steve Weinstein’s “Multimedia Adapted from Steve Weinstein’s “Multimedia Internet”Internet”

mcc chow 15

Milestones of MultimediaMilestones of MultimediaMilestones of MultimediaMilestones of Multimedia

Directx 9/10Directx 9/10

IE6 IE6 Podcasting

VOIP VOIP MPEG7/21MPEG7/21

RSS

IVR/VoiceXML/VoiceXML10GEthernet10GEthernetWLAN WLAN

802/11.abgn802/11.abgnWiManWiMan

801.15 PAN801.15 PANDVD double layer DVD double layer iPODiPOD

USB Flash Drive USB Flash Drive Xbox360Xbox360

02 04 06

mcc chow 16

Related CS and EE FieldsRelated CS and EE FieldsRelated CS and EE FieldsRelated CS and EE Fields

Computer Graphics/Virtual RealityComputer Graphics/Virtual Reality

Human Computer InterfaceHuman Computer Interface

Network/Protocol DesignNetwork/Protocol Design

OS/Real Time OS/Real Time Programming/SchedulingProgramming/Scheduling

Object Oriented ProgrammingObject Oriented Programming

Information Storage and RetrievalInformation Storage and Retrieval

Computer Architecture/IO SystemsComputer Architecture/IO Systems

Signal ProcessingSignal Processing

Computer Graphics/Virtual RealityComputer Graphics/Virtual Reality

Human Computer InterfaceHuman Computer Interface

Network/Protocol DesignNetwork/Protocol Design

OS/Real Time OS/Real Time Programming/SchedulingProgramming/Scheduling

Object Oriented ProgrammingObject Oriented Programming

Information Storage and RetrievalInformation Storage and Retrieval

Computer Architecture/IO SystemsComputer Architecture/IO Systems

Signal ProcessingSignal Processing

mcc chow 17

Semester ProjectsSemester ProjectsSemester ProjectsSemester Projects

Sniper Tracking System (wireless Sniper Tracking System (wireless sensor?/WLAN with microphone/high sensor?/WLAN with microphone/high resolution camera)resolution camera)

Decoding Human Body Movement Decoding Human Body Movement ProjectProject

Secure Podcasting SystemSecure Podcasting System

IVR over VOIP/telephone IVR over VOIP/telephone

Multimedia Conference System (Intel Multimedia Conference System (Intel HMP or open source/JMF)HMP or open source/JMF)

Interactive Networked Multimedia Interactive Networked Multimedia GameGame

Sniper Tracking System (wireless Sniper Tracking System (wireless sensor?/WLAN with microphone/high sensor?/WLAN with microphone/high resolution camera)resolution camera)

Decoding Human Body Movement Decoding Human Body Movement ProjectProject

Secure Podcasting SystemSecure Podcasting System

IVR over VOIP/telephone IVR over VOIP/telephone

Multimedia Conference System (Intel Multimedia Conference System (Intel HMP or open source/JMF)HMP or open source/JMF)

Interactive Networked Multimedia Interactive Networked Multimedia GameGame

mcc chow 18

UCCS Multimedia UCCS Multimedia Computing ResourcesComputing ResourcesUCCS Multimedia UCCS Multimedia Computing ResourcesComputing Resources

Multimedia Lab in El Pomar libraryMultimedia Lab in El Pomar library

Both Windows and Apple PCBoth Windows and Apple PC

Scanner, Digital TapeScanner, Digital Tape

Adobe/Macromedia software, Apple iMove..Adobe/Macromedia software, Apple iMove..

DVD Writer (Sign up/reserve your disk space for DVD Writer (Sign up/reserve your disk space for overnight video rendering)overnight video rendering)

Check out digital camera/camcorder/tripod from Check out digital camera/camcorder/tripod from Help Desk in El Pomar Help Desk in El Pomar

EN233 Lab (MathLab7.1)EN233 Lab (MathLab7.1)

EN149 Lab (VPC/VMware Virtual machines)EN149 Lab (VPC/VMware Virtual machines)

EN143 Lab MPC/Server that requires root privilegeEN143 Lab MPC/Server that requires root privilege

Bring your own headset/microphoneBring your own headset/microphone

Multimedia Lab in El Pomar libraryMultimedia Lab in El Pomar library

Both Windows and Apple PCBoth Windows and Apple PC

Scanner, Digital TapeScanner, Digital Tape

Adobe/Macromedia software, Apple iMove..Adobe/Macromedia software, Apple iMove..

DVD Writer (Sign up/reserve your disk space for DVD Writer (Sign up/reserve your disk space for overnight video rendering)overnight video rendering)

Check out digital camera/camcorder/tripod from Check out digital camera/camcorder/tripod from Help Desk in El Pomar Help Desk in El Pomar

EN233 Lab (MathLab7.1)EN233 Lab (MathLab7.1)

EN149 Lab (VPC/VMware Virtual machines)EN149 Lab (VPC/VMware Virtual machines)

EN143 Lab MPC/Server that requires root privilegeEN143 Lab MPC/Server that requires root privilege

Bring your own headset/microphoneBring your own headset/microphone

mcc chow 19

EL Pomar 238 Multimedia EL Pomar 238 Multimedia Development Lab Development Lab EL Pomar 238 Multimedia EL Pomar 238 Multimedia Development Lab Development Lab

9 Multmedia PC. 3.6GHz, 1.5GB. D: Drive for temporary 9 Multmedia PC. 3.6GHz, 1.5GB. D: Drive for temporary storage space. WinXP storage space. WinXP

HP Scanjet 4070 Photosmart scanner. HP Scanjet 4070 Photosmart scanner. JVC SR-VS30U DV/VHS Tape Recorder/Player JVC SR-VS30U DV/VHS Tape Recorder/Player Multimedia Software Packages: Multimedia Software Packages: Adobe: Audition 1.5, Premiere1.5, Encore CS, Illustrator CS, Adobe: Audition 1.5, Premiere1.5, Encore CS, Illustrator CS, PhotoShop CS, InDesign CS, Designer 7.0, Encore DVD 1.5, PhotoShop CS, InDesign CS, Designer 7.0, Encore DVD 1.5, GoLive CS, ImageReady CS, Acrobat 7.0 Professional, After GoLive CS, ImageReady CS, Acrobat 7.0 Professional, After Effects 6.5. Effects 6.5. Macromedia: Dreamweaver, Flash MX 2004, Freehand MXa, Macromedia: Dreamweaver, Flash MX 2004, Freehand MXa, Firework MX2004. Firework MX2004. S: mapped to S: mapped to \\excelsior\\excelsior Z: mapped to Z: mapped to \\enterprise\users\faculty\\enterprise\users\faculty

4 Apple Dual 2 GHz PowerPC G5 1GBDDR SDRAM MacOS 4 Apple Dual 2 GHz PowerPC G5 1GBDDR SDRAM MacOS Adobe: Illustrator CS, PhotoShop CS, InDesign CS, Designer Adobe: Illustrator CS, PhotoShop CS, InDesign CS, Designer 7.0, GoLive CS, Acrobat 6.0 Professional, After Effects 6.0 7.0, GoLive CS, Acrobat 6.0 Professional, After Effects 6.0 iTune(with podcast) iDVD, iMovie, iPhoto iTune(with podcast) iDVD, iMovie, iPhoto Macromedia: Dreamweaver, Flash MX 2004, Freehand MXa, Macromedia: Dreamweaver, Flash MX 2004, Freehand MXa, Firework MX2004. Firework MX2004.

9 Multmedia PC. 3.6GHz, 1.5GB. D: Drive for temporary 9 Multmedia PC. 3.6GHz, 1.5GB. D: Drive for temporary storage space. WinXP storage space. WinXP

HP Scanjet 4070 Photosmart scanner. HP Scanjet 4070 Photosmart scanner. JVC SR-VS30U DV/VHS Tape Recorder/Player JVC SR-VS30U DV/VHS Tape Recorder/Player Multimedia Software Packages: Multimedia Software Packages: Adobe: Audition 1.5, Premiere1.5, Encore CS, Illustrator CS, Adobe: Audition 1.5, Premiere1.5, Encore CS, Illustrator CS, PhotoShop CS, InDesign CS, Designer 7.0, Encore DVD 1.5, PhotoShop CS, InDesign CS, Designer 7.0, Encore DVD 1.5, GoLive CS, ImageReady CS, Acrobat 7.0 Professional, After GoLive CS, ImageReady CS, Acrobat 7.0 Professional, After Effects 6.5. Effects 6.5. Macromedia: Dreamweaver, Flash MX 2004, Freehand MXa, Macromedia: Dreamweaver, Flash MX 2004, Freehand MXa, Firework MX2004. Firework MX2004. S: mapped to S: mapped to \\excelsior\\excelsior Z: mapped to Z: mapped to \\enterprise\users\faculty\\enterprise\users\faculty

4 Apple Dual 2 GHz PowerPC G5 1GBDDR SDRAM MacOS 4 Apple Dual 2 GHz PowerPC G5 1GBDDR SDRAM MacOS Adobe: Illustrator CS, PhotoShop CS, InDesign CS, Designer Adobe: Illustrator CS, PhotoShop CS, InDesign CS, Designer 7.0, GoLive CS, Acrobat 6.0 Professional, After Effects 6.0 7.0, GoLive CS, Acrobat 6.0 Professional, After Effects 6.0 iTune(with podcast) iDVD, iMovie, iPhoto iTune(with podcast) iDVD, iMovie, iPhoto Macromedia: Dreamweaver, Flash MX 2004, Freehand MXa, Macromedia: Dreamweaver, Flash MX 2004, Freehand MXa, Firework MX2004. Firework MX2004.

mcc chow 20

EN233 LabEN233 LabEN233 LabEN233 Lab40 Pentium 4 PC 3.4Ghz, 1GB, sound card.40 Pentium 4 PC 3.4Ghz, 1GB, sound card.

Contain MATLAB 7.0.4 version which we will use for some of Contain MATLAB 7.0.4 version which we will use for some of our audio/video exercises.our audio/video exercises.Find in “my computer” the network drive that maps to your Find in “my computer” the network drive that maps to your ufp directory under \\excelsior\Students. Normally it is ufp directory under \\excelsior\Students. Normally it is mapped to z drive. Create a cs525 directory that network mapped to z drive. Create a cs525 directory that network drive and save your work in z:\cs525. This allows you to drive and save your work in z:\cs525. This allows you to login any computer to retrieve the files saved there.login any computer to retrieve the files saved there.If you can not find the ufp directory mapped as a network If you can not find the ufp directory mapped as a network drive in the local machine. You can use c:\temp for your drive in the local machine. You can use c:\temp for your work but transfer to ufp or CS Unix machines for storage.work but transfer to ufp or CS Unix machines for storage.Create a directory with your login in c:\temp directory andCreate a directory with your login in c:\temp directory andUse c:\temp\<login> it to save your work.Use c:\temp\<login> it to save your work.Note that the content in c:\temp will be clean up periodically Note that the content in c:\temp will be clean up periodically by the system admin’s scheduled task. It may not be there by the system admin’s scheduled task. It may not be there next moring.next moring.The front panel of the PC has green plug for audio playback.The front panel of the PC has green plug for audio playback.The back panel of the PC has red plug for audio recording The back panel of the PC has red plug for audio recording and green plug for audio playback.and green plug for audio playback.

40 Pentium 4 PC 3.4Ghz, 1GB, sound card.40 Pentium 4 PC 3.4Ghz, 1GB, sound card.Contain MATLAB 7.0.4 version which we will use for some of Contain MATLAB 7.0.4 version which we will use for some of our audio/video exercises.our audio/video exercises.Find in “my computer” the network drive that maps to your Find in “my computer” the network drive that maps to your ufp directory under \\excelsior\Students. Normally it is ufp directory under \\excelsior\Students. Normally it is mapped to z drive. Create a cs525 directory that network mapped to z drive. Create a cs525 directory that network drive and save your work in z:\cs525. This allows you to drive and save your work in z:\cs525. This allows you to login any computer to retrieve the files saved there.login any computer to retrieve the files saved there.If you can not find the ufp directory mapped as a network If you can not find the ufp directory mapped as a network drive in the local machine. You can use c:\temp for your drive in the local machine. You can use c:\temp for your work but transfer to ufp or CS Unix machines for storage.work but transfer to ufp or CS Unix machines for storage.Create a directory with your login in c:\temp directory andCreate a directory with your login in c:\temp directory andUse c:\temp\<login> it to save your work.Use c:\temp\<login> it to save your work.Note that the content in c:\temp will be clean up periodically Note that the content in c:\temp will be clean up periodically by the system admin’s scheduled task. It may not be there by the system admin’s scheduled task. It may not be there next moring.next moring.The front panel of the PC has green plug for audio playback.The front panel of the PC has green plug for audio playback.The back panel of the PC has red plug for audio recording The back panel of the PC has red plug for audio recording and green plug for audio playback.and green plug for audio playback.