Upload
melanie-susan-sullivan
View
216
Download
3
Tags:
Embed Size (px)
Citation preview
03/28/96 1
System Design of the System Design of the Kennedy Space Center Kennedy Space Center
Toplevel World Wide Web Toplevel World Wide Web (WWW) Server(WWW) Server
This talk covers the underlying system design and This talk covers the underlying system design and technical aspects of KSC Top Level WWW server, technical aspects of KSC Top Level WWW server,
including hardware and software systems and including hardware and software systems and interfaces to external sources of information.interfaces to external sources of information.
Jim Dumoulin - NASA Payload OperationsJim Dumoulin - NASA Payload Operations
Internet Systems Lab - Kennedy Space CenterInternet Systems Lab - Kennedy Space Center
03/28/96 2
KSC’s WWW Toplevel KSC’s WWW Toplevel ServerServer DEC Alpha 2100/5000 ServersDEC Alpha 2100/5000 Servers
– Multiple DEC Alpha ProcessorsMultiple DEC Alpha Processors– 640Mbytes of RAM, 24Gbytes Disk (RAID 5 640Mbytes of RAM, 24Gbytes Disk (RAID 5
and RAID 1) on main Public server - and RAID 1) on main Public server - 160Gbytes total on cluster160Gbytes total on cluster
– Redundant hot-swappable power suppliesRedundant hot-swappable power supplies– Multiple Networks (1FDDI, 3 Ethernets)Multiple Networks (1FDDI, 3 Ethernets)– Workload spread across 13 other systemsWorkload spread across 13 other systems
Digital OSF/1 Unix, Apache HTTPDDigital OSF/1 Unix, Apache HTTPD
03/28/96 3
KSC’s server on Launch KSC’s server on Launch DayDay Saturates E-1 and Saturates E-1 and
Fractional T-3 Fractional T-3 Circuits into KSCCircuits into KSC
1.8 Million hits 1.8 Million hits within a few hours within a few hours around launch time.around launch time.
CPU capacity not the CPU capacity not the problem but network problem but network congestion requires congestion requires constant tweaking to constant tweaking to handle load.handle load.
WWW.KSC.NASA.GOVWWW.KSC.NASA.GOV
Cluster of 4 multi-processor Dec Alpha Servers ona 100Mb/s FDDI ring. Current Disk Capacity 160Gbytes
4
03/28/96 5
NOMAD01
Internet Lab System Internet Lab System HardwareHardware
TITAN01VMS 7.1128MB RAM(User Accounts)
16G Raid 5
TITAN03OSF/1 4.2128MB RAM(News/WAIS)
22G Raid 5
TITAN02OSF/1 4.2512MB RAM(User Accounts)
9-Track Tape
Exabyte 1204 Drive TapeJukebox System115 8mmTapes1 Robot
ZENO OSF/1 4.2WWW Hot Mirror
Parallel Search & ListServ Engine 14 DEC5000’s
FDDI ConcentratorCISCO 7000
NIVEN OSF/1 2.0News/Listserv
18G Raid 5
TITAN04OSF/1 4.2640MB RAM(WWW/FTP)
24G Raid 50 1 2 3
WWW Page creationWWW Page creation
70,000+ HTML pages on Server - most 70,000+ HTML pages on Server - most produced and hypertexed produced and hypertexed automatically thru a series of PERL automatically thru a series of PERL scriptsscripts
Interfaces to external systems for Interfaces to external systems for dynamic content thru Common dynamic content thru Common Gateway Interface (CGI) ScriptsGateway Interface (CGI) Scripts
Daily content and automatic backups Daily content and automatic backups done thru Unix Crontabsdone thru Unix Crontabs
03/28/96 7
Automatic HypertexingAutomatic Hypertexing
Treat HTML as a binary LanguageTreat HTML as a binary Language Keep original material in text filesKeep original material in text files Run all text thru Hypertext Perl Run all text thru Hypertext Perl
ProgramProgram Program searches for Regular Program searches for Regular
expressions in context and replaces expressions in context and replaces with Hypertexed URL’s from with Hypertexed URL’s from dictionarydictionary
03/28/96 8
Regular Expression Regular Expression ExampleExample The Regular Expression:The Regular Expression:
– ([\s,\.\(\)])([\s,\.\(\)])– (T-[minus ]*([\d]+)[hour]*[s]*[and (T-[minus ]*([\d]+)[hour]*[s]*[and
counting]*)counting]*)– ([\s,\.\(\)])([\s,\.\(\)])
Matches:Matches:– (T-minus 1 hour), T-1 hour, T-10 hours,(T-minus 1 hour), T-1 hour, T-10 hours,– T-43 hours and countingT-43 hours and counting
03/28/96 9
WWW Page.html
Flow of Hypertext ProgramFlow of Hypertext Program
Status Archive .txt files
WWW Disk Farm Information Archive (HTTP/FTP/Gopher/NFS/Samba)
RE to URL
WAIS - Full Text Index
Listserv
E-Mail USENETINN Overchan
mailtonews.py
.txt
.html
to archive
03/28/96 10
Image CreationImage Creation
Input is a Captions Text file and a series Input is a Captions Text file and a series of High Resolution Photos (digitally of High Resolution Photos (digitally transferred or manually scanned)transferred or manually scanned)
Output products:Output products:– Contact Sheet Page and Clickable MapContact Sheet Page and Clickable Map– Photo Index HTML PagePhoto Index HTML Page– Image converted and stored in multiple Image converted and stored in multiple
formats (Tiny, Low, Medium, High)formats (Tiny, Low, Medium, High)– Captions Hypertext FileCaptions Hypertext File
03/28/9611
Flow of Image CreationFlow of Image Creation
Contact SheetPhoto IndexCaptions
Tiny Low Med High
PhotoID (L,M,H) title
Tiny
Titan04 Titan02
NTPhoto Lab NT
Scanner Scanner
WritersGroup
Titan03
STS #
Image Converter High
build_contact.pl
samba
build_captions.pl
captions.txt
E-mail and List Server
scsi
build_images.pl NFS
PBM toolkit
PhotoID (L,M,H) title
Digital
03/28/96 12
Movie/Video Capture Movie/Video Capture ProcessProcess Input comes from NASA TV, VCRs, RF-System or via Input comes from NASA TV, VCRs, RF-System or via
one of over 900 Cameras on KSC’s OTV System.one of over 900 Cameras on KSC’s OTV System. Have multi-input video capture cards in PC’s Have multi-input video capture cards in PC’s
(Creative Labs RT-300, SE-100, RealMajic Encoder)(Creative Labs RT-300, SE-100, RealMajic Encoder) Process is pipelined thru multiple CPU’s and stagesProcess is pipelined thru multiple CPU’s and stages
– RT-300 or SE-100 saves BMP or AVI file via SambaRT-300 or SE-100 saves BMP or AVI file via Samba– PBMtoolkit converts .BMP or .AVI to .GIF or JPEG. PBMtoolkit converts .BMP or .AVI to .GIF or JPEG. – AVI files are edited as small as possible.AVI files are edited as small as possible.– If MPEG is needed, AVI is riped into individual If MPEG is needed, AVI is riped into individual
Targa frames then Encoded into an MPEGTarga frames then Encoded into an MPEG
03/28/96 13
Movie Movie CreationCreation
1 2 3 4
RT-300
486PCs
SE-100
486PCs
Grass Valley Video Switch
OTVNASA Select
VCR
Titan02
Titan04 / WWW.KSC.NASA.GOVConvert BMP to GIF BMP to JPGAVI to TARGA AVIRIP
Pentium PentiumPC
RealMagicMPEG Encoderwith Sound
Samba
AVIto MPEGEditor(Adobe)
TranscodeEncode
SE-100 VideoGrabber
Dual Pentium
CMPEG
Live VideoPages
MPEG Movies
Samba
Samba
Samba
NFS viaFDDI
1 2 31 2 3
Video Capture DevicesVideo Capture Devices Creative Labs RT-300 -Creative Labs RT-300 -
– PC ISA Card, no longer in productionPC ISA Card, no longer in production– 4 Video Inputs (3 RCA/1 S-VIDEO)4 Video Inputs (3 RCA/1 S-VIDEO)
Creative Labs SE-100 -Creative Labs SE-100 -– PC ISA Card, Better quality than RT-300PC ISA Card, Better quality than RT-300– 3 Video Inputs (2 RCA/1 S-video)3 Video Inputs (2 RCA/1 S-video)
Sigma Designs Real Magic ProducerSigma Designs Real Magic Producer– Direct MPEG production but cannot Direct MPEG production but cannot
produce MPEGS at slow frame ratesproduce MPEGS at slow frame rates– ExpensiveExpensive
03/28/96 15
SummarySummary
The KSC Home Server The KSC Home Server – uses Regular Expressions to help uses Regular Expressions to help
maintainabilitymaintainability– uses RAID to help Availabilityuses RAID to help Availability– offloads processing to handle offloads processing to handle
exponential growthexponential growth– doesn’t worry about marketing since doesn’t worry about marketing since
NASA data belongs to the tax payersNASA data belongs to the tax payers