“Cyberinfrastructure to Support Ocean Observatories"
Invited Talk to the
Oceans Studies Board
National Research Council
UCSD, La Jolla, CA
March 18, 2005
Dr. Larry Smarr
Director, California Institute for Telecommunications and Information Technology
Harry E. Gruber Professor,
Dept. of Computer Science and Engineering
Jacobs School of Engineering, UCSD
Chair, NASA Earth System Science and Applications Advisory Committee
EOSDIS Archive Holdings Are Adding Several TBs/Dayto Federated Data Repositories
0
1,000
2,000
3,000
4,000
5,000
6,000
7,000
8,00020
01
2002
2003
2004
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
Calendar Year
Cu
mu
lati
ve T
era
Byt
es
Other EOSHIRDLSMLSTESOMIAMSR-EAIRS-isGMAOMOPITTASTERMISRV0 HoldingsMODIS-TMODIS-A
Other EOS =• ACRIMSAT• Meteor 3M• Midori II• ICESat• SORCE
file name: archive holdings_122204.xlstab: all instr bar
Terra EOMDec 2005
Aqua EOMMay 2008
Aura EOMJul 2010
NOTE: Data remains in the archive pending transition to LTA
Source: Glenn Iona, EOSDIS Element Evolution Technical Working Group January 6-7, 2005
Challenge: Average Throughput of NASA Data Products to End User is Only < 50 Megabits/s
Tested from GSFC-ICESATJanuary 2005
http://ensight.eos.nasa.gov/Missions/icesat/index.shtml
Forces a Non-Interactive Data
Architecture
Cyberinfrastructure Breakthrough—NLR ProvidesDedicated Optical Paths Between User and Data
First LightSeptember 2004
“National LambdaRail” PartnershipServes Very High-End Experimental and Research Applications
4 x 10Gb Wavelengths Initially Capable of 40 x 10Gb wavelengths at Buildout
Links Two Dozen
State and Regional Optical
Networks
DOE and NASAUsing NLR
US IRNC (black)–20Gb NYC—Amsterdam–10Gb LA—TokyoGEANT/I2 (orange) –30Gb London, etc.—NYCUK to US (red)–10Gb London—ChicagoSURFnet to US (light blue)–10Gb Amsterdam—NYC–10Gb Amsterdam—ChicagoCanadian CA*net4 to US (white)–30Gb Chicago-Canada-NYC–30Gb Chicago-Canada-SeattleJapan JGN II to US (grey)–10Gb Chicago—TokyoEuropean (not GEANT) (yellow)–10Gb Amsterdam—CERN –10Gb Prague—Amsterdam–2.5Gb Stockholm—Amsterdam–10Gb London—AmsterdamIEEAF lambdas (dark blue)–10Gb NYC—Amsterdam–10Gb Seattle—Tokyo CAVEwave/PacificWave (purple)–10Gb Chicago—Seattle—SD–10Gb Seattle—LA—SD
Northern Light
UKLight
PNWGP
Japan
Manhattan Landing
CERN
Optical Circuits to the Pacific Rim and EuropeAlready Exist and Link to U.S.
The OptIPuter Project – Creating a LambdaGrid “Web” for Gigabyte Data Objects
• NSF Large Information Technology Research Proposal– Calit2 (UCSD, UCI) and UIC Lead Campuses—Larry Smarr PI– Partnering Campuses: USC, SDSU, NW, TA&M, UvA, SARA, NASA
• Industrial Partners– IBM, Sun, Telcordia, Chiaro, Calient, Glimmerglass, Lucent
• $13.5 Million Over Five Years• Linking Global Scale Science Projects to User’s Linux ClustersNIH Biomedical Informatics NSF EarthScope
and ORION
http://ncmir.ucsd.edu/gallery.html
siovizcenter.ucsd.edu/library/gallery/shoot1/index.shtml
Research Network
Earth and Planetary Sciences are an OptIPuter Large Data Object Visualization Driver
EVL Varrier Autostereo 3D Image USGS 30 MPixel Portable Tiled Display
SIO HIVE 3 MPixel Panoram
Schwehr. K., C. Nishimura, C.L. Johnson, D. Kilb, and A. Nayak, "Visualization Tools Facilitate Geological Investigations of Mars Exploration Rover Landing Sites",
IS&T/SPIE Electronic Imaging Proceedings, in press, 2005
Enabling Scientists to Analyze Large Data Objects:UCSD Campus LambdaStore Architecture
SIO Ocean SupercomputerIBM Storage Cluster
Extreme Switch with 2 Ten Gbps Uplinks
Streaming Microscope
Source: Phil Papadopoulos, SDSC, Calit2
UCSD
StarLight Chicago
UIC EVL
NU
CENIC San Diego GigaPOP
CalREN-XD
8
8
Expanding the OptIPuter LambdaGridProviding 1-10 Gbps Bandwidth
NetherLight Amsterdam
U Amsterdam
NASA Ames
NASA GoddardNLRNLR
2
SDSU
CICESE
via CUDI
CENIC/Abilene Shared Network
1 GE Lambda
10 GE Lambda
PNWGP Seattle
CAVEwave/NLR
NASA JPL
ISI
UCI
CENIC Los Angeles
GigaPOP
22
Interactive Retrieval and Hyperwall Display of Earth Sciences Images Using NLR
Earth science data sets created by GSFC's Scientific Visualization Studio were retrieved across the NLR in real time from OptIPuter servers in Chicago and San Diego and from GSFC servers in McLean, VA, and displayed
at the SC2004 in Pittsburgh
Enables Scientists To Perform Coordinated Studies Of
Multiple Remote-Sensing Datasets
http://esdcd.gsfc.nasa.gov/LNetphoto3.html
Source: Milt Halem & Randall Jones, NASA GSFC& Maxine Brown, UIC EVL
Eric Sokolowsky
Calit2 is Partnering with the New SIOCenter for Earth Observations and Applications
• Viewing and Analyzing Earth Satellite Data Sets• High Accuracy Topographic Measurements• Project Atmospheric Brown Clouds• Climate Modeling • Coastal Zone Data Assimilation• Ocean Observatories
NSF’s Ocean Observatories Initiative (OOI)Envisions Global, Regional, and Coastal Scales
LEO15 Inset Courtesy of Rutgers University, Institute of Marine and Coastal Sciences
A Broad Collaboratory to Prototype a Future Cyberinfrastructure of Interactive Ocean Observatories
• LOOKING NSF ITR with PIs:– John Orcutt & Larry Smarr – UCSD
– Scripps Institution of Oceanography– California Institute of Telecommunications and Information Technology
– John Delaney & Ed Lazowska –UW– Neptune Project– Department of Computer Science
– Mark Abbott – OSU• Collaborators at:
– Southern California Coastal Ocean Observing System– Monterey Bay Aquarium Research Institute (MBARI) – Woods Hole Oceanographic Institute (WHOI) – CalPoly, San Luis Obispo– University of Victoria, CANARIE, NEPTUNE-Canada – Centro de Investigacion Cientifica y de Educacion Superior de Ensenada– National Center for Supercomputing Applications (NCSA)– University of Illinois @ Chicago (UIC)– Microsoft
Coupling Regional and Coastal Ocean Observatories Using OptIPuter and Web/Grid Services
LOOKING: (Laboratory
for the Ocean Observatory Knowledge Integration
Grid)
www.neptune.washington.edu www.mbari.org/mars/
www.sccoos.org/
Looking High Level System Architecture
LOOKING Service Architecture
Pilot Project ComponentsPilot Project Components
LOOKING Builds on the Multi- Institutional SCCOOS Program, OptIPuter, and CENIC-XD
• SCCOOS is Integrating:– Moorings– Ships– Autonomous Vehicles – Satellite Remote Sensing– Drifters– Long Range HF Radar – Near-Shore
Waves/Currents (CDIP)– COAMPS Wind Model– Nested ROMS Models– Data Assimilation and
Modeling– Data Systems
www.sccoos.org/
www.cocmp.org
Yellow—Initial LOOKING OptIPuter Backbone Over CENIC-XD
Use OptIPuter to Couple Data Assimilation Models to Remote Data Sources and Analysis in Near Real Time
Regional Ocean Modeling System (ROMS) http://ourocean.jpl.nasa.gov/
Goal is Real Time Local Digital Ocean Models
Long Range HF Radar
Similar Work on SoCal Coast at SIO
MARS Cable Observatory Testbed – LOOKING Living Laboratory
Tele-Operated Crawlers
Central Lander
MARS Installation Oct 2005 -Jan 2006
Source: Jim
Bellingham, MBARI OptIPuter
Goal – From Expedition to Cable Observatories with Streaming Stereo HDTV Robotic Cameras
Scenes from The Aliens of the Deep, Directed by James Cameron &
Steven Quale
http://disney.go.com/disneypictures/aliensofthedeep/alienseduguide.pdf
Proposed Experiment for iGrid 2005 –Remote Interactive HD Imaging of Deep Sea Vent
Source John Delaney & Deborah Kelley, UWash