VSO Integration with netDRMS Joseph A. Hourclé and the VSO Team HMI : 2009 Sept 08

Embed Size (px)

Citation preview

  • Slide 1

VSO Integration with netDRMS Joseph A. Hourcl and the VSO Team HMI : 2009 Sept 08 Slide 2 For those unfamiliar with my slides Turn on a view where you can see the notes. I put talking points / citation details / etc in there. Slide 3 The VSO Now Standardized API Allow searching & retrieval of data from: Allow searching & retrieval of data from: SOHO, Hinode, TRACE, STEREO, SOLIS, GONG, TON, H net, Nanay, Big Bear, Mt. Wilson, Mauna Loa, etc. SOHO, Hinode, TRACE, STEREO, SOLIS, GONG, TON, H net, Nanay, Big Bear, Mt. Wilson, Mauna Loa, etc. Same interface for all data Same interface for all data Allows multiple clients to use VSO Allows multiple clients to use VSO Web interface; IDL; Helioviewer; HEK; Helio Web interface; IDL; Helioviewer; HEK; Helio Slide 4 The VSOs role Making data available to the solar physics community Funded via NASAs Solar Data Analysis Center Funded via NASAs Solar Data Analysis Center Can be more responsive to the needs of the solar physics community Can be more responsive to the needs of the solar physics community If you want something ask us! If you want something ask us! NASA/GSFC : Joe Gurman, Joe Hourcl NASA/GSFC : Joe Gurman, Joe Hourcl NSO : Frank Hill, Igor Surez-Sol NSO : Frank Hill, Igor Surez-Sol SAO : Piet Martens, Alisdair Davey SAO : Piet Martens, Alisdair Davey Stanford : Rick Bogart, Jennifer Spencer Stanford : Rick Bogart, Jennifer Spencer Slide 5 VSO IDL usage Slide 6 Slide 7 Slide 8 Slide 9 Slide 10 Slide 11 Slide 12 Slide 13 Slide 14 Slide 15 IDL usage : warning vso_get can only retrieve direct URLs Cannot handle staged, offline or push Cannot handle staged, offline or push Cant currently use for data from SHA Cant currently use for data from SHA Until we finish the netDRMS integration to pull MDI data via netDRMS Until we finish the netDRMS integration to pull MDI data via netDRMS sample keyword is not support by all data providers Slide 16 The VSO Now Slide 17 Integration with netDRMS Dealing with the flood of SDO data: Getting the data to the users Getting the data to the users VSO caching nodes will store SDO data netDRMS / remote SUMS sites netDRMS / remote SUMS sites Try to reduce the load on Stanford: Try to reduce the load on Stanford: Pre-fetching data Pre-fetching data Caching the data in high-demand Caching the data in high-demand Distributing high-demand data across multiple sites Distributing high-demand data across multiple sites Slide 18 Example SDO request Slide 19 VSO pre-fetching Slide 20 New Tools vget Parallel downloading tool Parallel downloading tool Input file can also be passed to curl or wget Input file can also be passed to curl or wget Slide 21 http://virtualsolar.org/ [email protected] Slide 22