21
STDCS: A Spatio- Temporal Data-Centric Storage Scheme For Real- Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration with Anandha Gopalan (University of Pittsburgh, Imperial College) and Jerry Zhao, Adel Youssef (Google, Inc.)

STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration

Embed Size (px)

Citation preview

Page 1: STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration

STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications

Mohamed Aly(University of Pittsburgh & Yahoo, Inc.)

In collaboration with Anandha Gopalan

(University of Pittsburgh, Imperial College) and

Jerry Zhao, Adel Youssef(Google, Inc.)

Page 2: STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration

STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications 2 Mohamed Aly

Motivation: Real-Time Geo-Centric Sensor Network Applications

Globally deployed sensor around the globe. Clusters of sensors forming networks. Mobile users roaming across the networks. Real-time geo-centric ad-hoc queries issued from within

or nearby the queried area. The sensor network is responsible of answering these

queries directly from the sensors rather than from base stations.

Examples: Bronx Zoo cluster. Disaster management cluster.

Page 3: STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration

STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications 3 Mohamed Aly

Motivation: Real-Time Geo-Centric Sensor Network Applications

Page 4: STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration

STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications 4 Mohamed Aly

Data Storage Options in Sensor Networks

Base Station Storage: Events are sent to base stations where queries are

issued and evaluated. Best suited for continuous queries.

In-Network Storage (INS): Events are stored in the sensor nodes. Best suited for ad-hoc queries. All previous INS schemes were Data-Centric Storage

(DCS) schemes.

Page 5: STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration

STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications 5 Mohamed Aly

In-Network Data-Centric Storage (DCS)

Mainly to answer range queries. Quality of Data (QoD) of ad-hoc queries. Assign a value-range of readings for each sensor. Examples:

Distributed Hash Tables (DHT) [Shenker et. al., HotNets’02]

Geographic Hash Tables (GHT) [Ratnasamy et. al., WSNA’02]

Distributed Index for Multi-dimensional data (DIM)[Li et. al., SenSys’03, Aly et. al., DMSN’05, MOBIQUITOUS’06]

K-D Tree based Data-Centric Storage (KDDCS) [Aly et. al., CIKM’06]

Page 6: STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration

STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications 6 Mohamed Aly

STDCS Overview

Motivation: No previous INS schemes adopting geo-centric storage. Expected techniques may be:

Local storage. Spatial storage

Design Goal: Load-Balancing of storage load among sensors

Differences from previous schemes: Temporally evolving spatial indexing scheme to balance

query load among sensors. Dynamic query hotspot detection and decomposition.

Page 7: STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration

STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications 7 Mohamed Aly

Roadmap

Motivation: Real-Time Geo-Centric applications. Background: Data-Centric Storage (DCS). Problem Statement: Real-Time Geo-Centric Storage. Scheme Overview: STDCS. STDCS Components

Local Virtual address assignment Spatio-Temporal data indexing. Point-to-point data delivery. Query processing. Adaptive hotspot decomposition.

Experimental Results Conclusions

Page 8: STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration

STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications 8 Mohamed Aly

STDCS Components: Local Virtual Address Assignment

Page 9: STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration

STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications 9 Mohamed Aly

STDCS Components: Spatio-Temporal Data Indexing

Page 10: STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration

STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications 10 Mohamed Aly

STDCS Components: Reading Delivery and Querying

Page 11: STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration

STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications 11 Mohamed Aly

STDCS Components: Adaptive Hotspot Decomposition

Motivation: Dynamic query hotspots as time progresses.

Observation: Recurrent querying scenarios across the day, the week,

etc. Technique:

Continuously keeping track of hotspots using the Average Querying Frequency (AQF) metric.

Dynamically chaning the switching time to decompose hotspots.

Page 12: STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration

STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications 12 Mohamed Aly

Roadmap

Motivation: Real-Time Geo-Centric applications. Background: Data-Centric Storage (DCS). Problem Statement: Real-Time Geo-Centric Storage. Scheme Overview: STDCS. STDCS Components

Local Virtual address assignment Spatio-Temporal data indexing. Point-to-point data delivery. Query processing. Adaptive hotspot decomposition.

Experimental Results Conclusions

Page 13: STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration

STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications 13 Mohamed Aly

Simulation Description

Compare: STDCS, local storage, spatial indexing. A cluster of stationary sensors (with random locations). Each sensor senses a reading each 10 min. Sensor reading = 1 packet. Sensor capacity = 20 readings (packets) Multiple mobile users. A query: random sensor, radius, and type. Two phases: initialization (3 hours of readings) &

running (1 day of readings and queries). Metrics: throughput, energy level, node deaths.

Page 14: STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration

STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications 14 Mohamed Aly

Experimental Results: STDCS vs. Query Hotspots

Page 15: STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration

STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications 15 Mohamed Aly

Experimental Results: STDCS vs. Query Hotspots

Page 16: STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration

STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications 16 Mohamed Aly

Experimental Results: Switching Time Effect

Page 17: STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration

STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications 17 Mohamed Aly

Experimental Results: Switching Time vs. Node Deaths

Page 18: STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration

STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications 18 Mohamed Aly

Experimental Results: Adaptive Hotspot Decomposition

Page 19: STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration

STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications 19 Mohamed Aly

Conclusions

STDCS: A real-time geo-centric data storage scheme. A new concept of spatio-temporal data indexing. Ability to dynamically cope with dynamic loads and query

hotspots.

Page 20: STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration

STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications 20 Mohamed Aly

Acknowledgment

This work has been partly supported by: Google, Inc. The “Secure CITI: A Secure Critical Information

Technology Infrastructure for Disaster Management (S-CITI)” project funded through the ITR Medium Award ANI-0325353 from the National Science Foundation (NSF). For more information, please visit: http://www.cs.pitt.edu/s-citi/

Page 21: STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications Mohamed Aly (University of Pittsburgh & Yahoo, Inc.) In collaboration

STDCS: A Spatio-Temporal Data-Centric Storage Scheme For Real-Time Sensornet Applications 21 Mohamed Aly

Thank You

Questions ?