Embed Size (px)
DESCRIPTION
The Internet is evolving from a network of comput- ers to a network of devices, e.g., phones, smart meters, traffic cameras, and air quality sensors. In this Internet of Things, large amounts of data generated by everyday objects can often be organized into data streams, where each data stream is a time series of sensor values sampled together. Visualization is an easy-to-use, efficient, and effective method to present this heterogeneous data to large and diverse audiences, and enable its analysis by users without programming background. Although general data-storage and sharing systems for the Internet of Things, like Pachube and Sensor.Network, offer some basic visualizations, they do little to help users understand relations and patterns hidden in the data, nor do they support live updates to the underlying data streams. Other systems, like Biketastic and the Copenhagen Wheel, feature more complex visualizations but are tailored for a specific application domain and do not address heterogeneous data streams. In this paper, we present SNViz, a Web browser-based AJAX application built using Protovis for visual analysis of large, heterogeneous, and live data streams in the Internet of Things. Besides offering panning and zooming for a detailed look at smaller data subsets, SNViz offers brush-and- linking across multiple visualizations. The latter is invaluable in helping users understand and analyze relationships and patterns hidden in the data. Although SNViz currently works by accessing JSON representations of data streams from Sensor.Network over HTTP, it can be extended to work with other data sources (e.g., wireless sensor network devices or smartphones) and even customized for specific applications. This work was presented at the Internet of Things conference (www.iot2010.org).
Citation preview
SNVizAnalysis-oriented Visualization for the Internet of Things
Giacomo Ghidini1 2 Dr. Vipul Gupta2 Dr. Sajal K. Das1
1 Center for Research in Wireless Mobility and NetworkingUniversity of Texas at Arlington{giacomo,das}@uta.edu
2Sun Labs, [email protected]
Urban Internet of Things Workshop 2010November 29, 2010
IBM Japan Hakozaki HQ/Royal Park HotelTokyo, Japan
Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 1 / 26
Outline
1 Introduction
2 Visualization for the Internet of Things
3 SNViz
Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 2 / 26
Introduction
Outline
1 Introduction
2 Visualization for the Internet of Things
3 SNViz
Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 3 / 26
Introduction
Century of CitiesThe vision. . . and some facts
“The 19th century was a century of empires, the 20th century was acentury of nation states. The 21st century will be a century of cities”
– Wellington E. Webb, former mayor of Denver, CO1
Continuous urbanization2
In 2010, 50% of the world’s populations is living in urban areasThis figure will reach 70% by 2050
Most liveable cities3
Mid-sizedLocated in developed country with low population density
How can the Internet of Things help provide high quality of life in large cities?
1Webb, First Transatlantic Summit of Mayors, 20012U.N., World Population Prospects, 20073Economist Intelligence Unit, Global Liveability Report, 2010
Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 4 / 26
Introduction
Internet of Things (IoT)
The Internet is evolving from network of computers to network of devices4
AT&T added 900,000 connected devices in Q2, totaling 6.7M5
Non-phone consumer products and machine-to-machine (M2M) units
Smart objectsConnection between physical and cyber worldsSensors generate large amount of data
The network world is the computer
How to integrate devices, services, and users in the Web?
4Duffy Marsan, Network World 2010 [3]5AT&T News Release, July 23, 2010 [1]
Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 5 / 26
Introduction
Representational State Transfer7 (ReST)
“The main idea of REST is to design applications which implementtheir functionality completely as a set of URI-addressable resources,with HTTP being the access method for interacting with them. Insuch an application, there is no need for any special interface, theapplication fully blends into the Web [. . . ]”
– Erik Wilde, UC Berkeley6
6Wilde, Putting Things to REST, 2007 [9]7Fielding, Ph.D. Thesis, 2000 [4]
Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 6 / 26
Introduction
Sensor.Network8
Data storage and exchange platformRemoves coupling between devices, services, and users
Data streamTime series of a set of values (e.g., temperature, pressure, acceleration)Data points can be added to, edited, and removed from a data streamUsers visualize data streams on line charts, scatter charts, maps, . . .
REST-based APIUsers access it via a Web browserAny device can access it via HTTP
8Gupta et al., IEEE PerCom Workshops, 2010 [7]Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 7 / 26
Internet of Things Visualization
Outline
1 Introduction
2 Visualization for the Internet of Things
3 SNViz
Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 8 / 26
Internet of Things Visualization
Why Visualization?
ScenarioPartially structured data fromheterogeneous sourcesUsers with limited or no programmingbackground
EfficiencyLarge amount of data presented incompact form
EffectivenessRely on human vision and processing foranalysis
Ease of useNo specialized data analysis softwarerequired
Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 9 / 26
Internet of Things Visualization
Visualization and the DIKW Pyramid
Data-Information-Knowledge-Wisdom Pyramid9
Information depends on data, knowledge depends on information, . . .Ascent of DIKW pyramid is required to acquire wisdom from data
Sound visualization can help ascend the DIKW pyramid
9Ackoff, Journal of Applied System Analysis, 1989Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 10 / 26
Internet of Things Visualization
Related Work
Generic frameworksSensor.Network10
No interaction among views of data set
Application-specific systemsBiketastic11
Copenhagen Wheel12
Rich visualizations restricted to a specific domain
SNViz tries to bring visualization to the foregroundstriking a balance between flexibility and customization
10Gupta et al., IEEE PerCom Workshops, 201011Reddy et al., CHI 201012MIT SENSEable City Lab, 2010
Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 11 / 26
SNViz
Outline
1 Introduction
2 Visualization for the Internet of Things
3 SNViz
Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 12 / 26
SNViz
Problem
Analyze data bybrush-and-linking;highlighting; andpanning andzooming
ChallengesMultiple large,heterogeneous, livedata streamsMultiple values inmultiple charts in aWeb browser
Brush-and-linking
In multiview representation ofmultidimensional data, data pointsselected (brush) in one view arehighlighted (link) across all views
Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 13 / 26
SNViz
Architecture
Datastream
Chart
Event Bus
HTTP Requests
HTTP ResponsesJSON content
1:n
Datastream
Chart1:
n
...
Scatter chart,line chart, map,...
No standalone app
No plug-ins required
Local copy of data
Well-knownprotocol Datastream
metadataGET
Datastreamdata
GET
Compact datarepresentation
RESTful API
Event Bus
HTML & Javascript Java Servlets
Sensor.Network
......
Or any other tech
Sensor.Network Viz
Web browser Internet Web server
Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 14 / 26
SNViz
Visualization Libraries/Toolkits
Graphical systems (e.g., Processing13)Low-level abstractionTedious for complex work
Visualization systems (e.g., Google Chart Tools14)High-level abstractionCustomized solutions not allowed
Does a solution exist between these extremes?
13Resig, 2010 [8]14Google, 2010 [5]
Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 15 / 26
SNViz
Protovis15
MarksGraphical primitives (e.g.,lines, bars, dots)
Data-drivenMark features function ofdata
ExtensibleProper abstraction level
Control re-rendering Figure: Minard’s Napoleon
15Bostock & Heer, 2009 [2]Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 16 / 26
SNViz
Implementation
Client-side AJAXHTML, JavaScriptJSON wire format
Google Web Toolkit16
Develop Web application in JavaTranslate it into HTML and JavaScriptDeploy it to a Web server/Servlet container
VisualizationsProtovisGoogle Chart Tools
16Google, 2010 [6]Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 17 / 26
SNViz
Demo 1/2Bicycle Ride
Sensor.Network Viz Original visualization
Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 18 / 26
SNViz
Demo 2/2Tomato Farm
Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 19 / 26
SNViz
Analysis of SNViz
Flexible visualization for the Urban Internet of ThingsCustom visualizations can be easily added
Supports analysis of live dataPanning and zoomingBrush-and-linking
Responsive and compactClient-side JavaScript processing855 KB HTML and JavaScript, incl. 479.9 KB Protovis2.95 seconds to load Web page (if caching enabled)
Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 20 / 26
SNViz
More Applications
Sun SPOT VisualizationEach Sun SPOT is a datastreamEmployed in the Java OneHands-on Lab 2010
Web of Things VisualizationInternetworked devicesimplement RESTful protocolEverything is a data stream(RSS for data)Personal data stream mash-upscan be created
Datastream
Chart
Event Bus
HTTP Requests
HTTP ResponsesJSON content
1:n
Datastream
Chart
1:n
...
Datastreammetadata
GET
Datastreamdata
GETEvent Bus
Web browser
HTML & Javascript
Sun SPOT
Internet
......
Sensor.Network Viz
Web server
WoT Data Source
Sensor.NetworkMultiple data
sources
Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 21 / 26
Conclusions
Conclusions
Developed a modular and extensible Web-based visualization for the Webof Things
Addressed challenges due to large, heterogeneous, and live data streams
Enabled compact representation of data and analysis of patterns andrelationships
Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 22 / 26
Conclusions
Acknowledgments
Roger Meike and all the folkson the IoTA (Internet of Things Actualized) research group
at Sun Labs, Oracle
Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 23 / 26
Conclusions
References
AT&T.
AT&T Adds Nearly 900,000 Connected Devices to Network in 2Q; Now Services Nearly 6.7 Million Connected Devices, 2010.
Michael Bostock and Jeffrey Heer.
Protovis: a graphical toolkit for visualization.IEEE Transactions on Visualization and Computer Graphics, 15(6):1121–8, 2009.
Carolyn Duffy Marsan.
10 Fool-proof Predictions for the Internet in 2020, 2010.
Roy Thomas Fielding.
Architectural Styles and the Design of Network-based Software Architectures.PhD thesis, University of California Irvine, 2000.
Google.
Google Chart Tools / Interactive Charts, 2010.
Google.
Google Web Toolkit, 2010.
Vipul Gupta, Poornaprajna Udupi, and Arshan Poursohi.
Early Lessons from Building Sensor.Network: an Open Data Exchange for the Web of Things.In 8th IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom 2010 Workshops), pages738–744, March 2010.
John Resig.Processing.js, 2010.
Erik Wilde.
Putting Things to REST, 2007.
Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 24 / 26
Conclusions
Credits
Roger Meike’s Blog, http://blogs.sun.com/roger/entry/the_tomato_forest_connecting_external
Protovis Brush + Link, http://vis.stanford.edu/protovis/ex/brush.html
Protovis Minard’s Napoleon, http://vis.stanford.edu/protovis/ex/napoleon.html
Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 25 / 26
Conclusions
SNVizAnalysis-oriented Visualization for the Internet of Things
Giacomo Ghidini1 2 Dr. Vipul Gupta2 Dr. Sajal K. Das1
1 Center for Research in Wireless Mobility and NetworkingUniversity of Texas at Arlington{giacomo,das}@uta.edu
2Sun Labs, [email protected]
Urban Internet of Things Workshop 2010November 29, 2010
IBM Japan Hakozaki HQ/Royal Park HotelTokyo, Japan
Ghidini, Gupta & Das (CReWMaN and Sun Labs) SNViz Urban IoT Workshop – 11/29/2010 26 / 26
![Task-Oriented Optimal Sequencing of Visualization Charts · developing techniques to threading visualization charts into meaningful sequences. Kim et al. [25] introduced GraphScape,](https://img.pdfslide.us/doc/110x75/5f61133bf3ed7763fb2e9c52/task-oriented-optimal-sequencing-of-visualization-charts-developing-techniques-to.jpg)
