Quantified Self & Lifelogging Meets Internet of Things (IOT)

By: Dr. Mazlan Abbas, MIMOS Berhad

A little bit about the Speaker

HOW MANY STEPS

HAVE YOU WALKED TODAY?

Average 3,000 – 4000

NHS RECOMMENDS 10,000

YESTERDAY I MADE 5,559

+Classification of Pedometer-Determined Physical Activity

n  < 5000 steps/day - "sedentary lifestyle index”

n  5,000-7,499 steps/day - "low active"

n  7,500-9,999 steps/day - "somewhat active”

n  10,000 steps/day - "active”

n  > 12,500 steps/day - "highly active"

Am I a “Couch Potato”?

Umrah Trip: 26/2 – 7/3/2014

How Well Do I Sleep?

Am I Healthy?

How Effective Are Your Knowledge Sharing?

Favorite topic and high downloads!

How do I spend my time in the last 150 Days?

January 2014 February 2014

March 2014

My Productivity Level….

How Much Time I Spent With My Smartphone?

How to automatically records your real life story, as told by the places you visited and the things you've done because some of us have a

great story to tell.

Saga automatically records your real life story, as told by the places you visited and the things you've done. We all have a great story to tell. Let Saga tell yours.

Don’t You Love To Know …

•  Where you’re going? •  Who you’ve interacted with? •  How long you’ve spoken to friends? •  The affinity of connections? •  How long it takes to get to work? •  The tone of your messages •  The amount you text, tweet or update? •  How much exercise you’re getting? •  How much you get distracted?

Will Internet of Things (IOT) Help Us To Know More About Ourselves?

Progress of Techno-Human Evolution

More Connected Devices Than People

Growth of “Things” Connected to the Internet

Internet of Things (IOT) Wave

© 2013 MIMOS Berhad. All Rights Reserved.

MIMOS defined IoT as: “Technology that enables collaboration among people, things/objects, processes & data to improve lives”

Expected growth in the number of connected devices

Sensing as a Service and Big Data Arkady Zaslavsky#1, Charith Perera#*2, Dimitrios Georgakopoulos#3

#ICT Centre, CSIRO, Canberra, ACT, 2601, Australia arkady.zaslavsky@csiro.au 2charith.perera@csiro.au

dimitrios.georgakopoulos@csiro.au *Research School of Computer Science, The Australian National University,

Canberra, ACT 0200, Australia

Abstract— Internet of Things (IoT) will comprise billions of devices that can sense, communicate, compute and potentially actuate. Data streams coming from these devices will challenge the traditional approaches to data management and contribute to the emerging paradigm of big data. This paper discusses emerging Internet of Things (IoT) architecture, large scale sensor network applications, federating sensor networks, sensor data and related context capturing techniques, challenges in cloud-based management, storing, archiving and processing of sensor data. Keywords— Big Data, Sensing as a Service, Internet of Things, Large Scale Sensor Networks, Cloud Computing, Data Management.

1. Introduction The modern technology-savvy world is full of devices comprising sensors, actuators, and data processors. Such concentration of computational resources enables sensing, capturing, collection and processing of real time data from billions of connected devices serving many different applications including environmental monitoring, industrial applications, business and human-centric pervasive applications. These developments have brought us to the era of Internet of Things (IoT) [1] by introducing IoT in 1998as concept [2]. However, sensing the environment around us and objects populating this environment became synonymous with the introduction of pervasive or ubiquitous computing by the paper  ‘The  Computer  for  21st Century’  [3] in 1991 in the same year where World Wide Web became available. The major enabler of IoT is sensor networks. IoT has three unique features [4]: intermittent sensing, regular data collection, and Sense-Compute-Actuate (SCA) loops. In 2010, the total amount of data on earth exceeded one zettabyte (ZB) [5], [6] (see figure 1). By end of 2011, the number grew up to 1.8 ZB [7]. Further, it is expected that this number will reach 35 ZB in 2020. As in many cases with ICT, this estimate may prove to be too conservative. IEEE Spectrum [6] recognises both sensors and big data as to of the five technologies that will shape the world (figure 2). According to Gartner Research [8], by 2015, wirelessly networked sensors in everything we own will form a new Web. But it will only be of value if the 'terabyte' of data it generates

can be collected, analysed and interpreted. Further, European Commission [7] predicts that the present 'Internet of PCs' will move towards an 'Internet of Things' in which 50 to 100 billion devices will be connected to the Internet by 2020.

Figure 1: The total amount of data generated on earth exceeded one zettabyte in 2010.It is predicted that data volume will grow exponentially as depicted1.

Figure 2: Data generated from the Internet of Things will grow exponentially as the number of connected nodes increases. Estimated numbers of connected

nodes based on different sectors are presented in Millions [9].

1 www.teradata.com

“We are at the tipping point for broader IoT adoption with 53 percent of organizations

planning to implement an IoT solution in the next 24 months. Organizations in Asia Pacific and Latin America are more

aggressive with 69 and 60 percent, respectively,

planning to implement over the same time period”

[Source: “Building Value from Visibility.” – A Forrester

Consulting Thought Leadership paper Commissioned by Zebra Technologies, October 2012]

We Evolve Because We Communicate

•  It is also important to note there is a direct correlation between the input (data) and output (wisdom).

•  The more data that is created, the more knowledge and wisdom people can obtain. •  IoT dramatically increases the amount of data available for us to process.

Harnessing the Data

n  Every day, events occur in a business: Assets are used, transactions take place and employees move about.

n  Events constantly happen and those events constantly create data.

n  What if you could harness this information and form new insights to solve a business challenge or drive innovation?

n  The Internet of Things technologies will make this possible

Three Trends Moving to Mainstream

n  Life-streaming n  that you capture everything, but for the purpose of sharing the

details of your life with other people.

n  Life-streaming is sharing everything.

n  Quantified-Self n  Monitors your biological status

n  Lifelogging n  when you use technology to capture events, documents and

experiences and keep them in a chronological timeline.

n  Lifelogging is keeping everything;

The continuous tracking of various aspects of our physical bodies

n  how many calories we burn;

n  our body fat percentage;

n  how many steps we take in a day;

n  how long we sleep;

n  how many hours a week we spend commuting or sitting at a

n  ...

What is Quantified Self (QS)?

Measure and Score

We have the ability to measure and score our lives

n  social reach and influence;

n  tastes and preferences;

n  achievements;

n  credibility and reputation;

n  habits;

n  expertise;

n  ...

+Quantified Self Measurements…

n  Physical Activities n  Miles, steps, calories, repetitions, sets, METs1

n  Diet and Nutrition n  Calories consumed, carbs, fat, protein, specific ingredients, glycemic index, satiety,

portions, supplement doses, tastiness, cost, location

n  Psychological, Mental, and Cognitive States and Traits n  Mood, happiness, irritation, emotion, anxiety, esteem, depression, confidence

n  IQ, alertness, focus, selective/sustained/divided attention,  reaction, memory, verbal fluency, patience, creativity, reasoning, psychomotor vigilance

n  Environmental Variables n  Location, architecture, weather, noise, pollution, clutter, light, season

n  Situational Variables n  Context, situation, gratification of situation, time of day, day of week

n  Social Variables n  Influence, trust, charisma, karma, current role/status in the group or social network

1METs = Metabolic equivalents Source: http://measuredme.com/2012/10/building-that-perfect-quantified-self-app-notes-to-developers-and-qs-community-html/

Smartring (ElectricFoxy), Electronic tattoos (mc10), $1 blood API (Sano Intelligence), Continuous Monitors (Medtronic)

QS Sensor Mania! Wearable Electronics

28

Smartphone, Fitbit, Smartwatch (Pebble), Electronic T-shirt (Carre), Scanaflo Urinalysis1

Source: Swan, M. Sensor Mania! J Sens Actuator Netw 2012. 1Glucose, protein, leukocytes, nitrates, blood, bilirubin, urobilinogen, specific gravity, and pH urinalysis

Increasingly continuous and automated data collection

Sensor Mania! QS Gadgetry Trend

29

Source: Swan, M. Sensor Mania! The Internet of Things, Objective Metrics, and the Quantified Self 2.0. J Sens Actuator Netw 2012.

Portable sensors can take readings of things that are not even perceived by humans, such as oxygen levels in the

blood or the amount of carbon dioxide in the air.

Floor Tiles That Can Monitor the Health of the Elderly

A strip of pressure-sensitive floor tiles made of plastic evaluates a walker’s health based on footstep patterns. The tile system’s cloud-based analytics can provide health updates via smartphone and assist caretakers for the elderly. Tactonic, which plans to start selling IntelliMat tiles on its website later this year, is refining them to track arthristis, joint weakness, and Parkinson’s disease. Beyond in-home care, the tiles are valuable to hospitals and physical therapists.

Sensors can also log the three billion or so heartbeats in a person's lifetime, along with other physiological indicators, and warn of a possible heart attack. This information would allow doctors to spot irregularities early, providing warnings before an illness becomes serious.

Your physician would have access to a detailed, ongoing health record, and you would no longer have to rack your brain to answer questions such as "When did you first feel this way?"

+Star Trek’s Tricorder

A tricorder is a multifunction hand-held device used for sensor scanning, data analysis and recording data.

First appeared in a Star Trek episode “The Enemy Within” on Oct. 6, 1966

Lifelogging Take a Stroll Down a Virtual Memory Lane

“How much more IOT can do is only left to your imagination and to your budget. You can do as little or as much with IoT as you

want.”

Life Data

Acquire Analyze Store

Lifelogging - is moving beyond just counting how many steps you take

Soon it will encompass almost everything we do, generating vast quantities of data in the process. But how can you organize and browse all the video, audio, image and text data you amass?

Logging Your Mind

In the future, Gurrin (Dublin City University in Ireland) envisages that wearable headsets incorporating brainwave sensors will do memory ranking. "A spike due to excitement in a certain part of the brain could then be logged alongside the video to infer its importance level," he says

How to automatically annotate files with descriptive, searchable tags and to easily browse them.

Life-Logging with Mood Tracker

Digital memories can do more than simply assist the recollection of past events, conversations and projects.

Na

rra

tive

Clip

Auto Tagging

•  Fast browsing through memories will be dependent on such annotation •  To do this efficiently, we'll need machine learning algorithms that can

automatically recognize and tag all forms of lifelogged data. •  Only then will we get the killer applications,

Benefits of Lifelogging

It will take quite some time for people to feel comfortable with ‘always connected’ devices that can discreetly take photos or videos. One question is if the benefits outweigh the negatives.

Benefits of Lifelogging - Security

A huge amount of crimes are being filmed these days by passer’s by with cell phones. No need for security cameras when everyone in a building has a smart phone with a camera.

Benefits of Lifelogging – Precious Moments In ‘Total Recall’ (no relation to the movie) Gorden Bell (of Microsoft acclaim) found that by digitizing everything in his life he was able to reduce stress by a massive amount. Need a receipt of something you bought years ago? No problem, just do a quick search and it should pop right up.

What he also found was that by taking photos of everything moment of his life he could go back to precious unexpected moments that you wouldn’t normally take photos of.

Benefits of Lifelogging – Memory Recall

These moments could include a photo of your wife on the day you both met or a last photo of your beloved dog. It could also help with memory. Search for someone’s name and you’ll have all the information (including photos) of that person pop up when you are about to talk with them.

+Top 10 Places That Have Banned Google Glass

Because of these concerns, Google Glass has already received a number of pre-bans at certain places. 1.  Banks/ATMs 2.  Sports Arenas/Concert Venues 3.  Locker Rooms/Dressing Rooms 4.  Movie Theaters 5.  Cars 6.  Hospitals 7.  Classrooms 8.  Strip Clubs 9.  Casinos 10. Bars

I think the really big issue here is that you might, individually, not worry about publishing details of your personal life. But you are publishing your friends, family and business contacts details at the same time. You are potentially compromising your family and friends!

Lifelogging: Is It An Invasion Of Privacy?

Thought Controlled Computing

Neurowear Necomimi [Video] If you can capture emotions, you can tag it!

Neurowear “Neurocam” Concept [Video]

+Thought Controlled Computing

[Source: http://venturebeat.com/2013/11/04/next-step-for-wearables-neurosky-brings-its-smart-sensors-to-health-fitness/ ]

The flagship product, MindWave, is a headset that can log into your computer using just your thoughts. Researchers recently used the EEG headset to develop a toy car that can be driven forward with thought. NeuroSky’s smart sensors can also track your heart rate and other bodily metrics and can be embedded in the next generation of wearable devices. “We make it possible for millions of consumers to capture and quantify critical health and wellness data,” Yang (CEO of Softbank) said. Softbank is the funder.

NeuroSky – Thought Controlled Computing [Video]

SUMMARY

+

Self-Digitization

Data Generating Machines

Drive thru Automated Toll Pay with Credit Card Replying Email

Digital Exhaust Leaving Your Bits and Bytes Across the Internet

Data Shadows

+

THANK YOU EMAIL: mazlan@gmail.com TWITTER: mazlan_abbas FACEBOOK: www.facebook.com/drmazlanabbas LINKEDIN: my.linkedin.com/in/mazlan/ SLIDESHARE: www.slideshare.net/mazlan1