Photo courtesy of @MAMK
enhancement progressive beyond
http://www.flickr.com/photos/shoutsfromtheabyss/5313714706
It will be like electricity”.
“…[technology] will just be seamless. It will just be there.
The web will be everything and it will be nothing.
by 2020...
– Eric Schmidt, Google
it can be hard to visualise
what this will truly mean...
http://www.flickr.com/photos/mwichary/3189145257
http://www.flickr.com/photos/accidentdesigns/6137301255
with computation + connectivity…
with each day that goes by we find
new ways to augment everyday things
the results can be
both magical and disturbing
http://www.flickr.com/photos/accidentdesigns/6137308437
self driving cars that collect
gigabytes of data per second…
Twitter: Bill Gross
Almax - EyeSee Mannequin
mannequins that watch, listen
and analyse who you are
to “build” a better suit…
mobile stores with 3D scanners
Kickstarter: Tailor truck
recharge electric buses…smart roads that wirelessly
KAIST OLEV project: YouTube
Proteus Digital Health - Digital health feedback system
stomach acid powered sensors that communicate
with applications on your smartphone…
senses how you eat…
a fork that
Hapi Fork by Hapi Labs
Proteus Digital Health - Digital health feedback system
Apple Gives Share-holders More Input; Will Facebook Get the Message?
At its annual shareholders meet-ing on Thursday, Apple’s man-agement bowed to pressure from key investors and agreed to allow shareholders to elect board directors by a simple ma-jority vote.
Now any new or current director standing for election who fails to receive support from a majority of shareholders must resign his
By Tim CarmodyFebruary 24, 2012 | 4:26 pm
MENUand smart toilets that help you track
what comes out…
microchip+
sensors data out
A real-time web (or app) based progress report is available.
The fork gathers data as you eat.
data out
data outservice
data out
Fork vibrates if you’re eating too fast
they are systems…
these aren’t just smart connected objects,
Hapi Fork by Hapi Labs
http://www.flickr.com/photos/gcbb/2502506212
of these systems…
it’s not always obvious where the web fits in,
but it has an important role to play in each
http://www.flickr.com/photos/tristanf/2234332037
the pathways from today’s web to apps
and things are anything but…
but while the future may be seamless,
http://www.flickr.com/photos/doglotion/4131810103
AccelerometerCameraCaptureCompassConnectionContactsDeviceEventsFileGeolocationGlobalizationinAppBrowserMediaNotificationStorage
to communicate with hardware…
our current approach to building the future webis to develop APIs that enable the web
http://www.flickr.com/photos/davidchief/6441607321
…the theory being that only a more capable and
powerful web can compete with native apps...
http://www.flickr.com/photos/mozillaeu/9191443975
or maybe replace them altogether…
http://www.flickr.com/photos/orijinal/8133373975
I’m not suggesting this is the wrong path,
but I think we may be missing part of the story…
http://www.flickr.com/photos/micora/5105225792
(being “born of tech” doesn’t exempt us from these growing pains)
…we’re far from the only industry that’s been
challenged by the power of new technologies…
http://www.flickr.com/photos/bfishadow/3637298219
be the best path…
it’s natural to want to compete with them,
but history suggests this may not
http://www.flickr.com/photos/sohrab_kabuli/5294817108
rethink how we relate to them…
…rather than compete, we need to adapt,embrace new technologies and completely
Online journalism and blogging workshop in Jalalabad
http://www.flickr.com/photos/ummella/4088456000
a first step is to accept that
native software isn’t going away…
http://www.flickr.com/photos/sndrv/4635764320
…we need native software
to power complex experiences,
geolocation
camera
3D rendering
gyroscope
video & audio
at the last web standards round...access bits of hardware or software that didn’t exist
“Motes” are Bluetooth Low Energy (LE) devices that can broadcast data on behalf of things in the real world.
There still no Bluetooth API for the web (LE or otherwise...)
Source: EstimoteRead Scott Jenson’s W3C article proposing we extend web discovery to objects
...and take full advantage of
powerful new chipsets
The Moto X includes a low-power core whose only job is to listen for the
passphrase "OK, Google Now”.
(This plus another core devoted to sensorsenables, Touchless Control to run in the
background without the need to power upthe entire processor, which would
drain your battery.
and technologies
Photo: Mashable
http://www.flickr.com/photos/mujitra/8688838450
increasingly...out in the real world
…and native software needs the web to power discovery,
not just through search—but social media and
http://www.flickr.com/photos/craigmurphy/3979174573
a world of “things” you may want to chat withbut not care enough about to start a full-on relationship
For more on this, read Scott Jenson’s seminal article on just-in-time interactions.
http://www.flickr.com/photos/68453216@N03/6227748188
a veritable superpower that will only increase
once everyone is connected…
the web is the ubiquitous pathway,
http://www.flickr.com/photos/splitthekipper/5727366179
…so how do we
make the web even better?
http://www.flickr.com/photos/greggoconnell/201374093
progressive enhancementbut not the way we’ve known it…
http://www.flickr.com/photos/ducdigital/2892313560
providing an enhanced version to those
“…using web technologies in a layered fashion that allows
everyone to access the basic functionality…while also
with more advanced capabilities”.
Progressive enhancement:
http://www.flickr.com/photos/renaissancechambara/2267250649
if we truly value the ideasbehind progressive enhancement…
some see an escalator...others see a highly enhanced
and gracefully degrading staircase...
http://www.flickr.com/photos/blmurch/6024605166
everyone is different…
…if we truly believe that creating great experiencesbegins with an acknowledgement that
http://www.flickr.com/photos/dsf/9358670299
different contexts, with different
intents and capabilities…
experiencing the web in
…we must accept that enhancementmay sometimes lie beyond the web
Source: Nymi
Nymi lets you use your unique cardiac rhythm to authenticate your identity.
http://www.flickr.com/photos/yghelloworld/4964999147
weave the web in and outof their day…
that (thanks to mobile), people research already shows
http://www.flickr.com/photos/susanito/5447525972
in doing so, they dip in and outof the web content we create…
http://www.flickr.com/photos/shortcatt/6233298063
the choices they make are complex,
sometimes irrational, and uniquely personal…
http://www.flickr.com/photos/ducdigital/2892313560
“...services aren’t made on an assembly line...you can’t predict precisely which [touchpoint] each user will need, in what order she will encounter them, and who will help her along the way.
The service is experienced differently by every person, because every person is different."
- Andy Polaine
the services we create must embracethat complexity...
http://www.flickr.com/photos/mozillaeu/9293845962
it’s natural for us to want to coax users
towards the open web…
http://www.flickr.com/photos/kalleboo/9400677132
it’s also natural for our app-making colleagues
to want to drag them the other way…
http://www.flickr.com/photos/juhansonin/7883095062
…and who knows what directionmay come along next
http://www.flickr.com/photos/andrewmalone/2355592191
all this jostling for attention is
counterproductive…
http://www.flickr.com/photos/jazbeck/8025692978
through technology…
…it doesn’t help us gain trust, create engagement,increase loyalty or enable users to improve their lives
http://www.flickr.com/photos/shimelle/5586063513
web vs apps, print vs digital,or bricks + mortar vs online…
the work we do is not about
http://www.flickr.com/photos/drtran/7468519076
it’s about leveraging technology to
build relationships and enable conversations
http://www.flickr.com/photos/jdickert/3091034336
to make this happen, we have to
stop thinking in silos…
http://www.flickr.com/photos/eletrosonico/3359915532
often referred to as “digital”…
not just the technologies we use,
but the culture around what is still
...we need to evolve
If I buy a TV online while in-store on my
mobile, which channel am I using...?
http://www.flickr.com/photos/meddygarnet/4012204741
here’s an example of a company that is slowly taking steps
to disentangle itself from silos and legacy thinking…
http://www.flickr.com/photos/ducdigital/2892313560
Dixons (owner of electronics giants Curry’s and PC World) recently scrapped individual sales commissions in favour of store-wide schemes linked to measuresof customer satisfaction.
To overcome managers’ reluctance to refer customers to the website, stores are now credited with all salesin their catchment area...regardless of whethera buyer entered the premises.
- The Economist
“
http://www.flickr.com/photos/yokohamarides/6677622077
–not where and how the interactions occurred
this approach makes sense because in the end,what’s most valuable to the company is a satisfied customer
http://www.flickr.com/photos/carbonnyc/2154870998
it’s probably also more efficient as the entire companycan work towards a common goal…
http://www.flickr.com/photos/egfocus/6001107753
than what we’re doing todaywhat’s possible, and why embracing it might be bettershifting culture can be hard, but the first step is to understand
http://www.flickr.com/photos/jamesstewart/5736745348
more seamless, honest and future-friendly…
i’m going to walk you through some technologies that
I believe can help us create experiences that are
http://www.flickr.com/photos/ryanbrunsvold/5218091651
weaving the web in and out of everyday life
none of these examples exclusively involve the web –they can however play a role in more seamlessly
a friendly warning:
iOS smart app bannersURLs that (kinda) open apps
APPBROWSER
The call to action adapts to suit the context:• OPEN if the app is installed,• VIEW if it’s not
The banner also won’t appear if the app isn’t supported (...in that region, on that particular model)
iOS Smart App Banners can prompt users to open or install your app, and are easy to implement using a meta-tag in the head of each page.
They are less obtrusive than modal windows and are native components so won’t impact performance or suffer from usability problems as a modals often can.
Source: Apple developer
While less intrusive than other methods, smart app banners can still send mixed messages. Don’t use them “simply because you can”. Make sure they are truly useful.
If the user already has the app installed, generically linking to it is about as useful as generically dumping all smartphone users on your (mobile) home page. You can do better...
<a href=”http://www.amazon.co.uk/
bookReference”>
Clicking OPEN passes that page’s URL... ...which the app
parses and resolves to display the content
1
23
This is sadly a mythical example. Amazon could do this, but so far hasn’t.
Bottom line:If used well, Smart app banners can deliver a good experience.
It’s a shame however that their content can’t be customized to make them feel a bit less like an advert in cases where users already have the app installed.
Custom URI schemesmore URLs that (kinda) open apps
APPBROWSER
URI schemes are a mechanism through which third-party apps can communicate with each other.
They are supported on iOS, BlackBerry 10, Windows Phone 8 and Android (using the far more robust intents).
polar://
The user clicks a link within a web page
The native app (that’s already installed) recognises the scheme
The app developer registers the scheme within the native app
<a href=”polar://polls/2246/”>
The app opens and (if it’s been well designed) resolves the full URL to display the content or activity the user requested
using a web linkto launch an app in iOS
2
3
4
1
example:
Luke’s case study: Linking mobile web and native app experiences
Boo...the user is on another platform(Mac, PC, Android etc.)
...if only it were that simple :-((a complicated error prone process using cookies ensued to make this work...see the case study)
Boo...the native app isn’t installed
FAIL
Luke’s case study: Linking mobile web and native app experiences
<a href=”polar://polls/2246/”>
FAIL
polar://
The app developer registers the scheme within the native app
The user clicks a link within a web page
2
3
3
1
Bottom line:For the moment at least...schemes are a bit of a hack.They don’t gracefully degrade, so it takes a lot of work to ensure everyone gets a good experience.
intents on Androidoutsource tasks to other apps
TASKTASK
TASK
Intents are the glue between application components, both within an app, and across different apps. They allow apps to outsource tasks to other apps (that they may not even know about!) using predetermined interfaces.“
- Roman Nurik
Why is this useful?Intents enable users to choose the app they prefer to use when completing a task, such as sharing a link, saving a file or opening a URL.
(In contrast to the typical scenario where the platform owner, app developer or designer decides what people should use (and often how they should use it) and in some way hard-codes the functionality into the app.)
An intent is simply a combination of an action, and a piece of data.
Source: Nick Butcher, Google
VIEW
EDIT Contact “Bryan Rieger”
www.yiibu.com
Android apps can register their ability to handle each type of intent.
Source: Nick Butcher, Google
I can....
...VIEW
...EDIT
...SHARE
...CHOOSE
“...an image, file etc.
...an URL, photo etc.
...a photo, document etc.
...just about anything
EXAMPLE Opening a URL
Pick me!!Two apps respond“I can handle ”view” intents on amazon.co.uk”
browser resolves the URL
app resolves the URL
user is prompted to
pick...
the user clicks a link within a web page, in an email, or in another app...
<a href=”http://www.amazon.co.uk/
bookReference”>
the intent is broadcast
VIEW
{URI}
Share
Amazon Chrome
Clicking a hyperlink is one of the many user actions that triggers an intent.
It’s therefore possible for brands with both an app, and a mobile optimised site to enable behaviours like this....
Once again a mythical example. Amazon could do this, but so far hasn’t.
Reminder: The beauty here is this is an enhancement. The web page simply contains a URL. If there’s no Amazon app installed, the URL simply opens in a browser.
(If the user has two browsers installed (for example, a text to speech browser), and hasn’t designated a default, both will respond...and the user can make a choice).
SHARE
{data}
“Save”
INTENT
click “share”
...completing the action automatically brings you back to the Twitter app
choose an app
edit/composeyour note
Intents also enable out-of-the-box seamless experiences. Once a task is complete, the user automatically ends up back where they initiated that task.
Share
Twitter does use intents. Yay!
The more apps support intents, the more users can chain apps and activities together to complete very personal experiences...
Share (i.e. open)using Google Translate
...then Share in an SMS
hardware Back
open Tweet using your
chosen “app”
click a URL in the Tweet and open using
your favourite “app” seamless auto Back
seamless auto Back
hardware Back
http://www.flickr.com/photos/khamtran/5871541424
Intents are pretty cool. It’s a shame they’re just
an Android thing...
Detailed instructions on developers.google.com and try this out in Pocket on iOS
user clicks a link from within the Pocket iOS app
VIEW
mock-intent
?
NO
YES
isChromeInstalled?
offers the usual web view
roundtrip enabled using the x-callback-url scheme
enjoy content in your favourite browser
Google has implemented a variant of intents enabling apps to delegate viewing web content to Chrome on iOS. While a bit contrived, it incorporates feature detection so can be used as an unobtrusive progressive enhancement.
“open in Chrome” option is offered
“back” button added at runtime
Mozilla has also developed the web activities API for Firefox (mobile) and Firefox OS. Web activities enable (web) apps to delegate activities to other (web) apps.
three apps respond“I can pick a photo”
user picks a photo...
the app gets the photo back as a file blob, and does something with it...
PICK
{photo}
invokes the pick activity
Select Crop
...does other useful stuff with their favourite app...
I’m done!Pick
Wallpaper
Gallery
Camera
More on Web Activities and a comparison of Web Activities and the far broader Web Intents
Mozilla hopes that web activities will be adopted as a standard.
The development ofweb intents–a similar, but more complex W3C standard–is now on hold as the various groups discuss how best to proceed.
Before the web intents working group was disbanded, web intents were available behind a Chrome flag. This highly stylised and non-official visualization provides a glimpse of how these worked on a Chromebook.
Which service should be used for saving?
App suggestions from Chrome Web Store:
Evernote Add to Chrome
CONNECTED STUFF OUT IN THE WORLD
DEVICE
APPAPP
APP
The last couple scenariosall began (and ended) with an app (the browser is also an app :-)
Next we’ll talk about ways to enable interactions between other users, devices and connected “things”?
NFCeasily exchange all sorts of data
DEVICE DEVICE(and much more...)
NFC is a simple but powerful wireless technology that makes it easy to complete transactions, exchange digital content, and connect electronic devices.
Apple doesn’t yet support NFC :-(
Supported on most BlackBerry and Windows Phone devices.
1 million NFC-enabled Android devices activated each week*.
*Source: Google I/O 2013. Also of interest are the Mozilla NFC web API, a PhoneGap plugin, and the W3C NFC working group.
Apple appears to have no plan to support NFC and may instead focus on Bluetooth LE. These technologies overlap but each has its strengths. It’s a shame that Apple is as usual going its own way.
Receive small amounts of data from an unpowered object
the NFC tag is momentarily powered by the device’s NFC field
NFC enabled devices operate at a very short range (max. 4”/10cm) and can communicate with two types of “things.”
Exchange data of any size with another powered device
The word “data” downplays the power of a potential NFC data exchange. Here are a few examples...
Touch the poster (which contains a passive NFC tag) to receive a product-related URL. (...similar to a QR code but at least you don’t need to own, open and activate a separate QR code reader app)
Share a URI
OBJECT DEVICEdata
browser opens and loads the URI
Share a dataset
While using the British Airways app, tap your NFC device to an NFC-enabled (e-ink display) luggage tag to transfer your luggage and flight data.(Currently in Beta. This is a basic guess of how it will work. The e-ink image can last for weeks and only requires power when the tag is being written. )
OBJECTDEVICEdata
Source: British Airways to offer NFC luggage tags
While playing a video using the YouTube app, touch your phone to a Smart TV’s NFC logo...
Share a context
2 Loads the video
3 Sets the playhead location
4 Adjusts any other settings
1 Opens the TV’s YouTube app
(This is easy to demonstrate using two smartphones but not sure if the YouTube app on any NFC-enabled TV’s support this functionality.
In cases where the app isn’t yet installed, the device automatically takes you to the page on Google Play where you can download it.)
DEVICEdata
DEVICE
Tap to send the file
1 Activates Bluetooth (if not already on)
2 Pairs the devices
3 Initiates Bluetooth streaming
Share media
4 Disconnects Bluetooth once complete
Progress is visible in the notification window
e.g. PDF, mp3, mp4, MPEG
(or Wi-fi Direct)
DEVICEdata
DEVICE
(large)
Play using your favourite app...
(uses a ”view” intent on Android!)
Touching the headphone’s NFC logo to your NFC phone...
2 Activates Bluetooth
3 Pairs the devices
4 Initiates streaming of the song that’s currently open on your phone
1 Powers up the headphones
Initiate a connection
DEVICEdata
DEVICE
http://www.flickr.com/photos/aon/7184559114/
things get even more interesting,once you consider how users
may chain these behaviours together...
NFC payment
share voucher with a friendand so on...
in-store offer: check-into
Facebook for 10% off
....later that day
redeem 10% off
VIEW
grab QR code voucher from web
begin here...
download brand
loyalty app
see something you like! share a photo
tell 20 of your best friends...
conversation ensues...questions arise
+10!!friends say go for it!
browse reviews
tap POP display to
get reviews share them
http://www.flickr.com/photos/cristiano_betta/2753834595
tearing down silos isn’t just goodfor the web, it’s good for all of us…
http://www.flickr.com/photos/apes_abroad/4690659482
we’re not just build apps,
or web sites...
http://www.flickr.com/photos/heisenbergmedia/8409313926
we’re building strong, sustainable
companies and brands…
http://www.flickr.com/photos/comedynose/4328893766
…in a world where everything is connected
every company is now a technology company
“...it’s really rather simple, in the future, app development is going to be just as important as property development.”
- Philip Clarke, CEO, Tesco supermarkets
http://www.flickr.com/photos/78170556@N08/6992639132
the entire service,
the entire company...is the app
smart POP
contactless payment
loyalty
just-in-time inventory
global supply chain
accountability
privacy
personalization
sensors big datatransparency
open data
http://www.flickr.com/photos/comedynose/4328893766
APIs
loyalty
http://www.flickr.com/photos/yokohamarides/5754457946
the web is by far its most ubiquitousand resilient access point…
http://www.flickr.com/photos/danzen/4979854477
but the others also have a place in creating
wonderful, diverse and future-friendly experiences…
http://www.flickr.com/photos/docentjoyce/3314396603
they’re simply tools that help us tell storiesabout our products
...technologies aren’t solutions,
http://www.flickr.com/photos/brownpau/4969358409
and devices that surround us…
our job is to tear down the walls, build bridges, and
fill the gaps between the people, spaces
http://www.flickr.com/photos/seokchanyun/5537621999
…only then can we tell the stories
our customers deserve
http://www.flickr.com/photos/dcoetzee/3885789043
for what, for whom, where and most importantly, why.”- Bill Buxton (in a great many contexts)
for something else. The trick is knowing what is what,“Everything is best for something and worst
A one-handed ergonomic keyboard from the Buxton collection
http://www.flickr.com/photos/tinou/453593446
thank you
many thanks to the amazing photographers on
http://creativecommons.org/licenses/by/2.0
@yiibu
[email protected] usat
Presentation deck available @
http://www.slideshare.net/yiibu