Embed Size (px)
DESCRIPTION
This presentation is an updated version of my earlier presentation of the new concept of augemented audio. This concept interesting for both mobile adepts as well as visually impaired.
Citation preview
Tradidional interface on mobile internet
The interface for mobile internet has evolved from small displays and small (numeric) keyboards to large touchscreen with full qwerty keyboards.
Basically, the devices have the same interface as a traditional PC; a display and a keyboard, with a mouse, a stylus or touchscreen
These devices enable you have access to the internet at all places…
…but when you are walking, biking, driving, talking or listening, these interfaces are difficult to handle, or even dangerous (f.i. 7 pounds)…
Device batteries are limited to a few hours of intensive usage; most of the power is used by displays…
That’s doesn’t sounds very mobile at all, is it?
Ronald Huizer [email protected] CC-BY
Audio interface on mobile internet
Orientation and navigation,
Handsfree!
Ronald Huizer [email protected] CC-BY
Audio interface on mobile internet
So, how can we make applications using mobile internet,
without a keyboard and display,
without the use of hands and eyes?
Ronald Huizer [email protected] CC-BY
Audio interface on mobile internet
The new interface; a headset that creates a
virtual (audio) reality The headset is a (bluetooth) headset that: mixes the line out from your device with
exterior sounds/noises; enables you to listen to music, podcasts, text or
calls while still being able to hear and to
communicate (audio) as usual
This device, that is already on the market(from Plantronics)
It will enable visual impaired to listen to anyaudio device, and still having normal use of hearing
Ronald Huizer [email protected] CC-BY
Audio interface on mobile internet
Optimized version of this headset has additional features:
White noise modus – completely filters out all backround noises
External modus – 80% external audio
Internal modus – 20% external audio
Mute modus - 100% external audio
Voice activated; when your speaking, automatically switch to external modus
* I will be in contact with several companies to discuss further development of such a product.
Ronald Huizer [email protected] CC-BY
Audio interface on mobile internet
Audiotwitter : Listening to your tweets and music
at the same time! A twitter app using a twitter API captures
tweets from your account
A text-to-speech application (f.i. Siri, orAcapela) procudes spoken tweets.
Hyperlinks are mentioned, but not spoken
The app can also mix the spoken tweets with music from your iPhone; when tweets are spoken music is pauzed, or lowered in volume.
Tweets can be pauzed
Fase II developments:◦ Audiotwitter for desktop to enable visually impaired
to use twitter
◦ Speech2text interface for twitter
◦ The app recognizes the language of a tweet and selects the applicable voice/voccabulaire
◦ Multiple voices (male, female) based on gender in profile of tweet author
Easy to use with the v.a.r. headset
Ronald Huizer [email protected] CC-BY
Audio interface on mobile internet
Audio navigation with Google MapsWith a GPS-smartphone users can navigate and
be aware of all points of interest, without having to held and to view a handset
Using a speech-to-text application (f.i. Yap) that captures input from user about destination of a searched object
Use Google Maps (API) to produce route instructions and information on nearby objects likes stores and difficult situations
A text-to-speech application (f.i. Acapela ) will produce instructions
Special maps/layers for target groups can be developped and maintained by communities. “Safe routes” for visually impaired, of wheelchair users.
Fastes routes for bike-couriers
Nices routes for tourists
Easy to use with the v.a.r. headset
Ronald Huizer [email protected] CC-BY
Audio interface on mobile internet
Additional product concepts An orientation headset* with a compass
functionality (similar to Android G1/iPhone 3Gs) will enhance the opportunities for mobile orientation to an even more detailled level.
Based on your GPS position and viewing direction, an augmented reality application (to be developped) can reveil every information about locations, business, people etcetera.◦ Look at a buddy and find out who he is doing (with Google
latitude)
◦ Look at a star and hear what star it is (Google Stardroid)
Nonverbal communicator: In addiction to speech-to-text, a movement sensor (built in headset) can interpreter nonverbal communication, like nodding “yes” or “no” .
Ronald Huizer [email protected] CC-BY
Audio interface on mobile internet
“Turn left”
“There is a bookshopwith Lonely Planet
Iceland in that store on
your right hand”
“You’re buddy Paul is 1 mile close to you, do you want
directions?”
“Navigate to home”
“Skip commercial”
“Find Paul”
Ronald Huizer [email protected] CC-BY
Audio interface on mobile internet
Additional product concepts
Nonverbal communicator: In addiction to speech-to-text, a movement sensor/accelerator can interpreter nonverbal communication, like nodding left, right, up or down.
Commands like confirm, stop/skip, left & right, up & down, or customized commands can be given
This can be used in addition to manual and speech-to-text interfaces
This interface will also decrease the use of keyboard/touchscreens
Ronald Huizer [email protected] CC-BY
Comparison
Augmented Video* Augmented Audio
Heavy battery usage Lite battery usage, long endurance
Blocks/troubles normal sight Normale sight remains
Looks silly! Headsets are cool!
Costs 350 euro Costs 80 euro
Tablet or pda requires use of hands
Totally handsfree
Need good working eyes (noglasses when using VR glasses)
Suitable for everybody, especiallyvisually impaired. Not for hearing impaired.
* (with VR glasses, pda or tablet)
Next steps
Please preview and discuss my presentation;
I will be happy to answer questions and give additional explanation, and get feedback from you
Contact me [email protected]
Ronald Huizer [email protected] CC-BY
