Sensors: Getting Engaged!

7/30/2019 Sensors: Getting Engaged!

1/39

1 t h e p a c a . n e t

Sensors: Getting Engaged!Sensors: Getting Engaged!

Event

I/O: The Museum Inside-Out/Outside-In38th Annual MCN Conference

Austin, Texas

Presented by

Abhijit RaoAbhijit RaoPlan A Computing AssociatesPlan A Computing Associates


2/39


Sensors: Getting Engaged!Sensors: Getting Engaged!


3/39


Sensors: What are they?Sensors: What are they?

Miniature devices that capture sensory dataReact to external stimuli

Sensory data incl. heat, humidity, light....Micro Electro-Mechanical Systems (MEMS)

Data transmission is wireless, whereas theSensing mechanism and power supply are notSensor: Structure

Physical

Transducer + Control Logic(Analog + Digital)

AbstractPart of a bigger network


4/39


Sensors: What are they all about?Sensors: What are they all about?

Captures sensory data from real physical world

Detecting relevant quantities of the data

Monitoring and collecting the data

Assessing and evaluating collected data

Formulating meaningful information

To be conveyed to the user

To be stored for future

Performing decision making


5/39


Sensors: Why Museums?Sensors: Why Museums?

Traditional Uses

User interaction

Exhibit Design

Ubiquitous ComputingWhere technology recedes into the

background of our lives. - Mark Weiser

Tetherless

Experience

Planned

Activity

Sensing

Capability

Wow!

Sensors provide Physically unobtrusive, low power, form factor, low maintenance

New sensing paradigms


6/39


Sensors: Outlining a FrameworkSensors: Outlining a Framework

ExhibitExhibit

RemoteRemote

ExhibitExhibit

Back OfficeBack Office

ObserverObserver

Link / AgentLink / AgentSensor NetSensor Net

Sensor FusionSensor Fusion

Sensor ManagementSensor Management

db Managementdb Management

...... Services

Services


7/39


Sensor: Ecosystem PlayersSensor: Ecosystem Players

Multiple devices per square meter Mixed data rate requirements Varying streaming requirements

Real-time and tolerate latencyDatabases Static Database Content, Plan & Rules Dynamic Database User activity context, Sensor data

Applications Visitors

Sensors

Middleware

Services

ApplicationsDatabase


8/39


Sensors: Sense ElementSensors: Sense Element

TransducerTransducerPhysical propertyto be sensed

Detectablesignal

Also known as

Sensor Acceleration measured Accelerometer

Sensor Pressure measured Voltage output Pressure senso

Actuator Digital Signal Voice Loudspeaker

Actuator Digital Signal Rotary Motion Electrical Mot

Transducer

type

Input (Property of Interest

for Sensor)

Output (Property of Interest

for Actuator)

Digital representation (along

the axes)

Source:Springer.com

Author:JFortin


9/39


Sensors: Typical SensorSensors: Typical Sensor

Source:Spring

er.com

Author:JFort

in

Sense ElementSense Element

Physical Propertysuch as heat, light

Signal(Charge current)


10/39


Sensors: Transducer DetailsSensors: Transducer Details

Energy Domain Measurand Sense Principle

Physical Properties Pressure Piezoresistive, Capacitive

Temperature Thermistor, Thermo-mechanical

Humidity Resistive, capacitive

Motion Properties Position Electro-Magnetic, Contact Sensor

Acceleration Vibration (Proof-Mass), Capacitive

Gyroscope Capacitive, Electro-Magentic

Contact Strain Piezoresistive

Vibration Piezoresistive, Sound

Presence Tactile/Contact Contact, capacitive

Proximity Hall effect, Magnetic, RF

Identification ID

Fingerprint, data stored, retinal

scan

Source: Silicondesigns.com


11/39


Sensors: SMART SensorSensors: SMART Sensor

Provides extra functions beyondjust the correct representationof the sensed physical quantity

Moving the intelligencecloser to the point of

measurement

Control Logic

Virtual Sensor

Sense

Element

(MEMS)

Application

Algorithm

Communication

Interface

Analog-to-Digital

Conversion

Signal

Conditioning

Digital Signal

Processing

User Interface

buttons/led

Storage

(Threshold / Calibration)

Physical

Input

Base StationBase Station HostHost

SMA

RTSen

sor

SMA

RTSen

sor

S.M.A.R.T.Self-Monitoring,Analysis, and

ReportingTechnology


12/39


Sensors: Virtual SensorSensors: Virtual Sensor

Virtual SensorVirtual Sensor

Source:sparkfun.com

Control Logic

Virtual Sensor

Sensor

Element

Application

Algorithm

CommunicationInterface

Analog-to-

Digital

Conversion

Signal

Conditioni

ng

Digital Signal

Processing

User

Interface

buttons/led

Storage

(Threshold /

Calibration)


Smart

Sensor

Smart

Sensor


13/39


Sensors: Wireless ConnectivitySensors: Wireless Connectivity

Source:laboratoryequipment.com


14/39


Sensors: Power & NetworkingSensors: Power & Networking

Source:labo

ratoryequipment.com

Source:techbrie

fs.com


15/39


Sensors: Key DriversSensors: Key Drivers

Drivers Today's sensor future

Scale Micro Nano

Power consumption long life (> 2 years) energy harvesting

Improving Cost & Yield

Standardization efforts in Wireless Networking

Cheaper Efficient Tinier Processing Logic

Quick Integration Methods

Development of low power radio technologies

Advances in low-power embedded micro-controllers


16/39


Sensors: System DesignSensors: System Design

Wireless NetworkingMiddleware ServicesData ManagementSensory User Interaction (SUI)

ApproachIdentify the use case scenarios

List sense element and energy domain details

Calculate anticipated workloadIdentify the sensor network algorithmsPerform the Sensor System Design inconjunction with the Exhibit Design


17/39


Sensor: Identifying a SensorSensor: Identifying a Sensor

Identify the measurandEnergy Domain

Usage PatternBandwidth and other resource requirements

CharacteristicsPower consumptionNetwork supportForm factor

Volume of sensors to deploy and useVendor selectionMinimum Quantity requirementsLead time


18/39


Sensors: Technology restrictionsSensors: Technology restrictions

Size and packagingEnergy efficiency (Power constraints)Data rates for the wireless data transfer

High data rates (Audio/Video) / StreamingLow data rates (spatial sensors, environmentsensing)

Fine grained estimation and tracking oflocation and orientation of large number of

objects that are being sensedQuality of Service needs


19/39


Sensors: System ExampleSensors: System Example

Sensors - LightweightLocation & OrientationIdentification

Network Agent Conduit for the sensors

Master Act upon sensor data

Location & Orientation

Identification

Object Tracking

Spatial Configuration ofmultiple users and objects


20/39


Agent Host

Sensors: Outlining a FrameworkSensors: Outlining a Framework

Sensor 1

Sensor 2

Sensor 3

Computer Web

Exploration & Learning Plan

Content Management

Exploration & Learning

Interaction

Handheld

System Hardware Software App stackSensors


21/39


Sensors are a mature market!Sensors are a mature market! Using those sensors in a large scale, inUsing those sensors in a large scale, in

Museums, will have aMuseums, will have a rrevolutionary effect in userevolutionary effect in user

experience.experience. Sensory User Interaction is here to stay!Sensory User Interaction is here to stay!

If there is sufficient interest we can explore opening a SIG under MCNIf there is sufficient interest we can explore opening a SIG under MCN

To receive these slides, please send an email [email protected]

Sensor: Getting Engaged!Sensor: Getting Engaged!
mailto:[email protected]:[email protected]


22/39


Thank you!Thank you!


23/39


BackupBackup


24/39


Sensors: Experience RealmsSensors: Experience Realms

Sensors can enhancethe all experiencerealms


25/39


Sensor: Sample applicationsSensor: Sample applications

Wireless network of toysLearning individualized to the participant /each child

Unobtrusive evaluation of the learning process

Hidden in the infrastructure (walls,chairs, ...)Music toys (MIT Media Lab's Toy Symphony)

Heavy on gestures and tactile in nature

Embed sensors for touch, pressure .. in toysand exhibit objects and detect theirmanipulation

Sensors: Compare to a typical ComputingSensors: Compare to a typical Computing


26/39


Sensors: Compare to a typical ComputingSensors: Compare to a typical ComputingSystemSystem

Ad-hoc and Distributed structureLikely to be large scale yet sparse in densityUnreliability due to nature of the link

Restricted system resources, Power

managementOvercome by huge amount data that getscollected (redundancy)

Physical stimulus and reactionary in nature

Predominantly unstructured and asynchronousDiversity of data types with large dynamicrange of rate, latency, processing requirements


27/39


Sensors: Transducer PropertiesSensors: Transducer Properties

Physical PropertiesUsed to measure Pressure, temperature, Humidity...

Motion PropertiesUsed to measure Acceleration, Position, Angularvelocity, Direction

Contact PropertiesUsed to measure Vibration, Slip, Strain

PresenceUsed to measure Tactile, Contact, Proximity, Motion,Light

IdentificationUsed to measure ID Data, Retinal, Voice, ...


28/39


Sensors: Sense Element BasicsSensors: Sense Element Basics

Energy Domain Characteristic Transduction Principle

Mechanical

Thermal

Optical

Rely on direct

Physical

contact

Capacitive Sensors as in Touch

Sensors Piezoelectric effect

as in balls that lit when

bounced

Electromagnetic/ Magnetic

Useful for

detecting

proximityevents

Eddy-current sensors allows

bigger sensing range and

bigger probe spot size RFID

use power in the interrogating

signals to send back smallamounts of data

Measure

temperature or

heat flux

Thermoresistive effect

exploits resistance of a

conductor/semiconductor

changes with temperature

Thermocouples sensor based

on current flows between two

materials are joined together

and one is hotter than the

other. It is less expensive

and is very reliable ResonantTemperature sensors are

expensive and very high

accuracy.

convert light

to various

quantities

Photoelectric effect measures

the flow of electrons based on

incident light

Source:lionprecision.com

Source:analog.com

Source:eetimes.c

om


29/39


Sensors: Other Sensor ElementsSensors: Other Sensor Elements

Energy Domain Description / Uses

Chemical

Biological Medical Diagnostic, detecting Pesticides

Chemiresistors

Biosensors

EM spectrum Radar / Lidar, GPS

Acoustic

Acoustic Wave

Interact with matter of all types Used in sensing

pollutions causing gases

Implemented with an array of chemical sensors,

interpreted using a pattern-recognition algorithm to

sense a variety of chemicals. Used in Contamination

assessment

Metal-Oxide

Gas sensors

relies on adsoprtion of gases onto certain

semiconductors changes their resistivity. Used in

smoke detectors

Sensing depends upon selectivity of biomolecular

reactions such as molecular binding sites detect

property changes mass, resistance, spectral reading

Sound as the sensing medium detecting fluid leakages

and earthquakesEmploys two sets of fingers one to generate the

surface Acoustic Wave and the other to detect the

changes. Very versatile in its applications.

Source:sandia.gov

Source:sensormag.com


30/39


Sensors: Mapping a Smart SensorSensors: Mapping a Smart Sensor

Control Logic

Virtual Sensor

Sensor

Element

Application

Algorithm

Communication

Interface

Analog-to-Digital

Conversion

Signal

Conditioning

Digital Signal

Processing

User Interface

buttons/led

Storage

(Threshold /

Calibration)


Smart

Senso

r

Smart

Senso

r


31/39


Sensors: MEMS Sensor SoCSensors: MEMS Sensor SoC

Control Logic

Virtual Sensor

Sensor

Element

ApplicationAlgorithm

Communication

Interface

Analog-to-Digital

Conversion

Signal

Conditioning

Digital Signal

Processing

User Interface

buttons/led

Storage(Threshold /

Calibration)


Smart

Senso

r

Smart

Senso

r

Source: invensense.com

S F f t


32/39

32

t h e p a c a . n e t

Sensors: Form factorSensors: Form factor

Standalone

Integrated onto a PCBS

ource:monnit.com

Source:kcftech.com

Source:freescale.com

S Ad i T dS Ad ti T d


33/39

33


Sensors: Adoption TodaySensors: Adoption Today

Building industry, Green evolution,Transportation, Home automation, ...Importance indicated by IEEE drivenstandards in this space

Driven by affordability and ease of useEfficient and low cost connectivity methodsClassified solutions based on data rates

B kB k


34/39

34


BackupBackup

S Ch llS Ch ll


35/39

35


Sensor: ChallengesSensor: Challenges

PowerLack of ruggednessSteep learning curve

A t t Di l T h lA t t Di l T h l


36/39

36


Actuator: Display TechnologyActuator: Display Technology

Source: flexlighing.com Source: holografika.com

Source: microvision.com Source: mirasoldisplays.com

A t t T til F db kActuator: Tactile Feedback


37/39

37


Actuator: Tactile FeedbackActuator: Tactile Feedback

Source: densitron.comSource: densitron.com

Source: immersion.com

Actuator and Sensor Combined:Actuator and Sensor Combined:


38/39

38


ctuato a d Se so Co b edTouchable 3D DisplayTouchable 3D Display

Source: docomo

ReferencesReferences


39/39

39


ReferencesReferences

Weiser, Mark The Computer for the 21st

Century Scientific American Vol 265 p 66-75

http://www.ubiq.com/hypertext/weiser/SciAmDraft3.html

Smart Kindergarten: Sensor-based Wirelessnetworks for Smart Developmental Problem-solving environments - ACM ISBN1-58113-422-3/01/07

Documents

Sensors: Getting Engaged!