Embed Size (px)
Citation preview
Hardware Sensor Integration for mobile
LearningPrasoon NigamCTO / Vice President – TechnologyStratbeans [email protected]@prasoonnigam
Coverage• What are the sensors and other sensory elements.• Why sensor integration has revolutionary potential in
learning context – ILT vs CBT.• When is the right time for sensor integration – are we late ?• How to integrate basic to complex sensors to enhance
learning content – demo, if time permits.
WHATWhat are the sensors and other sensory elements
SENSED : THE IMAGEPROCESSED : IDENTIFIED IT BE RELATED WITH XMENINTEGRATED: WHY IS HE SHOWING ME THIS, HOW IS IT CONNECTED TO HIS TALK ?
What is a SensorSensor “receives”, “transmitted” information which is then “processed “for meaningful ends
LIGHT SEE
What is a SensorSensor “receives”, “transmitted” information which is then “processed “for meaningful ends
Eye
Webcam
Sensory Universe : Sensors, Transmitter, Processor
ProcessorIntegrator
SensorTransmitter
Sensory Universe : Sensors, Transmitter, Processor
ProcessorIntegrator
SensorTransmitter
WHYWhy sensor integration has revolutionary potential in
learning context – ILT vs CBT.
Lets spot sensory universe elements involved in ILT situation
ILT : Instructor Learner
MORE SENSORY ELEMENTS => MORE INTELLIGENCE / MORE LEARNING
Do you know the name of the XMEN Instructor with…
ILT : Instructor Learner
x x x
x x NO EAR, NO EYESMUCH SMALLER BRAIN
BRANCHING SIMULTION, SCORES ASSESSMENT
MUTANT POWERPRESENT EVERYWHERE AT SAME TIME,
Answer is : Madame CBT
MAGNETO STOLE HER SENSORS
Moment of Truth …
ILT : Instructor
x x
x x
CBT : Self Paced
NO EAR, NO EYESMUCH SMALLER BRAIN
BRANCHING SIMULTION, SCORES ASSESSMENT
MUTANT POWERPRESENT EVERYWHERE AT SAME TIME,
Answer is : Madame CBT
MAGNETO STOLE HER SENSORS
From “OR” to“AND”
OR
ILT : Instructor CBT : Self Paced Learner• Personalized• Intelligent• Adapts with Learner’s need
• Scalable• Self Paced• Geography Independent
Think, if we are able to give Madame CBT her sensory power back ... to make her “intelligent AND scalable”
Best of Both Worlds : The Smart CBT• Adapting Content to match learner’s state of
mind• Adapt interactivity• Adapt Engagement• Advices learner to take a break
• Interprets Brain Waves to determine cognitive state of mind• Hands Free Navigation
• Speech Detection• Movement Detection• Customized Gestures
• Detect Confidence Level through speech analysis of learner• Location based learningSmart CBT/mLearning
WHENWhen is the right time for sensor integration – are we late
?
Time
Number of SensorsInternet Of ThingsTIME IS
“NOW”FOR mLEARNING TO LEVERAGE THESENSORS
The Irony !
LEARNING CONTENT in IRON WALLS
The IRON WALL between• mLearning• Sensors on device
HOWLow hanging fruits + Advance Ideas
Simple to Complex Sensor Integration Ideas1.Brain wave detection 2.Hands free navigation of content
using Hand Gestures3.Augmentation of content using AR
apps4.Voice based response5.Confidence level detection6.Distraction detection
1: Detect Brain Attention LevelApplication Area:• Depending on brain attention level, user is
suggested to • BREAK• ENGAGE• INTERACT
SENSOR :EEG
DEMO AVAILABLE
Brain Wave Type
Implication
Gamma Problem solving, concentrationBeta Active Mind, BusyAlpha Restful, RelaxedTheta DrowsinessDelta Sleep / Dreaming
1: Detect Brain Attention Level
SENSOR :EEG
DEMO AVAILABLE
- Operating condition for learning- Adaptive content- Grade a content, before releasing
1 : Hands-Free Navigation of Content using Hand GesturesApplication Area: • Performance support system in Restaurant.
Staff can refer to recipe steps, while preparing the food
SENSOR : CAMERA
DEMO AVAILABLE
2: Augmentation of Content using Augmented Reality AppsApplication Area:• A complex process flow, comes alive with
videos that explain that step in depth• A user is attempting a check your
knowledge, clue appears for the knowledge options
• School children is reading about planetary system, Screen comes live with video, explaining about the planet he clicked
SENSOR : CAMERA
DEMO AVAILABLE
3: Voice Based Response Application Area: • Response to an assessment can be spoken
out instead of typed
SENSOR : MIC
DEMO AVAILABLE
DO NOT WASHDO NOT DRYWASH IN COLD WATERGIVE IT YOUR MOM
DO NOT WASH
What does this mean?
What is the Color of an apple?
What is Gravity?
How do you determine time?
What does this mean?
4: Confidence Level DetectionApplication Area: • A Customer support executive (voice
process), speaks out an answer and using speech analytics, he is tested on various performance parameters like “speed of response”, “tone”, “confidence”
SENSOR : MIC
5: Distraction DetectionApplication Area: • A learner is showing patterns like “shaking of
legs”, “no significant movement”, “body temperature” , “heart rate” and the content pops-up• BREAK : Suggest the user to take a break• ENGAGE : Put more engaging level of the
same content - “Watch a video to understand better”
• INTERACT : Put a CYU question related with the topic
SENSOR : BIO-WEARABLE
Final Note• Sensor integration is NOW a reality – wearable, camera & brain wave are top picks • Demand sensor smart content from your content
development/technology integration teams• Take baby steps• Yes SCORM / xAPI complaint sensor integrated content are
easily doable• Discuss what are the other possible application of
smart content Lets pledge to give Madame CBT her sensors back !
END
