Android Embedded - Smart Hubs als Schaltzentrale des IoT

Android Embedded

Smart Hubs als Schaltzentrale des IoT

Dominik Helleberg

Speaker

Dominik Helleberg

Mobile Development

Android / Embedded

http://dominik-helleberg.de/+

Android as we know + love it

Android everywhere?

Google Glass http://www.google.com/glass/start/Samsung Gear Live https://play.google.com/store/devices/details?id=samsung_gear_live_black

Android everywhere?

But there‘s even more...

https://twitter.com/Arubin/status/27808662429

Android Embedded

Amazon http://www.amazon.de/Kindle-Fire-Zoll-HDX-Display-WLAN/dp/B00D695H6OSamsung http://www.samsung.com/de/promotions/galaxycamera/Boing 787 http://www.boeing.com/boeing/commercial/787family/LG Kühlschrank http://www.lg.com/us/refrigerators/lg-LFX31995ST-french-3-door-refrigeratorMotorola MC3200 http://goo.gl/5dOVL7Honda http://www.golem.de/news/honda-connect-nvidias-tegra-faehrt-mit-android-in-japan-1410-109590.htmlNCR http://response.ncr.com/NCR-Kalpana

Android Embedded

How does it relate to IoT?

Android Embedded

Smart Hub

Smart Hubs

Smart Hub

Manage local „Things“

• Z-Wave

• ZigBee

• Thread

• WiFi

• Bluetooth (LE)

• ANT(+)

• BidCos

• KNX

• CAN Bus

• AUTOSAR

• BoardR-Reach

Smart Hubs

Smart Hub

Secure local „Things“

• Encryption

• Secure Connection

• Distribute Updates

• Firewall / Gateway

Smart Hubs

Smart Hub

Control local „Things“

• Centralized Logic

• Data Aggregation

• Status Reports

• Local HMI

Smart Hubs

Smart Hub

Smart Hubs are embedded Systems

• Robust

• Secure

• Easy to update

• Embedded friendly

• Rich Graphics

• Easy to build upon

Smart Hubs with Android

We do have

• Windows Embedded

• QNX

• Embedded Linux(s)

Is there anything new?

• Performance + HMI

• „App“ like Build-cycle

• Stable + Proven Architecture

• Pluggable Build System

• Robust + Secure OTA Update

• Protocols + Hardware integration

HMI Evolution

Canvas API

ViewsApplication

OpenGL ES

libHWUI SKIA

SurfaceFlinger

Hardware Acceleration “builtin”

Google „Power“

http://www.google.com/design/spec/material-design/introduction.html#https://www.youtube.com/watch?v=EBlTzQsUoOwhttp://www.anandtech.com/show/8231/a-closer-look-at-android-runtime-art-in-android-lhttp://arstechnica.com/gadgets/2014/07/examining-project-volta-we-put-android-l-through-our-battery-test/

Google „Power“

https://plus.google.com/u/0/104162817526798820937/posts/UVXbWmxWvBhhttps://www.openhub.net/p/platform_art

Current „State of the art“

Android Graphics Performance

Media Framework

https://source.android.com/devices/media.html

Android Graphics Performance

SystemService

Application Application logic

Java API / SDK / Documentation

Access to service over RPC

Manager Interface Binder Interface for the service (AIDL)

Manager Service

libhardware

Logic, Security Checks, Native JNI calls

Native “Interface” (header file)

driver.so

/dev/foo

Device Dependent Driver

Kernel / Module

SystemService

Application

/dev/foodriver.so

libhardware

Manager Service

Manager Interface

Java libs Android libsAndroidTools

Java Tools

shell@shamu:/ $ mount

rootfs / rootfs ro,seclabel,relatime 0 0tmpfs /dev tmpfs rw,seclabel,nosuid,relatime,size=1505044k,nr_inodes=171672,mode=755 0 0devpts /dev/pts devpts rw,seclabel,relatime,mode=600 0 0proc /proc proc rw,relatime 0 0sysfs /sys sysfs rw,seclabel,relatime 0 0selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0debugfs /sys/kernel/debug debugfs rw,relatime 0 0none /acct cgroup rw,relatime,cpuacct 0 0none /sys/fs/cgroup tmpfs rw,seclabel,relatime,size=1505044k,nr_inodes=171672,mode=750,gid=1000 0 0tmpfs /mnt/asec tmpfs rw,seclabel,relatime,size=1505044k,nr_inodes=171672,mode=755,gid=1000 0 0tmpfs /mnt/obb tmpfs rw,seclabel,relatime,size=1505044k,nr_inodes=171672,mode=755,gid=1000 0 0none /dev/cpuctl cgroup rw,relatime,cpu 0 0pstore /sys/fs/pstore pstore rw,relatime 0 0/dev/block/platform/msm_sdcc.1/by-name/system /system ext4 ro,seclabel,relatime,data=ordered 0 0/dev/block/platform/msm_sdcc.1/by-name/cache /cache ext4 rw,seclabel,nosuid,nodev,noatime,data=ordered 0 0/dev/block/platform/msm_sdcc.1/by-name/modem /firmware ext4 ro,context=u:object_r:firmware_file:s0,relatime,data=ordered 0 0/dev/block/platform/msm_sdcc.1/by-name/persist /persist ext4 rw,seclabel,nosuid,nodev,relatime,data=ordered 0 0/dev/block/platform/msm_sdcc.1/by-name/mdm1m9kefs3 /fsg ext4 ro,context=u:object_r:fsg_file:s0,nosuid,nodev,relatime 0 0adb /dev/usb-ffs/adb functionfs rw,relatime 0 0/dev/block/dm-0 /data ext4 rw,seclabel,nosuid,nodev,noatime,nodiratime,nobarrier,noauto_da_alloc,data=ordered 0 0/dev/fuse /mnt/shell/emulated fuserw,nosuid,nodev,noexec,relatime,user_id=1023,group_id=1023,default_permissions,allow_other 0 0

shell@shamu:/ $ mount

rootfs / rootfs ro,seclabel,relatime 0 0

selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0

tmpfs /mnt/asec tmpfs rw,seclabel,relatime,size=1505044k

/dev/block/platform/msm_sdcc.1/by-name/system /system ext4 ro,seclabel,relatime,data=ordered 0 0

• Read-Only System paritition

• SE-Linux ready

• Application Sandbox

• Encryption

• Verified Boot

• High Performance IPC (Binder)

Hardware

Smart Hubs with AndroidHardware

Komponenten

• SBC oder MBC• Base Board• (optional) CPU Board

• TFT / LCD Screen• Touch Sensor

• Screen / Touch Controller Converter

BaseBoard

CPUBoard

Screen + Touch Sensor

converter

ODroid http://www.hardkernel.com/main/main.php 46

Baseboard - Evaluation• SOC (CPU / GPU)• RAM• Storage• Interfaces

BaseBoard

CPUBoard

Baseboard• SOC (CPU / GPU)• RAM• Storage• Interfaces

BaseBoard

CPUBoard

SBC MBC

Screen + Touch• LCD / TFT Screen• Touch Sensor• Converter to „connect“ to

BaseBoard

Screen + Touch Sensor

converter

http://gadgetsin.com/uploads/2012/04/android_robot_lego_brick_building_kit_1.jpghttp://gadgetsin.com/uploads/2012/04/android_robot_lego_brick_building_kit_3.jpg

Build the Droid

terminology

Product and Board configuration

ModulesBuild Target

Build the Droid

product and variant management

● Boardconfiguration: contain hardware specific configurations

● Architecture (ARM/x86/mips,…)● Peripherals: GPS, Bluetooth,...● Boot Parameter,…● Inheritance

myBoardConfig.mk

fsl-BoardConfigCommon.mk

fsl-omx.mk fsl-codec.mkfsl-gpu.mk

Build the Droid

product and variant management

● Product configurations : describes software

● Device Name, Vendor Name, etc...● Pre-Installed Apps, Themes, Sounds● Localisation● Inheritance

my_product.mk

ereader.mk imx5x.mk

language_small.mkgeneric_no_telephony.mk

core.mk

http://gadgetsin.com/uploads/2012/04/android_robot_lego_brick_building_kit_1.jpghttp://gadgetsin.com/uploads/2012/04/android_robot_lego_brick_building_kit_3.jpg

Build the Droid

terminology

Product and Board configuration

ModulesBuild Target

three steps to your custom image 2/3

Build the Droid

build modules

Everything is a Module● Apps, ADB, Framework, SDK, Libraries, Fonts, etc. (3713 Modules in 5.0)● Defined in own Makefile: Android.mk● lot of stubs, extensive use of Makefile macros

packages/apps/Calculator/Android.mk:

LOCAL_PATH := $(call my-dir)LOCAL_MODULE_TAGS := optionalLOCAL_STATIC_JAVA_LIBRARIES := libarity android-support-v4 guavaLOCAL_SRC_FILES := $(call all-java-files-under, src)LOCAL_SDK_VERSION := currentLOCAL_PACKAGE_NAME := Calculator

Build the Droid

the result & releasetools

Results:● make droid: complete images for the target device, host tools

(boot.img, system.img, recovery.img…)● make dist: device_target_files

(a zip archive, containing all information to create every build system output)

Releasetools: a set of tools to create images, sign and verify images and updates● ./sign_target_files_apks

sign a build with test or debug certificates. All builds are signed!● ./img_from_target_files

create flashable images (called from ‘make droid’)● ./ota_from_target_files

create full or incremental over-the-air updates

For a Nexus 7 (2013)

1. configure the build: loads Product and Boardconfiguration in environment$> source build/envsetup.sh && lunch aosp_flo-userdebug

2. compile: builds “core” and each module that is included in this configuration

$> make droid -j8

....zzzZZZzzzZZZzzz...

3. Flash / distribute the result: runs releasetools, packs, signs & flashes the build

$> make dist || fastboot flashall

Build the Droid

three steps to your custom image

• Protocols + Hardware Integration

Smart Hubs with AndroidOTA Updates

Results:● make droid: complete images for the target device, host tools

(boot.img, system.img, recovery.img…)● make dist: device_target_files

(a zip archive, containing all information to create every build system output)

Releasetools: a set of tools to create images, sign and verify images and updates● ./sign_target_files_apks

sign a build with test or debug certificates. All builds are signed!● ./img_from_target_files

create flashable images (called from ‘make droid’)● ./ota_from_target_files

create full or incremental over-the-air updates

OTA Update

RecoverySystem.VerifyUpdate()

RecoverySystem. InstallUpdate()

verify signature

unpack archive

read argsfrom file

execute updaterbinary

execute edifyupdate script

cleanup

Android Recovery

save log &reboot

• Protocols + Hardware Integration

Smart Hubs with AndroidHardware Integration

SystemService

Application Application logic

Java API / SDK / Documentation

Access to service over RPC

Manager Interface Binder Interface for the service (AIDL)

Manager Service

libhardware

Logic, Security Checks, Native JNI calls

Native “Interface” (header file)

driver.so

/dev/foo

Device Dependent Driver

Kernel / Module

driver.so

/dev/foo

● Grove 16x2 display with I2C extension

○ LCD-Module

○ RGB-Module

● MarS Board with Android 4.0.4 (BSP)

● The LCD is connected through I2C

○ LCD 0x3e

○ RGB 0x62

driver.so

/dev/foo

● The Android Kernel is based on a Linux Kernel with some

android specific adaptations

● The Linux Kernel provides an I2C-Core-Driver

○ It is responsible for the communication between the devices

connected to the bus

● For the LCD-Module and the RGB-Module an I2C-Client-

Driver is needed

driver.so

/dev/foo

SystemService

Application

Manager Interface

Manager Service

libhardware

driver.so

/dev/foo

● Access to drivers through a HAL library (user space)

● HAL library uses the system call interface to get access to the

device files (/dev/lcd1313M1 u. /dev/rgb1313M1)

● A proprietary license can be used (Driver has to use GPL)

libhardware

● The HAL library consists of two components:

○ Implementation under:

■ /device/fsl/marsboard_6q/lcd1313M1

○ Header file under:

■ /hardware/libhardware/include/hardware

● The header file represents the interface of the HAL library

libhardware

● Some functions of the HAL library

○ displayInit()

○ setText(...)

○ setRGB(...)

○ backlightOn()/backlightOff()

○ ...

SystemService

Application

Manager Interface

Manager Service

libhardware

driver.so

/dev/foo

● The Manager Service consists of two components:

○ the native methods in

com_android_server_LCDService.cpp

○ LCDService.java

● com_android_server_LCDService.cpp includes the

header file of the HAL library and loads the library

● LCDService.java calls the native methods over the JNI

Manager Service

SystemService

Application

Manager Interface

Manager Service

libhardware

driver.so

/dev/foo

● A ILCDService.aidl file for the LCDService is needed

● This file contains the declaration of the functions callable

from Binder

● The .aidl file is used to generate a Binder-Interface for the

Java service (ILCDService.java)

Manager Interface

SystemService

Application

Manager Interface

Manager Service

libhardware

driver.so

/dev/foo

public class LCDManager

public static LCDManager getLCDManager()

IBinder b = ServiceManager.getService("lcd1313M1");

ILCDService service = ILCDService.Stub.asInterface(b);

return new LCDManager(service);

public int setText(String mString) {

return mService.setText(mString);

} catch (RemoteException e) {

return -1;

SystemService

Application

Manager Interface

Manager Service

libhardware

driver.so

/dev/foo

Smart Hubs with AndroidApplication Development

Smart Hubs with AndroidApplication Development – SDK AddOns

● How to get an App-Developer started?

● “Well, thats easy! Just ..."

○ Set up a linux box / VM

○ Install build chain

○ repo init && repo sync

○ lunch full-eng

○ make ...

SDK Addon

SDK Manager Integration

SDK Addon

device/inovex/

SDK Addon

Contents

System Image

Java Libraries / Stubs

Java Docs

lcd_sdk_addon-linux-x86.zip:

KernelHardware Definitions

(skins)

Metadata

SDK Addon

Contents

lcd_sdk_addon-linux-x86.zip:

SDK Addon

SDK Manager Integration I

SDK Addon

SDK Manager Integration II

SDK Addon

Gradle integration

SDK Addon

Android Studio

SDK Addon

Android Studio

SDK Addon

Emulator

SDK Addon

Emulator Log

D/LCDService( 203): LCD changed:D/LCDService( 203): /------------------\D/LCDService( 203): | inovex GmbH |D/LCDService( 203): | www.inovex.de/em |D/LCDService( 203): \------------------/D/LCDService( 203): Background: #FF5500

Is there anything new?

We do have

• Windows Embedded

• QNX

• Embedded Linux(s)

So tell me about the dark side...

• No Play Services (unless you go the CTS Route)

• (Almost) no documentation

• No Roadmap

• Obvious (?) things missing

• Realtime ?

So tell me about the dark side...

• No Play Services (unless you go the CTS Route)

• (Almost) no documentation

• No Roadmap

• Obvious (?) things missing

• Realtime ?

https://entwickler.de/IoT-Mag

Embedded Android + IoT

Devel Board

http://www.oreilly.de/catalog/9781449308292/index.htmlhttp://www.pearsonhighered.com/educator/product/Modern-Operating-Systems/9780133591620.page

Getting Started

Embedded Android

KontaktDominik Helleberg

http://dominik-helleberg.de/+Mail: dominik.helleberg@inovex.de

Vielen Dank für Ihre Aufmerksamkeit!

Android Embedded - Smart Hubs als Schaltzentrale des IoT

Software

Deﬁning the Digital e of our Cities...Dell Technologies Edge and IoT solutions help make them hubs of innovation in an ever-growing, ever-connected world. Edge and IoT Make Cities

ACOUSTIC HUBS

Impact from Excellence: The role of innovation hubs · Definitive IoT Testbed Island • Blanket Ireland in IoT Infrastructure • Connect a million Things • Can assess sensors,

ESP32-C3 Family...– Internet radio players • Generic Low-power IoT Sensor Hubs • Generic Low-power IoT Data Loggers 4 Y Contents Product Overview 2 Block Diagram 2 Features 3

EDJE PROJECT - EclipseTHE EDJE PROJECT Sensors/Actuators Local Network Internet A Java library at the edge of the IoT for sensor hubs and devices EDJE FOCUS IOT: DEVICES & GATEWAYS,

ALS Overview and ALS Curriculum

Narrowband-IoT: doorbreek de grenzen van IoT - …NB-IoT is een technologie die is ontwikkeld door 3GPP, en gestandaardiseerd als onderdeel van de 3GPP release 13 in juni 2016. Het

Industry 4.0 - What it really means in an production ...aws-de-media.s3.amazonaws.com/images/HMI... · Dynamics, BizTalk Services, Azure IoT Hub Notification Hubs OPC Clients, Servers,

WISE-PaaS IIoT Cloud Platform Architecture and Service · and reliable two-way communication between cloud-based IoT Hubs, edge gateways, and IoT sensing devices. 1.3 Device Management

Careers Hubs · Careers Hubs: One Year On careersandenterprise.co.uk 2. About the evaluation The purpose of evaluation of Careers Hubs is to find out: • The impact of Careers Hubs

The Internet of Things · Home IoT Local managers (which may be apps on a phone or computer) talk to hubs Hubs talk to devices via private protocols Hubs talk to vendor servers Things

Top IT hubs

Identification of Alaska’s Regional and Subregional Hubs FISH… · Hub selection process ... Hubs by Region: Interior. Hubs by Region: Northwest. Hubs by Region: Prince William

This time last year…...GEEK NIGHT Thames Valley IoT Meetup Use existing hubs and meetups Thames Valley IoT Meetup READING GEEK NIGHT •Launchpad for TTN Reading •Regular monthly

FOOD HUBS Y LA RED DE FOOD HUBS EN MÍCHIGAN

Telemetry with Windows 10 IoT Core : from Raspberry Pi2 to Event Hubs

Actionable Insights with PI Integrators - OSIsoft...visibility into systems and performance. The implementation of PI connected over 10 ... Apache Kafka Azure IoT Hub Azure Event Hubs

CognitionTM Hubs

Developing and delivering future mobility in GM · 5G & mobility hubs GMEV Cityverve Smart City IoT Smart Shared Green Mobility Hubs First of a Kind 2 Future funding - H2020, iUK,

Intelligent Edge and Intelligent Cloud - Microsoft · Intelligent Edge Azure IoT Edge Windows IoT Azure Sphere Microsoft IoT . Intelligent Cloud ... multiple IoT Hubs Re-provisioning