44
URUS project: Communication Systems URUS project: Communication Systems Prof. Alberto Sanfeliu Di t Director Institute of Robotics (IRI) (CSIC-UPC) Technical University of Catalonia October 15th, 2009 http://www-iri.upc.es IROS_NRS_Workshop_USA_2009

URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

  • Upload
    others

  • View
    6

  • Download
    0

Embed Size (px)

Citation preview

Page 1: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

URUS project: Communication SystemsURUS project: Communication Systems

Prof. Alberto SanfeliuDi tDirector

Institute of Robotics (IRI) (CSIC-UPC)Technical University of Catalonia

October 15th, 2009http://www-iri.upc.es

IROS_NRS_Workshop_USA_2009

Page 2: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Index

The URUS project Experiment locations an experiments System architecturesSyste a c tectu es

URUS Global architecture Tibi & Dabo architectures

Communication Systems Global communication system COMM component Ad-hoc networking: the MANET component

Example of complex communications in URUS

IROS_NRS_Workshop_USA_2009

Page 3: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

URUS project

IROS_NRS_Workshop_USA_2009

Page 4: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

URUS projectp jUbiquitous Networking Robotics in

U b S ttiUrban Settings

http://urus.upc.es

IROS_NRS_Workshop_USA_2009

Page 5: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

URUS Project Objectives

Objectives: The main objective is to develop an adaptable network robot The main objective is to develop an adaptable network robot

architecture which integrates the basic functionalities required for a network robot system to do urban tasks

1. Scientific and technological objectives- Specifications in Urban areas- Cooperative localization and navigationp g- Cooperative environment perception- Cooperative map building and updating

Human robot interaction- Human robot interaction- Multi-task allocation- Wireless communication in Network Robots

- 2. Experiment objectives- Guiding and transportation of people

S ill St d i i bli

IROS_NRS_Workshop_USA_2009

- Surveillance: Steward service in public spaces

Page 6: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

URUS PartnersInstitut de Robótica i Informática Industria (IRI)

Universitat Politécnica de Catalunya (UPC)

Centre National de la Recherche Scientifique/ LAAS

Eidgenössische Technische Hochschule/ ETHZg /

Asociación de Investigación y Cooperación Industrial de Andalucia/ AICIA

Scuola Superiore di Studi Universitari e di Perfezionamento Sant’Anna/ SSSAp /

Universidad de Zaragoza/ UniZar

Instituto Superior Técnico/ ISTp /

University of Surrey/ UniS

Urban Ecology Agency of Barcelona/ UbEcU ba co ogy ge cy o a ce o a/ Ub c

Telefónica I+D/ TID

RoboTech / RT

IROS_NRS_Workshop_USA_2009

Page 7: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Experiment Locations

IROS_NRS_Workshop_USA_2009

Page 8: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Experiment Locations: Scenario 1UPCUPC

Zone Campus Nord, UPC

Barcelona ROBOT Lab

IROS_NRS_Workshop_USA_2009

Page 9: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

1

5 6

71

8

9Barcelona ROBOT LabCampus Nord, UPC

100 m

2

3

1 3 95

4

7

10

100 m3 95

2 84 106

IROS_NRS_Workshop_USA_2009

Page 10: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

IROS_NRS_Workshop_USA_2009

Page 11: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Experiment Location: Scenario 1UPCUPC

IROS_NRS_Workshop_USA_2009

Page 12: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Experiment Location: Inauguration

IROS_NRS_Workshop_USA_2009

Page 13: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Experiment Location: Scenario 2Gracia DistrictGracia District

IROS_NRS_Workshop_USA_2009

Page 14: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Robots in Experiment Site 1

IROS_NRS_Workshop_USA_2009

Page 15: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Robots in Experiment Site 1

Video of Tibi and Dabo

IROS_NRS_Workshop_USA_2009

Page 16: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Robots in Experiment Site 1

Smarttek robotVideo of Romeo robot

IROS_NRS_Workshop_USA_2009

Page 17: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Experiments

Urban experiments:

1.- Transportation of people and goods

Transporting people and goods Transporting people and goods Taxi service requested via the phone User request the service directly

2.- Guiding people Guiding a person with one robot

3.- Surveillance Steward service in public spaces. Steward service in public spaces.

4.- Map building

IROS_NRS_Workshop_USA_2009

Page 18: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

System Architectures

IROS_NRS_Workshop_USA_2009

Page 19: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

URUS Global ArchitectureURUS_rot3D.exe

Robot 1 Robot 2 Robot N

Ethernet (Gb)

Functional Layer

SupervisorTask Allocation

Functional Layer

SupervisorTask Allocation

Functional Layer

SupervisorTask Allocation

WLANGSM/3G

WLANGSM/3G

WLANGSM/3G

Ethernet

Blue ToothMica2/Ethernet network

EnvironmentPerception

Task Allocation

GSM/3G NetworkCentral Station

IROS_NRS_Workshop_USA_2009

GSM/3GInterface

Global Supervision

Page 20: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Tibi & Dabo Architectures

IROS_NRS_Workshop_USA_2009

Page 21: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Communication Systems

IROS_NRS_Workshop_USA_2009

Page 22: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

URUS Communication Objectives

Transparent communication between services running in different entities regardless of WirelessLocal Area Network (WLAN) connectivity availability and changing propagation issuesissues

Traffic management and to allow Real time in communications between robots while performing cooperative tasksbetween robots while performing cooperative tasks,

Location and identification of nodes of the Wireless Sensor Network (WSN), for instance a node carried by a person or a robot, to ease service provision.

IROS_NRS_Workshop_USA_2009

Page 23: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

URUS Communication Systems

IEEE 802.11a

IEEE 802.11a

IROS_NRS_Workshop_USA_2009

Page 24: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

URUS Communication Systems

Internal Communication: Between components of the same entity We have developed an URUS communication protocol based on

YARP (Yet Another Robot Platform)

External Communication: Between components running in different entities We are using 4 different network technologies: We are using 4 different network technologies:

Infrastructure (WLAN), Mobile Ad-hoc Network (MANET) (WLAN), Personal Area Network (PAN) (Bluetooth) and MOBILEMOBILE

(GSM/3G.

We have developed the following components The COMM component The MANET component

IROS_NRS_Workshop_USA_2009

The MANET component

Page 25: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

COMM Component

IROS_NRS_Workshop_USA_2009

Page 26: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

COMM Component

IROS_NRS_Workshop_USA_2009

Page 27: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

COMM Requirements

Hide the complexity associated to the use of WLAN for comm nications and cell lar net orks as back pcommunications and cellular networks as backup.

Offer URUS Communications Protocol interfaces for local components to request communications services (including thecomponents to request communications services (including the MANET Component when the robot plays the role of Gateway when involved in a MANET).

Provide the means for best effort connectivity between Robots and with the Central Station (CS).

Detect connectivity loses in WLAN and re-direct traffic to GSM/3G as a backup.M i t i d t d i f ti h t h tit i th Maintain updated information on how to reach any entity in the robotic system (Robots may be using their WLAN fixed IP address or their 3G dynamic IP address in different moments).

IROS_NRS_Workshop_USA_2009

Optimize remote communications.

Page 28: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Architecture of the COMM Component

IROS_NRS_Workshop_USA_2009

Page 29: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

COMM Functions

Network interfaces: This module wraps the drivers for the WLAN and 3G/GSM cards that will be used Provides access to basic functions3G/GSM cards that will be used. Provides access to basic functions associated to data exchange and monitoring.

IP transmission: It implements the transport mechanisms over IP to meet p pthe communications needs of the the local robot components with components in different robots.

N k M i i Thi d l d l i h i i RF d IP Network Monitoring: This module deals with monitoring at RF and IP level. RF Monitoring: It monitor RF activity and triggers interface selection

b d ti il bilit d WLAN i l t thbased on connection availability and WLAN signal strength. IP Monitoring: It monitors IP activity and triggers interface selection

based on IP transport related events (timeouts, lost packages, delivery errors etc)errors, etc).

Interface selection: Manages physical interface selection depending on RF and IP status.

IROS_NRS_Workshop_USA_2009

and IP status.

Page 30: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

COMM Functions

Node / Service Availability: Maintains updated information on how to reach any entity in the robotic system in coordination with other robots andreach any entity in the robotic system in coordination with other robots and the CS.

Communications proxy: Wraps the component to comply with the URUS p y p p p yCommunications Protocol.

Request-Reply and Datafeed connections: Request-Reply provides a way for point to point two way

communications and works on a demand basis. Datafeed provides a way for point to multi-point one way p y p p y

communications and works on a subscription basis.

IROS_NRS_Workshop_USA_2009

Page 31: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

High Level Operations for Reply-Request and Data Feed CommunicationsData Feed Communications

IROS_NRS_Workshop_USA_2009

Page 32: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

A iAd-hoc Networking: The MANET ComponentThe MANET Component

IROS_NRS_Workshop_USA_2009

Page 33: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Motivation

Robot formation

leader Path planningObstacle avoidance

Slave robotsSpecific motion control

IROS_NRS_Workshop_USA_2009

Specific motion control[Mosteo et al. ICRA08]

Page 34: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

MANET Software Component Interaction

IROS_NRS_Workshop_USA_2009

Page 35: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Architecture of the MANET Component

Provides multi-hop communication supportcommunication support in Real Time

IROS_NRS_Workshop_USA_2009

[Tardoli and Villarroel. ICMASS07]

Page 36: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Example of Complex Communications

IROS_NRS_Workshop_USA_2009

Page 37: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Communication in Cooperative Environment PerceptionCooperative Environment Perception

Cooperative environment perception

Cooperative perception using:• embedded and own sensors• fusion techniques and technologies

IROS_NRS_Workshop_USA_2009

Page 38: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Communications Between Different Processes Communications for cooperative person tracking in URUS and

decentralized estimation between robots, camera network and WSN

Information channels

decentralized estimation between robots, camera network and WSN

Data association

Datafusion

Data association

Datafusion

Data association

Datafusion

Local Processing

Robot

Active Perception Local Processing Active

Perception Local Processing Active Perception

Robot Camera Network Wireless

Sensor NetworkNetwork

IROS_NRS_Workshop_USA_2009

Page 39: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Example of Communication in Camera Networkin Camera Network

21 cameras with little camera overlap Shadows challenging Delineates foreground objects from

non-stationary background e g treesnon-stationary background e.g trees

IROS_NRS_Workshop_USA_2009

Page 40: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Example of Communication in Camera Network: Trackingin Camera Network: Tracking

IROS_NRS_Workshop_USA_2009

Page 41: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Communication for Guiding People (I)Robot formation

Dog shepherding

IROS_NRS_Workshop_USA_2009

Page 42: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Communication for Guiding People (II)

Simulation resultsSimulation resultsGuia_personas_Anais_1.avi

IROS_NRS_Workshop_USA_2009

Page 43: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Communication for Guiding People (III)

Simulation resultsGuia_personas_Anais_3.avi

IROS_NRS_Workshop_USA_2009

Page 44: URUS project: Communication SystemsURUS project ...digital.csic.es/bitstream/10261/30173/1/URUS project communicatio… · URUS Project Objectives Objectives: The main objective is

Conclusions

The communication system allows to share information in the urban site between different entities.

The COMM component is a valuable software tool that allows to maintain the connectivity.

The MANET component allows to maintain robot formation pwithout the need of the urban network.

IROS_NRS_Workshop_USA_2009