28
Autonomous Systems Non-intrusive localization, autonomous navigation and accurate positioning of AGV’s for cooperative transportation of heavy added value loads Carlos Rizzo, PhD [email protected] https://eurecat.org/en/portfolio-items/geomove/ Eurecat Technology Center ERF 2018 - March 2018

Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems Non-intrusive localization, autonomous navigation and

accurate positioning of AGV’s for cooperative transportation

of heavy added value loads

Carlos Rizzo, [email protected]

https://eurecat.org/en/portfolio-items/geomove/Eurecat Technology Center

ERF 2018 - March 2018

Page 2: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 2

EURECAT

Eurecat is the leading Technology Centre in Catalonia, a result of the integration, in 2015, of Ascamm, Barcelona

Media, BDigital, Cetemmsa and CTM.

Page 3: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 3

Eurecat in numbers

Page 4: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 4

Eurecat research units

Page 5: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous SystemsAerial Robot for Sewer Inspection

Autonomous SystemsResearch Group

Applied-research on Autonomous Robots in

real use-cases

Ground and Aerial robotics

Field and Industrial Applications

Page 6: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 6

Research LinesAUTONOMOUS SYSTEMS

Localization• Multi-sensor robust localization

(IMU + vision + laser + GNSS)

• Simultaneous Localization andMapping (SLAM)

• Precise GNSS

Control• Motion control

• Auto Take-Off and Landingon mobile platforms

• AGV auto-docking and multi-AGV following

Heterogeneous multi-robot systems• Ground and aerial robots

cooperation• Communications• Task planning

Navigation• Specialized path planners• Collision avoidance• Infrastructure servoing: wall

tracking, vertical pipe tracking.• 3D flight planning based on

models or geometric shapes(helicoidal, etc)

Vision and Perception• Vision based navigation• 3D scene reconstruction• Victim detection• Image segmentation• Thermal, multispectral and

stereo imaging

Page 7: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 7

ApplicationsAUTONOMOUS SYSTEMS

Oil and Gas industry Electric towers, wind turbinesRailway networks monitoringTunnels, bridges and damns

Search and RescueBorder securityFirefightingTarget tracking

Automated Container management Autonomous AGVsCooperative transportation

Autonomous UGV for agricultural tasksPrecise agriculture through multi-robot cooperationVegetation analysis

Aerial photographyMapping and surveying 3D reconstructionSeismic, pollution and climate monitoring

3D reconstructionObject recognitionDamage inspectionSmart materials

Infrastructure InspectionSecurity and Emergency

Services Logistics

Agriculture Construction Cultural Heritage

Page 8: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 8

Ongoing projects - Drones

INSPECTIONDrones for inspection of severalindoor and outdoors infrastructure:• electric towers,• sewers,• bridges,• tunnels.

NATURE4CITIES• Nature based solutions for

re-naturing cities• Urban landscaping supported

by drones

COPILOT• Upgrades any commercial

Ready To Fly Multirotor to afully autonomous intelligentMAV.

ARSI• Semi-autonomous inspection

of sewer networks with aerialrobots

• Autonomous navigation andmapping

• Damage detection

BUILT2SPEC• 3D reconstruction with aerial

images for Construction Siteinspection and auditing

SMARTS• Inspection, monitoring and

analysis of Cultural Heritagematerials (objects andstructure surfaces) by meansof multi-analyticalapproaches based on a low-cost apparatus.

Page 9: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 9

Ongoing projects – Ground RobotsAUTONOMOUS SYSTEMS

LOGIMATIC• Tight integration of EGNSS and

on-board sensors for port vehicleautomation

• Modular GIS-based route andyard planning integrated withTerminal Operating Systems

GRAPE• (Semi)autonomous vineyard

monitoring and farming tasks,with Unmanned GroundVehicles (UGVs).

GEOMOVE• Two synchronized AGVs

(master/slave) for thecooperative transportation ofheavy, high-value loads in theaeronautic industry

• Sensor-based non-invasiveautonomous localization andnavigation

MAIC• Cooperative mobile manipulator• System composed by a highly

flexible robot arm and anomnidirectional AGV in theproduction line of our customerfrom the automotive industry.

BOTS2REC• Robots to reconstruction• Multi-robot units for asbestos

removal

Page 10: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 10

Ongoing projectsAUTONOMOUS SYSTEMS

https://eurecat.org/en/portfolio-items/geomove/

https://eurecat.org/en/portfolio-items/logimatic/

https://eurecat.org/en/portfolio-items/maic/

https://eurecat.org/en/portfolio-items/aerial-robot-for-sewer-inspection/

https://eurecat.org/es/portfolio-items/icarus/

https://eurecat.org/en/portfolio-items/grape/

https://eurecat.org/en/portfolio-items/nature4cities/

https://eurecat.org/en/portfolio-items/built2spec-2/

https://eurecat.org/en/portfolio-items/bots2rec/

Page 11: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 11

GEOMOVEAGVS IN SUPPORT/TOOLING OF AERONAUTIC INDUSTRY

Two synchronized AGVs (master+slave) for the cooperativetransport of heavy, high-value loads for the aeronauticindustry

Hardware: Aritex Software: EURECAT

Page 12: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 12

MOTIVATIONAGVS IN SUPPORT/TOOLING OF AERONAUTIC INDUSTRY

For a rigid structure transportation, the structure can slightlyguide/modify the robots navigation

Courtesy Giuseppe Loianno, UPENN Courtesy DTA

Page 13: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 13

MOTIVATIONAGVS IN SUPPORT/TOOLING OF AERONAUTIC INDUSTRY

For a fragile structure, a misalignment between robots candamage it

GEOMOVE!!!

Page 14: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 14

CHALLENGESAGVS IN SUPPORT/TOOLING OF AERONAUTIC INDUSTRY

• Localization without infrastructure modification

• Autonomous navigation with replanning capabilities

• “Wireless” cooperative transportation

• Below-the-centimeter relative positioning error

Courtesy AVT

Page 15: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 15

The AGVsAGVS IN SUPPORT/TOOLING OF AERONAUTIC INDUSTRY

MASTER AGVguides the movements

SLAVE AGVfollows the master

Page 16: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 16

The AGVsAGVS IN SUPPORT/TOOLING OF AERONAUTIC INDUSTRY

• Omnidirectional wheels for precise movements

Page 17: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 17

The AGVsAGVS IN SUPPORT/TOOLING OF AERONAUTIC INDUSTRY

Omnidirectional wheels for

precise movements

Safety laser range sensors for security stop, mapping

and navigation

IMU (inertial measurement unit)

for corrections

Page 18: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 18

Software architectureAGVS IN SUPPORT/TOOLING OF AERONAUTIC INDUSTRY

(C++, ROS – Robot Operating System)

Page 19: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 19

LOCALIZATIONAGVS IN SUPPORT/TOOLING OF AERONAUTIC INDUSTRY

• Map creation and update, Simultaneous Localization and Mapping (SLAM)module

• Multi-sensor robust localization (IMU + laser + odometry) withoutinfrastructure modification

Page 20: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 20

NAVIGATIONAGVS IN SUPPORT/TOOLING OF AERONAUTIC INDUSTRY

• Robot modelling and simulation

• Specialized path planners and motion control (Voronoi, Head-lock navigation)

• Autonomous navigation with collision avoidance and re-planning capabilities

Global Planner Local Planner

Page 21: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 21

TANDEM MODEAGVS IN SUPPORT/TOOLING OF AERONAUTIC INDUSTRY

• Reflective pattern for relative position detection

• ICP for transform estimation (reference and current position)

• Feedforward controller (master -> slave )

Page 22: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 22

TANDEM MODEAGVS IN SUPPORT/TOOLING OF AERONAUTIC INDUSTRY

• Reflective pattern for relative position detection

• ICP for transform estimation (reference and current position)

• Feedforward controller (master -> slave )

Page 23: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 23

TANDEM MODEAGVS IN SUPPORT/TOOLING OF AERONAUTIC INDUSTRY

Different points of rotation

Page 24: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 24

TANDEM MODEAGVS IN SUPPORT/TOOLING OF AERONAUTIC INDUSTRY

Proof of concept with EURECAT robots

Page 25: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 25

TANDEM MODEAGVS IN SUPPORT/TOOLING OF AERONAUTIC INDUSTRY

Final tests

Page 26: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 26

GEOMOVEAGVS IN SUPPORT/TOOLING OF AERONAUTIC INDUSTRY

Results:

• Mapping error below 5 cm (compared to floorplan)

• Mean absolute localization error below 7 cm (validated with optitrack)

• Navigation with obstacle avoidance and replanningcapabilities

• Mean relative positioning error (tandem mode) below 1 cm (validated with optitrack and wire encoders)

https://youtu.be/fzFW3hTubMs

Page 27: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems 27

GEOMOVEAGVS IN SUPPORT/TOOLING OF AERONAUTIC INDUSTRY

Ongoing work:

• EURECAT’s graph SLAM

• Autonomous navigation in tandem mode (need for large space for validation)

Page 28: Autonomous Systems Non-intrusive localization, autonomous …web.itainnova.es/eurobotics/files/2018/05/ERF2018_RO4LOG... · 2018-05-06 · result of the integration, in 2015, of Ascamm,

Autonomous Systems Non-intrusive localization, autonomous navigation and

accurate positioning of AGV’s for cooperative transportation

of heavy added value loads

THANK YOU!

Carlos Rizzo, [email protected]

https://eurecat.org/en/portfolio-items/geomove/Eurecat Technology Center

ERF 2018 - March 2018