Encontro de Usuários 2017

Casos de uso do FME no IBGE Renan de Alcantara Soares

The Brazilian Institute of Geography and Statistics (IBGE) is the main provider of data and information in Brazil, which responds to the needs of the most diverse segments of civil society, as well as federal, state and municipal government bodies.

IBGE offers a complete and current view of the Country through the performance of its main functions:

Production and analysis of statistical information

Coordination and consolidation of statistical information

Production and analysis of geographical information

Coordination and consolidation of geographical information

Documentation and dissemination of information

Coordination of statistical and cartographic systems

Coordenação de Cartografia Coordination of Cartography

The Coordination of Cartography is responsible for planning, organizing, coordinating, supervising and executing the cartographic works, aiming at the production of maps, as well as other documents of a cartographic nature, necessary for the representation of the Brazilian territorial space "(Portaria nº 215, 12/08/2004 - Art. 60.) "

Interoperability of data from many sources

Coordenação de Cartografia Coordination of Cartography

CCAR

Vetorial cartographic base production of all national territory

1:1.000.000

1:250.000

1:100.000 (in progress)

1:25.000 (RJ)

(Coordination of Cartography main use)

EDGV

(Structure of Vector Geospatial Data) Standarize

Topological Rules Identify

Fix

Equipe Team

Renan de Alcantara Soares

Cartographic and Surveyor Engineer - Federal University of Viçosa (UFV)

Rafael Damiati Ferreira

Geographer – São Paulo State University (UNESP)

Master in Remote Sensing – Brazilian National Institute for Space Research (INPE)

Ludolf da Mota Silva

Cartographic Engineer - Rio de Janeiro State University (UERJ)

All with advanced knowledge in GIS, but had never used FME before, learning it by job needs and investigative curiosity.

Casos Cases #1

The vetorial cartographic continuous bases of Brazil, has as main applications and products the planning and management of government programs with a territorial approach; The analyzes that demand an overall view (country, region and states); The elaboration of maps in smaller scales (Brazilian, regional, state and Atlas series maps) and representations of thematic aspects of the territory (statistics, natural resources and environmental research).

Its modeling is implemented according to the Technical Specifications for Vector Geospatial Data Structuring (ET-EDGV). In relation to the geodesic and cartographic spatial references, the Base follows the current norm, using the SIRGAS 2000 reference system, with a geographic coordinate system.

The data are available in free format (shapefile, geopackeg and dump from the PostGIS database) for use in Geographic Information Systems, and it is compatible with different softwares.

Casos Cases #1

Vetorial cartographic base of 1:1000000 Vetorial cartographic base of 1:250000 Vetorial cartographic base of 1:100000 Vetorial cartographic base of 1:25000

Casos Cases #1

And of course, on such a large base, errors may occur during vector acquisition.

Like, overlap of two features that should not, Intersessions without break, gap between adjacent polygons.

Problems that require time, resources and expertise available to apply the correct fixes, and still, can be subject to human errors.

The flows created in the FME to the Vector Base, in several scales, aimed at a quick identification and correction, with the minimum of human vector editing.

Casos Cases #1

A few examples: Poligons (Must not Overlap) Line (Fixes the flow (direction) of the rivers to fit the downstream direction) Point (Correction in many features simultaneously) Checks the contours and identifies discontinuities, missing curves or wrong values, also identifies incoherent points between two curves

Casos Cases #2

The Brazilian topographic mapping carried out between the 1970s and 1980s, whose purpose was to represent the Brazilian territorial space, in a systematic way, through a series of general, continuous, homogeneous and articulated maps, elaborated selectively and progressively, at the standard scales of 1:1000000, 1:250000, 1:100000, 1:50000 and 1:25000.

Casos Cases #2

Scale 1:25000 Scale 1:50000 Scale 1:100000 Scale 1:250000 Scale 1:1000000

Casos Cases #2

In January 1991, plans were started for the conversion of topographic sheets to CAD, which took time for the scanning and the vectorization, a project that took a lot of time during the 1990s.

Some of the regions of this systematic mapping have never been revisited, being this unique data for some local names, settlements, rivers and mountains. What motivated the idea of updating this data to the shapefile format.

Casos Cases #2

The first problem encountered was the Datum, there were at least 8, all digitized in DGN with units in kilometers. None of them recognized by FME.

Casos Cases #2

Transport Hydrography Buildings Batch

Reads a folder, where 26504 files are stored in DGN extension

Organizes for each line the various output addresses for each scale and mapped region.

Distributes feature classes correctly for processing

It calls the workspaces's that convert dgn to shp, each line represents a class of feature (Transport, Hydrography, Hypsometry, Buildings, Metadata, etc ...). The input data is iterative until it is able to make all such dgns in the folder (including subfolders) and prints according to the specified folder organization.

Casos Cases #2

Organization of the results folder

Scale

Producer of the data

Topographic Map

Metodology (also contains Metadata and Grid)

Feature Class

Shapefiles

Casos Cases #2

Results

Casos Cases #3

The Ibge has more than 50TB of raster images, for the Rapid-Eye images, which are being used in the production of the new vectorial cartographic base of 1: 100000 are 3 collections of Rapid-Eye covers from Brazil (5 meters). To correct or confirm the accuracy of these images, IBGE has a database for Ground Control Points (GCP), which has at least 15,5 thousand points spread throughout the Country.

Still, some Rapid-Eye coverage scenes may not have control points on it, or not enough points for an adequate analysis of their accuracy.

The technical team responsible for image processing opted to evaluate the positional quality of Rapid-Eye images comparing them with OrtoPhotos of greater precision. For that, Erdas AutoSync was used to compare two or more images, from search windows to determine the similar features and obtain the coordinates of these similar features, generating a report of the results found.

Casos Cases #3

First problem, the report is generated with coordinates in geographic system, while the Rapid-Eye images have coordinate in UTM (diverse fuses). Also the displacement can only be calculated on the plane.

Casos Cases #3

Read the report in txt.

Reads the raster in GeoTIFF

It plots the report points and defines it as EPSG: 4326

Extract the coordinate system information from the raster

Transfers this information for points and reproject it for the Raster coordinate system

Do the statistics

This workspace also has a batch caller, which arranges the output folder, toggles between several input files, and even if you need to stop and continue on another day it understands which raster has already been processed and discards them before it starts.

Statistics results (Output file)

Casos Cases #4

IBGE has a vast historical collection of analog aerial photos stored in Rio de Janeiro. These photos were the main resources for different cartographic products published by the institution, mostly consisted of topographic maps at various scales.

We’ve started the process of digitization and cataloging historical aerial photographs with approximate georeferencing.

The effort aims to facilitate searching and accessing the historical data and to preserve paper information once it tends to deteriorate over the time.

This work was presented in:

SBSR - Brazilian Remote Sensing Symposium (2017) – Santos

ICC - International Cartographic Conference (2017) – Washington DC

Casos Cases #4

Casos Cases #4

Dúvidas Questions