New Geoprocessing Toolbox in uDig Desktop Application

Minpa Lee (Mango System inc.) KiWoong Kim(Mango System inc.)

FOSS4G Seoul 20152015.09.16

2

OVERVIEW

3

Spatial & Processing ToolboxQGIS Processing Framework: http://qgis.org

4

Spatial & Processing ToolboxArcGIS ArcToolbox: http://www.esri.com/

5

Spatial & Processing ToolboxuDig Spatial Toolbox: http://udig.refractions.net/

6

Eclipse RCPSpring Framework + …

Goal

GeoTools LibrariesSpatial Statistics

Processes

GeoServer WPSExtension

uDig DesktopProcessing Plugin

uDig Desktop

Java + JTS + JAI + …

Spatial Statistics Programs

7

Open Source GIS Project - Java Tribe JTS, GeoTools, OGC Standards based Open Source Projects

LibrariesServer GIS

Desktop GIS

GeoTools

OpenMap

GeoServer JTS Topology Suite(Geometry Engine)

JUMP and …

uDig

deegree

gvSIG GeoAPI OGC Stan-dards

GEOS: C

NTS: .NET

JSTS: JavaScript

World Wind

shapely: Python

8

GeoToolsOpen source Java library that provides tools for geospatial data

Site : http://geotools.org/ License : GNU Lesser General Public License (LGPL) Features:

open source Java library that provides tools for geospatial data.

Spatial Libraries

9

uDig GISUser-friendly Desktop Internet GIS Site : http://udig.refractions.net/ License : Eclipse Public License(EPL) & Refractions BSD License Features :

LocationTech Incubation Project open source (EPL and BSD) desktop application framework, built with Eclipse Rich Client (RCP)

technology

Desktop GIS

10

GeoServerOpen source server for sharing geospatial data Site : http://geoserver.org/ License : GNU GENERAL PUBLIC LICENSE(GPL) Version 2.0 Features :

OGC Web Services(WMS,, WMTS, TMS WFS, WCS, WPS, CSW…)

Server GIS - WPS

11

PARAMETERS & USER INTERFACE

12

uDig Processing Toolbox uDig Processing Toolbox & GeoTools Process modules & Custom spatial statistics processes

GeoToolsProcess Modules

Toolbox

UI Builder

Output

13

uDig Processing Toolbox

Toolbox - Parameter Tab

I18N support and various widgets & actions in parameter tab

14

uDig Processing Toolbox

Toolbox - Help Tab

English Korean

15

Input parameters

Input parameters and User Interface

Parameter Type Widget Related Widget & Popup Constraints

BoundingBoxData BoundingBox Text + But-ton Extent from map, layers

ComplexData

SimpleFeatureCollection Combo All, Point, Line, Poly-gon

GridCoverage2D Combo

Geometry Text + But-ton

Map’s Centroid, ExtentGeometry Picker Dialog WKT

Filter Text+ But-ton Query Builder Dialog

LiteralData

CoordinateReferenceSystem Text+ But-ton

CRS Chooser DialogCRS from map, layers EPSG:3857

Enum Combo Enum Types

NumberFloat, Double Text+ But-

ton Layer’s Area…

Short, Integer, Long Spinner

Boolean Combo Yes/No

String

Field Combo Related to vector lay-ers

Other Text+ But-ton

Expression Builder DialogMultiple Fields Selector DialogSummary Fields Builder Dia-log

16

Input parametersToolbox – Custom Widget & Dialog – Popup menu related to numeric values LiteralData – short, int, long Feature count of selected layer

17

Input parametersToolbox – Custom Widget & Dialog – Popup menu related to numeric values LiteralData – Double, Float Polygon layer’s area(sum)

18

Input parameters

Toolbox – Custom Widget & Dialog

SimpleFeatureCollection & related field

19

Input parameters

Toolbox – Custom Widget & Dialog – CRS Chooser Dialog

BoundingBoxData– BoundingBox minx, miny, maxx, maxy, epsg

20

Input parameters

Toolbox – Custom Widget & Dialog - Expression Builder Dialog

LiteralData – String Type Filter Expression & Functions

21

Input parametersToolbox – Custom Widget & Dialog – Multiple Fields Selection Dialog LiteralData – String Type Comma separated fields

22

Input parametersToolbox – Custom Widget & Dialog – Statistics Fields Selection Dialog LiteralData – String Type String – first, last Numeric – sum, mean…

23

Input parametersToolbox – Custom Widget & Dialog – Statistics Fields Selection Dialog LiteralData – Java Enum Object

24

Input parametersToolbox – Custom Widget & Dialog – Statistics Fields Selection Dialog LiteralData – Boolean : Yes / No

25

Input parameters

Toolbox – Custom Widget & Dialog – Query Builder Dialog

ComplexData – Filter

26

Input parametersToolbox – Custom Widget & Dialog – CRS Chooser Dialog(uDig internal) LiteralData– CoordinateReferenceSystem

27

Input parameters

Toolbox – Custom Widget & Dialog – Geometry Picker Dialog

ComplexData – Geometry

28

Output parametersHTML, Shapefile(Vector), GeoTIFF(Raster), Temporary features(Geometry)

Parameter Type Target Display Type Constraints

BoundingBoxOutput BoundingBox Map Polygon Layer Temporary

ComplexOutput

SimpleFeatureCollection Map Vector Layer

GridCoverage2D Map Raster Layer

Geometry Map Vector Layer Temporary

Custom XML Text HTML

LiteralOutputString Text HTML

Number Text HTML Number Format(6)

29

Output parameters

Shapefile(SimpleFeatureCollection) output

30

Output parameters

Custom output

31

CUSTOM PROCESSES

32

Spatial Statistics ProcessesCategory Functions

R&DArcGIS GeoDa SAGA Crime

StatGeoTools uDig GeoServer

SpatialAggregation

&Distributions

Descriptive

Spatial Aggregation o o o 　 　 　 o 　Basic Statistics o o o o o 　 　 　Pearson Correlation Coefficient o o o o 　 　 　 　Standardized Scores o o o 2015

Focal Location Quotients o o o 2015

Distributions

Mean Center o o o o 　 o 　 　Median Center o o o 　 　 o o

2015　Central Feature o o o o 　 　 　 　Standard Distance o o o o 　 o 　 　Standard Deviational Ellipse o o o o 　 　 　 　Linear Directional Mean o o o o 　 　 　 　

Density Kernel Density Estimation o o o o 　 o o 　2015

33

Spatial Statistics ProcessesCategory Functions

R&DArcGIS GeoDa SAGA Crime

StatGeoTools uDig GeoServer

SpatialPatternAnalysis

GlobalPoint Pattern

Analysis

(k) Nearest Neighbor Statistic o o o o 　 　 o 　Quadrat Method 　 　 　 　 　 　 　 　G-function 　 　 　 　 　 　 　 　F-function 　 　 　 　 　 　 　 　Cuzick-Edwards Test (Case-Control) 　 　 　 　 　 　 　 　(Network) K-function 　 　 　 o 　 　 o 　

LocalPoint Pattern

Analysis

Nearest Neighbor Hierarchical Clustering 　 　 　 　 　 　 o 　Zonal Nearest Neighbor Hierarchical Clustering 　 　 　 　 　 　 o 　Spatial and Temporal Analysis of Crime 　 　 　 　 　 　 o 　K-Means Clustering (Kmeans) o o o 　 　 　 o 　

GlobalSpatialAuto-

correlation

Univariate

Join Count Statistic o o o 　 　 　 　 　Moran’s I Statistic o o o o o o o 　Oden’s I Statistic 　 　 　 　 　 　 　 　Geary’s C Statistic o o o 　 　 　 o 　Getis-Ord’s G Statistic o o o o 　 　 o 　Tango’s C Statistic o o o 　 　 　 　 　Rogerson’s R Statistic o o o 　 　 　 　 　

Bivariate Bivariate Moran’s I Statistic o o o 　 o 　 　 　Local

SpatialAuto-

correlation

Univariate

Local Moran’s I Statistic o o o o o 　 o 　Local G Statistic o o o o 　 　 o 　Local Tango’s C Statistic o o o 　 　 　 　 　Local Rogerson’s R Statistic o o o 　 　 　 　 　

Bivariate Local Bivariate Moran’s I Statistic o o o 　 o 　 　 　Local

Spatial Clustering

Openshaw’s GAM 　 　 　 　 　 　 　 　AMOEBA o o o 　 　 　 　 　Kulldorff’s Spatial Scan Statistic 　 　 　 　 　 　 　 　

New Algorithms

34

Spatial Statistics ProcessesCategory Functions

R&DArcGIS GeoDa SAGA Crime

StatGeoTools uDig GeoServer

(Spatial)Regression

Standardized Standardized regression 　 　 　 o 　 　 o 　Global

Spatial Lag Model (SLM) 　 　 　 　 o 　 o 　Spatial Error Model (SEM) 　 　 　 　 o 　 o 　

LocalGeographically Weighted Regression (GWR) 　 　 　 o 　 o 　 　Expansion Method 　 　 　 　 　 　 　 　

SpatialInterpolation

Deterministic IDW (Inverse Distance Weighted) o o o o 　 o 　 　Spline 　 　 　 o 　 o 　 　

Geostatistical (Co) Kriging 　 　 　 o 　 o 　 　

VisualizationAnalysis

Tools

Graph

Moran Scatter Plot 　 o 　 　 o 　 　 　Histogram 　 o 　 o o 　 　 　Box Plot(Box and Whisker) 　 o 　 o o 　 　 　Scatter Plot 　 o 　 o o 　 　 　Bubble Chart 　 o 　 o o 　 　 　3D Scatter Plot 　 　 　 　 o 　 　 　Conditional Map 　 　 　 　 o 　 　 　Conditional Scatter Plot 　 　 　 　 o 　 　 　Conditional Histogram 　 　 　 　 o 　 　 　Parallel Coordinate 　 　 　 　 o 　 　 　Covariance Cloud 　 　 　 o 　 　 　 　Semivariogram 　 　 　 o 　 o 　 　Correlagram 　 　 　 　 　 　 o 　

　 VisualizationStandard Graphic Tools 　 o 　 o 　 　 　 　Thematic Map 　 o 　 o o o 　 　

Graph Tools

35

Spatial Statistics ProcessesCategory Functions

R&DArcGIS GeoDa SAGA Crime

StatGeoTools uDig GeoServer

Utilities

Spatial WeightMatrix

Creating(Network) Spatial Weight Matrix 　 　 　 o o 　 　 　Create Spatial Weight Matrix o o o o o 　 　 2015　

　 Cross-Validation 　 　 　 o 　 　 　 　　 Pattern Creation 　 　 　 　 　 　 　 　

SpatialUnits

Area

Create Fishnet Grids o o o o 　 　 　 　Create Hesagonal Grids o o o o 　 　 　 　Create Thiessen Polygons o o o o 　 o 　 　

PointRandom Points o o o o 　 　 　 　Random Points per Features o o o 　 　 　 　 　

Calculation

Calculate Count o o o o 　 　 　 　Calculate Areas o o o o o 　 　 　Calculate Field o o o o o 　 　 　

Aggregation

Aggregate(Union) Polygons o o o o 　 　 　 　Collect Events o o o o 　 　 　 　Spatial Join o o o o 　 　 　 　Point Statistics o o o o 　 o 　 　Buffer Statistics o o o o 　 　 　 　Sum Line Lengths o o o 　 　 　 　 　

ConversionText File to Point Features o o 　 o o o 　 　Export Layer to Other Format o o o o o o 　 　

36

DEMO

37

uDig Plugin Update Site-http://www.mangosystem.com:8080/s2toolbox_updates

38

uDig Processing Toolbox uDig Desktop Plugin

39

uDig Processing ToolboxGeoTools Processes

40

uDig Processing ToolboxThematic Mapping Tool

41

uDig Processing Toolbox Thiessen Polygons

42

uDig Processing ToolboxText file to point features

43

uDig Processing Plug-inExport layer to other format

44

uDig Processing Plug-inBubble chart

45

uDig Processing Toolbox Scatter plot

46

uDig Processing Toolbox Local Moran’s I

47

uDig Processing Toolbox Scatter plot

48

GEOSERVER WPS

49

GeoServer WPS Package

Spatial Statistics Process WPS extension

WPS Process

Remote WFS

50

GeoServer WPS Extension : DemoStandard Deviational Ellipse

51

GeoServer WPS Extension : DemoLocal Moran’s I

52

GeoServer WPS Extension : DemoPoint in Polygon

53

GeoServer WPS Extension : DemoHexagonal Grids Point Statistics Local Moran’s I

54

GeoServer WPS Extension : DemoSum Line Length

55

GeoServer WPS Extension : DemoThiessen polygon Point Statistics

56

GeoServer WPS Extension : DemoBuffer Point Statistics

57

GeoServer WPS Extension : DemoPoint Statistics with Buffer

58

HOW TO JOIN

59

Source Code: Githubhttps://github.com/mapplus/spatial_statistics_for_geotools_udig

60

Deployment: SourceForgehttps://sourceforge.net/projects/mango-spatialstatistics

61

Localization: Transifexhttps://www.transifex.com/projects/p/ss-rd/

EnglishKorean

…

Thanks!

Minpa Lee : mapplus@gmail.comJooyong Park : jya1210@gmail.comKiWoong Kim :

socoooooool@gmail.com