GIS 1 GIS Lecture 4 Geodatabases Copyright – Kristen S. Kurland, Carnegie Mellon University

GIS Lecture 4Geodatabases

Copyright – Kristen S. Kurland, Carnegie Mellon University

Outline

•Administrative Data Example•Data Tables•Data Joins•Common Datasets•Spatial Joins•ArcCatalog Overview•Geodatabases•Editing Tables•Excel Tips

Administrative Data Example

Administrative Data

Mission • What does the organization do?• Transaction event (who, what, where, when)-must have spatial component

What data is available? • Databases• Spreadsheets

Example

County Property Assessments•Assesses the value of each land parcel and its structures

•Sets a property tax rate•Sends property tax bill = assessed value * tax rate

Allegheny County Assessment WEB Site

http://www.county.allegheny.pa.us

Westmoreland County Assessment WEB Site

http://207.140.67.68/westmoreland/viewer.htm

GIS 10

Data Tables

GIS 11

Property Table

Property Data• Owner• Address• Sale Date and Price• Map Lot Block Number

GIS 12

Parcels GIS Layer

• Smallest geographic element is a deeded land parcel

GIS 13

Data Joins

GIS 14

Join Property Table to Parcels•Join on common attribute value•Values must be the same

Must remove dashes!

GIS 15

Import Property Table to ArcMap

•Save Excel file as a comma separated file .CSV File or DBF (DBASE IV) file

GIS 16

Add Table as Data Layer

GIS 17

Join Table to Map•A common field joins or links tables•Records with the same value are matched•Some cleaning necessary (dashes removed)

GIS 18

Join Table to Parcels

GIS 19

Resultant Parcels Table•Property fields are appended to parcels table•Source files remain separate•Joins can be removed•Maps can be created from values in the new fields

GIS 20

Resulting Assessment Map

GIS 21

Resulting Assessment Map

Central Oakland Land Parcels

2003 Assessment

GIS 22

Problems with Joins

•Saving .DBF and .CSV files in Excel•Avoid special formats•Keep it simple•Use Access as a “middle man”

GIS 23

Common Datasets

GIS 24

Common Datasets U.S. Census Maps and U.S. Census Tables

GIS 25

Common Datasets•Zip Codes-Use with U.S. Census data or Geocoding

GIS 26

Place Geocodes: FIPS Codes

Federal Information Processing Standards Codes

Developed by the National Institute of Standards and Technology

Codes for Place Names Throughout the World•countries•states/provinces•counties•metropolitan statistical areas (MSA’s)•cities•places - indian reservations, airports, and post offices in the US

GIS 27

Place Geocodes: Hierarchy

Country: US

FIPS CODES

County: 003 (Allegheny)

State: 42 (Pennsylvania)

Tract: 0501

Block: 12 (US420030501312)

Block Group: 3CENSUS CODES

Minor Civil Division: 85188 (Wilkinsburg)

Parcel (Block & Lot#)

GIS 28

Locating Data

•Contact agencies•Obtain data on-line

GIS 29

Spatial Joins

GIS 30

Spatial Joins•Spatially count points within polygons•Join tables using Shape field•Join points to polygons or polygons to points

GIS 31

Spatial Joins•Join municipality name to points spatially

GIS 32

Spatial Joins•Resultant point layer (food points) now contains municipality information

GIS 33

Aggregate Data

• Summarize on spatial join- Counts the number of points (records) for each

municipality

GIS 34

Aggregate Data

• Resultant Table- Count of points (food stores) in each polygon

(municipality)

GIS 35

Join Summary Table• Join summary table of counts (based on municipality name from sum table) back to municipalities for labeling

GIS 36

Label Counts•Label the count of stores from the summary join

GIS 37

Label Counts•Show counts as a Choropleth Map

GIS 38

Map with Points

GIS 39

Map without Points

GIS 40

ArcCatalog

GIS 41

ArcCatalog

GIS 42

Metadata

GIS 43

Metadata

GIS 44

Metadata

GIS 45

Metadata

GIS 46

Metadata

GIS 47

Geodatabases

GIS 48

Geodatabase

•‘geographic database’ •represents geographic features and attributes as objects and is hosted inside a relational database management system

•managing your coverages, grids, and shapefiles inside a database management system, or DBMS

GIS 49

Enterprise Geodatabases

•require a ‘host’ DBMS -SQL Server, Oracle, or IBM DB2

GIS 50

Personal Geodatabases

•based on the Microsoft JET engine -appear as an .mdb file (Microsoft’s JET engine is also used by Microsoft Access).

GIS 51

Geodatabase Advantages

•Provide a uniform and IT compliant repository for geographic data.

•Many users can edit geographic data simultaneously.

GIS 52

Geodatabases

GIS 53

Importing Shapefiles into Geodatabases

GIS 54

Importing Tables into Geodatabases

GIS 55

dBASE and Tables

GIS 56

dBASE Tables

GIS 57

Editing Tables•Field definitions edited in ArcCatalog•Layers cannot be in use elsewhere

GIS 58

Calculator Functions

GIS 59

Calculator Functions

• Not just for numeric fields

GIS 60

Excel Tips and Tricks

GIS 61

FIPS Code Reminder

Country: US

FIPS CODES

County: 003 (Allegheny)

State: 42 (Pennsylvania)

Tract: 0501

Block: 12 (US420030501312)

Block Group: 3CENSUS CODES

Minor Civil Division: 85188 (Wilkinsburg)

Parcel (Block & Lot#)

GIS 62

Formatting and Replace

•Delete any Excel formatting (e.g. borders, patterns, etc.)

•Delete unwanted text (e.g. word “tract”)-Find and replace

GIS 63

Transpose Data

•Transpose data-Some census data saves data as rows instead of columns

-You need transpose the data so that tracts will be a column-Select your data in excel and go to Edit menu and select copy-Click on a cell outside of your selected data and go to edit menu to select paste special…

GIS 64

Now you see the data transposed in the right way. All you need to do is to delete the original rows and save your file.

GIS 65

Concatenate Strings

Sometimes you need add certain string before or after a value, and sometimes you want to combine two values. The excel CONCATENATE function makes that happen for you.

GIS 66

If you have the below dataset, and want to combine the state ID and county ID together as another variable and you want to make sure the new StateCountyID has the length of 5

For example, you want to add a “0” to State IDs that are only 1 character long, and you want add “00” to county IDs that that is 1 character long and “0” to those that are 2 characters.

Concatenate Strings

GIS 67

Start by adding a new column right to StateID, and enter:

=IF(LEN(A2)=1,CONCATENATE(0,A2),A2)

What you tell excel is: if the length of the cell A2 is 1, add 0 before the original value, otherwise, keep the original value

Concatenate Strings

GIS 68

After that, you copy and paste the formula to the rest of the column, and you will see the following result

Concatenate Strings

GIS 69

Now let’s solve the problem for county ID. In the cell next to C2, you enter:

=IF(LEN(C2)=1,CONCATENATE("00",C2),IF(LEN(C2)=2,CONCATENATE("0",C2),C2))

What this tells excel is if the length of county ID is 1, add “00” before it, if the length is 2, add “0” before it, if the length is 3, keep the original

Concatenate Strings

GIS 70

Now you copy and paste the formula to the rest of the column and you get the above result

Concatenate Strings

GIS 71

Next, you create a new column called StateCountyID, and enter is the cell E2:

=concatenate(B2,D2)

By this, you are telling Excel to combine the two new columns that you created in the previous steps

Concatenate Strings

GIS 72

Now you just need to copy and paste the formula to the rest of the column and you finally get what you want.

Concatenate Strings

GIS 73

Mid Function

Sometimes, a simple replace won’t do for you to substring a column. In this case, you can use Excel’s mid function to get a subset of a value.For example, if you have the following data want extract two letters in the middle, say 12 from the first row, and 13 from the second row, and so on, the Excel MID function is your choice.

GIS 74

Mid Function

You enter: =mid(A1,4,2) in the cell next to A1. What you tell excel to do is: From cell A1, extract 2 characters starting from the 4th character from left.

GIS 75

Mid Function

Then you copy and paste the formula from B1 to the rest of the column and you get what you need.

GIS 76

Excel Tips and Tricks

•Formatting•Find and Replace•Transpose•MID Function•Concatenate

GIS 77

Other Excel Functions

You might want to learn some other excel functions that could help you clean the data, such as:• Right()• Left()• Exact()

GIS 78

Conclusion

•Administrative Data Example•Data Tables•Data Joins•Common Datasets•Spatial Joins•ArcCatalog Overview•Geodatabases•Editing Tables•Excel Tips

GIS 1 GIS Lecture 4 Geodatabases Copyright – Kristen S. Kurland, Carnegie Mellon University

Documents

Multiuser Geodatabases & Replication: Join the Party

Geodatabases Essentials Part II - resources.esri.comresources.esri.com/help/9.3/geodatabase/Blog/TW... · Geodatabase Essentials Part II An Introduction to ArcSDE Geodatabases

Learning ArcGIS Geodatabases - Packt · is an Esri award-winning senior GIS solution architect at Electricity and ... A Software Interface ... 26 Balan's Diner Excellent Balan's Diner

Geodatabases to improve geotechnical design and modelling

Brandt Winkelman, Stacey Fairweather, Lindsey TollefsonArcGIS API for JavaScript Based Application • SQL Server geodatabases store, distribute and manage GIS data • ArcGIS for

Floodplain and Flood Probability Mapping Using Geodatabases

Basics on Geodatabases

JLCO - The Kurland AgencyJLCO JAZZ AT LINCOLN CENTER ORCHESTRAWAYNE SHORTER THE KURLAND AGENCY 617-254-0007 agents@thekurlandagency.com

Types of geodatabases

Building Geodatabases with Rational Rose

Geodatabases: An Overview

Managing Enterprise GIS Geodatabasescourses.washington.edu/geog469/Lec_2014/LecW9_T... · Managing Enterprise GIS Geodatabases . Geog 469 GIS Workshop . Outline . 1. Why is a geodatabase

Kurland Sasson Brochure

Kurland Decision

THE KURLAND AGENCY

Geodatabases by Farid Ullah

Geodatabases in GIS Engineering Geographic Information Systems CIVE 7397 Spring 09

Building Geodatabases tutorial PDF - ArcGIS Resources - Esri

Designing Geodatabases Part I: Polygons and lines

[ODRCD319] Liepaja Symphony Orchestra - Kurland Sounds