49
Emerging UAS Technologies FAA Updates Chip Berniard

Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Embed Size (px)

Citation preview

Page 1: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Emerging UAS Technologies

FAA Updates

Chip Berniard

Page 2: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

An unmanned aerial vehicle (UAV), commonly known

as a drone, is an aircraft without a human pilot on

board. Its flight is controlled either autonomously by

computers in the vehicle, or under the remote control

of a pilot on the ground or in another vehicle.

The term unmanned aircraft system (UAS)

emphasizes the importance of other elements beyond

an aircraft itself. A typical UAS consists of the:

– unmanned aircraft (UA)

– control system, such as Ground Control Station (GCS)

– control link, a specialized datalink

– other related support equipment.

What is UAS?

Credit: Wikipedia.org

Page 3: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

New emerging technology well

suited for geospatial professionals

Complementary to traditional

surveying technologies and to

traditional photogrammetry

Many UASs, but not many

targeting the geospatial industries

Why UAS Aerial Imaging?

Page 4: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

JPG images

4

A. Optimize GPS positions [m] [cm]

B. Optimize UAV angles [deg] [sec]

C. Camera calibration

KEY = high overlap

…How it works

Page 5: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

…How it works

Computer Vision Software:

A. Automatic Aerial triangulation (AAT) Hundreds of feature points per image

“Spider web” of connections

B. Robust Optimization Algorithm Bundle block adjustment (BBA)

External & internal calibration

C. Point Cloud densification Up to pixel size elevation data

5

Page 6: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

UAS image processing charachteristics

Imaging properties

Unstable camera geometry (initial calibration report not valid over time)

Small footprint

High and variable crab angle and constant pitch up around 5°

Only approximate position and orientation available

Image processing solutions

Computer vision (SFM) for fully automated feature point (tie point) detection and

matching (SIFT related) -> BBA and AT (georeferenced based on camera GPS

positions (WGS84) or optimized based on GCPs) -> sparse 3D point cloud

Densification based on multi-view stereo matching on pixel level (cluster,

extend, filter) yielding several M of 3D coordinates with normals

Images not individually rectified and then mosaiced (seamline editing) but

projected on DSM based on probability functions (novel view generation)

Page 7: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not
Page 8: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

3D Digital Surface Model

Page 9: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

History of Geospatial UAS Aerial

Imaging Solutions in Trimble

2013 • Trimble Business Center Photogrammetry Module released

• Trimble UX5 Aerial Imaging Solution released

2012 • Gatewing acquired by Trimble

2010 • Gatewing X100 released

2008 • Gatewing founded

• First idea for a surveying UAS within Gatewing

2009 • First Gatewing prototype for surveying

2011 • First desktop image processing software for UAS surveying from Gatewing

2007 • Inpho GmbH acquired by Trimble

Page 10: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Applications & Benefits

UAS Aerial Imaging Solutions

Page 11: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Economic solution – enables aerial mapping technology, once reserved for the largest surveying & engineering firms, to be used by the masses

Safety – enables surveying of rugged, hazardous, hard-to-reach or unhealthy areas without risking injury (or worse) to them or individuals in the area

Efficient process – ability to collect and process data faster than often achievable with terrestrial-based survey technology

Rapid workflow – system is designed to quickly plan a flight and collect data, allowing rapid response to your customer’s needs (traditional photogrammetry processes

Versatile – a technology that can be used to serve numerous professional markets and applications

Benefits of Aerial Imaging Solutions

Page 12: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Engineering & Surveying

Mining

Civil & Heavy Earthworks

Construction

Oil & Gas

Environmental & Landfill

Public Agencies

Agriculture & Forestry

Target Markets

Page 13: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Topographic Survey Example

Aerial Imaging vs. Traditional Surveying

Page 14: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

UAS GNSS Comments

Area 1.5 km2 1.5 km2

Ground control setup &

measurement

1 ¼ hr --- Ground control not required

for all applications

Setup time 15 min 15 min (per day)

Survey time 45 min 30 ½ hr (4 days)

Tear-down time 15 min 15 min (per day)

Data processing time 4 hrs

(2.80 GHz Intel Core i7,

16 GB RAM)

--- Data can be processed

overnight

Total time 6 hr 30 min 32 hr 30 min 5x faster than GNSS

Measurement sampling 3.8 cm (at 120 m flight

altitude)

15 m Minimum sampling size is

2.4 cm

Horizontal accuracy 2 cm 1 cm

Vertical accuracy 4 cm 2 cm

Topographic Survey Example

Page 15: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Topographic Survey Example

Surface model generated from UAS

survey (300,000 measurements)

Surface model generated from GNSS

survey (100,000 measurements)

Page 16: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Height

(m)

GSD

(cm)

Flight

Lines

Coverage / Flight (km2)

70% 80% 90%

Coverage / Day (km2)

70% 80% 90%

75 2.4 40 1.14 0.76 0.38 6.82 4.55 2.27

100 3.2 30 1.80 1.20 0.60 10.79 7.19 3.60

120 3.8 25 2.32 1.55 0.78 18.72 12.48 6.24

150 4.8 20 3.12 2.08 1.04 18.72 12.48 6.24

200 6.4 15 4.44 2.96 1.48 26.65 17.77 8.88

250 8 12 5.76 3.84 1.92 34.58 23.05 11.53

300 9.6 10 7.09 4.72 2.36 42.51 28.34 14.17

400 12.8 7.5 9.73 6.49 3.24 58.37 38.92 19.46

500 16 6 12.37 8.25 4.12 74.24 49.49 24.75

750 24 4 18.98 12.65 6.33 113.89 75.93 37.96

Flight Calculator Table

* 80% overlap is the default in Trimble Access Aerial Imaging Module

Page 17: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Legal Flight Operations

Pathways to Legal Flight for Unmanned

Aircraft

Page 18: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

BACKGROUND & DEFINITIONS

Pathways to Legal Flight for Unmanned Aircraft

Page 19: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

June 30, 1956 – TWA Super

Constellation and United Air Lines

DC-7 collide over the Grand Canyon

– All 128 occupants killed

May 21, 1958 – Senator Mike

Monroney introduced a bill to create

FAA to provide safe and efficient

use of national airspace

August 23, 1958 – President

Eisenhower signs Federal Aviation

Act

Federal Aviation Administration

Page 20: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

First law to address unmanned aircraft (Sections 331-336)

Unmanned Aircraft (UA): Aircraft operated without the possibility of direct human intervention from within or on the aircraft.

Small Unmanned Aircraft (SUA):Unmanned Aircraft Weighing less than 55 pounds.

Unmanned Aircraft System (UAS): unmanned aircraft and associated elements (including communication links and control components) required for pilot to operate safely in National Airspace System (NAS).

Definitions from Public Law 112-95 (2012)

Page 21: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

FAA focuses on three areas of interest: – Airspace

– Aircraft

– Operator

Airspace is categorized by expected air traffic

Aircraft are categorized by size and intent

Operators are categorized by demonstrated skill level, experience, and medical exam

The Aviation Environment

Page 22: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

AIRSPACE

Pathways to Legal Flight for Unmanned Aircraft

Page 23: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Aviators do not see a map the same way we do

Terrain is a hazard unless it is a runway – Controlled Flight Into

Terrain (CFIT)

Map detail is a distraction unless it’s a landmark usable for navigation

Airspace

Page 24: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Aviation maps show areas of air traffic – Represent cylinders/cones of controlled access

Areas near airports are more restrictive – The larger the airport, the more traffic and restrictions

Controlled airspace is where instrument procedures may take place and are priority – UAS operations would require additional equipment

– Operating illegally here is asking for serious trouble

Class G is the only uncontrolled airspace – Easiest airspace to obtain UAS flight approval

Populated areas are highlighted in yellow and may have an impact on flight approvals

Airspace

Page 25: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Airspace Map (VFR Sectional)

Page 26: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Airspace Classifications

Page 27: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

AIRCRAFT

Pathways to Legal Flight for Unmanned Aircraft

Page 28: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Manned aviation aircraft have type certificates and type ratings

UAS aircraft classifications are not developed like manned aircraft

FAA defines “small unmanned aircraft” (SUA) as those less than 55 pounds

Not all aviation authorities agree on this definition – e.g. France = 2kg

Aircraft

Page 29: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

OPERATORS

Pathways to Legal Flight for Unmanned Aircraft

Page 30: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

7 Different Pilot Licenses (Defined in Code of

Federal Regulation, Title 14, Part 61)

– Student Pilot – “learner’s permit”

– Recreational & Sport Pilot – aircraft, passenger,

airspace and environmental restrictions

– Private Pilot (PPL) – personal aircraft operation

Instrument rating requires at least PPL

– Commercial Pilot (CPL) – “for-hire” aircraft

operation

– Airline Transport Pilot (ATP) – Delta, United,

FedEx…

– Flight Instructors (CFI & CFII) – “certified trainers”

Operators

Page 31: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

PPL can not operate for compensation or hire – Some exceptions, but primarily a recreational pilot

– Only requires 3rd Class Medical

CPL can operate for compensation or hire – Instrument rating not required

– Requires 2nd Class Medical

ATP requires 1500 hours of flight time – Airliner pilots

– Requires 1st Class Medical

Key Differences of Pilot Licenses

Page 32: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

LEGAL FLIGHT OPERATIONS

Pathways to Legal Flight for Unmanned Aircraft

Page 33: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Certificate of Waiver or Authorization

(COA)

Public Entities

Public Aircraft

Aircraft Model

Defined Location(s)

Approved by UAS Integration Office

Special Airworthiness Certificate (SAC)

Manufacturers

Registered Aircraft

Aircraft Serial Number

Defined Location(s)

Approved by Manufacturing Inspection District Office

FAA Modernization and Reform Act of 2012, Section 333

Exemption

Civil Operators

Waiver request for commercial operation

Aircraft Model

Potentially Flexible Location

Approved by Administrator of the FAA

Legal Flight Operations

Page 34: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Public Entities – Public universities, law enforcement, department of transportation, etc.

Aircraft – Must be owned by the proponent

– Airworthiness of aircraft is self-certified by proponent

Operator – PPL Ground school passing grade for Class G airspace

– PPL for controlled airspace (other than G)

– Observer and Pilot must each have a current 2nd Class Medical

Airspace – Controlled or uncontrolled airspace, but not class B

– Determined by agreement among Flight Standards and Air Traffic Control

Key Requirements for COAs

Page 35: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Certificate of Waiver or Authorization

(COA)

Public Entities

Public Aircraft

Aircraft Model

Defined Location(s)

Approved by UAS Integration Office

Special Airworthiness Certificate (SAC)

Manufacturers

Registered Aircraft

Aircraft Serial Number

Defined Location(s)

Approved by Manufacturing Inspection District Office

FAA Modernization and Reform Act of 2012, Section 333

Exemption

Civil Operators

Waiver request for commercial operation

Aircraft Model

Potentially Flexible Location

Approved by Administrator of the FAA

Legal Flight Operations

Page 36: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Manufacturers – Experimental category for non-type certified aircraft

Aircraft – Requires a FAA registration

– Airworthiness of aircraft is approved by FAA

Operator – PPL and 2nd Class Medical

– Observer and Pilot must have 2nd Class Medical

Airspace – Determined by agreement among Flight Standards, Air

Traffic Control, and Manufacturing Authority

Key Requirements for SACs

Page 37: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Certificate of Waiver or Authorization

(COA)

Public Entities

Public Aircraft

Aircraft Model

Defined Location(s)

Approved by UAS Integration Office

Special Airworthiness Certificate (SAC)

Manufacturers

Registered Aircraft

Aircraft Serial Number

Defined Location(s)

Approved by Manufacturing Inspection District Office

FAA Modernization and Reform Act of 2012, Section 333

Exemption

Civil Operators

Waiver request for commercial operation

Aircraft Model

Potentially Flexible Location

Approved by Administrator of the FAA

Legal Flight Operations

Page 38: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Civil Proponent – Interested in commercial operation

Aircraft – No clear requirement on aircraft ownership

– Ownership of aircraft airworthiness is currently unknown

Operator – May require CPL in order to perform “for-hire” work

– Exemption can be requested

Airspace – No clear restriction on airspace

– Expected to be limited to C,D,E and G, but not all might be an option for Trimble aircraft

Key Requirements for Section 333

Page 39: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Public Law 112-95 is the FAA authorization

act of 2012. It addressed unmanned aircraft in

sections 331 to 336.

Goal posts for integration were set with dates

and time frames.

Section 333 was included to create a path for

circumventing the traditional means of

airworthiness should the administrator

choose to pursue such a path.

A 333 grant serves the purpose of granting

both airworthiness and operator approval.

Airworthiness & Operator Approval

Page 40: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

The 333 exemption is an airworthiness grant.

Trimble’s applies only to Trimble.

Each aircraft must be registered (N number).

The grant is specific to the UX5 aircraft.

Aircraft

Page 41: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

The 333 exemption is an operator approval.

Must be a Trimble employee and hold a

Private Pilot License (PPL).

May be a contractor for Trimble.

Only Trimble may fly under Trimble’s 333.

Operator

Page 42: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Must be class G.

Must be non-populated area.

– Can not fly over yellow patches of sectional chart.

Must obtain civil COA from FAA.

– Is the means for notifying Air traffic Control.

– Contains its own set of restrictions.

Seem to be taking about a month or two.

– The more desolate, the better.

– The more simple the operating request, the better.

Airspace

Page 43: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

In process of defining follow on procedure.

Expect an expedited application process for customers who agree to Trimble’s limitations.

Will publish the procedure to customers at not cost once the process is well defined.

Trimble would like its customers and dealers to obtain their own 333 with our help.

Continuing to work with FAA on COA requirements with desire reduce restrictions.

Do not expect any relief on flying over people or flying beyond line of sight.

Next Steps

Page 44: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

COA: N 8900.227 – Unmanned Aircraft Systems (UAS)

Operational Approval

SAC: 8130.34C – Airworthiness Certification of

Unmanned Aircraft Systems and Optionally Piloted

Aircraft

Section 333: Public Law 112-95 – FAA Modernization

and Reform Act of 2012

Busting Myths About the FAA and Unmanned Aircraft

– http://www.faa.gov/news/updates/?newsId=76240

How Do I Learn More?

Page 45: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

RULES FOR MODEL

AIRCRAFT

Pathways to Legal Flight for Unmanned Aircraft

Page 46: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Specifically addresses model aircraft

Compliance is voluntary

Hobby or recreation only

Non-Commercial Intent http://www.modelaircraft.org/

Advisory Circular 91-57 (1981)

Page 47: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

Clearly defines civil aircraft vs. public aircraft vs. model aircraft

Model aircraft is an unmanned aircraft (UA) that is— – 1) Capable of sustained flight in the atmosphere;

– 2) Flown within visual line of sight of the person operating the aircraft; and

– 3) flown for hobby or recreational purposes.

This is law, not voluntary – Advisory Circular 91-57 no longer applies

Aerial surveying & mapping qualifies as neither hobby nor recreation – intent is commercial

Definitions from Public Law 112-95 (2012)

Page 48: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

FAA-2014-0396: Interpretation for the Special

Rule of Model Aircraft

– Restates authority to take enforcement action

– Published June 18, 2014

– 30-day comment period

What Can I Do With My Model Aircraft?

– http://www.faa.gov/about/initiatives/uas/model_air

craft_operators/

Guidance to Model Aircraft Operators

Page 49: Emerging UAS Technologies FAA Updates - · PDF file · 2015-04-13UAS image processing charachteristics Imaging properties Unstable camera geometry (initial calibration report not

THANK YOU