12
http://www.data-tactics.com Data Tactics Corporation Proprietary Material Data Tactics FMV and Imagery Entity Extraction and Analytics Joint Presentation Integrating Data Tactics GM Stack and Technology OCT 17, 2012

Data Tactics and Nervve Integrated Big Data v3

Embed Size (px)

DESCRIPTION

 

Citation preview

Page 1: Data Tactics and Nervve Integrated Big Data v3

http://www.data-tactics.com

Data Tactics Corporation Proprietary Material

Data Tactics FMV and Imagery Entity Extraction and Analytics

Joint Presentation Integrating Data Tactics GM Stack and Technology

OCT 17, 2012

Page 2: Data Tactics and Nervve Integrated Big Data v3

Government Cloud Capabilities

• Government Investment in Cloud Technologies and Data Analytics• Secure, Operational Systems providing deep analytics into Petabyte level data sets for National Agencies• Based on Government Off the Shelf (GOTS) and Open Source Software running on commodity hardware• Coalescing of technologies into a Government Standard Cloud Architecture based on standards, security, and

capabilities• Fruits of large investments available to all Federal Agencies

• USD(I) – DI2E• ODNI – I2 Pilot• NGA – FMV Archive & Exploitation* • NSA – GhostMachine - SIGINT Cloud Node• DIA – Orion• CIA – Commercial Cloud• Army – DCGS-A• DARPA – Advanced Indexing and Analytic Research

Page 3: Data Tactics and Nervve Integrated Big Data v3

Single Solution for Multiple Missions

• Big Data Storage is ALREADY A COMMODITY• No Need for expensive non-interoperable Stovepipe Systems• Single Data Store supporting multiple missions• multiple data projections • complex and integrated analytics

•Concentrate mission effort where it is NEEDED• DO Build customized user interfaces, workflows, and business

logic• DO NOT build another data stovepipe and non-reusable

application stack

Page 4: Data Tactics and Nervve Integrated Big Data v3

NGA FMV and Imagery Data Analytics Cloud

FMV and Imagery Sources

AnalyticEnvironment

-Linearly Scalable- Commodity Hardware- GOTS and Open Source- Interoperable- Cost Efficient

Complex Analytics- Rapid Iteration Time- Advanced Query and Analysis- Explore Non-obvious Relationships based on:

- Temporal- Geospatial- Entity- other attributes

- Canonical Analysis- Multiple Data Sets- Multiple Dimensions

- Anomaly Detection- Prediction- Link Analysis- Statistical Analysis

Data Tactics Corporation Proprietary Material

Page 5: Data Tactics and Nervve Integrated Big Data v3

Nervve Visual Indexing Capabilities

• Nervve Visual Index allows rapid indexing of PBs of Video and Imagery in Seconds!!!– Rapid Iteration time (seconds to minutes) enabling easier iterative filtering or several “what if”

scenarios– Query using single image or image model – Directly Analogous to text querying of document store

• Infinitely Scalable Architecture with Tunable Indexing– Can Index streaming or archived video from 10s to 100s times speed– Linearly scalable no memory shared architecture– Runs on Commodity Nvidia GPU systems

• 2D Image Based Query Model Generation– Ability to create Object Model visually representing an Entity (e.g. “White Truck”)– Ability to Query the Visual Index using Image Models– Sub-second to seconds result set return time over Petabytes of original Video and Imagery– Can create for EO, IR, and LIDAR – algorithm is raster based

• Negative Filters– Do not send images or video containing “Just Unmoving Desert”

Data Tactics Corporation Proprietary Material

Page 6: Data Tactics and Nervve Integrated Big Data v3

Data Tactics Enterprise Analytics

• Complex Event Processing Based on Video Content– Identify and Alert Video and Imagery containing “Person of Interest”– Tag Video (in-stream or metadata)– Contact Alerting Engine

• Single Dataspace Ontology “maps” all Imagery and FMV sources to common model – Enables apples to apples comparisons across various data sets– Over time creates a “Video Content Log”– What you are interested is the prioritization of the logging

• Ability to use Semantic Queries on Entities (e.g. People, Cargo, Vessels) over time periods and within geographic regions– Complex Descriptions of Entities combining IMINT, VIDINT, SIGINT, HUMINT, etc…– Can Federate Imagery and FMV Queries across the IC– Semantic Queries Based NOT on the METADATA but on the CONTENT in the Video

Data Tactics Corporation Proprietary Material

Page 7: Data Tactics and Nervve Integrated Big Data v3

NGA FMV Enhanced GM Architecture

Data Tactics Corporation Proprietary Material

NiFi Ingest IC Standard Ghost

Machine Cloudbase

TUIC

OWF- Alerts

- Queries- Analytics

Model Generation

StructuredUnstructured

Semi-Structured

Video and Image Transformation Semantic

Ontology

Advanced Analytics

Page 8: Data Tactics and Nervve Integrated Big Data v3

NGA FMV Enhanced GM Benefits

• Single Dataspace allows for analysis of complete data sets of NGA• Complex algorithms can be more easily applied to dataspace using

distributed technologies to support NGA Missions• Greatly improved access to the large volume and variety of geospatial

knowledge at all security domains• Open and IC ITE Standards Based Architecture enabling, cross domain

and cross agency sharing and fusion• Cutting Edge Analytic Capabilities enabling rapid iterations and

hypothesis led analysis and Activity Based Intelligence• Customer Service aligned data stores, services, and common user

interfaces enabling timely and accurate access to all data on all domains• Affordability at Scale

– Commodity Hardware Scales Linearly– Software costs can be minimized by leveraging GOTS and Open Source

Data Tactics Corporation Proprietary Material

Page 9: Data Tactics and Nervve Integrated Big Data v3

FMV ingestion into IC GM

NiFi ingest and cloudBase

storageof distributed video content

index

TransformationOf Video Data

Image Model Generation

Page 10: Data Tactics and Nervve Integrated Big Data v3

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

Library of User Created Object Models

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distribu

ted Index

FMV Distributed Index

FMV Distributed Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index FMV Distribute

d Index

In ad-hoc, collaborative fashion, users may create, use, modify and refine

object models

Build and Share Image Object Models

Page 11: Data Tactics and Nervve Integrated Big Data v3

Object Models are comprised of a single or multiple images of what you

are looking for

Alert!- Object [White Car]

- Video Clip Transmitted

Time Start: 14:38:03Time Stop: 14:39:27Lat/Long: 32.3333/44.4333

+

Object Models are the input/patterns for Queries and Alerts

Page 12: Data Tactics and Nervve Integrated Big Data v3

Complex Multi-Dimension Queries

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

Secure, Multi-Domain, Distributed FMV Content Index in GM

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

FMV Distributed

Index

ImageModels

“Search for within

5 km of 31.5058° N, 65.8478° E