Upload
dokien
View
218
Download
0
Embed Size (px)
Citation preview
Click to edit Master title styleUNCLASS/FOUO
AMERICA’S ARMY:THE STRENGTH OF THE NATIONClick to edit Master title style
UNCLASS/FOUOAMERICA’S ARMY:THE STRENGTH OF THE NATION
UNCLASSIFIED//FOR OFFICIAL USE ONLY
Dr. Russell D. Richardson, G2/INSCOM Science AdvisorDr. Russell D. Richardson, G2/INSCOM Science Advisor
11UNCLASSIFIED//FOR OFFICIAL USE ONLY
UNCLASS/FOUOAMERICA’S ARMY:THE STRENGTH OF THE NATION
UNCLASSIFIED
Semantic Enrichment of the DataSemantic Enrichment of the Data
Solving the Precision / Recall Conundrum with Semantic Enrichment of the Data
Solving the Precision / Recall Conundrum with Semantic Enrichment of the Data
Precision
Concepts/Summarization (e.g. Terrorist Cell Leaders)Concepts/Summarization (e.g. Terrorist Cell Leaders)
Resolved Entity (J h ith ID )Resolved Entity (J h ith ID )
IncreasingSemanticRichness Semantically
Labeled Data
Precision
y Centric
Resolved Entity (John with ID xxxxx)Resolved Entity (John with ID xxxxx)
Entity (Person, Object, Organization, Location)Entity (Person, Object, Organization, Location)
Entity
Multi‐token/Lemma/Contexual Element/Part of Speech (Noun, Pronoun, Punctuation)Multi‐token/Lemma/Contexual Element/Part of Speech (Noun, Pronoun, Punctuation)
Token (Aggressively Indexed Words)Token (Aggressively Indexed Words)Aggressively IndexIncreasingRecall
De‐Anonymization of Large Data SetsDetect / Match Behaviors and Patterns
Enabled by fine grain security and compliance enforcement
gg y
Determine that Two Patterns of Life are the Same butNot Necessarily Whose Pattern of Life Determine that Two Patterns of Life are the Same butNot Necessarily Whose Pattern of Life
IncreasingAnonymity
ntric
Massive Data Sets for Anomaly / Change Detection
Massive Data Aggregation for Machine Analytics, Baselining, and Trend Analysis
Indications and WarningsIndications and Warnings
Non‐Attributable Aggregate Behavior ‐ Determine Avg Traffic Speed by Tracking Cell MovementDetermine the Sentiment of a Town City Region Country
Non‐Attributable Aggregate Behavior ‐ Determine Avg Traffic Speed by Tracking Cell MovementDetermine the Sentiment of a Town City Region Country
Non-Attributable
opulation Cen
‐ Determine the Sentiment of a Town, City, Region, Country‐ Determine the Sentiment of a Town, City, Region, Country
Po
22UNCLASSIFIED
UNCLASS/FOUOAMERICA’S ARMY:THE STRENGTH OF THE NATION
Extending Cloud-Enabled Advanced Analytics
Extending Cloud-Enabled Advanced Analytics
AllAll--Source Source Analytics for ‘Big Data’Analytics for ‘Big Data’AllAll--Source Source Analytics for ‘Big Data’Analytics for ‘Big Data’with Advances in with Advances in
Geospatial Indexing, Geospatial Indexing, Voice Index and Search, Voice Index and Search,
Bi t i E tit M tBi t i E tit M t
with Advances in with Advances in Geospatial Indexing, Geospatial Indexing,
Voice Index and Search, Voice Index and Search, Bi t i E tit M tBi t i E tit M t VoiceVoiceMobileMobileBiometric Entity Management, Biometric Entity Management,
Motion Imagery Tracks, Motion Imagery Tracks, MultiMulti--INT Visualization,INT Visualization,
C ll ti M tC ll ti M t
Biometric Entity Management, Biometric Entity Management, Motion Imagery Tracks, Motion Imagery Tracks, MultiMulti--INT Visualization,INT Visualization,
C ll ti M tC ll ti M t
VoiceVoiceMobileMobile
Collection Management,Collection Management,Support for Mobile Devices,Support for Mobile Devices,
Powerful Compute Platforms,Powerful Compute Platforms,MultiMulti Level SecurityLevel Security
Collection Management,Collection Management,Support for Mobile Devices,Support for Mobile Devices,
Powerful Compute Platforms,Powerful Compute Platforms,MultiMulti Level SecurityLevel SecurityMultiMulti--Level Security, Level Security,
IC Shared Software, IC Shared Software, ….….MultiMulti--Level Security, Level Security,
IC Shared Software, IC Shared Software, ….….
UNCLASSIFIED
Motion Imagery TracksMotion Imagery Tracks
Click to edit Master title styleUNCLASS/FOUO
AMERICA’S ARMY:THE STRENGTH OF THE NATION Fusion ChallengesFusion Challenges
INTs
SocialMedia Pattern of Life
Tipping and Cueing• Alerts & Notifications• Information and Situation
Media
All Source
Pattern of Life Analysis
Person
Location
• Sensors• Information requests
TacticalReports
HUMINT
Challenges1. Cross INT Correlation2 Entity Resolution and1. Cross INT Correlation2 Entity Resolution and
Threat Characterization
Persistent and Total Entity and Asset Tracking in Entity
Database
Org
Unit
…
Biometrics
2. Entity Resolution and Disambiguation
3. Scale of the Entity Database4. Velocity of Data Collection and
Processing5 D t i i P tt f Lif
2. Entity Resolution and Disambiguation
3. Scale of the Entity Database4. Velocity of Data Collection and
Processing5 D t i i P tt f LifCOABiometrics
DOMEX
5. Determining Patterns of Life and Major Combat Operations with Tolerance to Errors
6. Ranking Threat Severity and Timing
5. Determining Patterns of Life and Major Combat Operations with Tolerance to Errors
6. Ranking Threat Severity and Timing
ISR Optimization
COAAnalysis
SIGINT
GEOINT
Cyber
7. Optimizing / Synchronizing ISR8. Real‐time Tipping and Cueing 7. Optimizing / Synchronizing ISR8. Real‐time Tipping and Cueing
Continuously & Always Correlating All Data into the Entity Database
4
y Data into the Entity Database
Click to edit Master title styleUNCLASS/FOUO
AMERICA’S ARMY:THE STRENGTH OF THE NATION Need to Work Entity Tracking
SocialMedia
Threat Characterization
P1P2P3
(T1,L1) (T2,L1) (T3,L3)(T2,L3) (T3,L3) (T4,L3)(T1 O1) (T3 L3) (T3 L2)
Same Time, Same PlaceEntity Database
Persist Tracks 3 COAs
Person
Location
…
P3P4P5
L1L2
(T1,O1) (T3,L3) (T3,L2)(T1,L2) (T2,L2) (T3,L3)(T1,L1) (T2,L2) (T3,L3)
(T1,P1) (T2,P1) (T1,P4)(T3,P3) (T1,P4) (T2,P5)
Database
ted
base
FormLinks
L2 may be an important location as many P’s have been reportedOrg
Unit
…
Reports/
HUMINT
…
L3L4
O1O2O3
( ) ( ) ( )(T1,L1) (T2,L1) (T3,L3)(T1,L1) (T2,L1) (T3,L3)
(*,L1) (T1,P1) (T3,L3)(T1,L1) (T2,L1) (T3,L3)(T1 L1) (T2 L1) (T3 L3)
Precorrelat
Linked
Data as many P s have been reported
being there
…
Biometrics
DOMEX
…
O3O4O5
U1U2
(T1,L1) (T2,L1) (T3,L3)(T1,L1) (T2,L1) (T3,L3)
(T1,L1) (T2,L1) (T3,L3)
(T1,L1) (T2,L1) (T3,L3)(T1 L1) (T2 L1) (T3 L3)
1 2 Patterns of Life Determined
DOMEX…
U2U3U4U5
(T1,L1) (T2,L1) (T3,L3)(T1,L1) (T2,L1) (T3,L3)(T1,L1) (T2,L1) (T3,L3)(T1,L1) (T2,L1) (T3,L3)
T1 (P1 L1) (P3 L1) (T3 L3) Location of P1 over timeInfer P3 at L1 as O1 is at L1
P1 and P3 share location pattern
SIGINT
GEOINT
Cyber …
T1T2T3T4T5
(P1,L1) (P2,L3) (T3,L3)(P1,L3) (P3,L3) (T3,L3)(P2,L3) (T2,L1) (T3,L3)(T1,L1) (T2,L1) (T3,L3)
(P1,L1) (P3,L1) (T3,L3)
Optimize ISR4
5
ISR
Click to edit Master title styleUNCLASS/FOUO
AMERICA’S ARMY:THE STRENGTH OF THE NATION
The DCGSThe DCGS--A ICITE Cloud (aka Red Disk) A ICITE Cloud (aka Red Disk) atat--Scale Entity DatabaseScale Entity Database
• EDH• Provenance• TDF• Metadata taggingG l i
Data Interoperability Enterprise Context
Decreases Information
Burden Sensors
Data Access Process ‐ User’s authorizations
• Geo temporal extraction• Entity extraction and nomination• Artifact enrichment• Security Labeling• Metrics• moreSources DIAS User’s
Full Spectrum Analytic Awareness
authorizations and roles are
matched to data security labels
UCD
NIFI / StormRTAAP
Sources
• SIGINT• MTI• WAMI• FMV• TED
Velocity &
Content
Authorizations
Artifacts,Real‐Time Community UCD• TED• Fires• Harmony• USMFT• Collection Mgmt
Artifacts, Terms
Statements
Analytics and indexes updated
h if
Advanced Analytics Pipeline … updating analytics earliest as possible. Analyst’s
conclusions enrich the UCD
yPartners
• Open Source
• Mission Command
• Audio• etc
M RM R
wrt to each artifact
• Maximally correlated data• Contextual‐based navigation• All data under a common representation to enable
• Classes of relationships determined at various points
• No all relationships need to be explicitly expressed – correlations enable this
• All analytic disciplines together withM/RM/R
• Enrichment• Analytics and indexes wrt
to the entire corpus,• Bulk and incremental
All data under a common representation to enable assess to all layers
• Cross corpus analytics without custom code• Signatures are analyzed in real time• Logical representation needs to be consistent in
order for the physical model and view to be
• All analytic disciplines together with correlated data among all disciplines
Analytic models are represented in the UCD
6
Bulk and incremental updates
• Data sharing
p ydynamic