1 NVESD MILCOM AR Charts

Army Heads Up Situational Awareness

Technologies

26 October 2015

David Randall

Associate Director

RDECOM CERDEC NVESD

Distribution Statement A: Approved for Public Release

2 NVESD MILCOM AR Charts

Heads-Up Navigation, Tracking,

and Reporting (HUNTR)

`14

DEC JAN FEB MAR APR MAY JUN JUL AUG SEP OCT NOV DEC JAN FEB MAR APR MAY JUN JUL AUG SEP OCT NOV

Port ARC4 to the Android Operating System

Integrate ARC4 with Nett Warrior

Develop Extended Display Capability

Software Stability Improvement Program

Develop ARC4 System Configuration Tools

Integrate Head Tracking Sensor / Video Processing Unit

Vest and Helmet Integration

Perform System-Level Testing

Assemble Devlierable Systems

Soldier Trails Preparation and Execution

Milestones

Ph

ase

2b

2015

Ph

ase

1

2016

Ph

ase

2a

Phase 1PDR

Phase 1CDR

Phase 1demo

DeliverySoldier Trials

Phase 2PDR

Phase 2CDR

Phase 2demo prep

Purpose:

Demonstrate augmented reality for day and night

tactical applications to provide networked heads-up

situational awareness (SA) to reduce fratricide and

increase lethality, survivability, and maneuverability

Products: • Provide a heads-up extension to the Nett Warrior

situational awareness system (day display and

ENVG)

• Demonstration of a clear integration path to

existing, fielded Nett Warrior and ENVG-II systems

• Prototype systems that support Army evaluations

through Soldier trials

Payoff: • Reduce Soldier cognitive Load (user-selectable

information)

• Heads-up SA

• Human Computer Interface (speech recognition)

• Increased SA and maneuverability with Geo-

registered Information

• Threat cueing capability for SA

• Increase Soldier survivability

Joint effort between NVESD, DARPA, and PEO Soldier

3 NVESD MILCOM AR Charts

Heads-Up Navigation, Tracking,

and Reporting (HUNTR)

WHAT IS IT?

•A TRL 6 Heads-up visualization of tactical, geo-registered information, providing real-time situational awareness enabling situational understanding

WHAT DOES IT OFFER? • Advanced dismounted location / orientation

tracking

• Low SWaP USB head tracking sensor • IMU + GPS + computer vision

high accuracy, low latency • Intuitive User Interface, providing critical

information without distracting • Integration with Soldier networks for seamless

information sharing • Compatibility with various wearable displays

and computing platforms

Transition Partners: PM-Soldier Warrior and PM-Soldier Sensors and Lasers Technical Partners: DARPA, PM- SWAR, PM-SSL and RDECOM CERDEC CPID

TECHNICAL APPROACH:

• Software Development

– Port HUNTR to the Android operating system

– Demonstrate operation on the End User Device

• Side-by-side operation with the Nett Warrior app

• Integrated information sharing with Nett Warrior

– Laboratory / benchtop demo

• EUD running HUNTR and Nett Warrior

• USB head tracking sensor module

• Dual display capability

• Hardware Development

– Develop system configuration tools

• To be run on the Nett Warrior Mission Planning Computer (MPC)

• Configuration of system preferences and settings

• Pre-processing of DTED for horizon matching algorithm

– Implement helmet-mounted head tracking / video processing unit

• Extension of current USB head tracking sensor module

• Additional video processing capability to directly drive HUD

• ‘Hot-swap’ capability to support day or night operations (ENVG-II)

– Integrate heads-up SA capability with Nett Warrior wearable ensemble

4 NVESD MILCOM AR Charts

SVIT 70° (O)

Why not COTS?

SVIT 50° (T)

FOV

Lite Eye 28 °

Google

Glass 14°

Brightness Typical see-through display requirement: 20% contrast on 10,000 ft-L background

Yields 2,000 ft-L necessary Brightness

50ft-L 100ft-L

Lite Eye

2000ft-L

SVIT Req.

50ft-L 2000ft-L

SVIT Req.

100ft-L

Lite Eye