Human Systems Science & Technology for Navy and Marine …sites.nationalacademies.org/cs/groups/dbassesite/...ONR34 Science & Technology Goals • Solving today’s problems while

Dr. Terry Allard ▪ ONR34Department Head for Warfighter Performance S&TOffice of Naval Research

[email protected]

Human Systems Science & Technologyfor Navy and Marine Corps

a briefing to

Committee on Human-Systems IntegrationNational Research Council

20 Aug 2009

Distribution Statement A: Distribution authorized to the Department of Defense and U.S. DoD contractors only Case # 43-476-09: 18 AUG 09

2

Warfighter Performance S&T

Distribution A: Case # 43-476-09: 18 AUG 09

ONR34 Science & Technology Goals

• Solving today’s problems while planning for the Navy and Marine Corps after next

Delivering now while anticipating future requirements

• Art of the possible from the state of the artReducing investment risk in new ideas

• S&T Competency and Global awareness:“Consultants of the 1st resort”

3



High-Level Naval Support for S&T

Invest in S&T to provide for future capabilities and prevent technological

surprise.- 34th CMC Planning Guidance

13 November 2007

“…ensure adequate resources are provided for the Corps’ investment in

S&T…”-Guidance to DC P&R

December 2006

Increase S&T to 3% real program growth beginning in FY09

-MROC GuidanceSpring 2007

Build a Navy for tomorrow

• Leverage Science & Technology to ensure warfighting benefits

• Allocate resources and acquisition processes to deliver the right capability, on time, at the right cost throughout the lifecycle

Maintain current warfighting readiness

Provide for our people-CNO Guidance

26 October 2007

US Marine CorpsChief of Naval Operations

“. . . we must recognize the importance of S&T as a driver of both capability and threat.”-Navy Strategic Plan (2007)

4



Office of Naval Research

Expeditionary Warfare

& Combatting Terrorism

OceanBattlespace

Sensing

Sea Warfare and

Weapons

Warfighter Performance

S&T

Air Warfare and

Weapons

Director of

InnovationDirector

of Research

Directorof

Transition

C4ISR

30 31 32 33 34 35

SECNAV

N093 / SG

CMC*ACMC

CNO*VCNO *S&T Corporate Board

AVCNR

*ASN(RDA)

N091 / CNR

ACNR

Vice Chief of Naval Research (USMC) Chief of Naval Research Exec Director

5



Discovery & Invention(Basic Science, Early Applied Research)

~40%

AcquisitionEnablers(FNCs)

~30%

Leap Ahead Innovations(INPs)

~10%

Quick Reaction(10%)

• Tech Solutions• Experimentation

Acquisition Enablers(36%)

• Future Naval Capabilities• SBIR• Manufacturing Technology• Rapid Technology Transition

Discovery & Invention(42%)

• Basic & Early Applied Research• National Naval Responsibilities• Education Outreach HBCU/MI

Leap-Ahead Innovations(12%)

• Innovative Naval Prototypes • Swampworks

Near Mid Far

Bro

adN

arro

wIm

pact

Time Frame

Quick Reaction & Other S&T

~10%

S&T Focused on Naval Needs

FY10 DON S&T Funding = $1,824M

PE: 6.3 6.3 / 6.2 6.2 / 6.1

6



• Naval Warfighter Performance• Total Ownership Cost• Information Superiority & Communication • Distributed Operations• Asymmetric & Irregular Warfare• Operational Environments

• Maritime Domain Awareness • Platform Mobility• Power and Energy• Power Projection• Assure Access & Hold at Risk• Survivability & Self-Defense• Fleet/Force Sustainment

Naval S&T Strategic Plan Focus Areas

7



Naval S&T Strategic Plan Focus Area

8



HSI Required in DoD Acquisition

• Ensure a MANPOWER pipeline to meet Fleet needs• RECRUIT / SELECT the right people

and ASSIGN them to the right jobs • TRAIN warfighters to develop and maintain

the right skills and expertise• DESIGN systems that leverage unique strengths of

Human, Software and Hardware elements• Optimize human-system Performance• Enhance Warfighter Safety• Reduce Costs

More than Human Factors Engineering

DOD Instruction 5000.02: Operation of the Defense Acquisition System

9



Some HSI Requirements

• Reduced Personnel Costs• Reduced training requirements / time to train / OJT• “Lighten the load” for small unit operations• Human social, cultural, behavioral sciences• Human-Robotic Interaction• “Unmanned Systems”• Human-Autonomy Interaction• Network-centric Command and Control • Data fusion and distributed decision-making• Expeditionary and Irregular Warfare• Safe systems: Noise-Induced Hearing Loss• Expeditionary Medicine, Combat Casualty Care• Undersea Medicine

10



S&T Domains

• Human-Robotic Interaction• Human-Autonomy Interaction• Computational Cognition

& Social, Cultural, Behavioral Sciences• Decision Support &

Command, Control, Collaboration• Training Systems• Human-Systems Design• Safe Systems• Expeditionary and Undersea Medicine

11



Human-Robotic Interaction

12



Remotely Operated Vehicle Control

USVO Stations

LCS requirement: 1 operator controls 4 Unmanned Surface Vehicles (USVs)Current capability: 1 Operator controls 1 USV

FNC Demo: 1 operator controls 2 USVsDesign of USV Operator display and control interaction

Pay-offs: Improve operator performanceReduce manning requirementReduce space requirement

Unmanned Surface Vehicle Monitoring & Control HCI for Amphibious Operations

13



The Hybrid Force: Human-Robot Teams

Near Term: Multi-modal, natural Human-Robotic Interaction• Automatic detection, tracking, and following of human team members• Speech recognition for vocal command and control• Speech synthesis for high-level feedback to operator• Gesture recognition for physical command and control

Operator has head-up and hands-free

Enabling Robots to be Effective Team MembersNo controller hardware or displays needed

14



The Hybrid Force: Human-Robot Teams

Robotic Teammates for Damage Control / Asymmetric Warfare / Hazardous Duty

Far Term: Embedded intelligence on robots• Social cognition, collaboration • Biometrics• Multi-lingual communication • Human activity recognition• Deception detection • Remote physiological and medical sensing

Mobility and dexterity to perform complex tasks with shared attention.Facial expression enables intuitive non-verbal communication and fosters trust.

15



Human-Autonomy Interaction

16



Human-Autonomy S&T

Technical Areas• Human-robotic interaction • Supervisory control of autonomous vehicles• Data seeking / fusion to support human-machine collaboration• Distributed, dynamic, network-centric decision support • Enhance machine intelligence / human-machine interaction

Benefits: Hybrid Force enables new missions• Optimized manning that exploits machine capabilities:

Command & Control exploiting machine speeds• Increased span of control and reduced manpower costs• Removing people from the line of fire / hazardous duty • Enhanced situation awareness and faster operational tempo

S&T Questions & Opportunities• Autonomous systems workshops identify human role definition as critical step• Can human and autonomous systems learn to work together as a team?• What is machine “understanding” and how is that communicated? • Multi-disciplinary / cross-departmental collaboration

Building on ONR34 core / ONR Corporate Workshops

17



Computational Cognition,Social, Cultural Behavioral Sciences

18



Social-Cultural Modeling

HSI:

Training

DesignStandards

Decision Support

HSI:

Training

DesignStandards

Decision Support

Human Performance Modeling:Creating new fields/Anticipating requirements

1985 1990 1995 2000 2005 Today

Cognitive Science

Team Decision-Making

C2

Social Network Analysis

Social, Cultural, Behavioral Science

Intelligent Tutors

Organizational Models

TADMUS / Manning Affordability

Adaptive Architectures

Team Engineering Models

Individual Engineering Models

9/11/011988 Vincennes

Threat ID

Operational Adaptation

Threat ID

Operational Adaptation

6.1 Theory

6.1 Theory

6.1 Theory

19



Develop capability to understand, model, forecast human behavior– Cultural dynamics of geopolitical regions – Evaluation of individual behaviors, social networks / entire societies– Forecasting terrorist activity and adaptation to US interventions

Success strongly depends upon understanding cultural dynamics– Influencing attitudes about terrorism as a political solution – Combating the radicalization process– Enhancing training, planning and analysis in culturally distinct geo-political

environments

Research Challenges1) How to predict socio-cultural phenomena ?2) How to collect unbiased field data to validate predictive models ?3) How do we manipulate and shape socio-cultural networks ? 4) Understanding red and blue force Network Models

Predict and prevent terrorist activityPredict and prevent terrorist activity

Socio-Cultural Sciences (ONR 30/34)

20



Decision Support & Command, Control, Collaboration

21



Mission Performance Optimization (MPO) Mine Warfare Decision Support

Mission “Dashboards” and visualizations that provide up-to-date problem summaries / alerts

Overload, behind schedule, limited resources - too late!

Visualizations that collect and compile mission information enabling effective team supervision and collaboration with superiors

Supervisors with clipboards and no displays…

Visualizations with mission-centric current, past and pending issues and status

Knowledge Walls with cluttered GCCS Map, CNN, Fox News…

Mission “Dashboards” enable teams to focus on “problem solving” vs “problem finding”

Collaboration “systems” clogged with data (email, chat, viz, radio). . .

Explicit mission process and performance viewwith dynamic mission goals and metrics.Automatic feed from 24/7 mission support tools

Stale & Static Powerpoint Briefs requiring hours of preparation…

Integrating VisionToday

22



Warfighting Payoff• Reduced complexity: 1-click access to critical information for any MIW task• Reduced workload for MCM Task Group to generate mission reports• Reduce workload by eliminating PowerPoint mission briefs

vice current = 3 crewmembers 8AM, 8PM briefs• MIW mission focal tasks incorporated into Task-Centered MPO design

Products1.Mission Performance Visualization

Situation Awareness on mission process, status, delays, products, problems

2.Mission Dashboard DisplaysConcise status information about user selectable mission items

3.Integrated Task Visualization 1-step drill down to an integrated visualization of critical tasks

4.Mission Business Process ModelDescribe, edit, upgrade mission process & product flow

Mission Performance Optimization (MPO) Mine Warfare Decision Support

23



Battlespace on Demand Decision Support

Improving Operational planning in blue water, littoral and riverine Environments

Challenges• Determine COA, assess risk, position ISR assets • Integration of METOC, Intel, tactical and mission objectives• Decision-making complexity due to uncertainty and ambiguity.

Tier 2 – the Performance Layer• Operational Effectiveness

Tier 1 – the Environment Layer• Search Patterns• Asset Allocation

Fleet Data

40nm

100 nm

SSN AreaUPDATEDCONOPs

1800 sq nm

MPA Station #1UPDATEDCONOPs

4200 sq nm

MPA Station #2UPDATEDCONOPs

4000 sq nm

100 nm

28-00N

29-40N

60nm

30 nm

074-45W 072-50W

Province “B”

Province “A”“A” “A”

Updated CONOPs

Cumulative Probability of Detecting Both Threat Subs

0.0%

10.0%

20.0%

30.0%

40.0%

50.0%

60.0%

70.0%

80.0%

90.0%

100.0%

0 5 10 15 20 25 30 35 40

Hour

Cum

ulat

ive

Prob

abili

ty

Updated CONOPsUpdated EnvironmentOriginal CONOPsUpdated EnvironmentOriginal CONOPsHistorical Environment

Tier 3: the Decision Layer• Options / COA• Risk Assessment• Asset Allocation

PayoffsDecision Superiority:

Enhanced quality and timeliness of operational decision making

24



Training

25



Simulation-Based Training:Mid-frequency Active Sonar Training

Value to Naval Warfighter: • Preserves acoustic Emissions Control (EMCON)• Proficiency training for CRUDES operators and unit ASW team underway or in port• Coordinated ASW training & participation in Fleet Synthetic Training (FST) exercises

Naval Need: Realistic Mid Frequency Active (MFA) integrated ASW training

EFAAS Solution: Stand-alone, roll-on, roll-off laptop emulator• Realistic operator interface• Instructor console / training package• Incorporates moderate to high-fidelity models

4.9.2 Training & Education

From Idea to Implementation: • ONR 34 core (FY05-07); Swampworks & Rapid Technology Transition (FY07-09)• COMNAVSURFOR/ N7 / N86 funded deployment of 35 EFAAS systems

•2 DDGs, 9 FDNF CRUDES, DESRON 15, ATG-WESTPAC, CSCS WESTPAC• USFF commitment to 30 additional systems dependent on on-board evaluations

26



Game-Based TrainingBattle Stations 21

Capstone event exposes personnel to 19 fundamental ship board tasks.• Mockup training is very expensive, few fail, and performance is not measured adequately.

PC-based gaming software to prepare sailors before Battle Stations 21 exposure.

Mixed-reality training and automated assessment on 19 Battle Stations 21 tasks.

• 30% reduction in training time

• 10-15% improvement in retention

Current Capability

S&TProvides

SuccessMetrics

Great Lakes Naval Training Center

27



Enhancing Fluid Intelligence with Strategic Game Training

Brief, game-based training experiences can improve fundamental perceptual/intellectual abilities

that support combat decision making performance.

Young adults exposed to 24 hours of training on a strategic computer game (Rise of Nations) show highly significant gains in fundamental reasoning,

problem solving and attentional capabilities.

P < .01 P < .001

Raven’s Progressive Matrices( a measure of fluid intelligence)

Attention switching time (correlates withperformance in piloting combat aircraft)

4.9.2 Training & Education

Dr. Arthur Kramer, U. Illinois, FY 07 MURI

28



Human-Systems Design

29



Shipboard Manning Models

Current SME evaluations lack fidelity to assess reduced manning risk and task distribution

• Integrated modeling methods do not exist • Component models unvalidated

•Required to explore Cost / Performance Trades

Predictive algorithms to assess: - Personnel survivability & impact on ship recovery- Fatigue, workload, heat stress, motion sickness, etc.

• Use tools for ship design to optimize outfitting, survivability, maintainability, combat readiness, manning, training, Total Ownership Costs

Predictive algorithms to assess: - Personnel survivability & impact on ship recovery- Fatigue, workload, heat stress, motion sickness, etc.

• Use tools for ship design to optimize outfitting, survivability, maintainability, combat readiness, manning, training, Total Ownership Costs

Title 10 requires personnel & ship survivability report to Congress

30



Safe SystemsExpeditionary and Undersea Medicine

Saving Lives, Enhancing Quality of Life,

Improving System Performance

31



Multi-faceted systems approach to reduce warfighter hearing loss…

• Incidence & Susceptibility• Reduced Noise (e.g., Jet Engine Physics)• Personal Protective Equipment, Standards• Medical Prevention & Treatment

Noise Induced Hearing Loss

1. Predicting Shipboard Incidence, Noise Propagation & Cost2. Mitigation Strategies3. Jet Engine Noise Reduction4. 3D Digitization for “Prescription” Ear Plugs5. In-Ear Dosimetry6. Hearing Loss Simulator7. Medical Prevention & Treatment

a. Pharmacologic Interventions b. Cell Regeneration c. Blast Intervention

Supports Aviation, Surface, Submarine and Marine Corps Enterprises

32



“On a good day, medical is an afterthought.

On a bad day, medical is the only thought.”

-Vice Admiral RobinsonNavy Surgeon General

at ONR SG Day, 27Feb2009

Medical Capabilities are critical to Combat Effectiveness, Medical Capabilities are critical to Combat Effectiveness, new Operational Concepts, Safe Systems, Quality of Lifenew Operational Concepts, Safe Systems, Quality of Life

33



ABCABC’’s of Points of Point--ofof--Injury CareInjury Care

BREATHING

Oxygen GenerationClosed-Loop Ventilation

AIRWAYAssess & Secure

CIRCULATION

Transfusion Safety Artificial Blood Substitutes

Pharmacologic ResuscitationDecision Assist Fluid Delivery

*

Warfighter Benefit

• Saves lives!

• Extends the “Golden Hour”

• Reduces logistics, refrigeration requirement

Treating Hemorrhagic Shock

Transfusion Safety

Pharmacologic Resuscitation

ArtificialBlood

CombatGauze

PRODUCTS

Extending the “Golden Hour” after injuryExtending the “Golden Hour” after injury

34



Lightening the LoadLightening the Load

Warfighter BenefitClosed-Loop Ventilation

Decision-Assisted Fluid Delivery

Portable, Safe Oxygen Generation

Reduced # of O2 cylinders, fluids lighten the load

• Better medical care / saving livesby continuous patient monitoring

• Reduced logistical burden• Enhanced field performance

Enable Naval Sea Basing, Ship-to Objective-Maneuver (STOM)

and Distributed Operations (DO) concepts of operations

Forward Resuscitative Surgical SystemsFirst

Responder

CASEVAC / MEDEVAC

Combat Support or Fleet Hospital

35



Undersea Medicine S&T

Technical Areas• Decompression illnesses (DCI)• Oxygen toxicity• Medical prevention and mitigation of health and performance hazards

associated with diving/submarine deployments

Benefits: Protect the undersea warfighter• Development of non-recompression therapies for disabled submarine

(DISSUB) escapees• Expand mission flexibility of SPECWAR/SPECOPS divers• Platform to assist in the mitigation of prospective short- and long-term

diver/submarine deployment health threats• Maintain future NNR capability through the recruitment of young scientists

Questions & Opportunities• We do not understand the mechanisms underlying any health threat

associated with diving operations—the field is wide open for discoveries

National Naval Responsibility (NNR)

36



Undersea MedicineA National Naval ResponsibilityA National Naval Responsibility

• Non-recompression treatment for DISSUB escapees and remote divers at risk for decompression illnesses

Intravenous perfluorocarbons delayed the onset of decompression illness in 2 large-animal models in preparation for FY12 FDA submissionEnable longer transport time to recompression chamberExploring oral and inhalation approaches

ONR is the global leader of Undersea Medicine S&TONR is the global leader of Undersea Medicine S&T

37



Summary

• Strong support for DoD Science & Technology

• HSI at ONR receiving high level of visibility

• New opportunities in - Computational human system modeling- Autonomy and robotic systems- Socio-cultural sciences- Total Ownership Costs / Optimized manning

Documents

Human Systems Science & Technology for Navy and Marine …sites.nationalacademies.org/cs/groups/dbassesite/...ONR34 Science & Technology Goals • Solving today’s problems while