39
EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr. Ji-Hyun Yang Co-Advisor: Dr. Quinn Kennedy Second Reader: Dr. Joseph Sullivan

EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Embed Size (px)

Citation preview

Page 1: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A

SIMULATOR ENVIRONMENTLCDR Eric McMullen

MAJ Shane Grass

Thesis Advisor: Dr. Ji-Hyun Yang Co-Advisor: Dr. Quinn Kennedy

Second Reader: Dr. Joseph Sullivan

Page 2: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Outline

• Background • Pilot Study• Hypotheses• Experiment

– Participants– Equipment– Design

• Results– Data Formatting– Data Filtering– Statistics

• Future Work• Q&A 2

Page 3: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Background

• Distractions degrading task performance has been researched in numerous studies, but rarely concerning secondary tasks while flying military aircraft.

• Noted study by Strayer, Drews, & Couch (2006) investigated the effects of cell phone use while driving– Compared effects to intoxication– Frequently cited in Crew Resource

Management Instructors’ course for Naval Aviators

3

Page 4: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Pilot Study

Conducted proof of concept in HF of System Design

4

Inter-plane Following Distance

Page 5: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Hypotheses

The objective of this thesis is to investigate the following questions:

• What is the difference in performance of the primary flight task when performing a traditional secondary task versus a potential future UAV supervisory task?

• Does pilot experience and proficiency/currency indicate their primary task performance when performing a future secondary task?

• (EXPLORATORY) What is the difference in physiological measures such as heart rate, respiration rate, and posture when performing the traditional versus future secondary tasks?

5

Page 6: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

NAS Lemoore

6

Page 7: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Participants

– Aviators from NAS Lemoore operational squadrons– CAT II-IV qualified (moderate to high experience)

7

26 27 28 29 30 31 32 33 34 35 36 37 38 3901234567

Age of Subjects

Years

Subj

ects

400800

12001600

20002400

28003200

0

2

4

6

8

10

Total F-18 Time

Up to (hours)

Subj

ects

400800

12001600

20002400

28003200

0

2

4

6

8

10

Total Flight Time

Up to (hours)

Subj

ects

Median Mean SD

Page 8: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Equipment

• Primary Task Simulators : F-18 Tactical Operational Flight Trainers (TOFTs)

• Semi-Autonomous Wingman Supervisory Interface (SAWSI)

• BioHarness

8

Page 9: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

F-18 Tactical Operational Flight Trainer (TOFT)

9

Page 10: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Semi-Autonomous Wingman Supervisory Interface (SAWSI)

10

Page 11: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Cockpit Configuration

11

Page 12: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

BioHarness

12

Records Heartrate, Respiratory Rate, Posture, and Skin Conductance

Page 13: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Design

• Planned for 40 participants• 3 Scripted Tasks with a practice session

– Baseline (no secondary task)– Traditional (w/Air-Ground task)– Futuristic (w/UAV task using SAWSI)

• Length– Each session 5 minutes long (~20 min sim period)– ~ 1 hr/participant total

• Simplified Randomization – Group A: B, T, F– Group B: B, F, T

13

Page 14: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Primary Task - Parade Position

14

Page 15: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Parade Position Inter-plane Following Distance

15

Page 16: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Scenario Brief & Traditional Task

1650nm

Page 17: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Semi-Autonomous Wingman Supervisory Interface (SAWSI)

17

Page 18: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

SAWSI

18

Page 19: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

SAWSI

19

Page 20: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

SAWSI

20

Page 21: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

SAWSI

21

Page 22: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

SAWSI

22

Page 23: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

SAWSI

23

Page 24: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

SAWSI

24

Page 25: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Battle Hit Assessment (BHA)

25

Page 26: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Future Task

2650nm

Page 27: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Script

27

Page 28: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Data Formatting

28

Page 29: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Raw Data

29

Page 30: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Data Filtering

if (filtering distance == 0)

then use the original following distance value

else, (if original following distance>the filtering distance)

then (if the previous cell following distance > filtering distance)

then use min(the next previous cell’s value, filtering distance)

else use the original following distance.

30

Page 31: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Data Filtering

Smoothing Function=IF(AC$3=0,AB9,(IF (AB9> AC$3,IF(AB8>AC$3,MIN(AB7,AC$3),AB8),AB9)))

31

FilteringDistance

Page 32: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Raw Data

32

Page 33: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Filtered Data

33

Page 34: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

t-test Results on Filtered Data

34

Page 35: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

C/D vs E/F Comparison

35

C/D

E/F

Page 36: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Filtered Averages by Session

36

Page 37: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

37

Perceived Cockpit Workload

Page 38: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Future Work

• Continue analysis of biodata• Factor in performance of secondary task• Study performance in multi-crew aircraft

compared to single pilot• Vary intensity of secondary task

– Increased UAVs– Vary frequency of interaction

38

Page 39: EFFECTS OF UAV SUPERVISORY CONTROL ON F-18 FORMATION FLIGHT PERFORMANCE IN A SIMULATOR ENVIRONMENT LCDR Eric McMullen MAJ Shane Grass Thesis Advisor: Dr

Questions and Answers

39

?