How may I help you?

How may I help you?

User: I need to do some surveillance looking for missile launchers.

I need to do some surveillance looking for missile launchers

Application

MIDOS Processor

Speech Recognizer Stroke Recognizer

Text: I need to do some surveillance…Start Time: XDuration: Y

Ø

[mission-type = ?] & [ “surveillance” => mission-type = Recon] => [mission-type = Recon]

Learned from previous interactions

How may I help you?

System: Do you want to start a new mission or use parameters from an old one.

Do you want to start a new mission or use parameters from an old one.

Application

MIDOS Processor

Speech Synthesizer Stroke Synthesizer

Text: Do you want to start…Start Time: XDuration: Y

Ø

There are two options when synthesizing a new system:1. Start with parameters from an old mission2. Start with a clean slate

How may I help you?

User: I want to use the same parameters as last week’s mission.

I need to do some surveillance looking for missile launchers

Application

MIDOS Processor


Text: I need to do some surveillance…Start Time: XDuration: Y

Ø

Look up last week’s mission

Mission DB

System: Which mission?

Mission Type Start Date End Date Target

Recon 7/27/2009 13:45 7/28/2009 13:45 34°31 59″N 69°09 58″E′ ′

Recon 7/29/2009 14:00 7/30/2009 14:00 35°35 60″N 68°55 01″E′ ′

Recon 7/29/2009 6:00 8/1/2009 18:00 34°31 59″N 69°09 58″E′ ′

Which mission

Application

MIDOS Processor


Text: Which missionStart Time: XDuration: Y

Ø

There was more than one mission last week

Mission DB

User: (This one)red

Mission Type Start Date End Date Target

Recon 7/27/2009 13:45 7/28/2009 13:45 34°31 59″N 69°09 58″E′ ′

Recon 7/29/2009 14:00 7/30/2009 14:00 35°35 60″N 68°55 01″E′ ′

Recon 7/29/2009 6:00 8/1/2009 18:00 34°31 59″N 69°09 58″E′ ′

This (one)1

Stroke 1 = Red arrow with (X,Y,L)

Application

MIDOS Processor


Points: {X, Y, Time}, …Color: Red

Text: This oneStart Time: XDuration: Y

Look up the parameters for the selected mission

Mission DB

Mission Type: Recon

Mission Signal: Video

Video Signal Resolution: 1024 x 768

Video Signal Disposition: Streamed

Mission Target Mission Egress RouteMission Ingress Route

System: I have loaded the following parameters, would you like to make any changes?

I have loaded the following parameters, would you like to make any changes

Application

MIDOS Processor


Text: I have loaded…Start Time: XDuration: Y

Ø

Mission DB

[mission-target = (X,Y)] => [mission-target-terrain = plains] => [LOS = true][mission-target = (X,Y)]

[∆ ingress/egress > twistiness-limit] => [mission-capability: Precision Guidance][mission-ingress-route = {X,Y}…][mission-egress-route = {X,Y}…]

[mission-signal-type = Video][video-signal-resolution = 1024 x 768] => [mission-capability: Video Recon]

[mission-signal-disposition = streamed][mission-signal-disposition = streamed] & [LOS = true] => [mission-capability: Retransmission]

User: I’d like to change the target.

Mission Type: Recon





I’d like to change the target

Application

MIDOS Processor


ØText: I’d like to change…Start Time: XDuration: Y

[mission-ingress-route = ? ][mission-egress-route = ?][mission-target = ?]

[mission-target-terrain = ?][LOS = ?]


[mission-signal-disposition = streamed]

System: Please indicate on the map the new target area.

Please indicate on the map the new target area

Application

MIDOS Processor


Text: Please indicate…Start Time: XDuration: Y

Ø

[mission-target = ?]

User: ()red

Stroke 1 = Red circle with (X,Y,R)

Application

MIDOS Processor



Ø

[mission-target = (X,Y)] => [mission-target-terrain = mountain] => [LOS = false][mission-target = (X,Y)]

[mission-signal-disposition = streamed] & [LOS = false] => [mission-capability: Non-LOS Retransmission]

System: Please indicate the desired routes to and from the target area.

Click and drag points on the routes to change them

Application

MIDOS Processor


Text: Click and drag…Start Time: XDuration: Y

Ø

[mission-ingress-route = ? ]

[mission-egress-route = ?]

User: (This way to the target)teal and (this way back)blue.

Application

MIDOS Processor


Ø

[mission-ingress-route = {X,Y}….]

[mission-egress-route = {X,Y}….]

Ø

Ø

[∆ ingress/egress > twistiness-limit] => [mission-capability: Precision Guidance]

Mission Type: Recon




System: I have loaded the following parameters, would you like to make any changes?


I have loaded the following parameters, would you like to make any changes

Application

MIDOS Processor


Text: I have loaded…Start Time: XDuration: Y

Ø

[mission-target = (X,Y)] => [mission-target-terrain = mountain] => [LOS = false][mission-target = (X,Y)]

[∆ ingress/egress > twistiness-limit] => [mission-capability: Precision Guidance][mission-ingress-route = {X,Y}…][mission-egress-route = {X,Y}…]


[mission-signal-disposition = streamed][mission-signal-disposition = streamed] & [LOS = false] => [mission-capability: Non-LOS Retransmission]

User: No

Mission Type: Recon





No

Application

MIDOS Processor


ØText: NoStart Time: XDuration: Y

System stores the parameters

System: Please indicate when you want the platform on target.

August 1July 26 July 27 July 28 July 29 July 30 July 31

-each tick is 3 hours-Precipitation

Heavy Precipitation

Cloudy

Clear

Please indicate when you want the platform on target

Application

MIDOS Processor


Text: Please indicate when you want…Start Time: XDuration: Y

Ø

[mission-type = Recon] requires [mission-time-on-target = ?]

User: ()red

-each tick is 3 hours-


Precipitation

Heavy Precipitation

Cloudy

Clear

Stroke 1 = Red line with (X,Y,L)

Application

MIDOS Processor



Ø

[mission-time-on-target = 7/30/09 0300 - 8/1/09 0300] & [mission-target = (X,Y)]

=> [mission-target-weather = Precipitation]

[mission-time-on-target = 7/30/09 0300 - 8/1/09 0300]

System: Both the Reaper and the Predator are acceptable platforms for the currentmission. Which platform would your prefer to use?

Predator

Reaper

Recon Mission

Video Signal

Signal Transmission


Both the Reaper and the Predator are acceptable platforms for the current mission. Which platform would your prefer to use?

Application

MIDOS Processor


Text: Both the Reaper and the ….Start Time: XDuration: Y

Ø

[mission-capabilities = Video Recon, Precision Guidance,

Non-LOS Retransmission

=> Weight = X, Power = Y, Memory = Z

[mission-platform = ?] &[Predator: Weight > X, Power > Y, Memory > Z] &[Reaper: Weight > X, Power > Y, Memory > Z] &[Scan Eagle: Weight < X, Power < Y, Memory < Z] &[Avenger: Weight < X, Power < Y, Memory < Z]

User: Let’s use the Predator

Predator

Reaper

Recon Mission

Video Signal

Signal Transmission


Let’s use the Predator

Application

MIDOS Processor


ØText: Let’s use the PredatorStart Time: XDuration: Y

[mission-platform = Predator]

System: Why did you choose the Predator?

Predator

Reaper

Recon Mission

Video Signal

Signal Transmission


Why did you choose the Predator

Application

MIDOS Processor


Text: Why did you…Start Time: XDuration: Y

Ø

System wants to capture rationale behind platform selection

User: The Predator is more reliable in precipitation.

Predator

Reaper

Recon Mission

Video Signal

Signal Transmission


The Predator is more reliable in precipitation

Application

MIDOS Processor


ØText: The Predator…Start Time: XDuration: Y

If [mission-target-weather = Precipitation] => Predator is the preferred platform

System: In order to fulfill the given mission specifications, your platform will need these capabilities.

Video Recon

Precision Guidance


Recon Mission

Video Signal

Signal Transmission


Precipitation

In order to fulfill the given mission specifications, your platform will need these capabilities

Application

MIDOS Processor


Text: In order to fulfill the …Start Time: XDuration: Y

Ø

[mission-capabilities: Precision Guidance, Video Recon, Non-LOS Retransmission]

System: I can synthesize a software system that supplies these capabilities and I have provided asimulation of each collected signal, would you like to make any changes?

Video Recon

Precision Guidance


Recon Mission

Video Signal

Signal Transmission


Precipitation

I can synthesize a software system that supplies these capabilities and I have provided a simulation of each collected signal, would you like to make any changes

Application

MIDOS Processor


Text: I can synthesize…Start Time: XDuration: Y

Ø

Precision Guidance, Video Recon,


PAMS

Valid configuration for: Precision Guidance, Video Recon,


User: Tell me why the video is so grainy.

Video Recon

Precision Guidance


Recon Mission

Video Signal

Signal Transmission


Precipitation

Tell me why the video is so grainy

Application

MIDOS Processor


ØText: Tell me…Start Time: XDuration: Y

System looks up how it determined the quality of the video signal

System: The weather forecast is for precipitation and the Video Recon capabilitydoes not perform well in those conditions.

Recon Mission

Video Signal

Signal Transmission

PrecipitationPrecipitation

The weather forecast is for precipitation and the Video Recon capabilitydoes not perform well in those conditions

Application

MIDOS Processor


Text: The weather forecast…Start Time: XDuration: Y

Ø

(Video Recon => Low Resolution Camera Resource ) &[mission-weather = precipitation]

=> 25% effective/quality

User: Can I improve the video quality?

Recon Mission

Video Signal

Signal Transmission

PrecipitationPrecipitation

Can I improve the video quality

Application

MIDOS Processor


ØText: Can I…Start Time: XDuration: Y

System looks up a way to get a video signal that is of a higher quality

System: You can improve the video quality by substituting HD Video Recon for Video Recon.

HD Video ReconVideo ReconRecon Mission

Video Signal

Signal Transmission


Precipitation

You can improve the video quality by substituting HD Video Recon for Video Recon in your AV Recon capability

Application

MIDOS Processor


Text: You can…Start Time: XDuration: Y

Ø

(Video Recon => Low Resolution Camera Resource )& [mission-weather = precipitation]


(HD Video Recon => High Resolution Camera Resource )& [mission-weather = precipitation]


User: Let’s use HD Video Recon

HD Video ReconVideo ReconRecon Mission

Video Signal

Signal Transmission


Precipitation

Let’s use HD Video Recon

Application

MIDOS Processor


ØText: Let’s…Start Time: XDuration: Y

[mission-capabilities: Precision Guidance, , Non-LOS Retransmission] HD Video Recon

System: The configuration that you have selected can support only an one day mission. Which is more important, having a two day mission or high quality video?

Recon Mission

Video Signal

Signal Transmission



>?<?

High Video Resolution

Precipitation

The configuration that you have selected can support only an one day mission. Which is more important, having a two day mission or high quality video

Application

MIDOS Processor


Text: The configuration…Start Time: XDuration: Y

Ø

Power = Y=>

[time-on-target = 0400 on 7/30/09 - 0400 on 8/1/09 ] &[Low Output Battery Pack: Can’t provide Y at all] &[High Output Battery Pack: Can provide Y for only 24 hr]

[mission-capabilities: Precision Guidance,HD Video Recon,Non-LOS Retransmission]

User: Having a two day mission is more important

Recon Mission

Video Signal

Signal Transmission



>?<?

High Video Resolution

Precipitation

Two day mission is more important

Application

MIDOS Processor


ØText: High quality…Start Time: XDuration: Y

HD Video Recon Mission Capability << [time-on-target = 0400 on 7/30/09 - 0400 on 8/1/09 ]

System: I can synthesize a software system that supplies these capabilities and I have provided a simulation of each collected signal, would you like to make any changes?

Video Recon

Precision Guidance


Recon Mission

Video Signal

Signal Transmission


Precipitation

I can synthesize a software system that supplies these capabilities and I have provided a simulation of each collected signal, would you like to make any changes

Application

MIDOS Processor


Text: I can synthesize…Start Time: XDuration: Y

Ø

Precision Guidance, Video Recon,


PAMS

Valid configuration for: Precision Guidance, Video Recon,


User: First tell me why I need non-LOS retransmission.

Video Recon

Precision Guidance


Recon Mission

Video Signal

Signal Transmission


Precipitation

First tell me why I need non-LOS retransmission instead of normal retransmission.

Application

MIDOS Processor


ØText: First tell me…Start Time: XDuration: Y

Looks at the inferences that led to adding the non-LOS retransmission capability

System: You chose to stream your data back to base, but the mountainous terrain at the target area means that there will be no line of site back to base. This means that you require the non-LOS retransmission capability. Would you like to make any changes?

Video Recon

Precision Guidance


Recon Mission

Video Signal

Signal Transmission


Precipitation

You chose to stream your data back to base, but the mountainous terrain at the target area means that there will be no line of site back to base. This means that you require the non-LOS retransmission capability. Would you like to make any changes?

Application

MIDOS Processor


Text: You chose to …Start Time: XDuration: Y

Ø

[mission-target = (X,Y)] => [mission-target-terrain = mountain] => [LOS = false][mission-target = (X,Y)][mission-signal-disposition = streamed]

User: I want to substitute AV Recon for Video Recon

Video Recon

Precision Guidance


Recon Mission

Video Signal

Signal Transmission


Precipitation

I want to substitute AV Recon for Video Recon

Application

MIDOS Processor


ØText: I want to …Start Time: XDuration: Y

System searches for a capability matching “AV Recon”

System: What is AV Recon?

Video Recon

Precision Guidance


Recon Mission

Video Signal

Signal Transmission


Precipitation

What is AV Recon

Application

MIDOS Processor


Text: What is AV ReconStart Time: XDuration: Y

[“AV Recon”] => ?

Ø

User: AV Recon combines Video Recon and Audio Recon.

Video Recon

Precision Guidance


Recon Mission

Video Signal

Signal Transmission


Precipitation

AV Recon combines Video Recon and Audio Recon

Application

MIDOS Processor


ØText: AV Recon…Start Time: XDuration: Y

Video Recon Mission Capability

Audio Recon Mission Capability=> AV Recon Mission Capability

System: I have added AV Recon.I can synthesize a software system that supplies these capabilities and I have provided a simulation of each collected signal, would you like to make any changes?

AV Recon

Precision Guidance


Audio Signal

Video Signal

AV Recon Signal

Recon Mission

Signal Transmission


Precipitation

I have added AV Recon. I can synthesize a software system that supplies these capabilities and I have provided a simulation of each collected signal, would you like to make any changes

Application

MIDOS Processor


Text: I have added…Start Time: XDuration: Y

Ø

Precision Guidance,Video Recon, Audio Recon,Non-LOS Retransmission

PAMS

Valid configuration for: Precision Guidance, Video Recon, Audio Recon,


AV Recon

User: Yes, add the Image Filtering capability

AV Recon

Precision Guidance


Audio Signal

Video Signal

AV Recon Signal

Signal Transmission


Recon Mission

Precipitation

Yes, add the Image Filtering capability

Application

MIDOS Processor


ØText: Yes, add the Image Filtering…Start Time: XDuration: Y

[mission-capabilities: Precision Guidance, AV Recon,

Non-LOS Retransmission, ]Image Filtering

System: This list of capabilities exceeds the maximum useful memory capacity of 48 MB for the Predator. Please indicate your preference by dragging them onto the line below.

AV Recon Non-LOS RetransmissionImage Filtering Precision Guidance

RequiredOptional

This list of capabilities exceeds the maximum useful memory capacity of 48 MB for the Predator. Change your capability set to use 16 fewer MB of memory.

Application

MIDOS Processor


Text: This list of capabilities has an…Start Time: XDuration: Y

Ø

[mission-platform = Predator]

Memory = 60 MB=>

=> Memory = 48 MB

[mission-capabilities: Precision Guidance, AV Recon,

Non-LOS Retransmission, Image Filtering]

User: -user drags icons-

AV Recon


Image Filtering

Precision Guidance

RequiredOptional

ø

Application

MIDOS Processor


ØØ

Image Filtering << Precision Guidance << Non-LOS Retransmission << AV Recon

System: I had to remove the Image Filtering capability.I can synthesize a software system that supplies the following capabilities and I have provided a simulation of each collected signal, would you like to make any changes?

AV Recon

Precision Guidance


Audio Signal

Video Signal

AV Recon Signal

Signal Transmission


Recon Mission

Precipitation

I had to remove the Image Filtering capability. I can synthesize a software system that supplies these capabilities and I have provided a simulation of each collected signal, would you like to make any changes

Application

MIDOS Processor


Text: I had to remove…Start Time: XDuration: Y

Ø

PAMS

Valid configuration for: Precision Guidance, Video Recon, Audio Recon,


Image Filtering << Precision Guidance << Non-LOS Retransmission << (Video Recon & Audio Recon)

Precision Guidance,Video Recon, Audio Recon,Non-LOS Retransmission,Image Filtering

AV Recon

User: No

AV Recon

Precision Guidance


Audio Signal

Video Signal

AV Recon Signal

Signal Transmission


Recon Mission

Precipitation

No

Application

MIDOS Processor


ØText: NoStart Time: XDuration: Y

System: The software system has been synthesized and the platform will be deployedat 0300 on 7/30/09

AV Recon

Precision Guidance


Audio Signal

Video Signal

AV Recon Signal

Signal Transmission


Recon Mission

Precipitation

The software system has been synthesized and the platform will be deployedat 0300 on 7/30/09

Application

MIDOS Processor


Text: The software system…Start Time: XDuration: Y

Ø

Documents

How may I help you?