26
TRADE STUDIES Finding the best alternative for system performance from available options

Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

TRADE STUDIESFinding the best alternative for system performance from available options

Page 2: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

BACKGROUND

• Early on, trade studies were based on judgment calls

• Required experience and intuition

• Increasing system complexity made this more difficult

• The process has been “systemized”

• Elaborate mathematical decision analyses (and the computers)

• Are the results better? Debatable

• For certain, they diffuse responsibility for decisions

• Still required:

• Engineering judgment

• Good output only comes from good input (gigo)

• Output must be evaluated by someone with knowledge, experience, understanding

2

Page 3: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

WHAT IS A TRADE STUDY?

3

• A trade study is a formal tool that supports decision making

• A trade study is an objective comparison of all realistic alternatives

• Architectures; baselines; design, verification, manufacturing, deployment, training, operations, support, or disposal approaches

• Performance, cost, schedule, risk, and all other pertinent criteria A trade studydocuments the requirements, assumptions, criteria and priorities used for a decision. This is useful since new information frequently arises and decisions are re-evaluated

• A trade study documents the requirements, assumptions, criteria and priorities used for a decision

Page 4: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

4

TRADE STUDIES SUPPORT DECISION MAKING THROUGHOUT DEVELOPMENT

• Requirements development - e.g., to resolve conflicts; to resolve TBDs and TBRs

• System synthesis - e.g., assess the impact of alternative performance or resource allocations

• Investigate alternate technologies for risk or cost reduction

• Assess proposed design changes

• Make/buy decisions (i.e., build the part from a new design or buy from commercial, existing sources)

Page 5: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

DECISION DRIVERS

• Safety

• Rigid constraints

• No room for compromise

• Performance

• Little room for compromise

• Probably a requirement

• Cost

• Often the decisive factor

5

Page 6: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

6

THE TRADE STUDY PROCESS (1/2)

1. Define the objectives of the trade study

2. Review inputs, including the constraints and assumptions

3. Choose the evaluation criteria and their relative importance (these can be qualitative)

4. Identify and select the alternatives

5. Assess the performance of each option for each criteria

6. Compare the results and choose an option

7. Document the trade study process and its results

Page 7: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

THE TRADE STUDY PROCESS (2/2)

7

Page 8: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

8

• Criteria for decision making

• Measures of Effectiveness (MOE) – customer point-of-view

• Measures of Performance (MOP) – engineer point-of-view

• Measure of Effectiveness – the effectiveness of a solution

• How well are mission objectives achieved

• MOEs assess ‘how well’ not ‘how’

• Examples of MOEs• Life cycle cost• Schedule, e.g., development time, mission duration• Technology readiness level (maturity of concept/hardware)• Crew capacity• Payload Mass

EVALUATION CRITERIA (1/2)

Page 9: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

9

EVALUATION CRITERIA (2/2)

• Measure of Performance (MOP) – the measure of a particular design

• A specified quantitative measure

• Satisfying an MOP helps ensure that an MOE for the system will be satisfied

• Examples of MOPs

• Mass

• Power consumption

• Specific impulse

• Consumables required

• Propellant type

• MOEs and MOPs are system figures of merit (FOM)

Page 10: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

10

• Trade studies are based on assumptions the team makes.

• Examples of driving assumptions:• Crew size assumption drives the amount of consumables and the design of the

Life Support System

• Mission duration assumption drives the amount of power required which in turn drives the choice of power subsystem

• Landing location on the moon drives delta-v requirements which in turn drives orbit selection and propulsion subsystem

• Changing assumptions within the trade study allows the team to perform a ‘what-if’ analysis• Allows the team to understand the integrity of the design alternative selected

• Shows the importance of that assumption

TRADE STUDY CONSIDERATIONS (1/4)ASSUMPTIONS

Page 11: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

11

TRADE STUDY CONSIDERATIONS (2/4)MISSION ENVIRONMENT

• The trade space for subsystem alternatives is often defined by the space environment for the mission• Why use RTGs when the mission is at 1 AU or on the Moon?

• RTGs for deep space missions where solar intensity is less• But, what if the sun isn’t visible from deep in a crater?

• Types of thermal control • Consider the operating temperature extremes• Passive versus active

• Types of rendezvous and ‘landing’ with a Near Earth Object (NEO)• Need to understand the orbit, spin, and composition of object, if known• What assumptions can you make about its gravity field?

• Lunar missions • Is your system operating at one particular location (like Apollo) • Or at global sites depending on the particular mission?

Page 12: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

12

• Trade study analysis should only use relevant information

• Duh

• ‘Materials’ example:

• Do material characteristics such as tensile strength and Poisson’s ratio really matter in the selection process?

• Was heritage considered as a design factor, i.e., has this material flown on previous space missions?• If not, what is the cost to bring that technology up to flight-ready status?

• Availability and cost

TRADE STUDY CONSIDERATIONS (3/4)IMPORTANCE OF INFORMATION

Page 13: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

13

TRADE STUDY CONSIDERATIONS (4/4)TRADE SPACE VS VEHICLE DESIGN

• Is a trade study really necessary?

• Cargo capsule example:• Structural design of capsule is not a trade

• Evaluation criteria are the design characteristics

• Heritage is reference information for actual design work

• Mars habitat example:• What are the communications requirements for the mission (voice, video, etc.)?

• Amount of bandwidth to specify for comm subsystem

• Key question to ask: What makes for a successful mission?

• Answer defines which trades are of most importance

• Might drive additional trades

• Maximum surface exploration time => robust power and Life Support System

• 1-week cargo delivery => launch vehicle availability and mission plan

Page 14: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

PROPULSION (1/2)

• Four fundamental propulsion choices• Solid propellant

• Chemical propellant• Monopropellant

• Bipropellant

• Electric

• Solid• Pro

• Simple and reliable

• Single large impulse

• Con• Isp lower than chemical

• High acceleration

14

Page 15: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

PROPULSION (2/2)

• Bipropellant Monopropellant

• Higher Isp 1/2 to 2/3 Biprop Isp• Less prop mass/total impulse Half the valves, lines, and tanks

Cooler thrust chamber

Simpler system

Weigh simplicity vs mass vs efficiency vs …

• Electric

• Very large Isp: 2000 – 3000

• Has very specific applications

• Requires a considerable (and continuous) source of power

15

Page 16: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

COMMUNICATION SYSTEMS (1/2) • Basis of trade studies

• Amount of information to be transmitted

• Time available for transmission

• Distance of transmission

• Bottom line

• Antenna gain

• More gain = smaller beam width → more pointing accuracy → GNC system

• Broadcast power

• More power → more mass → larger solar cells → increased heat dissipation

• Antenna size can be a problem

• Packaging for launch

• Folding vs fixed geometry antennas

16

Page 17: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

COMMUNICATION SYSTEMS (2/2)

• Frequency choice• X-band, Ka-band, Ku-band

• Permits larger data rates for a given antenna size & power

• “Effective gain” is higher at higher frequencies

• X-band can be attenuated by heavy rain

• Ka- and Ku-band can be totally obliterated by rain

• Possible trades• Reduce amount of data being transmitted

• Pre-transmission on-board processing and data encoding

• Cost• More computational capability; i.e. $$$

• How to ensure data is not degraded

• More software is always more expensive

17

Page 18: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

POWER SYSTEM (1/2)

• Typical power sources• Solar voltaic cells

• Batteries (chemical)

• Fuel cells (chemical)

• Radioisotope thermoelectric generators (RTG)

• Nuclear ???

• Chemical – limited to short duration missions• Batteries: unfavorable power/mass

• Fuel cells: more efficient, but more complex. Produce potable water

• Solar• Most common power source

• Distance limits

• Batteries usually accompany solar cells

18

Page 19: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

POWER SYSTEM (2/2)• RTGs

• Long duration missions far from Sun• Voyager 1 and 2

• Viking landers

• Galileo

• Apollo lunar surface experiments

• Tend to be heavy

• Radiation by-product can be trouble for instrumentation/experiments

• Nuclear• Advantages

• High power

• Moderate mass

• Long life

• Disadvantages• Adds complexity to mission and SC design

• Political problems – attracts wacko demonstrators

19

Page 20: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

TECHNOLOGY TRADESNEW VERSUS OLD

Program/Project System Engineer Engineer

On schedule No interest in schedule

Within budget No interest in budget

Minimum uncertainty Most recent technology

What you did last time Why fly “same old thing”

• New technology is desirable• Maximize capability• Remain competitive• Encourage new development

• Can be seductive• Over sold• Creates uncertainty• Cost and schedule risks

20

Page 21: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

• Systems Engineer• Must evaluate new technology effect on the complete system

• Makes technology decision, or

• Makes recommendation to Program/Project Mgr.

• Questions to ask• Will existing technology do the job?

• What is the additional cost of incorporating the new technology?• Existing system?

• Redesign?

• Subsystem compatibility? (Is it transparent?)

• Are new tests required?

• What is its TRL?• Is it actually available?

• Is it in production?

• Possible unintended consequences

TECHNOLOGY TRADESNEW VERSUS OLD

21

Page 22: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

• May be forced to new technology

• Older components become increasingly hard to get

• Very little demand

• Vendor can no longer make a profit

• Voyager

• Design utilized many components from Viking landers

• Vendor was going to shut down the production line

• Project paid to keep the product line open

• Cheaper than redesign and maintained schedule

• Systems Engineer assesses the risk of new technology

• Too conservative: slow to adopt new tech & company falls behind

• Too optimistic: schedule delays, cost overruns, potential in-flight problems

TECHNOLOGY TRADESNEW VERSUS OLD

22

Page 23: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

23

BACKUP CHARTS

Page 24: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

24

ISRUNo

ISRU

Inte

rpla

ne

tary

Pro

pu

lsio

n(n

o h

yb

rid

s

in P

ha

se 1

)

Ma

rs A

sce

nt

Pro

pe

lla

nt

Ma

rs C

ap

ture

Me

tho

dC

arg

o

De

plo

ym

en

t

Aerocapture Propulsive

ISRUNo

ISRUISRU

No

ISRUISRU

No

ISRU

Aerocapture Propulsive

ISRUNo

ISRU

Aerocapture Propulsive

ISRUNo

ISRUISRU

No

ISRUISRU

No

ISRU

NTR

Ele

ctr

ic

Ch

em

ica

l

NTR

Ele

ctr

ic

Ch

em

ica

l

NTR

Ele

ctr

ic

Ch

em

ica

l

NTR

Ele

ctr

ic

Ch

em

ica

l

NTR

Ele

ctr

ic

Ch

em

ica

l

NTR

Ele

ctr

ic

Ch

em

ica

l

NTR

Ele

ctr

ic

Ch

em

ica

l

NTR

Ele

ctr

ic

Ch

em

ica

l

NTR

Ele

ctr

ic

Ch

em

ica

l

NTR

Ele

ctr

ic

Ch

em

ica

l

NTR

Ele

ctr

ic

Ch

em

ica

l

NTR

Ele

ctr

ic

Ch

em

ica

l

NTR

Ele

ctr

ic

Ch

em

ica

l

NTR

Ele

ctr

ic

Ch

em

ica

l

NTR

Ele

ctr

ic

Ch

em

ica

l

NTR

Ele

ctr

ic

Ch

em

ica

l

Aerocapture Propulsive

Pre-Deploy All-up Pre-Deploy All-up

Opposition Class

Short Surface Stay

Mis

sio

n

Typ

e

Human Exploration

Of Mars

Special Case

1-year Round-trip

TOP-LEVEL TRADE TREE-EXAMPLE FOR MARS

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48

NTR- Nuclear Thermal Rocket

Electric= Solar or Nuclear Electric Propulsion

Conjunction Class

Long Surface Stay

1988 “Mars Expedition”

1989 “Mars Evolution”

1990 “90-Day Study”

1991 “Synthesis Group”

1995 “DRM 1”

1997 “DRM 3”

1998 “DRM 4”

1999 “Dual Landers”

1989 Zubrin, et.al*

1994-99 Borowski, et.al

2000 SERT (SSP)

2002 NEP Art. Gravity

2001 DPT/NEXT

M1 2005 MSFC MEPT

M2 2005 MSFC NTP MSA

M2

M1

M1

M1

M2 M2

M2

M2

Decision Package 1

Long vs Short

Page 25: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

25

Low L/D

Medium L/D

High L/D

N/A

Earth Entry Vehicle

L/D Options

N

Earth EDL Orbit

Capture Options

Aerocapture

Propulsive Capture

N/A

M

Lunar

Descent/Ascent

Lander Options

Integrated Crew

Transit/Lander

Function

Modular Elements

LAll Chemical

Chemical + Electric

NTR

Other Hybrid Options

Orbital Operations

& Earth-Moon

Transit; Propulsion

Options

K

Lunar Surface (LS)

Location LO

Destination LSDock

Un-Dock

Both Dock / Un-Dock LO

Dock Optional

Transportation Functions L1

L1

Element Trades EO

EO LO

EO

LO

L1

L1

ES EO

EO

LO

Human Mission Segment

Cargo Mission Segment (Pre-Deployed Surface Cargo)

InboundOutbound

L1 - LO

EO - LS

ES - L1

LO - LS

L1 - LS

LO - LSL1 - LO

Earth Surface

LO - LS

ES - LO

LO - LS

EO - LO

LO - L1

LO - EO

L1 - EO

L1 - ES

L1 - EO

LS - EO

LS - ES

EO - ES

EO - ES

EO - ES

EO - ES

Earth

Surface

Water

Land

Water

Land

Water

Land

Water

Land

Water

Land

Water

Land

Water

Land

Water

Land

N

ES - EO

EO - L1 L1 - LS

LS - L1

L1 - ES

LS - LO

LO - ES

ES - LS

K

K

K

K

L

L

L

L

L

L

L

L

L

L

L

L N

K

K

K

K

M

M

M

M

M N

M N

M N

M N

N

N

H C

2,11

2,3

1,4&C4,5-8,12

9, 13

11

10

C1-3,5-13

EARTH-MOON TRANSIT TRADE TREE

1-4, 7-13

5

6 13

1-12

7

8

1-6,9-13

1-11,13

12

H = Human Mission Segment

C = Cargo Mission Segment

7,8

9,13

1,3-6,10,12

High Priority Medium Priority Low Priority

Page 26: Trade Studies · 2018-12-22 · •Can be seductive •Over sold •Creates uncertainty •Cost and schedule risks 20 •Systems Engineer •Must evaluate new technology effect on

26

EXAMPLE: EARTH-MOON TRANSIT TRADE OPTION ANALYSES

3 3 3 3

2010 9 9 9

5247 47

34

96

52

47 47

19

96

15

6 6

11

36

16 16

16

36

8

3 3

3

17

0

40

80

120

160

200

240

280

1) DRM 2) Thru LO 3) LO/L1 Hybrid 5b) NTR Thru LO 10b) Single

Module Thru LO

To

tal

Arc

hit

ec

ture

Ma

ss

(t)

Ascent

Descent

TEI

TLI #2

TLI #1

Crew

OM

SH

EV

• TLI stages dominate mass composition.

• Ascent/Descent stages for L1 approach are significantly

higher than for LO approach (combination of higher V

and habitat masses).

• NTR propulsion applied to TLI function results in

significant IMLEO benefit due to influence of TLI

maneuver.

• Single crew module carried through entire mission has

large scaling effect on all propulsive stages.

Lunar Surface (LS)

LO

Location LSDestination

Dock Optional

Transportation Functions LO

Element Trades L1

L1

EO

EO LO

EO

LO

L1

L1

ES EO

EO

LO

InboundOutbound

ES - LS

L1 - LO

EO - LS

ES - EO

L1 - LS EO - L1

ES - L1

LO - LS

L1 - LS

LO - LSL1 - LO

Earth Surface

LO - LS

ES - LO

LO - LS

EO - LO

LO - L1

LO - EO

LO - ES

L1 - EO

L1 - ES

L1 - EO

L1 - ES

LS - LO

LS - L1

LS - EO

LS - ES

EO - ES

EO - ES

EO - ES

EO - ES

Earth

Surface

Water

Land

Water

Land

Water

Land

Water

Land

Water

Land

Water

Land

Water

Land

Water

Land

K

K

K

K

L

L

L

L

L

L

L

L

L

L

L

L N

K

K

K

K

M

M

M

M

M N

M N

M N

M N

N

N

N

Earth EDL Orbit

Capture Options

Aerocapture

Propulsive Capture

N/A

M

Earth EDL Orbit

Capture Options

Aerocapture

Propulsive Capture

N/A

M

Lunar

Descent/Ascent

Lander Options

Integrated Crew

Transit/Lander

Function

Modular Elements

L

Lunar

Descent/Ascent

Lander Options

Integrated Crew

Transit/Lander

Function

Modular Elements

LAll Chemical

Chemical + Electric

NTR

Other Hybrid Options

Orbital Operations

& Earth-Moon

Transit; Propulsion

Options

KAll Chemical

Chemical + Electric

NTR

Other Hybrid Options

Orbital Operations

& Earth-Moon

Transit; Propulsion

Options

K

Low L/D

Medium L/D

High L/D

N/A

Earth Entry Vehicle

L/D Options

N

Low L/D

Medium L/D

High L/D

N/A

Earth Entry Vehicle

L/D Options

N

Key measure of performance: mass