38
Inves&ga&ng the Airspace Safety Threshold of the NAS Kyle Flenar https://ntrs.nasa.gov/search.jsp?R=20190026437 2020-06-24T14:07:17+00:00Z

Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

  • Upload
    others

  • View
    0

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Inves&ga&ng  the  Airspace  Safety  Threshold  of  the  NAS  

Kyle  Flenar  

https://ntrs.nasa.gov/search.jsp?R=20190026437 2020-06-24T14:07:17+00:00Z

Page 2: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Outline  

•  Mo&va&on  •  Simula&on  Data  •  Background  •  Results  •  Future  Work  

2  

Page 3: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Outline  

•  Mo&va&on  •  Simula&on  Data  •  Background  •  Results  •  Future  Work  

3  

Page 4: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Mo&va&on  •  Inves&gate  the  airspace  safety  threshold  of  the  NAS  by  analyzing  encounter  sta&s&cs  of  mi&gated  air  traffic.  

•  No  measure  of  current  mi&ga&on  impact.  

•  Require  a  metric  for  future  Detect  and  Avoid  (DAA)  systems  on  UAS  so  that  the  system  is  at  least  as  good  as  current  mi&ga&ons.  

4  

Page 5: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Assump&ons  •  Current  safety  level  of  the  NAS  can  be  measured  through  

historical  data  that  represents  the  result  of  air  traffic  mi&ga&ons  –  ATC  separa&on  services  –  See  and  avoid  of  pilots  

•  Future  UAS  will  be  IFR  and  self-­‐separa&on  will  only  be  required  against  VFR  traffic  

5  0  sec  ……………….……………  40  sec  ……….……….…..………….  3  min  ………………………..  30  min  …….........…….  24  hrs  

Detect  and  Avoid   Separa9on  Assurance  Collision  Avoidance  (PITL/TCAS)  

Self-­‐Separa&on  (PITL/POTL)  

ATC  Separa&on    Services  

(ATC  Radar,  ADS-­‐B)  

Traffic  Separa&on  (Procedures)  

Page 6: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Outline  

•  Mo&va&on  •  Simula&on  Data  •  Background  •  Results  •  Future  Work  

6  

Page 7: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Simula&on  Informa&on  •  Flight  Data  Set  

–  31,061  VFR  –  50,360  IFR  –  Same  day  (7/25/2012)  –  NAS-­‐wide  

7  

•  ACES  Set-­‐up  –  AAC  disabled  (non-­‐centralized  

Autoresolver)  –  SAA  enabled  

•  A]ached  to  all  VFR  flights  •  Surveillance  only,  no  resolving  

Page 8: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Simula&on  Results  •  Database  size:  728  GB  

–  SaaEncounterStats  size:  424  GB    

•  Total  Flights:  73,395  –  8,026  rejected  (9.9%)  

 

8  

Page 9: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Outline  

•  Mo&va&on  •  Simula&on  Data  •  Background  •  Results  •  Future  Work  

9  

Page 10: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Determining  a  Safety  Threshold  

•  A  safety  threshold  for  the  NAS  can  be  determined  based  on  encounter  probabili&es  for  separa&on  regions:  

10  

MAC  Rate     =   P(NMAC|WCV)   *   P(WCV|SST)    

*   Encounter  Rate  

Page 11: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Determining  a  Safety  Threshold  –  Risk  Ra&o  •  Probability  of  an  encounter  based  on  current  airspace  mi&ga&ons  is  

determined  by  a  risk  ra&o  and  an  unmi&gated  encounter  rate:  

 

•  The  risk  ra&o  (RR)  is  used  to  express  the  rela&ve  impact  of  a  mi&ga&on  on  airspace  safety,  independent  of  encounter  geometry:    

 

11  

RR    =  Mi&gated  WCV  Rate  

Unmi&gated  WCV  Rate    where    WCV  Rate        =      

#  Encounters  Flight  Hour  

where        

Page 12: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Defini&on  of  an  Encounter  •  Aircral  pair  analyzed  if  within  30  nmi  •  Considered  an  “encounter”  if:  

–                   –     

–         

 12  

Page 13: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Defini&on  of  a  Well  Clear  Viola&on  WCV  defini&on  has  spa&al  and  temporal  criteria.    

•  Horizontal  1.     

2.       

•  Ver&cal  1.     

2.     

13  

Thresholds  τm  (s)   τv  (s)   Δh  (l)   DMOD  (l)  

30   30   475   6000  

Both  must  be  true  

One  must  be  true  

AND  DMOD  

475  l  

Page 14: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Determining  a  Safety  Threshold  -­‐  Tau  •  Calculate                    and                  at  each  point  in  &me.    

–  Higher  of  the  two  values  characterizes  the  encounter  at  that  &me.  

 •  The  minimum  of  these  values  defines  the  encounter  

14  

Page 15: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Determining  a  Safety  Threshold  -­‐  Tau  •  Aggregate  of  Tau  for  each  encounter  creates  a  cumula&ve  Tau  

distribu&on  that  determines  the  RR  

15  

Minimum  tau  between  each  aircral  pair  (seconds)  

Number  of  encounters  per  VFR  flight  hour  with  tau  below  the  minimum  

   0    1                              40                                        120  

Unmi&gated  

 Mi&gated  

Risk  Ra9os:    0.02  0.20  

0.10  0.30  =  0.10     =  0.33    

WCV  

0.20  

0.02  

SST  

0.30  

0.10  

RR    =  Mi&gated  WCV  Rate  

Unmi&gated  WCV  Rate    where    WCV  Rate        =      

#  Encounters  Flight  Hour  

Page 16: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Outline  

•  Mo&va&on  •  Simula&on  Data  •  Background  •  Results  •  Future  Work  

16  

Page 17: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

•  Sample  of  1604/29770  VFR  flights  •  59,421  pairs  within  30  nmi  •  13,983  encounters  mee&ng                        ,                              ,                •  75  WCV  

Results  

17  `  

Page 18: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Results  –  Outlier  Case  

18  

Page 19: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Results  –  Outlier  Case  

19  

Page 20: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

•  Sample  of  1604  flights,  13983  encounters.      

Results  

20  

Page 21: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

•  Sample  of  1604  flights,  13983  encounters.      

Results  

N  =  12,329  

21  

Page 22: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

•  Sample  of  1604  flights,  13983  encounters.      

Results  

N  =  2,623  

22  

Page 23: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Results  

23  

Page 24: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Results  

24  

Page 25: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Results  

25  

0.047  

Unmi&gated  

 Mi&gated  

0.0951  

Page 26: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Results  –  WCV  Encounter  Sta&s&cs  

26  

•  75  WCV  out  of:  •  59,421  aircral  pairs  =  0.126%    •  13,983  encounters  =  0.536%  

Page 27: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Results  –  WCV  Encounter  Sta&s&cs  

27  

•  Evenly  distributed  

 •  Majority  met  475  l  spa&al  

threshold  

N   75  

Maximum   5893.82  

Mean   2943.26  

Median   2977.29  

Minimum   121.52  

Std  Dev   1649.26  

N   75  

Maximum   2738  

Mean   -­‐33.24  

Median   -­‐68  

Minimum   -­‐2184  

Std  Dev   704.43  

Page 28: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Results  –  WCV  Encounter  Sta&s&cs  

28  

Rela&ve  Heading  

N   75  

Maximum   180  

Mean   98.94  

Median   109  

Minimum   0  

Std  Dev   59.81  

Page 29: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Outline  

•  Mo&va&on  •  Simula&on  Data  •  Background  •  Results  •  Future  Work  

29  

Page 30: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Future  Work  •  Unmi&gated  study  analysis  

•  Further  analyze  encounter  sta&s&cs    –  Possible  rela&onships  (i.e.  rela&ve  heading  vs  rela&ve  velocity)  

•  Further  inves&gate  anomalous  data  points  

•  Op&mize  code  for  efficiency    

30  

Page 31: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Challenges  Faced  •  Large  databases    – Memory  issues  –  Code  efficiency  –  Time  required  for  analysis    

•  Balancing  priori&es  between  different  studies    

•  Shil  of  studies  over  &me    

31  

Page 32: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Other  Projects  •  Direc&on  of  studies  shiled  over  &me  

–  Familiariza&on  with:  •  ATM  concepts,  Java,  MySQL,  ACES,  JMP,  GIT  

–  Calcula&ng  path  lateral  devia&on  as  another  metric  for  Autoresolver  

–  Calcula&ng  range  between  all  aircral  pairs  NAS-­‐wide  

–  Determining  the  effec&veness  of  Autoresolver  •  Cost  func&on  results  •  Number  of  reversals,  succeeded  maneuvers,  reduced  trialplan  &me   32  

Page 33: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Ques&ons?  

Page 34: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Backup  Slides  

Page 35: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Defini&on  of  an  Encounter  •  Aircral  pairs  are  analyzed  if  within  30  nmi  horizontal  range  

•  Considered  an  “encounter”  if:  –                   –     

–     

–     

–     

 

35  

Page 36: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Results  –  WCV  Encounter  Sta&s&cs  

36  

•  Within  DMOD  =  6000  l  •  Rela&vely  evenly  distributed  

•  Majority  met  475  l  spa&al  threshold  

•  Most  are  in  near-­‐parallel  flight  paths  (0°,  180°)  •  Skewed  lel  •  More  head-­‐on  

Page 37: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Results  –  WCV  Encounter  Sta&s&cs  

37  

•  Redefined  to  0  once  WCV  occurred  

•  Redefined  to  0  if  within  475l  threshold  

•  Non-­‐zero  values  met  temporal  threshold  (30  s)    

Page 38: Inves&gang)the)Airspace)Safety) Threshold)of)the)NAS)€¦ · inves&gaon) Author: Flenar, Kyle A. (ARC-AFT)[UNIV OF CALIFORNIA SANTA CRUZ] Created Date: 20140606210018Z

Results  –  WCV  Encounter  Sta&s&cs  

38  

•  Requires  further  inves&ga&on  

 

•  Requires  further  inves&ga&on