1
Flexible Data Cube for Range-Sum Queries in
Dynamic OLAP Data Cubes
Authors: C.-I Lee and Y.-C. LiSpeaker: Y.-C. LiDate :Dec. 19, 2002
2
Outline
Introduction Related works Analysis of the average query and
update costs Flexible data cube Performance analysis Conclusions
3
Introduction
Data cubes are frequently adopted to implement OLAP and provides aggregate information
Data cube: also known as Multi-dimensional Database(MDDB)
Measure attributes: be chosen as metrics of interest Functional attributes(dimensions):
other attributes of records. Cells: store measure attribute values Range-Sum Query:
add all cells in query region
4
Measure attribute → Sale_Volume Dimensions → Year and Age of customers
Car-sales example
5
+
+
4
20
255
1430
6
Several previous approaches are used to accelerate the response time
But they slow down the update speed and require further space overhead
This study considers both query and update costs to construct data cubes
No extra space overhead Choice the best cube in any query or update ratio
We also present a FDC method No extra space overhead (for dense data cube) Select or integrate some pre-aggregation
techniques for each dimension
7
Related works
The history of pre-aggregate range-sum queries
Prefix Sum(PS)[Ho et al., 1997]
Dynamic Data Cube(DDC)[Geffer et al., 1999b]
Relative Prefix Sum(RPS) [Geffer et al., 1999a]
Hierarchical Cube (HC)[Chan & Ioannidis, 1999]
Double RPS[Liang et al., 2000]
Space-Efficient Data Cube(SEDC)[Riedewal et al., 2000]
Iterative Data Cube(IDC)[Riedewal et al., 2001]
1997 1998 1999 2000 2001
8
Prefix Sum(PS) ( Ho et al., 1997 )
3+5+1+2+7+3+2+6+2+4+2+3=40 A: 2+3+3+3+1+5+3+5+1+3+3+4=36 P: 103-50-35+18=36
9
Prefix Sum(PS)
10
Other methods RPS ( Geffer et al., 1999a)
Two levels(Local PS and overlay boxes) but extra space overhead HC ( Chan & Ioannidis, 1999 )
Hierarchical method DDC ( Geffer et al., 1999b )
Hierarchical method but need extra space overhead SEDC ( Riedewald et al., 2000 )
No exrtra space overhead of RPS and DDC (SRPS and SDDC) Double RPS ( Liang et al., 2000 )
Three levels but need extra space overhead IDC ( Riedewald et al., 2001 )
No extra space overhead (different method in different dimension)
11
Our work focuses mainly on methods that do not require any extra space overhead for dense data cubes.
12
Analysis of the average query and update costs Assume query ratio + update ratio
=100% Average query cost:
Average update cost: Cu(n) / n
13
14
Flexible Data Cube(FDC)
Exponential time is required to find the optimal pre-aggregated data cube
Proposed the FDC method that is a heuristic method to select or integrate any two pre-aggregation techniques for each dimension.
15
In certain situation Size Query ratio
FDCopt = min average cost{FDC candidates}
FDCopt = min{q×CaqFDC + u×CauFDC} Time complexity O(9n)=O(n)
The FDC Method
k’=0 A, LPS or PSk’=1 A, LPS or PSA, LPS or PS
k’=2 A, LPS or PSA, LPS or PS
k’=3 A, LPS or PSA, LPS or PSk’=4 A, LPS or PS
A, LPS or PSk’=5
A, LPS or PS
A, LPS or PSk’=7
A, LPS or PS
A, LPS or PSk’=6 A, LPS
or PS
A, LPS or PS
k’=4 A PS
16
Performance analysis
Average cost at different query ratios d = 2, n = 16, 64
0
10
20
30
40
50
60
70
1 0.8 0.6 0.4 0.2 0query ratio (q)
Aver
age
cost
(acc
ess
cells
)
ALPSPSFDC
1
10
100
1000
10000
1 0.8 0.6 0.4 0.2 0
query ratio (q)
Aver
age
cost
(ac
cess
cel
ls)
ALPSPSFDC
17
Average cost for different dimension sizes: d = 4, q = 1, 0.9
1.E+00
1.E+01
1.E+02
1.E+03
1.E+04
1.E+05
1.E+06
1.E+07
1.E+08
2 4 8 16 32 64 128 256
size (n)
Aver
age
cost
(acc
ess
cells
)
A
LPS
PS
FDC
1.E+00
1.E+01
1.E+02
1.E+03
1.E+04
1.E+05
1.E+06
1.E+07
1.E+08
2 4 8 16 32 64 128 256
size (n)
Aver
age
cost
(acc
ess
cells
)
A
LPS
PS
FDC
18
Average cost for different dimension sizes: d = 4, q = 0.1, 0
1.E+001.E+011.E+021.E+031.E+04
1.E+051.E+061.E+071.E+081.E+09
2 4 8 16 32 64 128 256
size (n)
Aver
age
cost
(acc
ess
cells
) A
LPS
PS
FDC
1.E+001.E+011.E+021.E+031.E+04
1.E+051.E+061.E+071.E+081.E+09
2 4 8 16 32 64 128 256
size (n)
Aver
age
cost
(acc
ess c
ells)
A
LPS
PS
FDC
19
Conclusions
Take both the query and update costs into consideration to select the suitable data cube.
Propose the FDC method select or integrate pre-aggregating techniques for
each dimension. Outperform other methods for any query (or
update) ratio situation linear time: determine the best FDC structure.
In the future, develop new techniques to support sparse data sets
20
Thank You