MOME 001990http://www.ist-mome.org
MOME: An advancedmeasurement meta-repository
IPS-MoMe Workshop, Warsaw, PolandMarch 14, 2005Felix Strohmeier
Authors:Pedro A. Aranda Gutiérrez, Antal Bulanza, Marek Dabrowski, Baiba Kaskina, Jürgen Quittek, Carsten Schmoll, Felix Strohmeier, Attila Vidacs, Kardos Sandor Zsolt
2
Outline
| Motivation
| MOME approach
| Meta data models
| Database implementation
| Current status
| Conclusion
4
Motivation: The need for measurement data
| Developing new measurement and monitoring methods| Developing architectures of measurement and monitoring
systems| Developing algorithms for network and traffic control
functions supported by measurements| Developing and validating realistic traffic models| Validating the offered level of QoS
Easy access to the repositories of raw measurement data is highly desirable
Easy access to information about available measurement tools is highly desirable
The ultimate goal: „understanding the Internet”
5
The MOME approach
| Collecting and disseminating information about known measurement toolsmeasurement tools and available measurement datameasurement data
MOMEDATABASE
(Data)
INTEROP-ERABILITYDATABASE
(Tools)
Raw data
E2E QoSparameters
BGP topologydata
WW
W-G
UI
Search
Functio
nsmethods
algorithms
protocols
platform
interfaces
interop-erability
licensing
availability
maturity
metrics
contact
Packetcaptures
...
Me
ta-data E
xtraction
Raw datarepositories
networktype
capture platform
URI Link
capturescenario
dataformat
analysisresults
data type
Data
Ana
lysis
6
Meta-database paradigm (1)
| „Data about data”| Documentation of measurement environment and scenario | Statistical information about the captured traffic| Link to the repository, where data is actually stored
| „Data about tools”| Category| Measured metrics| Hardware and software platform
MOME assists researchers in finding and retrieving the measurement data and tools that are most appropriate for their purposes
7
Meta-database paradigm (2)
| Distributed storage of measurement data| As much storage as provided by the sources of the measurements
| Centralised 'directory' functionality to access the measurement data| Directory stores data about the remotely stored measurement data
| Projects contributing measurements can keep total control on them| When they withdraw data from public access
| They delete the entry in the MOME database| The MOME database itself detects when registered measurements have been
withdrawn from the Internet
| In a centralised design, this control would have been lost
| Examples| CAIDA's Internet Measurement Database (work in progress)| GRID technology based solar observatory
8
Definition of the database model
| A database model suited for heterogeneous measurements| Different kinds of measurements| Measurements produced by different tools
| Meta-data model| Describe the actual data of interest
| Trade-off: keep it generic – keep it specific
Packet traces Flow traces
QoS results
Routing data
HTTP traces
Web-based repositories
Monitoring and
Measurement data
14
Data analysis
| Additional information about the characteristics of captured traffic| Automatic analysis by tools integrated in MOME| Results stored in the meta-database
15
Tools database
| E.g. different tool categories| Packet capturing| Traffic flow measurement| Packet monitoring| Connection monitoring| Service monitoring| Application-level monitoring| Intrusion detection| Sniffing| Performance measurement| Connectivity checking| Route detection| Topology detection| Traffic visualisation| Traffic generation
16
Implementation and deployment of the MOME system
| http://www.ist-mome.org| http://www.ist-mome.org/database/
DATABASE
WEBSERVER
THIRD PARTIES
USERGUI
mysql
„assoctiated“measurement
sites
http
mome
surveyor
www-data
www.ist-mome.org
shell.ist-mome.orgfile-
server
Publicrepositories
scp/sftp
http/ftp
dataanalysis
17
Current state of the MOME databases (1)
| Descriptions of exemplary datasets from public repositories| Proof of concept for definition of the MOME meta-data model| Covers most important measurement sites
| Descriptions of packet-level traces collected continuously at the „associated” measurement site in FH Salzburg| Traces stored locally at the MOME repository| So far about 480 1-hour long traces collected
| Analysis tools| Implemented framework, which allows for incorporating new
analysis tools| Currently allows for basic analysis of packet traces (libpcap)| Additional analysis tools planned to be added
18
Current state of the MOME databases (2)
| Framework| Implemented framework, which allows user registration and login| browsing and search open for all users| write access (add/modify) only available to registered users
| Tools descriptions| 57 MOME tools currently listed in database| Description (category, metrics, OS support) allows user
the selection of useful tools for his/her purpose
| Features| User comments for listed tools| Automatic URL checker| Search function| Database statistics
| Further improvements on the way…
19
Conclusion
| Database online:| http://www.ist-mome.org/database/| Unregistered access to all data| Free registration allows
| Adding new tools| Adding new meta-data| Start result analyses on own data
| Demo-PC available| Refreshment area| Visitors welcome
| Open for Co-operation| Encourage Projects to share measurement data