Upload
others
View
0
Download
0
Embed Size (px)
Citation preview
Processing Services in
Visual Information Systems
Eleni Kaldoudi
Institute of Computer Science
Foundation for Research and Technology - Hellas
work done in collaboration with
Marios Zikos
Invited Presentation
German Cancer Research Center,
Heidelberg, Germany
July 1, 1997
Institute of Computer Science - Foundation for Research and Technology - Hellas
visual information management
• pattern recognition
• image processing & analysis
• computer vision
• graphics
• information retrieval
• data base techniques
• human-computer interface issues
Institute of Computer Science - Foundation for Research and Technology - Hellas
image processing - current state
• toolkits
• software packages
• visual language environments
• systems & environments
Institute of Computer Science - Foundation for Research and Technology - Hellas
processing services
distributed execution of
processing algorithms
plug-n-play integration
of third party software
software development
testing, & evaluation
macro construction &
processing
integration with other
services & systems
charging: ‘renting’
algorithms and resources
computational
resource management
management & retrieval
of available software
Institute of Computer Science - Foundation for Research and Technology - Hellas
… in the quest of an environment
• scaleable & extensible environment
• robust & persistent execution
• easy access
• user transparency in terms of
– software and hardware platforms
– network technologies
Institute of Computer Science - Foundation for Research and Technology - Hellas
design issues
• modularity
• interactive components
• emerging functionality
• code re-use
• customization - adaptibility
Institute of Computer Science - Foundation for Research and Technology - Hellas
DIPE
other
application
execution agent
user
application
execution agent
manager
manager
manager
manager
execution agent
an environment
for image
processing
services
Institute of Computer Science - Foundation for Research and Technology - Hellas
coordination model
temp storage
cache execution
execution
execution
execution
execution
request & data
response & data
manager
algorithm
repository
execution agent
application
Institute of Computer Science - Foundation for Research and Technology - Hellas
algorithm repository
virtual repository, distributed over the network
each segment consists of a machine-specific
collection of algorithms
algorithms:
new and third party (only executable)
algorithms:
private or public (at various user group levels)
Institute of Computer Science - Foundation for Research and Technology - Hellas
generic algorithm structure
command line
execution
output data
read input data
execution
loop1
loop2
loopN
write output data
command line
output data
Institute of Computer Science - Foundation for Research and Technology - Hellas
communication library for developers
start-up
end-phase
user-call-back
main-loop
read input data
execution
loop1
loop2
loopN
write output data
command line
output data
Institute of Computer Science - Foundation for Research and Technology - Hellas
algorithm wrapper
communicate
with
application
receive request for algorithm execution
send results to the application
convert input data
execute algorithm
convert output data
execution
output data
command line
Institute of Computer Science - Foundation for Research and Technology - Hellas
generic algorithm description
types of I/O data & arguments
image, vector, parameter, string, set of any of the above
configuration file
name: argument name
data type: e.g. IMAGE, SET_IMAGE, POINT, ...
data format: specify appropriate converter
requirement: YES / NO
input: YES / NO
prefix: prefix string
Institute of Computer Science - Foundation for Research and Technology - Hellas
algorithm configuration file
[param 1] name = SEED type = POINT format = POINT_CDM_LN required = YES input = YES prefix = -s [param 3] name = IMAGE_IN type = IMAGE format = RAW2RAS required = YES input = YES
[segment-tree]
exepath = /usr/local/bin/segment-tree $SEED $PAR $IMAGE_IN $IMAGE_OUT
numparams = 4
[param 2] name = PAR type = INT format = INT_CDM_LN required = NO input = YES prefix = -l [param 4] name = IMAGE_OUT type = IMAGE format = RAS2RAW required = YES input = NO
segment-tree -s x y -l l file-in file-out
Institute of Computer Science - Foundation for Research and Technology - Hellas
execution profile (...work in progress)
• I/O data size
• processing element memory
• execution time
I/O
Institute of Computer Science - Foundation for Research and Technology - Hellas
algorithm retrieval (…future work)
• software related characteristics (static)
• execution characteristics (dymanic)
• user goals
• user preferences
Institute of Computer Science - Foundation for Research and Technology - Hellas
resource management
distributed decision making
process
based on the market metaphor
realized through the cooperation
of execution agents
manager
execution agent
execution agent
execution agent
execution agent
Institute of Computer Science - Foundation for Research and Technology - Hellas
resource management
bid
• performance of local CPU
• current state of local CPU
• network characteristics
• cached data
• algorithm profile
• self-confidence
• general policy
manager
execution agent
execution agent
execution agent
execution agent
estimated execution
time and cost
Institute of Computer Science - Foundation for Research and Technology - Hellas
resource management
task assignment
• minimum cost
• minimum execution time
• reliability of bidder
• user preferences
• general policy
manager
execution agent
execution agent
execution agent
execution agent
Institute of Computer Science - Foundation for Research and Technology - Hellas
macros
algo 1
1.i.1
1.i.2
1.i.3
1.i.4
1.o.1
4.i.1
4.i.2
4.i.3
4.o.1
algo 2
algo 4
algo 5
5.i.1
5.i.2
5.i.3
2.o.1
2.o.2
2.o.3
algo 3
I.3
I.2
I.1
I.6
I.5
I.4
I.7
5.o.1
5.o.2
2.i.1
3.o.1
3.o.2
3.i.1
3.i.2
O.2
O.3
O.1
input output execution
Institute of Computer Science - Foundation for Research and Technology - Hellas
macro agent
execution agent
macro
agent
execution agent
application
execution agent
execution agent
manager
Institute of Computer Science - Foundation for Research and Technology - Hellas
agents’ policy
on
• accepting execution
• allocating execution
• charging
in terms of
• user priority
• execution priority
• user id and origin
• user preferences
• time and date
• system state
• ...
Institute of Computer Science - Foundation for Research and Technology - Hellas
execution agent - roles
execution wrapper • execution spawning
• data conversions
• intermediate communication
data management • status of cache
• intelligent data delivery
• data prefetching
execution management • status of current processes
• estimate remaining execution time
• calculate actual execution time
repository manager • execution profile
• statistical analysis of profiles
• (algorithm retrieval)
resource monitoring • information on local platform
• current status of local platform
execution agent
algos
execution control resource
monitor
data mgt.
Institute of Computer Science - Foundation for Research and Technology - Hellas
manager - roles
manager
directory algo info
directory • local execution agents
• other managers
virtual repository • algorithm information
authentication • user authentication
• manager authentication
resource management • bid evaluation
• charging
Institute of Computer Science - Foundation for Research and Technology - Hellas
user application
…..
GUI
pre-processing
vizualization
real-time local
processing
embbed algos
• unique image ids
• image pre-processing and
vizualization functionalities
• multi-level help
• toolkits for
algorithm development
algorithm integration
macro recording and visualization
… etc.
Institute of Computer Science - Foundation for Research and Technology - Hellas
scripting & plug-ins
support new types of data
create dialogues for intermediate
communication
instruction macros
extend roles and policies of agents
add new breeds of agents
Institute of Computer Science - Foundation for Research and Technology - Hellas
implementation issues
• ACE operating system transparency network transparency
• CORBA integration
• zApp
graphical user interface transparency
Institute of Computer Science - Foundation for Research and Technology - Hellas
Institute of Computer Science - Foundation for Research and Technology - Hellas
Institute of Computer Science - Foundation for Research and Technology - Hellas
Institute of Computer Science - Foundation for Research and Technology - Hellas
Institute of Computer Science - Foundation for Research and Technology - Hellas
Institute of Computer Science - Foundation for Research and Technology - Hellas
applications
best use of computational resources &
quality of service
integration of heterogeneous algorithms,
and software/hardware platforms
‘renting’ processing algorithms and
resources
processing services within a ‘virtual’
enterprise
added value service over various
information services networks
Institute of Computer Science - Foundation for Research and Technology - Hellas
distributed processing within the same
organization
PC - linux
other
application
SUN - solaris
execution agent
manager
user
application algorithm
repository
execution agent
algorithm
repository
SGI - irix
PC windows NT/95
user
application
SUN - sunOS
user
application
execution agent
algorithm
repository
SGI - irix
user
application
execution agent
algorithm
repository
execution agent
algorithm
repository
SUN - solaris
execution agent
algorithm
repository PC windows NT/95
Institute of Computer Science - Foundation for Research and Technology - Hellas
other
application
execution agent
user
application
execution agent
execution agent
web-enabled
application
user
over the
internet
‘renting’
processing algorithms and
computational resources
over the internet
manager
Internet
Institute of Computer Science - Foundation for Research and Technology - Hellas
other
application
execution agent
user
application
execution agent
execution agent
manager
supercomputing center
manager
industry
manager
research institute
manager
research institute
transparent
processing services
within a ‘virtual’ enterprise
Institute of Computer Science - Foundation for Research and Technology - Hellas
image processing services
telemedicine services network
an added value service
offered by other information
services networks
Institute of Computer Science - Foundation for Research and Technology - Hellas
work in progress
• advanced graphical user
interface tools
• web-enabled application
• charging mechanisms
• algorithm management and
retrieval
Institute of Computer Science - Foundation for Research and Technology - Hellas
cite as
• E. Kaldoudi, “Processing Services in Visual Information
Systems”, Invited Talk, MBI Seminar Medizinische
Bildverarbeitung”, Division of Medical and Biological
Informatics, German Cancer Research Center,
Heidelberg, Germany, July 1, 1997