26

Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

Embed Size (px)

Citation preview

Page 1: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture
Page 2: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

PoznaPoznańń city, P city, PSNC - who are we?SNC - who are we?

Introduction into Virtual LaboratoryIntroduction into Virtual Laboratory

VLab architecture and solutionsVLab architecture and solutions

VLab in European projectsVLab in European projects

Current project progress, achievementsCurrent project progress, achievements

Page 3: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

Western Poland Province capitalWestern Poland Province capital

Historic, interesting city now in EU Historic, interesting city now in EU

International Fair Ground areaInternational Fair Ground area

Airport, Railway/Bus Central Terminal (all international)Airport, Railway/Bus Central Terminal (all international)

Extensive choice of museums, theaters, restaurants, Extensive choice of museums, theaters, restaurants,

pubs and clubspubs and clubs

PPoznańoznań

Page 4: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

PPoznańoznań

City of 600,000 inhabitants and one of the biggest City of 600,000 inhabitants and one of the biggest

Academic community in Poland:Academic community in Poland:

21 universities and colleges21 universities and colleges

122,000 students 122,000 students

44 science and research institutes44 science and research institutes

The Polish Academy of ScienceThe Polish Academy of Science

The Supercomputing & Networking Center (PSNC)The Supercomputing & Networking Center (PSNC)

Page 5: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

PPoznańoznań Supercomputing & Networking Center Supercomputing & Networking Center

Affiliated to Polish Academy of Sciences Affiliated to Polish Academy of Sciences

Major Polish HPC center Major Polish HPC center (largest SMP installation in Poland, one (largest SMP installation in Poland, one

of the largest IA64 cluster, and others)of the largest IA64 cluster, and others)

Poznań Metropolitan Area Network Poznań Metropolitan Area Network (POZMAN)(POZMAN) operator operator

Backbone operator Backbone operator ((Polish Optical InternetPolish Optical Internet PIONIER 10Gbit/s) PIONIER 10Gbit/s)

R&D institutionR&D institution

International projects partner International projects partner (EGEE, GridLab, CrossGrid, (EGEE, GridLab, CrossGrid,

Internet2, Geant and more)sInternet2, Geant and more)s

Page 6: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

PIONIER:PIONIER: Technology:Technology:

10Gigabit Ethernet, ATM10Gigabit Ethernet, ATM

Core speed: 10 Gb/sCore speed: 10 Gb/s

Number of nodes: 21Number of nodes: 21

http://noc.pionier.gov.pl/http://noc.pionier.gov.pl/

Page 7: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

Virtual Laboratory overviewVirtual Laboratory overview

The VLab is a distributed environment, providing its users with The VLab is a distributed environment, providing its users with

the following functionality:the following functionality: Remote access to complex and expansive laboratory research Remote access to complex and expansive laboratory research

equipmentequipment

User-customized Dynamic Measurement ScenariosUser-customized Dynamic Measurement Scenarios

Digital Science Library - dDigital Science Library - data storage and managementata storage and management

Educational potentialEducational potential

WorkWorkggroup collaboration toolsroup collaboration tools

SecuritySecurity

Page 8: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture
Page 9: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

Virtual Laboratory – technology usedVirtual Laboratory – technology used

Most modules written in generic UNIX – based C++ languageMost modules written in generic UNIX – based C++ language

End user-side applications written in Java technology End user-side applications written in Java technology

(Java WebStart)(Java WebStart)

Web Services chosen as main communication methodWeb Services chosen as main communication method

(gSOAP for C++, Axis for Java)(gSOAP for C++, Axis for Java)

Cooperation with Globus Toolkit on many levels (eg. Cooperation with Globus Toolkit on many levels (eg.

scheduling)scheduling)

User web portal is the main access pointUser web portal is the main access point

Page 10: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

Virtual Laboratory – access pointVirtual Laboratory – access point

Page 11: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

Preprocessing PostprocessingExperiment VisualisationData Results

VLab Dynamic Measurements VLab Dynamic Measurements SScenarioscenarios

• definition of complex, multi-dimensional research experiment definition of complex, multi-dimensional research experiment

scenariosscenarios• connection of experimental and computational jobsconnection of experimental and computational jobs• multiple conditions on jobs connections, determining the actual multiple conditions on jobs connections, determining the actual

execution pathexecution path• description language for resources and connection description language for resources and connection

dependenciesdependencies

Example of a simple measurement scenario

Page 12: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

Example of the connection diagramExample of the connection diagram

Page 13: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

VLab Scenario Submission ApplicationVLab Scenario Submission Application

Page 14: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

<application ID="001">

<devicename>Varian</devicename>

<devicedesc>Varian 300MHz</devicedesc>

<experimdesc>

<expertype>1D,2D</expertype>

<pulseseq>2D:COSY</pulseseq>

<nucleustype>15N,20N</nucleustype>

<solventtype>CD3OD</solventtype>

<probetype>broadband</probetype>

<temperature>10,20,25,30,40</temperature>

</experimdesc>

<cost>100</cost>

<parameters>"-x -p -c"</parameters>

<files>

<inputfile1>input1.txt</inputfile1>

<inputfile2>input2.txt</inputfile2>

<outputfile1>output1.txt</outputfile1>

<outputfile2>output2.txt</outputfile2>

</files>

<availableconnections>

<connectedapp>

<appID>"002"</appID>

<conversion>"NO"</conversion>

</connectedapp>

</availableconnections>

<timespec>

<deadline> </deadline>

<reservation>

<from>YYYY:MM:DD:HH:NN</from>

<to>YYYY:MM:DD:HH:NN</to>

</reservation>

<userpresence> </userpresence>

<adminpresence> </adminpresence>

</timespec>

</application>

Writing down connection rules – simplified exampleWriting down connection rules – simplified example

Page 15: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

VLab Digital Science Library – scientific data repositoryVLab Digital Science Library – scientific data repository

FeaturesFeatures

Widespread access to the published papersWidespread access to the published papers

DurabilityDurability

Version ManagementVersion Management

Access ManagementAccess Management

Copying ProtectionCopying Protection

NotificationsNotifications

CredibilityCredibility

Page 16: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

VLab Digital Science Library – scientific data repositoryVLab Digital Science Library – scientific data repository

AllowsAllows

• CategoryCategory – the ability to group the related publications – the ability to group the related publications

• Catalogue descriptionCatalogue description – – detailed information about digital entries in detailed information about digital entries in

the librarythe library

• SearchingSearching – library content lookup by the user-defined criteria – library content lookup by the user-defined criteria

• BrowsingBrowsing – visualization of the searched out data in the user-friendly – visualization of the searched out data in the user-friendly interfaceinterface

Page 17: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

VLab – current developments, NMRVLab – current developments, NMR

NMR Spectometer – BRUKER Advance 600MHzNMR Spectometer – BRUKER Advance 600MHzInstalled in the Chemistry Departmet of Adam Mickiewicz Installed in the Chemistry Departmet of Adam Mickiewicz University in PoznańUniversity in Poznań

Page 18: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

VLab – current developments, NMRVLab – current developments, NMR

Page 19: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

VLab – current developments, Radio AstronomyVLab – current developments, Radio Astronomy

Radiotelescope (32m)Radiotelescope (32m)

Department of Radioastronomy Department of Radioastronomy

of the Nicolaus Copernicus of the Nicolaus Copernicus

University in University in TorunTorun

Page 20: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

VLab – current developments, Radio AstronomyVLab – current developments, Radio Astronomy

Page 21: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

Virtual Laboratory in European projectsVirtual Laboratory in European projects

EXPReS – a Real-time e-VLBI Radio Telescope

- JRA1: Future Arrays of Broadband Radio-Telescopes

on Internet Computing (FABRIC)

- Grid – VLBI collaboration

- Grid Workflow management

- Grid Routing

RING – Remote Instrumentation in Next-Generation

Grids

- research project

Page 22: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

VLBI is a technique, in which physically independent and

widely separated radio telescopes observe the same region of

sky simultaneously, in order to generate very high-resolution

continuum and spectral-line images of cosmic radio sources.

Telescopes are usually separated by thousands of kilometres

Data from each telescope are digitally sampled and stored

locally, using high-capacity magnetic tape systems and

magnetic disk-array systems

Data are sent and correlated at the central point (JIVE)

The total flow of data into the central processor is

approximately 10-100 Terabytes per single observation, after

processing this is reduced to 10-100 Gbytes.

VLab in European projects - EXPReSVLab in European projects - EXPReS

Page 23: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

EXPReS – the objective is to create a production-level

“electronic” VLBI (e-VLBI) service, in which the radio telescopes

are reliably connected to the central data processor at JIVE via a

high-speed optical-fibre communication network:

Single radio telescope is producing a 2.5Gbps of data

during e-VLBI observation

Up to 16 radiotelescopes can take part in the e-VLBI

Aggregate data flow of up to 40 Gbps into the central

processor

Generating high-resolution images of cosmic radio

sources in real-time.

VLab in European projects - EXPReSVLab in European projects - EXPReS

Page 24: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

e-VLBIe-VLBIpilotspilots

Current status of the e-VLBI Proof-of-Concept Telescope Network connections. Five telescopes are connected to their NREN, GEANT & ultimately JIVE at 1 Gbps (Jodrell Bank & Cambridge – UK; Westerbork –NL; Torun – PL; Onsala – SE). Arecibo (USA) is connected at 155 Mbps.

Page 25: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

Real – time eVLBI correlation on distributed Grid Real – time eVLBI correlation on distributed Grid resources:resources:

4 radio telescopes4 radio telescopes

experiment length (2 – 4 hrs)experiment length (2 – 4 hrs)

data rate 128 Mb/s per telescopedata rate 128 Mb/s per telescope

VLab in European projects - EXPReSVLab in European projects - EXPReS

Page 26: Poznań city, PSNC - who are we? Poznań city, PSNC - who are we? Introduction into Virtual Laboratory Introduction into Virtual Laboratory VLab architecture

Thank you for your attentionThank you for your attention

http://vlab.psnc.pl/

e-mail:

Tomasz Rajtar: [email protected]

or: [email protected]