Upload
scott-wilson
View
214
Download
0
Embed Size (px)
Citation preview
EGEE User ForumEGEE User Forum 01/03/200601/03/2006
International Telecommunication International Telecommunication Union Regional Radio Conference Union Regional Radio Conference
and the EGEE gridand the EGEE grid
Andrea ManaraAndrea ManaraITU-Radiocommunication BureauITU-Radiocommunication Bureau
Terrestrial Service DepartmentTerrestrial Service Department
SummarySummary
International Telecommunication Union International Telecommunication Union (ITU) and the Radiocommunication (ITU) and the Radiocommunication Bureau (ITU-BR)Bureau (ITU-BR)
Regional Radio Conference RRC-04/06Regional Radio Conference RRC-04/06 The dataThe data Planning processPlanning process The computational problemThe computational problem The ITU-BR distributed computing systemThe ITU-BR distributed computing system Experience with the EGEE gridExperience with the EGEE grid Experience with DianeExperience with Diane
The International The International Telecommunication Union (ITU)Telecommunication Union (ITU)
ITU: oldest UN agency (17 May 1865) ITU: oldest UN agency (17 May 1865) historyhistory
Telecommunication Standardization Sector (ITU-T)Telecommunication Standardization Sector (ITU-T)• Production of standards covering all fields of Production of standards covering all fields of
telecommunicationstelecommunications Telecommunication Development Sector (ITU-D)Telecommunication Development Sector (ITU-D)
• Assist developing countries in bridging the “Digital Divide”Assist developing countries in bridging the “Digital Divide” Radiocommunication Sector (ITU-BR)Radiocommunication Sector (ITU-BR)
• Management of the radio-frequency spectrum and satellite Management of the radio-frequency spectrum and satellite orbits for fixed, mobile, broadcasting and many other orbits for fixed, mobile, broadcasting and many other communication servicescommunication services
ITU-BR RRC-04/06ITU-BR RRC-04/06
Regional Radio Conference for the introduction of digital broadcasting in the UHF (470-862 MHz) and VHF (174-230 MHz) bands.
RRC-04 (May 2004, 95 countries) established the technical basis (planning criteria and parameters) for the RRC-06 and defined the work for the intersessional activities
Amongst the intersessional activities: • First planning exercise (28/02/05-> 15/07/05)• Second planning exercise (31/10/05 -> 28/02/06): Draft Plan
RRC-06 (15 May–16 June 2006), 120 countries will negotiate the new frequency plan in Geneva. This plan will be part of a new international agreement.
The dataThe data
Digital broadcasting requirements (~75 K)• T-DAB and DVB-T : many system variants (i.e. data
capacity/reception modes) ->Reference Planning Configurations
• Assignments (location and features of transmitter known)• Allotments (service area known) -> Reference Networks
(number, location, power of transmitters) to approx. real networks
Existing and planned analogue radio and television stations (~95 K)
Existing and planned fixed and mobile stations (~10 K)
Propagation model for field strength prediction to be used for planning based on ITU-R P.1546-1 (statistical model)
Planning is to be based on the protection of service area for assignments and allotments
The Planning processThe Planning process
Compatibility analysisCompatibility analysis• D2d, d2a-a2d, d2o-o2dD2d, d2a-a2d, d2o-o2d
For each digital requirement :For each digital requirement : List of available channelsList of available channels List of incompatibilitiesList of incompatibilities
SynthesisSynthesis• Determine a suitable frequency Determine a suitable frequency
for each requirementfor each requirement to maximize the number of to maximize the number of
requirements satisfiedrequirements satisfied to avoid harmful interference to avoid harmful interference
Results of draft planResults of draft plan
The computational problemThe computational problem
Running compatibility analysis Running compatibility analysis very CPU demandingvery CPU demanding
Very limited time to perform Very limited time to perform the calculation at the RRC06the calculation at the RRC06• Full scale calculation in < 1dayFull scale calculation in < 1day• Smaller parallel regional areas Smaller parallel regional areas
(CNG) runs during the week(CNG) runs during the week
First planning exercise (06/2005)First planning exercise (06/2005)• CPU time: 90 daysCPU time: 90 days• Elapsed time: > 1week!Elapsed time: > 1week!
First Planning Exercise
d2dUHF Jobs: 428 CPU time: 1300 hours
~20 1-2 GHz Desktop PCs
6 dedicated 3GHz PCs
After the first planning exercise:•Look for more resources in BR•Look for resources elsewhere -> EGEE
BR distributed computing systemBR distributed computing system
Client-Server architectureClient-Server architecture Perl and Windows servicesPerl and Windows services UDP protocol for client-server UDP protocol for client-server
communication, XML-RPC communication, XML-RPC protocol for monitoring and protocol for monitoring and controlcontrol
Easily scalableEasily scalable 2 jobs in parallel on hyper-2 jobs in parallel on hyper-
threading dedicated PCs (~30% threading dedicated PCs (~30% gain on elapsed time)gain on elapsed time)
Hardware resourcesHardware resources:: 100 dedicated 3.6 GHz hyper-100 dedicated 3.6 GHz hyper-
thread PCs(~35 available for thread PCs(~35 available for draft plan run)draft plan run)
6 dedicated 3.0 GHz PCs6 dedicated 3.0 GHz PCs 70 auxiliary medium speed PCs70 auxiliary medium speed PCs
AnalysisAnalysis CPU (h)CPU (h) Elaps(h)Elaps(h) PCsPCs JobsJobs
d2dVHFd2dVHF 114114 33 2020 34763476
d2dUHFd2dUHF 453453 88 3232 1117011170
d2aVHFd2aVHF 4646 2.52.5 2525 34763476
d2aUHFd2aUHF 6262 55 2525 1117011170
a2dVHFa2dVHF 88 1.51.5 2525 34763476
a2dUHFa2dUHF 2828 44 2525 1117011170
d2o-o2dd2o-o2d 1616 1.21.2 3535 29302930
Draft Plan
Experience with the EGEE gridExperience with the EGEE grid
• Technical kick-off meeting at CERN (21 October)Technical kick-off meeting at CERN (21 October)• Feasibility studies at CERN (24-26 October) Feasibility studies at CERN (24-26 October)
Learned how the GRID works, submit jobs and retrieve Learned how the GRID works, submit jobs and retrieve results results
Run a small d2dVHF job on all LCG sites (98% efficiency)Run a small d2dVHF job on all LCG sites (98% efficiency)Run workflow:
•ITU_all.tar (ascii files, fortran exes, data binaries), ~350MB, self-contained•Copy and register tar file in two Storage Elements (CERN, CNAF)•Submit jdl jobs to Resource Broker via edg-job-submit
•Input SandBox: itu.pl, input.dat (exe, pointer to first/last record in bin)•Output SandBox: two results file (incompatibilities/available channels)
•Working Node: itu.pl retrieves/untar package from SE, run job•Retrieve results ( < 2 MB for 5 reqs/batch)
Too much overhead for ITU requirements! DIANE framework
Experience with DianeExperience with Diane
Run on the Grid using DIANE (1 November)Run on the Grid using DIANE (1 November)• Master-worker system optimise the usage of resources (see Master-worker system optimise the usage of resources (see
K.Moscicki talk n. 100 on “Special Type of Jobs” session)K.Moscicki talk n. 100 on “Special Type of Jobs” session)• Verification of the results quality (porting): Verification of the results quality (porting):
results files comparison btw LCG (Linux) and ITU (Windows) results files comparison btw LCG (Linux) and ITU (Windows) resourcesresources
• Full-scale test with Draft Plan data (Feb. 2006)Full-scale test with Draft Plan data (Feb. 2006) d2d and d2a analysis (5 requirements/batch) ~30k jobsd2d and d2a analysis (5 requirements/batch) ~30k jobs
AnalysisAnalysis CPU(h)CPU(h) Elaps( h)Elaps( h) CPUsCPUs TasksTasks
d2dVHFd2dVHF 153153 2.32.3 116116 34763476
d2dUHFd2dUHF 581581 6.36.3 142142 1117011170
d2aVHFd2aVHF 6262 4.34.3 6262 34763476
d2aUHFd2aUHF 8080 44 101101 1117011170
Institutions which will provide resources for the RRC-06:
CERN, CNAF (I), PIC (E), DESY (D), MSU (Russia), CYFRONET (PL)
Experience with DianeExperience with Diane
Draft Plan
d2dUHF
ConclusionConclusion
A key ingredient for the success of the ITU Regional Radio A key ingredient for the success of the ITU Regional Radio Conference RRC-06 is the capability of performing Conference RRC-06 is the capability of performing calculations in a very limited amount of time.calculations in a very limited amount of time.
Two independent distributed systems are available for the Two independent distributed systems are available for the RRC-06RRC-06
The EGEE infrastructure insure adequate support for an The EGEE infrastructure insure adequate support for an important CPU-demanding international event and opens the important CPU-demanding international event and opens the possibility to allow faster and more detailed studies during possibility to allow faster and more detailed studies during the Conferencethe Conference
Need to study how to share the runs (full planning area + Need to study how to share the runs (full planning area + smaller regional areas) between EGEE grid and ITU smaller regional areas) between EGEE grid and ITU distributed computing infrastructure to minimize overall distributed computing infrastructure to minimize overall running time.running time.
AcknowledgmentAcknowledgment
The ITU-CERN collaboration on the The ITU-CERN collaboration on the EGEE grid was possible thanks to the EGEE grid was possible thanks to the work of many people:work of many people:
CERN: CERN: M.Lamanna, P.Mendez, K. MoscickiM.Lamanna, P.Mendez, K. Moscicki
ITU: ITU: T.Gavrilov, P.N.Hai, D.Botha, M.CosicT.Gavrilov, P.N.Hai, D.Botha, M.Cosic