Embed Size (px)
DESCRIPTION
University at Buffalo. The State University of New York. Monitoring and Information Services Architecture and Deployment. Mark L. Green, Ph.D. Grid Computational Scientist. Layout. Monitoring and information Services - Core Infrastructure (MIS-CI) MIS Compute Element and Storage Element - PowerPoint PPT Presentation
Citation preview
Mark L. Green, Ph.D.Grid Computational Scientist
Monitoring and Information Services Architecture and Deployment
University at Buffalo
The State University of New York
University at Buffalo The State University of New York CCRCenter for Computational Research
Layout
Monitoring and information Services - Core Infrastructure (MIS-CI)MIS Compute Element and Storage Element
Discovery ServiceConsumer InterfaceResource RepositoryInformation Gathering
Current Grid3 Monitoring Services MIS-CI Deployment MIS-CI Proof of Concept Timeline
University at Buffalo The State University of New York CCRCenter for Computational Research
MIS-CI
MIS Compute Element and Storage Element Discovery ServiceLightweight information gatheringSelf monitoringScalableExpandableRobust and Fault TolerantTimestampsAPI
University at Buffalo The State University of New York CCRCenter for Computational Research
MIS-CI
MIS Compute Element and Storage Element Consumer InterfaceModular and customizable query infrastructureSelf monitoringScalableConsumer profilesConsumer throttlingAPI
University at Buffalo The State University of New York CCRCenter for Computational Research
MIS-CI
MIS Compute Element and Storage Element Resource RepositoryLightweight with minimal resource loading and
requirementsSelf monitoringExpandableCommon schema with unique name spaceVirtual organization based aggregationTimestamps
University at Buffalo The State University of New York CCRCenter for Computational Research
MIS-CI
MIS Compute Element and Storage Element Information GatheringLightweight information gatheringSelf monitoringExpandableModular designCron based implementation
University at Buffalo The State University of New York CCRCenter for Computational Research
Current Grid3 Monitoring Services
Unfortunately these projects have significant overlap and often report an inconsistent representation of the core monitoring and information required by application managers and grid schedulers.
The current monitoring systems include:MonaLisa, GridCat, MDS, ACDC Job Monitoring,
Ganglia Representatives from each project have agreed to
participate in the Monitoring and Information Services Technical Group and contribute information gathering infrastructure, expertise, and compatibility infrastructure.
University at Buffalo The State University of New York CCRCenter for Computational Research
MIS-CI Architecture
SQL-LiteDatabase
SQL-LiteRemote VOHistoricalRepository
SQL-LiteLocal
HistoricalRepository
SQL-LiteDatabaseBackup
User
ResourceGatekeeper
jobmanager-mis-profile (default)-jobs-gridftp-diskspace-accounting-policy-environment-software-VO-statistics-security
DiscoveryService
MIS-CI Profiles
Schema Eval
Cron
jobs
Self-Monitor
gridftp
VO
software
environment
diskspace
accounting
policy
statistics
security
?
MIS-CIConsumerThrottling
MIS-CI Resource Throttling
Custom Remote RepositoryGrid Scheduler
OSG Auditing/Accounting
University at Buffalo The State University of New York CCRCenter for Computational Research
MIS-CI Deployment
Proof of Concept MIS-CI Deployment Pacman Cache
Grid3DevMama Cluster
Grid3Acdc Cluster
Document Management SystemModule managementVersion control
MIS-CI API MIS-CI Online Documentation
University at Buffalo The State University of New York CCRCenter for Computational Research
MIS-CI Deployment Timeline
Proof of Concept MIS-CI Deployment ~ 12/2004 Pacman Cache
Grid3Dev ~ 1/2005Mama Cluster
Grid3 ~ 2/2005ACDC Cluster
Document Management System ~ 12/2004 Module management Version control
MIS-CI API ~ 1/2005 MIS-CI Online Documentation ~ 1/2005 Proof of Concept Web Repository (ACDC) ~ 1/2005
Only use MIS-CI for Information Gathering Load/Usage Statistics and Scalability reporting
