http://www.grnet.gr

GRNET Simple Storage

Kostas Koumantaros, Panos LouridasTF-MSP meeting, Amsterdam

February 4th 2009

Amsterdam, February 4th, 2009 GRNET Simple Storage Service

Outline

• An introduction to GSS• Authorisation & Authentication• GSS Functionality• GUI Access• API Access• Storage Architecture• Future steps

2

Amsterdam, February 4th, 2009 GRNET Simple Storage Service

What is GSS?

• GSS provides free storage for the Greek research & academic community; initially 10 Gbytes for each person

• Users are able to upload, share, and index their files

• Thin & Thick GUI access is provided• Direct API access is provided, enabling

third parties to build functionality on top• Code is Open Source (GPL)• Inspired by Amazon S3, but going

beyond…

3

Amsterdam, February 4th, 2009 GRNET Simple Storage Service

Authentication & Authorisation (AA)

• GSS uses Shibboleth for AA• GRNET has prepared a Shibboleth

infrastructure for all institutions in Greece• At the current stage, three universities have

Shibbolethised their AA process: NTUA, AUTH, UoPatras (total number of users > 50,000)

• Total number of users when all universities are Shibbolethised: > 300,000

• GSS will not offer other AA means (e.g., direct LDAP), but will be a carrot for other institutes to Shibbolethised their processes

• Initially, all users are equals

4

Amsterdam, February 4th, 2009 GRNET Simple Storage Service

User Functionality

• GSS offers users a file system abstraction, complete with file/folder hierarchical structures

• All usual file system operations are offered• Users are also able to share their files with

selected other users, or defined user groups

• Users are able to delete files permanently, or use a trash can

• GSS will enable users to version their files automatically

• Full text search is provided5

Amsterdam, February 4th, 2009 GRNET Simple Storage Service

GUI access

• Thin web client using AJAX• Thick client using Tcl/Tk• WebDAV access to enable integration

with window managers• All user interfaces will offer about the

same set of functionality

6

Amsterdam, February 4th, 2009 GRNET Simple Storage Service

Screenshot

7

Amsterdam, February 4th, 2009 GRNET Simple Storage Service

API Access

• GSS offers a REST API • A limited SOAP API will also be

offered (but there is no need for it anyway)

• Both APIs will be published• GSS encourages third parties to

write applications on top of the provided APIs

8

Amsterdam, February 4th, 2009 GRNET Simple Storage Service

Architecture

• SATA disks on a SAN – around 140 Tbytes

• All GSS functionality provided on the application layer via application server farms

• Application layer implemented in Java

9

Amsterdam, February 4th, 2009 GRNET Simple Storage Service

Logical Topology

10

Amsterdam, February 4th, 2009 GRNET Simple Storage Service

Storage Architecture – Connection with GRNET3

11

Amsterdam, February 4th, 2009 GRNET Simple Storage Service

Storage architecture - SAN

12

Amsterdam, February 4th, 2009 GRNET Simple Storage Service

GUI Preview

• Rollout complete application – currently at the beta –b round of testing

• Allow extra functionality on top of the initial one:– offering the capability to upload virtual

machines so as to move from hosting storage to hosting computation elements

• Increase infrastructure depending on use

• Open to suggestions

13

http://www.grnet.gr

GRNET Simple Storage

Ioannis Liabotis, Kostas Koumantaros, Panos Louridas

TF-MSP meeting, AmsterdamFebruary 4th 2009