1. Gluster Compliance & Beyond Joseph Fernandes Vivek
Agarwal
2. Agenda Motivation RHS Compliance WORM File System WORM Data
Maintenance WORM based Tiering
3. Motivation : Known Data Retention Requirements
4. Gluster - Compliance Write Once Read Multiple (WORM) File
System WORM Data Maintenance WORM based Data Tiering
5. Gluster - Compliance : Write Once Read Multiple (WORM) File
System Immutable and Undelete-able files WORM/Retention Transition
via Manual POSIX : chmod -w Automatic(Auto-commit): Time/Age based
Lazy Autocommit: via next IO Scheduled Autocommit: via namespace
scan (change log) Policy based WORM/Retention : WORM/Retention
Policies @Volume or @Share level *More details in notes.
6. Gluster - Compliance : Write Once Read Multiple (WORM) File
System Life cycle of file in WORM/Retention Filesystem Normal File
Mutable and Deletable WORM-Retained File Immutable &
undeletable For a spefied period WORM File (Immutable) WORM-HELD
File Immutable & undeletable indefinitely WORM-APPENDFile
Append only files Delete With or without data shredding Read-only
stage Retention Transition Manual or Auto-commit Retention exipiry
New Retention period assigned Legal hold applied Legal hold remove
Mark append-only Delete issued Data Validation supported Data
Validation NOT supported
7. Gluster - Compliance : WORM Data Maintenance Data Validation
: Checksum Generation Self Validating Checksum Store Data
Validation Scan (Data Scrubbing) Error Detection Error Correction
Data Health Report Data Shredding: Securely erase data, making
unrecoverable *More details in notes.
8. Gluster - Compliance : WORM based Tiering Cross Volume
tiering : WORM Volume Tier pair Active Volume Tier : IO
Performance, Passive Volume Tier : Scale, Security & Data
Integrity Localized Distribute/Replication/Cache/Tiering Policies
for Active/Passive Volume Tier File Stubs : On Retention
Transition, File Stub on Active Volume Tier File Data on the
Passive Volume Tier WORM Data Maintenance on Passive Volume Tier
Re-Hydration of Stub : On frequent access , Just a copy &
read-only *More details in notes.
9. Gluster - Compliance : WORM based Tiering Client 1
Unify/DHT/ARF Client 2 Unify/DHT/ARF Client 3 Unify/DHT/ARF Client
N Unify/DHT/ARF Passive Brick 1 Passive(Archive) Volume Tier)
Passive Brick 4 Passive Brick N Passive Brick 3 Passive Brick 2
Passive Brick N-1 replica replica replica Active Volume Tier Active
Brick 1 Active Brick 4 Active Brick M Active Brick 3 Active Brick 2
Active Brick M-1 replica replica STUB 1STUB FILE 1 STUB 1 FILE 1
Data Validation Store Data Validation Scan demon Data Validation
Scan demon Data Shredder replica Secure Cluster Network Client
Network Backup/Archive/ De-duplication ISV (Cold Storage) Secure
Cluster Network Local DHT/ ARF/Cache policies Local DHT/ ARF/Cache
policies Overview of WORM Volume Tiering
10. Gluster - Compliance : WORM based Tiering STUB Active
Volume Tier Read-only File Passive Volume Tier Active Volume Tier
R/W File Passive Volume Tier Active Volume Tier Passive Volume Tier
File Deletion / ShreddingRetention Transition Life cycle of File in
WORM Volume Tiering Data Validation Check-sum
11. Gluster - Compliance : WORM based Tiering Segregation &
Abstraction of Passive Tier from Client & Client Network Data
Maintenance Off-load to Passive Tier Backup/Cold Storage activities
Off-loaded to Passive Tier Server Based Tiering Advantages of WORM
based Volume Tiering *More details in notes.
