33
Making Backups Better Presented By Matt Porritt @MatthewPorritt

Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits

  • Upload
    others

  • View
    12

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits

Making Backups Better

Presented By Matt Porritt

@MatthewPorritt

Page 2: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits

System Level Backups

• Backups Of Entire Moodle• Database• Sitedata• Code

• Primarily For Disaster Recovery• Need To Rehearse Restores

Page 3: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits

Application Level Backups

• Backups Of Courses And Activities• Prevention Of Data Loss• Course Rollovers

Page 4: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 5: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 6: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 7: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits

Synchronous Requests

• Backups And Restores Are Synchronous Operations

• Synchronous Workflows Are Bad For Long Running Processes

• User Waits While Synchronous Workflows Complete

RE

QU

ES

T

RE

SP

ON

SE

Page 8: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 9: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits

Make It Faster?

• Practical Limits For:• Timeouts• Server Resources

• Resources Alone Won’t Fix Big Courses

• 190K Enrolled Students• Backups Files Over 10Gb

Page 10: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits

AsynchronousBackup & Restore

• Asynchronous (Background) Processing Of Backup And Restore In Moodle 3.7

• Better Large Course Handling• No Need To Wait For Backups And

Restores To Complete

New In3.7

Page 11: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 12: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 13: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 14: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 15: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 16: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 17: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 18: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 19: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 20: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 21: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 22: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 23: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 24: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 25: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 26: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 27: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 28: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 29: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 30: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits
Page 31: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits

Webservices

• New Asynchronous Webservices In Moodle 3.8 (Missed 3.7)

• Backup• Restore• Duplicate

Page 32: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits

AsynchronousBackup & Restore• Off By Default In Moodle 3.7• Requires Cron• Warning Only When Editing & Deleting

Courses• Only One Backup Per Course Per User

At A Time• Users Can Queue Backups of Multiple

Courses At Once• Backups Processed Concurrently

Page 33: Making Backups Better - Moodle...Synchronous Requests • Backups And Restores Are Synchronous Operations • Synchronous Workflows Are Bad For Long Running Processes • User Waits

Links

• Asynchronous Backup and Restore • https://tracker.moodle.org/browse/MDL-28505

• Webservices • https://tracker.moodle.org/browse/MDL-64914 • https://tracker.moodle.org/browse/MDL-64915 • https://tracker.moodle.org/browse/MDL-64916