DiskBoss File Synchronization

8/6/2019 DiskBoss File Synchronization

http://slidepdf.com/reader/full/diskboss-file-synchronization 1/12

DiskBoss File Synchronization Flexense Ltd.

1

File Synchronization

Version 1.2

Mar 2011

Flexense Ltd.

www.flexense.com [email protected]

DiskBossFile & Disk Manager




2

Product Overview

DiskBoss is an automated, rule-based file and disk manager allowing one to search andclassify files, perform disk space utilization analysis, detect and remove duplicate files,organize files according to user-defined rules and policies, copy large amounts of files in afault-tolerant way, synchronize disks and directories, cleanup wasted disk space, etc.

All file management operations are integrated in a centralized and easy-to-use GUI applicationwith a built-in file navigator allowing one to execute any required operation in a single mouseclick. Frequently used file management operations may be pre-configured as user-definedcommands and executed using the GUI application or direct desktop shortcuts.

DiskBoss is a highly extendable and customizable data management solution allowing one todesign custom file classification plugins and purpose-built file management operations usingan open and easy-to-use XML-Based format. Custom disk space analysis and file managementoperations may be integrated into the product, executed periodically at specific time intervals,performed as conditional actions in other operations or automatically triggered by one or morechanges in a disk or directory.

In addition, IT administrators are provided with extensive database integration capabilitiesallowing one to submit disk space analysis, file classification, duplicate files detection and filesearch reports into an SQL database. Reports from multiple servers and desktop computersmay be submitted to a centralized SQL database allowing one to display charts showing theused disk space, file categories and duplicate files per user or per host and providing an in-depth visibility into how disk space is used, what types of files are stored and how much spaceis wasted on duplicate files across the entire enterprise.

Finally, IT professionals and enterprises are provided with DiskBoss Server – a server-basedproduct version, which runs in the background as a service and is capable of executing all diskspace analysis and file management operations in a fully automatic and unattended mode.DiskBoss Server can be managed and configured locally or through the network using a freenetwork client GUI application or the DiskBoss command line utility, which provides the userwith the ability to integrate DiskBoss’ features and capabilities into other products andsolutions.




3

High-Speed File Synchronization

DiskBoss provides advanced file synchronization capabilities allowing one to synchronize filesbetween directories, local disks and network shares. The DiskBoss' built-in file synchronizationengine offers numerous one-way and two-way file synchronization modes, the ability to syncspecific file types, file compression capabilities and advanced performance tuning options.

Frequently used file synchronization operations may be pre-configured for custom hardwareand storage configurations, saved as user-defined commands and executed in a single mouseclick. Moreover, DiskBoss allows one to create direct desktop shortcuts for user-defined filesynchronization commands and execute them directly from the Windows desktop withoutstarting the main DiskBoss GUI application. Finally, power computer users and IT professionalsare provided with a command line utility, which is capable of executing file synchronizationcommands from shell scripts and batch files.

By default, file synchronization commands are executed in the preview mode, which providesthe user with the ability to review and manually confirm each specific file synchronizationaction. Once a sync command is tested and verified, the user can configure the command torun in a fully automatic, unattended stream file synchronization mode. The stream filesynchronization mode performs all file synchronization actions on-the-fly, without showing thepreview dialog and therefore it is much faster and uses significantly less system memory whenexecuted on large file systems.




4

Synchronizing a Pair of Directories

DiskBoss provides advanced file synchronization capabilities allowing one to synchronize filesbetween local disks, directories, network shares, NAS storage devices and enterprise storagesystems. The DiskBoss' file synchronization engine is capable of synchronizing files usingmultiple one-way and two-way file synchronization modes, provides performance tuningoptions, periodic and real-time file synchronization capabilities and allows one to synchronizespecific file types and categories.

In order to synchronize a pair of directories, press the ‘Sync’ button located on the maintoolbar, enter the source and destination directories and press the ‘Preview’ button. DiskBosswill scan the specified source and destination directories, compare files between the sourceand destination directories and show a list of file synchronization actions that should beperformed.

On the file synchronization preview dialog, review sync actions, select/unselect actions thatshould be performed and press the ‘Sync’ button to execute the selected file synchronizationactions. Optionally, press the ‘Options’ button to control advanced file synchronization optionsor press the ‘Export’ button to save file synchronization actions to an HTML, text or Excel CSVreport. The DiskBoss' file synchronization engine is especially optimized for modern hardwareand storage devices and is capable of effectively utilizing RAID storage devices, multi-core/multi-CPU systems and Gigabit networks delivering maximum possible performance.




5

Selecting File Synchronization Mode

Depending on specific needs, it may be required to perform different types of filesynchronization operations. For example, sometimes users may be interested in keeping allfiles in the destination directory even when some of them were deleted from the sourcedirectory. Another option is to perform two-way accumulation and update keeping bothdirectories completely identical. DiskBoss provides eight different one-way and two-way filesynchronization modes allowing one to perform different types of file synchronizationoperations according to user-specific needs and requirements.

In order to change the file synchronization mode for a file synchronization command, open thefile synchronization command dialog, select the 'General' tab and select one of the followingfile synchronization modes:

• Synchronize Destination Directory (one-way) - All changes made in the sourcedirectory will be propagated to the destination directory. Files deleted from the sourcedirectory will be deleted from the destination directory. All files changed or deleted inthe destination directory will be restored using files from the source directory. Nochanges will be made in the source directory. After the file synchronization process iscomplete both locations will be identical.

• Update Destination Directory (one-way) - Newly created and modified source fileswill be copied to the destination directory. Files deleted from the source directory willbe deleted from the destination directory. Files deleted from the destination directorywill be restored using files from the source directory. Newly created and modifieddestination files will be kept in place. No changes will be made in the source directory.

• Accumulate and Update Files in Destination (one-way) - Newly created andmodified source files will be copied to the destination directory. Files deleted from thedestination directory will be restored using files from the source directory. Newlycreated and modified destination files will be kept in place. No files will be deletedfrom the destination directory. No changes will be made in the source directory.

• Two-Way File Synchronization - Newly created and modified files will besynchronized in both directions. Files deleted from the source directory will be deletedfrom the destination directory. Files deleted from the destination directory will berestored from the source directory. Changes may be made in both locations. After thefile synchronization process is complete both locations will be identical.

• Two-Way Accumulation and Update - Newly created and modified files will beupdated in both directions. Files deleted from one location will be restored from thesecond location. Changes may be made in both locations. After the file synchronizationprocess is complete both locations will be identical.

The last three file synchronization modes are identical to the first three modes, but the lastthree modes are saving compressed files in the destination directory.




6

Synchronizing Files with Preview

File synchronization with preview is very useful providing the user with a clear picture aboutwhat files will be synchronized. By default, DiskBoss synchronizes directories with preview, butthe user is provided with the ability to disable the preview mode and synchronize all therequired files on-the-fly without showing the preview dialog.

Synchronizing Files without Preview

Sometimes, when the user needs to synchronize large directories or disks containing many

thousands of files, file synchronization with preview may be ineffective or completelyinappropriate especially due to the fact that none will have the time to review lists of filesynchronization actions containing huge amounts of items. Moreover, unattended filesynchronization operations performed periodically at specific time intervals or triggered by adisk change monitor, should be performed fully automatically without requiring any userintervention.

In order to disable the preview dialog for a file synchronization operation, open the operationdialog and set the process mode combo box to ‘Sync Without Preview’. The stream filesynchronization more is especially designed for file systems containing huge amounts of filesand is capable of synchronizing large directories, disks and NAS storage devices very fast and

effectively. In addition, the stream file synchronization mode is ideal for automated, periodicfile synchronization operations performed in the background without any user intervention.




7

Synchronizing Specific File Types or Categories

DiskBoss Ultimate and DiskBoss Server provide power computer users and IT administratorswith the ability to synchronize specific file types or file categories using one or more flexiblefile matching rules. For example, the user may specify to synchronize documents and digitalimages with the file size more than 2 MB.

In order to add one or more file matching rules, open the file synchronization commanddialog, select the 'Rules' tab and press the 'Add' button. On the 'Rules' dialog select anappropriate rule type and specify all the required parameters. During file synchronization,DiskBoss will scan the entered source and destination directories and apply the specified filematching rules to all the existing files. Files not matching the specified rules will be justskipped from the file synchronization process.

Excluding One or More Subdirectories

Sometimes, it may be required to exclude one or more subdirectories from the filesynchronization process. For example, if you need to synchronize two directories excludingone or two special subdirectories, you may specify the top level directories as the source anddestination directories and add the subdirectories that should be skipped to the exclude list.

In order to add one or more directories to the exclude list, open the file synchronizationcommand dialog, select the 'Exclude' tab and press the 'Add' button. Keep in mind thatexclude directories are case sensitive and should be specified with the same case as stored on

the disk. All files and subdirectories located in the specified exclude directories will be excludedfrom the file synchronization process. Select an exclude directory and press the 'Delete'button, to remove the selected directory from the exclude list.




8

File Synchronization Performance Tuning Options

In order to increase file synchronization performance, DiskBoss provides advanced computerusers and IT professionals with the ability to synchronize files using multiple filesynchronization streams. Multi-Stream file synchronization significantly improves filesynchronization performance when synchronizing large amounts of files between multipledisks, NAS storage devices or enterprise storage systems.

In order to enable multi-stream file synchronization for a sync command, open the commanddialog, select the 'Performance' tab and set an appropriate number of file synchronizationstreams. Take into account that multi-stream file synchronization is optimized for multi-disk,RAID and networked configurations and it is not recommended to use it when synchronizingdirectories located on the same physical disk. In addition, users required to synchronize fileson running, production systems are provided with the ability to execute file synchronizationcommands slowly thus minimizing the performance impact on running applications. In order tochange the speed of a file synchronization command, select an appropriate performance modein the 'Performance Mode' combo box.

User-Defined File Synchronization Commands

DiskBoss provides the user with the ability to pre-configure custom file synchronizationoperations as user-defined commands and execute such commands in a single mouse clickusing the DiskBoss GUI application or direct desktop shortcuts.

User-defined commands may be managed and executed through the commands dialog or thecommands tool pane. In order to add a new command through the commands pane, press the

right mouse button over the pane and select the ‘Add New – File Synchronization Command’ menu item. In order to execute a previously saved command, just click on the command itemin the commands tool pane or create a direct desktop shortcut on the desktop.




9

Periodic File Synchronization

Sometimes, it may be required to execute a file synchronization operation periodically atspecific time intervals. The first option to do that is to configure a periodic job in the DiskBossGUI application and select the required file synchronization command to be executedperiodically. Another option is to use DiskBoss Server, which runs as a service in thebackground and may be used to periodically execute file synchronization operations in a fullyautomatic, unattended mode.

In order to add a new periodic job, select the ‘Tools – Manage Periodic Jobs’ menu item andpress the ‘Add’ button. On the periodic job dialog, select the file synchronization commandthat should be executed and specify the time period.

Real-Time File Synchronization

DiskBoss Ultimate and DiskBoss Server provide the ability to monitor one or more disks ordirectories and automatically execute a file synchronization operation after a user-specifiednumber of changes is detected.

In order to execute a file synchronization command using the DiskBoss' disk change monitor,create a new disk change monitoring command, specify one or more disks or directories thatshould be monitored, select the ‘Actions’ tab, specify the number of disk changes that should

trigger the file synchronization command and selected the name of the file synchronizationcommand that should be executed once the disk change monitor reaches the specified numberof changes.




10

Synchronizing Files Using the Command Line Utility

In addition to the GUI application, DiskBoss Ultimate and DiskBoss Server provide a commandline utility allowing one to execute file synchronization commands form batch files and shellscripts. The command line utility is located in the ‘<ProductDir>/bin’ directory.

Command Line Syntax:

diskboss -sync -source <Source Directory> -dest <Dest Directory>

This command synchronizes files between directories, local disks or network shares.

diskboss –execute <File Synchronization Command>

This command executes the specified user-defined file synchronization command pre-configured using the DiskBoss GUI application or imported from an XML file.

Parameters:

-source <Source Directory>

This parameter specifies the source directory for file synchronization. In order to ensureproper parsing of command line arguments, directories and file names containing spacecharacters should be double quoted.

-dest <Destination Directory>

This parameter specifies the destination directory for file synchronization. In order to ensureproper parsing of command line arguments, directories and file names containing spacecharacters should be double quoted.

Options:

-sync_mode <SD | SUD | SAD | STW | STA>

SD - Sets the sync-destination file synchronization mode (Default)

All changes made in the source directory will be propagated to destination. Files deleted fromthe source directory will be deleted from destination. All files changed or deleted in destinationwill be restored from source.

SUD - Sets the update-destination file synchronization mode

Newly created and modified source files will be copied to destination. Files deleted from thesource directory will be deleted from destination. Files deleted from the destination directorywill be restored from source.

SAD - Sets the accumulate-destination file synchronization mode

Newly created and modified source files will be copied to destination. Files deleted from thedestination directory will be restored from source. Newly created and modified destination fileswill be kept in place.

STW - Sets the two-way file synchronization mode

Newly created and modified files will be synchronized in both directions. Files deleted from the

source directory will be deleted from destination. Files deleted from the destination directorywill be restored from source.




11

STA - Sets the two-way accumulate file synchronization mode

Newly created and modified files will be updated in both directions. Files deleted in onelocation will be restored from the second location. After finishing the synchronization processboth locations will be identical.

-streams <StreamCount>

This parameter specifies the number of simultaneous file synchronization streams.

-file_delay <delay in milliseconds>

This parameter sets the file delay to the specified value in milliseconds. Use this option whenyou need to slowly synchronize files to or from a busy production system in order to minimizethe potential performance degradation.

-block_delay <delay in milliseconds>

This parameter sets the block delay to the specified value in milliseconds. Use this option

when you need to slowly synchronize files to or from a busy production system in order tominimize the potential performance degradation.

-copy_dacl

This parameter instructs to copy files' access control lists (DACL).

- copy_sacl

This parameter instructs to copy files' security control lists (SACL).

-copy_owner

This parameter instructs to copy files' user/group information.

-v

This command shows the product’s major version, minor version, revision and build date.

-help

This command shows the command line usage information.




12

SyncBreeze – Dedicated File Synchronization Solution

In addition to the file synchronization capabilities available in DiskBoss, Flexense develops adedicated file synchronization solution, named SyncBreeze, which provides multiple, advancedfile synchronization features including periodic synchronization, multi-way file synchronization,real-time file synchronization, tertiary destination directories and much more.

Users are provided with multiple product versions ranging from an easy-to-use, free version toan advanced server-based product version, which runs in the background as a service and iscapable of synchronizing a number of disks, network shares or NAS storage devices in a fullyautomatic and unattended mode.

A number of SyncBreeze servers may be managed through the network using a free, networkclient GUI application capable of configuring and controlling file synchronization operationsacross the entire network. In addition, IT administrators are provided with a command lineutility allowing one to control file synchronization operations from batch files and shell scripts

enabling integrations of file synchronization capabilities into other products and solutions. Formore information about SyncBreeze refer to: http://www.syncbreeze.com

Documents

DiskBoss File Synchronization