duplicacy
lock-free cloud backup with deduplication
TLDR
Initialize a repository with local storage
SYNOPSIS
duplicacy command [options] [arguments]
DESCRIPTION
Duplicacy is a cross-platform backup tool featuring lock-free deduplication. It uses variable-length chunking to split files into chunks that are deduplicated across all backups, significantly reducing storage requirements for similar data.
A unique feature is lock-free design: multiple computers can back up to the same storage simultaneously without coordination. Each client operates independently, making Duplicacy suitable for backing up multiple machines to shared cloud storage.
The tool supports numerous storage backends including local disk, SFTP, WebDAV, and cloud services (AWS S3, Backblaze B2, Google Cloud, Azure, Wasabi, etc.). Client-side encryption ensures data privacy even with untrusted storage.
Duplicacy uses a two-repository model: the working directory (source) and the storage (destination). Multiple working directories can share the same storage, benefiting from cross-machine deduplication. The prune command implements flexible retention policies with tiered keep rules.
PARAMETERS
init snapshotid storage_
Initialize a new repository with the specified snapshot ID and storage location.backup [-stats] [-threads n]
Create a new backup snapshot.restore [-r revision] [-overwrite]
Restore files from a snapshot.list [-all] [-files]
List available snapshots.prune [-keep spec] [-id snapshotid_]
Remove old snapshots based on retention policy.check [-files] [-stats]
Verify repository integrity.diff [-r revision]
Show differences between snapshots.cat file [-r revision]
Print contents of a file from a snapshot.-encrypt
Enable encryption for the repository.-threads n
Number of concurrent threads.-stats
Show detailed statistics.-verbose
Enable verbose output.-d
Enable debug logging.
CAVEATS
Free CLI version has limitations; some features require license. Deduplication effectiveness varies with data type. Initial backup of large datasets takes significant time. Restoration speed depends on chunk distribution across storage. Some cloud storage operations incur API costs.
HISTORY
Duplicacy was created by Gilbert Chen starting around 2016 as a modern backup solution focusing on deduplication and cloud storage. The lock-free design was a response to limitations in tools like Duplicity where concurrent backups required coordination. Both CLI (open-source) and GUI (commercial) versions are available.
