eXdupe
eXdupe is a file archiver that supports deduplication and differential backups.
It's easy to use. Let's backup the entire D drive on Windows:
exdupe d:\ d.full
Each day we can then create a new backup that only stores the changes compared to the initial backup:
exdupe -D d:\ d.full d1.diff
exdupe -D d:\ d.full d2.diff
Benchmark
Backup of a Linux virtual machine of 22.1 GB on an average desktop computer with two SSDs:
| eXdupe 3 | tar+zstd | kopia | restic | Duplicacy | zpaq64 | 7-Zip flzma2 | Duplicati | |
|---|---|---|---|---|---|---|---|---|
| Time | 9.76 s | 14.2 s | 14.8 s | 24.8 s | 77.0 s | 112 s | 209 s | 360 s |
| Size | 7.34 GB | 10.6 GB | 9.93 GB | 9.21 GB | 11.4 GB | 8.18 GB | 9.42 GB | 10.2 GB |
Differential backup after some random work inside the virtual machine:
| eXdupe 3 | kopia | restic | Duplicacy | Duplicati | |
|---|---|---|---|---|---|
| Size | 0.77 GB | 2.42 GB | 1.78 GB | 3.10 GB | 1.62 GB |
Download
The latest stable version is 2.1.0 from 29-sep-2024:
exdupe.exe
exdupe_2.1.0_linux_amd64.tar.gz
- Three times faster restore speed
- 30% faster backup speed
Development version
The latest development version is 3.0.0.dev6 from 25-mar-2025:
exdupe_3.0.0.dev6.exe
exdupe_3.0.0.dev6_linux_amd64.tar.gz
- New hashing for much better speed and compression ratio
- Fast handling of incompressible data at disk I/O speed
- Detection and fast handling of files with fully identical contents
- Concurrent directory traversal for major speedup for numerous smaller files
About
It uses its own sliding-window deduplication library to find identical data blocks as small as 4 KB at byte grannularity positions across terabytes. Traditional compression is optionally applied afterwards.
The latest development version reaches 4.7 gigabyte/second (command line flags -g1t3x0) if not disk bound - and that's with just 3 threads.
It dates back to 2010 with very sporadic development and random URL homes. I have recently revived the project and put it on github.
Screenshot
eXdupe on github
Here you can find old versions and the source code https://github.com/rrrlasse/eXdupe