Global Deduplication

NGBackup Global Deduplication (GDD) is a production-grade, Rust-native dedup engine that shrinks backup storage far past the ~20:1 the industry typically guarantees — real NGBackup workloads reach beyond 60:1, and keep climbing with long retention (the more backups of the same data you keep, the more blocks repeat — no fixed ceiling). GDD reports the exact figure for your estate at runtime from real ingested-vs-stored bytes (savings_factor in gdd-core). It deduplicates on both the client and the storage side using FastCDC content-defined chunking, a RocksDB-backed refcounted index and multi-layer Bloom filters — a drop-in layer that needs no changes to your Bacula deployment.

Capabilities

Two-sided dedup: source-side (client) and storage-side, one on-disk format
FastCDC content-defined chunking with a RocksDB refcounted index
Multi-layer Bloom filters (hot/cold layers) — skip disk index reads for chunks known-absent
Encrypted wire protocol: HKDF-SHA256 + ChaCha20-Poly1305 AEAD
Self-healing: idle auto-vacuum + scrub with CRC verify and auto-repair
Drop-in — no Bacula source changes; Prometheus metrics, fail-closed

Configure

Enable on a Storage Daemon device (storage-side) and, optionally, the File Daemon plugin (source-side):

Device {
  Name = "DedupDisk"
  Device Type = Dedup
  Archive Device = "/opt/backup/dedup"
}

Restore

See the capability page in Protect.