I’m running two urbackup servers today, both on Linux with BTRFS. According to Urbackup, the storage usage is ~47 TB, but btrfs reports ~16.5 TB used. The systems both have 6 x 10TB SATA disks for backup storage and one 250 GB SSD for OS, and 48 GB of RAM.
I want to move to FreeBSD + ZFS, since FreeBSD is the OS we usually run on our servers and we feel the ZFS tools are more mature then BTRFS, at least now, and the future of BTRFS looked cloudy the last time I checked.
I know I won’t be able to just turn on deduplication, since the RAM usage would kill the server and adding enough RAM for dedup is unlikely. The nicest thing about dedup is that we can just do full file backups of every server, instead of cherry picking directories. Thanks to dedup, we’re not wasting space storing system files and libraries multiple times. Managing backups is so much easier this way, a server is either backed up or it isn’t. I’ve been in situations where it turns out that valuable data wasn’t backed up because someone forgot to add the directory to the backup set or data was moved to another directory and the backup set not updated.
Does anyone run Urbackup server on ZFS with either L2ARC on SSD and deduplication on, or without deduplication and can comment on it? Would compression give us most of the benefits of dedup?