A C library for parsing/normalizing street addresses around the world. Powered by statistical NLP and open geo data.

Extremely fast tool to remove duplicates and other lint from your filesystem

A kernel module which provide a pool of deduplicated and/or compressed block storage.

Userspace tools for managing VDO volumes.

CLI utility to find duplicate files

Continuous data protection for GNU/Linux (cdpfgl).

Deduplicating filesystem via Python3, FUSE and SQLite

Ultra fast file archiver that supports data deduplication and differential backups

A backup suite. Supports FLZMA2, bzip3, LZ4, Zstandard, LSH i-node ordering deduplicating archiver, long range deduplication, encryption and recovery records

Variable-sized block deduplication archival backed by Plan9's venti

Fast block device sync with digest, designed to improve block-based backups.

Quick and Dirty Deduplication Analyzer

A command-line tool for deduplicating entries in a file or stream with constant memory usage

This is a mirror of https://gitlab.com/gob-backup/gob

In-band deduplication via LD_PRELOAD for any filesystem that supports reflinks!

SuperREP: huge-dictionary LZ77 preprocessor

Alignment-free FASTQ deduplication.

a data deduplication tool for container images

Identical File Hardlinker