📧 CLI to deduplicate mails from mail boxes
A command-line tool for deduplicating entries in a file or stream.
Sift duplicate whitespaces away!
CloneReaper is a high performance deduper/deduplicator for Windows, and Linux. With hardlink/symlink support, it enables you to keep files in the same place while saving space. Supports reporting in TXT, JSON, and CSV with optional emails.
Analyse 2 paths to found identical files and hard link them to save space
Duplicate file finder and de-duplicator. A tool that detects duplicate files and replaces them with symlinks to a shared file in a special shared files folder.
Project to take two similar zipfiles, and to dedupe files that have the same tiemstamp in the older file.
File de-duplicator written in Rust.
A NiFi processor that deduplicates incoming data using an existing Redis connection pool service.
Fast video duplicate and clip finder using perceptual keyframe fingerprints
A web app that finds and removes duplicates in your Spotify playlists.
A Python pipeline that scrapes news headlines, removes duplicate stories, clusters related articles, and ranks them to produce a clean and relevant news feed.
A free tool for scanning image folders and identifying potential duplicates against a variety of user selectable criteria including Visual Similarity, Exact Hash, GPS Location, Dates & Time etc. Once identified the duplicates can be moved to a separate folder for archiving and/or deletion by the user (outside of the app)
Automatically identifies and refactors duplicate code patterns across a codebase, suggesting consolidation into reusable functions or classes
GraphQL response deduplication by mapping entities.
Utility for automatic Git repository deduplication
To associate your repository with the deduplicator topic, visit your repo's landing page and select "manage topics."