📧 CLI to deduplicate mails from mail boxes
A command-line tool for deduplicating entries in a file or stream.
Sift duplicate whitespaces away!
CloneReaper is a high performance deduper/deduplicator for Windows, and Linux. With hardlink/symlink support, it enables you to keep files in the same place while saving space. Supports reporting in TXT, JSON, and CSV with optional emails.
Project to take two similar zipfiles, and to dedupe files that have the same tiemstamp in the older file.
Duplicate file finder and de-duplicator. A tool that detects duplicate files and replaces them with symlinks to a shared file in a special shared files folder.
Analyse 2 paths to found identical files and hard link them to save space
File de-duplicator written in Rust.
A NiFi processor that deduplicates incoming data using an existing Redis connection pool service.
Fast video duplicate and clip finder using perceptual keyframe fingerprints
A web app that finds and removes duplicates in your Spotify playlists.
A free tool for scanning image folders and identifying potential duplicates against a variety of user selectable criteria including Visual Similarity, Exact Hash, GPS Location, Dates & Time etc. Once identified the duplicates can be moved to a separate folder for archiving and/or deletion by the user (outside of the app)
A Python pipeline that scrapes news headlines, removes duplicate stories, clusters related articles, and ranks them to produce a clean and relevant news feed.
GraphQL response deduplication by mapping entities.
Automatically identifies and refactors duplicate code patterns across a codebase, suggesting consolidation into reusable functions or classes
Utility for automatic Git repository deduplication
To associate your repository with the deduplicator topic, visit your repo's landing page and select "manage topics."