A fast file deduplicator
-
Updated
Sep 4, 2023 - Rust
#
file-deduplication
Here are 13 public repositories matching this topic...
Yet Another Dupes Finder
-
Updated
Feb 6, 2025 - Rust
.NET 8 API for document file format identification, text/metadata/attachment/embedded object/sensitive item (PII/PHI)/entity extraction.
metadata sdk csharp dotnet email text extraction indexing text-extraction archive pst embedded-objects file-format-detection entity-extraction phi file-deduplication pii microsoft-office pii-detection file-identification
-
Updated
Dec 31, 2024 - C#
Case study using dotfurther's Open Discover Platform with the RavenDB document store to rapidly create a full-text search/eDiscovery/information governance capable demonstration application.
metadata text-extraction full-text full-text-search ravendb ediscovery indexing-engine file-format-detection data-breach file-deduplication pii information-governance-catalog personally-identifiable-information archive-extractor pii-detection file-identification full-text-extraction document-ingestion information-governance
-
Updated
May 28, 2024
fast duplicate file detection
fast command-line file-deduplication statically-linked duplicate-file-finder duplicate-file-detection
-
Updated
Nov 17, 2024 - C
File deduplicator
-
Updated
Apr 27, 2022 - Rust
A simple command line utility that identifies groups of identical files and displays them to the console.
-
Updated
Jan 25, 2025 - Rust
Этот проект представляет собой мощный инструмент для поиска и анализа дублирующихся файлов в указанной директории. Программа позволяет эффективно выявлять одинаковые файлы на основе их содержимого, используя алгоритм хеширования SHA-256. Она поддерживает настройку параметров, таких как минимальный размер файла для проверки и игнорирование определен
python hashing productivity multithreading data-deduplication file-system sha256 file-management system-utility cli-tool dev-tools file-deduplication file-comparison disk-cleanup command-line-utility duplicate-file-finder
-
Updated
Feb 14, 2025 - Python
Golang Deduplication Utility Library
-
Updated
Dec 29, 2017 - Go
CloneZapper is a Python script that hunts down identical files within a directory and its subdirectories, ruthlessly eliminating them!
-
Updated
Jun 1, 2024 - Python
Find duplicate files in multiple folder(s) scanning .txt or/and .torrent files and depending on the selected mode (readonly: true | false) get information about duplicated files /+ extract them into new folders
nodejs cli typescript functional-programming file-scanner inquirer fp-ts file-deduplication eslint-plugin-functional inquirer-fuzzy-path
-
Updated
Feb 21, 2025 - TypeScript
Improve this page
Add a description, image, and links to the file-deduplication topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the file-deduplication topic, visit your repo's landing page and select "manage topics."