fclones

Find duplicate files

$ fclones group [directory]

$ fclones group [directory] | fclones remove

$ fclones group --depth [2] [directory]

$ fclones group [directory] --format fdupes

$ fclones group [directory] | fclones move [trash_dir]

fclones command [options] [paths...]

fclones is a high-performance duplicate file finder written in Rust. It uses multiple algorithms including hash-based comparison and parallel processing for fast scanning of large file systems.
The tool works in two phases: finding duplicates with 'group' and acting on them with remove, link, or move. Output can be piped between commands or saved for review before action.
fclones optimizes for speed with techniques like partial hashing, caching, and SIMD acceleration.

COMMAND

Operation: group, remove, link, move.

Directories or files to scan.

Maximum directory depth.

Minimum file size.

Maximum file size.

Output format: default, fdupes, csv, json.

Follow symbolic links.

Number of threads.

Display help information.

Requires careful review before removal. Hard linking changes all copies. Large directories may use significant memory.

fclones was created as a modern alternative to tools like fdupes, emphasizing performance through Rust's speed and memory safety. It achieves significant speedups through parallelism and optimized hashing.

fdupes(1), rmlint(1), jdupes(1)