Skip to content

installgentoo/dupefinder_advanced

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

7 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

dupefinder 2 electric boogaloo

Finds duplicate images from blockhash list

Very useful and much faster than the alternatives that i googled about 40 times faster than geeqie on truly large filesets. Compile this; download and compile C blockhash from http://blockhash.io.

Run blockhash with find . -regextype posix-egrep -regex ".*\.(png|jpe?g)$" -type f -printf '"%p"\n' | xargs -n1 -IF -P8 blockhash F >> hashes on your files.

Then run this program on hashes list, redirect output into a file and you'll get list of duplicates separated by newlines. You can bash then your way around the list, for example move all found files into something like dedup functionality in geeqie, and delete copies manually.