"duplicates.zip" is a folder that contains five unique cat images, four unique dog images, and overall 16 images (including seven duplicates images). These duplicates images are generated by varying dimensions, intensity, and color of existing unique photos.
colab$ !unzip "/content/duplicates.zip" colab$ ls -l duplicates/*.jpg duplicates/*.png | wc -l #count total image files with .jpg and .pngExecute the duplicate_images_remover.py with required command line arguments folder_path, hamming distance as threshold and details printing as True/False
colab$ %run duplicate_images_remover.py -f /content/duplicates -t 2 -i false
One may also explore the Structural Similarity Index (https://scikit-image.org/docs/dev/auto_examples/transform/plot_ssim.html#sphx-glr-auto-examples-transform-plot-ssim-py)