That's it. I'm adding an imagehash field to my master emoji file. Same name wouldn't work for consolidating because of how much name variance there is. Trying to match image files exactly isn't going to work either because of compression artifacts. Time to start reading up on how that works.
@o76923 i had the idea of a emoji compare software a longer time ago. Im not sure but depending on what you want this might not fit since it want to calculate a distance between two images... i used https://github.com/myint/perceptualdiff and i got, well not great results but far better results than some other stuff i found
I'm certainly open to suggestions on what might work better. The colorhash algorithm that I've been fiddling with seems to be doing an okay job so far. Or, at least, one of the algorithms in the package does. The rest are not great for this specific task.