How do search engines compare a submitted photo to all others in their database? Well this is an interesting, and not so easy to answer question.

reverse image search Technology Algorithms Research

Reverse image search technology is all about image processing and classification algorithms, of course.

So there are many different approaches towards this, and honestly, I cannot tell you which one is currently used by which search engine. I can only list here approaches that have most probably been used by reverse image search technology:

  • SIFT
    SIFT (scale invariant feature transform) features are very suitable to recognize similar pictures. They are invariant to size and location.
  • SURF
    SURF (speeded up robust features) features basically speed up the SIFT technology by replacing the Gaussian filters of SIFT.


What Search Engines reveal

Now and then there is some insight into what certain reverse image search engines are really doing. I will list any of those links here:


Google Research

To find out which technology is really used by giant search engine Google, one should have an eye on their submitted patents. And they are very actively submitting new patents. Here is a list of the latest most important granted patents:


Please contribute to find more Details. Send me a note!