Image Retrieval 2.0

Filip Radenovic
(Center for Machine Perception, CTU Prague, Czech Republic)


In the talk, I will address the topic of image retrieval. In particular, I will focus on retrieval methods based on bag of words image representation that exploit geometric constrains. Novel formulations of image retrieval problem will be discussed, showing that the classical ranking of images based on similarity addresses only one of possible user requirements. Retrieval methods efficiently solving the new formulations by exploiting geometric constraints will be used in different scenarios. These include online browsing of image collections, image analysis based on large collections of photographs, or model construction.

For online browsing, I will show queries that try to answer question such as: "What is this?" (zoom in at a detail), "Where is that?" (zoom-out to larger visual context), or "What is to the left / right of this?". For image analysis, two novel problems straddling the boundary between image retrieval and data mining are formulated: for every pixel in the query image, (i) find the database image with the maximum resolution depicting the pixel and (ii) find the frequency with which it is photographed in detail.