Visualization System Displaying Retrieved Images in 2-D Semantic Space

We have developed a similarity-based image re- trieval system that represents retrieved images as a scatter diagram in a semantic space. An axis of the space shows the suitabilities of a keyword assigned to the images. The suitabilities are estimated by a linear transformation of the image features of re- trieved data, and the coefficients of the transforma- tion are learned by a multiple regression analysis. The system can store multiple key-images and can retrieve images by using the center of gravity of the key-image feature vectors. The system can effective- ly assist a user in retrieving images through the use of semantic visualization and this center of gravity retrieval based on similarity. The system performs as follows. First, a user retrieves images. Then, the system presents the user with some keywords that provide large variances of the estimated suitabilities from among the retrieved results. Next, the user can choose two axes from the given keywords. Fi- nally, the system displays the retrieved images in the semantic space that is spanned by the axes. We ex- amined our method quantitatively by using a large number of samples, each of which was a pair made up of an image and its assigned keywords. tends to view as many images as possible in the us- er's effort to find targets that fulfill the user's need. Therefore a retrieval system needs to present users with many images and many variations of similarity among the images by using image visualization, and to assist the users in their trial and error search. It is the purpose of our researches. Operating from this point of view, we developed a visualization system for similarity-based image retrieval(2, 31. Although one of our svstem's functions allows a user to selec-