Fuzzy clustering to encode contextual information in artistic image classification

Abstract

Automatic art analysis comprises of utilizing diverse processing methods to classify and categorize works of art. When working with this kind of pictures, we have to take under consideration different considerations compared to classical picture handling, since works of art alter definitely depending on the creator, the scene delineated or their aesthetic fashion. This extra data improves the visual signals gotten from the images and can lead to better performance. However, this information needs to be modeled and embed alongside the visual features of the image. This is often performed utilizing deep learning models, but they are expensive to train. In this paper we utilize the Fuzzy C-Means algorithm to create a embedding strategy based on fuzzy memberships to extract relevant information from the clusters present in the contextual information. We extend an existing state-of-the-art art classification system utilizing this strategy to get a new version that presents similar results without training additional deep learning models.