Day 2 - Image classification of museum artefact

Example of artefacts from the Museum Art Medium (MAMe) dataset you will be working on</a>

Table of contents

  1. Introduction
  2. Dataset

Introduction

In our second day, you will be asked to train an image classifier to classify images of museum artefacts.

Your goal will be to recognize the artistic medium of the artefact in the image.

Please download the code and data from the github repository and follow the instructions in the A1_image_classification_of_museum_artefacts.

Github repository of the course

Dataset

To train your machine learning image classifier, you will use the Museum Art Medium (MAMe) dataset, that contains high and low resolution images of artefacts from:

  • The Metropolitan Museum of Art of New York
  • The Los Angeles County Museum of Art
  • The Cleveland Museum of Art

The dataset is available at MAMe dataset and includes:

  • Artefact images: ~37,000 in both high and low resolution (224x224 pixels)
  • Metadata (MAMe_dataset.csv): the museum provenance, the widht, height, product size, and aspect ratio.
  • The artistic medium (MAMe_labels.csv): 29 categories of artistic medium (i.e. materials and techniques), such as “oil on canvas”, “painting”, “photograph”, “ceramic”, etc.

In addition, we provide the file data/MAMe_dataset_extended.csv, which is similar to MAMe_dataset.csv but we added an extra column that contains the MobileNetV1 features for each image. MobileNetV1 is a generalist and pre-trained neural network specialized to extract visual features. It has been trained on 1000 categories of images from the ImageNet dataset.

**Assignment**: Your goal is to train the most accurate model to predict the medium of an museum artefact. Beside vision-related data, you are allowed to use the dimension of the object (width, height etc.) in your features. You must document all steps of the development cycle: data collection, data processing, feature selection, training, and evaluation.
  • Figures are encouraged and should be commented and interpreted
  • Every choice must be discussed and explained

Back to top

Logo HM Logo MUC.DAI Logo HMTM Logo Wavelab Logo BIDT