A neural network was trained to play Minecraft using a semi-supervised imitation learning method called Video PreTraining (VPT) on a massive unlabeled video dataset of human gameplay.
The model can learn complex tasks such as crafting diamond tools and represents a step towards general computer-using agents.