Fine-tuning OpenAI to play Minecraft

In https://arxiv.org/pdf/2106.01345.pdf, they “introduce a framework that abstracts Reinforcement Learning (RL) as a sequence modeling problem”. So in theory it is possible to make powerful bots for games using transformers?

I think it could be fun to build a Minecraft bot using OpenAI fine-tuned model on player network packets communication, more details here:

2 Likes