Fine-tuning OpenAI to play Minecraft

In, they “introduce a framework that abstracts Reinforcement Learning (RL) as a sequence modeling problem”. So in theory it is possible to make powerful bots for games using transformers?

I think it could be fun to build a Minecraft bot using OpenAI fine-tuned model on player network packets communication, more details here: