AI agents build various things in minecraft

Interesting little video…

In this video, I use AI agents powered by different large language models to build various things in minecraft. It is a test of their ability to code, create, follow instructions, and problem solve. They blow up some tnt and build ruins in a false world.

Interesting take on the whole AI+Minecraft idea, although this would have been a lot better with litematica and carpet integration :sweat_smile:

Yeah, I’ve not done any interfacing like that, but it sounds cool.

You’re saying there’s better methods?

Yes absolutely, creating a full litematica and carpet integration would require a bit more work, and fake-players from carpet might not be the best tool for the job, I’d probably add something that uses A* pathfinding as well :laughing:

Yeah, I’ve not dug into what tools they’re using to make those videos, but I thought they were interesting.

Yeah, definitely interesting, but I’m pretty sure the minecraft community thinks of this a cheating tbh :sweat_smile:

copypasta about cheating

You cheated not only the game, but yourself. You didn’t grow. You didn’t improve. You took a shortcut and gained nothing. You experienced a hollow victory. Nothing was risked and nothing was gained. It’s sad that you don’t know the difference. – Fetusberry

Yeah, I’m not rich in MineCraft culture lol… I think it was meant for fun/experimenting rather than “official minecraft playing”?

I was just interested in LLMs being able to do ANYTHING in Minecraft haha… Gemini was the worst apparently…

Yeah, he even used creative mode which makes the whole thing much easier, these bots would likely have a lot of trouble in survival mode (how most people play the game)

fun is the the actual purpose of playing the game in the fist place, so using AI seems a bit counterproductive to that goal :sweat_smile:

Ah, I gotcha. I don’t think he was trying to replace playing the game but rather see how the bots did? A little different than something competitive like Starcraft, DotA, etc. I’m sure it was fun for his AI-centric mind. :wink:

Fair point, I checked his other videos, and they also seems more focused on AI rather than minecraft :laughing:

This is really impressive

On Skyrim adding the AI is also pretty fun , makes allot npcs allot more interesting. Eventually allot games probably will use AI in several things

There is a version of Minecraft that Mojang made for the Raspberry Pi that has built-in Python programmability for Player/Blocks. Sometime I am going to hook it up with GPT and give it complete control over everything and see what happens.

Oh man please don’t do that to yourself :sweat_smile:

Minecraft PI Edition is really old, underdeveloped and built on MCPE, the python API doesn’t cover what you want to do and the mappings for MCPE are proprietary :sweat_smile:

I know it’s old, I am a better fan of it then regular Minecraft :laughing:. I have programmed stuff in it before and I think it would be a fun challenge.