AI agents build various things in minecraft

Interesting little video…

In this video, I use AI agents powered by different large language models to build various things in minecraft. It is a test of their ability to code, create, follow instructions, and problem solve. They blow up some tnt and build ruins in a false world.

4 Likes

Interesting take on the whole AI+Minecraft idea, although this would have been a lot better with litematica and carpet integration :sweat_smile:

1 Like

Yeah, I’ve not done any interfacing like that, but it sounds cool.

You’re saying there’s better methods?

2 Likes

Yes absolutely, creating a full litematica and carpet integration would require a bit more work, and fake-players from carpet might not be the best tool for the job, I’d probably add something that uses A* pathfinding as well :laughing:

1 Like

Yeah, I’ve not dug into what tools they’re using to make those videos, but I thought they were interesting.

2 Likes

Yeah, definitely interesting, but I’m pretty sure the minecraft community thinks of this a cheating tbh :sweat_smile:

copypasta about cheating

You cheated not only the game, but yourself. You didn’t grow. You didn’t improve. You took a shortcut and gained nothing. You experienced a hollow victory. Nothing was risked and nothing was gained. It’s sad that you don’t know the difference. – Fetusberry

Yeah, I’m not rich in MineCraft culture lol… I think it was meant for fun/experimenting rather than “official minecraft playing”?

I was just interested in LLMs being able to do ANYTHING in Minecraft haha… Gemini was the worst apparently…

2 Likes

Yeah, he even used creative mode which makes the whole thing much easier, these bots would likely have a lot of trouble in survival mode (how most people play the game)

fun is the the actual purpose of playing the game in the fist place, so using AI seems a bit counterproductive to that goal :sweat_smile:

1 Like

Ah, I gotcha. I don’t think he was trying to replace playing the game but rather see how the bots did? A little different than something competitive like Starcraft, DotA, etc. I’m sure it was fun for his AI-centric mind. :wink:

2 Likes

Fair point, I checked his other videos, and they also seems more focused on AI rather than minecraft :laughing:

1 Like

This is really impressive

2 Likes

On Skyrim adding the AI is also pretty fun , makes allot npcs allot more interesting. Eventually allot games probably will use AI in several things

1 Like

There is a version of Minecraft that Mojang made for the Raspberry Pi that has built-in Python programmability for Player/Blocks. Sometime I am going to hook it up with GPT and give it complete control over everything and see what happens.

2 Likes

Oh man please don’t do that to yourself :sweat_smile:

Minecraft PI Edition is really old, underdeveloped and built on MCPE, the python API doesn’t cover what you want to do and the mappings for MCPE are proprietary :sweat_smile:

1 Like

I know it’s old, I am a better fan of it then regular Minecraft :laughing:. I have programmed stuff in it before and I think it would be a fun challenge.

1 Like