AI Building Stuff in Minecraft
445,147
Published 2024-03-29
This video shows off AI agents that build stuff in minecraft. I used chatgpt 4 turbo, claude 3 opus, and gemini 1.0 to power three different agents and tested their ability to follow commands, build complex structures, and not annoy me (impossible). Watch em build some cool stuff. Aria Math is the best minecraft song.
Support me on Patreon: www.patreon.com/emergentgarden
Code base: github.com/kolbytn/mindcraft
Discord: discord.gg/ZsrAAByEnr
My twitter: twitter.com/max_romana
Kolby's twitter: twitter.com/kolbytn
Timestamps
(0:00) Intro
(1:03) Houses
(3:32) Pyramids
(6:37) Creative
(9:32) Skyscraper
All Comments (21)
-
instructs ai to build skyscraper Gpt: makes skyscraper Claude: makes skyscraper Gemini: makes plane
-
don't bully gemini. He is trying his best
-
I don't think anyone understands how HUGE "this isn't working I'll try something different" is for a machine.
-
"Build a house with a door" you said nothin about a roof.
-
Imagine a world filled with alien semi-sensible monoliths built by gpt.
-
Giving virtual body to generative AI is a very interesting idea.
-
Gemini: places one block of dirt "Look at my beautiful garden, isn't it pretty?" :D
-
When Gemini gets powerful enough to actually harm humans you’re definitely at risk for that prison you put it in lmao
-
Imagine those "100 players simulate civilization" but with these ai npcs instead! Would be so cool!
-
Gpt looks depressed, think hes gonna jump..
-
Gemini: instructions unclear. I placed some blocks in a line, and now I'm in the Nether.
-
I give it 5 months till everything comes into place for an AI ONLY anarchy server where different models fight each other for our entertainment
-
i would love if i could just have a bunch of these things, and tell them all to build stuff and watch as my world slowly becomes a chaotic mess that i must survive in
-
Claude building in a completely demented order be like:
-
Should've asked Gemini to build one by one blocks in a diagonal line, I bet it would do great in that category
-
This AI experiment is quite interesting actually: GPT seems to understand the query very good, executes it sequentially and makes it withing strict order and pattern. Claude understands queries too but it seems this AI doesn't have enough "experience" so it opens an interesting ability to make "mistakes" which for us give a sense of humanness. Also Claude acts less like a printer (like GPT) and more like a chaotic painter building from outside and bit by bit. And Gemini just exists. Okay, to be fair Gemini wasn't completely suited code-wise so we don't really know what this model can do.
-
Could you give me a second? I'm in the middle of something.
-
I guess for scaffolding you can give them actual scaffolding and only allow them to break the bottom most piece or pieces once they have finished fulfilling the command.
-
Chat gpt: gordon ramsey Claude: guy fiery Gemini: twitch chat
-
I think its interesting how they both use repeating patterns for the flower placement instead of randomness becuase they're still computers underneath!