AI Building Stuff in Minecraft

445,147
0
Published 2024-03-29
100k subscribers! Woohoo!
This video shows off AI agents that build stuff in minecraft. I used chatgpt 4 turbo, claude 3 opus, and gemini 1.0 to power three different agents and tested their ability to follow commands, build complex structures, and not annoy me (impossible). Watch em build some cool stuff. Aria Math is the best minecraft song.

Support me on Patreon: www.patreon.com/emergentgarden
Code base: github.com/kolbytn/mindcraft
Discord: discord.gg/ZsrAAByEnr
My twitter: twitter.com/max_romana
Kolby's twitter: twitter.com/kolbytn

Timestamps
(0:00) Intro
(1:03) Houses
(3:32) Pyramids
(6:37) Creative
(9:32) Skyscraper

All Comments (21)
  • @elementhokage
    instructs ai to build skyscraper Gpt: makes skyscraper Claude: makes skyscraper Gemini: makes plane
  • @reyalsregnava
    I don't think anyone understands how HUGE "this isn't working I'll try something different" is for a machine.
  • @jobobminer8843
    Imagine a world filled with alien semi-sensible monoliths built by gpt.
  • @Ormanity
    Giving virtual body to generative AI is a very interesting idea.
  • @ryttyr14
    Gemini: places one block of dirt "Look at my beautiful garden, isn't it pretty?" :D
  • @Clover298
    When Gemini gets powerful enough to actually harm humans you’re definitely at risk for that prison you put it in lmao
  • @mister_r447
    Imagine those "100 players simulate civilization" but with these ai npcs instead! Would be so cool!
  • @ThirtytwoJ
    Gpt looks depressed, think hes gonna jump..
  • @Caffin8tor
    Gemini: instructions unclear. I placed some blocks in a line, and now I'm in the Nether.
  • @dantekiwi7926
    I give it 5 months till everything comes into place for an AI ONLY anarchy server where different models fight each other for our entertainment
  • @lorddonqweetle
    i would love if i could just have a bunch of these things, and tell them all to build stuff and watch as my world slowly becomes a chaotic mess that i must survive in
  • @codybaird4811
    Should've asked Gemini to build one by one blocks in a diagonal line, I bet it would do great in that category
  • @LinteirSomeZebra
    This AI experiment is quite interesting actually: GPT seems to understand the query very good, executes it sequentially and makes it withing strict order and pattern. Claude understands queries too but it seems this AI doesn't have enough "experience" so it opens an interesting ability to make "mistakes" which for us give a sense of humanness. Also Claude acts less like a printer (like GPT) and more like a chaotic painter building from outside and bit by bit. And Gemini just exists. Okay, to be fair Gemini wasn't completely suited code-wise so we don't really know what this model can do.
  • @andonel
    I guess for scaffolding you can give them actual scaffolding and only allow them to break the bottom most piece or pieces once they have finished fulfilling the command.
  • @smlik
    Chat gpt: gordon ramsey Claude: guy fiery Gemini: twitch chat
  • @sirdumpybear
    I think its interesting how they both use repeating patterns for the flower placement instead of randomness becuase they're still computers underneath!