ChatGPT-based program nails Minecraft

Artificial intelligence has taken a step into the gaming world with Voyager, a large-language model (LLM) that uses ChatGPT-4 to play Minecraft — and pretty well at that, say its designers.

“We introduce Voyager, the first LLM-powered embodied lifelong learning agent in Minecraft that continuously explores the world, acquires diverse skills, and makes novel discoveries without human intervention,” said researchers, who posted their findings on free open-access archive service Arxiv on May 25th.

Cybernews took a look at demos of Voyager in action, and it does appear that the AI program can play the game quite handily, mining gold and amethysts, hunting pigs, and gathering cacti.

To do this, it keys off three core components: an automated curriculum that maximizes the LLM’s ability to explore the Minecraft world, a “skill library” that allows it to store and retrieve complex behaviors mimicking a human player, and a prompting mechanism that enables the program to improve itself in response to its virtual environment.

It does this while interacting with ChatGPT-4 and querying it for solutions, which allows it to function autonomously without further human input.

“Voyager shows strong in-context lifelong learning capability and exhibits exceptional proficiency in playing Minecraft,” said the research team. “Is this a great example of GPT-4’s ability to improve? Absolutely. Does it take the fun away from Minecraft? We’ll leave that up to you.”

More from Cybernews:

Reclaiming privacy: the Cap_able way

Twitter quits EU’s voluntary disinformation pact

MCNA Dental breach exposed nearly 9M people

Colombian government targeted by suspected cyber partisans

Deep dive into AI companions

Subscribe to our newsletter