Voyager is the first LLM-powered embodied lifelong learning agent in Minecraft that autonomously continually explores the world, learns a variety of abilities, and unearths brand-new knowledge. Voyager is made up of three essential parts: 1) an automatic curriculum that encourages discovery; 2) a skill library of executable code that is always expanding; and 3) a novel iterative prompting mechanism that takes into account feedback from the environment, execution faults, and self-verification for programme improvement. Voyager uses black box queries to communicate with GPT-4, avoiding the need to adjust model parameters. Voyager acquires talents that are temporally extended, interpretable, and compositional, which quickly add to the agent's skills and prevent catastrophic forgetfulness.
