Check out https://voyager.minedojo.org/, which uses a LLM to play Minecraft.