Skip to content
@CraftJarvis

CraftJarvis

This is the collection of our joint efforts to Craft an open-ended, multitask, generalist agent (Jarvis).

Welcome to Team CraftJarvis

At CraftJarvis, we're a passionate team committed to exploring the vast potential of AI in the dynamic, open-world environment of Minecraft. Our focus is on developing a generalist agent, an AI entity capable of mastering a wide range of tasks and challenges within this virtual world.

Publications

Here are a list of our latest publications on Open-world Agents.

  • MineStudio: A Streamlined Package for Minecraft AI Agent Development

    [Paper] [Code] [Document]

  • ROCKET-2: Steering Visuomotor Policy via Cross-View Goal Alignment

    [Website] [Paper] [Code]

  • ROCKET-1: Master Open-World Interaction with Visual-Temporal Context Prompting (CVPR 2025)

    [Website] [Paper] [Code] [Demo]

  • GROOT-2: Weakly Supervised Multi-Modal Instruction Following Agents (ICLR 2025)

    [Paper]

  • OmniJARVIS: Unified Vision-Language-Action Tokenization Enables Open-World Instruction Following Agents (NeurIPS 2024)

    [Website] [Paper]

  • GROOT: Learning to Follow Instructions by Watching Gameplay Videos (ICLR 2024)

    [Website] [Paper] [Code]

  • JARVIS-1: Open-world Multi-task Agents with Memory-Augmented Multimodal Language Models (T-PAMI 2024)

    [Website] [Paper] [Code]

  • MCU: A Task-centric Framework for Open-ended Agent Evaluation in Minecraft

    [Paper] [Code]

  • Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents (NeurIPS 2023)

    [Paper] [Code]

  • Open-World Multi-Task Control Through Goal-Aware Representation Learning and Adaptive Horizon Prediction (CVPR 2023)

    [Paper] [Code]

Popular repositories Loading

  1. JARVIS-1 JARVIS-1 Public

    JARVIS-1: Open-world Multi-task Agents with Memory-Augmented Multimodal Language Models

    Java 361 18

  2. MC-Planner MC-Planner Public

    Implementation of "Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents"

    Python 270 22

  3. RAT RAT Public

    Implementation of "RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generation".

    Python 226 24

  4. MineStudio MineStudio Public

    MineStudio: A Streamlined Package for Minecraft AI Agent Development

    Python 205 9

  5. GROOT GROOT Public

    GROOT: Learning to Follow Instructions by Watching Gameplay Videos

    Java 64 2

  6. MC-Controller MC-Controller Public

    Implementation of "Open-World Multi-Task Control Through Goal-Aware Representation Learning and Adaptive Horizon Prediction"

    Python 46 3

Repositories

Showing 10 of 17 repositories
  • ROCKET-2 Public

    Official Implementation of Paper "ROCKET-2: Steering Visuomotor Policy via Cross-View Goal Alignment"

    CraftJarvis/ROCKET-2’s past year of commit activity
    14 0 0 0 Updated Mar 19, 2025
  • MineStudio Public

    MineStudio: A Streamlined Package for Minecraft AI Agent Development

    CraftJarvis/MineStudio’s past year of commit activity
    Python 205 MIT 9 1 0 Updated Mar 18, 2025
  • CraftJarvis/SkillDiscovery’s past year of commit activity
    Python 2 MIT 0 0 0 Updated Mar 18, 2025
  • .github Public
    CraftJarvis/.github’s past year of commit activity
    1 0 0 0 Updated Mar 8, 2025
  • webchat Public
    CraftJarvis/webchat’s past year of commit activity
    Python 0 0 0 0 Updated Mar 6, 2025
  • ROCKET-1 Public
    CraftJarvis/ROCKET-1’s past year of commit activity
    Java 37 0 0 0 Updated Feb 28, 2025
  • CraftJarvis/ReasoningBench’s past year of commit activity
    0 0 0 0 Updated Dec 24, 2024
  • CraftJarvis/craftjarvis.github.io’s past year of commit activity
    HTML 1 MIT 0 0 0 Updated Dec 18, 2024
  • OmniJARVIS Public
    CraftJarvis/OmniJARVIS’s past year of commit activity
    27 1 1 0 Updated Jun 25, 2024
  • RAT Public

    Implementation of "RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Horizon Generation".

    CraftJarvis/RAT’s past year of commit activity
    Python 226 24 7 0 Updated May 28, 2024