Skip to main content

Documentation Index

Fetch the complete documentation index at: https://mintlify.com/NVIDIA/Isaac-GR00T/llms.txt

Use this file to discover all available pages before exploring further.

RoboCasa is a large-scale simulation framework for training robots to perform everyday kitchen tasks. It features realistic environments with over 2,500 3D assets and 100 diverse manipulation tasks using the Panda robot with Omron gripper. For more information, see the RoboCasa website.

​
Benchmark results

Checkpoint: nvidia/GR00T-N1.6-3B (zero-shot evaluation)
TaskSuccess rate
CoffeeSetupMug31.0%
CoffeeServeMug63.5%
CoffeePressButton98.5%
OpenSingleDoor81.5%
OpenDoubleDoor39.0%
CloseSingleDoor96.0%
CloseDoubleDoor88.5%
OpenDrawer81.1%
CloseDrawer100.0%
TurnOnMicrowave91.5%
TurnOffMicrowave96.0%
PnPCounterToCab47.5%
PnPCabToCounter41.0%
PnPCounterToSink46.0%
PnPSinkToCounter50.0%
PnPCounterToMicrowave19.0%
PnPMicrowaveToCounter24.5%
PnPCounterToStove63.2%
PnPStoveToCounter54.5%
TurnOnSinkFaucet89.0%
TurnOffSinkFaucet93.5%
TurnSinkSpout87.0%
TurnOnStove76.5%
TurnOffStove31.0%
Average66.22%

​
Evaluation

​
Setup environment

Install the required dependencies (only needs to be done once): 
sudo apt update
sudo apt install libegl1-mesa-dev libglu1-mesa
bash gr00t/eval/sim/robocasa/setup_RoboCasa.sh

​
Run evaluation

1

Start policy server

In Terminal 1:
uv run python gr00t/eval/run_gr00t_server.py \
    --model-path nvidia/GR00T-N1.6-3B \
    --embodiment-tag ROBOCASA_PANDA_OMRON \
    --use-sim-policy-wrapper
2

Start evaluation client

In Terminal 2:
gr00t/eval/sim/robocasa/robocasa_uv/.venv/bin/python gr00t/eval/rollout_policy.py \
    --n_episodes 10 \
    --policy_client_host 127.0.0.1 \
    --policy_client_port 5555 \
    --max_episode_steps=720 \
    --env_name robocasa_panda_omron/OpenDrawer_PandaOmron_Env \
    --n_action_steps 8 \
    --n_envs 5

​
Available tasks

All tasks use the robocasa_panda_omron/ prefix with _PandaOmron_Env suffix:

​
Coffee station tasks

  • CoffeeSetupMug_PandaOmron_Env - Set up mug for coffee
  • CoffeeServeMug_PandaOmron_Env - Serve coffee in mug
  • CoffeePressButton_PandaOmron_Env - Press coffee machine button

​
Door and drawer tasks

  • OpenSingleDoor_PandaOmron_Env - Open single cabinet door
  • OpenDoubleDoor_PandaOmron_Env - Open double cabinet doors
  • CloseSingleDoor_PandaOmron_Env - Close single cabinet door
  • CloseDoubleDoor_PandaOmron_Env - Close double cabinet doors
  • OpenDrawer_PandaOmron_Env - Open drawer
  • CloseDrawer_PandaOmron_Env - Close drawer

​
Appliance tasks

  • TurnOnMicrowave_PandaOmron_Env - Turn on microwave
  • TurnOffMicrowave_PandaOmron_Env - Turn off microwave
  • TurnOnSinkFaucet_PandaOmron_Env - Turn on faucet
  • TurnOffSinkFaucet_PandaOmron_Env - Turn off faucet
  • TurnSinkSpout_PandaOmron_Env - Rotate sink spout
  • TurnOnStove_PandaOmron_Env - Turn on stove burner
  • TurnOffStove_PandaOmron_Env - Turn off stove burner

​
Pick and place tasks

  • PnPCounterToCab_PandaOmron_Env - Counter to cabinet
  • PnPCabToCounter_PandaOmron_Env - Cabinet to counter
  • PnPCounterToSink_PandaOmron_Env - Counter to sink
  • PnPSinkToCounter_PandaOmron_Env - Sink to counter
  • PnPCounterToMicrowave_PandaOmron_Env - Counter to microwave
  • PnPMicrowaveToCounter_PandaOmron_Env - Microwave to counter
  • PnPCounterToStove_PandaOmron_Env - Counter to stove
  • PnPStoveToCounter_PandaOmron_Env - Stove to counter

Build docs developers (and LLMs) love

Get started for freeTalk to us