Template updates
LIBERO-Goal
libero-goal · benchmark template by LIBERO · 10 tasks · Franka Panda. Each version below is fixed once published, newest first.
seq init libero-goal gives the stable version, seq init libero-goal@beta the beta, and seq init libero-goal@v<N> any version below that is not withdrawn. A benchmark registered from this template names the version it runs in seq benchmark ls; seq benchmark upgrade moves it to the newer stable one.
-
LIBERO's libero_goal suite as a benchmark of its own, each task listed with its instruction.
Needs sequence-ai 0.37.0 or later.
seq init libero-goal my-libero-goal; it registers aslibero-goal, andlibero-goal-cpuon CPUs.--param eval.max_steps=Nsets how many steps an episode may take.- libero-spatial, libero-object, libero-goal and libero-10 are LIBERO's four suites, a template each.
Use v1
# start a benchmark from this version, then register it seq init libero-goal@v1 my-benchmark seq deploy my-benchmark/benchmark.py # its CPU version, on CPU machines seq deploy my-benchmark/benchmark_cpu.py # or move a benchmark registered from this template to it seq benchmark upgrade my-benchmark --to v1
In the console, New benchmark registers this version: the console registers the stable one.