Skip to content

Expand LIBERO-CF-Mini initial-state coverage #10

Description

@myheart521

Why

LIBERO-CF-Mini v0.1 covers four task families but only init state 0 in each family. This is enough for a pilot, not paper-level variation.

Scope

Add a bounded second initial state for each existing task family without changing the current v0.1 evidence.

Acceptance criteria

  • Propose a versioned manifest change and explain compatibility.
  • Pin every BDDL and init-state source hash.
  • Preserve exact snapshot restore, repeated no-op, and forward/reverse branch-order checks.
  • Generate or convert artifacts with resume-safe content addressing.
  • Update the benchmark card with coverage, runtime, licenses, and limitations.
  • Add tests for invalid hashes, restore mismatch, and branch-order dependence.
  • Run one smallest-task smoke before a full GPU run.

Non-goals

This is not a LIBERO policy leaderboard and does not claim task success. Generated RGB/state bundles and upstream assets stay outside Git.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:benchmarkBenchmark data or protocolhelp wantedExtra attention is needed

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions