b:botstest.Submit a resource ↗

Benchmarks / Research

vla-evaluation-harness · allenai

One framework to evaluate any VLA model on any robot simulation benchmark.

policy evaluation
Publisher repository ↗
vla-evaluation-harness · allenai resource page screenshot
Resource screenshot · captured 2026-10-09 · visually reviewed

Overview

One framework to evaluate any VLA model on any robot simulation benchmark.

Compare tasks, protocols, dataset/environment versions and hardware before interpreting reported results. A benchmark repository is not a certification of a robot system.

Project information

Maintainer
allenai
Primary language
Python
Repository code license
Apache-2.0
Model-weight license
Not recorded
Dataset license
Not recorded
Hardware design license
Not recorded
Maintenance
Not archived in the last recorded metadata
Last observed repository push
2026-10-01

Code licenses do not automatically cover model weights, datasets or hardware designs. Unrecorded license details require confirmation with the publisher.

Documentation sections

  • vla-evaluation-harness
  • Latest News
  • Why vla-evaluation-harness?
  • Motivation
  • Installation
  • Quick Start

Browse this resource’s categories

Explore related collections

Browse Benchmarks →