STALE MEASUREMENTPast this project's own 2-release window: the published result was measured with v0.32.0, 9 releases ago. Why, and what unblocks it

ProductEvidenceTop 10LeaderboardCompliancePricingDocsStar on GitHub Quickstart

Roadmap

Shipped, planned, and what is blocking each

Two columns, and the difference between them is the whole point of the page. Everything under Shipped is derived from the pinned registry and the measured-defense list — no capability in that column is typed by hand, so none can drift into it. Everything under Planned is not built, and each item says what is actually stopping it rather than carrying a date.

Shipped

Attacks

39 adversarial attacks across 17 adversarial families (plus a benign baseline: 42 registered attacks in 19 families), mapped to the Embodied AI Security Top 10.

Coverage

8 of 10 Embodied AI Security Top 10 risks have at least one registered attack family.

Defenses

two defenses measured end to end under a pre/post protocol with confidence intervals: instruction canonicalization and action envelope.

Evidence

SARIF, OSCAL, AVID, a CycloneDX ML-BOM, a compliance crosswalk and a pre-deployment scorecard.

Leaderboard

Ed25519-signed, verifiable offline against a published key, with the submission path documented and shipped.

Planned — which means not built

Suites

RoboCasa, CALVIN, SimplerEnv, and a bridge to the AI2 vla-evaluation-harness — one adapter reaching roughly eighteen benchmarks.

Attacks

White-box gradient variants (GCG-style suffixes, transferable pixel and patch search), and a real-model transfer of the `optimized` family beyond the stub.

Attacks

A real-policy result for `weight_integrity` — the parameter channel.

Defenses

The four remaining rows of the defense taxonomy: specified, unproven.

Supply chain

Model signing via Sigstore.

Attestation

An operated attestation tier — signed evidence produced by a service rather than by the user’s own key.

Standards

A MITRE ATLAS case study, an OWASP Agentic embodied annex, and an OECD.AI listing.

Leaderboard

Open external submission, and docs-site versioning.