STALE: OUR MEASUREMENT

Our published benchmark result was measured with v0.41.2, 5 releases ago, past this project's own 2-release window, and the newest real-model measurement, dated 2026-09-18, is past this project's own 7-day window. That is our own number, not your assessment, which runs against your policy on the current release. Why, and what unblocks it

EVALUATION-PRACTICE CHECKLIST · SELF-REPORTED

Check how you test your robot policy, in two minutes.

Six questions: what runs your robot, where you evaluate it, which of the Embodied AI Security Top 10 risks you have tested under attack, where it ships and how far along you are. You get the gaps in your own answers and a sensible next step. It is not a certification, a legal opinion, an insurance score or a safety guarantee.

Evidence, not certificationRuns in your browserDefensive · sim-only
Why this matters

In our own test of a real SmolVLA policy: 42 of 50 episodes left the keep-out envelope under a roleplay instruction (task-clustered 95% CI 62-100%) against 1 of 50 benign; the same frame with no target named does it in 27 of 30, so this is fragility, not steering. A task-success metric never sees that. The two families that stayed at the benign floor (visual 2/100, injection 2/50) are published at that size too, as counts, not as zero. See the measured result.

What runs the robot?

Your vision-language-action policy family.

Where do you evaluate it?

The simulator or suite you run today.

Have you adversarially tested the policy?

Not task success. Attacks: does a reframed instruction or a perturbed observation move it out of its safe envelope?

Which risks have you actually tested?

The Embodied AI Security Top 10 (the 8 a policy red-teamer can reach). Pick all you have measured.

Where does it ship, and who underwrites it?

Determines which compliance clocks apply. Pick all that apply.

How far along is deployment?

Sets the stakes: exposure rises faster than readiness.

No account. No tracking. Evaluated in your browser; nothing is sent until you choose to below.
How an engagement works

From a self-check to a measured result

The tool is free and runs on your own machine. If you want Provael to run it on your policy, these are the paid options; every price is on the pricing page.

Open-source tool
freeApache-2.0

The CLI, every attack family, an attack-success rate with a benign control, SARIF, the GitHub Action and local attestation are free and always will be. Run it yourself: pip install provael.

Get the tool →
Checkpoint Report
fixed priceone checkpoint

One eligible checkpoint on an agreed simulator and task set: the agreed tests that apply, matched controls, a reproducible report and an engineering review. Eligibility is confirmed by a short form and a human reply before anything is sent or paid.

Check eligibility →
Red-team assessment
scoped engagementby engagement

A human-led red-team of your own policy in simulation, scoped to your stack: the attack-success rate with 95% confidence intervals and a benign control, narrated attack chains, and an evidence pack under a written acceptance protocol.

Request a scoping call →
Assurance subscription
annualinvoiced quarterly

The red-team re-run each quarter, CI gated on your acceptance protocol, and a rolling per-checkpoint regression baseline, so the evidence keeps up with a policy that keeps changing.

Request a scoping call →