Public Release - 2026-07-21

A higher benchmark score is not a deployment certificate.

Artifact: reward_entropy_profile_v1. This note treats a benchmark score as one procurement input, not a business outcome: transfer to the operating task, recovery after failure, retained constraints, human review cost, and failure cost remain separate review fields.

benchmark_score task_transfer failure_recovery constraint_retention human_review_cost failure_cost
Benchmark Transfer Value Profile v1 public evidence visual.

Artifact

A leaderboard position is a filter, not a purchase order.

Model rankings can narrow a candidate set, but an enterprise deploys a workflow on its own data, permissions, review capacity, and failure surface. The review object keeps the reported score separate from the evidence that the score transfers to that operating environment.

A clean test does not price recovery or review.

Transfer

A clean test does not price recovery or review.

Two models with similar benchmark scores can create different business value when one preserves constraints, exposes uncertainty, and recovers from failure with less human work. Task transfer, review cost, and failure cost therefore remain independent fields.

If failure cost is absent, the score is not decision-complete.

Review

If failure cost is absent, the score is not decision-complete.

A useful challenge should identify a missing field, an unsupported transfer claim, a hidden review burden, or a condition under which constraints fail to persist. The protocol does not certify a model, guarantee deployment value, or replace task-specific evaluation.

1

benchmark_score

The reported score, benchmark version, task split, and evaluation conditions.

2

task_transfer

The observed transfer from the benchmark task to the actual operating task and data.

3

failure_recovery

The route by which the workflow detects, contains, and recovers from a failed output.

4

constraint_retention

The constraints that remain active when the context, tool chain, or task distribution changes.

5

human_review_cost

The time and expertise required to inspect, correct, or approve the model's work.

6

failure_cost

The operational, financial, legal, or safety cost when an accepted output is wrong.