MMR-Benchv1.0

External Calculation Oracle 0.9

No source outranks the others.

The protocol refuses to declare a permanent winner among cache, evaluator, and external engine. It classifies how the three relate, and lets the classification decide what may happen next.

Evidence model

For a formula cell c, the protocol holds three readings.

K(c)
The stored OOXML cache — what the last writing application left in the file.
M(c)
The bounded MMR result, computed under an AST whitelist.
E(c)
The independent external-engine result.

There is no permanent global ordering such as E > M > K. That ordering would be a policy dressed as a fact.

The nine classifications

Every formula cell lands in exactly one of these.

ClassificationRelationWhat it authorizes
three_way_agreementK = M = ENothing to do.
cache_stale_engines_agreeM = E ≠ KCache invalidation, in a separate safe copy.
cache_missing_engines_agreeK = ∅, M = ENothing to do.
external_only_cache_agreesM unsupported, K = ENothing to do.
mmr_semantic_gapK = E ≠ MReview only.
external_semantic_gapK = M ≠ EReview only.
external_date_system_gapdate system conflicts with EReview only.
error_agreementall sources give one error classNothing to do.
engine_disagreement_reviewno safe consensusReview only.

Write policy

Of the nine, one classification opens a write — and even that write goes to a separate safe copy, and touches a cached value rather than a formula.

authorized

cache_stale_engines_agree may authorize cache invalidation in a separate safe copy.

never

It does not authorize a formula rewrite. All semantic engine gaps and date-system gaps are review-only.

Structured-reference bridge

The external engine cannot parse Table[Column] formulas directly. The bridge expands structured references into equivalent A1 ranges while keeping defined names intact, and logs every transformed formula.

review only

Normalization success is not treated as direct syntax support.

Engine manifest

Each result records the conditions it was produced under, so a later replay can tell a genuine gap from a changed environment.

  • Engine and version.
  • Python version and platform.
  • Locale and decimal separator.
  • Timezone.
  • Workbook date system.
  • Workbook calculation mode.
  • Whether normalization was required, and how many times.
What the external engine is

An independent implementation, written by other people, with its own bugs and its own coverage.

what it is not

Microsoft Excel. Agreement with it does not establish universal Excel compatibility.