openparadox — Open infrastructure for verifiable model engineering
open research · tooling · protocols

Open infrastructure for verifiable model engineering.

Tools, protocols and public records for knowing what a model is, how it was produced, which checks it has passed, and whether a result reproduces.

This record is an illustrative example. No public evidence records have been published yet.

evidence instrumentEVR-0007example recordillustrative
subject example/clause-ner-1.3b@4e7a10checks 2 passed · 1 partial · 2 not runreproduction 1 recorded
identityrev 4e7a10
digest
sha256:4e7a10c2…9b1f
parent
3b19f0aa
format
safetensors · 2.61 GB

The field is generated from the digest. It identifies this revision and says nothing about its quality.

provenanceselect a record to trace it
checks5 named
  • harness integrityevalkit spec hash matches
    passed
  • data lineagedataset digest recorded at run start
    passed
  • re-run tolerance2 of 3 within ±0.5 pts
    partial
  • contamination scanoverlap not measured
    not run
  • independent reproductionno third-party record
    not run
limitations3
  1. English-language commercial contracts only.
  2. One evaluation suite; no human review of errors.
  3. Applies to revision 4e7a10 and no other checkpoint.
op reproduce EVR-0007 --seed 5last reproduction · within tolerance
evidence

A result is only as good as its record

An evidence record states what a model is, how it was produced, which named checks it passed, which were not run, and how to reproduce the result. The format is being drafted in the open. No public records have been published yet.

identity
The exact revision, its digest and its parent, with a fingerprint that identifies it and nothing more.
provenance
The datasets, code, runs and evaluations that produced it, as a graph you can trace in either direction.
checks
Named checks with their states: passed, partial, failed or not run. Checks that were skipped stay on the record.
limitations
Where the result applies and where it does not, in plain sentences.
reproduction
The inputs and command to re-run it, and every attempt compared with the original within a stated tolerance.
open stack

Tooling, protocols and research

Each part is listed with its real status. Nothing below has a public release yet; items move from planned to published when there is something to link to.

componentwhat it isstatus
evidence record formatA schema for identity, provenance, named checks, limitations and reproductions.drafting
protocolsA shared vocabulary for model revisions, runs, evaluations, artifacts and lineage.drafting
reproduction toolingRe-runs a record from its inputs and compares the result with the original.planned
research notesWrite-ups published together with the evidence records behind them.planned
model programme

Specialist models, planned in the open

None of these models has been trained or released. Each row lists what will be published with it, and every item starts as not yet available. el-x, the agent and interface on top of openparadox, is not yet public.

namestatusweightstraining recordevidence recordsreproduction recipe
op-4bplannednot yetnot yetnonenot yet
op-7bplannednot yetnot yetnonenot yet
op-14bplannednot yetnot yetnonenot yet
el-xnot yet publicnot applicablenot applicablenonenot applicable