Keyboard shortcuts

Press or to navigate between chapters

Press S or / to search in the book

Press ? to show this help

Press Esc to hide this help

What the instrument touches

You should not have to read the source to decide whether this tool is safe to run. This page says what each command reaches, and how to verify the binary before running anything.

Verify the binary first

Every release binary carries a Sigstore attestation. One command proves the exact bytes came out of this repository’s build workflow:

gh attestation verify veredictum-<tag>-<target>.tar.gz \
    -R rubentalstra/Veredictum \
    --signer-workflow rubentalstra/Veredictum/.github/workflows/release-build.yml

If that check fails, do not run the file.

What each command reaches

  • bench sends HTTP requests to the base URL you give it, and writes into the --out directory you give it. Nothing else. The packs are compiled into the binary, so it fetches nothing; the credential is read from an environment variable and never rides argv; there is no telemetry and no other network destination. With --with-baselines it additionally drives your local docker CLI to pull and run the two pinned reference images (from ghcr.io and Docker Hub) on loopback ports, and removes them when done.
  • run sends requests to the endpoints your own IXIT file declares, reads the catalogue and spec paths you pass, and writes into --out. It creates and deletes data on the target, which is why you point it at a test system.
  • validate, verdicts, verify-record, bench-compare, the asset renderers are offline: they read the paths you pass and write where you say. No network at all.
  • The console image binds loopback by default, has no login, and reaches a CDR only through the runs you start in it.

bench warns once when a credential would ride plain http to a host that is not loopback.

The record does not depend on trusting the operator

A published conformance reproduction is attested by the workflow that produced it, and a bench record embeds the histograms its summary is re-derived from, so both are checkable after the fact. The registry rules (registry/RULES.md) carry the details.