molina/how-to-read.md

docs

How to read a result

Every record says what it shows and what it does not show, and gives the conditions where they fit. No result is above the lowest level of claim, MIGHT: it was seen in these runs, and nothing more is claimed. A result marked UNRATED is below it: the record cannot say how it was produced, and it cannot stand as a claim.

The words on a record

  • Exact mode runs a world so that, for one seed, the files it writes can be compared byte for byte with another run's. A replay is a further run of the same compose file, faults, seed and length.
  • MIGHT is a rung of what a result may claim: it was seen or tried, evidence exists, and nothing is established. Screening means the record does not show that the run met the claim conditions, the strict conditions a run must meet before I say what it would do. Those conditions include a core of its own for each world, a restore from a snapshot with no boot, no run set aside or made again, and a recorded build. A committed-tree ledger PASS is a PASS row in the evidence ledger for a run made from a tree with no uncommitted changes. The hypervisor is Molina's own program that runs each world as a virtual machine. A gate is a program in the repository that runs an experiment and prints a verdict. The saved output a result cites is what one printed. A counted stop halts a world at an exact number of instructions. The hypervisor can refuse one, and a run with a refused stop is set aside: it is thrown away and made again. The world farm is the part of the hypervisor's tooling that gives each world cores reserved for it.
  • A frame is one network packet sent from one node to another on the virtual network, and the switch is the part of the hypervisor that carries frames between worlds and numbers them. A cut frame is one dropped because the link between the nodes was cut.
  • To shrink a set of faults is to take parts out of it for as long as the failure still happens. A re-run is a further run of the shrunk set, made to see that it still fails.
:SageTech --ready