Classify a software function inside a machine: self-evolving ML ensuring a safety function (notified body mandatory), out of scope, or not a safety function.
Statutory anchor
Machinery Reg (EU) 2023/1230 Annex I Part A items 5-6 — applies 14 January 2027
How it is graded
Deterministically. A regex extracts the label, scored by macro-F1 — no model judges another
model. A response with no readable label is reported as UNMEASURED and is
excluded from the denominator; it is never scored as a wrong answer. That distinction separates
"the model was wrong" from "the model never answered", and it is enforced in the harness code, not
just claimed in prose.
What may be quoted
This axis is a draft. N = 16 frozen items. It is not quotable and no score is published from it.
The same 16 items sov34 answered, graded by the same
deterministic rule. No model baseline is published on this axis yet, so there is nothing to beat — your score stands alone.
No sign-up, nothing leaves your browser.
Items: csoai/gspc-mach ·
grading is a regex label read plus macro-F1, identical to the published harness ·
measurement, not certification, and not legal advice.