Protocol
Loading…
Read before ranking.
OpenJev (Verdict) Choice queries allow at most 24 options; for 64/77/150-way tests the harness uses a sequential elimination tournament (not a single full softmax).
Laya and OpenJev public packages have no documented domain fine-tune path comparable to
onesystem.domain_adapt — the fine-tuned track is OneSystem-only.
This board does not include hosted TypeSafe Jev (API key / waitlist).
Fastino unpublished test scores are a different evaluation and are not mixed in.
Raw / zero-shot track
Released or default checkpoints. No domain fine-tune.
Loading…
Fine-tuned track
OneSystem domain checkpoints trained on each dataset’s train split only. Competitors: N/A in this harness.
Loading…