This repository contains code and references for two distinct models:
- Verdict (the 151M model evaluated on JevBench): General-purpose decision model based on ModernBERT-base and GLiClass. The public checkpoint is hosted at heman10x/rlcd-modernbert-151m, now updated to v1.4 via inference engine fixes.
- Verdict 2.0: Specialized architecture for typed software workflows evaluated on
LocalLLaMA/typed-decisions. The model weights are currently tracked via Git LFS pointers inartifacts/verdict2-base/model.pt. The benchmark numbers reported in the breakthrough section below were produced directly byverdict2/evaluate.pyagainst its audited test receipt (reports/verdict2_base_test.json).
These are inference fixes, not a retrain. The weights are byte-identical to the published checkpoint. Measured on the 231 public JevBench tasks.
The update addresses three defects in the inference engine:
- Calibrator auto-loading and removal of the 5-option scope restriction: The engine previously failed to load
calibrator.jsonduring standalone instantiation, running at uncalibrated temperature 1.0. A scope check also limited calibration exclusively to 5-candidate queries, leaving other cardinalities unscaled. The engine now loads calibrated temperatures automatically and scales across all supported candidate counts. - NLI sentence templating for candidate labels: Candidate labels were previously evaluated as bare noun phrases. Because the underlying GLiClass backbone descends from natural language inference (NLI) formulations that expect hypothesis sentences, formatting candidates with hypothesis framing (
It is {description}) aligns inputs with pretrained representations and lifts accuracy. - Context budget cut from 1024 to 512 tokens: The model weights were trained on context states under 71 tokens. Reducing the maximum token budget from 1024 to 512 tokens avoids out-of-distribution positional drift while preserving complete task contexts.

