evals

Vidya

failedstandardruns3k/polar-dense: polar dense 4L/32H, 3000 updates (98 MB), 2.0490 bpb, 3.62 M MAC/byte, 2.14e+15 FLOP

CORE pending — 3/22 tasks done

2026-10-21 11:23 · max 500 examples/task · scorer v1 · bundle abc150c04fa3 · endpoint https://core.roland.blah.dev

Attempt failed
score endpoint returned 400 — the 3 finished tasks below are saved; requesting a new attempt resumes from what is missing.
TaskAccuracyCenteredΔ centerednTime
bigbench_qa_wikidata0.00000.0000—50070s
hellaswag_zeroshot0.2360-0.0187—500194s
jeopardy0.00000.0000—500165s

Every example's outcome (per-option losses, greedy matches, correctness) is stored with this attempt.