Post
294
On-Fly-Jev is up: Quazim0t0/On-Fly-Jev
Second Jev-style model. First was Byrne-Jev (70M SpikeWhale). This one is a 96M spiking trunk - every unit is a copy of one of 100 real MaleCNS fly neurons - plus a typed-decision head. One forward pass. No generated text.
I built it for speed.
Typed-decisions test split, 400 cases, 2,000 decisions, 5 questions per case, local GPU:
• 7.3 ms p50 per decision (~137 / s)
• 36.6 ms p50 / 53.5 ms p95 per case of 5
• ~27 cases / s
Same protocol vs the others:
• On-Fly-Jev: 36.6 ms / case, ~137 decisions / s
• Byrne-Jev: 110.7 ms / case, ~45 / s
• ModernBERT-base: 349 ms / case, ~14 / s
• TypeSafe Jev 1.13 (hosted, so network is in it): 710 ms / case, ~7 / s
About 3x Byrne-Jev, 9.5x ModernBERT, 19x TypeSafe Jev per case.
Live ViZDoom, 1 question per tick including game I/O: 23.4 ms (~43 / s).
• Accuracy 0.666 (Byrne-Jev 0.630, Jev 1.13 0.727)
• ECE 0.045, same as Byrne-Jev, about a third of Jev 1.13
50/50 merge of two checkpoints from one run. Research artifact, not a chatbot. More videos are on the card.
Second Jev-style model. First was Byrne-Jev (70M SpikeWhale). This one is a 96M spiking trunk - every unit is a copy of one of 100 real MaleCNS fly neurons - plus a typed-decision head. One forward pass. No generated text.
I built it for speed.
Typed-decisions test split, 400 cases, 2,000 decisions, 5 questions per case, local GPU:
• 7.3 ms p50 per decision (~137 / s)
• 36.6 ms p50 / 53.5 ms p95 per case of 5
• ~27 cases / s
Same protocol vs the others:
• On-Fly-Jev: 36.6 ms / case, ~137 decisions / s
• Byrne-Jev: 110.7 ms / case, ~45 / s
• ModernBERT-base: 349 ms / case, ~14 / s
• TypeSafe Jev 1.13 (hosted, so network is in it): 710 ms / case, ~7 / s
About 3x Byrne-Jev, 9.5x ModernBERT, 19x TypeSafe Jev per case.
Live ViZDoom, 1 question per tick including game I/O: 23.4 ms (~43 / s).
• Accuracy 0.666 (Byrne-Jev 0.630, Jev 1.13 0.727)
• ECE 0.045, same as Byrne-Jev, about a third of Jev 1.13
50/50 merge of two checkpoints from one run. Research artifact, not a chatbot. More videos are on the card.