Back to explore

lifesim-social-1 vs OpenAI Decisions:Jevモデルのベンチマーク

Cris Lenta氏が公開したベンチマーク結果:lifesim-social-1はソーシャル意思決定で精度88%、レイテンシ102ms、較正誤差0.047を達成し、OpenAI Decisions APIを上回る。

we beat OpenAI's Decisions API 24h after it launched it's Jev competitor lifesim-social-1 vs OpenAI Decisions on social decisions: • accuracy: 88% vs 67% • p50 latency: 102 ms vs 278 ms • calibration error: 0.047 vs 0.170 (lower is better) this means agents will not only

lifesim-social-1 vs OpenAI Decisions:Jevモデルのベンチマーク video poster
· 8 likesOpen on X