Back to explore

lifesim-social-1 vs OpenAI Decisions: Jev Model Benchmark

Cris Lenta shares benchmark results: lifesim-social-1 achieves 88% accuracy, 102ms p50 latency, and 0.047 calibration error on social decisions, outperforming OpenAI Decisions API.

we beat OpenAI's Decisions API 24h after it launched it's Jev competitor lifesim-social-1 vs OpenAI Decisions on social decisions: • accuracy: 88% vs 67% • p50 latency: 102 ms vs 278 ms • calibration error: 0.047 vs 0.170 (lower is better) this means agents will not only

lifesim-social-1 vs OpenAI Decisions: Jev Model Benchmark video poster
· 8 likesOpen on X