TypeSafe AI Added to Citation Checker Tool
User added @typesafeai to their citation checker and praises it, free to try at PaperTrellis, tagged with Jev and AI in medicine. Link
Bias Issues of Jev-as-Judge in High-Stakes AI Evals
The user points out that Jev-as-Judge has severity and leniency biases that must be removed to be useful for high-stakes AI evaluations.
Have you noticed that Jev-as-Judge has severity and leniency bias that you have to remove to be useful for high stakes AI Evals?
· 0 likesOpen on X
More like this
JevBench: First Benchmark for Jev-Class Models Released
JevBench is the first benchmark for Jev-class models. Original Jev by TypeSafe AI leads at 75.3, with SemIf second at 74.6. Full results at benchmarkheaven.com/jev-models. Link
Jev Completes 100 Consecutive Trolley Problems
The post says someone entrusted their life to Jev and had it complete 100 consecutive trolley problems; in the first round, Jev chose to pull the lever with 99% probability, sacrificing 1 to save 5.
