Back to explore

Jev Performance on CLERC Retrieval Benchmark

On a subset of CLERC queries, Laya without fine-tuning scored 2.5%, below BM25 (5%) and FastLate (10%); Jev reached 30%, Luna 22.5%, and with prompt tuning Luna gets 52.5–55%.

I ran it on a subset of CLERC queries (recovering a missing citation’s source). Laya, without fine-tuning, scored 2.5% top-1, below BM25 (5%) and FastLate (10%). Jev 30%, Luna 22.5% , with bit of prompt tuning Luna gets 52.5–55%,

Jev Performance on CLERC Retrieval Benchmark 1
· 0 likesOpen on X