Back to explore

Jev Model Benchmarked on Phishing Email Subject Lines

Jev (jev-1.13.0), Clef, and Clef-flash were tested on phishing detection using only email subject lines (60 scam subjects vs. 79 official site titles). Direct questioning was ineffective; combining feature-based responses yielded AUC 0.90–0.93, but 15–25% were missed. Genuine emails were not tested.

詐欺メールの件名だけで AI は見分けられるか。Jev(jev-1.13.0)・Clef・Clef-flash に件名のみを入力し、詐欺の件名60件と公式サイトの題名79件で実測。直接「詐欺か」と聞くのは不向き。特徴を聞いて合算すると AUC 0.90〜0.93、ただし15〜25%は見逃す。本物のメールは未検証。

Jev Model Benchmarked on Phishing Email Subject Lines video poster
· 0 likesOpen on X