AI & ML
JEV vs. LLMs: A Comparative Analysis for Phishing Email Detection
arXiv cs.CR0 views
arXiv:2611.23683v1 Announce Type: new Abstract: Phishing remains a major source of credential theft and fraudulent payments, and email security systems must classify large message volumes reliably, quickly, and at manageable cost. Large Language Models (LLMs) offer flexible text understanding, but their token-based generation increases response time and API cost, and the reliability of their confidence values requires measurement. Jev 1.13, a typed decision model from TypeSafe AI, instead returns a structured outcome with a confidence value. This paper compares Jev 1.13 with Gemini 3.5 Flash-Lite, NVIDIA Nemotron 3 Ultra, and Meta Llama 4 Maverick on a labelled dataset of 1500 emails, covering classification performance, decision latency, token consumption, API cost, and probability calibration. Jev achieves the highest accuracy (79.67%), precision (71.43%), recall (97.97%), and F1 score (82.62%). It also records the shortest batch time (173.88 seconds), the lowest token count (597,895), the lowest cost (USD 0.015103 per 1000 decisions), and the lowest Brier score (0.1698) and ECE (0.1594). These results suggest that Jev is a promising option for fast, structured, high-volume triage. LLMs retain the advantage of generating explanations, which we do not evaluate, and all four systems require further validation before standalone deployment.
Source:https://arxiv.org/abs/2611.23683PreviousFlowSH: Detecting Web Attacks by Correlating Anomalous Network Flows and Endpoint LogsNextData Poisoning Attacks to Locally Differentially Private Triangle Counting Protocols
Related posts

How many small business websites block AI crawlers?
0dev.to WebDev
Our health check said "db ok" for 40 minutes. It was talking to a cache.
0dev.to WebDev
Banco do Brasil: acesso indevido pode ter exposto CPF, e-mail e dados bancários
0dev.to Security

When the Attacker Has No Return Address
0dev.to Security
La nube te mantiene responsable de todos modos; lo local simplemente nunca comet
0dev.to Security
Interrupções em bancos e redes da NSA são ligadas a correções de falhas por IA
0dev.to Security