Add safeagents judge bench results
#1
by ybelkada HF Staff - opened
Hi! This adds baselabs/joey-1's results on the safeagents judge bench, a benchmark of real agent tool calls that safeagents' scanner flags as suspicious, each labelled block or allow and with a kind of misuse (reward hacking, harness introspection, credential misuse, ...).
On the 562 test calls: balanced accuracy 0.502, AUROC 0.482, false-block rate 0.154, category macro F1 0.219. Run zero-shot, one System One request per call, on NVIDIA L4 (HF Jobs). Per-call verdicts are in the dataset's results/ folder.
The file is named after the benchmark, so it doesn't touch any existing .eval_results file.