SaylorTwift HF Staff commited on
Commit
6d6c04a
·
verified ·
1 Parent(s): da10385

Add evaluation results

Browse files

# Add evaluation results for LiquidAI/LFM3-VL-2B

## Summary

This PR adds the benchmark results published on the model card for `LiquidAI/LFM3-VL-2B` to `.eval_results/`, following the [Hugging Face Hub evaluation-results specification](https://huggingface.co/docs/hub/eval-results).

## Benchmarks Added

- [MMMU-Pro (standard, 10 options)](https://huggingface.co/datasets/MMMU/MMMU_Pro?eval_result=LiquidAI/LFM3-VL-2B&leaderboard_task_id=mmmu_pro_standard_10_options) — 45.7
- [ScreenSpot-Pro](https://huggingface.co/datasets/likaixin/ScreenSpot-Pro?eval_result=LiquidAI/LFM3-VL-2B&leaderboard_task_id=overall) — 55.5

## Benchmarks Skipped (Not Registered on Hub)

These benchmarks are on the model card but have no registered `eval.yaml` on the Hub:

- The other 60 of the card's 62 vision benchmarks (MME, MMStar, DocVQA, ChartQA, MathVista, RefCOCO, ScreenSpot-v2, MVBench, ...)

They can be added once their authors register an `eval.yaml` on the Hub.

## Mapping notes

- Video-MME (62.8 without subtitles, 69.0 with): the card uses Video-MME v1, but the Hub registers Video-MME v2.
- Scores come from the reasoning-mode column; the no-thinking configuration is not added.

## Source

- Model card: https://huggingface.co/LiquidAI/LFM3-VL-2B
- Blog: https://www.liquid.ai/blog/lfm3

## Files Added

- `.eval_results/LFM3-VL-2B.yaml`

## Verification

The scores come from the benchmark tables on the model card, as measured by Liquid AI. No verified token is included, because these were not run via HF Jobs with inspect-ai.

---

**To upload:**

```bash
hf upload LiquidAI/LFM3-VL-2B .eval_results .eval_results --create-pr --commit-message "Add evaluation results"
```

Files changed (1) hide show
  1. .eval_results/LFM3-VL-2B.yaml +16 -0
.eval_results/LFM3-VL-2B.yaml ADDED
@@ -0,0 +1,16 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ - dataset:
2
+ id: MMMU/MMMU_Pro
3
+ task_id: mmmu_pro_standard_10_options
4
+ value: 45.7
5
+ date: "2026-10-27"
6
+ source:
7
+ url: https://huggingface.co/LiquidAI/LFM3-VL-2B
8
+ name: "LFM3-VL-2B model card"
9
+ - dataset:
10
+ id: likaixin/ScreenSpot-Pro
11
+ task_id: overall
12
+ value: 55.5
13
+ date: "2026-10-27"
14
+ source:
15
+ url: https://huggingface.co/LiquidAI/LFM3-VL-2B
16
+ name: "LFM3-VL-2B model card"