Sajjad Pakdamansavoji's picture

Sajjad Pakdamansavoji

savoji
2

AI & ML interests

VLM, VLA, LLM, Robotics, Computer Vision

Recent Activity

posted an update about 10 hours ago
Open-weight Qwen3.8-Flash-Next hits a RoboDojo Score of 31.39 with no depth or task-verifier feedback, above GPT-6 Astra's published 28.97 and every listed VLA/WAM baseline. The lever is the harness. The same Qwen scores 1.90 with RoboProbe, 7.75 with RPent, 21.01 with GAP (Hybrid) and 31.39 with uni-robot-agent. Under that harness GPT-6 Astra reaches 51.90, so a gap to closed models remains. šŸ“Š The numbers • Qwen costs $1.09 per episode; Astra costs $21.29 • Best VLA/WAM baseline, Xiaomi-Robotics-1: 20.07 Score • Real robot, 19 tabletop tasks: Qwen 49.50, fine-tuned pi0.5 47.75, zero-shot Dream-1 35.50 • No depth keeps 87.5% of Qwen's score; RGB only without camera parameters drops it to 9.13 šŸ› ļø Try it • pip install uni-robot-agent, then uni-robot-agent setup --integration robodojo (MIT, Python 3.11, Linux GPU host) • Reusable ideas: immutable observation snapshots, duplicate-action rejection, pipelined execution (84.5% to 93.8% of motion overlaps model calls) āš ļø Caveats • Scores are low in absolute terms; Qwen needs 95.5 min to reach a score of 25, Astra 42.6 • The package has no physical-robot support yet; the real-world benchmark is in-house on one dual-arm platform https://huggingface.co/papers/2611.01560 https://github.com/Open-RUA/uni-robot-agent https://arxiv.org/abs/2611.01560 Before buying depth sensors or a frontier API, how much of your robot agent's gap is really the harness? šŸ“š Read it elsewhere • The deep dive on Medium: https://medium.com/p/51efcc243344 • The long read on Substack: https://sajjadpakdamansavoji.substack.com/p/open-qwen38-flash-next-beats-gpt • The thread on X: https://x.com/saavoji/status/2117670449111007255 • Every version on sajjadpsavoji.github.io: https://sajjadpsavoji.github.io/blog#qwen3-8-flash
repliedto their post about 13 hours ago
LFM3-1.7B from @LiquidAI is the #1 trending model on the Hub (855 likes). It takes about 1 GB at 4-bit, and in the vendor's own table it beats Qwen3.5 9B on several agent benchmarks. The edge decision moves from "are small models good enough?" to "which architecture and runtime do I pick?" One 1.7B backbone now ships as text, VL-2B and Omni-2B checkpoints with open weights. šŸ” Architecture and speed • 24 layers: 13 gated convolutions (kernel 7), 5 sliding-window attention (256 tokens), 6 global attention, chosen by a search over 14 device and backend targets • llama.cpp Q4_0 at 32K context: 1.8 to 2.8x faster decode than the next model on 3 devices • Full 128K context needs 1.6 GB of KV cache vs 4.3 GB (Qwen3.5-4B) and 5.6 GB (MiniCPM5-2B) šŸ“Š Liquid AI's table • Average 49.37 vs 47.24 for Qwen3.5 9B; BFCL V4 71.39 vs 62.83; WebArena-Verified 38.42 vs 28.94 • Qwen3.5 9B still wins SWE-bench Verified (51.20 vs 43.40) and GPQA Diamond (80.40 vs 63.37) šŸ› ļø Try it • GGUF (174,177 downloads last month) runs in llama.cpp b11960+, Ollama and LM Studio; MLX 4-bit for Apple Silicon; SGLang for GPUs • llama-cli -hf LiquidAI/LFM3-1.7B-GGUF:Q4_K_M --temp 0.1 --top-k 50 --repeat-penalty 1.1 • Omni-2B runs in the browser in the WebGPU Space āš ļø Caveats • The numbers are vendor-reported, with no independent reproduction in the sources. The card says it is not for agentic coding or complex multi-step reasoning. https://huggingface.co/LiquidAI/LFM3-1.7B https://huggingface.co/LiquidAI/LFM3-1.7B-GGUF https://huggingface.co/LiquidAI/LFM3-Omni-2B https://huggingface.co/spaces/LiquidAI/LFM3-Omni-2B-WebGPU Has a sub-2B model held up on your own tool-calling harness? • Medium: https://medium.com/p/05507e4e81c8 • Substack: https://sajjadpakdamansavoji.substack.com/p/liquid-ais-lfm3-turns-the-small-model • X: https://x.com/saavoji/status/2117307514177941672 • Website: https://sajjadpsavoji.github.io/blog#liquid-ais-lfm3
repliedto their post 1 day ago
LFM3-1.7B from @LiquidAI is the #1 trending model on the Hub (855 likes). It takes about 1 GB at 4-bit, and in the vendor's own table it beats Qwen3.5 9B on several agent benchmarks. The edge decision moves from "are small models good enough?" to "which architecture and runtime do I pick?" One 1.7B backbone now ships as text, VL-2B and Omni-2B checkpoints with open weights. šŸ” Architecture and speed • 24 layers: 13 gated convolutions (kernel 7), 5 sliding-window attention (256 tokens), 6 global attention, chosen by a search over 14 device and backend targets • llama.cpp Q4_0 at 32K context: 1.8 to 2.8x faster decode than the next model on 3 devices • Full 128K context needs 1.6 GB of KV cache vs 4.3 GB (Qwen3.5-4B) and 5.6 GB (MiniCPM5-2B) šŸ“Š Liquid AI's table • Average 49.37 vs 47.24 for Qwen3.5 9B; BFCL V4 71.39 vs 62.83; WebArena-Verified 38.42 vs 28.94 • Qwen3.5 9B still wins SWE-bench Verified (51.20 vs 43.40) and GPQA Diamond (80.40 vs 63.37) šŸ› ļø Try it • GGUF (174,177 downloads last month) runs in llama.cpp b11960+, Ollama and LM Studio; MLX 4-bit for Apple Silicon; SGLang for GPUs • llama-cli -hf LiquidAI/LFM3-1.7B-GGUF:Q4_K_M --temp 0.1 --top-k 50 --repeat-penalty 1.1 • Omni-2B runs in the browser in the WebGPU Space āš ļø Caveats • The numbers are vendor-reported, with no independent reproduction in the sources. The card says it is not for agentic coding or complex multi-step reasoning. https://huggingface.co/LiquidAI/LFM3-1.7B https://huggingface.co/LiquidAI/LFM3-1.7B-GGUF https://huggingface.co/LiquidAI/LFM3-Omni-2B https://huggingface.co/spaces/LiquidAI/LFM3-Omni-2B-WebGPU Has a sub-2B model held up on your own tool-calling harness? • Medium: https://medium.com/p/05507e4e81c8 • Substack: https://sajjadpakdamansavoji.substack.com/p/liquid-ais-lfm3-turns-the-small-model • X: https://x.com/saavoji/status/2117307514177941672 • Website: https://sajjadpsavoji.github.io/blog#liquid-ais-lfm3
View all activity

Organizations

None yet