LFM3-Omni-2B-MLX-bf16

BF16 MLX version of LFM3-Omni-2B for Apple Silicon. The weights take 4.33 GB, plus 0.15 GB for the audio codec in audio_tokenizer/.

Weights are stored in BF16, as in the original checkpoint.

Find architecture and usage details in the original model card.

Use with MLX-VLM


Support for LFM3-Omni in MLX-VLM is in progress. We will update this card when an MLX-VLM release supports it.

# Speech recognition
python -m mlx_vlm.generate --model LiquidAI/LFM3-Omni-2B-MLX-bf16 --temperature 0 \
  --system "Perform ASR in English." --prompt "" --audio speech.wav

# Text to speech (24 kHz WAV)
python -m mlx_vlm.generate --model LiquidAI/LFM3-Omni-2B-MLX-bf16 \
  --system "Perform TTS in American English using a female voice." \
  --prompt "The quick brown fox jumps over the lazy dog." \
  --output-modality audio --output tts.wav

# Image question
python -m mlx_vlm.generate --model LiquidAI/LFM3-Omni-2B-MLX-bf16 --temperature 0 \
  --system "Answer questions about the provided image. Base every answer only on what can be seen. Respond with text." \
  --image image.png --prompt "What does the sign say?"

Text answers use greedy decoding (--temperature 0). Speech output samples with audio_temperature=0.4 and audio_repetition_penalty=1.2 by default. The original model card lists the voices, languages and other system prompts. More options in the MLX guide.

Downloads last month
1,356
Safetensors
Model size
2B params
Tensor type
BF16
ยท
MLX
Hardware compatibility
Log In to add your hardware

Quantized

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for LiquidAI/LFM3-Omni-2B-MLX-bf16

Quantized
(20)
this model