Instructions to use KBlueLeaf/MOSS-Image-FP16-fixed with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use KBlueLeaf/MOSS-Image-FP16-fixed with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("KBlueLeaf/MOSS-Image-FP16-fixed", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- Draw Things
- DiffusionBee
INT8 Convrot
#1
by Talanca - opened
Is an INT8 Convrot version possible?
I would do the quantization myself, but my quant node doesn't have the MOSS profile to select the proper quantization.
uh, bruh, if you want to use int8 convrot it will just works isn't it? bcuz int8 convrot make matmul happen in int8, and activation natively sit in fp32?
fp16 fix ckpt is for fp16 fix usage somehow