Ornith-1.5-35B-A3B-Uncensored-OpenVINO-INT4
OpenVINO INT4 IR of an uncensored variant of ornith-ai/Ornith-1.5-35B-A3B.
The model was exported as a Qwen3.5 vision-language model and can also be used for text-only generation.
Evaluation
| Format | Size | JailbreakBench ASR | HarmBench ASR (159 standard behaviors) |
|---|---|---|---|
| OpenVINO INT4 | 17.69 GiB | 93/100 (93.0%) | 153/159 (96.2%) |
Higher ASR indicates fewer refusals on these benchmarks. HarmBench behaviors were submitted as
direct requests. Evaluation used reasoning off, temperature 0, seed 42, a 256-token output limit,
and the HarmBench-Llama-2-13b-cls classifier. Results can vary with runtime, prompt format,
sampling, and context.
Requirements
- OpenVINO 2026.3.x
- OpenVINO GenAI 2026.3.x
Usage
import openvino_genai as ov_genai
pipe = ov_genai.VLMPipeline("/path/to/model", "GPU")
result = pipe.generate("日本語で短く自己紹介して。", max_new_tokens=128)
print(result.texts[0])
Use VLMPipeline, not LLMPipeline.
Validation
The IR passed structural loading and text-only CPU generation with OpenVINO GenAI 2026.3.1.
License
MIT. See LICENSE, NOTICE, and the original model for upstream information.
- Downloads last month
- -
Model tree for vonvonhero/Ornith-1.5-35B-A3B-Uncensored-OpenVINO-INT4
Base model
ornith-ai/Ornith-1.5-35B-A3B